WO2022078184A1 - 一种教学直播方法及显示设备 - Google Patents

一种教学直播方法及显示设备 Download PDF

Info

Publication number
WO2022078184A1
WO2022078184A1 PCT/CN2021/120219 CN2021120219W WO2022078184A1 WO 2022078184 A1 WO2022078184 A1 WO 2022078184A1 CN 2021120219 W CN2021120219 W CN 2021120219W WO 2022078184 A1 WO2022078184 A1 WO 2022078184A1
Authority
WO
WIPO (PCT)
Prior art keywords
handwriting input
student
input function
display device
live
Prior art date
Application number
PCT/CN2021/120219
Other languages
English (en)
French (fr)
Inventor
谢尧
栗军涛
赖园园
董鹏
王光强
张宁
吴昱恒
李英杰
Original Assignee
聚好看科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202011437934.3A external-priority patent/CN112653897B/zh
Priority claimed from CN202110003691.0A external-priority patent/CN112788361B/zh
Application filed by 聚好看科技股份有限公司 filed Critical 聚好看科技股份有限公司
Priority to CN202180068411.2A priority Critical patent/CN116349230A/zh
Publication of WO2022078184A1 publication Critical patent/WO2022078184A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/08Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application

Definitions

  • the present application relates to the technical field of display devices, and in particular, to a teaching live broadcast method and display device.
  • Distance education refers to a teaching mode that relies on computer, television, Internet and other media. It breaks through the boundaries of time and space and enables students to take classes in different places. Among them, live education is a teaching form that is gradually emerging in distance education. Live education refers to a teaching mode that enables students in different places to go online at the same time and interact with teachers through live broadcast within a specific time. . Compared with other distance education models, the biggest advantage of live education is that it can increase the interaction between teachers and students and improve students' enthusiasm for learning.
  • the existing teaching live broadcast system is made up of multiple softwares, each software realizes a function, for example, one software is used for enrollment, one software is used for teaching, and one software is used for exams.
  • the software is disconnected from each other.
  • the data is not shared in real time, and it needs to be manually imported every time it is used, which is relatively cumbersome; and the existing teaching live broadcast system is usually applied to the mobile terminal, but not the TV terminal.
  • the present application provides a display device, including:
  • a display configured to present the first live broadcast interface
  • controller connected to the display, the controller configured to:
  • the handwriting input function control is displayed in the first live broadcast interface
  • the handwriting input function control is not displayed in the first live broadcast interface.
  • the present application also provides a display device, including:
  • a display configured to present the second live broadcast interface
  • controller connected to the display, the controller configured to:
  • the handwriting input function query result refers to the result of the student terminal display device requesting the server to inquire whether the local terminal is configured with the handwriting input function
  • the first operation item corresponding to each student-side display device with the handwriting input function is displayed on the second live broadcast interface.
  • a second operation item corresponding to each student display device without the handwriting input function is displayed on the second live broadcast interface, and the second operation entry is displayed on the second live broadcast interface.
  • the entry includes a second authority control button that does not have the control authority of the handwriting input function corresponding to the display device on the student side.
  • the present application also provides a teaching live broadcast method, which is applied to a student-side display device, and the method includes:
  • the handwriting input function control is displayed in the first live broadcast interface
  • the handwriting input function control is not displayed in the first live broadcast interface.
  • the present application also provides a teaching live broadcast method, which is applied to a teacher-side display device, and the method includes:
  • the handwriting input function query result refers to the result of the student terminal display device requesting the server to inquire whether the local terminal is configured with the handwriting input function
  • the first operation item corresponding to each student-side display device with the handwriting input function is displayed on the second live broadcast interface.
  • a second operation item corresponding to each student display device without the handwriting input function is displayed on the second live broadcast interface, and the second operation entry is displayed on the second live broadcast interface.
  • the entry includes a second authority control button that does not have the control authority of the handwriting input function corresponding to the display device on the student side.
  • the present application further provides a storage medium, the computer storage medium can store a program, and when the program is executed, it can implement some or all of the steps in the various embodiments of the teaching live broadcast method provided by the present application.
  • FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device in some embodiments of the present application
  • FIG. 2 is a schematic diagram of a page for accessing an application in some embodiments of the present application.
  • FIG. 3 is a schematic diagram of a user interface of a display device for online live courses in some embodiments of the present application
  • FIG. 4 is a schematic diagram of a user interface of a display device for online live courses in some embodiments of the present application
  • FIG. 5 is a schematic diagram of the interactive time sequence of the online live course of the display device and the server in some embodiments of the present application;
  • FIG. 6 is a schematic diagram of the interaction sequence of the display device and the server implementing the online live course control in some embodiments of the present application;
  • FIG. 7 is a schematic page diagram of team management in some embodiments of the present application.
  • FIG. 8 is a schematic page diagram of mode management in some embodiments of the present application.
  • FIG. 9 is a schematic page diagram of a three-split screen live class in some embodiments of the present application.
  • FIG. 10 is a schematic page diagram of a three-split screen live class in some embodiments of the present application.
  • 11 is a schematic page diagram of the home page of the student terminal in some embodiments of the present application.
  • FIG. 12 is a schematic diagram of a page of a student listening to a lecture in some embodiments of the present application.
  • FIG. 13 is a schematic page diagram of students practicing in class in some embodiments of the present application.
  • FIG. 14 is a schematic diagram of a first live broadcast interface in some embodiments of the present application.
  • 15 is a schematic diagram of a course content area in a live broadcast interface when using handwriting input to scribble in some embodiments of the present application;
  • 16 is an interactive schematic diagram of automatically displaying the handwriting input function in the teaching live broadcast in some embodiments of the present application.
  • 17 is a flow chart of automatically displaying the handwriting input function in the teaching live broadcast in some embodiments of the present application.
  • FIG. 19 is a schematic diagram of a first live broadcast interface showing handwriting input function controls in some embodiments of the present application.
  • FIG. 20 is another flowchart of automatic display of handwriting input function in teaching live broadcast in some embodiments of the present application.
  • 21 is a schematic diagram of a list of students in the second live broadcast interface in some embodiments of the present application.
  • FIG. 22 is a schematic diagram of the interface of the teacher terminal using the handwriting input function to scribble in some embodiments of the present application;
  • FIG. 23 is another flow chart of automatically displaying the handwriting input function in the teaching live broadcast in some embodiments of the present application.
  • 24 is a schematic diagram of a user interface during live broadcast in some embodiments of the present application.
  • FIG. 25 is a flowchart of a method for displaying a message in some embodiments of the present application.
  • FIG. 26 is a sequence diagram of a method for displaying a message in some embodiments of the present application.
  • 27 is a schematic diagram of list paging in some embodiments of the present application.
  • 29 is a schematic diagram of displaying a message list on a user interface in some embodiments of the present application.
  • FIG. 30 is a schematic diagram of an interface when a new message is sent abnormally in some embodiments of the present application.
  • 31 is a schematic diagram of displaying a new message in a message list in some embodiments of the present application.
  • 32 is a schematic interface diagram showing a new message reminder interface in a message list in some embodiments of the present application.
  • 33 is a schematic diagram of an interface showing a loading status prompt box in a message list in some embodiments of the present application.
  • 34 is a business flow diagram of a method for displaying a message in some embodiments of the present application.
  • 35 is a schematic diagram of an application scenario of a live class in some embodiments of the present application.
  • 36 is a flowchart of a method for recording a live class in some embodiments of the present application.
  • FIG. 38 is a schematic display diagram of a teacher-side live class interface in some embodiments of the present application.
  • FIG. 39 is a schematic display diagram of a student-side live class interface in some embodiments of the present application.
  • 40 is a schematic diagram of recording a live class in some embodiments of the present application.
  • 41 is a schematic diagram of an interface for practicing with the class in some embodiments of the present application.
  • FIG. 42 is a schematic diagram of an interface for presenting teacher interaction data on a student-side display device in some embodiments of the present application.
  • FIG. 43 is a schematic display diagram of a student-side live class display interface in some embodiments of the present application.
  • Figure 44 is a comparison table of student interaction data in some embodiments of the present application.
  • 45 is a flowchart of a method for reviewing a live class in some embodiments of the present application.
  • 46 is an interactive flowchart of a method for reviewing a live class in some embodiments of the present application.
  • Figure 47 is a schematic diagram of a live class review interface in some embodiments of the present application.
  • FIG. 49 is a schematic diagram of displaying interactive data on the student terminal in some embodiments of the present application.
  • FIG. 50 is a schematic display diagram of an interactive interface generated during review in some embodiments of the present application.
  • FIG. 51 is a schematic display diagram of students performing real-time interaction based on an interactive interface during review in some embodiments of the present application.
  • FIG. 52 is another flowchart of a method for reviewing a live class in some embodiments of the present application.
  • FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus in some embodiments of the present application. As shown in FIG. 1 , a user may operate the display apparatus 200 through the mobile terminal 300 and the control apparatus 100 .
  • control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, etc., and controls the display device 200 by wireless or other wired methods.
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like.
  • the user can control the display device 200 by inputting corresponding control commands through the volume up/down key, channel control key, up/down/left/right movement keys, voice input key, menu key, power-on/off key, etc. on the remote control. function.
  • mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 .
  • the display device 200 is controlled using an application running on the smart device.
  • the app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.
  • UI intuitive user interface
  • the mobile terminal 300 can also be used as a display device.
  • the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication.
  • a control command protocol can be established between the mobile terminal 300 and the display device 200
  • the remote control keyboard can be synchronized to the mobile terminal 300
  • the function of controlling the display device 200 can be realized by controlling the user interface on the mobile terminal 300.
  • the audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to implement a synchronous display function.
  • the display device 200 also performs data communication with the server 400 through various communication methods.
  • the display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks.
  • the server 400 may provide various contents and interactions to the display device 200 .
  • the application installed in the display device that provides online courses may be a "juwei school” application.
  • the corresponding login or registration page can be presented according to different users.
  • the user avatar included in the account information is the default avatar.
  • the default avatar can be displayed by intercepting the user name. For example, the first two characters of the user name can be intercepted and displayed from left to right. If the third one is a Chinese character, display the last 1 character on the APP side or 2 characters on the web side; if the third one is not a Chinese character, display the first two characters or the second character; if the user name is an English name, take The first letter is displayed. For example, if the user name is Jerry, J will be displayed; if the user name is a special character, it will not be displayed, but the default avatar provided by the system will be displayed. Users can also change the avatar according to their own preferences.
  • FIG. 2 is a schematic diagram of a page for accessing an application in some embodiments of the present application.
  • the application interface displays the "Juwei School” home page by default.
  • the home page supports a carousel within 5 pictures, which is used to introduce the related functions of "Juwei School".
  • the carousel is automatically rotated and played. If only one carousel is displayed, the carousel status will not be displayed.
  • the live class needs to include a teacher-side display device, a student-side display device and a server.
  • the teacher-side display device provided in this application includes a display and a first controller.
  • the first controller is configured to: send a course creation instruction including course information to the server, wherein the course creation instruction is used to make the server add the course corresponding to the course information to the live course list, the The course information includes the start time of the course, and the live course list is used to enable the server to create a first live room for the first course about to start a class within a preset duration according to the start time of the course, and generate a live room creation Completed message; do not create a live room for a second class that does not start for a preset duration.
  • the course information further includes one or a combination of course name, end time, student list, and class mode.
  • the teacher sends a course creation instruction to the server, where the course creation instruction includes course information of the first course, the second course, the third course, and the fourth course.
  • course information of the first course may include: start time is 18:00, end time is 18:30, student list 1, and class mode is public;
  • the start time of the second course is 19:00, the end time is 19:30, the student list is 2, and the class mode is public;
  • the start time of the third course is 20:00, the end time is 20:30, the student list is 3, and the class mode is public;
  • the start time of the fourth course is 21:00; the end time is 21:30, the student list 4, and the class mode is public.
  • the course creation instruction can cause the server to identify a first course that is about to start a class within a preset duration according to the start time of the course information, and create a first live broadcast room for the first course for use in an online live broadcast course, And generate a message that the live room has been created, so that the student-side display device and the teacher's segment display device can instantly get the information about the successful preparation of the corresponding course.
  • the present application further provides a server, including a second controller, configured to: regularly scan a list of live courses, wherein the list of live courses is based on the received courses by the second controller.
  • the course information in the creation instruction is generated, and the course information includes the start time of the course.
  • the second controller of the server After receiving the course creation instruction sent by the above-mentioned first controller, the second controller of the server adds the corresponding course to the live course list according to the start time of the corresponding course information and other course information; it can be understood that, The start time in the course information is necessary information for the live course listing.
  • the second controller regularly scans the above-mentioned list of live courses with different course start times, and automatically prepares courses in advance for courses that meet the preparation conditions, such as establishing a dedicated live room, chat room, and pushing course preparation status information to the display device, etc.
  • the second controller when the scanned course is a first course about to start within a preset duration, creates a first live room for the first course according to the course information and generates a live room Create finished message.
  • the second controller of the server scans the list of live courses to which multiple courses have been added in the background at the frequency of scanning once every 30 minutes, and finds a course with time after, eg, 15 minutes, as the first course.
  • the second controller After confirming the qualified first course, the second controller creates a dedicated first live room for the first course; if the first live room is successfully created, the second controller will generate a message that the live room has been created .
  • the second controller generates a message that the creation of the live broadcast room is completed, and specifically includes the second controller: after creating the first live broadcast room, marking the first course in the live broadcast course list as In-progress state, the in-progress state can be acquired by the display device when querying the live course list remotely.
  • the second controller marks the first course as an ongoing state in the live broadcast course list; wherein, the status of each course in the live broadcast course list can be displayed on the display device through a remote Acquired during round-robin queries.
  • the second controller is further configured to: send the message that the live room is created to the display device, and the live room is The created message is used to cause the user interface of the display device to display an entry control including entering the first live room.
  • the second controller After creating the first live room, the second controller records relevant data of the first live room into the first course of the live course list.
  • the relevant data may include, for example, the code of the first live room.
  • the corresponding live room can be entered according to the encoding of the first live room; the second controller sends a message of the completion of the creation of the live room including the encoding of the first live room to the display device, and the message of the completion of the creation of the live room is used to enable all the live rooms to be created.
  • the user interface display of the display device includes an entry control for entering the first live room.
  • the corresponding first controller of the display device displays, on the user interface, an entry control for entering the first live room after acquiring the message that the live room is created, including the first controller: After receiving the message sent by the server that the creation of the live room is complete, display on the user interface an entry control that includes entering the first live room; or send an instruction for querying the creation status of the live room at preset time intervals, and in the query After the creation of the first live broadcast room is completed, the control user interface display includes an entry control for entering the first live broadcast room.
  • the second controller does not create a live room for the second course and continues to scan the list of live courses when the scanned course is the second course that does not start the course within the preset duration.
  • the server does not perform course preparation operations such as creating a live room for courses that do not meet the course preparation conditions.
  • FIG. 3 is a schematic diagram of a user interface of a display device for online live courses in some embodiments of the present application.
  • the figure shows the user interface of the online live course on the display device of the teacher.
  • the live course list includes 4 courses, namely the first course, the second course, the third course, and the fourth course .
  • the start time of the first course is 18:00
  • the start time of the second course is 19:00
  • the start time of the third course is 20:00
  • the start time of the fourth course is 21:00; the above four courses are displayed as Not Started.
  • the second controller of the server periodically scans the list of live courses, and when the scanned course is the first course about to start within a preset duration, creates a first course for the first course according to the course information.
  • a live room including the second controller: regularly scan the list of live courses at a first time interval; when the start time of the scanned course is within a preset duration range based on the current time, determine that the scanned course is is a first course; a first live room is created for the first course according to the course information of the first course.
  • the second controller of the server repeatedly scans the established live course list in the background database at the first time interval of 15 minutes, and takes the start time in the online live course list as the target, and the query filters out
  • the second time interval is implemented as a course that starts after 30 minutes. It can be found in the user interface shown in Figure 3 that at 15:00, there is no live course that needs to be automatically created. After that, the second controller will scan the live course list again at 15:15, 15:30, 15:45, 16:00, etc. at an interval of 15 minutes.
  • FIG. 4 is a schematic diagram of a user interface of an online live course on a display device of a teacher in some embodiments of the present application.
  • the first controller of the display device has scanned the list of live courses at 15:30 and successfully obtained the first course that needs to be created in the first live room; After success, the identifier of the first course in the list of live courses in the user interface is displayed as in-progress, as shown in the figure.
  • the second controller continues to process other courses in the live broadcast course list cyclically at a first time interval, so that the class is about to start within a preset time period. of the second course to create a second live room.
  • the live course list is further configured to enable the server to create a first chat room for a first course about to start within a preset duration according to the start time of the course, and to generate a message that the chat room has been created , the first chat room is coupled to the first live broadcast room.
  • the first controller of the display device sends a course creation instruction including course information to the server, where the course creation instruction is used to cause the server to add the course corresponding to the course information to the live course list;
  • the second controller of the server creates a first chat room for the first course according to the course information and generates a chat room creation completion message, wherein the first chat room can be coupled to the first live room.
  • the second controller of the server calls the interactive chat room server to create a first chat room for the first course according to the course information of the first course; after the first chat room is successfully created, the chat room service interface returns to the first chat room coding; the second controller updates and stores the coding update of the first chat room into the corresponding first course in the live course list.
  • the second controller of the server also takes the course name as the name of the first live room according to the course information of the first course; the start time and the end time are used as the usage time interval of the first live room;
  • the live room service interface will return the newly created first live room code, and the second controller updates and stores the first live room code to the corresponding live course list in the database. in the first course.
  • the server second controller creates a first chat room and a first live room for the first course according to the course information, the first chat room is coupled to the first live room; in After the first chat room and the first live room are successfully created, a message including the first live room code, the first chat room code, and the message that the chat room is created is sent to the display device.
  • the second controller After the server completes the creation of the first live room and the first chat room, the second controller sends feedback information including the code of the first live room and the code of the first chat room to the display device.
  • the second controller of the server detects whether the code of the first chat room and the code of the first live broadcast room are empty; if both are empty, it means that both the first chat room and the first live broadcast room are successfully created.
  • the first controller displays an entry control for entering the first live room on the user interface; after acquiring the confirmation operation for the entry control , controlling the user interface to display the live broadcast user interface of the first live broadcast room, wherein the live broadcast user interface is provided with a local window for displaying local video data and a peer window for displaying peer video data.
  • the first course is in a ready state.
  • the teacher can enter in advance to interact with the students before the class, or wait until the official start of the course to enter the first live broadcast room. If the teacher is not ready, the first chat room can notify the students to delay the start.
  • the live user interface includes a local window and a peer window.
  • the local window is used to display local video data
  • the peer window is used to display peer video data.
  • the second controller does not modify the state of the first course in the live course list, and scans the live course list again to reprocess the course.
  • FIG. 5 is a schematic diagram of the interaction sequence of the online live broadcast course of the teacher-side display device, the student-side display device, and the server in some embodiments of the present application.
  • the teacher creates a new live course through the online live course management interface of the teacher terminal display device, including configuring the course name, start time, end time, student list, class mode and other parameters, and calling the business service live course save interface;
  • the live class save interface verifies the validity of parameters, including the length of the course name, whether the course name contains sensitive content, whether the start time and end time meet the requirements, and save the live course data to the database (DB) after the verification is passed;
  • the background task periodically scans the list of live courses in the database in the background, and based on the start time of the course, queries the live course that is about to start within the preset duration, that is, the first course, and processes other courses in the list of live courses in a loop;
  • the background task obtains the course name of the first course, the number of students in the course and other parameters, and requests the chat room service to create the first chat room; after the creation is successful, the chat room service interface returns the code of the newly created first chat room, and saves the code update to the database in the first course in;
  • the background task obtains the course name of the first course as the name of the first live room; the start time and end time are used as the usage time interval of the first live room, and requests the live room service to create the first live room; after the creation is successful, the live room service interface Return to the newly created first live room code, and save the first live room code update to the first course in the database;
  • the background task checks whether the first chat room code and the first live room code of the first course are empty. If they are not empty, it means that both are successfully created. Then change the first course status to in progress.
  • the student terminal displays the device requesting the business service to query the list of live courses belonging to the student, and the entry status is the live broadcast course in progress; at this time, the student terminal will carry the ID of the first live broadcast course, call the course details interface of the business service, and obtain the course from the business service. Details, including course name, start time, end time, course material list, first chat room code and first live room code, etc.;
  • the student terminal parses the first chat room code from the course details, calls the chat room service interface, and enters the corresponding first chat room. Students who have entered the chat room can interact and chat;
  • the student terminal parses the code of the first live room from the course details, calls the service interface of the live room, and enters the first live room.
  • the live room does not display the picture;
  • the teacher After the official start of the first course, the teacher enters the live course, obtains the code of the first chat room and the first live room from the details of the live course, and enters the first chat room and the first live room respectively as an administrator to start the class, and Manage the first chat room and the first live broadcast room, including prohibiting everyone from chatting, assigning a certain person to speak, connecting to a student's microphone, etc.;
  • FIG. 6 is a schematic diagram of the interaction sequence of the display device and the server on the teacher's side to realize the online live course control in some embodiments of the present application.
  • step S1001 the first controller of the display device on the teacher side sends a course creation instruction including course information to the server, and the course information also includes one or more combinations of course name, end time, student list, and class mode .
  • step S1002 the second controller of the server adds the corresponding course to the live course list. After receiving the course creation instruction sent by the first controller, the second controller of the server adds the corresponding course to the live course list according to the start time of the corresponding course information and other course information.
  • step S1003 the second controller of the server regularly scans the list of live courses at a first time interval.
  • the second controller scans the list of live courses to which multiple courses have been added in the background at the frequency of scanning once every 30 minutes, and finds out a course with time after, for example, 15 minutes, as the first course.
  • step S1004 the second controller of the server determines that the scanned course is the first course when the start time of the scanned course is within a preset duration range based on the current time.
  • the course scanned and acquired by the second controller is the first course to be taught within the preset time period.
  • step S1005 the second controller creates a first live room for the first course according to the course information. After confirming the qualified first course, the second controller creates a dedicated first live room for the first course; if the first live room is successfully created, the second controller will generate a message that the live room has been created .
  • step S1006 the second controller identifies the first course in the live course list as an in-progress state, and the in-progress state can be acquired by the display device when remotely querying the live course list.
  • step S1007 the user of the display device on the teacher side performs a confirmation operation on the first course whose status is in progress in the live course list.
  • the first controller displays an entry control for entering the first live broadcast room on the user interface.
  • step S1008 the first controller controls the user interface to display the user interface of the first live room.
  • the first controller controls the user interface to display the live broadcast user interface of the first live broadcast room, wherein the live broadcast user interface is provided with a local interface for displaying local video data. Window and the peer window for displaying the peer video data.
  • the present application also provides a control method for online live courses applied to display devices, the method comprising: sending a course creation instruction including course information to a server, The course creation instruction is used to make the server add a course corresponding to the course information to a live course list, where the course information includes the start time of the course, and the live course list is used to make the server According to the start time of the course, create the first live room for the first course that is about to start within the preset time, and generate a message that the live room is created; do not create a live room for the second course that does not start within the preset time.
  • the present application also provides a control method for online live courses applied to the server, the method comprising: regularly scanning the live broadcast course list, wherein the live broadcast course list It is generated according to the course information in the received course creation instruction, and the course information includes the start time of the course; when the scanned course is the first course about to start the course within the preset duration, according to the course information Create a first live room for the first course and generate a message that the live room has been created; when the scanned course is a second course that does not start classes within a preset time period, do not create a live room for the second course to continue scanning the list of live classes.
  • the specific operation method and steps of the control scheme for the online live broadcast of the course on the server have been described in detail in the implementation scheme of the display device above, and will not be repeated here.
  • generating the message that the creation of the live broadcast room is completed includes: after the first live broadcast room is created, marking the first course in the live broadcast course list as an in-progress state, and the in-progress state can be described by the The display device obtains when remotely querying the list of live courses; and after generating a message that the live room is created, the method further includes: sending a message that the live room is created to the display device, and the live room creates The completed message is used to cause the user interface of the display device to display an entry control including entering the first live room.
  • the specific operation method and steps of the control scheme for the online live broadcast of the course on the server have been described in detail in the implementation scheme of the display device above, and will not be repeated here.
  • the teacher-side display device can also manage the course by selecting the course. For example, by selecting the course corresponding to the list in FIG. 3 or FIG. 4, the team management shown in FIG. 7 can be performed. , or the class mode settings as shown in Figure 8.
  • FIG. 7 is a schematic page diagram of team management in some embodiments of the present application.
  • the teacher can modify the team. After the live class starts, you cannot add or modify teams, and the corresponding team options are grayed out.
  • the teacher can select two team names from the candidate team names as the team names for this live class. For example, after selecting "Panda Team” and “Dinosaur Team”, select “Confirm Selection” to create two teams, and the students will be equally distributed among them. Two teams; if you select "Do not set a team", the default state will be restored; if the number of teams selected by the teacher is not two, a prompt "Please select two teams” will pop up.
  • Each PK team adopts the method of one lesson and one assignment, that is, each time it is temporarily formed, during the application process, the teacher can also assign the right of a long-term group (team).
  • the same student repeatedly enters and leaves the same live class, the grouping remains unchanged, and the points continue.
  • Each new user who enters the live broadcast room is assigned to a team with a smaller number of people. If the number of users is the same, it will be randomly assigned.
  • the way for the team to get points is that each student gets 1 point for every 5 minutes of online time, and no points for less than 5 minutes; the time less than 5 minutes before the student exits, the time can be accumulated after entering the live room again.
  • FIG. 8 is a schematic page diagram of mode management in some embodiments of the present application.
  • teachers can choose a class mode, including three-screen class mode and multi-channel video class mode. Among them, the three-screen class mode is selected by default. Click "Confirm Selection" to enter the live room.
  • the display device includes a display and a controller, the display is used for presenting a live teaching interface, and the controller is used for realizing the teaching live according to the relevant operations of the live broadcast.
  • the program of the live class can be the "Juwei School" program.
  • the live class program includes a second program and a first program.
  • the second program is a program configured on the display device on the teacher's side. When the second program is started, the second live broadcast interface is displayed on the display; the first program is on the display device on the student side.
  • the configured program displays the first live broadcast interface on the display when the first program is started.
  • the schematic diagram of the second live broadcast interface shown in FIG. 9 is entered.
  • the teacher can enter the live room when it arrives at the class time.
  • the second live broadcast interface displays the course content area, the student video area, the teacher video area, the main function area and the live broadcast information display area, which can realize three-screen teaching.
  • the student video area is used to display student images
  • the teacher video area is used to display teacher images.
  • the student images and teacher images are captured by a camera (such as the image collector in FIG. 3 ) configured by the display device used by them.
  • the course content area displays the live screen, and the lower part of the course content area displays the main functional area, which is used to switch functions such as handouts, whiteboards, and videos.
  • the lower part of the main functional area displays the live broadcast operation buttons and the competition of the teams.
  • the live broadcast operation buttons include handwriting input functions (the button text is "brush"), start the live broadcast (switch to pause the live broadcast after it is turned on), end the live broadcast, etc. controls.
  • the teacher in order to improve the effect of the class, can divide the students of the class into two teams before the live broadcast, and accumulate points by answering questions during the class. After the class ends, which team has the highest score, The students of the team will receive corresponding rewards.
  • the team competition situation displays the points of the two teams in real time.
  • the live broadcast operation button is used to start live broadcast, pause live broadcast and end live broadcast. After clicking to start the live broadcast, send the live stream signal to the students, the handout area and discussion area are available, and start recording and playback at the same time. When the live broadcast is paused, the handout area is reserved, the teacher has no audio and video signals, and the live broadcast playback of the paused live broadcast device will not be recorded.
  • the handwriting input function control displayed on the second live broadcast interface is used for simulating a real class scene on the teacher's end, so as to arrange homework on the blackboard or mark the content of a written course, the handwriting input can be used to realize the live broadcast.
  • the handwriting input function control in the live broadcast operation button can be triggered by a touch method such as a stylus pen or finger on the teacher's end, such as the "brush" control in Figure 9, to manually touch the display.
  • Interactive operations such as scribing, writing, and drawing are performed on the handout displayed on the monitor
  • the display interface of the three-split screen live class shows the topic name of the live class, the broadcast time of the class, the pause time, the teacher's avatar and name and other live broadcast information.
  • the teacher is clicking the "brush", which supports the use of handouts and whiteboards, and can be synchronized to all students.
  • the stroke thickness of the brush can be adjusted, and functions such as recalling the previous brush, deleting all brushes, and adjusting the brush color can be performed.
  • the teacher can create real-time questions for in-class practice, and students answer the questions in the in-class practice area. After each student has answered the question, the selection rate and answer time of each choice can be displayed, and the number of correct answers, the number of hits and the online users.
  • the number of people online refers to the number of online answerers at the moment when the question is clicked.
  • the display order of each question is the order in which the classroom test is managed.
  • the teacher can provide time for each student to discuss. The teacher can select any student or all students in the discussion area to send a message to ask questions. When selecting students, they can choose from the drop-down list, or directly input Student name to select. Teachers can clear their own discussion area, which cannot be restored; after clicking "Mute", students in the discussion area cannot leave a message (the teacher can still leave a message), and click "Unblock" to resume the message.
  • the process of connecting to the microphone includes the student raising or not raising his hand, the teacher turning on the student's camera and microphone, the student raising his hand and putting it down, and the student video area on stage. Can see and hear.
  • connecting to the microphone connect the microphone only when the functional area is for handouts and whiteboards.
  • the view connection to the microphone prompts "temporarily unavailable”.
  • only one student and teacher can connect to the microphone.
  • the video area is the design size.
  • the teacher can drag the student image to any position in the functional area to avoid blocking the content of the handout, and the video area on the student side moves synchronously.
  • the terminal used by the student terminal of Lianmai needs to be equipped with a camera and a microphone.
  • the ribbon can display tabs such as whiteboard, handouts (imported attachments) and videos, and can drag and drop the tab order. Except for the whiteboard, the name of each tab can be modified by double-clicking the other tabs; the first tab is displayed by default in the course content Content. When the function area is video, you can click the video area to pause or resume playback, or you can drag the progress bar to select the progress. When the ribbon is handout (PPT or PDF), the control buttons are displayed in the lower right corner. The handout can be scrolled in response to the mouse to turn pages up and down, and the keyboard can be turned up and down; it can also support the pen to mark on the PPT.
  • PPT handout
  • Teachers can use the "Online” button provided in the live broadcast room to check the number of online users in the current live broadcast room. Click the “Online” button to display all the students in the class of this section, the online number includes the total number of students and teachers.
  • the left side of each student's name displays the device type, that is, the terminal used by the student to participate in the live class, such as TV, PAD, etc.
  • On the right side of each student's name are raised hand, microphone, like and brush controls. Any one of the four controls is red to indicate that the function is enabled, and if it is gray, it means that the function is disabled.
  • the camera and microphone devices are controlled by a single microphone button. If the button is red, it means that the microphone is connected. When the button is gray, it means that the device is supported but not connected. When it has a slash, it means that there is no microphone or no camera device. During Lianmai, only one student can get video or Lianmai, and it is the same student. If the brush button is red, it means that you have the brush permission, left-click to authorize the brush; if it is gray, it means that you have no brush permission.
  • FIG. 10 is a schematic page diagram of another three-split screen live class in some embodiments of the present application.
  • live classes can also support multi-channel video classes, which are more suitable for 1-to-1 to 1-to-7 small class teaching scenarios (up to 8 channels of video).
  • the teacher's video is in the first place by default, the video area is slightly larger, and the student's own video is in the second place by default. The rest of the students' videos are displayed in the order they entered the live room. Long time, carousel.
  • everyone's video and microphone are turned off; after the live broadcast, everyone's video is turned on by default, the student's microphone is turned off by default, and the teacher's microphone is turned on by default.
  • linking microphones only one student can perform linking microphones, and the video and linking microphones need to be the same person.
  • the teacher can right-click on a student image to bring up the shortcut menu, left-click in the shortcut menu, and perform the corresponding operations (send likes, end the continuous microphone, grant the brush), and the interface disappears.
  • clicking "Send Like” means clicking to give a like to the student, and the pop-up layer disappears after sending; clicking "End Continuing Mic" will end the contiguous microphone, the student will return to their seat, and the pop-up layer will disappear; clicking "Grant Brush” will be used by students Brush permissions, the bullet layer disappears.
  • the teacher Before connecting to the microphone, the teacher can right-click on a student image to bring up the shortcut menu, and left-click in the shortcut menu to perform the corresponding operations (send likes, go to the stage and connect to the microphone, put down and raise your hand, and recycle the brush) After that, the interface disappears.
  • the "raise hand” sign is red to indicate that the student has raised his hand, which can be used for Small hand icon; a "raised hand” sign in white indicates that the student did not raise a hand.
  • the student video area also displays the student's name and the number of points. Click to give the student a like; it shows whether the microphone is on, click the microphone, and click again to disconnect the microphone.
  • the teacher side can also close the handout area and restore the handout area. After closing the handout area, the teacher's video is enlarged to the functional area for display. Teachers can also close all student videos and restore all student videos, as well as conduct in-class practice and discussion areas. These two parts can refer to the three-screen class content, and will not be repeated here.
  • the playback content only includes the course content and the images and videos of teachers and students during the live broadcast.
  • the playback resources come from the real-time recording content during live teaching.
  • the contents that can be played live include: recording the process of connecting to the microphone, but you cannot participate; the practice questions pop up in the classroom, you can participate in answering the questions and feedback right or wrong, and the results of the questions do not participate in the recording; the brushing process is fully recorded, but cannot be operated; raise your hand The function is not displayed.
  • the parts that do not need to be recorded include discussion areas, student lists, and teams, which are not required to be displayed in the playback area.
  • a progress bar is displayed at the bottom of the playback video, indicating which time period has continuous microphones and which time period has classroom training, and distinguishes colors.
  • the progress bar will disappear automatically after X seconds is displayed by default, click the video area to pause, click the video area again to play; drag the progress bar left and right to fast forward and rewind, without selection function.
  • the two-screen class mode can also be used, and the corresponding live room displays the course content and the student video area, instead of the teacher video area.
  • the student terminal can also use the two-screen listening mode, and the corresponding live room displays the course content and the student video area, instead of the teacher video area.
  • students After logging in to the "Juwei School” app, students can enter the live broadcast room according to their class schedule when they arrive at the class time. Since the teacher side can use the three-split screen class mode and the multi-channel video class mode, correspondingly, the student side can also use the three-split screen lecture mode and the multi-channel video lecture mode.
  • FIG. 11 is a schematic page diagram of the home page of the student terminal in some embodiments of the present application.
  • the user's avatar and student's name are displayed on the left side of the user's home page. If the user's avatar is empty, the last two characters of the name are used as the avatar.
  • the right side shows my parents and the logout button, click to return to the login interface.
  • the user home page displays class schedule information and homework information.
  • the assignment information includes a list of today's assignments.
  • the "All assignments" button is displayed in the upper right corner of the assignment list. Click to jump to the all assignments interface.
  • Today's homework displays the homework whose start time is today, and displays unfinished homework by default. It supports the filtering of unfinished and completed homework. Jobs with statuses are displayed in Completed except for jobs that are not completed. After students click on an assignment to complete the submission and return, the assignment needs to be hidden from the uncompleted module.
  • Each assignment displays the assignment's subject icon, the assignment's subject title, and the assignment's due date. Icon data comes from backend configuration.
  • the timetable information includes my timetable list.
  • the top of my timetable list displays the year and month selection bar, which can be turned left and right by month.
  • the date below changes accordingly.
  • the default is the first week, and No. 1 is selected.
  • the selected date in each month has a green background.
  • An orange dot is marked below the date, which means that there is at least one live class on that day.
  • a list of courses is displayed below the date box, arranged in chronological order of each course, the earlier the time is at the top.
  • the class time, team status and points status are displayed on each course. If a certain course has been completed, the team status displayed is the team competition result of the student's own team during the current live class, and the points status is the points obtained by the corresponding live broadcast. .
  • Action buttons are displayed on the right side of each course, including watch playback, class, leave, and leave.
  • the Watch Playback button is displayed on the right side of the course that the live class has finished. Students can click the Watch Playback button to play back the video of the course; the Class button indicates that the course is about to be broadcast live. Students can click to enter the class 15 minutes in advance.
  • the Request for Leave button can be selected 15 minutes before the class starts. After being selected, the button will be replaced by the Requested Leave button.
  • the Leave button is displayed on the right side of the course, indicating that the student has asked for leave in the course. If the live broadcast has started, click to enter the live broadcast room, which is counted as attendance; if the live broadcast has not started, click to cancel the leave. Specifically, the "Ask for Leave” button is displayed 15 minutes before the class (excluding), and after 15 minutes before the class, if there is no leave, the "Class” button is displayed, and if the leave is requested, the "Ask for Leave” button is displayed.
  • FIG. 12 is a schematic page diagram of a student listening to a class in some embodiments of the present application. After the students click the "Class" button, they can enter the corresponding live room to listen to the class.
  • the student's lecture mode is the same as the teacher's class mode. When the three-screen lecture mode is adopted, see Figure 12.
  • the page of the live lecture room is similar to the page of the teacher's live class.
  • the student's live lecture page includes the course content area, the student video area, the teacher's Video area and ribbon.
  • the title of the live class and the duration of the live broadcast are displayed on the live broadcast page.
  • the student presses the back button on the live broadcast page the student side exits the live broadcast room.
  • the course content area is used to present live content such as handouts, whiteboards, videos, etc.
  • the student video area is used to display the student's own image, name and the number of points in this live broadcast
  • the teacher video area is used to display the teacher's image
  • the functional area is used to display the team situation.
  • the operation buttons during live interaction include microphone, camera, raise hand, paintbrush, and discussion buttons.
  • raise hand is red, it means that the hand has been raised, and when it is gray, it means that the hand has not been raised.
  • the "Camera” button is red, it means that the camera has been turned on.
  • the camera When the button is activated again, the camera will be turned off, and the "Camera” button will be gray; Trigger the “Camera” button, and the purchase camera interface will pop up.
  • the "Microphone” button is red, it means that the microphone is turned on.
  • the button When the button is activated again, the microphone is turned off, and the “Microphone” button is gray; Trigger the "Microphone” button, and the purchase microphone interface will pop up.
  • the "Brush” button has permission, the trigger button will expand the brush panel, the default brush color is red, and the panel will be closed when returning; when the button has no permission, the trigger button will pop up a "Brush cannot be used” prompt.
  • the link to purchase the QR code and the instructions for connecting to the microphone will be displayed on the monitor screen.
  • the instructions for using Lianmai can be static or dynamic pictures to describe how to use Lianmai.
  • a reject button is also displayed on the display. If you click the "don't buy first, just take a look” button, the page will be closed.
  • first perform device detection to determine whether the "Juweijiao” application has the permission to call the camera. If it does not have the permission to call the camera, a pop-up prompt "Do you want to allow Juweijiao to shoot and record videos?", If it is rejected, the AI surveillance video area will be empty.
  • the camera will be called normally and the images of the students will be collected and displayed in the video area.
  • the display device is configured with a camera, and the "Juwei School” application has the permission to call the camera, but the camera is occupied by other applications, when the "Juwei School” application calls the camera, it will prompt "The camera is occupied, teacher Can't see your video footage”. If the student forcibly quits other applications occupying the camera, they can enter the live room; if the student chooses not to use the camera temporarily, the AI surveillance video area will be empty after entering the live room.
  • the "Discussion” button When students enter the live broadcast room, the "Discussion” button is selected by default, and the discussion area is displayed on the right side of the live broadcast screen. Right-click on the "Discussion” button to the "Discussion tab”, press on the "Discussion tab", you can view the past chat records, and press the return key to return to the "Discussion tab”. Right-click on the "discussion area tab” to switch the "student tab”, click to view the student list, and press the return key to return to the "discussion area tab".
  • the live broadcast interface is the same as that in the three-split screen lecture mode, the difference lies in the activation of the discussion area.
  • press the OK button on the remote control to pop up the discussion area, and at the same time pop up the selection area, the first copy is selected by default, and press the back button to disappear.
  • the input method can also be voice input, which will be displayed after converting the voice into text. Students can operate the arrow keys of the remote control to control the focus to move on each copy selected and input, and click the OK button to send it in the discussion area.
  • FIG. 13 is a schematic page diagram of students practicing in class in some embodiments of the present application.
  • the teacher when the teacher is teaching live, he can practice in-class during the live class.
  • the related options of the in-class practice will be displayed in the live broadcast interface.
  • the option button When the in-class practice pops up, the option button will get the focus by default. Previously, other locations could not gain focus; if the student tried to cut away, the options area would jitter. Students interact with the classroom practice.
  • the student terminal After entering the live room, the student terminal needs to use the camera to collect the images of the students. To ensure the integrity of the collected images, the AI monitoring function can be turned on when the camera is called.
  • the display device When students enter the live room, the display device first detects whether there is a camera. If there is a camera, a prompt to obtain camera permission will pop up. If the camera is occupied by other applications, it will prompt "Occupied”. If the display device is not equipped with a camera, the student's own video area is not displayed.
  • the AI monitoring function can detect whether the student is in the video: when the camera captures the image of the student, a human-shaped frame is displayed in the capture area.
  • the default detection interval is X seconds. It can also detect whether the student's sitting posture is correct: if the student's sitting posture is not correct, the human-shaped dotted line will flash, and the voice broadcast "please be correct, and teach the teacher ⁇ ", the default detection interval is X seconds; among them, the definition of correctness refers to: no , lying down no, not facing the camera no.
  • the AI monitoring function can be equipped with a monitoring switch. If the monitoring switch is turned off, the camera area will not be displayed.
  • the AI monitoring broadcast has not ended, but it has detected that the student is sitting upright, the broadcast will be completed and disappear. If it has not been detected that a person is alive and sitting upright, it will be broadcast again every 1 minute. Judging that there is one person in the human-shaped dotted line box and correcting it, it meets the requirements. If there are many people in the video, the person detected by Byte shall prevail.
  • the microphone and the "connected microphone” corner icon will be displayed, and the user will be prompted by flashing.
  • the students themselves are displayed in the left area, and the right screen is empty, or vice versa.
  • the system will provide a live report, including the answering status, the number of hands-raised, the number of consecutive microphones, and the number of likes.
  • FIG. 14 is a schematic diagram of a first live broadcast interface in some embodiments of the present application.
  • the first live broadcast interface displays a course content area, a student video area, a teacher video area and a functional area.
  • the live screen of the course content area is the same as the live screen of the course content area of the second live broadcast interface, the teacher video area is used to display the teacher's image, and the student video area is used to display the student's image.
  • multiple student images are displayed in the student video area.
  • the student video area and the teacher video area are displayed above the course content area
  • the teacher video area is displayed first
  • the student video area is located to the right of the teacher video area
  • the image of the local student is at the first position in the student video area
  • the images of the remaining students are displayed in the order they entered the live class.
  • the functional area is used to realize the interactive functions of students during the live class, including functional controls such as raising hand, handwriting input (optional configuration), discussion and asking for help.
  • functional controls such as raising hand, handwriting input (optional configuration), discussion and asking for help.
  • the handwriting input function control is used to perform corresponding handwriting input operations according to the authorization of the teacher, such as adjusting the handwriting input style, scribbling, painting, etc.
  • the handwriting input style includes but is not limited to the shape, color, thickness, font, etc. of the brush.
  • the first live broadcast interface shown in Figure 14 is not configured with the handwriting input function.
  • the first live broadcast interface shown in FIG. 19 is configured with a handwriting input function.
  • the discussion control can realize real-time text discussion and interaction between teachers and students, and between students and students. You can refer to the discussion area function in the second live broadcast interface.
  • the help function control can provide help function to the program platform when there is an abnormality in the application program during the live class, such as the failure to start the camera, the inability to see the live screen, etc.
  • FIG. 15 is a schematic diagram of a course content area in a live broadcast interface when scribbling is performed using handwriting input in some embodiments of the present application.
  • the teacher assigns homework on the blackboard, and the students answer questions on the blackboard, in some embodiments, referring to FIG.
  • the virtual interface is used as a blackboard, and both students and teachers use their own handwriting input functions to scribble on the corresponding live broadcast interface.
  • the live broadcast interface written by the teacher is the second live broadcast interface
  • the live broadcast interface written by the students is the first live broadcast interface.
  • both the student end and the teacher end can use the handwriting input function to scribble on the corresponding live broadcast interface.
  • the display device used needs to have a touch screen, and the display device with an ordinary screen cannot be used temporarily.
  • To scribble with the handwriting input function you need to borrow other equipment to operate.
  • different live class programs need to be provided to realize the live class, that is, a live class program with handwriting input function needs to be configured for touch screen display devices, and a live class program with handwriting input function needs to be configured for ordinary display devices. Live class program with handwriting input function.
  • the program platform needs to provide two versions of the program.
  • the program platform needs to maintain more versions of the program, which will inevitably lead to high maintenance costs for the platform. Therefore, in order to reduce the development cost, for different models of student display devices, the program platform can provide the same version of the first program, which can realize the compatibility of different models of display devices, that is, different models of display devices can be compatible with two models at the same time.
  • the two display modes include a first live broadcast interface with handwriting input function and a first live broadcast interface without handwriting input function.
  • the first program when configuring the first program on display devices of different models, it is necessary to control the automatic display of the handwriting input function in the live broadcast interface according to whether the display device is a touch screen.
  • the first program of the version it is necessary to control whether the display devices of different models have the handwriting input function to be turned on and off, so that one version can be adapted to display devices of all models, and the two forms of interface display are compatible.
  • the student-side display device used by the student needs to first check whether the handwriting input capability is configured, so as to accurately determine whether the handwriting input function control needs to be displayed in the first live broadcast interface.
  • the developer when developing a display device, the developer needs to configure whether the model has the handwriting input capability based on factors such as the model and whether the CPU and memory resources of the model meet the usage requirements. That is, when the model is a touch screen, and the CPU, memory resources, etc. meet the requirements, the handwriting input capability is configured for the display device; and when the model is a normal screen, even if the CPU and memory resources meet the requirements, it is not a display device. Configure handwriting input capabilities.
  • the developer obtains the function configuration information after configuring each display device with the brush capability and model, and stores it in the server.
  • the server stores the function configuration information of each display device correspondingly according to the identification information.
  • the first program needs to query the server for information such as the model of the device, the configuration of the brush capability, etc., according to the current device capability, to decide whether to display the handwriting input function control.
  • terminal devices with the same hardware configuration may display the handwriting input function control when the conditions are satisfied, and not display when the conditions are not satisfied due to different installed software versions.
  • the student-side device with the paintbrush function can be set to manually turn off or enable the paintbrush function, and the student-side device can synchronize the changed information to the teacher-side device.
  • FIG. 16 is an interactive schematic diagram of automatically displaying the handwriting input function in the teaching live broadcast in some embodiments of the present application
  • FIG. 17 is a flowchart of automatically displaying the handwriting input function in the teaching live broadcast in some embodiments of the present application.
  • the embodiment of the present application provides a display device, which is applied to the display device on the student side, including: a display configured to present a first live broadcast interface generated when a first program is started; a memory configured with a first live broadcast interface for implementing online live classes Program; a controller connected with a display and a memory, respectively, when executing the control method for automatically displaying the handwriting input function, referring to FIG. 16 and FIG. 17 , the controller is configured to perform the following steps:
  • the controller responds to the application startup instruction and calls up the display interface of the first program. That is, the first live broadcast interface is generated and displayed on the display.
  • the first live broadcast interface is generated and displayed on the display.
  • the interface content shown in FIG. 14 please refer to the interface content shown in FIG. 14 .
  • the controller of the display device on the student side When the student starts the first program, the controller of the display device on the student side generates a handwriting input function query instruction and sends it to the server, and the server queries whether the device is configured with the handwriting input function according to the handwriting input function query instruction on the student side display device. If the device that sends the handwriting input function query instruction is a touch screen model, the display device is equipped with the handwriting input function. At this time, the server sends the instruction supporting the handwriting input function to the corresponding student display device; if the handwriting input function query instruction is sent If the device is an ordinary screen model, the display device is not configured with a handwriting input function. At this time, the server sends an instruction that does not support the handwriting input function to the corresponding student display device.
  • the main body that queries whether the display device is configured with the handwriting input function is the server, rather than the device itself.
  • the query of the handwriting input function is realized by the server, which can reduce the occupation of CPU and memory resources of the display device and avoid affecting the normal operation of the display device.
  • the server may receive multiple handwriting input function query instructions at the same time.
  • the student-side display device is sending the handwriting input function query command.
  • the respective identification information needs to be carried, and the identification information is used to identify at least one of the model information, hardware configuration information, and version information of the display device.
  • FIG. 18 is a flowchart of a method for sending a handwriting input function query instruction in some embodiments of the present application.
  • the controller is further configured to perform the following steps when executing, in response to the application startup instruction for starting the first program, sending a handwriting input function query instruction to the server:
  • S114 Send a handwriting input function query instruction to the server, where the handwriting input function query instruction is used to instruct the server to query the handwriting input function query result of the display device corresponding to the local end identification information according to the local end identification information.
  • an application startup instruction is generated, and the server responds to the application startup instruction to obtain local identification information.
  • the identification information is the unique identification of the corresponding display device, which is used to distinguish different display devices on the student side.
  • the identification information of the display device can be generated based on the relevant information of the device and a random character string. Therefore, the controller is further configured to perform the following steps when executing the acquisition of the identification information of the local end:
  • Step 1111 When starting the first program, obtain the model information, version information and hardware configuration information of the display device at the local end.
  • Step 1112 Generate local identification information based on the model information, version information, hardware configuration information and randomly generated character string of the local display device.
  • the controller of the display device where it is located obtains the model information, version information and hardware configuration information of the device.
  • the model information includes touch screen models and ordinary screen models
  • the hardware configuration information includes CPU, memory resources, etc.
  • Hardware information, version information includes information such as the system version of the device.
  • a character string is randomly generated, and local identification information is generated from the model information, version information, hardware configuration information and the randomly generated character string.
  • the model information, version information and hardware configuration information are used to distinguish the hardware structure of different display devices, and the randomly generated character string is used to further distinguish different display devices, so as to avoid the same identification information of display devices with the same hardware structure. Therefore, the local identification information generated based on model information, version information, hardware configuration information and random strings is unique.
  • the display device on the student side can generate a handwriting input function query instruction carrying the identification information of the local terminal, and send it to the server.
  • the server parses the instruction to obtain the corresponding identification information, and then queries the handwriting input function query result corresponding to the student display device based on the unique identification information.
  • the query result of the handwriting input function includes two contents, one is that the handwriting input function is supported, and the other is that the handwriting input function is not supported.
  • the first program is configured in the display device A on the student side, and step S11 and related steps are executed to query the server whether the display device A on the student side is configured with the handwriting input function, if the server returns the handwriting input function that supports the handwriting input function. Input the function query result to the display device A on the student side, and then the display device A on the student side displays the handwriting input function control in its corresponding first live broadcast interface.
  • FIG. 19 is a schematic diagram showing a first live broadcast interface with handwriting input function controls in some embodiments of the present application.
  • the display device A on the student side is a touch screen model, it has a handwriting input function. Therefore, when the first program is started, the generated first live broadcast
  • the handwriting input function controls are displayed synchronously in the interface, such as the "Brush" control displayed in the functional area in Figure 19.
  • the first program is configured in the display device B on the student side, and step S11 and related steps are executed to query the server whether the display device B on the student side is configured with a handwriting input function, and if the server returns a device that does not support the handwriting input function
  • the handwriting input function query result is sent to the display device B on the student side, and the display device B on the student side does not display the handwriting input function controls in the corresponding first live broadcast interface.
  • the handwriting input function controls are not displayed in the interface. If the display device B on the student side is an ordinary screen type, it does not have the handwriting input function. Therefore, when the first program is started, the handwriting input function control is not displayed in the generated first live broadcast interface.
  • first live broadcast interfaces that is, the display device with handwriting input function controls.
  • the first live broadcast interface and the first live broadcast interface that does not display the handwriting input function control it can be seen that the two interfaces of the same version of the first program adopted in this application can be displayed in a compatible manner.
  • Different display devices need to report the local identification information to the server when starting the live class program, so that the server can issue the switch of whether to enable the handwriting input function, that is, whether it is necessary to display the handwriting input function control in the first live broadcast interface.
  • different display devices can run the same version of the first program, and automatically determine whether it is necessary to display the handwriting input function control by reporting the identification information of the local terminal, so that the two different forms of interfaces can be displayed compatibly, and the program platform does not need to be displayed. Maintain different versions of the program for different models to reduce development costs.
  • the corresponding students can directly participate in the shared handwriting input function operation by touching, while the display device without handwriting input function control display, its corresponding students cannot directly participate in the sharing
  • the handwriting input function operation if it wants to participate in the interaction, it needs to use other external devices to realize it.
  • information input can be implemented by connecting an external device to the display device, for example, the external device can be a terminal that provides a touch input function. Students use a stylus or finger to scribble, draw and other operations on a terminal that provides touch input function to generate input information.
  • the terminal transmits the input information to the display device. After the display device receives the input information, it parses the content. It is displayed in the live broadcast interface, specifically in the answer area or handout area, so that students who use ordinary screen display devices can participate in the sharing operation of handwriting input function.
  • the server recognizes the display device as a device equipped with the handwriting input function. Therefore, when the student-side display device starts the live class program (such as the first program), the query result of the handwriting input function that is queried to the server is the result with the handwriting input function.
  • the handwriting input function controls are displayed in the live class interface.
  • the teacher-side display device needs to know whether the display device used by each student participating in the live class has the handwriting input function. Therefore, after each student-side display device obtains its own handwriting input function configuration, it immediately informs the teacher-side display device synchronously, so that the teacher can clarify which students can obtain the handwriting input function authorization and which students cannot obtain the handwriting input function authorization. Live classes are running as normal.
  • the display devices on the student side that can obtain the authorization of the handwriting input function include a touch screen display device and a common screen display device with an external touch input terminal.
  • the controller when executing the control method for automatically displaying the handwriting input function, after the student-side display device learns the query result of the handwriting input function, the controller is further configured to perform the following steps: after receiving the handwriting input function returned by the server After the function query result is input, the handwriting input function query result is sent to the display device on the teacher side, so that the display device on the teacher side displays the first authority control button for representing the control authority of the display device on the student side with the handwriting input function and the display device for representing the first authority.
  • the student terminal without the handwriting input function displays the second authority control button of the device control authority, the first authority control button is in a triggerable state, and the second authority control button is in a non-triggerable state.
  • each student-side display device After each student-side display device has inquired about the query result of its own handwriting input function, it needs to send its own handwriting input function query result to the teacher-side display device in time. According to the configuration situation, a corresponding student list is generated to show whether the corresponding students can participate in the shared handwriting input function operation according to the received different handwriting input function configurations. In some embodiments, whether each student display device can participate in the operation of the shared handwriting input function may be determined by displaying an authority control button in the second live broadcast interface.
  • the student list includes a first operation entry and a second operation entry.
  • the first operation entry shows the student name and the first permission control button corresponding to the student display device with handwriting input function
  • the second operation entry shows no handwriting input function.
  • the student terminal of the device displays the student name and the second permission control button corresponding to the device.
  • the first authority control button is in a triggerable state and has control authority for the handwriting input function of the corresponding student-side display device; the second authority control button is in a non-triggerable state and does not have the handwriting input function control authority for the corresponding student-side display device.
  • the student-side display device A sends the result with the handwriting input function to the teacher-side display device
  • the student-side display device B sends the result without the handwriting input function to the teacher-side display device
  • the teacher-side display device is based on the student-side display device.
  • a student list is generated based on the configuration of the handwriting input function of the display device B on the student side
  • the first operation item is generated based on the result sent by the display device A on the student side
  • the second operation item is generated based on the result sent by the display device B on the student side.
  • the authority control button displayed on the teacher terminal includes two display forms with the handwriting input function control authority and without the handwriting input function control authority.
  • the teacher can only select students with the handwriting input function to participate in the sharing of the handwriting input function operation, that is, only by triggering the first permission control button to activate the handwriting input function of the corresponding student, and authorize the handwriting input function.
  • a handwriting input authorization instruction is generated to authorize the handwriting input function on the student-side display device corresponding to the first authority control button.
  • the student terminal display device receives the handwriting input authorization instruction, and can activate the configured handwriting input function to perform handwriting input operation.
  • controller in the student display device is further configured to perform the following steps:
  • Step 141 Receive a handwriting input authorization instruction sent by the display device on the teacher's end, where the authorization instruction for handwriting input refers to an instruction generated when the display device on the teacher side triggers the first authority control button.
  • Step 142 in response to the handwriting input authorization instruction, activate the handwriting input function control to be in a triggerable state.
  • Step 143 In response to triggering the handwriting input function control in a triggerable state, a handwriting input function activating instruction is generated, and the handwriting input function activating instruction is used to activate the handwriting input function to perform handwriting input operation in the first live broadcast interface.
  • the teacher end triggers the first authority control button, generates a handwritten input authorization instruction, and sends it to the corresponding student end display device.
  • the display device on the student side turns on the trigger state of the handwriting input function control configured on it, so that it is in a triggerable state.
  • a prompt can be popped up synchronously in the first live broadcast interface, and the content of the prompt can be "You have obtained the authorization of the handwriting input function and can perform handwriting input operation".
  • the handwriting input function call-up command is used to call up the handwriting input function.
  • a handwriting input operation is performed in a live interface.
  • the embodiment of the present application provides a display device that, when the first program is started, executes an automatic handwriting input function query strategy, and queries the server whether the display device has the handwriting input function. And when the handwriting input function is available, the handwriting input function controls are displayed on the first live broadcast interface; when the handwriting input function is not available, the handwriting input function controls are not displayed on the first live broadcast interface, so that the first program can be compatible with both at the same time.
  • Different forms of display modes two live class interfaces are compatible for display, and one version of the live class program can be adapted to all display devices without the need to develop and maintain multi-version programs to reduce development costs.
  • each student-side display device sends the query result of the handwriting input function automatically queried to the teacher-side display device, so that the teacher can select students with handwriting input function to participate in sharing brushes.
  • FIG. 20 is another flow chart of automatically displaying the handwriting input function in the teaching live broadcast in some embodiments of the present application.
  • An embodiment of the present application provides a display device, which is applied to the display device at the teacher's end, including: a display configured to present a second live broadcast interface generated when a second program is started; a memory configured with a second live broadcast interface for implementing online live classes Program; a controller connected with a display and a memory, when executing the control method for automatically displaying the handwriting input function, see FIG. 16(c) and FIG. 20, the controller is configured to perform the following steps:
  • the handwriting input function query result refers to the result of the student display device requesting the server to query whether the local end is configured with the handwriting input function.
  • the teacher starts the second program configured on the display device used by the teacher through the remote control or voice, and generates the application start instruction.
  • the controller invokes the display interface of the second program, that is, generates a second live broadcast interface and displays it on the display.
  • the progress of the live class needs to be initiated by the teacher. Therefore, after the teacher starts the second program, a corresponding notification is pushed to each student display device, and the student starts the corresponding notification after receiving the notification.
  • first program When starting their respective first programs, the students automatically inquire about the configuration of their handwriting input functions from the server at the same time, and send the query results of their respective handwriting input functions to the display device on the teacher's side.
  • the teacher-side display device starts the second program, it can receive the handwriting input function query result sent by each student-side display device.
  • the handwriting input function query result means that the student-side display device requests the server to query whether the local end is configured with handwriting.
  • the configuration of each student's handwriting input function can be carried out in the form of a list. exhibit.
  • the controller in the display device on the teacher side is further configured to perform the following steps: receiving a query result of handwriting input function sent by each display device on the student side; Input the function query result, display the student list in the second live broadcast interface, display the first operation entry and the second operation entry in the student list, and display the student name and the first operation entry corresponding to the student display device with handwriting input function in the first operation entry.
  • An authority control button, the second operation item displays the student name and the second authority control button corresponding to the display device on the student side without the handwriting input function, the first authority control button is in a triggerable state, and the second authority control button is in a non-triggerable state state.
  • FIG. 21 is a schematic diagram of a student list in the second live broadcast interface in some embodiments of the present application.
  • the teacher-side display device After receiving the handwriting input function query results sent by several student end display devices, the teacher-side display device generates a student list based on each student's name and the handwriting input function query result.
  • the student list is displayed in the live broadcast information display area of the second live broadcast interface.
  • the student list displays the number of students currently participating in the live broadcast class, the name of each student, and the permission control button for the handwriting input function.
  • the teacher-side display device In order to distinguish whether the display devices used by different students have the handwriting input function, when the teacher-side display device generates the student list, the students participating in the live class are distinguished according to the query results of the handwriting input function, that is, the first operation entry and the second operation entry are generated. For the operation items, the information of students whose display device is equipped with handwriting input function is displayed by the first operation item, and the information of students whose display device is not equipped with handwriting input function is displayed by the second operation item.
  • the first operation item displays the student name and the first permission control button corresponding to the student-side display device with handwriting input function
  • the second operation item displays the corresponding student-side display device without handwriting input function.
  • the student name and the second authority control button, the first authority control button is in a triggerable state
  • the second authority control button is in a non-triggerable state.
  • the teacher-side display device can generate a student list after receiving the handwriting input function query result sent by each student-side display device. Therefore, the generation of the student list can exist in different application scenarios.
  • One application scenario is that at the beginning of the live class, when the teacher has just entered the live room and has not started the real class, the student list can be generated based on the query result of the handwriting input function sent by the display device used by the students entering the live room at this time.
  • Another application scenario is that during the live class, some students are late and do not enter the live room until the class has already started. That is, when students join one after another, the teacher's display device can real-time display according to the students who are currently entering the live room. Display the query result of handwriting input function sent by the device to update the student list.
  • the teacher terminal can perform the corresponding handwriting input function authorization operation based on the information presented by the latest student list.
  • the second authority control button displayed in the student list does not have the control authority for the handwriting input function of the corresponding student display device.
  • the display devices used by other students have the handwriting input function and can participate in the sharing operation of the handwriting input function. Therefore, the first authority control button displayed in the student list has the control authority of the handwriting input function of the corresponding student display device. That is to say, the query result of the handwriting input function corresponds to the display form of the authority control button.
  • the display form of the authority control button may be a white brush pattern (the first authority control button) and a gray brush pattern (the second authority control button), and the white brush pattern represents the handwriting input function with the corresponding student display device Control authority, the teacher can click to trigger; the gray brush pattern means that the teacher does not have the handwriting input function control authority of the corresponding student display device, and the teacher cannot click to trigger.
  • the display form of the buttons may also be other colors or forms, which are not specifically limited in this embodiment.
  • the display device on the teacher side receives the handwriting input function query result sent by the display device on the student side and the result is that it has the handwriting input function
  • the display device used by the corresponding student is a touch screen model, or an ordinary screen model with an external touch input terminal.
  • the first operation item corresponding to the student-side display device with the handwriting input function is displayed on the second live broadcast interface, and the first authority control button with the handwriting input function control authority corresponding to the student-side display device is presented in the first operation item. , such as a white brush-patterned button.
  • the display device on the teacher side receives the query result of the handwriting input function sent by the display device on the student side and the result is that it does not have the handwriting input function, it means that the display device used by the corresponding student is an ordinary screen model and there is no external touch input terminal.
  • the device is not configured with a handwriting input function, and thus cannot participate in the operation of the shared handwriting input function. Therefore, the second operation entry corresponding to the display device on the student side without the handwriting input function is displayed on the second live broadcast interface, and the second operation entry without the control authority on the handwriting input function corresponding to the display device on the student side is presented.
  • Control buttons such as buttons with a gray brush pattern.
  • the display devices used by student A and student C have the handwriting input function, the first operation entry is correspondingly displayed in the second live broadcast interface, and the first permission control button with a white brush pattern is displayed in the first operation entry.
  • Student A generates the first operation entry, and displays student A in the first operation entry and displays the first permission control button with a white brush pattern on the right side of student A, and generates the first operation entry based on student C, and in the The first permission control button with a white brush pattern is displayed on the right side of student C, indicating that the first permission control button from top to bottom in the student list has the control permission of the handwriting input function of the student display device A, and the third permission control button has The student terminal displays the control authority of the handwriting input function of the device C.
  • a second operation entry is displayed in the second live broadcast interface, and a second permission control button with a gray brush pattern is displayed in the second operation entry, that is, based on student B's generation
  • the white brush pattern can be triggered by triggering the The first authority control button initiates the authorization of the handwriting input function to the corresponding student, allowing the student to participate in the handwriting input interaction.
  • the controller in the display device on the teacher side is further configured to perform the following steps:
  • Step 241 When authorizing the student to perform a handwriting input operation, receive a handwriting input authorization instruction generated when the first authority control button corresponding to the student is triggered.
  • Step 242 sending the handwriting input authorization instruction to the student display device corresponding to the first authority control button that performs the trigger operation, and the handwriting input authorization instruction is used to activate the handwriting input function control displayed by the student side display device in the first live broadcast interface.
  • the handwriting input function controls presented in the live broadcast operation button area displayed below the main functional area such as the “brush” control in FIG. 9 or FIG. 10 .
  • the model of the display device on the teacher's end can be a touch screen or an ordinary screen
  • the teacher's end starts the second program, it also automatically sends the identification information of the local end to the server to check whether the display device it is in has a handwriting input function.
  • the handwriting input function control is displayed below the main functional area; if the handwriting input function is not found, the handwriting input function control is not displayed below the main functional area.
  • the execution process of whether to display the handwriting input function control in the second live broadcast interface is the same as the relevant steps of the control method for automatically displaying the handwriting input function executed by the display device on the student side, and will not be repeated here.
  • FIG. 22 is a schematic diagram of the interface of the teacher terminal using the handwriting input function to scribble in some embodiments of the present application.
  • the teacher can trigger the handwriting input function control, and in the display area of the handout function mode, the teacher can realize the handwriting input function control on the handwriting interface. scribble.
  • the course content area of the second live broadcast interface will switch to display the handout display area, and simulate the blackboard in the handout display area to simulate the process of the teacher scribbling on the blackboard in the real class scene.
  • the teacher In the lecture mode, after the teacher has written the question through the handwriting input function control, he can choose one of the students to participate in the answer.
  • the handwriting input function control is displayed on the first live broadcast interface of the student end, the student end cannot actively trigger the handwriting input function control. If the student end wants to use the handwriting input function, it needs to obtain the authorization of the teacher end.
  • the handwriting input function of the display device on the student side is not enabled, and the handwriting input function control displayed in the first live broadcast interface is gray, that is, it cannot be triggered, and the student cannot actively trigger the handwriting.
  • the input function performs handwriting input operations. Students need to obtain the authorization of the teacher to use the handwriting input function, that is, when the teacher authorizes a certain student for the handwriting input function, the display device used by the student receives the handwriting input authorization instruction, and the handwriting input function of the display device on the student side is disabled. Turn on, switch the handwriting input function control in the first live broadcast interface to white, that is, the state that can be triggered.
  • the display form of the non-triggerable state and the triggerable state corresponding to the handwriting input function control is not only displayed in gray and white patterns, but also displayed in other forms, so as to distinguish two different trigger states.
  • the student-side display device's handwriting input function is enabled, and the student can trigger the triggerable handwriting input function control displayed in the first live broadcast interface.
  • the generated brush setting interface adjust the brush shape, thickness, color, font and other handwriting input styles.
  • students use a stylus or finger to scribble and other operations on the touch screen display (or the display of the touch input terminal), complete information input, and realize interactive operations such as answering questions.
  • the handwriting input function control When the student terminal is not authorized by the handwriting input function of the teacher, if the student triggers the handwriting input function control, because the handwriting input function control in the current state is in a non-triggerable state, the handwriting input function control on the student side does not respond to the student's trigger, and A prompt pops up in the first live broadcast interface, and the content of the prompt can be "You have not obtained the authorization of the brush and cannot perform handwriting input operation".
  • the handwriting input function authorization can be initiated to allow students to participate in answering the question.
  • the teacher triggers any of the first authority control buttons with handwriting input function control authority displayed in the student list. For example, if the teacher wants to select student A to answer a question, it triggers the white brush pattern displayed on the right side of student A. The first permission control button. If the teacher wants to select student C to answer the question, trigger the first permission control button of the white brush pattern displayed on the right side of student C.
  • a handwritten input authorization instruction is generated and sent to the display device on the student side corresponding to the triggered first authority control button. For example, if the teacher triggers the first permission control button corresponding to student A, the handwriting input authorization instruction is sent to the student display device A used by student A. If the teacher triggers the first authority control button corresponding to the student C, the handwriting input authorization instruction is sent to the student display device C used by the student C.
  • the content of the live course displayed in the course content area of the first live broadcast interface is the same as the content of the live broadcast course displayed in the course content area of the second live broadcast interface. Therefore, after switching the handout mode on the teacher and completing the assignment of topics, the course content of the first live broadcast interface The topic is displayed simultaneously in the area.
  • a student-side display device After a student-side display device receives the handwriting input authorization instruction sent by the teacher-side display device, the student-side display device receives a prompt and displays the prompt information in the first live broadcast interface, for example, "Receive the brush authorization, you can to scribble".
  • the display device on the student side receives the teacher's handwriting input function authorization and enables the handwriting input function, and the student can use the handwriting input function to answer, that is, by touching the display screen, in the corresponding position of the course content area in the first live broadcast interface. scribble.
  • the student-side display device A receives the handwriting input authorization instruction sent by the teacher-side display device, and enables the handwriting input function of the student-side display device A, student A can use the handwriting input function to scribble in the course content area.
  • the content written by student A is displayed in the course content area, and is synchronized to the teacher-side display device and the other student-side display devices, so that the interactive display of student A's handwriting input is displayed simultaneously on the display devices used by the teachers and students in the live class. content.
  • the teacher needs to cancel the authorization of the handwriting input function of the student.
  • the teacher clicks the first permission control button corresponding to the student in the second live broadcast interface again to generate handwriting. Enter the authorization cancellation instruction and send it to the student display device.
  • a prompt for canceling the brush authorization is displayed on the first live broadcast interface of the display device on the student side, and the prompt information can be "Your handwriting input function has been canceled".
  • the handwriting input function control on the student side is in a non-triggerable state again, and the teacher side can continue the subsequent courses, or the teacher side can click the handwriting input function displayed in the main function area of the second live broadcast interface again. Control, regain the handwriting input function, the teacher can continue to use its configured handwriting input function to continue to scribble.
  • the teacher can click the handwriting input function control displayed in the second live broadcast interface to end the activation of the teacher's handwriting input function. After the handwriting input function is cancelled, the teacher can continue with the subsequent lessons.
  • the teacher shares the handwriting input function with any student, he needs to click the permission control button in the student list presented in the second live broadcast interface.
  • the authority control buttons include buttons with control authority for the handwriting input function of the student display device and buttons without the handwriting input function control authority for the student side display device, when the teacher clicks to trigger a certain authority control button, the button may appear If the wrong selection is made, that is, the first permission control button should be triggered, but the second permission control button is clicked by mistake.
  • the teacher intended to trigger the first authority control button that has the handwriting input function control authority of the student display device, but wrongly triggered the second authority control button that does not have the handwriting input function control authority of the student display device.
  • the authority control button with the handwriting input function control authority of the student display device can perform the trigger operation, and the authority control button without the handwriting input function control authority of the student side display device cannot perform the trigger operation.
  • an error prompt pops up in the second live broadcast interface, prompting the content Can be used for "The device used by the student you selected is not configured for handwriting input.”
  • the teacher sees the error prompt, he knows that the student he chooses cannot use the handwriting input function, that is, he cannot answer the question, and he needs to select another student with the handwriting input function to answer the question.
  • each question corresponds to a time limit. For example, if the answering time provided by the teacher terminal to the students is 30 seconds, when the teacher terminal selects a student to authorize the handwriting input function, the handwriting input function of the student terminal display device will be enabled, and the display will be displayed in the course content area of the student terminal display device. 30-second countdown control and corresponding questions, students need to complete the answer within 30 seconds.
  • the server will automatically withdraw the question, and at the same time, the authorization of the handwriting input function obtained by the student will be cancelled, and the student will no longer be able to answer the question.
  • the teacher will activate the blackboard eraser function to erase the content input by the students.
  • the blackboard eraser function can be configured in the second live broadcast interface and displayed in the form of controls. The teacher can click to trigger, and click again to cancel the blackboard eraser function.
  • the teacher end display device when the teacher end authorizes a handwriting input function for a certain student, the teacher end display device needs to send a handwriting input authorization instruction to the student end display device through the server.
  • a time limit can be added for the handwriting input authorization command. If the instruction is sent overtime and the display device on the student side has not yet received the instruction, that is, the time limit of the instruction expires, the teacher side needs to click the first permission control button corresponding to the student again to resend the handwritten input authorization instruction.
  • the teacher end needs to reclaim the handwriting input function authorization of the student end. If the authorized recovery of the handwriting input function on the teacher side fails due to abnormal network communication, the display device on the teacher side can report to the server for compulsory recovery. If the student still scribbles and scribbles after completing the answer, the teacher can kick the student out of the live broadcast room and disconnect all message transmission between the student and the live broadcast room. If the student wants to continue listening to the class, he needs to click again to enter the first live broadcast interface.
  • the functions of forcibly recovering handwriting input function authorization and forcibly disconnecting student communication can be configured in the second live broadcast interface and displayed in the form of controls.
  • the teacher can click the corresponding control.
  • the teacher clicks on the forced recovery control or the forced disconnection of the communication control the corresponding instruction is sent to the server, and the server performs the operation corresponding to the received instruction, such as forcibly recovering the handwriting input function authorization or forcibly disconnecting the student communication.
  • the display device acquires the handwriting input function query result sent by each student-side display device after executing the automatic handwriting input function query when the second program is started.
  • an authority control button having a handwriting input function control authority corresponding to the display device on the student side is displayed on the second live broadcast interface.
  • the authority control button that does not have the handwriting input function control authority corresponding to the display device on the student side is displayed on the second live broadcast interface, so that the teacher can choose the students with the handwriting input function to participate. Share the handwriting input function, realize the purpose that the handwriting input function of the student side can be controlled by the teacher side, and further reduce the development cost.
  • the developer configures the display device, he or she configures whether to enable the handwriting input capability of the model according to factors such as the model and whether the CPU and memory resources of the model meet the usage requirements. That is, when the model is a touch screen, and the CPU, memory resources, etc. meet the requirements, the handwriting input capability is configured for the display device; and when the model is a normal screen, even if the CPU and memory resources meet the requirements, it is not a display device. Configure handwriting input capabilities.
  • the developer After completing the handwriting input capability and model configuration of each display device, the developer obtains the function configuration information and stores it in the server, and the server stores the function configuration information of each display device correspondingly according to the identification information.
  • the first program needs to query the server for information such as the model of the device, the configuration of the handwriting input capability, etc., according to the current device capability, to decide whether to display the handwriting input function.
  • FIG. 23 is another flowchart of a control method for automatically displaying a handwriting input function in some embodiments of the present application.
  • a server including: a database, configured to store functional configuration information of a display device; a controller connected to the database, on the student-side display device to execute an automatic handwriting input function query strategy , the controller in the server is configured to perform the following steps:
  • the display device on the student side When the display device on the student side starts the first program, the display device on the student side automatically generates a handwriting input function query instruction to the server to query whether the device where it is located has the handwriting input function.
  • the controller of the server After receiving the handwriting input function query instruction sent by the display device on the student side, the controller of the server sends the handwriting input function query instruction to the database to obtain the stored function configuration information from the database, and based on the function configuration information and handwriting input function query instruction to obtain the query result of the handwriting input function of the display device on the student side.
  • the student display device obtains the brush capability of the local end from the server based on the unique identifier of the local end.
  • the controller when inquiring about the configuration of the handwriting input function, the controller queries the database for the handwriting input function query result corresponding to the student-side display device when executing the handwriting input function query instruction sent by the student-side display device, is further configured to perform the following steps:
  • Step 311 in response to the handwriting input function query instruction sent by the student terminal display device, parse the local identification information of the student terminal display device carried in the handwriting input function query instruction.
  • Step 312 based on the local identification information of the display device of the student, in the function configuration information stored in the database, query the query result of the handwriting input function corresponding to the local identification information.
  • the identification information of the local end is used to identify the model information of the display device of the local end, and the generation process of the identification information of the local end can be Referring to steps S111 to S114 provided in the foregoing embodiments, and related contents of steps 1111 to 1112, details are not repeated here.
  • the controller parses the handwriting input function query instruction, and obtains the local identification information of the student display device carried in the instruction.
  • the identification information of the local terminal is the unique identification of the display device on the student side, and the function configuration information stored in the database includes the relevant function configuration corresponding to the identification information.
  • the terminal displays the query result of the handwriting input function corresponding to the terminal identification information of the device.
  • the handwriting input function configuration of the display device is related to its model, that is, if it is a touch screen model, the handwriting input function is configured; if it is a normal screen model, the handwriting input function is not configured. Therefore, when the controller queries the database based on the local identification information of the display device on the student side, it will obtain two query results.
  • the query result of the handwriting input function corresponding to the identification information of the local terminal is that it has the handwriting input function;
  • the local identification information represents a common model, and in the function configuration information stored in the database, the query result of the handwriting input function corresponding to the local identification information is that it does not have the handwriting input function.
  • the handwriting input function query result is returned to the corresponding student terminal display device.
  • the display device on the student side determines whether the handwriting input function control needs to be displayed in the first live broadcast interface according to the handwriting input function query result. If the handwriting input function query result returned by the server is that the terminal has the handwriting input function, it will be displayed in the first live broadcast interface.
  • Handwriting input function controls For example, if the handwriting input function query result returned by the server is that the terminal does not have the handwriting input function, the handwriting input function control is not displayed in the first live broadcast interface.
  • the student-side display device also needs to send the handwriting input function query result to the teacher-side display device, and the teacher-side display device presents the student list in the second live broadcast interface according to the handwriting input function query result sent by each student-side display device.
  • the embodiment of the present application provides a server.
  • the display device on the student side executes an automatic handwriting input function query strategy, and queries the server whether it has the handwriting input function.
  • the server returns the query result of the handwriting input function to the display device on the student side, so that when the handwriting input function is available, the handwriting input function control is displayed on the first live broadcast interface; when the handwriting input function is not available, it is not displayed on the first live broadcast interface.
  • Handwriting input function control so that the first program can be compatible with two different forms of display modes at the same time, and the two live broadcast interfaces are compatible for display, so that one version of the first program can be adapted to all display devices, and there is no need to develop and maintain multi-version programs. to reduce development costs.
  • the live program when a user uses a display device to conduct a live class, the live program includes a first program and a second program, the second program is a program configured in the display device on the teacher's side, and when the second program is started, the program is displayed on the display
  • the second live broadcast interface is displayed in the first program; the first program is the program configured in the display device of the student side, and when the first program is started, the first live broadcast interface is displayed on the display.
  • FIG. 24 is a schematic diagram of a user interface during live broadcasting in some embodiments of the present application.
  • the student user interface displays the first live broadcast interface
  • the first live broadcast interface displays the lecture area, the student’s own video area, and the teacher’s own video area.
  • the handout area is the course content area.
  • the live screen in this area is the same as the live screen in the course content area in the teacher's live interface. It displays the teacher's shared handout, shared desktop, shared video, etc. It is mainly used to display what the teacher wants to present to the students. content, this area cannot be selected.
  • the teacher's video area is used to display the teacher's image. Students can watch the teacher's real-time status through this area. This area can only be viewed and cannot be selected.
  • the student video area is used to display the student's own image, and the student's own camera image is displayed in this area, which can only be viewed and cannot be selected.
  • the functional area is used to realize the interactive functions of students during the live class, including functional controls such as raising hand, handwriting input (brush), discussion and feedback. Students can operate the ribbon, and each button can be selected and clicked. During the live class, if students want to actively answer the teacher's question, they can trigger the hand raise function control to inform the teacher that they want to answer the question.
  • the handwriting input function control is used to perform corresponding handwriting input operations according to the authorization of the teacher, for example, adjusting the handwriting input style, scribbling, painting, etc.
  • the handwriting input style includes but is not limited to the shape, color, thickness, font, etc. of the brush.
  • the discussion control can realize real-time text discussion and interaction between teachers and students, and between students and students. Please refer to the discussion area function in the second live broadcast interface.
  • the feedback function control can provide a help function to the program platform when there is an abnormality in the application during the live class, such as the inability to start the camera, the inability to see the live screen, etc.
  • the discussion area and the student list are two side-by-side tabs. After selecting, you can switch the tabs.
  • the message list area is displayed below the two tabs, which is used to display the discussion records in the live room or the student list in the live room.
  • the message list area below the discussion area tab presents a list display window, which is used to display real-time text chat messages between students and students and between students and teachers.
  • the message list area below the student list tab displays relevant information about all students participating in the live class.
  • an input box is displayed in the list display window, and the input box can be displayed at the bottom of the list display window.
  • the user needs to move on the different function controls of the ribbon through the remote control button (left or right button) configured by the display device, when moving to the function control on the rearmost side , continue to right-click, focus on the discussion area tab.
  • the remote control button left or right button
  • the user presses the left button of the remote control on the discussion area tab it will return to the functional area; if the user presses the right button of the remote control on the discussion area tab, it will switch to the student list tab; if the user presses the down button of the remote control on the discussion area tab , browse the content of the discussion area, that is, the list of messages presented in the list display window. If the user presses the key on the remote control in the message list, it will return to the discussion area tab.
  • the latest news is usually displayed at the bottom of the message list.
  • the focus will fall on the top of the message list and cannot locate the latest message.
  • the user wants to view the historical messages in the message list, he needs to press the up key to start browsing upwards from the new message at the bottom, and this operation will conflict with the operation of pressing the up key to return to the "Discussion Area" tab. It can be seen that the display manner of displaying the message at the bottom of the message list will cause the problem that it is inconvenient to browse historical messages from a new message.
  • an embodiment of the present application provides a display device.
  • the latest message published and received by the user is placed at the top of the historical message in the message list, so that the user can trigger the remote control from the discussion area tab.
  • Press the down button of the remote control the focus is on the new message at the top of the message list, and the down button of the remote control is pressed from the new message at the top to realize downward browsing of historical messages, which is convenient for the user to operate the button.
  • FIG. 25 is a flowchart of a method for displaying a message in some embodiments of the present application
  • FIG. 26 is a sequence diagram of a method for displaying a message in some embodiments of the present application.
  • a display device including: a display configured to present a user interface on which discussion controls are displayed; a controller connected to the display, in When performing the message presentation methods shown in Figures 25 and 26, the controller is configured to perform the following steps:
  • the live interface is displayed in the user interface, and discussion controls are displayed in the live interface, such as the discussion area tab in Figure 24.
  • Triggering the discussion control is to generate a control start instruction, so as to display a list display window in the user interface for displaying the message list.
  • the manner of triggering the discussion control may be triggered by triggering the direction keys of the remote control. For example, if the current control focus of the remote control is in the functional area, trigger the right key of the remote control to move the control focus from the function control on the far right of the functional area to the discussion control (discussion area tab). If the current control focus of the remote control is on the student list tab or a student information display position in the student list, trigger the left button of the remote control to move the control focus from the left to the discussion control. If the control focus of the current remote control is on the display position of a message in the message list, trigger the up key of the remote control to move the control focus from up to the discussion control.
  • the control start command is generated.
  • a list display window needs to be displayed in the message list area to display the text chat between students and students, and students and teachers. information.
  • the controller After the controller receives the control start instruction, it needs to obtain the messages generated by all the users participating in the live broadcast program during the interaction.
  • the messages generated by the interaction include historical messages generated during the last live broadcast and real-time messages generated during the current live broadcast. Therefore, when the controller acquires the message, in response to the control start instruction generated when the discussion control is triggered, it can acquire the historical messages generated by all users during the interaction when the live program was started last time; After that, obtain the real-time messages generated by all users during the interaction when the live broadcast program is started for the first time.
  • the messages received by users include messages sent by themselves and messages generated by third parties.
  • the users who can generate chat messages can be all students or teachers.
  • Chat messages generated by teachers or other students need to be displayed in the message list of the local display device in real time.
  • the messages generated by the display device at the local end are also displayed in the message list of the display device at the third end in real time.
  • the method for displaying the message by the third-end display device is the same as the method for displaying the message by the local-end display device, and details are not described here.
  • all messages need to be sorted in chronological order to generate a message list.
  • the sorting rules of the messages in the message list are from top to bottom, and they are displayed sequentially from late to late.
  • the message received earlier that is, the closer the generation time of each message is to the current time, the closer to the top of the message list, and the message closest to the current time is displayed at the top of the message list.
  • the controller sorts all messages according to the generation time of each message, generates a message list, and is further configured to perform the following steps:
  • Step 21 Obtain the generation time of each message.
  • Step 22 Sort all messages in the order of generation time from adjacent to the current time to far away from the current time to obtain a message sequence, and the message whose generation time is close to the current time is the first message in the message sequence.
  • Step 23 Generate a message list based on the message sequence, and the first message in the message sequence is located at the top of the message list.
  • the message corresponds to a sending time, that is, the generation time.
  • the controller sorts all the acquired information in the chronological order of the generation time. In order to ensure that the latest received message is at the top of the message list, it needs to be sorted in the order of generation time from near the current time to far away from the current time. Get the message sequence.
  • the current time refers to the time later than the generation time of each message, and at most is the same as the generation time of each message.
  • the current time can be the time to get all messages when the discussion control is launched, or the time to receive new messages.
  • the first message is the message whose generation time is close to the current time, that is, the latest message received at the latest.
  • the message list generated according to the message sequence can make the first message in the message sequence at the top of the message list, that is, the latest message received at the latest is displayed at the top of the message list, and the remaining messages are displayed according to the sorting result.
  • the current time is 9:05
  • the generation time of message 1 is 8:05
  • the generation time of message 2 is 8:06
  • the generation time of message 3 is 8:00
  • the generation time of message 4 is The time is 8:10
  • the message 5 is generated at 7:55.
  • the generation time of the five messages is sorted in the order from near to the current time to far away from the current time, which is 8:10>8:06>8:05>8:00>7:55.
  • the obtained message sequence is message 4 > message 2 > message 1 > message 3 > message 5. Then the first message in the message sequence is message 4, that is, message 4 is displayed at the top of the message list, and the remaining messages are displayed according to the sorting result.
  • the controller is further configured to perform the steps of:
  • Step 231 When the total number of messages exceeds the threshold of the visible number of messages in the message list, group all the messages in the message sequence according to the number corresponding to the threshold of the number of visible messages to obtain multiple message groups.
  • Step 232 based on each message grouping, generate a corresponding list page, each list page includes a number of display positions corresponding to the threshold of the number of visible bars, the first display position is located at the top of the list page, and the end display position is located in the list page. At the bottom of , the first message in the corresponding message group whose generation time is adjacent to the current time is displayed in the first display position.
  • Step 233 Paginate multiple lists showing message groups to generate a message list, and the multiple list pages are sorted based on the display order of each message in the corresponding message group.
  • the first few list pages display the number of messages corresponding to the visible number threshold, and the number of messages displayed in the last list page can be less than or equal to the number corresponding to the visible number threshold.
  • the visible area of the list display window is limited, so when a message list including several messages is displayed in the list display window, only part of the messages can be displayed. Therefore, the threshold for the number of visible messages in the visible message list is the threshold for the number of visible messages in the list display window.
  • all messages in the message sequence are grouped according to the number corresponding to the visible number threshold to obtain multiple message groups. For example, if the total number of all messages included in the message sequence is 53, and the number of visible message thresholds is 5, then the messages with bits 1-5 in the message sequence are divided into the first group, 6-10 The messages of bits are divided into the second group, the messages of 11-15 bits are divided into the third group, and the messages of 51-53 bits are divided into the eleventh group.
  • the first ten groups of message groups all include 5 messages, and the last group (eleven groups) of message groups includes 3 messages.
  • FIG. 27 is a schematic diagram of list paging in some embodiments of the present application.
  • Each display position is sorted in order, the first display position is at the top of the list page, the last (fifth) display position is at the bottom of the list page, and the first display position displays the first message in the corresponding message group whose generation time is adjacent to the current time. (eg message 1), the last display bit displays the last message (eg message 5) in the corresponding message group whose generation time is far from the current time.
  • each list page is the same as the grouping order of each message group, that is, each list page is sorted according to the display order of each message in the corresponding message group, and each message in each message group is generated according to the time from near the current time to far away. If the order of the current time is to be sorted, then each list page is also sorted according to the order of the generation time including each message from near the current time to far away from the current time.
  • FIG. 28 is a schematic diagram of a message list in some embodiments of the present application.
  • a message list is generated by paging multiple lists showing message groups, and the message list includes the messages in each list page sorted in order of generation time from near to the current time to far away from the current time.
  • the first list page includes messages of 1-5 digits in the message sequence (the first group of message groups)
  • the second list page includes messages with bits 6-10 in the message sequence (the second group of message groups)
  • the third list page includes messages with bits 11-15 in the message sequence (the third group of message groups)
  • tenth The list page includes messages of bits 46-50 in the message sequence (the tenth group of message packets)
  • the eleventh list page includes messages of bits 51-53 in the message sequence (the eleventh group of message packets).
  • the messages in the message list are sorted according to the generation time of each message, and the newest new message is at the first position, when displaying, it can be guaranteed that the latest received new message is displayed at the top of the message list.
  • FIG. 29 is a schematic diagram of displaying a message list on a user interface in some embodiments of the present application.
  • a list display window is presented in the message list area, the control focus is moved to the message list displayed in the list display window below the discussion control, and the control focus is on the message list top of the list.
  • the top of the message list displays the most recently received new message (message 1), while the historical messages (message 2, 3, 4, 5, etc.) are displayed in order from late to early. Therefore, users can By continuing to trigger the down key of the remote control, the control focus moves down in the message list, so that historical messages can be browsed sequentially from the latest message.
  • the user can trigger the up key on the remote control to move the control focus up along the message list , until you move to the latest news.
  • the message display method adopted by the display device provided by the embodiment of the present application enables the user to trigger the down key of the remote control from the discussion area tab, and the focus will be placed on the top of the message list, and the latest message will be positioned.
  • the user wants to view the historical messages in the message list press the down key of the remote control to start browsing down from the new message at the top. If the user wants to go back to the discussion area tab, just trigger the up key on the remote control. It can be seen that the operation of the user returning to the "discussion area" tab (pressing the up key) will not conflict with the operation of browsing historical messages (pressing the key). It conforms to the user's browsing habits and improves the user experience.
  • each student and teacher participating in the live class can implement text chat through the discussion area tab. Therefore, new messages generated by each of them need to be synchronized to other students or teachers.
  • the controller is further configured to perform the following steps:
  • Step 41 Receive a new message generated when the user performs an input operation based on the input box displayed in the list display window.
  • Step 42 Display the new message at the top of the message list, and send the new message to the server, and the server is used for sending the new message to the list display window of the third terminal device for display.
  • a list display window is presented in the message list area, and at the same time, an input box is displayed in the list display window, and the user can input text through the input box to generate a new message.
  • Third-end users can also generate new messages through input boxes in the user interface displayed in the display device they use.
  • the local user After the local user performs an input operation through the input box, after a new message is generated, it is directly displayed at the top of the local message list. At the same time, the new message is sent to the server, and the server forwards the new message to other third-end devices. to display the window of the list displayed in the third-end device, specifically, the top of the message list displayed in the third-end device.
  • the server When the server forwards the new message from the local end to other third-end devices, the server needs to first determine whether the new message sent by the local end is successful. If there is a bad network or a server failure, the new message from the local end will fail to be sent. Therefore, only when the server detects that the new message from the local end is successfully sent, will the new message be forwarded to other third-end devices for display.
  • the controller is further configured to perform the following steps:
  • Step 51 Receive a failure notification generated by the server when judging that the sending of the new message fails.
  • Step 52 In response to the failure notification, generate a sending failure prompt box, and display the sending failure prompt box on the side of the display position of the new message.
  • the server If the server detects that the new message from the local end fails to be sent due to network problems or server failure, it will receive a failure notification returned by the server, indicating that the new message from the local end cannot be sent to other third-end devices for display.
  • FIG. 30 is a schematic diagram of an interface when a new message is sent abnormally in some embodiments of the present application.
  • a sending failure prompt box can be displayed in the list display window. Specifically, the sending failure prompt box is displayed in the new message of the sending failure. The side where the message is located.
  • the sending failure prompt box can be displayed in the form of an abnormal pattern, for example, the abnormal pattern can be represented by a "red exclamation mark".
  • the user can browse historical messages based on the multiple list pages.
  • the user can browse historical messages based on the multiple list pages.
  • the controller upon receiving a new message, is further configured to perform the following steps when performing the display of the new message at the top of the message list:
  • Step 421 Determine whether the first visible message in the message list is the message displayed in the first display position of the first list page, and the first list page refers to the list page located at the first position in the message list.
  • Step 422 If yes, display the new message in the first display position of the first list page, and move the previously displayed message in the first list page down one place for display, and display it at the end of the first list page. The message in the slot scrolls to the first display slot in the next list tab for display.
  • the local end After the local end receives a new message, it first determines whether the first visible message in the current message list is the message displayed at the top of the message list, that is, whether it is the message displayed in the first display position of the first list page.
  • the bit-visible message refers to the first message that can be seen among the partial messages displayed in the message list in the list display window.
  • the list page being browsed is in the visible area of the list display window. Therefore, if the first visible message in the message list is the message at the top of the message list, it means that the current user has not browsed the historical messages in the message list; if the first visible message in the message list is not the message at the top of the message list, it means The current user is browsing the historical messages in the message list.
  • the received new message can be directly displayed at the top of the message list, that is, displayed in the first display position of the first list page .
  • the message originally located in the first display position of the first list page will be displayed as a historical message moved down by one position, that is, displayed in the second display position.
  • the total number of messages in the first list page exceeds the visible number threshold.
  • the message originally located at the last display position of the first list page can be moved to the next list page for display, specifically, moved to the first display position of the second list page for display.
  • the message displayed at the end of the second list page is moved to the next list page for display, and so on, all historical messages in the message list are moved down one place for display.
  • FIG. 31 is a schematic diagram of displaying a new message in a message list in some embodiments of the present application.
  • each display slot in the first list page displays message 1, message 2, message 3, message 4, and message 5 in sequence
  • each display slot in the second list page displays message 6, message 7, Message 8, Message 9, Message 10.
  • the new message is displayed in the first display position of the first list page, that is, the display position of the original message 1 .
  • the message 1 originally located in the first display position of the first list page will be displayed as a historical message moving down one place, that is, displayed in the second display position; and so on, the original display will be displayed at the end of the first list page.
  • the message 5 of the bit is displayed in the first display slot in the second list page.
  • the rest of the messages are displayed accordingly, refer to the content shown in FIG. 31 , and details are not repeated here.
  • the controller when it is determined that the first visible message in the message list is not the message at the top of the message list, it indicates that the user is browsing historical messages at this time, and at this time, the controller is further configured to perform the following steps:
  • Step 423 If the first visible message of the message list is not the message displayed in the first display position of the first list page, then display the new message in the first display position of the first list page in the background, and generate a new message. Message reminder interface.
  • Step 424 Display the new message reminder interface in the list display window.
  • the local display device After the local display device receives a new message (either a message sent by itself or a message sent from a third-end device) and determines that the first visible message in the message list is not the message at the top of the message list, it means that the user is currently Browsing historical messages in other list pages, in order to avoid affecting the user's process of browsing historical messages, at this time, only new messages are displayed in the background in the first display position of the first list page without scrolling the message list to the top. That is, the message list is kept in its current state.
  • a new message either a message sent by itself or a message sent from a third-end device
  • a new message reminder interface can be generated synchronously when the new message is displayed in the background, and the new message reminder interface is displayed in the list display window.
  • FIG. 32 is a schematic diagram of an interface displaying a new message reminder interface in a message list according to some embodiments of the present application.
  • the new message reminder interface when displaying the new message reminder interface, it can be displayed at the bottom of the list display window, specifically at the bottom of the currently browsed list page, so as to avoid obscuring the information in the currently browsed list page.
  • the content of the new message reminder information can be generated based on the number of new messages received by the local end. If the user receives multiple new messages in the process of browsing historical messages, the local end can generate corresponding reminder information including the number of new messages. For example, new message reminder information is presented in the new message reminder interface, and the content of the information may be "You have received X new messages".
  • the controller is further configured to:
  • Step 61 In response to the user's downward browsing instruction for browsing any message in the message list generated based on the discussion control, move the control focus from the discussion control to the first display position of the first list page in the message list.
  • Step 62 When the control focus is moved to the last display position of the first list page, a loading state prompt box is generated, and the loading state prompt box is displayed at the bottom of the first list page.
  • the controller responds to the downward browsing instruction to move the control focus from the discussion control to the top of the message list, that is, to the first display position of the first list page in the message list.
  • the down key of the remote control is triggered continuously, so that the control focus moves down on the currently browsed list page.
  • control focus moves to the display position at the end of the currently browsed list page, it means that the user has browsed to the last message in the current list page.
  • a loading status prompt appears at the bottom of the browsed list tab.
  • FIG. 33 is a schematic diagram of an interface showing a loading state prompt box in a message list in some embodiments of the present application.
  • the user when the user browses to the last message of the currently browsed list page by triggering the down key of the remote control, for example, when browsing to the message on the display position at the end of the first list page, the user can A loading status prompt box is automatically displayed at the bottom of the message, and the prompt information in the loading status prompt box can be "Loading".
  • the controller when paging through the historical messages, the controller is further configured to perform the following steps:
  • Step 63 Acquire the messages in the second list page in the message list in response to the system notification generated when the loading state prompt box is generated.
  • Step 64 When the display duration of the loading state prompt box reaches the preset time threshold, display the messages in the second list page at the bottom of the first list page.
  • the loading state prompt box After completing the message browsing in the current list page, the loading state prompt box is displayed synchronously.
  • a system notification can be generated while the loading state prompt box is generated.
  • the controller receives the system notification and can Get the message in the next list pagination in the message list. For example, if the currently browsed list page is the first list page, the information in the second list page will be obtained; if the currently browsed list page is the second list page, the information in the third list page will be obtained.
  • the messages in the next list page must be obtained.
  • the display time of the loading state prompt box reaches the preset time threshold, the acquired messages in the next list page can be displayed at the bottom of the currently browsed list page, for example, the messages in the second list page can be displayed in the first page.
  • the bottom of a list pagination at the same time, cancel the display of the loading status prompt box.
  • each message in the second list page is displayed in a continuous state below the last message in the first list page, for example, the second list page is displayed.
  • the message 6 on the first display position in the page is displayed below the message 5 on the last display position in the first list page, and other messages are displayed in sequence.
  • the down key is triggered again to automatically obtain the messages in the next list page, and the user can trigger the remote control to click the The key continues to move the control focus down so that the user can browse older chats.
  • the controller is further configured to perform the following steps:
  • Step 71 When the control focus is on any display position in the message list, receive a return instruction generated by the user triggering the return key.
  • Step 72 in response to the return instruction, move the control focus from any display position in the message list to the discussion control, and display the paging message of the first list of the message list in the list display window, and the first page of the list display window.
  • a visible message is the message on the first display slot of the first list pagination.
  • the user can trigger the return key of the remote control to generate a return instruction.
  • FIG. 34 is a business flow diagram of a method for displaying a message in some embodiments of the present application.
  • the controller can move the control focus originally located on a browsed message display position to the discussion control.
  • the message list is automatically scrolled to the top, that is, the message of the first list page of the message list is displayed in the list display window, and the first visible message of the list display window is the message on the first display position of the first list page. .
  • the controller is further configured to perform the following steps:
  • Step 81 Receive a switching instruction generated when the user switches from another control to a discussion control.
  • Step 82 in response to the switching instruction, move the control focus from other controls to the discussion control, and display the paging message of the first list of the message list in the list display window, and the first visible message of the list display window is the The message on the first display slot of a list pagination.
  • Other controls in the user interface include the student list tab and various functional controls in the display ribbon.
  • a switching instruction is generated to move the control focus from other controls to the discussion control. superior.
  • the controller After the controller receives the switching instruction, it can move the control focus originally located on other controls to the discussion control. At the same time, in order to facilitate users to view the latest news, the message list is automatically scrolled to the top, that is, the paged message in the first list of the message list is displayed in the list display window, and the first visible message in the list display window is the paged page of the first list. The message on the first display.
  • the display device can display the new message at the top of the message list when receiving a new message, and when the user uses the direction keys of the remote control to switch from other controls to the discussion control, it can display the new message at the top of the message list.
  • the message list is automatically scrolled to the top, and when browsing historical messages, when the control focus is on the display position of any message, the return key can be triggered to automatically scroll the message list to the top.
  • it can ensure that new messages are always displayed at the top of the message list, ensuring that users can view the latest received new messages in time when browsing historical messages, and they will not switch the controls in the user interface when browsing historical messages. Conflicts are generated between operations, which is convenient for users to browse messages.
  • FIG. 25 is a flowchart of a method for displaying a message in some embodiments of the present application.
  • the present application also provides a method for displaying a message, which is executed by the controller in the display device provided in the foregoing embodiment, and the method includes:
  • the method for displaying messages and the display device provided by the embodiments of the present application when triggering the discussion control, acquire the messages generated by all users participating in the live broadcast program during the interaction, and rank the messages according to the generation time of each message. All messages are sorted, a message list is generated, and displayed in the list display window, so that the latest received message is displayed at the top of the message list. It can be seen that with the method and display device provided by the embodiments of the present application, all messages are sorted according to the generation time from late to early, and the latest message is placed at the top of the message list, so that when the user triggers the down button on the remote control from the discussion control, the focus is controlled. On the new message that falls on the top of the message list, the historical message can be browsed downward from the new message at the top, which is more in line with the operation logic of the user using the buttons of the remote control, and is convenient for the user to browse the historical message.
  • a live class application may be configured within the display device.
  • the teacher-side display device and the student-side display device are respectively equipped with their own live class application programs. After the teacher and each student log in to the app, they can enter the live broadcast room to realize the live broadcast of the target live class.
  • the commonly used recording method is to use the screen recording method to record all the content of the live class, and students can directly play the video file when they watch it back.
  • all students see the same content, lack of personalization, and in the actual live class, student A is asked and answered questions by the teacher, and student B is not answered by the teacher, then the experience of student A and student B
  • the courses are different.
  • all students can only watch passively when reviewing, lack of interactivity, unable to attract students to focus on video files, resulting in poor experience for students.
  • the embodiment of the present application proposes a method for reviewing a live class, which can restore the scene of the online live class during the review process of the live class, so that students can experience the process of the live class again. Improve the concentration of students. In addition, during the review, it can also provide students to participate in the course of the review of the live broadcast class to achieve some interaction and improve the user experience.
  • FIG. 35 is a schematic diagram of an application scenario of a live class in some embodiments of the present application.
  • the teacher and the student use their own display devices to participate in the live class process, such as teacher A1, teacher A2... ...Teacher AN, student B1, student B2, student BN.
  • the teacher and the student use their respective display devices, install the live class application program in each display device, and log in to their respective accounts to obtain the teacher-side display device 201 and the student-side display device 202 .
  • the teacher-side display device 201 and the student-side display device 202 are connected to the service server 500 and the live broadcast server 600 respectively.
  • the service server obtains the contents of each class.
  • the interactive data of the teacher-side display device 201 and each student-side display device 202, and the database 501 is configured in the business server 500 to store the interactive data obtained by the business server; the live broadcast server 600 realizes the online live broadcast of the teacher and the students and the content of the live broadcast. to record.
  • the business server In order to ensure that students can interact in real time when reviewing the video files recorded by the live class, on the one hand, it is necessary to use the business server to store the interactive data generated by the teacher and the students during the live class, and use the live server to record the live class screen to form a video file; On the one hand, when reviewing, the video file is played, and based on the time axis of the video file, the interactive data generated by the teacher and the interactive data generated by the students are correspondingly displayed based on the interactive logo, so as to realize the real-time interaction of the students when reviewing the video files.
  • the embodiment of the present application provides a server, which is applied to a business server.
  • the live class screen and interactive data need to be stored separately during recording. , that is, only the content of the teacher's lecture is recorded, and the interaction data between the teacher and the students is stored in the database of the business server based on the timeline of the live class.
  • the interaction data includes the interaction data generated by the teacher and the interaction data generated by the students.
  • Fig. 36 is a flowchart of a method for recording a live class in some embodiments of the present application
  • Fig. 37 is an interactive flowchart of a method for recording a live class in some embodiments of the present application.
  • a server provided by an embodiment of the present application includes: a database and a controller, where the database is configured to store student interaction data, teacher interaction data, and video file information; the controller is connected to the database and performs live broadcast When recording the lesson method, the controller is configured to perform the following steps:
  • the teacher-side display device enters the live broadcast room where the live class is located, and the teacher-side live class interface is displayed on the monitor of the teacher-side display device.
  • FIG. 38 is a schematic diagram of displaying a live class interface on the teacher terminal in some embodiments of the present application.
  • the teacher-side live class interface displays a course content area, a student video area, a teacher video area, and a live broadcast information display area, which enables three-screen classes.
  • the student video area is used to display student images
  • the teacher video area is used to display teacher images
  • the student images and teacher images are captured by a camera (such as the image collector in Figure 3) configured with the display device used by them.
  • the course content area displays the live screen
  • the lower part of the course content area displays the main functional area, which is used to switch functions such as handouts, whiteboards, and videos.
  • the lower part of the main functional area displays the live broadcast operation buttons and the team competition.
  • the live broadcast operation buttons include buttons such as paintbrush, start live broadcast (switch to pause live broadcast after opening), and end live broadcast.
  • the teacher can divide the students participating in the live class into two teams, such as the Tiger team and the Wangwang team, and accumulate points by answering questions during the class. High, the students of the team will receive corresponding rewards.
  • the team competition situation displays the points of the two teams in real time.
  • the live broadcast information display area in the live class interface of the teacher terminal is used to provide the live broadcast information of the current live class, including discussion area, student list and classroom practice.
  • the discussion area is used to realize real-time text (or voice) discussion and interaction between teachers and students, and between students and students during live classes.
  • the student list is used to display the current live class number and student information.
  • In-class practice is used to realize the function of teacher's online real-time questioning. During the live class, the teacher can use the in-class practice to create real-time questions and push them to the students, and students can answer the questions through the display device they use.
  • FIG. 39 is a schematic diagram of displaying a live class interface on the student side in some embodiments of the present application.
  • the student-side display device when the live class starts, the student-side display device also enters the live room, and the student-side live class interface is displayed on the monitor of the student-side display device.
  • the student-side live class interface displays the course content area, student video area, teacher video area, functional area and team competition.
  • the live class screen in the course content area is the same as the live class screen in the course content area on the teacher's live class interface.
  • the teacher video area is used to display the teacher's image
  • the student video area is used to display the student's image. When there are multiple students taking live classes at the same time, multiple student images are displayed in the student video area. If the teacher is connected to one of the students during the live class, the image of the connected student will be displayed in the course content area.
  • the functional area is used to realize the interactive functions of students during the live class, including functional controls such as microphone, camera, raising hand, brush, and discussion.
  • functional controls such as microphone, camera, raising hand, brush, and discussion.
  • the camera controls are used to control whether or not to capture images of the students themselves.
  • the brush function control is used to perform corresponding brush operations according to the authorization of the teacher, such as adjusting the brush style, scribbling, painting, etc.
  • the brush style includes but is not limited to brush shape, color, thickness, font, etc.
  • students can scribble on the touchscreen display with a stylus used with the display device, or they can scribble directly on the touchscreen display with their fingers.
  • the discussion control can realize real-time text discussion and interaction between teachers and students, and between students and students. You can refer to the discussion area function in the live class interface of the teacher.
  • the team competition displayed on the student side is used to display the team and the score of the team that the student joined.
  • the name size of the team the student belongs to is larger than the size of the name of the other team. As shown in Figure 39, the student joins the Tiger team.
  • the teacher clicks the start live button on the teacher's live class interface displayed on the teacher's display device to start the class, and generates an instruction to start recording the live class, which is sent to the live server for live broadcasting.
  • the server is used to realize the live class of the live class, and at the same time, the course content area in the live class interface of the teacher terminal display device displays the live class picture.
  • FIG. 40 is a schematic diagram of recording a live class in some embodiments of the present application.
  • the live server After the live server receives the instruction to start recording the live class, it starts to record the video data.
  • the video data includes the live class screen, the teacher's image displayed in the teacher's video area, and the voice data of the teacher and the students. See the two boxes in Figure 40.
  • the living area is the live class screen displayed in the course content area and the teacher image displayed in the teacher video area. If during the live class, the teacher and one of the students are connected to the microphone, the image of the student will be displayed in the course content area.
  • the live class screen includes the course content and the image of the student connected to the microphone.
  • the live server pushes the live class screen to each student's display device.
  • the display content of the live class screen on the teacher's display device is the same as the display content of the live class screen on the student's display device.
  • the teacher will generate interactive data in real time. For example, based on the content of the live class, the teacher will ask different questions in real time for students to answer.
  • Interactive buttons are displayed in the live broadcast room corresponding to the display device on the teacher's side.
  • the practice button displayed in the live broadcast information display area.
  • the teacher interactive information includes the interactive serial number, interactive content, interactive options and correct interactive results.
  • the interactive serial number is used to represent the question number of the question issued by the teacher
  • the interactive content is used to represent the question and type of the question issued by the teacher
  • the interactive option is used to represent the alternative answers to the question
  • the interactive correct result is used to represent the correct answer to the question issued by the teacher.
  • FIG. 41 is a schematic diagram of an interface for practicing in class in some embodiments of the present application.
  • the teacher clicks the Practice button to enter the practice interface.
  • the teacher sets the interactive serial number (question number), interactive content (question), interactive option (alternative answer) and interactive correct result (correct answer) on the classroom practice interface, and then clicks the question button to complete an interactive action (outcome). question operation).
  • the interactive content specifies the question stem and question type.
  • the teacher-side display device sends the teacher interaction information to the service server for storage after responding to the question-setting instruction (interactive instruction) generated by triggering the question-setting button. After the teacher performs one interaction, the teacher interaction data is generated. For example, each time the teacher asks a question, a teacher interaction data including the teacher interaction information is generated.
  • the teacher can set the display time of each question during the question-making stage, that is, the time for students to answer the question; the teacher can also manually end the answer. Click the end answering button shown in Figure 41, the answering is over, and the student will no longer be able to answer the question.
  • the time zone displayed on the classroom practice interface displays the current student's answering time.
  • the answering time refers to the time corresponding to the time when the teacher clicks the question button to the time when the end answering button is clicked, or it refers to each question set by the teacher. display duration.
  • the business server detects the instruction of the teacher's display device in real time. If it detects that the teacher's display device generates a question-making instruction (interactive instruction), it means that the teacher clicks the "Learn in class" button and completes a question-setting action, and then obtains the teacher's instruction generated by the teacher's display device.
  • Interactive data During the live class, the teacher will perform multiple interactive actions, that is, there will be multiple questions, so multiple teacher interaction data will be generated.
  • the business server After the teacher completes a question, an interactive action is performed, and the business server sends the teacher's interactive data to the student-side display device for display. If there are multiple students participating in the live class, the teacher interaction data will be displayed on each student display device, that is, the topic information generated by the teacher will be displayed.
  • FIG. 42 is a schematic diagram of an interface for displaying teacher interaction data on a student-side display device in some embodiments of the present application.
  • the student display device after receiving the teacher interaction data sent by the teacher side display device, the student display device generates an interactive interface based on the teacher interaction data, and the interactive interface displays the interaction sequence number, interaction content and Interactive options are displayed and the submit button is displayed.
  • the correct interactive results are not displayed during the question-making stage, and will be displayed after the students have completed their answers.
  • the interactive interface is displayed in the upper floating layer of the course content area in the form of a floating window. Students can use a stylus, remote control or finger to click on any interactive option displayed in the interactive interface. After completing the selection, click the submit button to complete the current process. student interaction.
  • the interactive serial number is "8”
  • the interactive content is “question and multiple-choice questions”
  • the interactive option is "ABCD”
  • the submit button, etc. and each interactive option is in a triggerable state, submit Buttons are schematically placed to the right of the interactive options.
  • the video file information refers to the data generated by the live server in response to the end recording instruction of the live class generated by the teacher display device. file information.
  • each corresponding student can interact according to the teacher interaction data displayed on the interactive interface displayed on the display device used by each student, that is, according to the questions and interaction options,
  • the learner clicks on one of the interactive options that they think matches the question as an answer.
  • the student clicks one of the interactive options, and then clicks the submit button the student interaction data is generated, and the student interaction data includes the content of at least one interactive option clicked by the student, that is, the student's answer.
  • the time when the interaction is generated is the time when the student interaction data is generated, and the student interaction data, the corresponding generation time, and the student ID are sent to the business server for storage.
  • the live room in the student display device displays the live class screen.
  • an interactive interface is generated based on the teacher interaction data and displayed on the upper layer of the live class screen.
  • the student interacts based on the teacher's interactive information displayed in the interactive interface. If the current student triggers the interactive option A based on the topic with the interactive serial number "8", and then clicks the submit button, the student interaction data is generated. , the student interaction data is the content corresponding to the interaction option A.
  • the teacher will generate multiple teacher interaction data, and according to the time sequence, the business server will push it to the student's display device in turn.
  • the data will correspond to the generation of multiple student interaction data.
  • the teacher clicks the end live broadcast button displayed in the live broadcast room (which can be located at the bottom of the live broadcast class screen), generates a live broadcast end recording instruction to the live broadcast server, closes the live broadcast room of the live broadcast class, and the live broadcast class recording ends.
  • the live class is in a state that has ended but cannot be watched back.
  • the live server In response to the recording instruction at the end of the live class, the live server generates a video file according to the live class screen recorded during the live class, the teacher's image in the teacher's video area, and the voice information of the teacher and the student.
  • the live server generates video file information based on the video file, and sends it to the service server.
  • the video file information includes the video file review address and the video file timeline.
  • the video file review address refers to the URL address that can access the video file.
  • the video file timeline is used to represent the video duration of the video file.
  • the video file timeline and live broadcast The time axis is the same when the class is in session.
  • the business server can change the course status of the live class to a replayable state, so as to remind students that they can click to watch it back.
  • a review button can be displayed in the live class display interface, which is convenient for students to trigger to review the video file.
  • FIG. 43 is a schematic display diagram of the display interface of the live class on the student side in some embodiments of the present application.
  • the student-side display device after completing the live class, the student-side display device returns to the live class display interface, where the live class display interface presents a date selection area and a list of live classes that the student has finished or is about to take.
  • the date selection area is used to display the date.
  • Each date corresponds to a list of live classes that exist every day.
  • Each live class in the live class list corresponds to the live class status.
  • the live class status includes but is not limited to live broadcast status, upcoming live broadcast status, and available live broadcast status. Check back the status.
  • a replay button is displayed on the right side of the corresponding live class, such as "Watch Playback", to modify the course status of the live class to a replayable state.
  • Watch Playback When students want to watch the live class, they can click the watch button to enter the live class review interface for review.
  • the business server needs to store the interactive data and video file information separately and store them in the database.
  • it can be used as a storage identifier with the live class ID of the live class, and the interactive data and video file information can be stored after establishing a corresponding relationship with the live class ID, so as to facilitate subsequent accurate retrieval of interactive data and video files based on the live class ID. information.
  • the controller in the business server is further configured to perform the following steps when executing sending the teacher interaction data to a database for storage:
  • Step 1411 Obtain the live class ID and live class timeline of the live class, as well as the start time, duration and teacher interaction information generated by the teacher-side display device when each interactive action is performed.
  • the interactive action means that the teacher-side display device is based on the The action generated by the interactive button displayed on the live class screen.
  • the live class screen refers to the screen displayed by the teacher-side display device after the instruction to start recording the live class is generated.
  • Step 1412 based on the corresponding start time, duration and teacher interaction information of each interaction action, generate teacher interaction data corresponding to each interaction action performed by the display device on the teacher side.
  • Step 1413 based on the time correspondence between the live class timeline and the start time of each interactive action, correspondingly add a teacher interaction logo on the live class timeline.
  • Step 1414 Create a corresponding relationship between each teacher interaction data, live class ID, teacher interaction ID, and live class timeline, and store the corresponding relationship in the database.
  • each teacher interaction data is also stored in chronological order.
  • the teacher interaction identifier is used to indicate that teacher interaction data exists at the current moment of the live class timeline.
  • the live class ID is used to represent the name or serial number of the live class conducted by the teacher and the students to distinguish it from other live classes;
  • the live class timeline is used to represent the duration of the live class.
  • the interface of the live broadcast room where the live class screen is located displays an interactive button (in-class practice button).
  • the interactive action is the action of the question
  • the start time is used to represent the time point when the question is generated, that is, the time point when the question button is clicked
  • the duration is used to represent the display time of the question
  • the teacher interaction information is the question information proposed by the teacher.
  • Teacher interactive information refers to the interactive serial number, interactive content, interactive options and correct interactive results generated by the teacher's display device.
  • the start time, duration and teacher interaction information corresponding to each interaction action are the teacher interaction data corresponding to the interaction action.
  • each interactive action Correspond the start time of each interactive action to the time on the live class timeline, for example, if the start time of interactive action 1 is 0:23:28 and the duration is 5 seconds, it will be 23 minutes 28 on the live class timeline Add the teacher interaction identifier 1 at the second to establish an association with the teacher interaction data generated by the interaction action 1, and set the display time of the teacher interaction data to 5 seconds. If the start time of interactive action 2 is 0:35:50 and the duration is 6 seconds, add teacher interaction logo 2 at 35 minutes and 50 seconds on the live class timeline to correspond to the teacher interaction data generated by interactive action 2. And set the display time of teacher interaction data to 6 seconds.
  • the time correspondence between each interactive action and the live class timeline is used as the correlation benchmark, and the corresponding interaction data of each teacher, the ID of the live class, the interaction ID of each teacher and the live class timeline are established correspondingly, and the corresponding relationship is established.
  • This correspondence is stored in the database.
  • each time the teacher performs an interactive action a corresponding relationship is generated.
  • the corresponding several corresponding relationships can be uniformly stored in the server after the live class ends. It can also be immediately stored to the service server every time a corresponding relationship is generated. That is to say, the execution process of storing the corresponding relationship may occur after the end of the live class, and the execution process of storing the corresponding relationship in the database may also occur after the business server receives the teacher interaction data sent by the teacher-side display device, that is, After receiving the teacher interaction data, the business server sends it to the database for storage, and then pushes the teacher interaction data to display devices on each student side for display.
  • the specific storage process can be performed according to the actual application, which is not specifically limited here.
  • the controller in the business server is further configured to perform the following steps when executing sending the student interaction data to a database for storage:
  • Step 1421 Obtain the live class ID and live class timeline of the live class, as well as the student ID corresponding to each student display device, each student interaction data, and the generation time point of each student interaction data.
  • Step 1422 Request the stored teacher interaction information from the database, where the teacher interaction information refers to the information generated when each interaction action is performed by the display device on the teacher side.
  • Step 1423 Based on the teacher interaction information and each student interaction data, determine the interaction result of each student interaction data.
  • Step 1424 Based on the time correspondence between the live class timeline and the generation time point of each student interaction data, correspondingly add a student interaction identifier on the live class timeline.
  • Step 1425 Establish each student ID, each student interaction data, the interaction result corresponding to each student interaction data, the generation time point of each student interaction data, each student interaction ID, the live class ID and the live class timeline. The corresponding relationship is stored in the database.
  • Each student will generate a corresponding student interaction data based on one teacher interaction data. Therefore, in order to ensure that the student interaction data is displayed corresponding to the live class timeline, it is necessary to base multiple student interaction data on the live class timeline, that is, during the live class time. Add student interaction identifiers on the axis, and add student interaction identifiers in the chronological order of the generation time point of each student interaction data. During storage, each student interaction data is also stored in chronological order. The student interaction identifier is used to indicate that there is student interaction data at the current moment of the live class timeline.
  • each student ID is used to distinguish all students in the live broadcast room, such as student B1, student B2, student BN, etc.
  • the same student will generate multiple student interaction data, and the number of student interaction data is the same as the number of teacher interaction data.
  • Figure 44 is a comparison table of student interaction data in some embodiments of the present application. Referring to Figure 44, if the teacher interaction data is m, the student interaction data generated by each student is m. For example, student B1 generates m student interaction data, student B2 generates m student interaction data, and student BN generates m student interaction data. m student interaction data.
  • the time points of the multiple student interaction data generated by it correspond to the generation time point of the teacher interaction data. Therefore, it is necessary to obtain the generation time point of each student interaction data, and the generation time point is to select a certain interaction for the student.
  • the corresponding time when the submit button is clicked after the option is selected.
  • m pieces of student interaction data generated by student B1 correspond to generation time points t1 B1 , t2 B1 ?? tm B1 .
  • the m pieces of student interaction data generated by student B2 correspond to the generation time points t1 B2 , t2 B2 Hence tm B2 .
  • the business server When the business server stores the student interaction data, it also needs to judge the correctness of the student interaction data, and store the judgment result synchronously.
  • the information for judging the correctness is stored in the database. Therefore, the business server needs to obtain interactive information from the server, and the interactive information includes the correct result of the interaction.
  • the business server makes a correctness judgment according to the interaction data of a certain student and the correct interaction result, so as to obtain a corresponding interaction result, and the interaction result can be "correct” or "incorrect and provide the correct answer”.
  • Correspond the generation time point of each student interaction data with the time on the live class timeline and add the student interaction identifier. For example, if the generation time point t1 B1 of student interaction data S1 B1 of student B1 is 0:23:30, then Add the student interaction identifier M1 B1 at 23 minutes and 30 seconds on the live class timeline to establish an association with the student interaction data S1 B1 ; if the generation time point t2 B1 of the student interaction data S2 B1 of the student B1 is 0:35:55, Then, the student interaction identifier M2 B1 is added on the live class timeline at 35 minutes and 55 seconds to establish an association with the student interaction data S2 B1 .
  • each student interaction data corresponding to each student and the live class timeline is used as the correlation benchmark, and each student ID, each student interaction data, the interaction result corresponding to each student interaction data, each A corresponding relationship is established between the generation time point of each student interaction data, each student interaction identifier, the live class ID, and the live class timeline, and the corresponding relationship is stored in the database.
  • a student generates several corresponding relationships, and a corresponding relationship includes a student ID, a student interaction data, a generation time point, an interaction result, a student interaction ID, a live class ID, and a live class timeline.
  • the corresponding relationship L1 B1 generated by student B1 includes student B1, student interaction data S1 B1 , generation time point t1 B1 , interaction result P1 B1 , student interaction identifier M1 B1 , live class ID and live class timeline; the corresponding relationship L2 B1 Including student B1, student interaction data S2 B1 , generation time point t1 B2 , interaction result P2 B1 , student interaction ID M2 B1 , live class ID and live class timeline, and so on for other students.
  • the content shown in Figure 44 please refer to the content shown in Figure 44 .
  • the controller in the service server is further configured to: send the interaction result of each student interaction data to the corresponding student display device, and each student display device displays the corresponding interaction result.
  • the business server needs to return the interactive results generated by the student to the corresponding student-side display device for display in the live class. screen to inform students of their answering results.
  • the interactive result includes the correct answer result and the interactive correct result.
  • the correct answer result includes "correct” and "false”
  • the interactive correct result is the correct answer.
  • the video file information includes a video file review address and a video file timeline; and, the controller in the service server is further configured to perform the following steps when executing sending the video file information to a database for storage:
  • Step 1431 Obtain the live class ID of the live class and the teacher ID corresponding to the teacher-side display device.
  • Step 1432 based on the teacher ID, the video file review address, and the video file timeline, generate video file information of the live class corresponding to the live class ID.
  • Step 1433 Store the video file information corresponding to the live class ID in the database.
  • the live server After generating the video file, the live server sends the video file information to the service server.
  • the service server will not directly store video files to avoid taking up too much space, but instead will store video file information.
  • the service server can access the video file based on the video file review address.
  • the live class ID and the teacher ID are respectively corresponding to the video file information, so that the corresponding video file information can be obtained according to the live class ID and the teacher ID during subsequent review.
  • the teacher ID, video file review address, and video file timeline are used to generate the video file information of the live class corresponding to the live class ID, and store it in the database for easy retrieval later.
  • the live class detailed information is generated based on the teacher interactive data, the student interactive data and the video file information, and stored in the service server database.
  • the server provided by the embodiment of the present application is applied to the business server, and can obtain the teacher interaction data generated by the teacher-side display device in real time during the live class process, and the student-side display device based on the student interaction data generated by the teacher interaction data. And, the video file information recorded by the live server including the live class screen.
  • the teacher interaction data, student interaction data and video file information are stored in the database respectively, so that when the students review the video files, they can simultaneously display the teacher interaction data and/or the student interaction data while watching the video files, so that the students can experience the scene again. Live class, and you can participate in the live class during the review process to interact and improve user experience.
  • the embodiment of the present application provides a display device, which is applied to a student-side display device.
  • real-time interaction is required, an interactive interface is generated in the live class review screen for students to interact.
  • FIG. 45 is a flowchart of a method for reviewing a live class in some embodiments of the present application
  • FIG. 46 is an interactive flowchart of a method for reviewing a live class in some embodiments of the present application.
  • a display device provided by an embodiment of the present application includes: a display and a controller, the display is configured to present a live class display interface, and the live class display interface displays a review corresponding to the live class ID button; the controller is connected to the display, and when executing the live lesson review method, the controller is configured to perform the following steps:
  • S21A in response to a live lesson review instruction generated by triggering the review button, generate a live lesson review interface including a video playback window, a play button and a student data display button.
  • the live class display interface shows that there are multiple live classes. Classes, each live class correspondingly displays a review button. Multiple live classes can be distinguished by their respective live class IDs, and a live class ID is bound to a review button.
  • the controller When a student selects one of the live classes for review in the live class display interface, click the review button corresponding to the selected live class to generate a live class review instruction carrying the live class ID.
  • the controller generates a live class review interface in response to the live class review instruction, and switches the live class display interface displayed on the monitor to display the live broadcast class review interface.
  • FIG. 47 is a schematic diagram of an interface for viewing a live class in some embodiments of the present application. See Figure 47.
  • the student-side live class review interface includes a video playback window, a play button, and a student data display button.
  • the video playback window is used to play the video files generated during the recording of the live class
  • the play button is used to control the playback and pause of the video file
  • the student data display button is used to control whether the student interaction data needs to be displayed synchronously when the live class is replayed.
  • S22A Obtain from the service server video file information, teacher interaction data, and student interaction data corresponding to the live class ID, where the video file information refers to the video files including the live class screen recorded during the live class and the data corresponding to the live class timeline.
  • Video file timeline teacher interaction data refers to the interactive data generated by the teacher during the live class and corresponding to the live class timeline
  • student interaction data refers to the student interaction data generated during the live class based on the teacher's interactive data and corresponding to the live class timeline.
  • live class details include video file information, teacher Interaction Data and Student Interaction Data.
  • the controller of the display device on the student side is further configured to perform the following steps when obtaining the video file information, teacher interaction data and student interaction data corresponding to the live class ID from the service server:
  • Step 221 In response to the live class review instruction, send a live class detail request carrying the live class ID to the business server, and the live class detail request is used to instruct the business server to obtain the live class detail information corresponding to the live class ID from the database.
  • the detailed information includes teacher ID and video file information.
  • Step 222 Receive the live class details information corresponding to the live class ID returned by the service server.
  • Step 223 Send the interactive data request carrying the teacher ID to the business server, and the interactive data request carrying the teacher ID is used to instruct the business server to obtain the teacher interactive data corresponding to the teacher ID from the database.
  • Step 224 Receive teacher interaction data corresponding to the teacher ID returned by the service server.
  • Step 225 Send the interactive data request carrying the student ID to the business server, and the interactive data request carrying the student ID is used to instruct the business server to obtain the student interactive data corresponding to the student ID from the database.
  • Step 226 Receive the student interaction data corresponding to the student ID returned by the business server.
  • the student triggers the review button of a live class to generate a live class review instruction with the live class ID.
  • the student-side display device generates a live class detail request with the live class ID based on the live class review instruction, and sends it to the service server.
  • the business server retrieves the live class detail information corresponding to the live class ID from its database, including the teacher ID and video file information.
  • the student-side display device After receiving the detailed information of the live class, the student-side display device sends an interactive data request carrying the teacher ID to the service server to request the interactive data generated by the teacher during the live class corresponding to the live class ID, so as to play the video file. displayed in real time.
  • a student ID When a student logs in to the live class application configured on the student display device, a student ID will be generated. When students conduct online live classes in live classes, the student interaction data generated by them are all stored in the business server. Therefore, when a student is reviewing, an interactive data request with the student ID can be sent to the business server, and the business server receives the interactive data request, searches its database for the student interactive data corresponding to the student ID, and returns it to the student side for display. equipment.
  • the business server can store the multiple teacher interaction data in the form of a list according to the chronological order of the start time, and return it to the student side for display in the form of a list equipment.
  • the business server can return all student interaction data related to the live class corresponding to the live class ID of the student to the student-side display device , the interaction data of several students can be arranged in the chronological order of the generation time points, and returned in the form of an interaction data list. Then, the student-side display device sequentially displays the interactive data of each student on the live class review screen.
  • the student-side display device After receiving the video file information returned by the service server, the student-side display device can play the video file based on the video file information, that is, play the video file in the video playback window.
  • the controller of the display device on the student side is further configured to perform the following steps when executing the video playback instruction generated in response to triggering the play button, displaying the video file in the video playback window for playback:
  • Step 231 in response to the video play instruction generated by triggering the play button, obtain the video file review address and the video file time axis corresponding to the video file information.
  • Step 232 Based on the video file review address and the video file time axis, play the corresponding video file in the video playback window.
  • the play button displayed in the live class review interface.
  • the play button can be displayed below the video playback window or in the floating layer above the video playback window.
  • the video file review address is the URL address for accessing the video file
  • the controller can access the video file based on the URL address, so as to present the playback screen of the video file in the video playback window.
  • the video file is played based on the video file timeline, and the video file timeline is displayed at the bottom of the video playback window.
  • the corresponding video file can be played.
  • the interactive data of the teacher or the students can be displayed synchronously in the video playback window.
  • the display of student interaction data is related to the switch state of the student data display button. If the student data display button is turned on, the student data will be displayed in the video playback window. If the student data display button is turned off, the student data will not be displayed in the video playback window.
  • Video files are played based on the video file timeline.
  • teacher interaction data and student interaction data are displayed in the video playback window in time.
  • real-time detection of whether there is a teacher interaction logo on the video file timeline Interact with students.
  • the teacher interaction ID and student interaction ID that exist on the timeline of the video file, the corresponding teacher interaction data and student interaction data are retrieved and displayed.
  • FIG. 48 is a flowchart of a method for displaying interactive data in some embodiments of the present application.
  • the controller of the display device on the student side is executing the switch state of the display button based on the video file timeline and the student data, and displays the teacher interaction data and the student interaction data respectively on the floating screen above the video playback window. layer, is further configured to perform the following steps:
  • the teacher's interactive logo will be added to the live class timeline. Add learner interaction badges.
  • the timeline of the live class is the same as the timeline of the recorded video file. Therefore, during the playback of the video file, it is possible to detect in real time whether there are teacher interaction marks and student interaction marks on the video file timeline.
  • if there is a teacher interaction identifier at a certain moment on the timeline of the video file it means that the teacher interaction data generated by the teacher during the live class currently needs to be displayed.
  • the teacher interaction data is displayed synchronously in the video playback window, and the teacher interaction data is located in the floating layer above the video playback window, that is, the teacher interaction data is superimposed and displayed on the upper layer of the screen where the video file is located.
  • the controller of the display device on the student side displays the teacher interaction data corresponding to the teacher interaction ID on the top of the video playback window when the teacher interaction ID exists at the current playback moment of the video file timeline.
  • the floating layer is further configured to perform the following steps:
  • Step 2421 When there is a teacher interaction identifier at the current playback time of the video file timeline, obtain the start time, duration and teacher interaction information generated by the teacher performing each interaction action in the teacher interaction data during the live class.
  • Step 2422 Generate a teacher interaction data display window based on the teacher interaction information, display the teacher interaction data display window in the floating layer above the video playback window according to the start time and duration, and the teacher interaction information is suspended on the upper layer of the video file, and the start time It is the same as the current playback moment where the teacher interaction logo exists.
  • a teacher interaction data display window is generated according to the teacher interaction information, and the teacher interaction data display window is displayed in the form of a floating window.
  • the teacher interactive data display window may be a translucent gradient interface, so as to avoid blocking the screen of the video file currently playing in the video playback window.
  • the teacher interactive data display window is displayed in the floating layer above the video playback window.
  • the start time of the teacher interactive data display window is the same as the start time of the interactive action during the recording of the live class, that is, it is the same as the existing teacher.
  • the current playing time of the interactive logo is the same.
  • the display time of the teacher interaction data display window is the same as the duration of the teacher interaction information displayed during the recording of the live class.
  • FIG. 49 is a schematic diagram of displaying interactive data on the student terminal in some embodiments of the present application.
  • the teacher interaction data when the teacher interaction data is displayed on the student side, the student uses the display device on the student side to watch the live class. If there is a teacher interaction identifier at the current playback time of the video file timeline, the teacher interaction information corresponding to the live lesson is obtained.
  • the interactive information includes the interactive serial number (8), interactive content (questions and multiple-choice questions), and interactive options (ABCD).
  • the teacher's interactive data display window is generated and displayed above the floating layer of the video playback window. The relative physical position is at below the video playback window.
  • the display time of the teacher interaction data display window is the same as the duration of the teacher interaction information displayed on the student side during the live class.
  • the teacher interaction identifier 1 is detected when the current playback time of the video file timeline reaches 0:23:28, the start time of the interaction action 1 in the teacher interaction data corresponding to this moment is 0:23:28.
  • the teacher interaction information corresponding to interactive action 1 is played, and the teacher interaction data display window is generated based on the teacher interaction information, and the display time of the teacher interaction data display window is the duration, which is 5 seconds.
  • the start time of the interaction action 2 in the teacher interaction data corresponding to this moment is 0:35:50.
  • the teacher interactive information corresponding to the interactive action 2 is played, and the teacher interactive data display window is generated based on the teacher interactive information, and the display time of the teacher interactive data display window is the duration, which is 6 seconds.
  • the teacher interaction data includes several teacher interaction information.
  • One teacher interaction information corresponds to a start time and corresponds to a teacher interaction identifier. According to the sequence of the start time and the corresponding relationship with the timeline of the video file, each teacher detected The interactive logo displays the corresponding interactive information of each teacher in the floating layer above the video playback window.
  • the teacher interaction information includes the interaction sequence number, the interaction content, the interaction options, and the correct interaction result, and the correct interaction result is not always displayed according to the teacher interaction identifier, but is displayed according to whether the student interaction data is displayed or not. . For example, if the student interaction data is displayed, the teacher interaction data will display the correct result of the interaction, and the interaction option cannot be triggered; if the student interaction data is not displayed, the teacher interaction data will not display the correct interaction result, and the interaction option can be triggered for Students interact in real time.
  • if there is a student interaction identifier at a certain moment on the timeline of the video file it means that the student interaction data generated by the student during the live class currently needs to be displayed.
  • the switch state of the student data display button needs to be detected at the same time to determine whether the student needs to display the student interaction data synchronously. If the student data display button is on (as shown in Figure 49), the student interaction data will be displayed in the video playback window synchronously, and the student interaction data will be located in the floating layer above the video playback window, that is, the student interaction data will be displayed superimposed on the video playback window.
  • the video file is located in the upper layer of the screen. For clear display, the student interaction data is displayed in a floating layer above the teacher interaction data.
  • the controller in the student-side display device determines whether the student interaction is displayed in the floating layer above the video playback window according to the switch state of the student data display button when the student interaction identifier exists at the current playback moment of the video file timeline. data, is further configured to perform the following steps:
  • Step 2431 When there is a student interaction logo at the current playback time of the video file timeline, determine the switch state of the student data display button.
  • Step 2432 If the student data display button is on, display the student interaction data in the floating layer above the video playback window.
  • Step 2433 If the student data display button is off, the student interaction data is not displayed in the floating layer above the video playback window.
  • a student data display button can be generated synchronously in the live class interface to control whether the student interaction data needs to be displayed synchronously.
  • the switch state of the student data display button is detected. If the student data display button is on, as shown in Figure 49, it means that the student does not need to interact in real time, and the student interaction data is displayed in the floating layer above the video playback window. If the student data display button is off, as shown in Figure 50, it means that the student needs to interact in real time, and the student interaction data will not be displayed in the floating layer above the video playback window.
  • the floating layer above the video playback window will be displayed synchronously when the student data display button is turned on.
  • Teacher interaction data and student interaction data When the student data display button is off, only the teacher interaction data is displayed in the floating layer above the video playback window.
  • the student interaction data is displayed in the video playback window of the live class review interface in a timely manner, that is, after the teacher interaction data is displayed in the video playback window, the corresponding student interaction data is displayed in a timely manner within the specified time.
  • the display time interval of teacher interaction data and student interaction data during the review process is the same as the display time interval of teacher interaction data and student interaction data during the previous live class, so as to restore the scene of the live class.
  • the specified time may be the duration of the interactive action generated by the teacher.
  • the student interaction data In order to accurately display the student interaction data when reviewing the live class, it can be displayed based on the time point when the student interacts during the recording of the live class. is displayed in a floating layer above the video playback window, and is further configured to perform the following steps:
  • Step 24321 Acquire the generation time point and the interaction information of the students when each interaction corresponding to the interaction data of the students is generated.
  • Step 24322 Generate a student interactive data display window based on the student interactive information, display the student interactive data display window in the floating layer above the video playback window according to the generation time point, and the student interactive data display window is located on the upper layer of the teacher interactive data display window, generating The time point is the same as the current playback moment where the student interaction logo exists.
  • the student data display button When there is a student interaction logo at the current playback moment of the video file timeline, and the student data display button is on, obtain the generation time point and student interaction information corresponding to the student interaction data when each interaction occurs, that is, the student records the live class.
  • the interaction generated by the student based on the teacher's interaction data is the operation action of the student to answer the question
  • the student interaction information is the content corresponding to the student's click on any interaction option.
  • the student interaction data display window can be a translucent gradient interface, and the student interaction data display window is located on the upper layer of the teacher interaction data display window, so as to avoid the current playing video in the video playback window. The file screen and the teacher interaction data displayed in the teacher interaction data display window are blocked.
  • the student interaction data display window displays the student interaction data display window in the floating layer above the video playback window according to the generation time. That is, the generation time point is the same as the current playback time when the student interaction logo exists.
  • the student data display button when the student data display button is turned on and the student interaction data needs to be displayed synchronously, if the live class is in the live class, the student is based on the teacher interaction data (the start time is 25 minutes and 28 seconds, and the duration is 25 minutes and 28 seconds). 5 seconds, the interaction result is A) At 25 minutes and 30 seconds, a student interaction data is generated, and the student interaction data includes: selecting the interaction option A, and the interaction result is that the selection is correct. Then, when the video file is played for review, when the current playback time of the video file timeline reaches 25 minutes and 30 seconds, the existence of the student interaction logo is detected.
  • the student interaction data display window is generated based on the corresponding student interaction data, and It is displayed in the floating layer above the video playback window, and the student interactive data display window is superimposed and displayed on the upper layer of the teacher's interactive data display window, that is, there are "interactive serial number (8), interactive content (multiple-choice questions and questions), interactive options. (ABCD) and interactive correct result (correct answer A)”, the student interactive data display window is displayed in the floating layer above the teacher interactive data display window, and the interactive option A is displayed in the student interactive data display window, and the interactive result is the correct choice ( ⁇ ) .
  • the student's display device when the student's display device is viewing the video file of the live class, if it is detected that there is a teacher interaction logo on the timeline of the video file, the corresponding teacher interaction data will be displayed. If it is detected that there is a student interaction logo on the timeline of the video file, the switch state of the student data display button in the live class interface of the student terminal is detected first. If it is on, the teacher interaction data (including interactive Correct results) and student interaction data; if it is turned off, only the teacher interaction data (excluding the correct results of the interaction) will be displayed, and the student interaction data will not be displayed. At this time, students can interact in real time.
  • students can adjust whether they need to display the student interaction data at any time during the review of the live class, and conduct real-time interaction when the student interaction data is not displayed. Therefore, students can control the switch state of the student data display button at any time when watching the live class.
  • the student data display button can be reopened to display the student interaction data.
  • the controller determines whether the student interaction data is displayed in the floating layer above the video playback window according to the switch state of the student data display button, and is further configured to: in the process of playing the video file, in response to triggering the student data display
  • the data display start command generated by the button displays the student interaction data in the floating layer above the video playback window.
  • the student data display button is turned off, the student interaction data is not displayed in the video playback window. If students want to simultaneously see their interactions during the recording of the live class, they can click the student data display button to turn it on. At this time, a data display turn-on instruction is generated.
  • the controller In response to the data display start instruction, the controller displays the student interaction data at the corresponding time when the student interaction identifier is detected on the video file timeline, that is, the student interaction data is displayed in the floating layer above the video playback window.
  • the teacher interaction data is always displayed according to the time of the teacher interaction logo detected on the timeline of the video file, and its display is not affected by the switch state of the student data display button.
  • the display process of student interaction data can refer to the content of steps 24321 to 24322 in the foregoing embodiment, and the display process of teacher interaction data can refer to the content of steps 2421 to 2422 of the foregoing embodiment, which will not be repeated here.
  • the student data display button can be turned off to cancel the display of the student interaction data.
  • the controller determines whether the student interaction data is displayed in the floating layer above the video playback window according to the switch state of the student data display button, and is further configured to: in the process of playing the video file, in response to triggering the student data display The data display closing instruction generated by the button, the teacher interaction data is displayed according to the current playback time corresponding to the teacher interaction logo on the video file timeline, and the display of the student interaction data is canceled.
  • the student data display button is turned on, the student interaction data is already displayed in the video playback window. If students do not want to see their interactions during the recording of the live class, they can click the student data display button to close it. At this time, the data display closing instruction is generated.
  • the controller responds to the data display closing instruction. At this time, even if the student interaction logo is detected on the video file timeline, the student interaction data will not be displayed, and the teacher interaction data will continue to correspond to the teacher interaction logo on the video file timeline.
  • the current playback moment is displayed, that is, it is displayed in the floating layer above the video playback window.
  • the student interaction data is no longer displayed in the video playback window, and at this time, the student can interact in real time during the review of the live class. In order to interact in real time, students need to interact based on the teacher interaction data generated during the recording of the live class.
  • the controller of the display device on the student side is further configured as:
  • Step 251 when the student data display button is in the off state, and when there is a teacher interactive logo at the current playback moment of the video file timeline, generate an interactive interface based on the teacher interactive data, and the interactive interface is used to provide students with interaction when watching the live class.
  • the teacher interaction data includes the start time, duration and teacher interaction information generated by each interaction action.
  • Step 252 display the interactive interface in the floating layer above the video playback window, the interactive interface is suspended on the upper layer of the corresponding screen of the video file, the interactive interface presents the teacher's interactive information, the start time and the existence of the teacher's interactive logo is the same as the current playback time.
  • the student data display button is turned off, it means that the student needs to interact in real time.
  • the teacher interaction logo is detected on the video file timeline, the corresponding teacher interaction data is obtained, and an interaction interface is generated based on the teacher interaction data.
  • a submit button is also displayed in the interaction interface. The interactive interface allows students to click and operate for real-time interaction.
  • FIG. 50 is a schematic display diagram of generating an interactive interface when looking back in some embodiments of the present application.
  • the student data display button is off.
  • the teacher interaction data includes the start time, duration, and teacher interaction information generated by each interactive action.
  • the interaction interface displays teacher interaction information and a submit button.
  • the interactive interface displays interactive information.
  • Serial number (18) interactive content (questions and multiple-choice questions), interactive options (ABCD), and submit button, and the interactive options are in a clickable state, and the correct interactive results will not be displayed.
  • the start time and display duration of the interactive interface are the same as the start time and duration of the teacher's interactive information during the live class recording, that is, the interactive interface is displayed above the video playback window.
  • the display time of the interactive interface is the start time of the interactive action, and it is also the current playback time corresponding to the detection of the teacher's interactive logo.
  • the start time of an interactive action in the teacher interaction data is 25 minutes and 28 seconds, and the duration is 5 seconds.
  • the teacher interaction is detected on the video file timeline.
  • the logo is also 25 minutes and 28 seconds. Therefore, the interactive interface is generated according to the teacher interaction data corresponding to 25 minutes and 28 seconds.
  • the display time of the interactive interface is 25 minutes and 28 seconds, the display time is 5 seconds, and the real-time interaction time of the students is within 5 seconds.
  • Students can interact in real time based on the interactive information presented in the interactive interface in the live class review interface of their student-side display device.
  • the interactive interface displays the topic and interactive options with the interactive serial number 18.
  • the student selects one of the interactive options. That is, the answer is based on the question with the serial number 18, and the interactive option selected by the student is the real-time interactive data of the student.
  • the student-side display device acquires and plays the video file corresponding to the live class ID when reviewing the live class, and can play the video file in the live class review interface to a certain video file.
  • the interactive interface generated based on the teacher's interactive data corresponding to the start time will be displayed in the live class review interface, that is, the interactive interface will be displayed in the floating layer above the video playback window for students to interact in real time. In the case of restoring the scene of live class, improve the personalized experience of students.
  • the service server may again judge the correctness of the interaction data. Therefore, during the review of the live class, the controller in the display device on the student side is further configured to perform the following steps:
  • Step 261 When the student interaction data is not displayed, receive the current interactive instruction generated when the student triggers the submit button based on the interactive content and interactive options presented in the interactive interface.
  • the teacher's interactive information includes the interactive content and interactive options, and the interactive interface displays the submission. button.
  • Step 262 in response to the current interaction instruction, generate current student interaction data.
  • Step 263 sending the current student interaction data to the business server, and the business server is used to generate the current interaction result according to the current student interaction data;
  • Step 264 Receive the current interactive result returned by the service server, and display it in the interactive interface.
  • FIG. 51 is a schematic display diagram of a student performing real-time interaction based on an interactive interface during review in some embodiments of the present application.
  • the interactive interface displays the teacher interaction information and submit button corresponding to the current moment.
  • the teacher interaction information includes the interaction sequence number (18), the interaction content (questions and multiple-choice questions), and interaction options. (ABCD), and the interaction option is triggerable. Students can click any interactive option based on the interactive content as the current interactive operation, and click the submit button after completing the selection to generate the current interactive instruction. For example, the student clicks the interactive option AB, and then clicks the submit button to generate the current interactive instruction.
  • the controller In response to the current interaction instruction, the controller generates current student interaction data, where the current student interaction data includes interaction options AB selected by the student.
  • the controller sends the current student interaction data to the business server, and the business server retrieves the correct answer (interaction correct result) of the corresponding question (question No. 18) from the database, and conducts the correct answer according to the current student interaction data and the correct answer made by the student. Sexual judgment, get the current interaction result.
  • the business server returns the current interactive result to the student-side display device, and displays it in the interactive interface.
  • the controller of the display device on the student side sends the current interactive instruction carrying the interactive option AB to the business server, and the business server retrieves the interactive correct answer (AB) with question number 18.
  • the business server retrieves the interactive correct answer (AB) with question number 18.
  • the business server returns the current interactive result (correct ⁇ ) to the student-side display device, and displays it on the interactive interface. At the same time, it also displays the interactive correct answer (AB) on the interactive interface to realize the judgment of the interactive result of real-time interaction.
  • the Submit button transitions to an Exit quiz button. Students can click the exit answering button displayed in the interactive interface to exit the answering interface by themselves and end the answering of the current question in advance. At this time, the display of the interactive interface will be cancelled. Otherwise, the interactive interface will always be displayed in the video playback window, and the display time of the interactive interface is the same as the duration corresponding to the topic.
  • the students when reviewing the live class, the students can interact in real time on the display device, and perform the interactive result judgment process again to further restore the scene during the class, so that the students can experience the online live class process again and improve the user experience.
  • the display device provided by the embodiment of the present application is applied to the display device on the student side.
  • replaying the live class in response to the replay instruction of the live class generated by the student triggering the replay button, it can generate a video playback window, playback
  • the live class review interface of the button and the student data display button obtain the video file information, teacher interaction data and student interaction data corresponding to the live class ID from the business server, and display the video file in response to the video playback instruction generated by triggering the play button.
  • Play in the video playback window based on the video file timeline and the switch status of the student data display button, the teacher interaction data and the student interaction data are displayed in the floating layer above the video playback window.
  • the display device provided by the embodiment of the present application can simultaneously display the teacher interaction data and/or the student interaction data while the students review the video files, so that the students can experience the live broadcast class again, and can participate in the review process.
  • real-time interaction is carried out to improve the user experience.
  • FIG. 52 is another flowchart of a method for reviewing a live class in some embodiments of the present application.
  • an embodiment of the present application provides a server, which is applied to a service server, including: a database configured to store student interaction data, teacher interaction data, and video file information generated by a display device when recording a live class;
  • the connected controller is configured to perform the following steps when executing the live lesson review method:
  • S3A1 Obtain a live class information request carrying a live class ID sent by the display device, where the live class information request refers to a request generated by the display device in response to a live class review instruction generated by triggering the review button.
  • the live class detail information includes video file information, teacher interaction data and student interaction data, and the video file information refers to the time during the live class.
  • the recorded video files include the live class screen and the video file timeline corresponding to the live class timeline.
  • Teacher interaction data refers to the interactive data generated by the teacher during the live class and corresponding to the live class timeline.
  • Student interaction data refers to the The interactive data corresponding to the live class timeline generated by the students based on the teacher's interactive data during the live class.
  • the student uses the student-side display device to review the live class
  • the student selects one of the live classes to review the live class display interface displayed on the student-side display device
  • click the review button corresponding to the selected live class
  • the controller responds to the live class review instruction, generates a live class information request, and sends it to the service server to obtain the live class detailed information.
  • the live class details information is stored in the database of the business server
  • the business server responds to the live class information request, and the business server obtains the live class details corresponding to the live class ID from the database.
  • the live class details include video file information, teacher interaction Data and student interaction data.
  • the service server obtains the detailed information of the live class from the database, that is, the specific implementation process of obtaining video file information, teacher interaction data, and student interaction data. Reference may be made to the content shown in steps 221 to 226 proposed in the foregoing embodiment, which will not be repeated here.
  • the business server returns the obtained live class detail information corresponding to the live class ID to the corresponding student-side display device, so that when students use the student-side display device to review the live class, the details of the live class can be displayed.
  • the relevant steps of displaying the detailed information of the live class on the display device on the student side reference may be made to the contents shown in steps 21 to 24 and related implementation contents proposed in the foregoing embodiment, which will not be repeated here.
  • the server provided by the embodiment of the present application is applied to the service server, and can obtain information corresponding to the live class ID from the database according to the live class information request with the live class ID generated by the display device on the student side when the live class is replayed.
  • the detailed information of the live class such as video file information, teacher interaction data and student interaction data, is returned to the display device, and the live class details information is used for the display device to display the live class replay.
  • the server provided in the embodiment of the present application can provide the student-side display device with detailed information of the live class while the student is viewing the video file, so that the student-side display device can synchronously display the teacher interaction data and/or the student interaction data, allowing the students to Re-experience the live broadcast class again, and you can participate in the live broadcast class during the review process, conduct real-time interaction, and improve the user experience.
  • FIG. 45 is a flowchart of a method for reviewing a live class in some embodiments of the present application.
  • an embodiment of the present application provides a method for reviewing a live class, which is applied to a student-side display device. The method includes:
  • the service server Acquire from the service server video file information, teacher interaction data and student interaction data corresponding to the live class ID, where the video file information refers to the video file including the live class screen and the video files recorded during the live class and related to the live class.
  • the time axis of the video file corresponding to the time axis.
  • the teacher interaction data refers to the interaction data generated by the teacher during the live class and corresponding to the live class timeline
  • the student interaction data refers to the student interaction data generated by the students based on the teacher interaction data during the live class.
  • FIG. 52 is another flowchart of a method for reviewing a live class in some embodiments of the present application.
  • a method for reviewing a live class provided by an embodiment of the present application is applied to a service server, and the method includes:
  • the live class detail information includes video file information, teacher interaction data and student interaction data
  • the video refers to the video files recorded during the live class including the live class screen and the video file timeline corresponding to the live class timeline
  • the teacher interaction data refers to the live class time axis generated by the teacher during the live class and corresponding to the live class timeline.
  • the interactive data of the student, the student interactive data refers to the interactive data corresponding to the live class timeline generated by the student based on the teacher's interactive data during the live class;
  • the present application provides a teaching live broadcast method, which is executed by a controller in a display device on the teacher's side, and the method includes:

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Educational Administration (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请公开了一种教学直播方法及显示设备,在学生端显示设备启动第一程序时,向服务器查询其是否具备手写输入功能。具备时,在第一直播界面展示手写输入功能控件;不具备时,在第一直播界面不展示手写输入功能控件。老师端显示设备根据学生端显示设备的手写输入功能查询结果,展示对应的权限控制按钮,以对任一个学生进行手写输入功能授权。

Description

一种教学直播方法及显示设备
本申请要求在2020年10月15日提交中国专利局,申请号为202011103569.2的中国专利申请、在2021年01月04日提交中国专利局,申请号为202110003691.0的中国专利申请、在2021年01月06日提交中国专利局,申请号为202110014131.5的中国专利申请、在2021年01月19日提交中国专利局,申请号为202110067566.6的中国专利申请、在2020年12月07日提交中国专利局,申请号为202011437934.3的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及显示设备技术领域,尤其涉及一种教学直播方法及显示设备。
背景技术
远程教育,指的是依靠电脑、电视及互联网等传播媒体的教学模式,它突破了时空的界线,能够使学员能够在不同地方进行上课。其中,直播教育是远程教育中逐渐兴起的一种教学形式,直播教育指的是通过直播的方式,在特定的时间内使不同地方的学员能够同时上线与老师一起进行教学互动的一种教学模式。相比于其他远程教育模式,直播教育最大的好处是能够增加老师和学员之间的互动,提高学员的学习积极性。
现有的教学直播系统,是由多个软件拼凑而成,每个软件实现一种功能,例如,招生利用一个软件实现,教学利用一个软件实现,考试利用一个软件实现,相互软件之间脱节,数据并未实时共享,每次使用均需人工导入,较为繁琐;并且,现有的教学直播系统通常应用到手机端,而电视端并不适用。
发明内容
第一方面,本申请提供了一种显示设备,包括:
显示器,被配置为呈现第一直播界面;
与所述显示器连接的控制器,所述控制器被配置为:
响应于用于启动第一程序的应用启动指令,发送手写输入功能查询指令至服务器,所述手写输入功能查询指令用于指示所述服务器查询本端是否配置手写输入功能;
如果所述服务器返回的手写输入功能查询结果为本端具备手写输入功能,则在所述第一直播界面中展示手写输入功能控件;
如果所述服务器返回的手写输入功能查询结果为本端不具备手写输入功能,则在所述第一直播界面中不展示手写输入功能控件。
第二方面,本申请还提供了一种显示设备,包括:
显示器,被配置为呈现第二直播界面;
与所述显示器连接的控制器,所述控制器被配置为:
在第二程序启动后,接收学生端显示设备发送的手写输入功能查询结果,所述手写输入功能查询结果是指所述学生端显示设备请求服务器查询本端是否配置手写输入功能的结果;
在所述手写输入功能查询结果为具有手写输入功能时,则在所述第二直播界面显示与每个具有手写输入功能的学生端显示设备对应的第一操作条目,所述第一操作条目中包括具有对应学生端显示设备的手写输入功能控制权限的第一权限控制按钮;
在所述手写输入功能查询结果为不具有手写输入功能时,则在所述第二直播界面显示与每个不具有手写输入功能的学生端显示设备对应的第二操作条目,所述第二操作条目中包括不具有对应学生端显示设备的手写输入功能控制权限的第二权限控制按钮。
第三方面,本申请还提供了一种教学直播方法,应用于学生端显示设备,所述方法包括:
响应于用于启动第一程序的应用启动指令,发送手写输入功能查询指令至服务器,所述手写输入功能查询指令用于指示所述服务器查询本端是否配置手写输入功能;
如果所述服务器返回的手写输入功能查询结果为本端具备手写输入功能,则在所述第一直播界面中展示手写输入功能控件;
如果所述服务器返回的手写输入功能查询结果为本端不具备手写输入功能,则在所述第一直播界面中不展示手写输入功能控件。
第四方面,本申请还提供了一种教学直播方法,应用于老师端显示设备,所述方法包括:
在第二程序启动后,接收学生端显示设备发送的手写输入功能查询结果,所述手写输入功能查询结果是指所述学生端显示设备请求服务器查询本端是否配置手写输入功能的结果;
在所述手写输入功能查询结果为具有手写输入功能时,则在所述第二直播界面显示与每个具有手写输入功能的学生端显示设备对应的第一操作条目,所述第一操作条目中包括具有对应学生端显示设备的手写输入功能控制权限的第一权限控制按钮;
在所述手写输入功能查询结果为不具有手写输入功能时,则在所述第二直播界面显示与每个不具有手写输入功能的学生端显示设备对应的第二操作条目,所述第二操作条目中包括不具有对应学生端显示设备的手写输入功能控制权限的第二权限控制按钮。
第五方面,本申请还提供了一种存储介质,该计算机存储介质可存储有程序,该程序执行时可实现包括本申请提供的教学直播方法各实施例中的部分或全部步骤。
附图说明
图1是本申请一些实施例中显示设备与控制装置之间操作场景的示意图;
图2是本申请一些实施例中访问应用程序的一种页面示意图;
图3是本申请一些实施例中显示设备在线直播课程用户界面的示意图;
图4是本申请一些实施例中显示设备在线直播课程用户界面的示意图;
图5是本申请一些实施例中显示设备、服务器在线直播课程交互时序示意图;
图6是本申请一些实施例中显示设备、服务器实现在线直播课程控制的交互时序示意图;
图7是本申请一些实施例中战队管理的页面示意图;
图8是本申请一些实施例中模式管理的页面示意图;
图9是本申请一些实施例中三分屏直播上课的页面示意图;
图10是本申请一些实施例中三分屏直播上课的页面示意图;
图11是本申请一些实施例中学生端首页的页面示意图;
图12是本申请一些实施例中学生端听课的页面示意图;
图13是本申请一些实施例中学生随堂练的页面示意图;
图14本申请一些实施例中第一直播界面的示意图;
图15本申请一些实施例中利用手写输入进行涂写时的直播界面中课程内容区的示意图;
图16是本申请一些实施例中的教学直播中自动展示手写输入功能的交互示意图;
图17是本申请一些实施例中的教学直播中自动展示手写输入功能的一种流程图;
图18是本申请一些实施例中发送手写输入功能查询指令的方法流程图;
图19是本申请一些实施例中展示有手写输入功能控件的第一直播界面的示意图;
图20是本申请一些实施例中的教学直播中自动展示手写输入功能的另一种流程图;
图21是本申请一些实施例中第二直播界面中学生列表的示意图;
图22是本申请一些实施例中教师端使用手写输入功能涂写的界面示意图;
图23是本申请一些实施例中的教学直播中自动展示手写输入功能的又一种流程图;
图24是本申请一些实施例中直播时用户界面的示意图;
图25是本申请一些实施例中消息的展示方法的流程图;
图26是本申请一些实施例中消息的展示方法的时序图;
图27是本申请一些实施例中列表分页的示意图;
图28是本申请一些实施例中消息列表的示意图;
图29是本申请一些实施例中在用户界面展示消息列表的示意图;
图30是本申请一些实施例中新消息发送异常时的界面示意图;
图31是本申请一些实施例中消息列表中展示新消息的示意图;
图32是本申请一些实施例中消息列表中展示新消息提醒界面的界面示意图;
图33是本申请一些实施例中消息列表中展示加载状态提示框的界面示意图;
图34是本申请一些实施例中消息的展示方法的业务流程图;
图35是本申请一些实施例中直播课应用场景示意图;
图36是本申请一些实施例中直播课录制方法的流程图;
图37是本申请一些实施例中直播课录制方法的交互流程图;
图38是本申请一些实施例中老师端直播课界面的显示示意图;
图39是本申请一些实施例中学员端直播课界面的显示示意图;
图40是本申请一些实施例中录制直播课的示意图;
图41是本申请一些实施例中随堂练的界面示意图;
图42是本申请一些实施例中学员端显示设备呈现老师互动数据的界面示意图;
图43是本申请一些实施例中学员端直播课显示界面的显示示意图;
图44是本申请一些实施例中学员互动数据的对照表;
图45是本申请一些实施例中直播课回看方法的流程图;
图46是本申请一些实施例中直播课回看方法的交互流程图;
图47是本申请一些实施例中直播课回看界面的示意图;
图48是本申请一些实施例中展示互动数据的方法流程图;
图49是本申请一些实施例中学员端展示互动数据的显示示意图;
图50是本申请一些实施例中回看时生成互动界面的显示示意图;
图51是本申请一些实施例中回看时学员基于互动界面进行实时互动的显示示意图;
图52是本申请一些实施例中直播课回看方法的另一流程图。
具体实施方式
为使本申请的目的、实施方式和优点更加清楚,下面将结合本申请示例性实施例中的附图,对本申请示例性实施方式进行清楚、完整地描述,显然,所描述的示例性实施例仅是本申请一部分实施例,而不是全部的实施例。
图1中本申请一些实施例中显示设备与控制装置之间操作场景的示意图。如图1中示出,用户可通过移动终端300和控制装置100操作显示设备200。
在一些实施例中,控制装置100可以是遥控器,遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信,及其他短距离通信方式等,通过无线或其他有线方式来控制显示设备200。用户可以通过遥控器上按键,语音输入、控制面板输入等输入用户指令,来控制显示设备200。如:用户可以通过遥控器上音量加减键、频道控制键、上/下/左/右的移动按键、语音输入按键、菜单键、开关机按键等输入相应控制指令,来实现控制显示设备200的功能。
在一些实施例中,也可以使用移动终端、平板电脑、计算机、笔记本电脑、和其他智能设备以控制显示设备200。例如,使用在智能设备上运行的应用程序控制显示设备200。该应用程序通过配置可以在与智能设备关联的屏幕上,在直观的用户界面(UI)中为用户提供各种控制。在一些实施例中,移动终端300也可以微微一种显示设备使用。
在一些实施例中,移动终端300可与显示设备200安装软件应用,通过网络通信协议实现连接通信,实现一对一控制操作的和数据通信的目的。如:可以实现用移动终端300与显示设备200建立控制指令协议,将遥控控制键盘同步到移动终端300上,通过控制移动终端300上用户界面,实现控制显示设备200的功能。也可以将移动终端300上显示音视频内容传输到显示设备200上,实现同步显示功能。
如图1中还示出,显示设备200还与服务器400通过多种通信方式进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器400可以向显示设备200提供各种内容和互动。
在一些实施例中,显示设备中安装的提供在线课程的应用可以是“聚微校”应用。
在使用“聚微校”应用程序进行教学直播时,根据不同的用户可呈现相应的登录或注册页面。
用户登录后,账号信息中包括的用户头像为默认头像,默认头像可为从用户名中截取显示,例如,可从左往右截取用户名的前两个字进行显示。如果后面第三个是汉字,则展示最后APP端1个或web端2个字;如果第三个不是汉字,则展示前两个字 或第二个字;如果用户名为英文名,则取第一个字母进行展示,例如用户名为Jerry,则展示J;若用户名为特殊字符,则不展示,而是以系统提供的默认头像进行展示。用户也可根据自己的喜好对头像进行更换。
图2中本申请一些实施例中访问应用程序的一种页面示意图。参见图2所示,用户在访问“聚微校”应用程序时,应用界面默认展示“聚微校”首页。
在一些实施例中,首页支持5张以内轮播图,用于介绍“聚微校”的相关功能。轮播图自动轮换播放,若仅显示1张轮播图,则不展示轮播状态。
在一些实施例中,直播课的进行需要包括教师端显示设备,学生端显示设备和服务器。本申请提供的教师端显示设备包括显示器、第一控制器。其中,第一控制器被配置为:发送包含课程信息的课程创建指令至服务器,其中,所述课程创建指令用于使所述服务器将所述课程信息对应的课程添加至直播课程列表,所述课程信息包括所述课程的开始时间,所述直播课程列表用于使所述服务器根据课程的开始时间,为在预设时长内即将开始上课的第一课程创建第一直播间并生成直播间创建完成的消息;不为在预设时长内不开始上课的第二课程创建直播间。
在一些实施例中,所述课程信息还包括课程名称、结束时间、学员列表、上课模式中的一种、或多种组合。
例如,教师端发送课程创建指令至服务器,所述课程创建指令包括第一课程、第二课程、第三课程、第四课程的课程信息。
其中,第一课程的课程信息可包括:开始时间为18:00、结束时间为18:30、学员列表1、上课模式为公开;
第二课程的开始时间为19:00、结束时间为19:30、学员列表2、上课模式为公开;
第三课程的开始时间为20:00、结束时间为20:30、学员列表3、上课模式为公开;
第四课程的开始时间为21:00;结束时间为21:30、学员列表4、上课模式为公开。
所述课程创建指令可以使服务器根据其包含课程信息的开始时间,识别在预设时长内即将开始上课的第一课程,并为所述第一课程创建第一直播间用于在线直播课程使用,并生成直播间创建完成的消息,以使学员端显示设备和老师段显示设备可以即时得到对应课程备课成功的信息。
在一些实施例中,本申请还提供了一种服务器,包括第二控制器,被配置为:定时扫描直播课程列表,其中,所述直播课程列表是所述第二控制器根据接收到的课程创建指令中的课程信息生成的,所述课程信息包括课程的开始时间。
例如,服务器的第二控制器在接收到上述第一控制器发送的课程创建指令后,根据其中对应课程信息的开始时间和其他课程信息,将对应该的课程添加至直播课程列表;可以理解,课程信息中的开始时间是直播课程列表必要的信息。
第二控制器定时扫描上述包含不同课程开始时间的直播课程列表,自动为符合备课条件的课程进行提前备课,例如建立专用的直播间、聊天室、推送备课状态信息给显示设备端等。
在一些实施例中,第二控制器在扫描到的课程为在预设时长内即将开始上课的第 一课程时,根据所述课程信息为所述第一课程创建第一直播间并生成直播间创建完成的消息。
例如,服务器的第二控制器以每30分钟扫描一次的频率,在后台扫描已添加多个课程的直播课程列表,找出可是时间在例如15分钟后的课程作为第一课程。
在确认符合条件的第一课程后,第二控制器为所述第一课程创建专用的第一直播间;如果所述第一直播间创建成功,第二控制器将生成直播间创建完成的消息。
在一些实施例中,所述第二控制器生成直播间创建完成的消息,具体包括所述第二控制器:在创建第一直播间后,将所述直播课程列表中的第一课程标识为进行中状态,所述进行中状态可被所述显示设备在远程查询所述直播课程列表时获取。
例如,第二控制器在创建所述第一直播间完成后,将所述第一课程在直播课程列表中标识为进行中状态;其中,直播课程列表中各个课程的状态可以被显示设备通过远程轮循查询时获取。
在一些实施例中,第二控制器在生成直播间创建完成的消息后,所述第二控制器还被配置为:发送所述直播间创建完成的消息至所述显示设备,所述直播间创建完成的消息用于使所述显示设备的用户界面显示包含进入所述第一直播间的进入控件。
例如,第二控制器创建第一直播间完成后,将第一直播间的相关数据记录到直播课程列表的第一课程中,所述相关数据例如可包括所述第一直播间的编码,用户根据所述第一直播间的编码可以进入相应的直播间;第二控制器发送包含第一直播间编码的直播间创建完成的消息至显示设备,所述直播间创建完成的消息用于使所述显示设备的用户界面显示包含进入所述第一直播间的进入控件。
在一些实施例中,对应的显示设备第一控制器在获取到所述直播间创建完成的消息后,在用户界面显示进入所述第一直播间的进入控件,包括所述第一控制器:在接收服务器发送的所述直播间创建完成的消息后,在用户界面显示包含进入所述第一直播间的进入控件;或以预设时间间隔发送用于查询直播间创建状态的指令,在查询所述第一直播间创建完成后,控制用户界面显示包含进入所述第一直播间的进入控件。
在一些实施例中,第二控制器在扫描到的课程为在预设时长内不开始上课的第二课程时,不为所述第二课程创建直播间,继续扫描直播课程列表。
即服务器根据直播课程列表中各个课程包含的开始时间,对于不符合备课条件的课程不进行创建直播间等备课操作。
图3本申请一些实施例中显示设备在线直播课程用户界面的示意图。
图中示出了教师端显示设备在线直播课程的用户界面,在系统时间为15:00时,直播课程列表包括4个课程,分别是第一课程、第二课程、第三课程、第四课程。
其中,第一课程的开始时间为18:00、第二课程的开始时间为19:00、第三课程的开始时间为20:00、第四课程的开始时间为21:00;上述四个课程的状态都显示为未开始。
在一些实施例中,服务器第二控制器定时扫描直播课程列表,在扫描到的课程为在预设时长内即将开始上课的第一课程时,根据所述课程信息为所述第一课程创建第一直播间,包括所述第二控制器:以第一时间间隔定时扫描直播课程列表;在被扫描课程的开始时间处于以当前时间为基础的预设时长范围内时,判定所述被扫描课程为第一课程;根据所述第一课程的课程信息为所述第一课程创建第一直播间。
例如,在15:00时,服务器第二控制器以第一时间间隔实施为15分钟进行重复扫描后台数据库已建立的直播课程列表,以在线直播课程列表中的开始时间为目标,查询筛选出在第二时间间隔实施为30分钟之后开始的课程,可以发现在图3所示的用户界面中,15:00时没有直播课程需要被自动创建直播间,在没有获取到需要创建直播间的直播课程后,第二控制器将以15分钟为间隔,在之后的15:15、15:30、15:45、16:00等再次扫描所述直播课程列表。
图4本申请一些实施例中教师端显示设备在线直播课程用户界面的示意图。
当系统时间为15:31时,此时显示设备的第一控制器在15:30时已扫描直播课程列表并成功获取需要创建第一直播间的第一课程;在所述第一直播间创建成功后,用户界面中直播课程列表中的所述第一课程标识显示为进行中状态,如图所示。
在一些实施例中,第二控制器在为上述第一课程创建第一直播间后,继续以第一时间间隔循环处理所述直播课程列表中的其他课程,以为在预设时长内即将开始上课的第二课程创建第二直播间。
在一些实施例中,所述直播课程列表还用于使所述服务器根据课程的开始时间,为在预设时长内即将开始上课的第一课程创建第一聊天室并生成聊天室创建完成的消息,所述第一聊天室耦合至所述第一直播间。
例如,显示设备第一控制器发送包含课程信息的课程创建指令至服务器,所述课程创建指令用于使所述服务器将所述课程信息对应的课程添加至直播课程列表;
服务器的所第二控制器根据所述课程信息为所述第一课程创建第一聊天室并生成聊天室创建完成的消息,其中,所述第一聊天室可耦合至所述第一直播间。
服务器第二控制器根据所述第一课程的课程信息,调用互动聊天室服务器为第一课程创建第一聊天室;在第一聊天室创建成功后,聊天室服务接口返回所述第一聊天室编码;第二控制器将第一聊天室编码更新存储到直播课程列表中对应的第一课程中。
在一些实施例中,服务器第二控制器还根据第一课程的课程信息,例如将课程名称作为第一直播间的名称;开始时间、结束时间作为第一直播间的使用时间区间;
服务器第二控制器执行请求直播间服务创建成功后,直播间服务接口将返回新建的第一直播间编码,第二控制器将所述第一直播间编码更新存储至数据库直播课程列表中对应的第一课程中。
在一些实施例中,服务器第二控制器根据所述课程信息为所述第一课程创建第一聊天室、及第一直播间,所述第一聊天室耦合至所述第一直播间;在所述第一聊天室、及第一直播间创建成功后,发送包含所述第一直播间编码、第一聊天室编码的直播间创建完成的消息、聊天室创建完成的消息至显示设备。
服务器完成第一直播间、第一聊天室的创建后,第二控制器发送包含第一直播间编码、第一聊天室编码的反馈信息至显示设备。
在一些实施例中,服务器第二控制器检测第一聊天室编码、第一直播间编码是否为空;如果都不为空,则表示第一聊天室、第一直播间都创建成功。
在一些实施例中,第一控制器在获取到所述直播间创建完成的消息后,在用户界面显示进入所述第一直播间的进入控件;在获取到针对所述进入控件的确认操作后,控制所述用户界面显示所述第一直播间的直播用户界面,其中,所述直播用户界面设置有用于显示本地视频数据的本地窗口以及用于显示对端视频数据的对端窗口。
例如,直播课程列表中第一课程标识为进行中状态时,学员可点击进入第一课程进行课前互动。
第一课程处于准备就绪的状态,老师可以提前进入与学员进行课前互动,也可以等到课程正式开始时进入第一直播间上课,如果老师未准备,可通过第一聊天室通知学生延迟开始。
直播用户界面包括本地窗口和对段窗口,本地窗口用于显示本地视频数据、对端窗口用于显示对端视频数据。
在一些实施例中,如果第一聊天室、或第一直播间未能成功创建,第二控制器则不修改直播课程列表中第一课程的状态,再次循环扫描直播课程列表重新处理该课程。
图5本申请一些实施例中教师端显示设备、学生端显示设备、服务器在线直播课程交互时序示意图。
在一些实施例中,老师通过教师端显示设备在线直播课程管理界面新建直播课程,包括配置课程名称、开始时间、结束时间、学员列表、上课模式等参数,并调用业务服务直播课保存接口;
直播课保存接口校验参数的有效性,包括课程名称长度、课程名称是否包含敏感内容、开始时间、结束时间是否符合规定,校验通过后将直播课程数据保存到数据库(DB);
后台任务在后台定时扫描数据库中的直播课程列表,以课程的开始时间为基准,查询出在预设时长内即将开始的直播课程,即第一课程,并循环处理直播课程列表中的其他课程;
后台任务获取第一课程的课程名称、课程学员人数等参数,请求聊天室服务创建第一聊天室;创建成功后,聊天室服务接口返回新建的第一聊天室编码,将该编码更新保存到数据库中的第一课程中;
后台任务获取第一课程的课程名称作为第一直播间的名称;开始时间、结束时间作为第一直播间的使用时间区间,请求直播间服务创建第一直播间;创建成功后,直播间服务接口返回新建的第一直播间编码,将第一直播间编码更新保存到数据库中的第一课程中;
第一聊天室、第一直播间创建流程完成后,后台任务检查第一课程的第一聊天室编码、第一直播间编码是否为空,如果都不为空,则表示两者都创建成功,然后将第一课程状态改为进行中。
学员端显示设备请求业务服务查询属于该学员的直播课程列表,进入状态为进行中的直播课;此时学员端会携带直播第一课程ID,调用业务服务的课程详情接口,从业务服务获取课程详情,包括课程名称、开始时间、结束时间、课程资料列表、第一聊天室编码和第一直播间编码等;
学员端从课程详情中解析出第一聊天室编码,调用聊天室服务接口,进入对应的第一聊天室,已经进入聊天室的学员之间可以互动聊天;
同时,学员端从课程详情中解析出第一直播间编码,调用直播间服务接口,进入第一直播间,此时直播间无画面,即老师未开始直播之前,直播间不展示画面;
第一课程正式开始后,老师进入直播课程,从直播课详情中获取第一聊天室编码、第一直播间编码,以管理员的身份分别进入第一聊天室和第一直播间开始上课,并对 第一聊天室和第一直播间进行管理,包括禁止所有人聊天、指定某一个人发言、连接某一个学员的麦克风等;
至此,学员端可看到老师的直播画面,正式进入上课阶段。
图6本申请一些实施例中教师端显示设备、服务器实现在线直播课程控制的交互时序示意图。
在步骤S1001中,教师端显示设备第一控制器发送包含课程信息的课程创建指令至服务器,所述课程信息还包括课程名称、结束时间、学员列表、上课模式中的一种、或多种组合。
在步骤S1002中,服务器第二控制器将对应课程添加至直播课程列表。服务器的第二控制器在接收到上述第一控制器发送的课程创建指令后,根据其中对应课程信息的开始时间和其他课程信息,将对应该的课程添加至直播课程列表
在步骤S1003中,服务器第二控制器以第一时间间隔定时扫描直播课程列表。例如第二控制器以每30分钟扫描一次的频率,在后台扫描已添加多个课程的直播课程列表,找出可是时间在例如15分钟后的课程作为第一课程。
在步骤S1004中,服务器第二控制器在被扫描课程的开始时间处于以当前时间为基础的预设时长范围内时,判定所述被扫描课程为第一课程。第二控制器扫描获取的课程为在预设时长内即将开始上课的第一课程。
在步骤S1005中,第二控制器根据所述课程信息为所述第一课程创建第一直播间。在确认符合条件的第一课程后,第二控制器为所述第一课程创建专用的第一直播间;如果所述第一直播间创建成功,第二控制器将生成直播间创建完成的消息。
在步骤S1006中,第二控制器将所述直播课程列表中的第一课程标识为进行中状态,所述进行中状态可被所述显示设备在远程查询所述直播课程列表时获取。
在步骤S1007中,教师端显示设备用户通过对直播课程列表中状态为进行中的第一课程进行确认操作。第一控制器在获取到所述直播间创建完成的消息后,在用户界面显示进入所述第一直播间的进入控件。
在步骤S1008中,第一控制器控制用户界面显示所述第一直播间的用户界面。第一控制器在获取到针对所述进入控件的确认操作后,控制所述用户界面显示所述第一直播间的直播用户界面,其中,所述直播用户界面设置有用于显示本地视频数据的本地窗口以及用于显示对端视频数据的对端窗口。
基于上文中对显示设备实现在线直播课程控制方案的阐述,本申请还提供了一种应用于显示设备的在线直播课程的控制方法,所述方法包括:发送包含课程信息的课程创建指令至服务器,其中,所述课程创建指令用于使所述服务器将所述课程信息对应的课程添加至直播课程列表,所述课程信息包括所述课程的开始时间,所述直播课程列表用于使所述服务器根据课程的开始时间,为在预设时长内即将开始上课的第一课程创建第一直播间并生成直播间创建完成的消息;不为在预设时长内不开始上课的第二课程创建直播间;在获取到所述直播间创建完成的消息后,显示进入所述第一直播间的进入控件;在获取到针对所述进入控件的确认操作后,显示所述第一直播间的直播用户界面,其中,所述直播用户界面设置有用于显示本地视频数据的本地窗口以及用于显示对端视频数据的对端窗口。所述显示设备在线直播课程控制方案具体操作方法、步骤在上文对显示设备实现方案中已进行详细阐述,在此不再赘述。
基于上文中对服务器实现在线直播课程控制方案的阐述,本申请还提供了一种应用于服务器的在线直播课程的控制方法,所述方法包括:定时扫描直播课程列表,其中,所述直播课程列表是根据接收到的课程创建指令中的课程信息生成的,所述课程信息包括课程的开始时间;在扫描到的课程为在预设时长内即将开始上课的第一课程时,根据所述课程信息为所述第一课程创建第一直播间并生成直播间创建完成的消息;在扫描到的课程为在预设时长内不开始上课的第二课程时,不为所述第二课程创建直播间,继续扫描直播课程列表。所述服务器在线直播课程控制方案具体操作方法、步骤在上文对显示设备实现方案中已进行详细阐述,在此不再赘述。
在一些实施例中,生成直播间创建完成的消息,包括:在创建第一直播间后,将所述直播课程列表中的第一课程标识为进行中状态,所述进行中状态可被所述显示设备在远程查询所述直播课程列表时获取;以及在生成直播间创建完成的消息后,所述方法还包括:发送所述直播间创建完成的消息至所述显示设备,所述直播间创建完成的消息用于使所述显示设备的用户界面显示包含进入所述第一直播间的进入控件。所述服务器在线直播课程控制方案具体操作方法、步骤在上文对显示设备实现方案中已进行详细阐述,在此不再赘述。
在一些实施例中,教师端显示设备在设定好直播课程后,还可以通过选中课程进行课程的管理,例如,选中图3或图4的列表对应的课程,可以进行图7所示战队管理,或如图8所示的上课模式设置。
图7中本申请一些实施例中战队管理的页面示意图。参见图7,在战队管理页面中,在直播课开始之前,老师可修改战队。直播课开始之后,不可新增、修改战队,相应战队选项为灰色。老师可在候选的战队名称中选择两个作为本次直播课的战队名称,例如,选择“熊猫队”和“恐龙队”后,选择“确认选择”则创建两个战队,学生将平均分配在两个战队;如果选择“不设置战队”,则恢复默认状态;如果老师选择的战队数量不是两个,则弹出提示“请选择两个战队”。老师选择两个战队名称后,在直播课过程中,两个战队进行PK。每次的PK战队采取一课一分配的方式,即每次临时组建,在应用过程中,还可由老师端分配长期小组(战队)的权利。同一学生反复进出同一节直播课,分组不变,积分也延续。每位新进入直播间的用户,被分配给人数较少的战队,人数相同时,随机分配。战队获得积分的方式为每个学生在线时间每5分钟获得1分,不足5分钟没有分;学生退出前的不足5分钟的时间,再次进入直播间后时间可以累加。学生参与答题1分,答题正确2分;参与连麦成功一次,2分;被老师点赞一次,2分。战队积分按照每节课的分组结果保存,每位学生的得分结果及明细也进行保存。老师在完成战队分配和在课程结束时结束战队,均会显示动效,默认显示X秒后自动消失。
图8中本申请一些实施例中模式管理的页面示意图。参见图8,在模式管理页面中,老师可以选择上课模式,包括三分屏上课模式和多路视频上课模式。其中,默认选择三分屏上课模式。点击“确认选择”后,进入直播间。
在一些实施例中,显示设备包括显示器和控制器,显示器用于呈现直播教学界面,控制器用于根据直播相关操作,实现教学直播。直播课程序可为“聚微校”程序。直播课程序包括第二程序和第一程序,第二程序为教师端显示设备中配置的程序,在启动第二程序时,在显示器中展示第二直播界面;第一程序为学生端显示设备中配置的 程序,在启动第一程序时,在显示器中展示第一直播界面。
在一些实施例中,在进入直播间后进入图9所示的第二直播界面的示意图。教师端在登录到“聚微校”应用程序并新建直播课后,在到达上课时间,即可进入直播间。本实施例中,由于显示设备的显示器屏幕较大,可容纳更多的内容,因此,可采用三分屏直播上课模式。第二直播界面显示有课程内容区、学生视频区、老师视频区、主功能区和直播信息展示区,可实现三分屏上课。学生视频区用于显示学生图像,老师视频区用于显示老师图像,学生图像和老师图像由其使用的显示设备配置的摄像头(如图3中的图像采集器)进行采集。课程内容区显示直播画面,课程内容区的下方显示主功能区,主功能区用于切换讲义、白板和视频等功能。
在一些实施例中,主功能区的下方显示直播操作按钮和战队比拼情况,直播操作按钮包括手写输入功能(按钮文案为“画笔”)、开启直播(开启后切换为暂停直播)、结束直播等控件。
在一些实施例很正宗,为提高上课效果,老师在直播前,可将该班级的学生分成两个战队,通过在上课期间回答问题等累积积分,在课程结束后,哪一战队的积分高,则该战队的学生会得到相应的奖励。战队比拼情况实时显示两个战队的积分。直播操作按钮处用于实现开启直播、暂停直播和结束直播。在点击开始直播后,发送直播流信号给学生端,讲义区和讨论区可用,并同时开始录制回放。在暂停直播时,讲义区保留,老师音视频无信号,且暂停直播器件直播回放不进行录制。在结束直播后,所有师生可离开此直播间。其中,在结束直播时间半小时前,按返回,退出直播间,但不结束直播;在接收直播时间半小时后,且直播间无老师,则结束直播。
在一些实施例中,第二直播界面显示的手写输入功能控件用于在教师端需要模拟真实上课场景,以在黑板上布置作业或对某写课程内容进行标注时,可通过手写输入实现在直播画面上进行写画操作。例如,可在讲义功能模式下,教师端触控笔或手指等触控方式触发直播操作按钮中的手写输入功能控件,如图9中的“画笔”控件,以通过手动触摸显示器的方式,在显示器中显示的讲义上进行划线、写字、画画等互动操作
三分屏直播上课的显示界面中显示有本节直播课的主题名称、本节课已播时长、暂停时间时长、老师头像和姓名等直播信息。在上课期间,老师在点击“画笔”,支持讲义和白板使用,并可同步到所有学生。画笔的笔触粗细可调整,还可执行撤回上一步画笔、删除所有画笔和调整画笔颜色等功能。上课期间,老师可实时出题进行随堂练,学生在随堂练分区进行答题,每个学生答题完毕后,可显示每个选择的选择率和答题时间,并显示答对人数、已打人数和在线人数。在线人数是指点击出题时刻的在线答题人数,当已答人数大于该数时,取已答人数。在随堂练的题数为多个时,每个试题的显示顺序为随堂测验管理时的顺序。上课期间,老师可提供给每个学生进行讨论的时间,老师可在讨论区选择任一学生或全部学生发送消息进行提问,在选择学生时,可通过下拉列表的形式进行选择,也可直接输入学生姓名进行选择。老师可清空自己的讨论区,不可恢复;还可在点击“禁言”后,讨论区学生不可留言(老师仍可留言),点击“解禁”后恢复留言。
上课期间,可与该班级内任一学生进行连麦互动,连麦流程包括学生举手或不举手、老师打开学生摄像头和麦克风,学生举手被放下,学生视频区域上台,所有师生 均能看到和听到。在连麦时,只有在功能区为讲义和白板情况下进行连麦。课程内容为视频播放时,视图连麦提示“暂不可用”。且只能实现一位学生与老师连麦,学生上台后,视频区域为设计尺寸,老师可拖动学生图像在功能区的任意位置,避免挡住讲义内容,学生端视频区域同步跟着移动。被连麦的学生端所使用的终端需配置摄像头和麦克风。
功能区可展示白板、讲义(导入的附件)和视频等tab,并可拖动调换tab顺序,除了白板以外,其余tab可通过双击修改每个tab的名称;课程内容中默认展示第一个tab的内容。当功能区为视频时,可点击视频区实现暂停或恢复播放,也可拖动进度条,选择进度。当功能区为讲义(PPT或PDF),右下角显示操控按钮。讲义可响应鼠标通过滚动实现上下翻页,和键盘上下翻页;还可支持画笔在PPT上标记。
老师可在直播间提供的“在线”按钮,查看当前直播间的在线人数。点击“在线”按钮,显示本节课程所在班级的所有学生,在线人数包括学生和老师的总人数。每个学生姓名的左侧显示设备类型,即学生参与直播课所采用的终端,如TV、PAD等。每个学生姓名右侧显示举手、麦克风、收赞和画笔控件,四个控件中的任一个为红色代表功能开启,若为灰色,则代表功能关闭。举手控件,学生左键单击可举手并变为红色,再次单击左键则举手方向并变为灰色;老师不可以替学生举手,学生放下手后才能再次举手。摄像头和话筒设备统一由一个麦克风按钮控制,按钮为红色表示连麦中,为灰色时表示有设备支持但未连接;带有斜杠时表示无话筒或无摄像头设备。在连麦时,只能有一个学生获得视频或连麦,且为同一个学生。画笔按钮为红色表示有画笔权限,左键单击,授权画笔;为灰色时表示无画笔权限,授权后学生如举手,则画笔权限被放下,且同时只能有一个学生获得画笔权限;按钮带有斜杠时表示设备无法触控。老师还可点击“全部放下举手”按钮,将所有学生的举手都变为放下,数字为举手人数。在“在线”页面中还显示有“未到10”,表示有10名学生未到,并在未到名单中,每个学生名称的右侧显示请假和缺勤情况。如果老师点击“未到”按钮,则相应位置变为“已到”按钮显示。
图10中本申请一些实施例中另一种三分屏直播上课的页面示意图。参见图10,直播上课还可支持多路视频上课,比较适合1对1到1对7的小班教学场景(最多8路视频)。在进行直播教学时,老师视频默认在第一位,视频区略大,学生端自己的视频默认在第二位,其余学生视频按照进入直播间的顺序显示,重进则往后排,人过多时,轮播。老师开始直播前,所有人的视频和话筒全部关闭;开始直播后,所有人的视频默认打开,学生话筒默认关闭,老师的话筒默认开启。连麦时,仅有一个学生可进行连麦,且需要视频和连麦为同一个人。在连麦过程中,老师右键在某个学生图像点击,可调出快捷菜单,左键在快捷菜单中单击,执行对应操作(发送点赞、结束连麦、授予画笔)后,界面消失。其中,点击“发送点赞”是指点击给学生发赞,发完弹层消失;点击“结束连麦”则结束连麦,学生回座位,弹层消失;点击“授予画笔”则给学生使用画笔权限,弹层消失。在未进行连麦时,老师右键在某个学生图像点击,可调出快捷菜单,左键在快捷菜单中单击,执行对应操作(发送点赞、上台连麦、放下举手、回收画笔)后,界面消失。其中,点击“发送点赞”则点击给学生发赞,发完弹层消失;点击“上台连麦”则打开视频和话筒,学生上台,举手被放下(“放下举手”文案变灰色),单层消失;点击“放下举手”则举手被放下,弹层消失;点击“回 收画笔”则回收画笔权限,弹层消失。在上课期间,每个学生均可举手以获得回答问题的权力,每个学生视频区的右上角会显示“举手”标识,“举手”标识为红色表示该学生已经举手,可为小手图标;“举手”标识为白色表示该学生未举手。学生视频区还显示学生姓名和积分数量,单击可给该学生发赞;显示是否话筒打开,单击连麦,再次单击则断开连麦。
老师端还可关闭讲义区和恢复讲义区,在关闭讲义区后,老师视频放大到功能区显示。老师还可关闭所有学生视频和恢复所有学生视频,以及,进行随堂练和讨论区,此两部分内容可参照三分屏上课内容,此处不再赘述。
无论采用三分屏上课还是多路视频上课,在完成当前次直播课后,学生均可对已经直播过的课程进行回放,回放内容仅包括课程内容和师生直播时的图像视频。回放资源来自于直播教学时的实时录制内容。可进行直播回放的内容包括:连麦过程录制,但不能参与;随堂练试题弹出,可参与做题和反馈对错,做题结果不参与记录;画笔过程全记录,但不能操作;举手功能无展示。不需要录制的部分包括讨论区、学生列表、战队,在回放区不要求显示。回放视频的下方显示进度条,标注出哪个时间段有连麦,哪个时间段有随堂练,且区分颜色。在播放回放视频时,进度条默认显示后X秒自动消失,点击视频区可暂停,再次点击视频区可播放;左右拖动进度条可实现快进快退,无选集功能。除此之外,还可采用二分屏上课模式,相应直播间显示课程内容和学生视频区,而不再显示老师视频区。同样的,学生端也可采用二分屏听课模式,相应直播间显示课程内容和学生视频区,而不再显示老师视频区。
学生端在登录到“聚微校”应用程序后,可根据其课表,在到达上课时间,即可进入直播间。由于老师端可采用三分屏上课模式和多路视频上课模式,因此,对应的,学生端也可采用三分屏听课模式和多路视频听课模式。
图11中本申请一些实施例中学生端首页的页面示意图。学生端登录到“聚微校”应用程序后,进入用户首页。参见图11,用户首页左边显示用户头像和学生姓名,用户头像如果为空的话,使用名称后两个字作为头像。右边显示我的家长与退出按钮,点击返回到登录界面。用户首页显示课表信息和作业信息。
作业信息包括今日作业列表,今日作业列表右上角显示“全部作业”按钮,点击跳到全部作业界面。今日作业显示的是开始时间是今天的作业,默认显示未完成的作业,支持未完成与已完成作业的筛选。除了未完成的作业,其余状态的作业都显示在已完成中。学生点击一份作业进去完成提交并返回后,此份作业需要从未完成模块中隐藏。每个作业显示作业的学科icon,作业学科标题与作业的截止时间。Icon数据来自于后台配置。
课表信息包括我的课表列表,我的课表列表顶部显示年月选择条,可左右按月翻页,下方日期跟着变化,默认为第一周,并选中1号。每个月当中被选定的日期为绿色底,默认选中首次打开应用当天,退出前记忆选择位置。日期下方标注橙黄小点,代表当天有至少一节直播课。在显示日期框中,可左右滑动查看其他日期的课表安排,在滑动时,被选中日期不跟着变。选中未显示橙黄小点的日期,则提示“这天没课”。
日期框下方显示课程列表,按照每节课的时间顺序排列,时间越早的在越上方。每个课程上显示上课时间、战队情况和积分情况,若某节课程已上课完毕,则显示的战队情况为学生自己所在战队在当前直播课时的战队比拼结果,积分情况为对应的直 播获得的积分。每个课程的右侧显示操作按钮,包括看回放,上课,请假和已请假。看回放按钮显示在直播课已完结的课程右侧,学生点击看回放按钮,即可回放该课程视频;上课按钮表示该课程即将进行直播,学生可提前15分钟点击进入上课,学生提前进入的,直播间无直播流,显示“直播上尚未开始”提示。请假按钮在上课15分钟前可被选中,被选中后,该按钮替换为已请假按钮。课程右侧显示有已请假按钮表示该节课学生已请假。已开始直播,点击进入直播间,算考勤;未开始直播,点击取消请假。具体为,上课前15分钟(不含)显示“请假”按钮,上课前15分钟之后,如果没请假,则显示“上课”按钮,如果请假,则显示“已请假”按钮。
图12中本申请一些实施例中学生端听课的页面示意图。学生在点击“上课”按钮后,即可进入对应直播间进行听课。学生听课模式与老师的上课模式相同,在采用三分屏听课模式时,参见图12,听课直播间页面与老师端直播上课的页面相似,学生直播听课页面包括课程内容区、学生视频区、老师视频区和功能区。直播页面中显示直播课主题名称和直播时长,学生在直播页面中按返回键,则学生端退出直播间。课程内容区用于呈现讲义、白板、视频等直播内容,学生视频区用于展示学生自己的图像、名称和本节直播课积分数量,老师视频区用于展示老师的图像,功能区展示战队情况和直播互动时的操作按钮。直播互动时的操作按钮包括麦克风、摄像头、举手、画笔和讨论按钮,“举手”按钮为红色时表示已举手,为灰色时表示未举手。“摄像头”按钮为红色时表示已开启摄像头,在开启时再次触发按钮,则关闭摄像头,“摄像头”按钮为灰色;若“摄像头”按钮上显示斜杠,则说明学生端设备未安装摄像头,学生触发“摄像头”按钮,则弹出购买摄像头界面。“麦克风”按钮为红色时表示已开启麦克风,在开启时再次触发按钮,则关闭麦克风,“麦克风”按钮为灰色;若“麦克风”按钮上显示斜杠,则说明学生端设备未安装麦克风,学生触发“麦克风”按钮,则弹出购买麦克风界面。“画笔”按钮有权限时,触发按钮展开画笔面板,默认画笔颜色为红色,返回则收起面板;无权限时,触发按钮则弹出“画笔不能使用”提示。
在摄像头或麦克风为未配置状态而直播需要调用摄像头或麦克风时,则在显示器画面中显示购买二维码链接和连麦使用说明。连麦使用说明可为静置静态或动态图片,用于描述如何进行连麦。同时,显示器中还显示拒绝按钮,如点击“先不买,随便看看”按钮,则页面关闭。在需要使用摄像头时,先进行设备检测,判断该“聚微校”应用程序是否具有调用摄像头的权限,如果没有调用权限,则弹出提示“要允许聚微校拍摄找和录制视频吗?”,如果拒绝,则进入AI监控视频区为空,如果允许,则正常调用摄像头并采集学生的图像显示在视频区。而若显示设备配置有摄像头,且“聚微校”应用程序具有调用摄像头的权限,但是摄像头被其他应用程序占用,则在“聚微校”应用程序调用摄像头时,提示“摄像头被占用,老师看不到你的视频画面”。如果学生将占用摄像头的其他应用强制退出,便可进入直播间;如果学生选择暂不使用摄像头,则进入直播间后AI监控视频区为空。
学生进入直播间时,“讨论”按钮默认选中,且在直播画面右侧显示讨论区。在“讨论”按钮右键点击到“讨论区tab”,“讨论区tab”按上,可往上看以往聊天记录,按返回键回到“讨论区tab”。“讨论区tab”按右键,可切换“学生tab”,点击,可往上查看学生清单,同样按返回键回到“讨论区tab”。
在采用多路视频听课模式时,直播界面与采用三分屏听课模式时的界面相同,不 同之处在于讨论区的调起。在多路视频听课模式下,按遥控器OK键弹出讨论区,同时弹出选择区域,默认选中第一项文案,按返回键消失。讨论区存储有选择输入文案,选择输入可预知最多20个短于,超过文字宽度,选中跑马灯,例如常出现的没声音、视频卡了、没听懂、谢谢老师等。选择输入方式还可为语音输入,将语音转化为文本后显示。学生可操作遥控器的方向键控制焦点在选择输入的每个文案上移动,点击OK键后即可在讨论区发送。
图13中本申请一些实施例中学生随堂练的页面示意图。参见图13,老师在直播教学时,可在直播课过程中进行随堂练,随堂练的相关选项会显示在直播界面中,在弹出随堂练时,选项按钮默认获得焦点,在结束答题之前,其他位置不可获取焦点;若学生尝试切走时,选项区域会抖动。学生与随堂练进行交互,交互时,若为多选题,学生选中若干个选项后点击提交,出答案,老师结束答题后答案消失;若为单选题或判断题,选中一个直接出答案。学生答题错误或正确,均会给出对应的音效和加分效果,且学生选择的答案不可以修改。如果某位学生在课堂上表现良好或者回答正确的问题数量最多,老师可对学生进行点赞。老师点赞后,所有学生端和老师端都同时接收到“点赞”特效,“点赞”特效中间显示有学生的姓名,表示获得者。“点赞”特效无法获取焦点,在显示几秒钟后自动消失。
学生端在进入直播间后,由于需要利用摄像头采集学生的图像,为保证采集图像的完整性,可在调用摄像头时,开启AI监控功能。学生进入直播间,显示设备先检测是否有摄像头,如果有摄像头,则弹出获取摄像头权限提示。如果该摄像头被其他应用程序占用,则提示“已被占用”。如果显示设备未配置摄像头,则不展示学生自己的视频区。AI监控功能可检测学生是否在视频内:摄像头在采集学生图像时,在采集区域内显示人形框,如果学生不在框内,则闪烁人形虚线,并语音播报“我看不见你呢,请做好,听老师讲课哦~”,默认检测间隔X秒。还可检测学生坐姿是否端正:如果学生坐姿不端正,则闪烁人形虚线,并语音播报“请端正做好,跟老师上课哦~”,默认检测间隔X秒;其中,端正定义参考:趴着no、躺着no、非正面对镜头no。AI监控功能可设置有监控开关,如果监控开关关闭后则摄像头区域也随之不显示。
如果AI监控播报未结束,而已经检测到学生坐姿端正,则播报完毕并消失。如果一直未检测到人活着坐姿不端正,则隔1分钟再播报一次。判断人形虚线框内有一人并端正即满足要求,如果视频内为多人时,则以字节检测到的人为准。
如果学生正与老师进行连麦,则显示麦克风和“连麦中”的角标,并闪烁提示用户。连麦时,学生本人连麦在左侧区域显示,右侧画面为空,或者相反。在完成直播课听课后,系统会提供直播报告,包括答题情况、举手次数、连麦次数和点赞次数。
图14本申请一些实施例中第一直播界面的示意图。参见图14,学生端显示设备启动第一程序后,基于直播课列表点击进入其中一个到达上课时间的直播课或已经处于直播中的直播课,以在学生端显示设备中呈现第一直播界面。第一直播界面展示有课程内容区、学生视频区、老师视频区和功能区。课程内容区的直播画面与第二直播界面的课程内容区的直播画面一致,老师视频区用于显示老师图像,学生视频区用于显示学生图像。在同时进行直播课上课的学生为多个时,学生视频区显示多个学生图像。
在一些实施例中,在显示学生图像和老师图像时,学生视频区和老师视频区显示 在课程内容区的上方,且老师视频区显示在第一位,学生视频区位于老师视频区的右侧,本端学生的图像位于学生视频区的第一位,其余学生的图像以进入直播课的顺序依次显示。
功能区用于实现学生在直播课上课时的互动功能,包括举手、手写输入(选择性配置)、讨论和求助等功能控件。在直播课上课时,学生若想要主动回答老师的提问,可通过触发举手功能控件,以告知老师其想要回答问题。手写输入功能控件用于根据老师的授权可进行相应的手写输入操作,例如,调整手写输入样式和涂写、作画等,手写输入样式包括但不限于画笔形状、颜色、粗细、字体等。涂写时,学生可通过与显示设备搭配使用的触控笔在触摸屏显示器中涂写,或者,直接用手指在触摸屏显示器中涂写,图14所示的第一直播界面为未配置有手写输入功能的情况,图19所示的第一直播界面为配置有手写输入功能的情况。讨论控件可实现老师与学生之间、学生与学生之间的实时文字讨论和互动,可参照第二直播界面中的讨论区功能。求助功能控件可在直播课上课时应用程序出现异常时,如无法启动摄像头、无法看到直播画面等情况,向程序平台提供求助功能。
图15本申请一些实施例中利用手写输入进行涂写时的直播界面中课程内容区的示意图。为在利用显示设备进行直播上课时,能够模拟真实上课场景,例如,老师在黑板上布置作业,学生在黑板上进行答题等操作,在一些实施例中,参见图15,将直播界面形成的在线虚拟界面作为黑板,学生和老师都借用各自的手写输入功能在相应的直播界面上进行涂写操作,其中,老师涂写的直播界面为第二直播界面,学生涂写的直播界面为第一直播界面。
在一些实施例中,无论是学生端还是教师端,均可利用手写输入功能在对应的直播界面上涂写操作时,需要所使用的显示设备具有触摸屏,而对于普通屏的显示设备,暂时无法利用手写输入功能进行涂写,需借用其它设备进行操作。可见,若针对不同机型的显示设备,在进行直播课时,需要提供不同的直播课程序来实现,即针对触摸屏显示设备需要配置具有手写输入功能的直播课程序,针对普通显示设备需要配置不具有手写输入功能的直播课程序。
由于针对学生端和教师端的直播上课,程序平台需提供两种版本的程序。而针对上述这种情况,若每个学生端使用的显示设备机型不同,则程序平台需要维护更多版本的程序,这必将导致平台的维护成本过高。因此,为减少开发成本,针对不同机型的学生端显示设备,程序平台可提供同一版本的第一程序,即可实现不同机型显示设备的兼容,即不同机型的显示设备可同时兼容两种不同形态的展示模式,两种展示模式包括具有手写输入功能的第一直播界面和不具有手写输入功能的第一直播界面。
因此,在不同机型显示设备上配置第一程序时,需要根据显示设备是否为触摸屏来控制直播界面中手写输入功能的自动展示,为此,本申请实施例提供一种显示设备,在配置相同版本的第一程序时,需要针对不同机型的显示设备,对其是否具有手写输入功能进行控制开启和关闭,实现一个版本适配所有机型的显示设备,两个形态界面展示兼容。
在一些实施例中,针对学生端显示设备配置第一程序的场景,不同的学生使用不同的显示设备,不同的显示设备其机型可能不同。因此,在学生启动第一程序时,其所采用的学生端显示设备需先查询其是否配置手写输入能力,进而以准确确定第一直 播界面中是否需要展示手写输入功能控件。
在一些实施例中,在开发显示设备时,开发人员需根据机型、以及机型的CPU、内存资源是否符合使用需求等因素,来配置该机型是否开启手写输入能力。即在机型为触摸屏,且CPU、内存资源等均满足需求时,为显示设备配置手写输入能力;而在机型为普通屏时,即使CPU、内存资源等均满足需求,也不为显示设备配置手写输入能力。
在一些实施例中,开发人员在将每个显示设备完成画笔能力、机型配置后,得到功能配置信息,并存储至服务器,服务器中按照标识信息对应存储有每个显示设备的功能配置信息。在进行直播课上课时,第一程序需要根据当前所处的设备能力,向服务器查询所处设备的机型、画笔能力配置等信息,来决定是否展示手写输入功能控件。
在一些实施例中,同样硬件配置的终端设备可能会因为安装的软件版本不同,在满足条件时展示手写输入功能控件,在不满足时不展示。
在一些实施例中,具有画笔功能的学生端设备,可以通过设置在手动关闭或开启画笔功能,学生端设备可以将变化后的信息同步给教师端设备。
图16本申请一些实施例中的教学直播中自动展示手写输入功能的交互示意图;图17本申请一些实施例中的教学直播中自动展示手写输入功能的一种流程图。本申请实施例提供一种显示设备,应用在学生端显示设备,包括:显示器,被配置为呈现在启动第一程序时生成的第一直播界面;存储器,配置有用于实现在线直播上课的第一程序;与显示器和存储器分别连接的控制器,在执行自动展示手写输入功能的控制方法时,参见图16和图17,控制器被配置为执行下述步骤:
S11、响应于用于启动第一程序的应用启动指令,发送手写输入功能查询指令至服务器,手写输入功能查询指令用于指示所述服务器查询本端是否配置手写输入功能。
在进行直播课上课之前,学生通过遥控器或语音的形式,触发其使用的显示设备上配置的第一程序,产生应用启动指令,控制器响应应用启动指令,调起第一程序的显示界面,即生成第一直播界面,并显示在显示器中。第一直播界面的一种显示形式可参见图14所示界面内容。
在学生启动第一程序时,由学生端显示设备的控制器生成手写输入功能查询指令,并发送至服务器,服务器根据学生端显示设备的手写输入功能查询指令,查询该设备是否配置手写输入功能。如果发送手写输入功能查询指令的设备为触摸屏机型,则该显示设备配置有手写输入功能,此时,服务器发送支持手写输入功能的指令至对应的学生端显示设备;如果发送手写输入功能查询指令的设备为普通屏机型,则该显示设备未配置有手写输入功能,此时,服务器发送不支持手写输入功能的指令至对应的学生端显示设备。
在一些实施例中,查询显示设备是否配置手写输入功能的主体为服务器,而非设备本身。由服务器实现手写输入功能的查询,可减少显示设备的CPU、内存资源的占用,避免影响显示设备的正常运行。
由于进行直播课上课的学生有多名,那么数个学生分别开启各自显示设备上配置的直播课程序时,各自使用的学生端显示设备均生成手写输入功能查询指令,并分别发送至服务器。此时,服务器可能会同时接收到多个手写输入功能查询指令,为保证服务器能够准确地为每个学生端显示设备返回对应的手写输入功能查询结果,学生端 显示设备在发送手写输入功能查询指令时,需携带各自的标识信息,标识信息用于标识显示设备的机型信息、硬件配置信息、版本信息中的至少一种。
图18本申请一些实施例中发送手写输入功能查询指令的方法流程图。在一些实施例中,参见图18,控制器在执行响应于用于启动第一程序的应用启动指令,发送手写输入功能查询指令至服务器,被进一步配置为执行下述步骤:
S111、接收用于启动第一程序的应用启动指令。
S112、响应于应用启动指令,获取本端标识信息,本端标识信息用于标识本端显示设备的机型信息、硬件配置信息、版本信息中的至少一种。
S113、基于本端标识信息,生成手写输入功能查询指令,其中,手写输入功能查询指令中包含本端标识信息。
S114、将手写输入功能查询指令发送至服务器,手写输入功能查询指令用于指示服务器根据所述本端标识信息,查询与本端标识信息对应的显示设备的手写输入功能查询结果。
学生在启动其使用的显示设备中配置的第一程序时,产生应用启动指令,服务器响应应用启动指令,获取本端标识信息。标识信息为对应显示设备的唯一标识,用于区分不同的学生端显示设备。
在一些实施例中,为保证唯一性,显示设备的标识信息可基于设备的相关信息和随机字符串生成,因此,控制器在执行获取本端标识信息,被进一步配置为执行下述步骤:
步骤1111、在启动第一程序时,获取本端显示设备的机型信息、版本信息和硬件配置信息。
步骤1112、基于本端显示设备的机型信息、版本信息、硬件配置信息和随机生成的字符串,生成本端标识信息。
第一程序启动后,所处显示设备的控制器获取本设备的机型信息、版本信息和硬件配置信息,机型信息包括触摸屏机型和普通屏机型,硬件配置信息包括CPU、内存资源等硬件信息,版本信息包括设备的系统版本等信息。
同时,随机生成字符串,由机型信息、版本信息、硬件配置信息和随机生成的字符串,生成本端标识信息。机型信息、版本信息和硬件配置信息用于区分不同显示设备的硬件结构,随机生成的字符串用于进一步区分不同显示设备,避免具有相同硬件结构的显示设备的标识信息相同。因此,基于机型信息、版本信息、硬件配置信息和随机字符串生成的本端标识信息,具有唯一性。
学生端显示设备在获取到本端标识信息后,便可生成携带本端标识信息的手写输入功能查询指令,并发送至服务器。服务器接收到手写输入功能查询指令后,解析该指令得到对应的标识信息,进而基于唯一的标识信息查询与该学生端显示设备对应的手写输入功能查询结果。
手写输入功能查询结果包括两种内容,一种是支持手写输入功能,另一种是不支持手写输入功能。
S12、如果服务器返回的手写输入功能查询结果为本端具备手写输入功能,则在第一直播界面中展示手写输入功能控件。
参见图16中(a),学生端显示设备A内配置第一程序,并执行步骤S11及相关 步骤,向服务器查询学生端显示设备A是否配置手写输入功能,如果服务器返回支持手写输入功能的手写输入功能查询结果至学生端显示设备A,则由学生端显示设备A在其对应的第一直播界面中展示手写输入功能控件。
图19本申请一些实施例中展示有手写输入功能控件的第一直播界面的示意图。参见图19所示的第一直播界面的另一种显示形式,如果学生端显示设备A为触摸屏机型,则其具有手写输入功能,因此,在启动第一程序时,在生成的第一直播界面中同步展示手写输入功能控件,如图19中功能区显示的“画笔”控件。
S13、如果服务器返回的手写输入功能查询结果为本端不具备手写输入功能,则在第一直播界面中不展示手写输入功能控件。
参见图16中(b),学生端显示设备B内配置第一程序,并执行步骤S11及相关步骤,向服务器查询学生端显示设备B是否配置手写输入功能,如果服务器返回不支持手写输入功能的手写输入功能查询结果至学生端显示设备B,则由学生端显示设备B在其对应的第一直播界面中不展示手写输入功能控件。
再次参见图14所示的第一直播界面,其界面中不展示手写输入功能控件。如果学生端显示设备B为普通屏机型,则其不具有手写输入功能,因此,在启动第一程序时,在生成的第一直播界面中不展示手写输入功能控件。
不同的学生进入直播课进行学习,根据各自使用的显示设备的机型,例如普通屏显示设备和触摸屏显示设备,不同的学生会分别看到不同的第一直播界面,即展示有手写输入功能控件的第一直播界面和未展示有手写输入功能控件的第一直播界面,可见,本申请采用的同一版本的第一程序的两种界面可兼容展示。
不同的显示设备在启动直播课程序时,均需执行上报本端标识信息至服务器,以由服务器下发是否开启手写输入功能开关,即是否需要在第一直播界面中展示手写输入功能控件的步骤。可见,不同的显示设备可运行同一版本的第一程序,通过上报本端标识信息的方式,来自动确定是否需要展示手写输入功能控件,以使得两种不同形态的界面能够兼容展示,程序平台无需维护针对不同机型的不同版本的程序,以降低开发成本。
具有手写输入功能控件展示的显示设备,其对应的学生可直接通过触控的方式参与到共享手写输入功能操作,而不具有手写输入功能控件展示的显示设备,其对应的学生不可直接参与到共享手写输入功能操作,其若想参与到互动,需要借助其他外接设备来实现。
在一些实施例中,如果学生采用普通屏显示设备,因其显示器不具有触摸功能,因此无法直接通过触控的方式输入相关信息(涂写、作画等内容)。但是,可通过在显示设备上外接设备来实现信息输入,例如,外接的设备可为提供触摸输入功能的终端。学生在提供触摸输入功能的终端上利用触控笔或手指进行涂写、作画等操作,产生输入信息,由该在终端将输入信息传输至显示设备,显示设备接收到输入信息后,经过解析将内容显示在直播界面中,具体显示在答题区或讲义区,实现采用普通屏显示设备的学生可参与到手写输入功能共享操作中。
由于外接设备的普通屏显示设备也可实现手写输入功能,因此,采用普通屏的学生端显示设备在向服务器上报能力时,服务器将该显示设备识别为配置有手写输入功能的设备。因此,学生端显示设备在启动直播课程序(如第一程序)时,向服务器查 询到的手写输入功能查询结果为具有手写输入功能的结果,此时,在采用普通屏的学生端显示设备的直播课界面中展示手写输入功能控件。
学生参与共享手写输入功能操作,需要获得老师的画笔授权,教师端显示设备需要获知参与到直播课的每名学生所使用的显示设备是否具有手写输入功能。因此,每个学生端显示设备在得到各自的手写输入功能配置情况后,即时同步告知教师端显示设备,以便老师能够明确哪些学生可获得手写输入功能授权,哪些学生无法获得手写输入功能授权,保证直播课的正常进行。其中,可获得手写输入功能授权的学生端显示设备包括触摸屏显示设备和外接有触摸输入终端的普通屏显示设备。
在一些实施例中,在执行自动展示手写输入功能的控制方法时,学生端显示设备在得知手写输入功能查询结果后,控制器被进一步配置为执行下述步骤:在接收到服务器返回的手写输入功能查询结果后,将手写输入功能查询结果发送至教师端显示设备,以由教师端显示设备展示用于表征具有手写输入功能的学生端显示设备控制权限的第一权限控制按钮和用于表征不具有手写输入功能的学生端显示设备控制权限的第二权限控制按钮,第一权限控制按钮呈可触发状态,第二权限控制按钮呈不可触发状态。
每个学生端显示设备在查询到各自的手写输入功能查询结果后,需及时将各自的手写输入功能查询结果发送至教师端显示设备,教师端显示设备根据每个学生端显示设备的手写输入功能配置情况,生成对应的学生列表,以根据接收到的不同手写输入功能配置情况,展示相应学生是否可以参与共享手写输入功能操作。在一些实施例中,可通过在第二直播界面中展示权限控制按钮的方式来明确每个学生端显示设备是否可参与共享手写输入功能操作。
学生列表包括第一操作条目和第二操作条目,第一操作条目中展示具有手写输入功能的学生端显示设备对应的学生名称和第一权限控制按钮,第二操作条目中展示不具有手写输入功能的学生端显示设备对应的学生名称和第二权限控制按钮。第一权限控制按钮呈可触发状态,具有相应学生端显示设备的手写输入功能控制权限;第二权限控制按钮呈不可触发状态,不具有相应学生端显示设备的手写输入功能控制权限。
例如,学生端显示设备A将具有手写输入功能的结果发送至教师端显示设备,学生端显示设备B将不具有手写输入功能的结果发送至教师端显示设备,教师端显示设备根据学生端显示设备A和学生端显示设备B的手写输入功能配置情况生成学生列表,基于学生端显示设备A发送的结果生成第一操作条目,基于学生端显示设备B发送的结果生成第二操作条目。并同步在第一操作条目中展示具有手写输入功能的学生端显示设备控制权限的第一权限控制按钮,在第二操作条目中展示不具有手写输入功能的学生端显示设备控制权限的第二权限控制按钮。可见,教师端展示的权限控制按钮包括具有手写输入功能控制权限和不具有手写输入功能控制权限的两种展示形式。在进行手写输入功能共享时,老师只能选择具备手写输入功能的学生参与共享手写输入功能操作,即只能通过触发第一权限控制按钮以启动对应学生端的手写输入功能,进行手写输入功能授权。
老师在点击教师端显示设备的第二直播界面中的第一权限控制按钮时,产生手写输入授权指令,以对该第一权限控制按钮对应的学生端显示设备进行手写输入功能授权。此时,该学生端显示设备接收到手写输入授权指令,即可调起其配置的手写输入 功能,进行手写输入操作。
在此场景中,该学生端显示设备中的控制器被进一步配置为执行下述步骤:
步骤141、接收教师端显示设备发送的手写输入授权指令,手写输入授权指令是指教师端显示设备触发第一权限控制按钮时产生的指令。
步骤142、响应于手写输入授权指令,启动手写输入功能控件呈可触发状态。
步骤143、响应于触发呈可触发状态的手写输入功能控件,产生手写输入功能调起指令,手写输入功能调起指令用于调起手写输入功能,以在第一直播界面中进行手写输入操作。
由于学生不具有主动开启其所使用的学生端显示设备中配置的手写输入功能控件的权利,只能由教师端进行授权后才可开启,即虽然学生端显示设备的第一直播界面中显示有手写输入功能控件,但在未获得老师授权的情况下,该控件呈不可触发状态。因此,在直播课过程中,如果需要某个学生通过手写输入功能参与到直播课课程中,老师可在其第二直播界面中呈现的学生列表中点击该名学生对应的第一权限控制按钮,开启该名学生所处设备的手写输入功能,使得该学生端获得手写输入功能授权。
教师端触发第一权限控制按钮,产生手写输入授权指令,发送至对应的学生端显示设备。学生端显示设备在接收到该手写输入授权指令后,开启其配置的手写输入功能控件的触发状态,使其处于可触发状态。同时,为告知学生其已获得手写输入功能授权。可在第一直播界面中同步弹出提示,提示内容可为“您已获得手写输入功能授权,可进行手写输入操作”。
学生在看到该提示内容后,便可通过触控笔或手指的方式触发手写输入功能控件,产生手写输入功能调起指令,手写输入功能调起指令用于调起手写输入功能,以在第一直播界面中进行手写输入操作。
可见,本申请实施例提供一种显示设备,在第一程序启动时,执行自动手写输入功能查询策略,向服务器查询其是否具备手写输入功能。并在具备手写输入功能时,在第一直播界面上展示手写输入功能控件;在不具备手写输入功能时,在第一直播界面上不展示手写输入功能控件,使得第一程序可以同时兼容两种不同形态的展示模式,两种直播课界面兼容展示,实现一个版本的直播课程序可适配所有显示设备,无需开发和维护多版本程序,以降低开发成本。
在启动第一程序时,每个学生端显示设备将各自自动查询的手写输入功能查询结果分别发送至教师端显示设备,以使得老师可以选择具备手写输入功能的学生参与共享画笔。
图20本申请一些实施例中的教学直播中自动展示手写输入功能的另一种流程图。本申请实施例提供一种显示设备,应用在教师端显示设备,包括:显示器,被配置为呈现在启动第二程序时生成的第二直播界面;存储器,配置有用于实现在线直播上课的第二程序;与显示器和存储器连接的控制器,在执行自动展示手写输入功能的控制方法时,参见图16中(c)和图20,控制器被配置为执行下述步骤:
S21、在第二程序启动后,接收学生端显示设备发送的手写输入功能查询结果,手写输入功能查询结果是指学生端显示设备请求服务器查询本端是否配置手写输入功能的结果。
在进行直播课上课时,老师通过遥控器或语音的形式,启动其使用的显示设备上 配置的第二程序,产生应用启动指令。控制器响应应用启动指令,调起第二程序的显示界面,即生成第二直播界面,并显示在显示器中。
在一些实施例中,直播课的进行需要由教师端发起,因此,在教师端启动第二程序后,推送相应的通知至每个学生端显示设备,学生端收到该通知后启动其对应的第一程序。学生端在启动各自的第一程序时,同时自动向服务器查询各自的手写输入功能配置情况,并将各自的手写输入功能查询结果发送给教师端显示设备。
因此,在教师端显示设备启动第二程序后,便可接收到每个学生端显示设备发送的手写输入功能查询结果,手写输入功能查询结果是指学生端显示设备请求服务器查询本端是否配置手写输入功能的结果,具体实现过程可参照前述实施例提供的步骤S11至S13的内容及相关实现内容,此处不再赘述。
教师端显示设备在接收到每个学生端显示设备的手写输入功能查询结果后,为便于明确每个学生是否可享有手写输入功能授权,可通过列表的形式将各个学生的手写输入功能配置情况进行展示。
在一些实施例中,在第二直播界面展示时,教师端显示设备中的控制器被进一步配置为执行下述步骤:接收每个学生端显示设备发送的手写输入功能查询结果;基于每个手写输入功能查询结果,在第二直播界面中显示学生列表,学生列表中展示第一操作条目和第二操作条目,第一操作条目中展示具有手写输入功能的学生端显示设备对应的学生名称和第一权限控制按钮,第二操作条目中展示不具有手写输入功能的学生端显示设备对应的学生名称和第二权限控制按钮,第一权限控制按钮呈可触发状态,第二权限控制按钮呈不可触发状态。
图21本申请一些实施例中第二直播界面中学生列表的示意图。参见图21,教师端显示设备在接收到数个学生端显示设备发送的手写输入功能查询结果后,基于每个学生名称及手写输入功能查询结果,生成学生列表。学生列表展示在第二直播界面中的直播信息展示区,学生列表上显示当前在线参与直播课的学生数量、每个学生名称、手写输入功能的权限控制按钮。
为便于区分不同学生所使用的显示设备是否具有手写输入功能,教师端显示设备在生成学生列表时,将参与直播课的学生按照手写输入功能查询结果进行区分,即生成第一操作条目和第二操作条目,由第一操作条目展示显示设备配置有手写输入功能的学生信息,由第二操作条目展示显示设备未配置有手写输入功能的学生信息。
在一些实施例中,第一操作条目中展示具有手写输入功能的学生端显示设备对应的学生名称和第一权限控制按钮,第二操作条目中展示不具有手写输入功能的学生端显示设备对应的学生名称和第二权限控制按钮,第一权限控制按钮呈可触发状态,第二权限控制按钮呈不可触发状态。
在一些实施例中,教师端显示设备在接收到每个学生端显示设备发送的手写输入功能查询结果后,便可生成学生列表,因此,学生列表的生成可存在于不同的应用场景。一种应用场景是在直播课开启初期时,老师刚进入直播间还未进行真实的上课时,可基于此时进入直播间的学生所使用的显示设备发送的手写输入功能查询结果生成学生列表。另一种应用场景是在直播课进行过程中,有些学生因迟到而在已经开始上课后才进入直播间,即学生陆陆续续加入时,教师端显示设备可实时根据当前进入直播间的学生端显示设备发送的手写输入功能查询结果更新学生列表。教师端可基于最新 的学生列表所呈现的信息进行对应的手写输入功能授权操作。
由于部分学生所使用的显示设备不具备手写输入功能,无法参与到手写输入功能共享操作,因此,在学生列表显示的第二权限控制按钮不具有相应学生端显示设备手写输入功能的控制权限。而另一部分学生所使用的显示设备具备手写输入功能,可以参与到手写输入功能共享操作,因此,在学生列表显示的第一权限控制按钮具有相应学生端显示设备手写输入功能的控制权限。也就是说,手写输入功能查询结果与权限控制按钮的展示形式相对应。
在一些实施例中,权限控制按钮的展示形式可为白色画笔图案(第一权限控制按钮)和灰色画笔图案(第二权限控制按钮),白色画笔图案代表具有相应学生端显示设备的手写输入功能控制权限,老师可以点击触发;灰色画笔图案代表不具有相应学生端显示设备的手写输入功能控制权限,老师不可以点击触发。为区分具有控制权限和不具有控制权限的权限控制按钮,其按钮的展示形式还可为其他颜色或形式,本实施例不做具体限定。
S22、在手写输入功能查询结果为具有手写输入功能时,则在第二直播界面显示与每个具有手写输入功能的学生端显示设备对应的第一操作条目,第一操作条目中包括具有对应学生端显示设备的手写输入功能控制权限的第一权限控制按钮。
S23、在手写输入功能查询结果为不具有手写输入功能时,则在第二直播界面显示与每个不具有手写输入功能的学生端显示设备对应的第二操作条目,第二操作条目中包括不具有对应学生端显示设备的手写输入功能控制权限的第二权限控制按钮。
在教师端显示设备接收到学生端显示设备发送的手写输入功能查询结果为具备手写输入功能时,说明对应学生所使用的显示设备为触摸屏机型,或者,外接有触摸输入终端的普通屏机型,配置有手写输入功能,进而可以参与共享手写输入功能操作。因此,在第二直播界面显示具有手写输入功能的学生端显示设备对应的第一操作条目,且在第一操作条目中呈现具有对应学生端显示设备的手写输入功能控制权限的第一权限控制按钮,如白色画笔图案的按钮。
在教师端显示设备接收到学生端显示设备发送的手写输入功能查询结果为不具备手写输入功能时,说明对应学生所使用的显示设备为普通屏机型,也未外接有触摸输入终端,则说明该设备未配置有手写输入功能,进而不可以参与共享手写输入功能操作。因此,在第二直播界面显示不具有手写输入功能的学生端显示设备对应的第二操作条目,且在第二操作条目中呈现不具有对应学生端显示设备的手写输入功能控制权限的第二权限控制按钮,如灰色画笔图案的按钮。
例如,再次参见图21所示的学生列表,参与直播课的学生为300名,示意性列出三位学生的信息。如果学生A和学生C所使用的显示设备具备手写输入功能,则在第二直播界面中对应显示第一操作条目,并在第一操作条目中显示白色画笔图案的第一权限控制按钮,即基于学生A生成第一操作条目,并在第一操作条目中显示学生A和在学生A的右侧显示白色画笔图案的第一权限控制按钮,以及,即基于学生C生成第一操作条目,并在学生C的右侧显示白色画笔图案的第一权限控制按钮,说明学生列表中由上至下第一个权限控制按钮具有学生端显示设备A的手写输入功能控制权限,第三个权限控制按钮具有学生端显示设备C的手写输入功能控制权限。
如果学生B所使用的显示设备不具备手写输入功能,则在第二直播界面中显示第 二操作条目,并在第二操作条目中显示灰色画笔图案的第二权限控制按钮,即基于学生B生成第二操作条目,并在第二操作条目中显示学生B和在学生B的右侧显示灰色画笔图案的第二权限控制按钮,说明学生列表中由上至下第二个权限控制按钮不具有学生端显示设备B的手写输入功能控制权限。
由于白色画笔图案的第一权限控制按钮可以点击触发,而灰色画笔图案的第二权限控制按钮不可以点击触发,因此,在老师需要选择学生进行手写输入功能共享时,可通过触发白色画笔图案的第一权限控制按钮,对相应的学生发起手写输入功能授权,让该学生参与手写输入互动。
在一些实施例中,在需要选择学生进行手写输入互动时,教师端显示设备中的控制器被进一步配置为执行下述步骤:
步骤241、在授权学生进行手写输入操作时,接收触发与学生对应的第一权限控制按钮时生成的手写输入授权指令。
步骤242、将手写输入授权指令发送至执行触发操作的第一权限控制按钮对应的学生端显示设备,手写输入授权指令用于启动学生端显示设备在第一直播界面中展示的手写输入功能控件的触发状态,学生点击处于可触发状态的手写输入功能控件,启动手写输入功能,以在第一直播界面中进行手写输入操作。
再次参见图9或图10所示的第二直播界面,在主功能区的下方显示的直播操作按钮区域中呈现的手写输入功能控件,如图9或图10中的“画笔”控件。由于教师端显示设备的机型可为触摸屏和普通屏,因此,教师端在启动第二程序时,也自动发送本端标识信息至服务器,以查询其所处的显示设备是否具有手写输入功能。并在查询到具有手写输入功能时,在主功能区下方显示手写输入功能控件;若查询到不具有手写输入功能时,在主功能区下方不显示手写输入功能控件。第二直播界面中手写输入功能控件的显示与否的执行过程与学生端显示设备所执行的自动展示手写输入功能的控制方法的相关步骤相同,此处不再赘述。
图22本申请一些实施例中教师端使用手写输入功能涂写的界面示意图。参见图22,如果第二直播界面中显示有手写输入功能控件,则老师可触发该手写输入功能控件,并在讲义功能模式的显示区内,老师可通过手写输入功能控件实现在讲义界面上的涂写。在讲义功能模式下,第二直播界面的课程内容区将切换显示讲义显示区,将讲义显示区模拟黑板,以模拟在真实上课场景下,老师在黑板涂写的过程。
老师在讲义模式下,通过手写输入功能控件写好题目后,可选择其中一名学生参与答题。学生端的第一直播界面中虽然显示有手写输入功能控件,但学生端无法主动触发手写输入功能控件,学生端若想使用手写输入功能,需要获得教师端的授权。
在一些实施例中,在直播课进行过程中,学生端显示设备的手写输入功能未被开启,第一直播界面中显示的手写输入功能控件呈灰色,即无法触发的状态,学生无法主动触发手写输入功能进行手写输入操作。学生使用手写输入功能需要获得教师端的授权,即在教师端对某一位学生进行手写输入功能授权时,该学生所使用的显示设备接收到手写输入授权指令,学生端显示设备的手写输入功能被开启,将第一直播界面中的手写输入功能控件切换为白色,即可以触发的状态。其中,手写输入功能控件对应的不可触发状态和可触发状态的展示形式不仅采用灰色和白色图案来展示,还可使用其他形式进行展示,以能区分两种不同触发状态即可。
在学生端显示设备获得教师端的手写输入功能授权后,学生端显示设备的手写输入功能被开启,学生可触发第一直播界面中显示的呈可触发状态的手写输入功能控件,触发后,学生可在生成的画笔设置界面调整画笔形状、粗细、颜色、字体等手写输入样式。完成调整后,学生使用触控笔或手指在触摸屏显示器(或触摸输入终端的显示器)中进行涂写等操作,完成信息输入,实现答题等互动操作。
在学生端未获得教师端的手写输入功能授权时,如果学生触发手写输入功能控件,由于当前状态下的手写输入功能控件呈不可触发状态,因此,学生端的手写输入功能控件不响应学生的触发,并在第一直播界面中弹出提示,提示内容可为“您还未获得画笔授权,无法进行手写输入操作”。
在一些实施例中,在老师想要选择学生授权手写输入功能时,即在老师在讲义上写好题目,针对有手写输入功能的学生,可以发起手写输入功能授权,以让学生参与答题。在具体实现时,老师触发学生列表中显示的任一个具有手写输入功能控制权限的第一权限控制按钮,例如,如果老师想选择学生A进行答题,则触发学生A右侧显示的白色画笔图案的第一权限控制按钮。如果老师想选择学生C进行答题,则触发学生C右侧显示的白色画笔图案的第一权限控制按钮。
触发第一权限控制按钮后,产生手写输入授权指令,并发送至该被触发的第一权限控制按钮对应的学生端显示设备。例如,如果老师触发的是学生A对应的第一权限控制按钮,则将手写输入授权指令发送至学生A所使用的学生端显示设备A。如果老师触发的是学生C对应的第一权限控制按钮,则将手写输入授权指令发送至学生C所使用的学生端显示设备C。
第一直播界面的课程内容区显示的直播课内容与第二直播界面的课程内容区显示的直播课内容相同,因此,在教师端切换讲义模式并完成题目布置后,第一直播界面的课程内容区同步显示该题目。
在某一学生端显示设备接收到教师端显示设备发送的手写输入授权指令后,该学生端显示设备收到提示,并在第一直播界面中显示提示信息,例如,“收到画笔授权,可进行涂写”。学生端显示设备接收到老师的手写输入功能授权,开启手写输入功能,该学生便可使用手写输入功能进行作答,即通过触摸显示屏的方式,在第一直播界面中的课程内容区对应位置进行涂写。
例如,如果学生端显示设备A接收到教师端显示设备发送的手写输入授权指令后,开启学生端显示设备A的手写输入功能,学生A便可使用手写输入功能在课程内容区进行涂写。学生A涂写的内容显示在课程内容区,并同步给教师端显示设备和其余学生端显示设备,使得在进行直播课上课的老师和学生所使用的显示设备上均同步显示学生A的手写输入互动内容。
在一些实施例中,在学生完成手写输入功能使用后,教师端需要取消学生端的手写输入功能授权,此时,由老师再次点击第二直播界面中该学生对应的第一权限控制按钮,产生手写输入授权取消指令,并发送至该学生端显示设备。此时,该学生端显示设备中的第一直播界面中显示取消画笔授权提示,提示信息可为“您的手写输入功能已被取消”。学生端的手写输入授权被取消后,学生端的手写输入功能控件再次呈不可触发状态,教师端可继续进行后续课程,或者,教师端通过再次点击第二直播界面的主功能区中显示的手写输入功能控件,重新获得手写输入功能,教师端可继续使用 其配置的手写输入功能继续进行涂写。
在一些实施例中,若教师端显示设备想要结束手写输入操作进行后续的正常课程,可由老师点击第二直播界面中显示的手写输入功能控件,结束教师端手写输入功能的调起。手写输入功能被取消后,老师可继续进行后续课程。
在一些实施例中,由于老师在向任一个学生共享手写输入功能时,需要点击第二直播界面中呈现的学生列表中的权限控制按钮。但是,由于权限控制按钮包括具有学生端显示设备手写输入功能控制权限的按钮和不具有学生端显示设备手写输入功能控制权限的按钮,因此,老师在点击触发某一权限控制按钮时,可能会出现选择错误的情况,即本应触发第一权限控制按钮,但却误点击第二权限控制按钮。
例如,老师本想触发具有学生端显示设备手写输入功能控制权限的第一权限控制按钮,但是却错误触发了不具有学生端显示设备手写输入功能控制权限的第二权限控制按钮。而具有学生端显示设备手写输入功能控制权限的权限控制按钮可执行触发操作,不具有学生端显示设备手写输入功能控制权限的权限控制按钮不可执行触发操作。
因此,为保证教师端手写输入功能授权操作的正常进行,可在老师触发不具有学生端显示设备手写输入功能控制权限的第二权限控制按钮时,在第二直播界面中弹出错误提示,提示内容可为“您选择的学生所使用的设备未配置手写输入功能”。老师在看到错误提示后,便可知自己选择的学生不可进行使用手写输入功能,即无法进行答题,需要选择其他具有手写输入功能的学生进行作答。
在一些实施例中,教师端在出题让学生作答时,每个题目均对应有时效。例如,教师端提供给学生的答题时间为30秒,则在教师端选择某一学生进行手写输入功能授权时,学生端显示设备的手写输入功能开启,并在学生端显示设备的课程内容区显示30秒倒计时控件和相应的题目,学生需要在30秒完成作答。
如果学生使用手写输入功能处理超时,即答题超时,则由服务器自动将该题目收回,同时,将学生端获得的手写输入功能授权取消,学生无法再进行答题。如果学生在获得手写输入功能进行答题时,输入的内容错误,或者,胡乱输入,则由教师端调起黑板擦功能,将学生输入的内容擦掉。黑板擦功能可配置在第二直播界面中,以控件的形式展示,老师可进行点击触发,再次点击,则取消黑板擦功能。
在一些实施例中,在教师端给某一个学生进行手写输入功能授权时,需要由教师端显示设备通过服务器向学生端显示设备发送手写输入授权指令。为避免因网络通信异常,导致学生端显示设备无法接收到该手写输入授权指令,而教师端显示设备无法获知这种情况,导致直播课暂时进入等待状态时,可为手写输入授权指令添加时效限制。若在指令发送超时,学生端显示设备仍未收到该指令,即指令的时效失效,则教师端需要再次点击一次该学生对应的第一权限控制按钮,重新发送手写输入授权指令。
在一些实施例中,在学生端完成手写输入功能操作后,教师端需要回收学生端的手写输入功能授权。若因网络通信异常,导致教师端手写输入功能授权回收失败,教师端显示设备可上报服务器,进行强制回收。如果学生端在完成答题后仍进行乱写乱画,则教师端可将该学生踢出直播间,断开该学生与直播间的所有消息传输。该学生若想继续听课,则需要重新点击进入第一直播界面。
强制回收手写输入功能授权和强制断开学生通信的功能可配置在第二直播界面中,对应以控件的形式进行展示,在需要执行某一个功能时,老师点击对应控件即可。老 师点击强制回收控件或强制断开通信控件时,发送相应的指令至服务器,由服务器执行接收到的指令相对应的操作,如强制回收手写输入功能授权或强制断掉学生通信。
可见,本申请实施例提供的一种显示设备,在第二程序启动时,获取每个学生端显示设备在执行自动手写输入功能查询后发送的手写输入功能查询结果。在手写输入功能查询结果为具备手写输入功能时,在第二直播界面显示具有对应学生端显示设备的手写输入功能控制权限的权限控制按钮。在手写输入功能查询结果为不具备手写输入功能时,在第二直播界面显示不具有对应学生端显示设备的手写输入功能控制权限的权限控制按钮,以便于老师可以选择具备手写输入功能的学生参与共享手写输入功能,实现学生端的手写输入功能可由教师端控制的目的,进一步降低开发成本。
由于开发人员在配置显示设备时,根据机型、以及机型的CPU、内存资源是否符合使用需求等因素,来配置该机型是否开启手写输入能力。即在机型为触摸屏,且CPU、内存资源等均满足需求时,为显示设备配置手写输入能力;而在机型为普通屏时,即使CPU、内存资源等均满足需求,也不为显示设备配置手写输入能力。
开发人员在将每个显示设备完成手写输入能力、机型配置后,得到功能配置信息,并存储至服务器,服务器中按照标识信息对应存储有每个显示设备的功能配置信息。在进行直播课上课时,第一程序需要根据当前所处的设备能力,向服务器查询所处设备的机型、手写输入能力配置等信息,来决定是否展示手写输入功能。
图23本申请一些实施例中自动展示手写输入功能的控制方法的又一种流程图。参见图16和图23,本申请实施例提供一种服务器,包括:数据库,被配置为存储显示设备的功能配置信息;与数据库连接的控制器,在学生端显示设备执行自动手写输入功能查询策略时,服务器中的控制器被配置为执行下述步骤:
S31、响应于学生端显示设备发送的手写输入功能查询指令,向数据库查询与学生端显示设备对应的手写输入功能查询结果。
在学生端显示设备启动第一程序时,学生端显示设备自动生成手写输入功能查询指令至服务器,以查询其所处设备是否具有手写输入功能。
服务器的控制器在接收到学生端显示设备发送的手写输入功能查询指令后,将手写输入功能查询指令发送至数据库,以向数据库获取其存储的功能配置信息,基于功能配置信息和手写输入功能查询指令,以获取到该学生端显示设备的手写输入功能查询结果。
由于在进行直播课上课时,会同时存在多个学生,使得存在多个学生端显示设备发送的手写输入功能查询指令,为便于区分不同的学生端显示设备,保证手写输入功能查询结果的准确性,学生端显示设备基于本端的唯一标识向服务器获取本端的画笔能力。
在一些实施例中,在查询手写输入功能的配置情况时,控制器在执行响应于学生端显示设备发送的手写输入功能查询指令,向数据库查询与学生端显示设备对应的手写输入功能查询结果,被进一步配置为执行下述步骤:
步骤311、响应于学生端显示设备发送的手写输入功能查询指令,解析手写输入功能查询指令中携带的学生端显示设备的本端标识信息。
步骤312、基于学生端显示设备的本端标识信息,在数据库存储的功能配置信息中,查询与本端标识信息对应的手写输入功能查询结果。
为保证结果查询的准确性,由于学生端显示设备是基于本端标识信息生成手写输入功能查询指令,本端标识信息用于标识本端显示设备的机型信息,本端标识信息的生成过程可参照前述实施例提供的步骤S111至S114,以及,步骤1111至步骤1112的相关内容,此处不再赘述。
为便于服务器获取对应学生端显示设备的手写输入功能查询结果,由控制器对手写输入功能查询指令进行解析,得到该指令中携带的学生端显示设备的本端标识信息。本端标识信息为学生端显示设备的唯一标识,而数据库中存储的功能配置信息包括与该标识信息对应的相关功能配置,因此,可根据本端标识信息,在功能配置信息中查询到与学生端显示设备的本端标识信息对应的手写输入功能查询结果。
显示设备的手写输入功能配置与其机型有关,即若为触摸屏机型,则配置手写输入功能;若为普通屏机型,则不配置手写输入功能。因此,控制器在数据库基于学生端显示设备的本端标识信息进行查询时,会得到两种查询结果。
如果学生端显示设备的本端标识信息表征触摸屏机型,则在数据库存储的功能配置信息中,查询与本端标识信息对应的手写输入功能查询结果为具有手写输入功能;如果学生端显示设备的本端标识信息表征普通机型,则在数据库存储的功能配置信息中,查询与本端标识信息对应的手写输入功能查询结果为不具有手写输入功能。
S32、将手写输入功能查询结果发送至学生端显示设备,以使学生端显示设备确定在第一直播界面中的手写输入功能控件的展示结果。
在服务器根据学生端显示设备发送的手写输入功能查询指令在数据库中查询到其对应的手写输入功能查询结果后,将该手写输入功能查询结果返回至对应的学生端显示设备。学生端显示设备根据手写输入功能查询结果确定是否需要在第一直播界面中展示手写输入功能控件,如果服务器返回的手写输入功能查询结果为本端具备手写输入功能,则在第一直播界面中展示手写输入功能控件。例如,如果服务器返回的手写输入功能查询结果为本端不具备手写输入功能,则在第一直播界面中不展示手写输入功能控件。相关过程参照前述实施例提供的步骤S11至S13的内容以及相关实现内容,此处不再赘述。
学生端显示设备还需将手写输入功能查询结果发送至教师端显示设备,由教师端显示设备根据每个学生端显示设备发送的手写输入功能查询结果,在第二直播界面中呈现学生列表,以展示对应学生端显示设备的手写输入功能的权限控制按钮,通过在第二直播界面中展示权限控制按钮的方式来明确每个学生端显示设备是否可参与共享手写输入操作。相关过程参照前述实施例提供的步骤S21至S23的内容以及相关实现内容,此处不再赘述。
可见,本申请实施例提供一种服务器,在学生端显示设备启动第一程序时,学生端显示设备执行自动手写输入功能查询策略,向服务器查询其是否具备手写输入功能。服务器将手写输入功能查询结果返回至学生端显示设备,使得在具备手写输入功能时,在第一直播界面上展示手写输入功能控件;在不具备手写输入功能时,在第一直播界面上不展示手写输入功能控件,进而使得第一程序可以同时兼容两种不同形态的展示模式,两种直播界面兼容展示,实现一个版本的第一程序可适配所有显示设备,无需开发和维护多版本程序,以降低开发成本。
在一些实施例中,在用户利用显示设备进行直播课上课时,直播程序包括第一程 序和第二程序,第二程序为教师端显示设备中配置的程序,在启动第二程序时,在显示器中展示第二直播界面;第一程序为学生端显示设备中配置的程序,在启动第一程序时,在显示器中展示第一直播界面。
不同的用户所配置的程序版本不同,在显示设备上显示的用户界面内容不同。但是在直播过程中,为了直播间的安静,无论是教师还是学生都会通过文字聊天的方式进行沟通。
图24本申请一些实施例中直播时用户界面的示意图。参见图24,在进行直播上课时,以学生端显示设备的显示器中显示的用户界面为例,学生端用户界面显示第一直播界面,第一直播界面展示有讲义区、学生本人视频区、教师视频区、功能区、讨论区和学生列表。讲义区为课程内容区,该区的直播画面与教师端直播界面中课程内容区的直播画面一致,展示教师的共享讲义、共享桌面、共享视频等,主要用作展示教师想要呈现给学生的内容,该区不可以选中。教师视频区用于显示教师图像,学生可以通过此区域观看到教师的实时状态,此区域只可以观看,不可以选中。学生视频区用于显示学生自己的图像,学生自己的摄像头画面在此区域展示,只可以观看,不可以选中。
功能区用于实现学生在直播课上课时的互动功能,包括举手、手写输入(画笔)、讨论和反馈等功能控件。学生可以操作功能区,每个按钮都可以选中,可以点击。在直播课上课时,学生若想要主动回答教师的提问,可通过触发举手功能控件,以告知教师其想要回答问题。手写输入功能控件用于根据教师的授权可进行相应的手写输入操作,例如,调整手写输入样式和涂写、作画等,手写输入样式包括但不限于画笔形状、颜色、粗细、字体等。涂写时,学生可通过与显示设备搭配使用的触控笔在触摸屏显示器中涂写,或者,直接用手指在触摸屏显示器中涂写。讨论控件可实现教师与学生之间、学生与学生之间的实时文字讨论和互动,可参照第二直播界面中的讨论区功能。反馈功能控件可在直播课上课时应用程序出现异常时,如无法启动摄像头、无法看到直播画面等情况,向程序平台提供求助功能。
讨论区和学生列表是并列的两个tab,选中后可以切换tab,两个tab的下方显示消息列表区,用于展示直播间的讨论记录或直播间的学生列表。在切换到讨论区tab时,讨论区tab下方的消息列表区呈现列表展示窗口,用于展示学生与学生之间、学生与老师之间的实时文字聊天消息。在切换到学生列表tab时,学生列表tab下方的消息列表区呈现显示参与该直播课的所有学生的相关信息。
在一些实施例中,为便于学生和教师发生文字消息,在列表展示窗口中展示有输入框,输入框可显示在列表展示窗口的底部。
在需要切换到讨论区tab以输入文字聊天消息时,用户需要通过显示设备配置的遥控器按键(左键或右键)在功能区的不同功能控件上移动,当移动到最后侧的功能控件上时,继续按右键,焦点选中讨论区tab。
如果用户在讨论区tab上按遥控器左键,则返回至功能区;如果用户在讨论区tab上按遥控器右键,则切换至学生列表tab;如果用户在讨论区tab上按遥控器下键,则浏览讨论区的内容,即列表展示窗口中呈现的消息列表。如果用户在消息列表按遥控器上键,则返回至讨论区tab。
而在常用的消息展示方式上,最新消息通常展示在消息列表的底部。但是,如果 用户从讨论区tab触发遥控器下键,焦点会落在消息列表的顶部,无法定位到最新一条消息上。在用户想查看消息列表中的历史消息时,需要按上键从底部的新消息开始向上开始浏览,而该操作将与按上键回到“讨论区”tab操作冲突。可见,将消息展示在消息列表底部的展示方式将导致不便于从新消息开始浏览历史消息的问题。
为了符合用户的浏览习惯,本申请实施例提供一种显示设备,在展示消息时,将用户发布和接收到的最新消息放置在消息列表中历史消息的最上面,使得用户从讨论区tab触发遥控器下键,焦点落在消息列表顶部的新消息上,以从顶部的新消息开始按遥控器下键,实现向下浏览历史消息,方便用户按键操作。为此,需要对新接收到的消息和历史消息重新排序后再展示,保证新消息发布在历史消息的最上面,更符合用户使用遥控器按钮的操作逻辑,方便用户浏览历史消息。
图25本申请一些实施例中消息的展示方法的流程图;图26本申请一些实施例中消息的展示方法的时序图。为将用户接收到的新消息展示在消息列表的最上方,本申请实施例提供一种显示设备,包括:显示器,被配置为呈现显示有讨论控件的用户界面;与显示器连接的控制器,在执行图25和图26所示的消息的展示方法时,控制器被配置为执行下述步骤:
S1、响应于触发讨论控件时产生的控件启动指令,获取参与直播程序的所有用户在互动时产生的消息,以及,在用户界面中生成列表展示窗口。
在直播课进行时,用户界面中呈现直播界面,且在直播界面中显示有讨论控件,如图24中的讨论区tab。触发讨论控件即产生控件启动指令,以在用户界面中显示列表展示窗口,用于展示消息列表。
在一些实施例中,触发讨论控件的方式可为通过触发遥控器方向键的方式进行触发。例如,若当前遥控器的控制焦点位于功能区,则触发遥控器的右键,将控制焦点由功能区最右侧的功能控件上向右移动至讨论控件(讨论区tab)。若当前遥控器的控制焦点位于学生列表tab或学生列表中某个学生信息的展示位上,则触发遥控器的左键,将控制焦点由向左移动至讨论控件。若当前遥控器的控制焦点位于消息列表中某个消息的展示位上,则触发遥控器的上键,将控制焦点由向上移动至讨论控件。
在上述任一种触发方式下,在控制焦点位于讨论控件时,即产生控件启动指令,此时,需在消息列表区展示列表展示窗口,以展示学生和学生、学生和教师之间的文字聊天消息。
控制器在接收到控件启动指令后,需获取参与直播程序的所有用户在互动时产生的消息。互动产生的消息包括在进行上一次直播时产生的历史消息和当前直播时产生的实时消息。因此,控制器在获取消息时,可在响应于触发讨论控件时产生的控件启动指令时,获取上一次启动直播程序时对应的所有用户在互动时产生的历史消息;并在本次直播程序启动后,获取当前次启动直播程序时所有用户在互动时产生的实时消息。
S2、按照每条消息的产生时间对所有消息进行排序,生成消息列表,产生时间邻近当前时间的消息展示在消息列表的顶部。
用户接收到的消息包括自己发送的消息和第三方发生的消息,例如,在一节直播课中,参与直播课的学生为数名,那么可产生聊天消息的用户可为所有学生,也可为教师。教师或其他学生产生的聊天信息,需要实时地显示在本端显示设备的消息列表 中。同样,本端显示设备产生的消息,也实时地显示在第三端显示设备的消息列表中。第三端显示设备展示消息的方法与本端显示设备展示消息的方法相同,此处不赘述。
为保证用户接收到的最新消息能够展示在消息列表的顶部,需要对所有消息按照时间顺序进行排序,以生成消息列表,消息列表中的消息排序规则为由上至下的展示顺序依次展示由晚到早接收到的消息,也就是说,每条消息的产生时间越临近当前时间,则展示在消息列表的位置越接近顶部,而最临近当前时间的消息则展示在消息列表的顶部。
在一些实施例中,控制器在执行按照每条消息的产生时间对所有消息进行排序,生成消息列表,被进一步配置为执行下述步骤:
步骤21、获取每条消息的产生时间。
步骤22、按照产生时间从邻近当前时间到远离当前时间的顺序,将所有消息进行排序,得到消息序列,产生时间邻近当前时间的消息为消息序列中的第一位消息。
步骤23、基于消息序列,生成消息列表,消息序列中的第一位消息位于消息列表的顶部。
每个用户在发送消息时,该条消息均对应一个发送时间,即产生时间。控制器将获取到的所有信息按照产生时间的时间顺序进行排序,为保证最晚接收到的消息位于消息列表的顶部,则需按照产生时间从邻近当前时间到远离当前时间的顺序进行排序,以得到消息序列。当前时间是指晚于各消息产生时间的时间,至多是与各消息的产生时间相同。当前时间可为启动讨论控件时获取所有消息的时间,也可为接收新消息的时间。
消息序列中,第一位消息为产生时间临近当前时间的消息,即最晚接收到的最新消息。根据消息序列生成的消息列表,可以使得消息序列中的第一位消息位于消息列表的顶部,即最晚接收到的最新消息展示在消息列表的顶部,其余消息按照排序结果进行展示。
以对五条消息进行排序为例,当前时间为9:05,消息1的产生时间为8:05,消息2的产生时间为8:06,消息3的产生时间为8:00,消息4的产生时间为8:10,消息5的产生时间为7:55。将五条消息的产生时间按照从邻近当前时间到远离当前时间的顺序进行排序,为8:10>8:06>8:05>8:00>7:55。
基于产生时间从晚到早的排序结果,进而得到的消息序列为消息4>消息2>消息1>消息3>消息5。则该消息序列中的第一位消息为消息4,即将消息4展示在消息列表的顶部,其余消息按照排序结果进行展示。
在一些实施例中,控制器在执行基于消息序列,生成消息列表,被进一步配置为执行下述步骤:
步骤231、在消息的总条数超过消息列表的可视条数阈值时,将消息序列中的所有消息按照可视条数阈值对应的数量进行分组,得到多个消息分组。
步骤232、基于每个消息分组,生成对应的列表分页,每个列表分页中包括可视条数阈值对应数量的展示位,第一展示位位于列表分页的顶部,末尾展示位位于所述列表分页的底部,第一展示位中展示对应消息分组中的产生时间邻近当前时间的第一位消息。
步骤233、将多个展示有消息分组的列表分页生成消息列表,多个列表分页基于 对应消息分组中每条消息的展示顺序进行排序。
由于在进行一次直播课时,学生和教师均会产生数条消息,而列表展示窗口的可视区域有限,仅能展示一定数量的消息。因此,在控制器获取的所有消息的总条数超过可视区域的可视条数阈值时,需要对消息进行分页展示。前几个列表分页均展示可视条数阈值对应数量的消息,最后一个列表分页展示消息的条数可小于或等于可视条数阈值对应的数量。
列表展示窗口的可视区域有限,那么在包括数条消息的消息列表展示在列表展示窗口时,仅能展示部分消息。因此,可被看见的消息列表中消息的可视条数阈值即为列表展示窗口的可视条数阈值。
在控制器获取到的所有消息的总条数超过消息列表的可视条数阈值时,将消息序列中的所有消息按照可视条数阈值对应的数量进行分组,得到多个消息分组。例如,若消息序列中包括的所有消息的总条数为53条,而可视条数阈值的数量为5条,那么将消息序列中1-5位的消息分为第一组,6-10位的消息分为第二组,11-15位的消息分为第三组,……51-53位的消息分为第十一组。前十组消息分组中均包括5条消息,最后一组(十一组)消息分组中包括3条消息。
图27本申请一些实施例中列表分页的示意图。将得到的多个消息分组生成多个列表分页,每个列表分页中包括可视条数阈值对应数量的展示位,例如,参见图27,在可视条数阈值为5条时,列表分页中包括5个展示位。各个展示位依次排序,第一展示位位于列表分页的顶部,末尾(第五)展示位位于列表分页的底部,第一展示位中展示对应消息分组中的产生时间邻近当前时间的第一位消息(例如消息1),末尾展示位展示对应消息分组中的产生时间远离当前时间的最后一位消息(例如消息5)。
各个列表分页的展示顺序与各消息分组的分组顺序相同,即各个列表分页按照对应消息分组中每条消息的展示顺序进行排序,每个消息分组中的各个消息按照产生时间从临近当前时间到远离当前时间的顺序进行排序,那么每个列表分页也按照其包括各个消息的产生时间从临近当前时间到远离当前时间的顺序进行排序。
图28本申请一些实施例中消息列表的示意图。参见图28,将多个展示有消息分组的列表分页生成消息列表,消息列表中包括各个列表分页中的各个按照产生时间从临近当前时间到远离当前时间的顺序排序后的消息。若消息序列中包括的所有消息的总条数为53条,而可视条数阈值的数量为5条,那么第一列表分页包括消息序列中1-5位的消息(第一组消息分组),第二列表分页包括消息序列中6-10位的消息(第二组消息分组),第三列表分页包括消息序列中11-15位的消息(第三组消息分组),……,第十列表分页包括消息序列中46-50位的消息(第十组消息分组),第十一列表分页包括消息序列中51-53位的消息(第十一组消息分组)。
由于消息列表中的消息已按照每条消息的产生时间进行排序,且最新产生的新消息位于第一位,那么在展示时,可保证最新收到的新消息展示在消息列表的顶部。
S3、将消息列表展示在列表展示窗口。
在启动讨论控件时,根据获取到的所有消息进行排序后,得到消息列表,可将消息列表展示在列表展示窗口,便于用户进行浏览。
图29本申请一些实施例中在用户界面展示消息列表的示意图。参见图29,在用户从讨论控件通过触发遥控器下键,在消息列表区呈现列表展示窗口,将控制焦点移 动至位于讨论控件下方的列表展示窗口中显示的消息列表中,且控制焦点位于消息列表的顶部。而消息列表的顶部显示有最新接收到的新消息(消息1),而历史消息(消息2、3、4、5等)则按照产生时间的从晚到早的顺序依次展示,因此,用户可通过继续触发遥控器下键,使得控制焦点在消息列表中向下移动,实现从最新消息开始依次浏览历史消息。
若当前控制焦点位于消息列表的可视区域的底部,如果用户此时想要向上浏览消息或回到最新接收的新消息上,则用户可触发遥控器上键,使控制焦点沿消息列表向上移动,直到移动至最新消息上。
本申请实施例提供的显示设备所采用的消息展示方法,可使用户从讨论区tab触发遥控器下键,焦点会落在消息列表的顶部,并定位到最新一条消息上。在用户想查看消息列表中的历史消息时,按遥控器下键从顶部的新消息开始向下开始浏览。若用户想要回到讨论区tab,则触发遥控器上键即可。可见,用户回到“讨论区”tab的操作(按上键)与浏览历史消息的操作(按下键)不会产生冲突,将消息展示在消息列表的顶部可便于从新消息开始浏览历史消息,符合用户的浏览习惯,提高用户体验。
在一些实施例中,在直播课过程中,参与直播课的每名学生和教师均可通过讨论区tab实现文字聊天,因此,需将各自产生的新消息同步至其他学生或教师端。
因此,在本端展示用户自己发送的新消息或展示其他第三端用户发送的新消息时,控制器被进一步配置为执行下述步骤:
步骤41、接收用户基于列表展示窗口中展示的输入框进行输入操作时产生的新消息。
步骤42、将新消息展示在消息列表的顶部,以及,将新消息发送至服务器,服务器用于将新消息发送至第三端设备的列表展示窗口进行展示。
在用户通过遥控器触发讨论控件时,在消息列表区呈现列表展示窗口,同时,在列表展示窗口中展示输入框,用户可通过输入框输入文字产生新消息。第三端用户也可通过其所使用的显示设备中显示的用户界面中的输入框产生新消息。
为实现参与直播课的各学生和教师端的信息交互展示,以本端接收到新消息为例,在接收到新消息后,由于新消息的产生时间必然晚于消息列表中已存在的历史消息,因此,可直接将新消息展示在消息列表的顶部。
在本端用户通过输入框进行输入操作,产生新消息后,直接展示在本端消息列表的顶部,同时,将该新消息发送至服务器,由服务器将该新消息转发至其他第三端设备,以展示在第三端设备中的列表展示窗口,具体地,展示在第三端设备中的消息列表的顶部。
服务器在将本端的新消息转发至其他第三端设备时,服务器需先判断本端发送的新消息是否成功。如果存在网络不好或服务器故障,则将导致本端的新消息发送失败,因此,只有在服务器检测到本端的新消息发送成功时,才将新消息转发至其他第三端设备进行展示。
在一些实施例中,如果服务器检测到本端的新消息发送失败时,控制器被进一步配置为执行下述步骤:
步骤51、接收服务器在判断新消息发送失败时产生的失败通知。
步骤52、响应于失败通知,生成发送失败提示框,将发送失败提示框显示在新消 息的展示位置的一侧。
如果服务器检测到本端的新消息因网络问题或服务器故障等原因发送失败,则接收服务器返回的失败通知,说明本端的新消息无法发送至其他第三端设备进行展示。
图30本申请一些实施例中新消息发送异常时的界面示意图。参见图30,为提示本端的新消息发送异常,可在接收到服务器返回的失败通知后,在列表展示窗口中展示发送失败提示框,具体地,将发送失败提示框显示在该发送失败的新消息所在位置的一侧。发送失败提示框可以异常图案的形式进行展示,例如,异常图案可采用“红色感叹号”来表示。
在一些实施例中,由于消息列表中包括多个列表分页,用户可基于多个列表分页进行浏览历史消息,而若在用户浏览历史消息的过程中,接收到来自本端用户产生的新消息或来自其他第三端设备发送的新消息时,在展示新消息之前,需判断用户浏览的历史消息在消息列表中的所在位置。
因此,在接收到新消息后,控制器在执行将新消息展示在消息列表的顶部,被进一步配置为执行下述步骤:
步骤421、判断消息列表的第一位可视消息是否为展示在第一列表分页的第一展示位的消息,第一列表分页是指位于消息列表第一位的列表分页。
步骤422、如果是,则将新消息展示在第一列表分页的第一展示位,以及,将第一列表分页中的在先展示消息向下移动一位进行展示,第一列表分页的末尾展示位中的消息滚动至下一列表分页中的第一展示位进行展示。
在本端接收到新消息后,先判断当前消息列表的第一位可视消息是否为展示在消息列表顶部的消息,即是否是展示在第一列表分页的第一展示位的消息,第一位可视消息是指消息列表在列表展示窗口中展示的部分消息中可被看到的第一位消息。
由于如果用户在浏览历史消息时,是基于各个列表分页的顺序进行浏览,正在浏览的列表分页处于列表展示窗口的可视区域内。因此,如果消息列表的第一位可视消息为消息列表顶部的消息,说明当前用户并未浏览消息列表中的历史消息;如果消息列表的第一位可视消息不是消息列表顶部的消息,说明当前用户正在浏览消息列表中的历史消息。
在判断出消息列表的第一位可视消息是消息列表顶部的消息时,此时,可将接收到的新消息直接展示在消息列表的顶部,即展示在第一列表分页的第一展示位。而原位于第一列表分页的第一展示位的消息将作为历史消息向下移动一位进行展示,即展示在第二展示位中。
由于每个列表分页中仅可最多展示可视条数阈值对应数量的消息,因此,在第一列表分页中展示新消息后,第一列表分页中的总消息条数超过可视条数阈值,此时,可将原位于第一列表分页的末尾展示位的消息移动至下一列表分页中进行展示,具体地,移动至第二列表分页的第一展示位中进行展示。第二列表分页的末尾展示位的消息移动至下一列表分页中进行展示,依此类推,将消息列表中的历史消息均向下移动一位进行展示。
图31本申请一些实施例中消息列表中展示新消息的示意图。参见图31,例如,若第一列表分页中各个展示位中依次展示消息1、消息2、消息3、消息4、消息5,第二列表分页中各个展示位中依次展示消息6、消息7、消息8、消息9、消息10。若 此时接收到新消息,则将新消息展示在第一列表分页的第一展示位,即原消息1的展示位置。而原位于第一列表分页的第一展示位的消息1将作为历史消息向下移动一位进行展示,即展示在第二展示位中;依此类推,原展示在第一列表分页的末尾展示位的消息5则展示在第二列表分页中的第一展示位中。其余消息依此展示,参见图31所示内容,此处不再赘述。
在一些实施例中,在判断出消息列表的第一位可视消息不是消息列表顶部的消息时,说明此时用户正在浏览历史消息,此时,控制器被进一步配置为执行下述步骤:
步骤423、如果消息列表的第一位可视消息不是展示在第一列表分页的第一展示位的消息,则在后台将新消息展示在第一列表分页的第一展示位,以及,生成新消息提醒界面。
步骤424、将新消息提醒界面展示在列表展示窗口中。
在本端显示设备接收到新消息(自己发送的消息或来自第三端设备发送的消息)后,判断出消息列表的第一位可视消息不是消息列表顶部的消息时,说明此时用户正在浏览其他列表分页中的历史消息,为避免影响用户正在浏览历史消息的进程,此时,仅将新消息在后台展示在第一列表分页的第一展示位,而不将消息列表滚动到顶部,即将消息列表保持当前的所处状态。
而在展示新消息后,为提醒用户当前已接收到新消息进行及时查看,可在后台展示新消息时,同步生成新消息提醒界面,并新消息提醒界面展示在列表展示窗口中。
图32本申请一些实施例中消息列表中展示新消息提醒界面的界面示意图。参见图32,在展示新消息提醒界面时,可展示在列表展示窗口的底部,具体可展示在当前浏览的列表分页的底部,以避免对当前所浏览的列表分页中的信息造成遮挡。新消息提醒信息的内容可基于本端接收到的新消息的条数生成。若用户在浏览历史消息过程中,本端接收到多条新消息,则可对应生成包含新消息条数的提醒信息。例如,新消息提醒界面中呈现新消息提醒信息,信息内容可为“您收到X条新消息”。
在一些实施例中,若消息列表中按照多个列表分页的形式展示数条信息,因此,用户可采用分页浏览的形式浏览消息列表中的各条信息,此时,控制器被进一步配置为:
步骤61、响应于用户基于讨论控件产生的浏览消息列表中任一消息的向下浏览指令,将控制焦点由讨论控件移动至消息列表中第一列表分页的第一展示位上。
步骤62、在控制焦点移动至第一列表分页的末尾展示位上时,生成加载状态提示框,将加载状态提示框显示在第一列表分页的底部。
在用户想要启动讨论控件,在列表展示窗口展示消息列表后,若用户想要浏览消息列表中的历史消息,则可触发遥控器下键,产生向下浏览指令,控制器响应向下浏览指令,将控制焦点由讨论控件移动至消息列表的顶部,即移动至消息列表中第一列表分页的第一展示位上。
若用户想继续浏览其余历史消息,则连续触发遥控器下键,使得控制焦点在当前所浏览的列表分页上向下移动。
在控制焦点移动至当前所浏览的列表分页的末尾展示位上时,说明用户已浏览到当前列表分页中的最后一条消息,因此,为提示用户可继续下一列表分页中的消息,可在当前浏览的列表分页的底部显示加载状态提示框。
图33本申请一些实施例中消息列表中展示加载状态提示框的界面示意图。参见图33中(a),在用户通过触发遥控器下键浏览到当前所浏览的列表分页的最后一条消息时,例如,浏览到第一列表分页的末尾展示位上的消息时,可在该条消息的底部自动展示加载状态提示框,加载状态提示框中的提示信息可为“加载中……”。
在一些实施例中,在分页浏览历史消息时,控制器被进一步配置为执行下述步骤:
步骤63、响应于在生成加载状态提示框时产生的系统通知,获取消息列表中第二列表分页中的消息。
步骤64、在加载状态提示框的显示时长达到预设时间阈值时,将第二列表分页中的消息展示在第一列表分页的底部。
在完成当前列表分页中的消息浏览后,同步展示加载状态提示框,为获取到下一列表分页中的消息,可在生成加载状态提示框的同时产生系统通知,控制器接收到系统通知,可获取消息列表中下一列表分页中的消息。例如,若当前浏览的列表分页为第一列表分页,则获取的是第二列表分页中的消息;当前浏览的列表分页为第二列表分页,则获取的是第三列表分页中的消息。
为加载状态提示框的显示时长设定时间阈值,该时间阈值内需将下一列表分页中的消息获取到。在加载状态提示框的显示时长达到预设时间阈值时,可将获取到的下一列表分页中的消息展示在当前浏览的列表分页的底部,例如,将第二列表分页中的消息展示在第一列表分页的底部,同时,取消加载状态提示框的显示。
参见图33中(b),在显示第二列表分页中的消息时,将第二列表分页中的各消息以连续状态显示在第一列表分页中最后一条消息的下方,例如,将第二列表分页中的第一展示位上的消息6展示在第一列表分页中的末尾展示位上的消息5的下方,其他消息依次展示。
在分页浏览历史消息时,若在浏览到当前列表分页的最后一条消息(控制焦点位于该条消息上)后,再次触发下键,自动获取下一列表分页中的消息,用户可触发遥控器下键继续使控制焦点向下移动,以便用户能够浏览更早的聊天记录。
在一些实施例中,在用户浏览历史消息过程中,如果用户浏览到后续几个列表分页的消息时,若此时用户想退出历史消息浏览,回到讨论控件(讨论区tab)或查看最新接收到的新消息,通常向上浏览消息可通过触发遥控器上键来实现,但是在浏览过的消息较多时,则无法通过持续按遥控器上键依次退回到上一消息,效率低下。因此,为快速回到讨论控件,控制器被进一步配置为执行下述步骤:
步骤71、在控制焦点位于消息列表中的任一展示位上时,接收用户触发返回键产生的返回指令。
步骤72、响应于返回指令,将控制焦点由消息列表中的任一展示位移动至讨论控件上,以及,将消息列表的第一列表分页的消息展示在列表展示窗口,列表展示窗口的第一位可视消息为第一列表分页的第一展示位上的消息。
在用户浏览历史消息过程中,若用户想快速返回到讨论控件,或者想查看新接收到的新消息时,则可触发遥控器返回键,产生返回指令。
图34本申请一些实施例中消息的展示方法的业务流程图。参见图34,控制器接收到返回指令后,可将原位于所浏览的某条消息展示位上的控制焦点移动至讨论控件。同时,将消息列表自动滚动到最顶部,即将消息列表的第一列表分页的消息展示在列 表展示窗口,列表展示窗口的第一位可视消息为第一列表分页的第一展示位上的消息。
在一些实施例中,由于用户可使用遥控器使控制焦点在用户界面中呈现的直播界面中各可点击的控件之间进行切换,而为便于在控制焦点切换到讨论控件时,用户能够直接查看到最新接收到的新消息,也可自动将消息列表滚动到最顶部。在该过程中,控制器被进一步配置为执行下述步骤:
步骤81、接收用户由其他控件切换至讨论控件时产生的切换指令。
步骤82、响应于切换指令,将控制焦点由其他控件移动至讨论控件上,以及,将消息列表的第一列表分页的消息展示在列表展示窗口,列表展示窗口的第一位可视消息为第一列表分页的第一展示位上的消息。
用户界面中的其他控件包括学生列表tab和展示功能区中的各个功能控件,用户通过触发遥控器从上述控件切换到讨论区控件时,产生切换指令,以将控制焦点由其他控件移动至讨论控件上。
例如,再次参见图32,在由功能区切换到讨论控件时,用户需要通过遥控器按键(左键或右键)在功能区的不同功能控件上移动,当移动到最后侧的功能控件上时,继续按右键,控制焦点选中讨论区tab,同时产生切换指令。在由学生列表tab切换到讨论区tab时,用户可触发遥控器左键,产生切换指令,同时,将控制焦点由学生列表tab切换到讨论区tab。
控制器接收到切换指令后,可将原位于其他控件上的控制焦点移动至讨论控件。同时,为便于用户查看最新消息,将消息列表自动滚动到最顶部,即将消息列表的第一列表分页的消息展示在列表展示窗口,列表展示窗口的第一位可视消息为第一列表分页的第一展示位上的消息。
可见,本申请实施例提供的显示设备,在接收到新消息时,可将新消息展示在消息列表的顶部,且在用户利用遥控器的方向键由其他控件上切换到讨论控件时,可将消息列表自动滚动至顶部,以及,在浏览历史消息时,可在控制焦点位于任一消息所在展示位时,触发返回键,将消息列表自动滚动至顶部。在进行消息展示时,可保证新消息始终显示在消息列表的顶部,保证用户在浏览历史消息时能够及时查看最新接收到的新消息,且在浏览历史消息时不会与切换用户界面中各控件之间的操作产生冲突,便于用户浏览消息。
图25本申请一些实施例中消息的展示方法的流程图。参见图25,本申请还提供了一种消息的展示方法,由前述实施例提供的显示设备中的控制器执行,所述方法包括:
S1、响应于触发讨论控件时产生的控件启动指令,获取参与直播程序的所有用户在互动时产生的消息,以及,在所述用户界面中生成列表展示窗口;
S2、按照每条所述消息的产生时间对所有消息进行排序,生成消息列表,所述产生时间邻近当前时间的消息展示在消息列表的顶部;
S3、将所述消息列表展示在所述列表展示窗口。
由以上技术方案可知,本申请实施例提供的一种消息的展示方法及显示设备,在触发讨论控件时,获取参与直播程序的所有用户在互动时产生的消息,按照每条消息的产生时间对所有消息进行排序,生成消息列表,并展示在列表展示窗口,使得最晚接收到的消息展示在消息列表的顶部。可见,本申请实施例提供的方法及显示设备, 对所有消息按照产生时间从晚到早进行排序,将最新消息放置在消息列表的顶部,使得用户从讨论控件触发遥控器下键时,控制焦点落在消息列表顶部的新消息上,以从顶部的新消息开始实现向下浏览历史消息,更符合用户使用遥控器按键的操作逻辑,方便用户浏览历史消息。
在一些实施例中,为进行在线直播上课,可在显示设备内配置直播课应用程序。老师端显示设备和学员端显示设备内分别配置各自的直播课应用程序,老师和各个学员登录该应用程序后即可进入直播间,实现目标直播课的直播上课过程。
为便于在直播课的课程结束后,学员能够回看直播课的内容,通常需要对老师和各个学员的上课过程进行录制,生成回看视频文件,以备学员回看使用。
常用的录制方法是采用录屏方式,将直播课过程中的所有内容全部录制,学员在回看时直接播放视频文件。但是,后续回看时,所有学员看到的内容一样,缺少个性化,而实际直播上课时,学员A被老师提问回答问题,学员B未被老师问题回答问题,则学员A与学员B所经历的课程是有差异的。另外,所有学员回看时只能被动观看,缺少交互性,无法吸引学员将注意力全部用在视频文件上,导致学员体验不好。
因此,在这种应用场景下,本申请实施例提出一种直播课回看方法,可以在直播课回看过程中,还原在线直播上课时的场景,让学员重新经历一遍现场直播上课的过程,提高学员的注意力。另外,在回看时,还可提供学员参与到回看直播课的课程中,实现一些互动,提高用户体验。
图35本申请一些实施例中直播课应用场景示意图。参见图35,在同一直播课过程中,会存在至少一位老师和至少一位学员,每个老师和每个学员均利用各自的显示设备参与到直播课过程中,如老师A1、老师A2……老师AN,学员B1、学员B2、学员BN。为实现直播课,老师和学员分别利用各自的显示设备,在各个显示设备中安装直播课应用程序,并登录各自的账号,得到老师端显示设备201和学员端显示设备202。
老师端显示设备201和学员端显示设备202分别与业务服务器500和直播服务器600连接,在实现直播课回看方法时,需先将直播课进行时的上课内容进行录制,即由业务服务器获取各老师端显示设备201和各学员端显示设备202的互动数据,业务服务器500内配置数据库501,以存储业务服务器获取的互动数据;由直播服务器600实现老师和学员的在线直播上课并对直播课内容进行录制。
为保证学员在回看直播课录制的视频文件时能够实时进行互动,一方面需要利用业务服务器将在直播课时老师和学员产生的互动数据进行存储,利用直播服务器录制直播课画面形成视频文件;另一方面在回看时,播放视频文件,并以视频文件的时间轴为准,基于互动标识对应显示老师产生的互动数据和学员产生的互动数据,实现学员在回看视频文件时的实时互动。
因此,在进行直播课录制过程时,本申请实施例提供一种服务器,应用于业务服务器,为保证后续回看时可供学员实时互动,在录制时,需将直播课画面与互动数据分开存储,即只录制老师讲课的内容,而老师与学员的互动数据,以直播课进行的时间轴为基准,存储到业务服务器的数据库中。其中,互动数据包括老师产生的互动数据和学员产生的互动数据。
图36本申请一些实施例中直播课录制方法的流程图;图37本申请一些实施例中 直播课录制方法的交互流程图。参见图36和图37,本申请实施例提供的一种服务器,包括:数据库和控制器,数据库被配置为存储学员互动数据、老师互动数据和视频文件信息;控制器与数据库连接,在执行直播课录制方法时,控制器被配置为执行下述步骤:
S11A、在直播服务器响应于老师端显示设备产生的直播课开始录制指令之后,获取直播课过程中老师端显示设备产生的老师互动数据。
老师端显示设备进入直播课所在直播间,老师端显示设备的显示器中呈现老师端直播课界面。
图38本申请一些实施例中老师端直播课界面的显示示意图。参见图38,在直播课开始时,老师端直播课界面显示有课程内容区、学员视频区、老师视频区和直播信息展示区,可实现三分屏上课。学员视频区用于显示学生图像,老师视频区用于显示老师图像,学员图像和老师图像由其使用的显示设备配置的摄像头(如图3中的图像采集器)进行采集。课程内容区显示直播画面,课程内容区的下方显示主功能区,主功能区用于切换讲义、白板和视频等功能。主功能区的下方显示直播操作按钮和战队比拼情况,直播操作按钮包括画笔、开始直播(开启后切换为暂停直播)、结束直播等按钮。为提高上课效果,老师在直播前,可将参与该直播课的学员分成两个战队,如老虎战队和汪汪战队,通过在上课期间回答问题等累积积分,在课程结束后,哪一战队的积分高,则该战队的学员会得到相应的奖励。战队比拼情况实时显示两个战队的积分。
老师端直播课界面中的直播信息展示区用于提供当前直播课的直播信息,包括讨论区、学生列表和随堂练。讨论区用于实现在直播课上课时,老师与学生之间、学生与学生之间的实时文字(或语音)讨论和互动。学生列表用于显示当前直播课的上课人数和上课的学生信息。随堂练用于实现老师在线实时出题功能,在直播课上课时,老师可通过随堂练实时出题并推送给学生端,学生可通过其使用的显示设备进行答题。
图39本申请一些实施例中学员端直播课界面的显示示意图。参见图39,在直播课开始时,学员端显示设备也进入该直播间,学员端显示设备的显示器中呈现学员端直播课界面。学员端直播课界面展示有课程内容区、学员视频区、老师视频区、功能区和战队比拼情况。课程内容区的直播课画面与老师端直播课界面的课程内容区内的直播课画面一致,老师视频区用于显示老师图像,学员视频区用于显示学生图像。在同时进行直播课上课的学员为多个时,学员视频区显示多个学生图像。如果在直播课上课时老师与其中一个学员进行连麦,那么该连麦学员的图像显示在课程内容区。
功能区用于实现学生在直播课上课时的互动功能,包括麦克风、摄像头、举手、画笔和讨论等功能控件。在直播课上课时,学生若想要主动回答老师的提问,可通过触发举手功能控件,以告知老师其想要回答问题;通过触发麦克风控件实现语音的开启和关闭。摄像头控件用于控制是否需要采集学员自身的图像。画笔功能控件用于根据老师的授权可进行相应的画笔操作,例如,调整画笔样式和涂写、作画等,画笔样式包括但不限于画笔形状、颜色、粗细、字体等。涂写时,学生可通过与显示设备搭配使用的触控笔在触摸屏显示器中涂写,或者,直接用手指在触摸屏显示器中涂写。讨论控件可实现老师与学生之间、学生与学生之间的实时文字讨论和互动,可参照老师端直播课界面中的讨论区功能。学员端展示的战队比拼情况用于展示学员加入的战 队和战队比分,学员所属战队的名称尺寸大于另一战队名称尺寸,如图39所示,该学员加入老虎战队。
在老师和学员均进入直播课对应的直播间后,老师点击老师端显示设备中呈现的老师端直播课界面中的开始直播按钮开始上课,并产生直播课开始录制指令,发送至直播服务器,直播服务器用于实现直播课的直播上课,同时老师端显示设备的直播课界面中的课程内容区显示直播课画面。
图40本申请一些实施例中录制直播课的示意图。直播服务器在接收到直播课开始录制指令后,即开始进行视频数据的录制,视频数据包括直播课画面、老师视频区显示的老师图像以及老师与学员的语音数据,参见图40中两个方框框住的区域,分别为课程内容区显示的直播课画面和老师视频区显示的老师图像。如果在直播课上课过程中,老师与其中一名学员处于连麦状态,则课程内容区展示该学员的图像,此时,直播课画面包括课程内容和连麦学员图像。同时,直播服务器将直播课画面推送至各学员端显示设备中,此时,老师端显示设备中直播课画面的显示内容与学员端显示设备中直播课画面的显示内容相同。
在直播课开始后,老师会实时产生互动数据,例如,老师基于直播课的内容,会实时提出不同的问题需要学员进行回答。老师端显示设备对应的直播间中显示有互动按钮,例如在直播信息展示区展示的随堂练按钮,老师点击随堂练按钮(互动按钮),即可进行出题操作,产生老师互动信息,老师互动信息包括互动序号、互动内容、互动选项和互动正确结果。互动序号用于表征老师出题的题号,互动内容用于表征老师出题的题目及类型,互动选项用于表征题目的备选答案,互动正确结果用于表征老师出题的正确答案。
图41本申请一些实施例中随堂练的界面示意图。参见图41,老师点击随堂练按钮,进入随堂练界面。老师在随堂练界面设置互动序号(题号)、互动内容(题目)、互动选项(备选答案)和互动正确结果(正确答案),然后点击出题按钮,即可完成一次互动动作(出题操作)。互动内容写明题干和题目类型,题目类型包括单选题、多选题、判断题等。老师端显示设备在响应触发出题按钮产生的出题指令(互动指令)后,将老师互动信息发送至业务服务器进行存储。老师在进行一次互动后,即产生老师互动数据,例如,老师每出一次题,即产生一个包括老师互动信息的老师互动数据。
老师可在出题阶段设定每道题的显示时长,即供学员答题的时长;老师还可手动结束答题,例如,在直播课的所有学员答题完毕或者大多数都已答题的情况下,老师点击图41所示的结束答题按钮,答题结束,学员将不可再进行答题操作。随堂练界面显示的计时区显示当前学员答题的时长,答题时长是指从老师点击出题按钮的时刻到点击结束答题按钮的时刻所对应的时长,或者,是指老师设定的每道题的显示时长。
业务服务器实时检测老师端显示设备的指令,如果检测到老师端显示设备产生出题指令(互动指令),说明老师点击随堂练按钮并完成一次出题动作,随即获取老师端显示设备产生的老师互动数据。在直播课的过程中,老师会执行多次互动动作,即会出多个题目,因此,会产生多个老师互动数据。
S12A、将老师互动数据发送至学员端显示设备进行显示。
老师完成一次出题后,即执行一次互动动作,业务服务器将老师互动数据发送至学员端显示设备进行显示。如果在直播课有多名学员参与,则在每个学员端显示设备 中均显示老师互动数据,即显示老师产生的题目信息。
图42本申请一些实施例中学员端显示设备呈现老师互动数据的界面示意图。参见图42,在一些实施例中,学员端显示设备接收到老师端显示设备发送的老师互动数据后,基于老师互动数据生成互动界面,互动界面中展示老师互动数据中的互动序号、互动内容和互动选项,并展示提交按钮,互动正确结果在出题阶段不进行展示,在学员完成作答之后再进行展示。互动界面以浮窗的形式显示在课程内容区的上方浮层中,学员可利用触控笔、遥控器或手指点击互动界面中展示的任一互动选项,完成选择后,点击提交按钮,完成当前学员互动。
例如,互动界面中呈现互动序号为“8”,互动内容为“题目和多选题”,互动选项为“ABCD”,以及,提交按钮等内容,且每个互动选项均为可触发状态,提交按钮示意性地设置在互动选项的右侧。
S13A、获取学员端显示设备基于老师互动数据产生的学员互动数据,以及,直播服务器发送的视频文件信息,视频文件信息是指直播服务器响应于老师端显示设备产生的直播课结束录制指令后生成的文件的信息。
业务服务器将老师产生的老师互动数据推送至学员端显示设备后,各对应学员即可根据各自所使用的显示设备中显示的互动界面所示的老师互动数据进行互动,即根据题目和互动选项,学员点击其中一个其认为与题目相匹配的互动选项作为答案。学员点击其中一个互动选项后,点击提交按钮,即产生学员互动数据,学员互动数据包括学员点击的至少一个互动选项内容,即学员作答的答案。
学员每基于一个老师互动数据点击一次提交按钮,即为一次互动,并对应产生学员互动数据。产生互动的时间为学员互动数据的产生时间点,将学员互动数据、对应产生时间点、学员ID发送至业务服务器进行存储。
学员端显示设备中的直播间显示直播课画面,在接收到业务服务器发送的老师互动数据后,基于老师互动数据生成互动界面,并显示在直播课画面的上层。再次参见图42所示,学员基于互动界面中显示的老师互动信息进行互动,若当前学员基于互动序号为“8”的题目,触发互动选项A,而后点击提交按钮,产生学员互动数据,此时,学员互动数据为互动选项A对应的内容。
在直播课过程中,老师会产生多个老师互动数据,并根据时间顺序,依次由业务服务器推送至学员端显示设备,学员根据其所使用的显示设备上依次显示的互动界面中呈现的老师互动数据,会对应产生多个学员互动数据。
在直播课结束时,老师点击直播间中显示的结束直播按钮(可位于直播课画面的下方),产生直播课结束录制指令至直播服务器,关闭直播课的直播间,直播课录制结束,此时直播课处于已结束但无法回看的状态。
直播服务器响应于直播课结束录制指令,根据其在直播课过程中录制的直播课画面、老师视频区的老师图像和老师与学员的语音信息,生成视频文件。直播服务器基于视频文件生成视频文件信息,并发送至业务服务器。视频文件信息包括视频文件回看地址和视频文件时间轴,视频文件回看地址是指可供访问视频文件的URL地址,视频文件时间轴用于表征视频文件的视频时长,视频文件时间轴与直播课上课时的时间轴相同。
在直播服务器处理完视频文件,并返回到业务服务器后,业务服务器可将直播课 的课程状态修改为可回看状态,便于提示学员可点击回看。同时,可在直播课显示界面中显示回看按钮,便于学员触发以回看视频文件。
图43本申请一些实施例中学员端直播课显示界面的显示示意图。参见图43,在完成直播课上课后,学员端显示设备返回到直播课显示界面,直播课显示界面中呈现日期选择区以及学员已经结束上课或即将上课的直播课列表。日期选择区用于显示日期,每个日期对应显示每天存在的直播课列表,直播课列表中每个直播课对应显示直播课状态,直播课状态包括但不限于直播中状态、即将直播状态和可回看状态。完成直播课之后,相应直播课的右侧对应显示回看按钮,如“看回放”,以将直播课的课程状态修改为可回看状态。后续学员要回看直播课时,点击回看按钮,即可进入直播课回看界面进行回看。
S14A、将老师互动数据、学员互动数据和视频文件信息发送至数据库进行存储。
为便于后续在回看直播课时,学员可基于视频文件进行实时互动,业务服务器需将互动数据和视频文件信息分开存储,并存储至数据库。存储时,可与直播课上课时的直播课ID作为存储标识,将互动数据和视频文件信息与直播课ID建立对应关系后进行存储,便于后续基于直播课ID进行准确调取互动数据和视频文件信息。
在一些实施例中,业务服务器中的控制器在执行将老师互动数据发送至数据库进行存储,被进一步配置为执行下述步骤:
步骤1411、获取直播课的直播课ID和直播课时间轴,以及,老师端显示设备在执行每个互动动作时产生的开始时间、持续时长和老师互动信息,互动动作是指老师端显示设备基于直播课画面显示的互动按钮产生的动作,直播课画面是指老师端显示设备在产生直播课开始录制指令后显示的画面。
步骤1412、基于每个互动动作对应的开始时间、持续时长和老师互动信息,生成老师端显示设备在执行每个互动动作时对应产生的老师互动数据。
步骤1413、基于直播课时间轴和每个互动动作的开始时间的时间对应关系,在直播课时间轴上对应添加老师互动标识。
步骤1414、创建每个老师互动数据、直播课ID、老师互动标识和直播课时间轴的对应关系,将对应关系存储至数据库。
由于老师在直播课过程中会执行多次互动动作,产生多个对应的老师互动数据。因此,为保证老师互动数据与直播课时间轴对应显示,需要将多个老师互动数据以直播课时间轴为基准,即在直播课时间轴上添加老师互动标识,并按照每个互动动作的时间顺序依次添加老师互动标识。存储时,每个老师互动数据也依据时间顺序依次进行存储。老师互动标识用于表征直播课时间轴的当前时刻存在老师互动数据。
获取直播课的直播课ID和直播课时间轴,直播课ID用于表征老师与学员进行的直播课名称或序号,以与其他直播课进行区分;直播课时间轴用于表征直播课的时长。
直播课画面所在直播间界面显示有互动按钮(随堂练按钮),老师点击一次互动按钮,完成相应互动信息的设置后,即执行一次互动动作。老师每执行一次互动动作,即产生对应的开始时间、持续时长和老师互动信息,并在开始时间对应的时刻在直播课时间轴上添加老师互动标识。互动动作即为出题动作,开始时间用于表征该题目的产生时间点,即点击出题按钮的时间点,持续时长用于表征该题目的显示时长,老师互动信息即为老师提出的题目信息,老师互动信息是指老师端显示设备产生的互动序 号、互动内容、互动选项和互动正确结果。每个互动动作对应的开始时间、持续时长和老师互动信息,即为该互动动作对应产生的老师互动数据。
将每个互动动作的开始时间与直播课时间轴上的时间对应,例如,如果互动动作1的开始时间为0:23:28,持续时长为5秒,则在直播课时间轴上23分28秒处添加老师互动标识1,以与互动动作1产生的老师互动数据建立关联,并设定老师互动数据的显示时长为5秒。如果互动动作2的开始时间为0:35:50,持续时长为6秒,则在直播课时间轴上35分50秒处添加老师互动标识2,以与互动动作2产生的老师互动数据对应,并设定老师互动数据的显示时长为6秒。
基于此,将每个互动动作与直播课时间轴的时间对应关系作为关联基准,将对应的每个老师互动数据、直播课ID、每个老师互动标识和直播课时间轴建立对应关系,并将此对应关系存储至数据库。
在一些实施例中,老师每执行一次互动动作,即产生一个对应关系,在直播课过程中产生的数个互动动作,其对应的数个对应关系可在直播课结束后统一存储至业务器,还可在每产生一个对应关系立即存储至业务服务器。也就是说,存储对应关系的执行过程可发生在直播课结束之后,并且,将该对应关系存储至数据库的执行过程还可发生在业务服务器接收到老师端显示设备发送的老师互动数据之后,即业务服务器在接收到老师互动数据后即发送至数据库进行存储,再将老师互动数据推送至各学员端显示设备进行显示。具体的存储过程可根据实际应用情况进行,此处不做具体限定。
在一些实施例中,业务服务器中的控制器在执行将学员互动数据发送至数据库进行存储,被进一步配置为执行下述步骤:
步骤1421、获取直播课的直播课ID和直播课时间轴,以及,每个学员端显示设备对应的学员ID、每个学员互动数据和每个学员互动数据的产生时间点。
步骤1422、向数据库请求存储的老师互动信息,老师互动信息是指老师端显示设备在执行每个互动动作时产生的信息。
步骤1423、基于老师互动信息和每个学员互动数据,判断每个学员互动数据的互动结果。
步骤1424、基于直播课时间轴和每个学员互动数据的产生时间点的时间对应关系,在直播课时间轴上对应添加学员互动标识。
步骤1425、将每个学员ID、每个学员互动数据、每个学员互动数据对应的互动结果、每个学员互动数据的产生时间点、每个学员互动标识、直播课ID和直播课时间轴建立对应关系,将对应关系存储至数据库。
学员每基于一个老师互动数据会对应产生一个学员互动数据,因此,为保证学员互动数据与直播课时间轴对应显示,需要将多个学员互动数据以直播课时间轴为基准,即在直播课时间轴上添加学员互动标识,并按照每个学员互动数据的产生时间点的时间顺序依次添加学员互动标识。存储时,每个学员互动数据也依据时间顺序依次进行存储。学员互动标识用于表征直播课时间轴的当前时刻存在学员互动数据。
获取每个学员ID,该学员ID所属学员所产生的数个学员互动数据和每个学员互动数据的产生时间点,学员ID用于区分该直播间进行直播课的所有学员,如学员B1、学员B2、学员BN等。同一个学员会产生多个学员互动数据,学员互动数据的个数与老师互动数据的个数相同。
图44本申请一些实施例中学员互动数据的对照表。参见图44,若老师互动数据为m个,则每个学员所产生的学员互动数据均为m个,例如,学员B1产生m个学员互动数据,学员B2产生m个学员互动数据,学员BN产生m个学员互动数据。
针对同一个学员,其产生的多个学员互动数据的时间点与老师互动数据的产生时间点对应,因此,需获取每个学员互动数据的产生时间点,产生时间点即为学员选择某个互动选项后点击提交按钮时对应的时间。例如,学员B1产生的m个学员互动数据,对应产生时间点分别为t1 B1,t2 B1……tm B1。学员B2产生的m个学员互动数据,对应产生时间点分别为t1 B2,t2 B2……tm B2。学员BN产生的m个学员互动数据,对应产生时间点分别为t1 BN,t2 BN……tm BN
业务服务器在将学员互动数据进行存储,还需对学员互动数据进行正确性判断,并将判断结果同步进行存储。而用于判断正确性的信息存储在数据库,因此,业务服务器需向服务器获取互动信息,互动信息中包括互动正确结果。业务服务器根据某个学员互动数据与互动正确结果进行正确性判断,以得到对应的互动结果,互动结果可为“正确”或“错误并提供正确答案”。
将每个学员互动数据的产生时间点与直播课时间轴上的时间对应,添加学员互动标识,例如,如果学员B1的学员互动数据S1 B1的产生时间点t1 B1为0:23:30,则在直播课时间轴上23分30秒处添加学员互动标识M1 B1,以与学员互动数据S1 B1建立关联;如果学员B1的学员互动数据S2 B1的产生时间点t2 B1为0:35:55,则在直播课时间轴上35分55秒处添加学员互动标识M2 B1,以与学员互动数据S2 B1建立关联。
基于此,将每个学员对应的每个学员互动数据与直播课时间轴的时间对应关系作为关联基准,将每个学员ID、每个学员互动数据、每个学员互动数据对应的互动结果、每个学员互动数据的产生时间点、每个学员互动标识、直播课ID和直播课时间轴建立对应关系,将对应关系存储至数据库。一个学员对应产生数个对应关系,一个对应关系中包括学员ID、一个学员互动数据、一个产生时间点、一个互动结果、一个学员互动标识、直播课ID和直播课时间轴。
例如,学员B1产生的对应关系L1 B1包括学员B1、学员互动数据S1 B1、产生时间点t1 B1、互动结果P1 B1、学员互动标识M1 B1、直播课ID和直播课时间轴;对应关系L2 B1包括学员B1、学员互动数据S2 B1、产生时间点t1 B2、互动结果P2 B1、学员互动标识M2 B1、直播课ID和直播课时间轴,其他学员依此类推,具体可参照图44所示内容。
在一些实施例中,业务服务器中的控制器被进一步配置为:将每个学员互动数据的互动结果发送至对应的学员端显示设备,由每个学员端显示设备显示对应的互动结果。
每个学员在产生学员互动数据,即针对一个题目进行作答后,需获知其作答结果的正确性,因此,业务服务器需将其产生的互动结果返回至对应的学员端显示设备,显示在直播课画面中,以告知学员其作答结果。互动结果包括作答正确性结果和互动正确结果,例如,作答正确性结果包括“正确”和“错误”,互动正确结果为正确答案。
在一些实施例中,视频文件信息包括视频文件回看地址和视频文件时间轴;以及,业务服务器中的控制器在执行将视频文件信息发送至数据库进行存储,被进一步配置为执行下述步骤:
步骤1431、获取直播课的直播课ID和老师端显示设备对应的老师ID。
步骤1432、基于老师ID、视频文件回看地址和视频文件时间轴,生成与直播课ID对应直播课的视频文件信息。
步骤1433、将与直播课ID对应的视频文件信息存储至数据库。
直播服务器在生成视频文件后,向业务服务器发送视频文件信息。业务服务器不会直接存储视频文件,避免占用过多的空间,而替代会存储视频文件信息。在需要访问视频文件时,业务服务器基于视频文件回看地址访问视频文件即可。
因此,在将视频文件信息存储至数据库中时,将直播课ID和老师ID分别与视频文件信息进行对应,以便于后续回看时能够根据直播课ID和老师ID获取对应的视频文件信息。将老师ID、视频文件回看地址和视频文件时间轴,生成与直播课ID对应直播课的视频文件信息,存储至数据库,便于后续调取回看。
在一些实施例中,由于在完成直播课录制时,需将互动数据与视频文件信息分别进行存储,因此,基于老师互动数据、学员互动数据和视频文件信息生成直播课详情信息,存储至业务服务器的数据库。
可见,本申请实施例提供的一种服务器,应用在业务服务器,可在直播课过程中,实时获取老师端显示设备产生的老师互动数据,学员端显示设备基于老师互动数据产生的学员互动数据,以及,直播服务器录制的包括直播课画面的视频文件信息。将老师互动数据、学员互动数据和视频文件信息分别存储至数据库,便于后续学员回看时,能够在观看视频文件的同时,同步显示老师互动数据和/或学员互动数据,让学员重新经历一遍现场直播上课,并可在回看过程中参与到直播课中,进行互动,提高用户体验。
在直播课录制完毕后,学员便可基于自身的需求点击回看视频文件。为提供在回看时学员可以进行互动,在进行直播课回看过程中,本申请实施例提供一种显示设备,应用于学员端显示设备,在回看时,根据视频文件时间轴,实时显示对应的老师互动数据,并根据学员的操作,确定是否需要进行实时互动。在需要进行实时互动时,在直播课回看画面中生成互动界面,供学员互动。
图45本申请一些实施例中直播课回看方法的流程图;图46本申请一些实施例中直播课回看方法的交互流程图。参见图45和图46,本申请实施例提供的一种显示设备,包括:显示器和控制器,显示器被配置为呈现直播课显示界面,直播课显示界面中显示有与直播课ID对应的回看按钮;控制器与显示器连接,在执行直播课回看方法时,控制器被配置为执行下述步骤:
S21A、响应于触发回看按钮产生的直播课回看指令,生成包括视频播放窗口、播放按钮和学员数据展示按钮的直播课回看界面。
学员在需要回看某个直播课的视频文件时,点击配置的直播课应用程序,在显示器中的用户界面中呈现直播课显示界面,再次参见图44,直播课显示界面中显示有多个直播课,每个直播课对应显示一个回看按钮。多个直播课可由各自的直播课ID进行区分,一个直播课ID与一个回看按钮绑定。
学员在直播课显示界面中选择其中一个直播课进行回看时,点击该选定直播课对应的回看按钮,产生携带直播课ID的直播课回看指令。控制器响应于直播课回看指令,生成直播课回看界面,将显示器中显示的直播课显示界面切换显示为直播课回看界面。
图47本申请一些实施例中直播课回看界面的示意图。参见图47,学员端直播课 回看界面中包括视频播放窗口、播放按钮和学员数据展示按钮。视频播放窗口用于播放直播课录制时产生的视频文件,播放按钮用于控制视频文件的播放和暂停,学员数据展示按钮用于控制在直播课回看时是否需要同步展示学员互动数据。
S22A、向业务服务器获取与直播课ID对应的视频文件信息、老师互动数据和学员互动数据,视频文件信息是指在进行直播课时录制的包括直播课画面的视频文件以及与直播课时间轴对应的视频文件时间轴,老师互动数据是指在进行直播课时老师产生的与直播课时间轴对应的互动数据,学员互动数据是指在进行直播课时学员基于老师互动数据产生的与直播课时间轴对应的互动数据。
学员在直播课显示界面中选择其中一个直播课进行回看时,点击该选定直播课对应的回看按钮,产生携带直播课ID的直播课回看指令,以获取直播课详情信息。由于直播课详情信息存储在业务服务器,因此,将直播课回看指令发送至业务服务器,由业务服务器向数据库获取与直播课ID对应的直播课详情信息,直播课详情信息包括视频文件信息、老师互动数据和学员互动数据。
在一些实施例中,学员端显示设备的控制器在执行向业务服务器获取直播课ID对应的视频文件信息、老师互动数据和学员互动数据,被进一步配置为执行下述步骤:
步骤221、响应于直播课回看指令,发送携带直播课ID的直播课详情请求至业务服务器,直播课详情请求用于指示业务服务器向数据库获取与直播课ID对应的直播课详情信息,直播课详情信息包括老师ID和视频文件信息。
步骤222、接收业务服务器返回的与直播课ID对应的直播课详情信息。
步骤223、发送携带老师ID的互动数据请求至业务服务器,携带老师ID的互动数据请求用于指示业务服务器向数据库获取与老师ID对应的老师互动数据。
步骤224、接收业务服务器返回的与老师ID对应的老师互动数据。
步骤225、发送携带学员ID的互动数据请求至业务服务器,携带学员ID的互动数据请求用于指示业务服务器向数据库获取与学员ID对应的学员互动数据。
步骤226、接收业务服务器返回的与学员ID对应的学员互动数据。
为保证在学员回看直播课时,能够在播放视频文件的同时显示老师在直播课直播上课时所产生的互动数据,为学员还原直播上课时的场景,学员端显示设备需依次向业务服务器获取该直播课对应的视频文件信息、老师互动数据和学员互动数据。
学员触发某个直播课的回看按钮,产生携带直播课ID的直播课回看指令,学员端显示设备基于直播课回看指令生成携带直播课ID的直播课详情请求,并发送至业务服务器。业务服务器基于直播课详情请求中的直播课ID,在其数据库调取与直播课ID对应的直播课详情信息,包括老师ID和视频文件信息。
学员端显示设备在接收到直播课详情信息后,发送携带老师ID的互动数据请求至业务服务器,以请求直播课ID对应的直播课在直播上课时老师所产生的互动数据,以在播放视频文件时实时显示出来。
学员登录学员端显示设备中配置的直播课应用程序,将产生学员ID。而学员在直播课进行在线直播上课时,其产生的学员互动数据均存储在业务服务器。因此,在学员进行回看时,可发送携带学员ID的互动数据请求至业务服务器,业务服务器接收到互动数据请求,在其数据库中查找与学员ID对应的学员互动数据,并返回至学员端显示设备。
由于在同一节直播课中,同一个老师会产生多个老师互动数据,因此,业务服务器可按照开始时间的时间顺序将多个老师互动数据以列表形式存储,并以列表形式返回至学员端显示设备。同样的,由于学员在一堂直播课中,可能会产生多个学员互动数据,因此,业务服务器可将该学员的针对直播课ID对应的直播课相关的所有学员互动数据均返回至学员端显示设备,数个学员互动数据可按照产生时间点的时间先后顺序排列,以互动数据列表的形式返回。而后,学员端显示设备将每个学员互动数据依次显示在直播课回看画面中。
S23A、响应于触发播放按钮产生的视频播放指令,将视频文件展示在视频播放窗口进行播放。
学员端显示设备在接收到业务服务器返回的视频文件信息后,即可基于视频文件信息播放视频文件,即将视频文件在视频播放窗口进行播放。
在一些实施例中,学员端显示设备的控制器在执行响应于触发播放按钮产生的视频播放指令,将视频文件展示在视频播放窗口进行播放,被进一步配置为执行下述步骤:
步骤231、响应于触发播放按钮产生的视频播放指令,获取视频文件信息对应的视频文件回看地址和视频文件时间轴。
步骤232、基于视频文件回看地址和视频文件时间轴,在视频播放窗口播放对应的视频文件。
直播课回看界面中显示有播放按钮,播放按钮可显示在视频播放窗口的下方,也可显示在视频播放窗口上方的浮层中。学员点击播放按钮,产生视频播放指令,控制器响应于视频播放指令,获取视频文件信息中的视频文件回看地址和视频文件时间轴。
视频文件回看地址为访问视频文件的URL地址,控制器基于URL地址即可访问视频文件,以将视频文件的播放画面呈现在视频播放窗口。在播放时,视频文件基于视频文件时间轴进行播放,视频文件时间轴显示在视频播放窗口的下方。
S24A、基于视频文件时间轴和学员数据展示按钮的开关状态,将老师互动数据和学员互动数据分别展示在视频播放窗口上方的浮层中。
基于视频文件回看地址和视频文件时间轴即可播放对应的视频文件,而在播放视频文件过程中,为便于提供给学员的个性化体验,可在视频播放窗口中同步显示老师互动数据或学员互动数据。学员互动数据的展示与否与学员数据展示按钮的开关状态有关,如果开启学员数据展示按钮,则在视频播放窗口展示学员数据,如果关闭学员数据展示按钮,则在视频播放窗口不展示学员数据。
视频文件以视频文件时间轴为依据进行播放,为便于能够及时在视频播放窗口展示老师互动数据和学员互动数据,则在播放视频文件的过程中,实时检测视频文件时间轴上是否存在老师互动标识和学员互动标识。基于视频文件时间轴上存在的老师互动标识和学员互动标识,调取对应的老师互动数据和学员互动数据进行展示。
图48本申请一些实施例中展示互动数据的方法流程图。参见图48,在一些实施例中,学员端显示设备的控制器在执行基于视频文件时间轴和学员数据展示按钮的开关状态,将老师互动数据和学员互动数据分别展示在视频播放窗口上方的浮层中,被进一步配置为执行下述步骤:
S241、在视频播放窗口播放视频文件的过程中,检测视频文件时间轴上是否存在 老师互动标识和学员互动标识,老师互动标识用于表征存在老师互动数据,学员互动标识用于表征存在学员互动数据。
S242、在视频文件时间轴的当前播放时刻存在老师互动标识时,将老师互动标识对应的老师互动数据展示在视频播放窗口上方的浮层中。
S243、在视频文件时间轴的当前播放时刻存在学员互动标识时,根据学员数据展示按钮的开关状态,确定视频播放窗口上方的浮层中是否展示学员互动数据。
在直播课上课过程中,如果老师在某个时刻产生互动数据,则在直播课时间轴上对应添加老师互动标识,以及,如果学员在某个时刻产生互动数据,则在直播课时间轴上对应添加学员互动标识。而直播课时间轴与录制得到的视频文件时间轴相同,因此,可在视频文件播放过程中,实时检测视频文件时间轴上是否存在老师互动标识和学员互动标识。
在一些实施例中,若在视频文件时间轴上的某个时刻存在老师互动标识,说明当前需要展示老师在直播课上课时产生的老师互动数据。老师互动数据同步展示在视频播放窗口,且老师互动数据位于视频播放窗口上方的浮层中,即老师互动数据叠加显示在视频文件所处画面的上层中。
具体地,在展示老师互动数据时,学员端显示设备的控制器在执行在视频文件时间轴的当前播放时刻存在老师互动标识时,将老师互动标识对应的老师互动数据展示在视频播放窗口上方的浮层中,被进一步配置为执行下述步骤:
步骤2421、在视频文件时间轴的当前播放时刻存在老师互动标识时,获取老师互动数据中的老师在进行直播课时执行每个互动动作产生的开始时间、持续时长和老师互动信息。
步骤2422、基于老师互动信息生成老师互动数据展示窗口,按照开始时间和持续时长,将老师互动数据展示窗口展示在视频播放窗口上方的浮层中,老师互动信息悬浮在视频文件的上层,开始时间与存在老师互动标识的当前播放时刻相同。
在视频文件时间轴的当前播放时刻存在老师互动标识时,即说明当前播放时刻到达老师互动数据对应的某个互动动作的开始时间,则获取老师互动数据中的老师在进行直播课时执行每个互动动作产生的开始时间、持续时长和老师互动信息。
为展示老师互动数据,根据老师互动信息生成老师互动数据展示窗口,老师互动数据展示窗口以浮窗的形式进行展示。在一些实施例中,老师互动数据展示窗口可为半透明的渐变界面,以避免对视频播放窗口中当前播放的视频文件画面造成遮挡。
按照开始时间和持续时长,将老师互动数据展示窗口展示在视频播放窗口上方的浮层中,老师互动数据展示窗口的开始展示时间与直播课录制时互动动作产生的开始时间相同,即与存在老师互动标识的当前播放时刻相同。老师互动数据展示窗口的展示时长与在直播课录制时显示老师互动信息的持续时长相同。
图49本申请一些实施例中学员端展示互动数据的显示示意图。参见图49,在学员端展示老师互动数据时,学员利用学员端显示设备回看直播课,如果视频文件时间轴的当前播放时刻存在老师互动标识,则获取该直播课对应的老师互动信息,老师互动信息包括互动序号(8)、互动内容(题目及选择题)和互动选项(ABCD),根据老师互动信息生成老师互动数据展示窗口,并展示在视频播放窗口的浮层上方,相对物理位置在视频播放窗口的下方。老师互动数据展示窗口的展示时长与在直播课上课时 老师互动信息在学员端显示的持续时长相同。
如果视频文件时间轴的当前播放时刻到达0:23:28时检测到老师互动标识1,则该时刻对应老师互动数据中互动动作1的开始时间为0:23:28,因此,在当前时刻到达0:23:28时播放互动动作1对应的老师互动信息,基于该老师互动信息生成老师互动数据展示窗口,且该老师互动数据展示窗口的显示时长为持续时长,为5秒。如果视频文件时间轴的当前播放时刻到达0:35:50时检测到老师互动标识2,则该时刻对应老师互动数据中互动动作2的开始时间为0:35:50,因此,在当前时刻到达0:35:50时播放互动动作2对应的老师互动信息,基于该老师互动信息生成老师互动数据展示窗口,且该老师互动数据展示窗口的显示时长为持续时长,为6秒。
老师互动数据包括数个老师互动信息,一个老师互动信息对应一个开始时间,并对应一个老师互动标识,依据开始时间的先后顺序以及与视频文件时间轴的对应关系,依次根据检测到的每个老师互动标识将对应的每个老师互动信息显示在视频播放窗口上方的浮层中。
在一些实施例中,老师互动信息包括互动序号、互动内容、互动选项和互动正确结果,而互动正确结果并不会始终根据老师互动标识进行展示,而是根据学员互动数据的展示与否进行展示。例如,如果学员互动数据进行展示,则老师互动数据中展示互动正确结果,互动选项不可触发;如果学员互动数据不进行展示,则老师互动数据中不展示互动正确结果,互动选项可触发,以供学员进行实时互动。
在一些实施例中,若在视频文件时间轴上的某个时刻存在学员互动标识,说明当前需要展示学员在直播课上课时产生的学员互动数据。此时,需同时检测学员数据展示按钮的开关状态,以确定学员是否需要同步显示学员互动数据。若学员数据展示按钮为开启状态(如图49所示状态),则将学员互动数据同步展示在视频播放窗口,且学员互动数据位于视频播放窗口上方的浮层中,即学员互动数据叠加显示在视频文件所处画面的上层中。为便于清晰显示,学员互动数据显示在老师互动数据的上方浮层中。
具体地,学员端显示设备中的控制器在执行在视频文件时间轴的当前播放时刻存在学员互动标识时,根据学员数据展示按钮的开关状态,确定视频播放窗口上方的浮层中是否展示学员互动数据,被进一步配置为执行下述步骤:
步骤2431、在视频文件时间轴的当前播放时刻存在学员互动标识时,判断学员数据展示按钮的开关状态。
步骤2432、如果学员数据展示按钮处于开启状态,则将学员互动数据展示在视频播放窗口上方的浮层中。
步骤2433、如果学员数据展示按钮处于关闭状态,则在视频播放窗口上方的浮层中不展示学员互动数据。
为提供学员在回看直播课时的互动性,可在直播课界面中同步生成学员数据展示按钮,以控制是否需要同步展示学员互动数据。
在视频文件时间轴的当前播放时刻存在学员互动标识时,说明此时存在学员互动数据可被展示。为确定学员互动数据的展示与否,此时,检测学员数据展示按钮的开关状态。如果学员数据展示按钮处于开启状态,如图49所示状态,说明学员无需进行实时互动,则将学员互动数据展示在视频播放窗口上方的浮层中。如果学员数据展示 按钮处于关闭状态,如图50所示状态,说明学员需要进行实时互动,则在视频播放窗口上方的浮层中不展示学员互动数据。
由于在直播课回看时,老师互动数据始终基于老师互动标识在视频播放窗口上方的浮层中进行展示,因此,在学员数据展示按钮处于开启状态时,视频播放窗口上方的浮层中同步显示老师互动数据和学员互动数据。在学员数据展示按钮处于关闭状态时,视频播放窗口上方的浮层中仅显示老师互动数据。
在回看视频文件时,需保证及时在直播课回看界面的视频播放窗口中显示学员互动数据,即保证在视频播放窗口中显示老师互动数据之后,在规定时间内及时显示对应的学员互动数据,使得回看过程中老师互动数据与学员互动数据的显示时间间隔与在先直播上课时老师互动数据与学员互动数据的显示时间间隔相同,进而达到还原直播上课时的场景。其中,规定时间可为老师产生互动动作的持续时长。
为在直播课回看时,准确展示学员互动数据,可基于学员在直播课录制每次产生互动的时间点进行展示,在一些实施例中,学员端显示设备的控制器在执行将学员互动数据展示在视频播放窗口上方的浮层中,被进一步配置为执行下述步骤:
步骤24321、获取学员互动数据对应的每次互动产生时的产生时间点和学员互动信息。
步骤24322、基于学员互动信息生成学员互动数据展示窗口,按照产生时间点将学员互动数据展示窗口展示在视频播放窗口上方的浮层中,学员互动数据展示窗口位于老师互动数据展示窗口的上层,产生时间点与存在学员互动标识的当前播放时刻相同。
在视频文件时间轴的当前播放时刻存在学员互动标识,且学员数据展示按钮处于开启状态时,获取学员互动数据对应的每次互动产生时的产生时间点和学员互动信息,即学员在直播课录制时每次基于老师互动数据产生相应互动操作时的产生时间点和学员互动信息。例如,学员基于老师互动数据产生的互动即为学员进行答题的操作动作,学员互动信息为学员点击任一个互动选项对应的内容。
为及时显示学员互动数据,获取学员基于老师互动数据产生互动时的产生时间点,在视频文件时间轴的当前播放时刻达到某个产生时间点,即存在学员互动标识时,基于学员互动信息生成学员互动数据展示窗口。在一些实施例中,再次参见图49,学员互动数据展示窗口可为半透明的渐变界面,且学员互动数据展示窗口位于老师互动数据展示窗口的上层,以避免对视频播放窗口中当前播放的视频文件画面和老师互动数据展示窗口中呈现的老师互动数据造成遮挡。
学员互动数据展示窗口按照产生时间点将学员互动数据展示窗口展示在视频播放窗口上方的浮层中,学员互动数据展示窗口的展示时间点与学员在直播课录制时产生互动的产生时间点相同,即产生时间点与存在学员互动标识的当前播放时刻相同。
参见图49,例如,在学员数据展示按钮为开启状态,需要同步展示学员互动数据的情况下,如果直播课在直播上课时,学员基于老师互动数据(开始时间为25分28秒,持续时长为5秒,互动正确结果为A)在25分30秒时产生一个学员互动数据,学员互动数据包括:选择互动选项A,以及,互动结果为选择正确。那么在播放视频文件进行回看时,则视频文件时间轴的当前播放时刻到达25分30秒时,检测到存在学员互动标识,此时,基于对应的学员互动数据生成学员互动数据展示窗口,并展示 在视频播放窗口上方的浮层中,且学员互动数据展示窗口叠加显示在老师互动数据展示窗口的上层,即在展示有“互动序号(8)、互动内容(选择题和题目)、互动选项(ABCD)和互动正确结果(正确答案A)”的老师互动数据展示窗口上方的浮层中展示学员互动数据展示窗口,学员互动数据展示窗口中呈现互动选项A,互动结果为选择正确(√)。
可见,在学员端显示设备回看直播课的视频文件时,若检测到视频文件时间轴上存在老师互动标识,则展示对应的老师互动数据。若检测到视频文件时间轴上存在学员互动标识,则先检测学员端直播课界面中的学员数据展示按钮的开关状态,如果为开启状态,则在互动标识对应的时间展示老师互动数据(包括互动正确结果)和学员互动数据;如果为关闭状态,则只展示老师互动数据(不包括互动正确结果),而不展示学员互动数据,此时学员可进行实时互动。
在一些实施例中,学员可在直播课回看过程中,随时调整是否需要展示学员互动数据,在不展示学员互动数据时以进行实时互动。因此,学员可在直播课回看时,随时控制学员数据展示按钮的开关状态。
在一些实施例中,如果学员数据展示按钮原处于关闭状态,则可重新开启学员数据展示按钮,以将学员互动数据进行展示。具体地,控制器在执行根据学员数据展示按钮的开关状态,确定视频播放窗口上方的浮层中是否展示学员互动数据,被进一步配置为:在播放视频文件的过程中,响应于触发学员数据展示按钮产生的数据展示开启指令,将学员互动数据展示在视频播放窗口上方的浮层中。
在直播课回看过程中,如果学员数据展示按钮原处于关闭状态,此时视频播放窗口中未展示学员互动数据。若学员想同步看到自己在直播课录制过程中的互动情况,可点击学员数据展示按钮,将其开启,此时,产生数据展示开启指令。
控制器响应该数据展示开启指令,则在视频文件时间轴上检测到学员互动标识时,在对应时间展示学员互动数据,即在视频播放窗口上方的浮层中展示学员互动数据。老师互动数据始终根据视频文件时间轴上检测到的老师互动标识所在时间进行展示,其展示与否不受学员数据展示按钮的开关状态影响。学员互动数据的展示过程可参照前述实施例步骤24321至步骤24322的内容,老师互动数据的展示过程可参照前述实施例步骤2421至步骤2422的内容,此处不再赘述。
在一些实施例中,若学员数据展示按钮原处于开启状态,则可关闭学员数据展示按钮,以取消学员互动数据的展示。具体地,控制器在执行根据学员数据展示按钮的开关状态,确定视频播放窗口上方的浮层中是否展示学员互动数据,被进一步配置为:在播放视频文件的过程中,响应于触发学员数据展示按钮产生的数据展示关闭指令,老师互动数据按照视频文件时间轴上的老师互动标识对应的当前播放时刻进行展示,以及,取消学员互动数据的展示。
在直播课回看过程中,若学员数据展示按钮原处于开启状态,此时视频播放窗口中已展示有学员互动数据。若学员不想看到自己在直播课录制过程中的互动情况,可点击学员数据展示按钮,将其关闭,此时,产生数据展示关闭指令。
控制器响应该数据展示关闭指令,此时,即使在视频文件时间轴上检测到学员互动标识,也不展示学员互动数据,而老师互动数据则继续按照视频文件时间轴上的老师互动标识对应的当前播放时刻进行展示,即展示在视频播放窗口上方的浮层中。老师互动数据的展示过程可参照前述实施例步骤2421至步骤2422的内容,此处不再赘 述。
在一些实施例中,在学员数据展示按钮为关闭状态时,视频播放窗口中不再展示学员互动数据,此时,学员可在直播课回看过程中进行实时互动。学员为进行实时互动,需基于直播课录制过程中产生的老师互动数据进行互动。
因此,在直播课回看过程中,学员端显示设备的控制器被进一步配置为:
步骤251、在学员数据展示按钮处于关闭状态,以及,在视频文件时间轴的当前播放时刻存在老师互动标识时,基于老师互动数据生成互动界面,互动界面用于提供学员在回看直播课时进行互动,老师互动数据包括每个互动动作产生的开始时间、持续时长和老师互动信息。
步骤252、按照开始时间和持续时长,将互动界面展示在视频播放窗口上方的浮层中,互动界面悬浮在视频文件对应画面的上层,互动界面中呈现老师互动信息,开始时间与存在老师互动标识的当前播放时刻相同。
在直播课回看时或在直播课回看过程中,若检测到学员数据展示按钮处于关闭状态,则说明学员需要进行实时互动。此时,在视频文件时间轴上检测到老师互动标识,则获取对应的老师互动数据,并基于老师互动数据生成互动界面,为便于产生学员互动数据,互动界面中还展示有提交按钮。互动界面可供学员进行点击操作,以进行实时互动。
图50本申请一些实施例中回看时生成互动界面的显示示意图。参见图50,学员数据展示按钮呈关闭状态,老师互动数据包括每个互动动作产生的开始时间、持续时长和老师互动信息,互动界面中展示有老师互动信息和提交按钮,例如,互动界面展示互动序号(18)、互动内容(题目和多选题)、互动选项(ABCD)和提交按钮,且互动选项处于可点击状态,互动正确结果不进行展示。
由于直播课录制的时间轴与视频文件时间轴相同,因此,互动界面的开始展示时间和展示时长与直播课录制时老师互动信息的开始时间和持续时长相同,即互动界面展示在视频播放窗口上方的浮层中时,互动界面的展示时刻为互动动作的开始时间,也为检测到老师互动标识对应的当前播放时刻,展示时长为持续时长,学员可在展示时长内进行实时互动。
例如,在直播课录制时,老师互动数据中执行某个互动动作的开始时间为25分28秒,持续时长为5秒,则在直播课回看时,在视频文件时间轴上检测到老师互动标识也为25分28秒。因此,根据25分28秒对应的老师互动数据生成互动界面,互动界面的展示时间为25分28秒,展示时长为5秒,学员实时互动的时间为5秒内。
学员基于其学员端显示设备的直播课回看界面中的互动界面中呈现的互动信息可进行实时互动,例如,互动界面中显示互动序号为18的题目和互动选项,学员选择其中一个互动选项,即基于序号为18的题目进行作答,学员选择的互动选项即为该学员的实时互动数据。
可见,本申请实施例提供的学员端显示设备,在直播课回看时,获取与直播课ID对应的视频文件并进行播放,并可在直播课回看界面中的视频文件播放到与某个互动动作产生的开始时间相同时,在直播课回看界面中呈现基于该开始时间对应的老师互动数据生成互动界面,即在视频播放窗口上方浮层中展示互动界面,供学员进行实时互动,在还原直播上课场景的情况下,提高学员的个性化体验。
在一些实施例中,学员在基于互动界面进行实时互动时,还可在产生实时互动数据后,再次由业务服务器对该互动数据进行正确性判断。因此,在直播课回看过程中,学员端显示设备中的控制器被进一步配置为执行下述步骤:
步骤261、在未展示学员互动数据时,接收学员基于互动界面中呈现的互动内容和互动选项触发提交按钮时产生的当前互动指令,老师互动信息包括互动内容和互动选项,互动界面中展示有提交按钮。
步骤262、响应于当前互动指令,产生当前学员互动数据。
步骤263、将当前学员互动数据发送至业务服务器,业务服务器用于根据当前学员互动数据产生当前互动结果;
步骤264、接收业务服务器返回的当前互动结果,展示在互动界面中。
在直播课回看过程中,如果学员想要重新经历一遍答题过程,可将学员互动数据展示按钮关闭,取消视频播放窗口中展示的学员互动数据,此时,直播课回看画面中只展示老师互动数据。并基于老师互动数据在直播课回看画面中生成互动界面,使得学员可基于互动界面进行实时互动,即重新经历一次答题过程。
图51本申请一些实施例中回看时学员基于互动界面进行实时互动的显示示意图。参见图50和22,在进行实时互动时,互动界面中显示有当前时刻对应的老师互动信息和提交按钮,老师互动信息包括互动序号(18)、互动内容(题目和多选题)和互动选项(ABCD),且互动选项为可触发状态。学员可基于互动内容点击任一个互动选项作为当前互动操作,在完成选择后点击提交按钮,产生当前互动指令。例如,学员点击互动选项AB,后点击提交按钮,生成当前互动指令。
控制器响应于该当前互动指令,产生当前学员互动数据,当前学员互动数据包括学员选择的互动选项AB。控制器将当前学员互动数据发送至业务服务器,业务服务器去数据库中调取对应题目(序号18的题目)的正确答案(互动正确结果),并根据学员作出的当前学员互动数据和正确答案进行正确性判断,得到当前互动结果。业务服务器将当前互动结果返回至学员端显示设备,并展示在互动界面中。
例如,参见图51,学员端显示设备的控制器将携带互动选项AB的当前互动指令发送至业务服务器,业务服务器调取题号为18的互动正确答案(AB)。判断学员的当前互动数据(互动选项AB)与互动正确答案(AB)的正确性,如果一致,则返回当前互动结果(正确√)。在一些实施例中,如果学员的当前互动数据与互动正确答案的不一致,则返回当前互动结果(错误X)
业务服务器将当前互动结果(正确√)返回至学员端显示设备,并显示在互动界面,同时,将互动正确答案(AB)也显示在互动界面中,实现实时互动的互动结果的判断。
在完成一次答题后,提交按钮转换显示为退出答题按钮。学员点击互动界面中显示的退出答题按钮,可自行退出答题界面,提前结束当前题目的答题,此时,将取消互动界面的显示。否则互动界面会一直显示在视频播放窗口,互动界面的显示时长与该题目对应的持续时长相同。
因此,在进行直播课回看时,学员端显示设备可进行实时互动,并再次执行互动结果判断过程,进一步还原上课时的场景,使得学员可以重新经历一遍在线直播上课过程,提高用户体验。
可见,在学员端显示设备进行回看视频文件时,可提供给学员两种互动模式,一 种是基于视频文件时间轴上检测到的老师互动标识和学员互动标识,以及,处于开启状态的学员数据展示按钮,依次显示老师互动数据和学员互动数据,另一种是基于视频文件时间轴和处于关闭状态的学员数据展示按钮,只显示老师互动数据,此时,可提供互动界面,用于供学员进行实时互动。两种互动模式均可以在回看时给学员展示除直播课画面以外的其他互动内容,丰富回看视频文件的显示内容,提高用户体验。
可见,本申请实施例提供的一种显示设备,应用在学员端显示设备,可在直播课回看时,响应于学员触发回看按钮产生的直播课回看指令,生成包括视频播放窗口、播放按钮和学员数据展示按钮的直播课回看界面,向业务服务器获取与直播课ID对应的视频文件信息、老师互动数据和学员互动数据,响应于触发播放按钮产生的视频播放指令,将视频文件展示在视频播放窗口进行播放;基于视频文件时间轴和学员数据展示按钮的开关状态,将老师互动数据和学员互动数据分别展示在视频播放窗口上方的浮层中。可见,本申请实施例提供的显示设备,可在学员回看视频文件的同时,同步显示老师互动数据和/或学员互动数据,让学员重新经历一遍现场直播上课,并可在回看过程中参与到直播课中,进行实时互动,提高用户体验。
图52本申请一些实施例中直播课回看方法的另一流程图。参见图52,本申请实施例提供一种服务器,应用于业务服务器,包括:数据库,被配置为存储显示设备在进行直播课录制时产生的学员互动数据、老师互动数据和视频文件信息;与数据库连接的控制器,在执行直播课回看方法时,所述控制器被配置为执行下述步骤:
S3A1、获取显示设备发送的携带直播课ID的直播课信息请求,直播课信息请求是指显示设备在响应于触发回看按钮产生的直播课回看指令后生成的请求。
S32A、响应于直播课信息请求,向数据库中查询与直播课ID对应的直播课详情信息,直播课详情信息包括视频文件信息、老师互动数据和学员互动数据,视频文件信息是指在进行直播课时录制的包括直播课画面的视频文件以及与直播课时间轴对应的视频文件时间轴,老师互动数据是指在进行直播课时老师产生的与直播课时间轴对应的互动数据,学员互动数据是指在进行直播课时学员基于老师互动数据产生的与直播课时间轴对应的互动数据。
S33A、将直播课详情信息返回至显示设备,直播课详情信息用于供显示设备在进行直播课回看时进行展示。
在学员利用学员端显示设备进行直播课回看时,学员在学员端显示设备中呈现的直播课显示界面中选择其中一个直播课进行回看时,点击该选定直播课对应的回看按钮,产生携带直播课ID的直播课回看指令。控制器响应于直播课回看指令,产生直播课信息请求,发送至业务服务器,以获取直播课详情信息。由于直播课详情信息存储在业务服务器的数据库,因此,业务服务器响应直播课信息请求,由业务服务器向数据库获取与直播课ID对应的直播课详情信息,直播课详情信息包括视频文件信息、老师互动数据和学员互动数据。
业务服务器向数据库获取直播课详情信息,即获取视频文件信息、老师互动数据和学员互动数据的具体实现过程,可参照前述实施例提出的步骤221至步骤226所示内容,此处不再赘述。
业务服务器将获取到的与直播课ID对应的直播课详情信息后,返回至对应的学员端显示设备,便于在学员利用学员端显示设备进行直播课回看时,将直播课详情信息 进行展示。学员端显示设备展示直播课详情信息的相关步骤可参照前述实施例提出的步骤21至步骤24所示内容及相关实现内容,此处不再赘述。
可见,本申请实施例提供的一种服务器,应用在业务服务器,可在直播课回看时,根据学员端显示设备发生的携带直播课ID的直播课信息请求,向数据库获取与直播课ID对应的直播课详情信息,如视频文件信息、老师互动数据和学员互动数据,将直播课详情信息返回至显示设备,直播课详情信息用于供显示设备在进行直播课回看时进行展示。可见,本申请实施例提供的服务器,可在学员回看视频文件的同时,为学员端显示设备提供直播课详情信息,以便学员端显示设备同步显示老师互动数据和/或学员互动数据,让学员重新经历一遍现场直播上课,并可在回看过程中参与到直播课中,进行实时互动,提高用户体验。
图45本申请一些实施例中直播课回看方法的流程图。参见图45,本申请实施例提供一种直播课回看方法,应用于学员端显示设备,所述方法包括:
S21、响应于触发回看按钮产生的直播课回看指令,生成包括视频播放窗口、播放按钮和学员数据展示按钮的直播课回看界面,所述回看按钮显示在直播课显示界面中,所述回看按钮与直播课ID对应;
S22、向业务服务器获取与所述直播课ID对应的视频文件信息、老师互动数据和学员互动数据,所述视频文件信息是指在进行直播课时录制的包括直播课画面的视频文件以及与直播课时间轴对应的视频文件时间轴,所述老师互动数据是指在进行直播课时老师产生的与直播课时间轴对应的互动数据,所述学员互动数据是指在进行直播课时学员基于老师互动数据产生的与直播课时间轴对应的互动数据;
S23、响应于触发所述播放按钮产生的视频播放指令,将所述视频文件展示在所述视频播放窗口进行播放;
S24、基于所述视频文件时间轴和所述学员数据展示按钮的开关状态,将所述老师互动数据和学员互动数据分别展示在所述视频播放窗口上方的浮层中。
图52本申请一些实施例中直播课回看方法的另一流程图。参见图52,本申请实施例提供的一种直播课回看方法,应用于业务服务器,所述方法包括:
S31、获取显示设备发送的携带直播课ID的直播课信息请求,所述直播课信息请求是指显示设备在响应于触发回看按钮产生的直播课回看指令后生成的请求;
S32、响应于所述直播课信息请求,向数据库中查询与所述直播课ID对应的直播课详情信息,所述直播课详情信息包括视频文件信息、老师互动数据和学员互动数据,所述视频文件信息是指在进行直播课时录制的包括直播课画面的视频文件以及与直播课时间轴对应的视频文件时间轴,所述老师互动数据是指在进行直播课时老师产生的与直播课时间轴对应的互动数据,所述学员互动数据是指在进行直播课时学员基于老师互动数据产生的与直播课时间轴对应的互动数据;
S33、将所述直播课详情信息返回至显示设备,所述直播课详情信息用于供显示设备在进行直播课回看时进行展示。
在一些实施例中,本申请提供了一种教学直播方法,由老师端的显示设备中的控制器执行,所述方法包括:
S1、接收老师触发直播教学界面中的直播控件产生的直播课上课信号;
S2、响应于所述直播课上课信号,进入指定直播间进行上课,以及,发送所述直 播课上课信号至学生端设备,所述学生端设备用于响应于所述直播课上课信号进入指定直播间进行听课;
S3、在完成直播课上课后,接收老师触发所述直播教学界面中的作业控件产生的布置作业信号;
S4、响应于所述布置作业信号,进入布置作业界面,所述布置作业界面用于提供布置直播课对应作业的输入界面;
S5、接收老师触发所述布置作业界面中的布置作业按钮产生的作业布置确认信号,将所述作业布置确认信号发送至学生端设备,所述学生端设备用于响应于所述作业布置确认信号进入作业作答页面进行作答,所述作业作答页面与所述布置作业界面中呈现的作业相同。
为了方便解释,已经结合具体的实施方式进行了上述说明。但是,上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导,可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用,从而使得本领域技术人员更好的使用所述实施方式以及适于具体使用考虑的各种不同的变形的实施方式。

Claims (10)

  1. 一种显示设备,包括:
    显示器,被配置为呈现第一直播界面;
    与所述显示器连接的控制器,所述控制器被配置为:
    响应于用于启动第一程序的应用启动指令,发送手写输入功能查询指令至服务器,所述手写输入功能查询指令用于指示所述服务器查询本端是否配置手写输入功能;
    如果所述服务器返回的手写输入功能查询结果为本端具备手写输入功能,则在所述第一直播界面中展示手写输入功能控件;
    如果所述服务器返回的手写输入功能查询结果为本端不具备手写输入功能,则在所述第一直播界面中不展示手写输入功能控件。
  2. 根据权利要求1所述的显示设备,所述控制器在执行所述响应于用于启动第一程序的应用启动指令,发送手写输入功能查询指令至服务器,被进一步配置为:
    接收用于启动第一程序的应用启动指令;
    响应于所述应用启动指令,获取本端标识信息,所述本端标识信息用于标识本端显示设备的机型信息、硬件配置信息、版本信息中的至少一种;
    基于所述本端标识信息,生成手写输入功能查询指令,其中,所述手写输入功能查询指令中包含所述本端标识信息;
    将所述手写输入功能查询指令发送至服务器,所述手写输入功能查询指令用于指示所述服务器根据所述本端标识信息,查询与所述本端标识信息对应的显示设备的手写输入功能查询结果。
  3. 根据权利要求2所述的显示设备,所述控制器在执行所述获取本端标识信息,被进一步配置为:
    在启动第一程序时,获取本端显示设备的机型信息、版本信息和硬件配置信息;
    基于所述本端显示设备的机型信息、版本信息、硬件配置信息和随机生成的字符串,生成本端标识信息。
  4. 根据权利要求1所述的显示设备,所述控制器被进一步配置为:
    在接收到所述服务器返回的手写输入功能查询结果后,将所述手写输入功能查询结果发送至老师端显示设备,以由所述老师端显示设备展示用于表征具有手写输入功能的学生端显示设备控制权限的第一权限控制按钮和用于表征不具有手写输入功能的学生端显示设备控制权限的第二权限控制按钮,所述第一权限控制按钮呈可触发状态,所述第二权限控制按钮呈不可触发状态。
  5. 根据权利要求1所述的显示设备,所述控制器被进一步配置为:
    接收老师端显示设备发送的手写输入授权指令,所述手写输入授权指令是指老师端显示设备触发第一权限控制按钮时产生的指令;
    响应于所述手写输入授权指令,启动所述手写输入功能控件呈可触发状态;
    响应于触发所述呈可触发状态的手写输入功能控件,产生手写输入功能调起指令,所述手写输入功能调起指令用于调起手写输入功能,以在所述第一直播界面中进行手写输入操作。
  6. 一种显示设备,包括:
    显示器,被配置为呈现第二直播界面;
    与所述显示器连接的控制器,所述控制器被配置为:
    在第二程序启动后,接收学生端显示设备发送的手写输入功能查询结果,所述手写输入功能查询结果是指所述学生端显示设备请求服务器查询本端是否配置手写输入功能的结果;
    在所述手写输入功能查询结果为具有手写输入功能时,则在所述第二直播界面显示与每个具有手写输入功能的学生端显示设备对应的第一操作条目,所述第一操作条目中包括具有对应学生端显示设备的手写输入功能控制权限的第一权限控制按钮;
    在所述手写输入功能查询结果为不具有手写输入功能时,则在所述第二直播界面显示与每个不具有手写输入功能的学生端显示设备对应的第二操作条目,所述第二操作条目中包括不具有对应学生端显示设备的手写输入功能控制权限的第二权限控制按钮。
  7. 根据权利要求6所述的显示设备,所述控制器被进一步配置为:
    接收每个所述学生端显示设备发送的手写输入功能查询结果;
    基于每个所述手写输入功能查询结果,在所述第二直播界面中显示学生列表,所述学生列表中展示第一操作条目和第二操作条目,所述第一操作条目中展示具有手写输入功能的学生端显示设备对应的学生名称和第一权限控制按钮,所述第二操作条目中展示不具有手写输入功能的学生端显示设备对应的学生名称和第二权限控制按钮,所述第一权限控制按钮呈可触发状态,所述第二权限控制按钮呈不可触发状态。
  8. 根据权利要求6所述的显示设备,所述控制器被进一步配置为:
    在授权学生进行手写输入操作时,接收触发与所述学生对应的第一权限控制按钮时生成的手写输入授权指令;
    将所述手写输入授权指令发送至执行触发操作的第一权限控制按钮对应的学生端显示设备,所述手写输入授权指令用于启动所述学生端显示设备在第一直播界面中展示的手写输入功能控件的触发状态,学生点击处于可触发状态的手写输入功能控件,启动手写输入功能,以在所述第一直播界面中进行手写输入操作。
  9. 一种教学直播方法,应用于学生端显示设备,所述方法包括:
    响应于用于启动第一程序的应用启动指令,发送手写输入功能查询指令至服务器,所述手写输入功能查询指令用于指示所述服务器查询本端是否配置手写输入功能;
    如果所述服务器返回的手写输入功能查询结果为本端具备手写输入功能,则在所述第一直播界面中展示手写输入功能控件;
    如果所述服务器返回的手写输入功能查询结果为本端不具备手写输入功能,则在所述第一直播界面中不展示手写输入功能控件。
  10. 一种教学直播方法,应用于老师端显示设备,所述方法包括:
    在第二程序启动后,接收学生端显示设备发送的手写输入功能查询结果,所述手写输入功能查询结果是指所述学生端显示设备请求服务器查询本端是否配置手写输入功能的结果;
    在所述手写输入功能查询结果为具有手写输入功能时,则在所述第二直播界面显示与每个具有手写输入功能的学生端显示设备对应的第一操作条目,所述第一操作条目中包括具有对应学生端显示设备的手写输入功能控制权限的第一权限控制按钮;
    在所述手写输入功能查询结果为不具有手写输入功能时,则在所述第二直播界面显示与每个不具有手写输入功能的学生端显示设备对应的第二操作条目,所述第二操作条目中包括不具有对应学生端显示设备的手写输入功能控制权限的第二权限控制按钮。
PCT/CN2021/120219 2020-10-15 2021-09-24 一种教学直播方法及显示设备 WO2022078184A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202180068411.2A CN116349230A (zh) 2020-10-15 2021-09-24 一种教学直播方法及显示设备

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
CN202011103569.2 2020-10-15
CN202011103569 2020-10-15
CN202011437934.3 2020-12-07
CN202011437934.3A CN112653897B (zh) 2020-12-07 2020-12-07 一种显示设备、服务器及在线直播课程的控制方法
CN202110003691.0A CN112788361B (zh) 2020-10-15 2021-01-04 一种直播课回看方法、显示设备及服务器
CN202110003691.0 2021-01-04
CN202110014131.5 2021-01-06
CN202110014131.5A CN112866734B (zh) 2020-10-15 2021-01-06 一种自动展示手写输入功能的控制方法及显示设备
CN202110067566.6A CN114390359B (zh) 2020-10-15 2021-01-19 一种消息的展示方法及显示设备
CN202110067566.6 2021-01-19

Publications (1)

Publication Number Publication Date
WO2022078184A1 true WO2022078184A1 (zh) 2022-04-21

Family

ID=81207729

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/120219 WO2022078184A1 (zh) 2020-10-15 2021-09-24 一种教学直播方法及显示设备

Country Status (2)

Country Link
CN (1) CN116349230A (zh)
WO (1) WO2022078184A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114615223A (zh) * 2022-05-11 2022-06-10 深圳市永兴元科技股份有限公司 考试无人监控即时通讯方法、设备、系统及存储介质
CN115002493A (zh) * 2022-04-28 2022-09-02 五八有限公司 直播培训的交互方法、装置、电子设备及存储介质
CN115100004A (zh) * 2022-06-23 2022-09-23 北京新唐思创教育科技有限公司 在线授课系统、方法、装置、设备及介质
CN115167726A (zh) * 2022-07-08 2022-10-11 上海百家云科技有限公司 一种基于直播学习平台的辅导方式确定方法和确定装置
CN116668771A (zh) * 2023-07-31 2023-08-29 全时云商务服务股份有限公司 一种课堂监督辅导方法、装置、存储介质和电子设备
CN118227068A (zh) * 2024-05-08 2024-06-21 广州大学 智慧教育管理方法及系统

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140063179A1 (en) * 2012-09-05 2014-03-06 Konica Minolta, Inc. Conference supporting system, control apparatus and input terminal
CN109413438A (zh) * 2018-09-26 2019-03-01 平安科技(深圳)有限公司 手写笔辅助直播方法、装置、计算机设备和存储介质
CN109982102A (zh) * 2019-04-10 2019-07-05 广州华多网络科技有限公司 直播间的界面显示方法和系统、以及直播服务器和主播端
CN110168490A (zh) * 2017-01-02 2019-08-23 三星电子株式会社 显示装置及其控制方法
CN110381332A (zh) * 2019-08-01 2019-10-25 广州虎牙科技有限公司 直播间组件处理方法、装置、电子设备及可读存储介质
CN110971925A (zh) * 2019-11-22 2020-04-07 广州三人行壹佰教育科技有限公司 直播界面的显示方法、装置及系统
CN111131851A (zh) * 2019-12-31 2020-05-08 网易(杭州)网络有限公司 游戏直播控制方法及装置、计算机存储介质、电子设备
CN111447456A (zh) * 2019-08-21 2020-07-24 广州视源电子科技股份有限公司 一种课件的操作方法、计算机设备和存储介质
CN112866734A (zh) * 2020-10-15 2021-05-28 聚好看科技股份有限公司 一种自动展示手写输入功能的控制方法及显示设备

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140063179A1 (en) * 2012-09-05 2014-03-06 Konica Minolta, Inc. Conference supporting system, control apparatus and input terminal
CN110168490A (zh) * 2017-01-02 2019-08-23 三星电子株式会社 显示装置及其控制方法
CN109413438A (zh) * 2018-09-26 2019-03-01 平安科技(深圳)有限公司 手写笔辅助直播方法、装置、计算机设备和存储介质
CN109982102A (zh) * 2019-04-10 2019-07-05 广州华多网络科技有限公司 直播间的界面显示方法和系统、以及直播服务器和主播端
CN110381332A (zh) * 2019-08-01 2019-10-25 广州虎牙科技有限公司 直播间组件处理方法、装置、电子设备及可读存储介质
CN111447456A (zh) * 2019-08-21 2020-07-24 广州视源电子科技股份有限公司 一种课件的操作方法、计算机设备和存储介质
CN110971925A (zh) * 2019-11-22 2020-04-07 广州三人行壹佰教育科技有限公司 直播界面的显示方法、装置及系统
CN111131851A (zh) * 2019-12-31 2020-05-08 网易(杭州)网络有限公司 游戏直播控制方法及装置、计算机存储介质、电子设备
CN112866734A (zh) * 2020-10-15 2021-05-28 聚好看科技股份有限公司 一种自动展示手写输入功能的控制方法及显示设备

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115002493A (zh) * 2022-04-28 2022-09-02 五八有限公司 直播培训的交互方法、装置、电子设备及存储介质
CN114615223A (zh) * 2022-05-11 2022-06-10 深圳市永兴元科技股份有限公司 考试无人监控即时通讯方法、设备、系统及存储介质
CN115100004A (zh) * 2022-06-23 2022-09-23 北京新唐思创教育科技有限公司 在线授课系统、方法、装置、设备及介质
CN115167726A (zh) * 2022-07-08 2022-10-11 上海百家云科技有限公司 一种基于直播学习平台的辅导方式确定方法和确定装置
CN116668771A (zh) * 2023-07-31 2023-08-29 全时云商务服务股份有限公司 一种课堂监督辅导方法、装置、存储介质和电子设备
CN118227068A (zh) * 2024-05-08 2024-06-21 广州大学 智慧教育管理方法及系统

Also Published As

Publication number Publication date
CN116349230A (zh) 2023-06-27

Similar Documents

Publication Publication Date Title
WO2022078184A1 (zh) 一种教学直播方法及显示设备
US10805365B2 (en) System and method for tracking events and providing feedback in a virtual conference
CN112788361B (zh) 一种直播课回看方法、显示设备及服务器
US10541824B2 (en) System and method for scalable, interactive virtual conferencing
US11217109B2 (en) Apparatus, user interface, and method for authoring and managing lesson plans and course design for virtual conference learning environments
US7733366B2 (en) Computer network-based, interactive, multimedia learning system and process
US20060057550A1 (en) Remote education system, course attendance check method, and course attendance check program
CN109388321B (zh) 电子白板的操作方法及装置
KR20060035729A (ko) 가상교실에서의 수업내용을 제공 및 기록하는 방법 및시스템
CN111738889A (zh) 一种支持多终端的omo智能互动性云教室系统
WO2016019694A1 (zh) 信息互动的方法及终端
CA2463437A1 (en) A dynamically configurable collaboration system and method
JPWO2005062218A1 (ja) 反応情報表示システム
KR102036639B1 (ko) 동영상 강의를 재생하는 이동 단말 및 연관 동영상 표시 방법
JP2020187603A (ja) 学習管理システム
JP6565051B1 (ja) 学習管理システム
CN116055666A (zh) 显示设备及会议纪要的生成方法
CN115762264A (zh) 一种教学互动方法、系统、计算机设备及存储介质
CN116800449A (zh) 显示设备及账号切换联动方法
JP2010186195A (ja) 反応情報表示システム
WO2009048424A1 (en) Generic remote access of software application
WO2010061985A1 (en) System, server and method for providing education program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21879230

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 10-08-2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21879230

Country of ref document: EP

Kind code of ref document: A1