WO2023246575A1 - 多媒体控制方法、终端、服务器、存储介质 - Google Patents

多媒体控制方法、终端、服务器、存储介质 Download PDF

Info

Publication number
WO2023246575A1
WO2023246575A1 PCT/CN2023/100111 CN2023100111W WO2023246575A1 WO 2023246575 A1 WO2023246575 A1 WO 2023246575A1 CN 2023100111 W CN2023100111 W CN 2023100111W WO 2023246575 A1 WO2023246575 A1 WO 2023246575A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
multimedia
control
channel
server
Prior art date
Application number
PCT/CN2023/100111
Other languages
English (en)
French (fr)
Inventor
彭磊
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2023246575A1 publication Critical patent/WO2023246575A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/155—Conference systems involving storage of or access to video conference sessions

Definitions

  • the present disclosure relates to the field of multimedia technology, and in particular to a multimedia control method, terminal, server and computer-readable storage medium.
  • Video conferencing is a real-time, point-to-point or point-to-multipoint online conference held through the Internet. Video conferencing users can conveniently conduct online meetings, training, teaching, etc. Based on video conferencing technology, a teaching system that supports online interactive teaching has been further developed.
  • the present disclosure provides a multimedia control method, applied to a terminal, including: generating a multimedia data stream in response to the running of an application program integrated in a multimedia system; transmitting the multimedia data stream to the multimedia channel through a multimedia channel of the current terminal. server, so that the server distributes the multimedia data stream.
  • the present disclosure provides a multimedia control method, applied to a server, including: receiving a multimedia data stream transmitted by a terminal through a multimedia channel, wherein the terminal generates the data stream in response to an application program integrated in the multimedia system of the terminal.
  • the multimedia data stream is distributed to at least one target terminal.
  • the present disclosure provides a terminal, including: one or more processors; a memory having one or more computer programs stored thereon, the one or more computers The program is executed by the one or more processors, so that the one or more processors implement the multimedia control method described in the first aspect of the present disclosure.
  • the present disclosure provides a server, including: one or more processors; a memory having one or more computer programs stored thereon, and the one or more computer programs are processed by the one or more processors. Execution causes the one or more processors to implement the multimedia control method described in the second aspect of the present disclosure.
  • the present disclosure provides a computer-readable storage medium having a computer program stored thereon, and the computer program is executed by a processor to implement at least one of the following methods: multimedia control according to the first aspect of the present disclosure. Method; the multimedia control method described in the second aspect of this disclosure.
  • Figure 1 is a flow chart of a multimedia control method in an embodiment of the present disclosure
  • Figure 2 is a flow chart of some steps in another multimedia control method in an embodiment of the present disclosure.
  • Figure 3 is a flow chart of a multimedia control method in an embodiment of the present disclosure
  • Figure 4 is a flow chart of some steps in another multimedia control method in an embodiment of the present disclosure.
  • Figure 5 is a flow chart of some steps in yet another multimedia control method in an embodiment of the present disclosure.
  • Figure 6 is a block diagram of a terminal in an embodiment of the present disclosure.
  • FIG. 7 is a block diagram of a server in an embodiment of the present disclosure.
  • Figure 8 is a block diagram of a computer-readable storage medium in an embodiment of the present disclosure.
  • Example embodiments will be described more fully hereinafter with reference to the accompanying drawings, but may be embodied in different forms and should not be construed as limited to the practices set forth herein. Example. These embodiments are provided so that this disclosure will be thorough and complete, and will fully understand the scope of the disclosure to those skilled in the art.
  • an embodiment of the present disclosure provides a multimedia control method, which is applied to a terminal and includes the following steps S11 and S12.
  • step S11 a multimedia data stream is generated in response to the execution of an application integrated in the multimedia system.
  • step S12 the multimedia data stream is transmitted to the server through the multimedia channel of the current terminal, so that the server distributes the multimedia data stream.
  • Embodiments of the present disclosure provide a multimedia system.
  • the hardware architecture of the multimedia system includes a server and multiple terminals.
  • the application program integrated in the multimedia system may be a self-contained application program of the multimedia system or a third-party application program, which is not specifically limited in the embodiment of the present disclosure.
  • the applications integrated in the multimedia system may be applications that have multimedia interactive functions themselves, or they may be applications that do not have multimedia interactive functions themselves.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • multimedia The interactive function can be a video conferencing function or an online teaching function.
  • the multimedia system may be a video conferencing system or an online teaching system.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • the terminal in the multimedia system can generate multimedia data streams in response to the running of the application program, thereby providing multimedia interactive functions for the application program.
  • generating a multimedia data stream in response to the running of an application integrated in the multimedia system means that during the running of the application, the speaker's audio and/or video is synchronously collected, and the application program interface can also be shared, thereby Generate multimedia data streams.
  • the application itself is a drawing tool without multimedia interactive function.
  • the multimedia system in the embodiment of the present disclosure collects video and audio, and can share the screen to generate a multimedia data stream, which is then processed by the server of the multimedia system.
  • drawing tools can be used in scenarios such as video conferencing and online teaching, which is equivalent to making applications that do not originally have multimedia interactive functions have multimedia interactive functions.
  • the multimedia system can provide multimedia interactive functions for applications. Therefore, in the development process of integrated applications, there is no need to develop the multimedia interactive functions of the application itself, and there is no need to develop Multimedia functions such as audio and video collection and screen sharing that are compatible with different terminals and other hardware devices can help reduce development difficulty and development costs and improve application compatibility.
  • the application program is integrated into the multimedia system.
  • the terminal of the multimedia system can synchronously generate a multimedia data stream and distribute the multimedia data stream to other devices through the server of the multimedia system. terminal, thereby being able to share multimedia data streams between multiple terminals. That is, the multimedia control method provided by the embodiment of the present disclosure can provide multimedia interactive functions for applications integrated in the multimedia system, thereby reducing the development of applications in the terminal. Difficulty, improve the compatibility of applications with different hardware, and help save development costs.
  • what kind of multimedia data streams can be generated determines what kind of multimedia interactive functions the multimedia system can provide for applications. For example, if you can generate audio data streams, you can provide audio-based multimedia interactive functions for applications; if you can generate video data streams, you can provide video-based multimedia interactive functions for applications; Being able to generate a shared screen data stream can provide applications with multimedia interactive functions that share the application interface.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • generating a multimedia data stream includes: collecting an audio data stream; and/or collecting a video data stream; and/or generating a data stream that shares the application program interface.
  • the multimedia data stream sent by the terminal to the server is an unprocessed original data stream, for example, original audio data collected by the terminal, original video data collected by the terminal, etc.
  • the server processes the original data stream, for example, rendering, encoding and decoding the audio and video streams. Processing multimedia data streams in the server is conducive to simplifying application development, improving application compatibility in different terminals, and reducing development costs.
  • the multimedia control method further includes the following step S13.
  • step S13 a control instruction is sent to the server, where the control instruction is used to control the multimedia channel of at least one terminal.
  • multimedia data streams there is a multimedia channel between each terminal and the server.
  • the terminal can transmit multimedia data streams to the server through multimedia channels
  • the server can transmit multimedia data streams to other terminals through the multimedia channels of other terminals in the system.
  • multimedia data streams may be transmitted between terminals in a point-to-point manner, or may be transmitted between terminals in a point-to-multipoint manner.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • the terminal sends a control instruction to the server, and the server controls the multimedia channel of the terminal. It can control whether the terminal can send the multimedia data stream to the server, and/or control whether the terminal can receive the multimedia data stream from the server.
  • the multimedia function of the terminal can be controlled through the server.
  • the multimedia data stream is an audio and video data stream.
  • the terminal sends control instructions to the server, controls the multimedia channel of the terminal through the server, and disables one or more terminals from transmitting audio and video data streams to the server. This can be achieved by shutting down the terminal in the terminal.
  • the audio and video collection function has the same effect; the terminal sends control instructions to the server, and the server controls the multimedia channel of the terminal, allowing one or more terminals to transmit audio and video data streams to the server, which can be achieved It has the same effect as turning on the audio and video collection function of the terminal in the terminal.
  • the multimedia data stream is an audio and video data stream.
  • the terminal sends control instructions to the server, controls the multimedia channel of the terminal through the server, and disables the server from transmitting audio and video data streams to one or more terminals. This can be achieved by shutting down the terminal in the terminal.
  • the audio and video playback function has the same effect; the terminal sends control instructions to the server; the multimedia channel of the terminal is controlled through the server, allowing the server to transmit audio and video data streams to one or more terminals, which can achieve the same goal as turning on the audio and video of the terminal in the terminal.
  • Video playback function has the same effect.
  • control instructions sent by the terminal can be used to control the multimedia channels of the terminal itself, and can also be used to control the multimedia channels of other terminals.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • the terminal can send a control instruction to the server, and the server can control the multimedia channel of at least one terminal for transmitting the multimedia data stream according to the received control instruction sent by at least one of the plurality of terminals. , thereby achieving control of the multimedia functions of the terminal through the server.
  • the terminal does not need to have multimedia control functions, which can reduce the difficulty of developing applications in the terminal, improve the compatibility of applications in different terminals, and help save development costs.
  • Embodiments of the present disclosure have no special limitations on how to send control instructions so that the server controls the multimedia channel of the terminal according to the control instructions.
  • the participants in the video conference or online teaching will interact with each other in audio, video, files and other data. That is, for one participant, it can send data to other participants and receive data from other participants. Data sent by participants.
  • the terminal sends control instructions to the server, so that the server controls the multimedia channel of the terminal in two directions: receiving and sending.
  • sending a control instruction to the server includes: sending a control instruction to the server to control a receiving channel and/or a sending channel of at least one terminal.
  • the multimedia channel of the terminal includes a receiving channel and a sending channel.
  • a control instruction can be directed to the receiving channel of the terminal, the sending channel of the terminal, or the receiving channel and the sending channel of the terminal.
  • the server can root According to the control instructions, the receiving channel of the terminal is controlled, or the sending channel of the terminal is controlled, or the receiving channel and the sending channel of the terminal are controlled simultaneously.
  • the terminal sends control instructions to cause the server to control the terminal's multimedia channel in two directions: receiving and sending, which is beneficial to enriching and improving the control of the terminal's multimedia functions.
  • the multimedia data stream is an audio and video data stream.
  • the terminal sends control instructions to enable the server to control the terminal's sending channel, thereby controlling the terminal's audio and video collection function; the terminal sends control instructions to enable the server to control the terminal's reception Channel control can realize control of the terminal’s audio and video playback functions.
  • the terminal achieves complete control of the terminal's audio and video functions by sending control instructions and controlling the terminal's sending channel and receiving channel through the server.
  • each participant in the video conference or online teaching usually has different roles.
  • video conferences usually include conference organizers, participants, etc.; online teaching usually includes teachers, students, etc.
  • Different roles have different responsibilities in video conferencing or online teaching.
  • different control permissions are set for users of different terminals. Terminals with different control permissions can send different control instructions, so that they can pass the server Perform different controls on the multimedia functions of the terminal.
  • control instructions sent to the server correspond to the control permissions of the current terminal.
  • terminals with different control permissions send different control instructions
  • the server can perform different controls on the multimedia channels of the terminal according to different control instructions, so that terminals with different control permissions can control the terminal's multimedia channels through the server.
  • control permissions are set for different terminals, corresponding to different roles in video conferencing or online teaching, which is beneficial to restoring the scene of video conferencing or online teaching and improving user experience.
  • different terminals have different control permissions. For example, a terminal with higher control permissions can control the multimedia functions of a terminal than a terminal with lower control permissions. The terminal can control many multimedia functions of the terminal. In some embodiments, different terminals have different control permissions. For example, a terminal with higher control permissions has a higher priority in controlling a multimedia function than a terminal with lower control permissions has in controlling the multimedia function. The embodiments of the present disclosure do not impose special limitations on this.
  • the terminal is any one of a mobile phone, a television, and a set-top box.
  • an embodiment of the present disclosure provides a multimedia control method, which is applied to a server and includes the following steps S21 to S22.
  • step S21 the multimedia data stream transmitted by the terminal through the multimedia channel is received, and the terminal generates the multimedia data stream in response to an application program integrated in the multimedia system of the terminal;
  • step S22 the multimedia data stream is distributed to at least one target terminal.
  • Embodiments of the present disclosure provide a multimedia system.
  • the hardware architecture of the multimedia system includes a server and multiple terminals.
  • the application program integrated in the multimedia system may be a self-contained application program of the multimedia system or a third-party application program, which is not specifically limited in the embodiment of the present disclosure.
  • the applications integrated in the multimedia system may be applications that have multimedia interactive functions themselves, or they may be applications that do not have multimedia interactive functions themselves.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • the multimedia interactive function can be a video conferencing function or an online teaching function.
  • the multimedia system may be a video conferencing system or an online teaching system.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • the server of the multimedia system can distribute the multimedia data stream generated by the terminal when the application program is running to other terminals, thereby realizing the sharing of multimedia data streams between multiple terminals, making the multimedia system It can provide multimedia interactive functions for integrated applications, thereby reducing the difficulty of developing applications in the terminal, improving the compatibility of applications with different hardware, and helping to save development costs.
  • the multimedia control method further includes the following steps S23 to S24.
  • step S23 a control instruction sent by at least one of the plurality of terminals is received.
  • step S24 at least one multimedia channel of the terminal is controlled according to the control instruction, and the multimedia channel of the terminal is used to transmit multimedia data streams.
  • multimedia data streams there is a multimedia channel between each terminal and the server.
  • the terminal can transmit multimedia data streams to the server through multimedia channels
  • the server can transmit multimedia data streams to other terminals through the multimedia channels of other terminals in the system.
  • multimedia data streams may be transmitted between terminals in a point-to-point manner, or may be transmitted between terminals in a point-to-multipoint manner.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • the server controls the multimedia channel of the terminal, and can control whether the terminal can send multimedia data streams to the server, and/or control whether the terminal can receive multimedia data streams from the server, thereby realizing the control of the terminal through the server. to control the multimedia functions.
  • the multimedia data stream is an audio and video data stream.
  • the server controls the terminal's multimedia channel and disables one or more terminals from transmitting audio and video data streams to the server. This can achieve the same results as turning off the audio and video collection function of the terminal in the terminal. Effect: The server controls the terminal's multimedia channel, allowing one or more terminals to transmit audio and video data streams to the server, which can achieve the same effect as turning on the terminal's audio and video collection function in the terminal.
  • the multimedia data stream is an audio and video data stream.
  • the server controls the multimedia channel of the terminal and disables the server from transmitting audio and video data streams to one or more terminals. This can achieve the same effect as turning off the audio and video playback function of the terminal in the terminal. Effect: The server controls the multimedia channel of the terminal, allowing the server to transmit audio and video data streams to one or more terminals, which can achieve the same effect as turning on the audio and video playback function of the terminal in the terminal.
  • control instructions sent by the terminal can be used to control the multimedia channels of the terminal itself, and can also be used to control the multimedia channels of other terminals.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • the server can control the multimedia channel of at least one terminal for transmitting the multimedia data stream according to the received control instruction sent by at least one of the multiple terminals, thereby realizing multimedia control of the terminal through the server. function to control.
  • the terminal does not need to have multimedia control functions, which can reduce the It reduces the difficulty of application development, improves the compatibility of applications in different terminals, and helps save development costs.
  • the embodiments of this disclosure do not specifically limit how to control the multimedia channel of the terminal according to the control instructions.
  • the participants in the video conference or online teaching will interact with each other in audio, video, files and other data. That is, for one participant, it can send data to other participants and receive data from other participants. Data sent by participants.
  • the multimedia channel of the terminal is controlled by the server in two directions: receiving and sending.
  • controlling the multimedia channel of at least one of the terminals according to the control instruction includes: controlling the receiving channel and/or transmitting channel of at least one of the terminals according to the control instruction, said The terminal's multimedia channels include receiving channels and sending channels.
  • a control instruction can be directed to one terminal or multiple terminals.
  • the server controls the multimedia channels of one terminal or controls the multimedia channels of multiple terminals according to the control instructions.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • a control instruction can be directed to the receiving channel of the terminal, the sending channel of the terminal, or the receiving channel and the sending channel of the terminal.
  • the server controls the receiving channel of the terminal, or controls the sending channel of the terminal, or controls the receiving channel and the sending channel of the terminal simultaneously according to the control instruction.
  • the multimedia channel of the terminal is controlled by the server in two directions: receiving and sending, which is beneficial to enriching and improving the control of the multimedia function of the terminal.
  • the multimedia data stream is an audio and video data stream.
  • the audio and video collection function of the terminal can be controlled; by controlling the receiving channel of the terminal by the server, the audio and video playback function of the terminal can be realized.
  • the server realizes the control of the terminal by controlling the sending channel and receiving channel of the terminal. Complete control of audio and video functions.
  • each participant in the video conference or online teaching usually has different roles.
  • video conferences usually include conference organizers, participants, etc.; online teaching usually includes teachers, students, etc.
  • Different roles have different responsibilities in video conferencing or online teaching.
  • different control permissions are set for users of different terminals. Terminals with different control permissions can send different control instructions, so that they can pass the server Perform different controls on the multimedia functions of the terminal.
  • control instructions of the terminal correspond to the control authority of the terminal.
  • terminals with different control permissions send different control instructions
  • the server can perform different controls on the multimedia channels of the terminal according to different control instructions, so that terminals with different control permissions can control the terminal's multimedia channels through the server.
  • Different controls for multimedia functions are possible.
  • control permissions are set for different terminals, corresponding to different roles in video conferencing or online teaching, which is beneficial to restoring the scene of video conferencing or online teaching and improving user experience.
  • different terminals have different control permissions. For example, a terminal with higher control permissions can control more multimedia functions of the terminal than a terminal with lower control permissions can control. In some embodiments, different terminals have different control permissions. For example, a terminal with higher control permissions has a higher priority in controlling a multimedia function than a terminal with lower control permissions has in controlling the multimedia function. The embodiments of the present disclosure do not impose special limitations on this.
  • multiple terminals include at least one first terminal and at least one second terminal; according to the control instruction corresponding to the control authority of the terminal, the receiving channel and/or the at least one terminal Or control the sending channel, including: opening or closing the receiving channel of the first terminal itself according to the control instruction of the first terminal; and/or opening or closing the third terminal according to the control instruction of the first terminal.
  • the control instruction of the terminal opens or closes the sending channel of at least one second terminal directed by the control instruction; and/or according to the control instruction of the second terminal, opens or closes the receiving channel of the second terminal itself; and /Or open or close the transmission channel of the second terminal itself according to the control instruction of the second terminal; wherein the control authority of the first terminal is higher than the control authority of the second terminal.
  • the first terminal is a terminal used by the organizer of the video conference, and the second terminal is a terminal used by participants of the video conference. In some embodiments, the first terminal is a terminal used by teachers who teach online, and the second terminal is a terminal used by students.
  • the control authority of the first terminal is higher than that of the second terminal.
  • the first terminal can either send control instructions to control its own multimedia functions through the server, or it can send control instructions to control the third terminal through the server. Multimedia functions of the second terminal; the second terminal can only send control instructions to control its own multimedia functions through the server.
  • the server when the server opens or closes the multimedia channel of at least one second terminal pointed to by the control command according to the control command of the first terminal, the server can open or close the multimedia channels of multiple second terminals in batches, that is, the first The terminal can batch control the multimedia functions of multiple second terminals through the server; it can also open or close the multimedia channel of a specific second terminal, that is, the first terminal can control the multimedia functions of a specific second terminal through the server.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • control instruction of the first terminal and the control instruction of the second terminal are received, and the multimedia channel pointed by the control instruction of the second terminal is the multimedia channel pointed by the control instruction of the first terminal, subset, execute the control instruction of the first terminal.
  • the multimedia channel pointed by the control instruction of the second terminal is a subset of the multimedia channel pointed by the control instruction of the first terminal, which refers to when the second terminal sends a control instruction to control its own receiving channel through the server.
  • the first terminal also sends control instructions through the server to control the receiving channel of the second terminal; or when the second terminal sends control instructions through the server to control its own sending channel, the first terminal also sends control instructions through the server at the same time Control the sending channel of the second terminal.
  • the control instruction of the first terminal is executed without executing the control instruction of the second terminal. That is, the priority of a terminal with higher control authority to control a multimedia function is higher than the priority of a terminal with lower control authority to control the multimedia function.
  • the multimedia channels pointed by the control instructions of the second terminal are a subset of the multimedia channels pointed by the control instructions of the first terminal. As long as the terminals pointed by the control instructions sent by the first terminal include the second terminal, that is Yes, there is no need for the first terminal to send a separate control instruction directed to the second terminal.
  • the terminal is only used to obtain multimedia data streams and transmit them to the server, and the processing of the collected multimedia data streams, such as encoding, decoding, rendering, etc., is performed by the server.
  • distributing the multimedia data stream to at least one target terminal includes: processing the multimedia data stream and transmitting it to at least one target terminal.
  • the multimedia data stream transmitted by the terminal is the original data stream obtained by the terminal.
  • the original video data stream collected by the terminal through the camera is the original data stream obtained by the terminal.
  • processing the multimedia data stream includes rendering, encoding and decoding the multimedia data stream.
  • processing the multimedia data stream in the server is conducive to simplifying the development of application programs in terminals, improving the compatibility of application programs in different terminals, and reducing development costs.
  • the multimedia data stream includes at least one of an audio data stream, a video data stream, and a data stream sharing an application program interface.
  • the audio data stream may be a data stream collected by the terminal through an audio collection device, or a data stream generated by playing an audio file in the terminal.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • the video data stream may be a data stream collected by the terminal through a video collection device such as a camera, or a data stream generated by playing a video file in the terminal.
  • a video collection device such as a camera
  • a data stream generated by playing a video file in the terminal may be a data stream collected by the terminal through a video collection device such as a camera.
  • the data flow of the shared application program interface may be in the terminal A stream of video data generated by sharing the application interface when the application is running.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • the multimedia data stream also includes text data stream, application data stream, etc.
  • the text data stream can be a data stream generated by the terminal sharing a file in text format, a data stream generated by the user writing on the blackboard at the terminal, or a data stream generated by the user inputting text at the terminal. flow.
  • the embodiments of the present disclosure do not impose special limitations on this.
  • the application data flow may be a signaling and other data flow generated when the terminal runs an application program.
  • blackboard writing can be displayed by transmitting video data streams, or blackboard writing can be displayed by transmitting text data streams.
  • the application program in the terminal is integrated in a common application program (Application, APP) corresponding to the system composed of the server and the terminal.
  • Application Application
  • the multimedia control method further includes the following step S25.
  • step S25 control authority is issued to the terminal according to the user identity corresponding to the terminal.
  • the user logs in through the terminal, and then the server determines the user identity corresponding to the terminal.
  • the server issues control permissions, terminals corresponding to different user identities have different control permissions.
  • the multimedia control method further includes the following step S26.
  • step S26 in response to the end instruction sent by the first terminal, the second terminal is controlled to go offline; or in response to the first terminal going offline, the second terminal is controlled to go offline; wherein the plurality of terminals include At least one first terminal and at least one second terminal, the control authority of the first terminal is higher than the control authority of the second terminal.
  • an embodiment of the present disclosure provides a terminal, which includes: one or more processors 101; a memory 102, on which one or more computer programs are stored, and the one or more computer programs are processed by a or multiple processors, causing one or more A processor implements the multimedia control method described in the first aspect of the embodiment of the present disclosure; one or more I/O interfaces 103 are connected between the processor and the memory, and are configured to implement information interaction between the processor and the memory.
  • the processor 101 is a device with data processing capabilities, including but not limited to a central processing unit (CPU), etc.
  • the memory 102 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically Such as SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory (FLASH);
  • the I/O interface (read-write interface) 103 is connected between the processor 101 and the memory 102 , can realize information interaction between the processor 101 and the memory 102, which includes but is not limited to a data bus (Bus), etc.
  • processor 101 memory 102, and I/O interface 103 are connected to each other and, in turn, to other components of the computing device via bus 104.
  • an embodiment of the present disclosure provides a server, which includes: one or more processors 201; a memory 202, on which one or more computer programs are stored, and the one or more computer programs are processed by a Or multiple processors execute, so that one or more processors implement the multimedia control method described in the second aspect of the embodiment of the present disclosure; one or more I/O interfaces 203 are connected between the processor and the memory, and are configured as Realize information interaction between processor and memory.
  • the processor 201 is a device with data processing capabilities, including but not limited to a central processing unit (CPU), etc.
  • the memory 202 is a device with data storage capabilities, including but not limited to a random access memory (RAM, more specifically Such as SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory (FLASH);
  • the I/O interface (read-write interface) 203 is connected between the processor 201 and the memory 202 , can realize information interaction between the processor 201 and the memory 202, which includes but is not limited to a data bus (Bus), etc.
  • processor 201 memory 202, and I/O interface 203 are connected to each other and, in turn, to other components of the computing device via bus 204.
  • an embodiment of the present disclosure provides a computer-readable storage medium on which a computer program is stored, and the computer program is executed by a processor to implement at least one of the following methods: First Embodiment of the Disclosure The multimedia control method described in this aspect; this The multimedia control method described in the second aspect of the embodiment is disclosed.
  • This embodiment takes online teaching as an example for explanation.
  • the terminal can be a mobile phone, smart TV, set-top box, etc.
  • the server issues control permissions based on the account identity.
  • the teacher has more permissions than the students, and for the control of the same switch, the teacher has higher permissions.
  • the teacher can take the initiative to end the online class, and all members of the class will automatically exit the class; if the teacher forgets to end the class, all members of the class will be automatically dismissed after the teacher exits the class.
  • teachers and students log in to the server through the universal APP, and the physical terminal where the universal APP is located only needs to have the audio and video signal collection function. Users do not need to download APPs from various manufacturers to use their teaching functions. They only need to log in through the universal APP in this embodiment to use multiple applications integrated in the system for interactive teaching. These integrated applications need to have Its own functions and other functions are handed over to the server in this embodiment, which greatly increases the scalability of teaching and the ease of use of software that can be used for teaching.
  • Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
  • computer storage media includes volatile and nonvolatile media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. removable, removable and non-removable media.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disk (DVD) or other optical disk storage, magnetic cassettes, tapes, disk storage or other magnetic storage devices, or may Any other medium used to store desired information and that can be accessed by a computer.
  • communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .
  • Example embodiments have been disclosed herein, and although specific terms are employed, they are used and should be interpreted in a general illustrative sense only and not for purpose of limitation. In some instances, it will be apparent to those skilled in the art that, unless expressly stated otherwise, features, characteristics, and/or elements described in connection with a particular embodiment may be used alone, or may be combined with features, characteristics, and/or elements described in connection with other embodiments. and/or used in combination with components. Accordingly, it will be understood by those skilled in the art that various changes in form and details may be made without departing from the scope of the present disclosure as set forth in the appended claims.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本公开提供一种应用于终端的多媒体控制方法，包括：响应于集成在多媒体系统中的应用程序运行，生成多媒体数据流；以及通过当前终端的多媒体通道将所述多媒体数据流传输到服务器，以使所述服务器分发所述多媒体数据流。本公开实施例还提供一种应用于服务器的多媒体控制方法、终端、服务器和计算机可读存储介质。

Description

多媒体控制方法、终端、服务器、存储介质
相关申请的交叉引用
本申请要求于2022年6月24日提交的中国专利申请NO.202210730382.8的优先权，该中国专利申请的内容通过引用的方式整体合并于此。
技术领域
本公开涉及多媒体技术领域，特别涉及一种多媒体控制方法、终端、服务器以及计算机可读存储介质。
背景技术
视频会议是通过网络召开的实时、点对点或点对多点的线上会议，视频会议用户能够方便地进行线上会议、培训、教学等。基于视频会议技术，还进一步产生了支持线上互动教学的教学系统。
但是，视频会议系统还需要进一步改进。
发明内容
第一方面，本公开提供一种多媒体控制方法，应用于终端，包括：响应于集成在多媒体系统中的应用程序运行，生成多媒体数据流；通过当前终端的多媒体通道将所述多媒体数据流传输到服务器，以使所述服务器分发所述多媒体数据流。
第二方面，本公开提供一种多媒体控制方法，应用于服务器，包括：接收终端通过多媒体通道传输的多媒体数据流，其中，终端响应于集成在所述终端的多媒体系统中的应用程序运行生成所述多媒体数据流；将所述多媒体数据流分发到至少一个目标终端。
第三方面，本公开提供一种终端，包括：一个或多个处理器；存储器，其上存储有一个或多个计算机程序，所述一个或多个计算机 程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现本公开第一方面所述的多媒体控制方法。
第四方面，本公开提供一种服务器，包括：一个或多个处理器；存储器，其上存储有一个或多个计算机程序，所述一个或多个计算机程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现本公开第二方面所述的多媒体控制方法。
第五方面，本公开提供一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行以实现以下方法中的至少一者：本公开第一方面所述的多媒体控制方法；本公开第二方面所述的多媒体控制方法。
附图说明
图1是本公开实施方式中一种多媒体控制方法的流程图；
图2是本公开实施方式中另一种多媒体控制方法中部分步骤的流程图；
图3是本公开实施方式中一种多媒体控制方法的流程图；
图4是本公开实施方式中另一种多媒体控制方法中部分步骤的流程图；
图5是本公开实施方式中又一种多媒体控制方法中部分步骤的流程图；
图6是本公开实施方式中一种终端的组成框图；
图7是本公开实施方式中一种服务器的组成框图；以及
图8是本公开实施方式中一种计算机可读存储介质的组成框图。
具体实施方式
为使本领域的技术人员更好地理解本公开的技术方案，下面结合附图对本公开提供的多媒体控制方法、终端、服务器、计算机可读存储介质进行详细描述。
在下文中将参考附图更充分地描述示例实施例，但是所述示例实施例可以以不同形式来体现，且不应当被解释为限于本文阐述的实 施例。提供这些实施例的目的在于使本公开更加透彻和完整，并将使本领域技术人员充分理解本公开的范围。
在不冲突的情况下，本公开各实施例及实施例中的各特征可相互组合。
如本文所使用的，术语“和/或”包括一个或多个相关列举条目的任何和所有组合。
本文所使用的术语仅用于描述特定实施例，且不意欲限制本公开。如本文所使用的，单数形式“一个”和“该”也意欲包括复数形式，除非上下文另外清楚指出。还将理解的是，当本说明书中使用术语“包括”和/或“由……制成”时，指定存在特定特征、整体、步骤、操作、元件和/或组件，但不排除存在或可添加一个或多个其它特征、整体、步骤、操作、元件、组件和/或其群组。
除非另外限定，否则本文所用的所有术语(包括技术和科学术语)的含义与本领域普通技术人员通常理解的含义相同。还将理解，诸如那些在常用字典中限定的那些术语应当被解释为具有与其在相关技术以及本公开的背景下的含义一致的含义，且将不解释为具有理想化或过度形式上的含义，除非本文明确如此限定。
第一方面，参照图1，本公开实施例提供一种多媒体控制方法，应用于终端，包括如下步骤S11和S12。
在步骤S11中，响应于集成在多媒体系统中的应用程序运行，生成多媒体数据流。
在步骤S12中，通过当前终端的多媒体通道将所述多媒体数据流传输到服务器，以使所述服务器分发所述多媒体数据流。
本公开实施例提供了一种多媒体系统，多媒体系统的硬件架构包括服务器和多个终端。多媒体系统中集成的应用程序可以是多媒体系统自带的应用程序，也可以是第三方应用程序，本公开实施例对此不做特殊限定。多媒体系统中集成的应用程序可以是本身具有多媒体互动功能的应用程序，也可以是本身不具有多媒体互动功能的应用程序。本公开实施例对此不做特殊限定。
本公开实施例对多媒体互动功能不做特殊限定。例如，多媒体 互动功能可以是视频会议功能，也可以是线上教学功能。在一些实施方式中，多媒体系统可以是视频会议系统，也可以是线上教学系统。本公开实施例对此不做特殊限定。
在本公开实施例中，多媒体系统中的终端响应于应用程序运行，能够生成多媒体数据流，从而为应用程序提供多媒体互动功能。在一些实施例中，响应于集成在多媒体系统中的应用程序运行生成多媒体数据流，是指在应用程序运行过程中，同步采集演讲者的音频和/或视频、还可以共享应用程序界面，从而生成多媒体数据流。
例如，应用程序本身为不具有多媒体互动功能的画图工具，本公开实施例中的多媒体系统在画图工具运行时，采集视频、音频，并能够共享屏幕，生成多媒体数据流，然后由多媒体系统的服务器将多媒体数据流分发到各个终端，从而能够将画图工具应用于视频会议、线上教学等场景中，相当于使本来不具有多媒体互动功能的应用程序具有了多媒体互动功能。
需要说明的是，本公开实施例中多媒体系统能够为应用程序提供多媒体互动功能，因此，在集成的应用程序的开发过程中，可以不需要开发应用程序自身的多媒体互动功能，而且也不需要开发与不同的终端等硬件设备兼容的音视频采集、屏幕共享等多媒体功能，有利于降低开发难度和开发成本，提升应用程序的兼容性。
本公开实施例提供的多媒体控制方法中，将应用程序集成在多媒体系统中，当应用程序运行时，多媒体系统的终端能够同步生成多媒体数据流，并通过多媒体系统的服务器将多媒体数据流分发到其他终端，从而能够在多个终端之间分享多媒体数据流，即，本公开实施例提供的多媒体控制方法能够为集成在多媒体系统中的应用程序提供多媒体互动功能，从而能够降低终端中应用程序的开发难度，提升应用程序对于不同硬件的兼容性，有利于节约开发成本。
在本公开实施例中，能够生成何种多媒体数据流决定了多媒体系统能够为应用程序提供何种多媒体互动功能。例如，能够生成音频数据流，则能够为应用程序提供基于音频的多媒体互动功能；能够生成视频数据流，则能够为应用程序提供基于视频的多媒体互动功能； 能够生成共享屏幕数据流，则能够为应用程序提供共享应用程序界面的多媒体互动功能。本公开实施例对此不做特殊限定。
在一些实施方式中，在一些实施例中，生成多媒体数据流，包括：采集音频数据流；和/或采集视频数据流；和/或生成共享所述应用程序界面的数据流。
在一些实施例中，终端向服务器发送的多媒体数据流为没有经过处理的原始数据流，例如，终端采集的原始音频数据、终端采集的原始视频数据等。终端将原始数据流发送到服务器后，由服务器对原始数据流进行处理，例如，对音视频流进行渲染、编解码等处理。在服务器中对多媒体数据流进行处理，有利于简化应用程序开发，提升应用程序在不同终端中的兼容性，降低开发成本。
在一些实施例中，参照图2，所述多媒体控制方法还包括如下步骤S13。
在步骤S13中，向所述服务器发送控制指令，所述控制指令用于对至少一个终端的多媒体通道进行控制。
在本公开实施例中，每个终端与服务器之间都具有多媒体通道。终端能够通过多媒体通道，将多媒体数据流传输到服务器，服务器通过系统中的其他终端的多媒体通道，将多媒体数据流传输到其他终端。在本公开实施例中，多媒体数据流可以通过点对点的方式在终端之间传输，也可以通过点对多点的方式在终端之间传输。本公开实施例对此不做特殊限定。
在本公开实施例中，终端向服务器发送控制指令，通过服务器对终端的多媒体通道进行控制，可以控制终端是否能够向服务器发送多媒体数据流，和/或控制终端是否能够从服务器接收多媒体数据流，从而实现了通过服务器对终端的多媒体功能进行控制。例如，多媒体数据流为音视频数据流，终端向服务器发送控制指令，通过服务器对终端的多媒体通道进行控制，禁用一个或多个终端向服务器传输音视频数据流，能够实现与在终端中关闭终端的音视频采集功能相同的效果；终端向服务器发送控制指令，通过服务器对终端的多媒体通道进行控制，允许一个或多个终端向服务器传输音视频数据流，能够实现 与在终端中开启终端的音视频采集功能相同的效果。例如，多媒体数据流为音视频数据流，终端向服务器发送控制指令，通过服务器对终端的多媒体通道进行控制，禁用服务器向一个或多个终端传输音视频数据流，能够实现与在终端中关闭终端的音视频播放功能相同的效果；终端向服务器发送控制指令；通过服务器对终端的多媒体通道进行控制，允许服务器向一个或多个终端传输音视频数据流，能够实现与在终端中开启终端的音视频播放功能相同的效果。
需要说明的是，在本公开实施例中，终端发送的控制指令可以用于控制该终端自身的多媒体通道，也可以用于控制其他终端的多媒体通道。本公开实施例对此不做特殊限定。
在本公开实施例中，终端能够向服务器发送控制指令，服务器能够根据接收到的多个终端中的至少一者发送的控制指令，对至少一个终端的用于传输多媒体数据流的多媒体通道进行控制，从而实现通过服务器对终端的多媒体功能进行控制。在此基础上，终端无需具备多媒体控制功能，从而能够降低终端中应用程序的开发难度，提升应用程序在不同终端中的兼容性，有利于节约开发成本。
本公开实施例对于如何发送控制指令，以使服务器根据控制指令对终端的多媒体通道进行控制不做特殊限定。
在视频会议或线上教学过程中，视频会议或线上教学的各参与方会彼此交互音视频、文件等数据，即对于一个参与方，其既可以向其他参与方发送数据，也可以接收其他参与方发送的数据。在一些实施例中，对应于视频会议或线上教学的互动特点，终端向服务器发送控制指令，使服务器对终端的多媒体通道按照接收和发送两个方向进行控制。
在一些实施例中，向所述服务器发送控制指令，包括：向所述服务器发送对至少一个终端的接收通道和/或发送通道进行控制的控制指令，终端的多媒体通道包括接收通道和发送通道。
在本公开实施例中，针对一个被控制的终端，一条控制指令可以指向该终端的接收通道，也可以指向该终端的发送通道，还可以指向该终端的接收通道和发送通道。在一些实施方式中，服务器能够根 据控制指令对该终端的接收通道进行控制，或对终端的发送通道进行控制，或对终端的接收通道和发送通道同时进行控制。本公开实施例对此不做特殊限定。
在本公开实施例中，终端通过发送控制指令，使服务器对终端的多媒体通道按照接收和发送两个方向进行控制，有利于丰富和完善对终端的多媒体功能的控制。
例如，多媒体数据流为音视频数据流，终端通过发送控制指令，使服务器对终端的发送通道进行控制，能够实现对终端音视频采集功能的控制；终端通过发送控制指令，使服务器对终端的接收通道进行控制，能够实现对终端音视频播放功能的控制。终端通过发送控制指令，通过服务器对终端的发送通道和接收通道的控制，实现了对终端音视频功能的完整控制。
在视频会议或线上教学过程中，视频会议或线上教学的各参与方通常具有不同的角色。例如，视频会议中通常有会议组织者、参与者等；线上教学中通常有老师、学生等。不同的角色在视频会议或线上教学中的职责不同。在一些实施例中，对应于视频会议或线上教学中不同角色的不同职责，为不同终端的用户设置了不同的控制权限，具备不同控制权限的终端能够发送不同的控制指令，从而能够通过服务器对终端的多媒体功能进行不同的控制。
在一些实施例中，向服务器发送的控制指令与当前终端的控制权限相对应。
在本公开实施例中，具备不同控制权限的终端发送的控制指令不同，服务器根据不同的控制指令能够对终端的多媒体通道进行不同的控制，从而使得具备不同控制权限的终端能够通过服务器对终端的多媒体功能，进行不同的控制。
在本公开实施例中，为不同终端的设置不同的控制权限，与视频会议或线上教学中的不同角色对应，有利于还原视频会议或线上教学的场景，提升用户体验。
在一些实施例中，不同终端的控制权限不同，例如，具有较高控制权限的终端能够控制的终端的多媒体功能比具有较低控制权限 的终端能够控制的终端的多媒体功能多。在一些实施例中，不同终端的控制权限不同，例如，具有较高控制权限的终端对一个多媒体功能进行控制的优先级高于具有较低控制权限的终端对该多媒体功能进行控制的优先级。本公开实施例对此不做特殊限定。
本公开实施例对终端不做特殊限定。在一些实施例中，所述终端为手机、电视、机顶盒中的任意一者。
第二方面，参照图3，本公开实施例提供一种多媒体控制方法，应用于服务器，包括如下步骤S21至S22。
在步骤S21中，接收终端通过多媒体通道传输的多媒体数据流，终端响应于集成在所述终端的多媒体系统中的应用程序运行生成所述多媒体数据流；
在步骤S22中，将所述多媒体数据流分发到至少一个目标终端。
本公开实施例提供了一种多媒体系统，多媒体系统的硬件架构包括服务器和多个终端。多媒体系统中集成的应用程序可以是多媒体系统自带的应用程序，也可以是第三方应用程序，本公开实施例对此不做特殊限定。多媒体系统中集成的应用程序可以是本身具有多媒体互动功能的应用程序，也可以是本身不具有多媒体互动功能的应用程序。本公开实施例对此不做特殊限定。
本公开实施例对多媒体互动功能不做特殊限定。例如，多媒体互动功能可以是视频会议功能，也可以是线上教学功能。在一些实施方式中，多媒体系统可以是视频会议系统，也可以是线上教学系统。本公开实施例对此不做特殊限定。
本公开实施例提供的多媒体控制方法中，多媒体系统的服务器能够将终端在应用程序运行时生成的多媒体数据流分发到其他终端，从而实现了在多个终端之间分享多媒体数据流，使得多媒体系统能够为集成的应用程序提供多媒体互动功能，从而能够降低终端中应用程序的开发难度，提升应用程序对于不同硬件的兼容性，有利于节约开发成本。
在一些实施例中，参照图4，所述多媒体控制方法还包括如下步骤S23至S24。
在步骤S23中，接收多个终端中的至少一者发送的控制指令。
在步骤S24中，根据所述控制指令对至少一个所述终端的多媒体通道进行控制，所述终端的多媒体通道用于传输多媒体数据流。
在本公开实施例中，每个终端与服务器之间都具有多媒体通道。终端能够通过多媒体通道，将多媒体数据流传输到服务器，服务器通过系统中的其他终端的多媒体通道，将多媒体数据流传输到其他终端。在本公开实施例中，多媒体数据流可以通过点对点的方式在终端之间传输，也可以通过点对多点的方式在终端之间传输。本公开实施例对此不做特殊限定。
在本公开实施例中，通过服务器对终端的多媒体通道进行控制，可以控制终端是否能够向服务器发送多媒体数据流，和/或控制终端是否能够从服务器接收多媒体数据流，从而实现了通过服务器对终端的多媒体功能进行控制。例如，多媒体数据流为音视频数据流，通过服务器对终端的多媒体通道进行控制，禁用一个或多个终端向服务器传输音视频数据流，能够实现与在终端中关闭终端的音视频采集功能相同的效果；通过服务器对终端的多媒体通道进行控制，允许一个或多个终端向服务器传输音视频数据流，能够实现与在终端中开启终端的音视频采集功能相同的效果。例如，多媒体数据流为音视频数据流，通过服务器对终端的多媒体通道进行控制，禁用服务器向一个或多个终端传输音视频数据流，能够实现与在终端中关闭终端的音视频播放功能相同的效果；通过服务器对终端的多媒体通道进行控制，允许服务器向一个或多个终端传输音视频数据流，能够实现与在终端中开启终端的音视频播放功能相同的效果。
需要说明的是，在本公开实施例中，终端发送的控制指令可以用于控制该终端自身的多媒体通道，也可以用于控制其他终端的多媒体通道。本公开实施例对此不做特殊限定。
本公开实施例中，服务器能够根据接收到的多个终端中的至少一者发送的控制指令，对至少一个终端的用于传输多媒体数据流的多媒体通道进行控制，从而实现通过服务器对终端的多媒体功能进行控制。在此基础上，终端无需具备多媒体控制功能，从而能够降低终端 中应用程序的开发难度，提升应用程序在不同终端中的兼容性，有利于节约开发成本。
本公开实施例对于如何根据控制指令对终端的多媒体通道进行控制不做特殊限定。
在视频会议或线上教学过程中，视频会议或线上教学的各参与方会彼此交互音视频、文件等数据，即对于一个参与方，其既可以向其他参与方发送数据，也可以接收其他参与方发送的数据。在一些实施例中，对应于视频会议或线上教学的互动特点，通过服务器对终端的多媒体通道按照接收和发送两个方向进行控制。
在一些实施例中，根据所述控制指令对至少一个所述终端的多媒体通道进行控制，包括：根据所述控制指令，对至少一个所述终端的接收通道和/或发送通道进行控制，所述终端的多媒体通道包括接收通道和发送通道。
在本公开实施例中，一条控制指令可以指向一个终端，也可以指向多个终端。在一些实施方式中，服务器根据控制指令对一个终端的多媒体通道进行控制，或对多个终端的多媒体通道进行控制。本公开实施例对此不做特殊限定。
在本公开实施例中，针对一个终端，一条控制指令可以指向该终端的接收通道，也可以指向该终端的发送通道，还可以指向该终端的接收通道和发送通道。在一些实施方式中，服务器根据控制指令对终端的接收通道进行控制，或对终端的发送通道进行控制，或对终端的接收通道和发送通道同时进行控制。本公开实施例对此不做特殊限定。
在本公开实施例中，通过服务器对终端的多媒体通道按照接收和发送两个方向进行控制，有利于丰富和完善对终端的多媒体功能的控制。
例如，多媒体数据流为音视频数据流，通过服务器对终端的发送通道进行控制，能够实现对终端音视频采集功能的控制；通过服务器对终端的接收通道进行控制，能够实现对终端音视频播放功能的控制。服务器通过对终端的发送通道和接收通道的控制，实现了对终端 音视频功能的完整控制。
在视频会议或线上教学过程中，视频会议或线上教学的各参与方通常具有不同的角色。例如，视频会议中通常有会议组织者、参与者等；线上教学中通常有老师、学生等。不同的角色在视频会议或线上教学中的职责不同。在一些实施例中，对应于视频会议或线上教学中不同角色的不同职责，为不同终端的用户设置了不同的控制权限，具备不同控制权限的终端能够发送不同的控制指令，从而能够通过服务器对终端的多媒体功能进行不同的控制。
在一些实施例中，所述终端的控制指令与所述终端的控制权限相对应。
在本公开实施例中，具备不同控制权限的终端发送的控制指令不同，服务器根据不同的控制指令能够对终端的多媒体通道进行不同的控制，从而使得具备不同控制权限的终端能够通过服务器对终端的多媒体功能进行不同的控制。
在本公开实施例中，为不同终端的设置不同的控制权限，与视频会议或线上教学中的不同角色对应，有利于还原视频会议或线上教学的场景，提升用户体验。
在一些实施例中，不同终端的控制权限不同，例如，具有较高控制权限的终端能够控制的终端的多媒体功能比具有较低控制权限的终端能够控制的终端的多媒体功能多。在一些实施例中，不同终端的控制权限不同，例如，具有较高控制权限的终端对一个多媒体功能进行控制的优先级高于具有较低控制权限的终端对该多媒体功能进行控制的优先级。本公开实施例对此不做特殊限定。
在一些实施例中，多个所述终端包括至少一个第一终端和至少一个第二终端；根据与所述终端的控制权限对应的所述控制指令，对至少一个所述终端的接收通道和/或发送通道进行控制，包括：根据所述第一终端的控制指令，开启或关闭所述第一终端自身的接收通道；和/或根据所述第一终端的控制指令，开启或关闭所述第一终端自身的发送通道；和/或根据所述第一终端的控制指令，开启或关闭所述控制指令指向的至少一个第二终端的接收通道；和/或根据所述第一 终端的控制指令，开启或关闭所述控制指令指向的至少一个第二终端的发送通道；和/或根据所述第二终端的控制指令，开启或关闭所述第二终端自身的接收通道；和/或根据所述第二终端的控制指令，开启或关闭所述第二终端自身的发送通道；其中，所述第一终端的控制权限高于所述第二终端的控制权限。
在一些实施例中，第一终端为视频会议的组织者使用的终端，第二终端为视频会议的参与者使用的终端。在一些实施例中，第一终端为线上教学的老师使用的终端，第二终端为学生使用的终端。
在本公开实施例中，第一终端的控制权限高于第二终端的控制权限，第一终端既可以发送控制指令，通过服务器控制其自身的多媒体功能，也可以发送控制指令，通过服务器控制第二终端的多媒体功能；第二终端只可以发送控制指令，通过服务器控制其自身的多媒体功能。
在本公开实施例中，服务器根据第一终端的控制指令，开启或关闭控制指令指向的至少一个第二终端的多媒体通道时，可以批量开启或关闭多个第二终端的多媒体通道，即第一终端可以通过服务器对多个第二终端的多媒体功能进行批量控制；也可以开启或关闭特定的第二终端的多媒体通道，即第一终端可以通过服务器对特定的第二终端的多媒体功能进行控制。本公开实施例对此不做特殊限定。
在一些实施例中，当接收到第一终端的控制指令和第二终端的控制指令、且所述第二终端的控制指令指向的多媒体通道为所述第一终端的控制指令指向的多媒体通道的子集时，执行所述第一终端的控制指令。
在本公开实施例中，第二终端的控制指令指向的多媒体通道为第一终端的控制指令指向的多媒体通道的子集，是指第二终端发送控制指令通过服务器对自身的接收通道进行控制时，第一终端也同时发送控制指令通过服务器对该第二终端的接收通道进行控制；或第二终端发送控制指令通过服务器对自身的发送通道进行控制时，第一终端也同时发送控制指令通过服务器对该第二终端的发送通道进行控制。在此情况下，执行第一终端的控制指令，而不执行第二终端的控制指 令，即具有较高控制权限的终端对一个多媒体功能进行控制的优先级高于具有较低控制权限的终端对该多媒体功能进行控制的优先级。
需要说明的是，第二终端的控制指令指向的多媒体通道为第一终端的控制指令指向的多媒体通道的子集，只要是第一终端发送的控制指令指向的终端中，包括该第二终端即可，而不需要第一终端发送单独指向该第二终端的控制指令。
在一些实施例中，终端只用于获取多媒体数据流并传输到服务器，而对采集到的多媒体数据流的处理，例如编解码、渲染等，则由服务器执行。
在一些实施例中，将所述多媒体数据流分发到至少一个目标终端，包括：对所述多媒体数据流进行处理，并传输到至少一个目标终端。
在本公开实施例中，终端传输的多媒体数据流为终端获取的原始数据流。例如，终端通过摄像头采集的原始视频数据流。
本公开实施例对服务器对多媒体数据流进行处理不做特殊限定。
在一些实施例中，对所述多媒体数据流进行处理，包括：对所述多媒体数据流进行渲染、编解码处理。
在本公开实施例中，在服务器中对多媒体数据流进行处理，有利于简化终端中应用程序开发，提升应用程序在不同终端中的兼容性，降低开发成本。
本公开实施例对多媒体数据流不做特殊限定。
在一些实施例中，所述多媒体数据流包括音频数据流、视频数据流、共享应用程序界面的数据流中的至少一者。
在本公开实施例中，音频数据流可以是终端通过音频采集设备采集的数据流，也可以是在终端中播放音频文件而生成的数据流。本公开实施例对此不做特殊限定。
在本公开实施例中，视频数据流可以是终端通过摄像头等视频采集设备采集的数据流，也可以是终端中播放视频文件而生成的数据流。本公开实施例对此不做特殊限定。
在本公开实施例中，共享应用程序界面的数据流可以是终端中 运行应用程序时共享应用程序界面而生成的视频数据流。本公开实施例对此不做特殊限定。
在一些实施例中，多媒体数据流还包括文本数据流、应用数据流等。
在本公开实施例中，文本数据流可以是终端共享文本格式的文件而生成的数据流，也可以是用户在终端进行板书而生成的数据流，还可以是用户在终端输入文字而生成的数据流。本公开实施例对此不做特殊限定。
在本公开实施例中，应用数据流可以是终端运行应用程序时生成的信令等数据流。
例如，在线上教学过程中，可以通过传输视频数据流实现板书的展示，也可以通过传输文本数据流实现板书的展示。
在一些实施例中，终端中的应用程序集成在由服务器和终端组成的系统对应的通用应用程序(Appl ication，APP)中。
在一些实施例中，参照图5，所述多媒体控制方法还包括如下步骤S25。
在步骤S25中，根据所述终端对应的用户身份，向所述终端下发控制权限。
在本公开实施例中，用户通过终端登录，进而使服务器确定终端对应的用户身份。服务器在下发控制权限时，不同用户身份对应的终端的控制权限不同。
在一些实施例中，参照图5，所述多媒体控制方法还包括如下步骤S26。
在步骤S26中，响应于第一终端发送的结束指令，控制第二终端下线；或响应于所述第一终端下线，控制所述第二终端下线；其中，多个所述终端包括至少一个第一终端和至少一个第二终端，所述第一终端的控制权限高于所述第二终端的控制权限。
第三方面，参照图6，本公开实施例提供一种终端，其包括：一个或多个处理器101；存储器102，其上存储有一个或多个计算机程序，一个或多个计算机程序被一个或多个处理器执行，使得一个或多 个处理器实现本公开实施例第一方面所述的多媒体控制方法；一个或多个I/O接口103，连接在处理器与存储器之间，配置为实现处理器与存储器的信息交互。
其中，处理器101为具有数据处理能力的器件，其包括但不限于中央处理器(CPU)等；存储器102为具有数据存储能力的器件，其包括但不限于随机存取存储器(RAM，更具体如SDRAM、DDR等)、只读存储器(ROM)、带电可擦可编程只读存储器(EEPROM)、闪存(FLASH)；I/O接口(读写接口)103连接在处理器101与存储器102间，能实现处理器101与存储器102的信息交互，其包括但不限于数据总线(Bus)等。
在一些实施例中，处理器101、存储器102和I/O接口103通过总线104相互连接，进而与计算设备的其它组件连接。
第四方面，参照图7，本公开实施例提供一种服务器，其包括：一个或多个处理器201；存储器202，其上存储有一个或多个计算机程序，一个或多个计算机程序被一个或多个处理器执行，使得一个或多个处理器实现本公开实施例第二方面所述的多媒体控制方法；一个或多个I/O接口203，连接在处理器与存储器之间，配置为实现处理器与存储器的信息交互。
其中，处理器201为具有数据处理能力的器件，其包括但不限于中央处理器(CPU)等；存储器202为具有数据存储能力的器件，其包括但不限于随机存取存储器(RAM，更具体如SDRAM、DDR等)、只读存储器(ROM)、带电可擦可编程只读存储器(EEPROM)、闪存(FLASH)；I/O接口(读写接口)203连接在处理器201与存储器202间，能实现处理器201与存储器202的信息交互，其包括但不限于数据总线(Bus)等。
在一些实施例中，处理器201、存储器202和I/O接口203通过总线204相互连接，进而与计算设备的其它组件连接。
第五方面，参照图8，本公开实施例提供一种计算机可读存储介质，其上存储有计算机程序，计算机程序被处理器执行以实现以下方法中的至少一者：本公开实施例第一方面所述的多媒体控制方法；本 公开实施例第二方面所述的多媒体控制方法。
为了使本领域技术人员能够更清楚地理解本公开实施例提供的技术方案，下面通过具体的实施例，对本公开实施例提供的技术方案进行详细说明：
实施例1
本实施例以线上教学为例进行说明。
(1)老师和学生通过终端承载的通用APP登录，终端可以是手机、智能电视、机顶盒等，服务器根据账号身份下发控制权限。老师的权限比学生的多，且对于相同开关的控制，老师拥有更高的权限。
(2)上课后老师和学生可通过服务器对多媒体通道进行开关控制，若学生开启了某项功能，老师可直接关闭学生的该功能，例如学生未关闭语音，老师可直接禁言学生。随后开启多媒体通道的老师和学生的音视频数据流将被传输到服务器进行渲染和编解码等操作，再分发到各个终端。
(3)学生也可以主动打开自己的音视频开关，进行提问或发言、板书，发言完毕可自主关闭音视频开关，老师也可以中途关闭其音视频信号。
(4)课堂结束后，老师可主动结束线上课堂，该课堂所有成员自动退出该节课；若老师忘记结束课堂，在老师退出后课堂后，会自动解散该节课内所有成员。
在本实施例中，老师和学生通过通用APP登录服务器，通用APP所在的物理终端仅需具有音视频信号采集功能。对于用户来说无需下载各个厂家的APP从而使用其教学功能，只需要通过本实施例的通用APP登录，即可使用系统中集成的多款应用程序进行互动教学，而集成的这些应用程序需要具备本身的功能，其他功能交给本实施例中的服务器，大大增加了教学的可扩展性和可用于教学的软件的易用性。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物 理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器(如中央处理器、数字信号处理器或微处理器)执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其它数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其它存储器技术、CD-ROM、数字多功能盘(DVD)或其它光盘存储、磁盒、磁带、磁盘存储或其它磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其它的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其它传输机制之类的调制数据信号中的其它数据，并且可包括任何信息递送介质。
本文已经公开了示例实施例，并且虽然采用了具体术语，但它们仅用于并仅应当被解释为一般说明性含义，并且不用于限制的目的。在一些实例中，对本领域技术人员显而易见的是，除非另外明确指出，否则与特定实施例相结合描述的特征、特性和/或元素可单独使用，或可与结合其它实施例描述的特征、特性和/或元件组合使用。因此，本领域技术人员将理解，在不脱离由所附的权利要求阐明的本公开的范围的情况下，可进行各种形式和细节上的改变。

Claims (20)

  1. 一种多媒体控制方法，应用于终端，包括：
    响应于集成在多媒体系统中的应用程序运行，生成多媒体数据流；以及
    通过当前终端的多媒体通道将所述多媒体数据流传输到服务器，以使所述服务器分发所述多媒体数据流。
  2. 根据权利要求1所述的多媒体控制方法，其中，生成多媒体数据流，包括：
    采集音频数据流；和/或
    采集视频数据流；和/或
    生成共享所述应用程序界面的数据流。
  3. 根据权利要求1或2所述的多媒体控制方法，还包括：
    向所述服务器发送控制指令，其中，所述控制指令用于对至少一个终端的多媒体通道进行控制。
  4. 根据权利要求3所述的多媒体控制方法，其中，终端的多媒体通道包括接收通道和发送通道，向所述服务器发送控制指令，包括：
    向所述服务器发送对至少一个终端的接收通道和/或发送通道进行控制的控制指令。
  5. 根据权利要求4所述的多媒体控制方法，其中，向服务器发送的控制指令与当前终端的控制权限相对应。
  6. 根据权利要求1或2所述的多媒体控制方法，其中，所述终端为手机、电视、机顶盒中的任意一者。
  7. 一种多媒体控制方法，应用于服务器，包括：
    接收终端通过多媒体通道传输的多媒体数据流，其中，所述终端响应于集成在多媒体系统中的应用程序运行，生成所述多媒体数据流；以及
    将所述多媒体数据流分发到至少一个目标终端。
  8. 根据权利要求7所述的多媒体控制方法，其中，所述多媒体控制方法还包括：
    接收多个终端中的至少一者发送的控制指令；以及
    根据所述控制指令对至少一个所述终端的多媒体通道进行控制。
  9. 根据权利要求8所述的多媒体控制方法，其中，所述终端的多媒体通道包括接收通道和发送通道，根据所述控制指令对至少一个所述终端的多媒体通道进行控制，包括：
    根据所述控制指令，对至少一个所述终端的接收通道和/或发送通道进行控制。
  10. 根据权利要求9所述的多媒体控制方法，其中，所述终端的控制指令与所述终端的控制权限相对应。
  11. 根据权利要求10所述的多媒体控制方法，其中，多个所述终端包括至少一个第一终端和至少一个第二终端；根据所述控制指令，对至少一个所述终端的接收通道和/或发送通道进行控制，包括：
    根据所述第一终端的控制指令，开启或关闭所述第一终端自身的接收通道；和/或
    根据所述第一终端的控制指令，开启或关闭所述第一终端自身的发送通道；和/或
    根据所述第一终端的控制指令，开启或关闭所述控制指令指向的至少一个第二终端的接收通道；和/或
    根据所述第一终端的控制指令，开启或关闭所述控制指令指向的至少一个第二终端的发送通道；和/或
    根据所述第二终端的控制指令，开启或关闭所述第二终端自身的接收通道；和/或
    根据所述第二终端的控制指令，开启或关闭所述第二终端自身的发送通道；
    其中，所述第一终端的控制权限高于所述第二终端的控制权限。
  12. 根据权利要求11所述的多媒体控制方法，其中，当接收到第一终端的控制指令和第二终端的控制指令、且所述第二终端的控制指令指向的多媒体通道为所述第一终端的控制指令指向的多媒体通道的子集时，执行所述第一终端的控制指令。
  13. 根据权利要求7至12中任意一项所述的多媒体控制方法，其中，将所述多媒体数据流分发到至少一个目标终端，包括：
    对所述多媒体数据流进行处理，并传输到至少一个目标终端。
  14. 根据权利要求13所述的多媒体控制方法，其中，对所述多媒体数据流进行处理，包括：
    对所述多媒体数据流进行渲染、编解码处理。
  15. 根据权利要求7至12中任意一项所述的多媒体控制方法，其中，所述多媒体数据流包括音频数据流、视频数据流、共享应用程序界面的数据流中的至少一者。
  16. 根据权利要求7至12中任意一项所述的多媒体控制方法，还包括：
    根据所述终端对应的用户身份，向所述终端下发控制权限。
  17. 根据权利要求7至12中任意一项所述的多媒体控制方法，还包括：
    响应于第一终端发送的结束指令，控制第二终端下线；或
    响应于所述第一终端下线，控制所述第二终端下线；
    其中，多个所述终端包括至少一个第一终端和至少一个第二终端，所述第一终端的控制权限高于所述第二终端的控制权限。
  18. 一种终端，包括：
    一个或多个处理器；
    存储器，其上存储有一个或多个计算机程序，所述一个或多个计算机程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现根据权利要求1至6中任意一项所述的多媒体控制方法。
  19. 一种服务器，包括：
    一个或多个处理器；
    存储器，其上存储有一个或多个计算机程序，所述一个或多个计算机程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现根据权利要求7至17中任意一项所述的多媒体控制方法。
  20. 一种计算机可读存储介质，其上存储有计算机程序，所述程序被处理器执行以实现根据权利要求1至17中任意一项所述的多媒体控制方法。
PCT/CN2023/100111 2022-06-24 2023-06-14 多媒体控制方法、终端、服务器、存储介质 WO2023246575A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210730382.8 2022-06-24
CN202210730382.8A CN115002399A (zh) 2022-06-24 2022-06-24 多媒体控制方法、终端、服务器、计算机可读介质

Publications (1)

Publication Number Publication Date
WO2023246575A1 true WO2023246575A1 (zh) 2023-12-28

Family

ID=83036091

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/100111 WO2023246575A1 (zh) 2022-06-24 2023-06-14 多媒体控制方法、终端、服务器、存储介质

Country Status (2)

Country Link
CN (1) CN115002399A (zh)
WO (1) WO2023246575A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115002399A (zh) * 2022-06-24 2022-09-02 中兴通讯股份有限公司 多媒体控制方法、终端、服务器、计算机可读介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030050506A (ko) * 2001-12-18 2003-06-25 이경근 인터넷 프로토콜 버전6 멀티캐스트를 이용한 가상 학술회의 시스템
CN101610385A (zh) * 2009-07-16 2009-12-23 中兴通讯股份有限公司 一种无线视频会议的实现系统及方法
CN102572218A (zh) * 2012-01-16 2012-07-11 唐桥科技(杭州)有限公司 基于网络视频会议系统的视频标注方法
CN102883135A (zh) * 2012-11-01 2013-01-16 成都飞视美视频技术有限公司 屏幕共享及控制方法
CN112954256A (zh) * 2021-01-29 2021-06-11 深圳壹秘科技有限公司 会议控制方法、装置、系统及计算机可读存储介质
CN114268761A (zh) * 2021-12-22 2022-04-01 北京达佳互联信息技术有限公司 会议控制方法、装置、电子设备、存储介质和程序产品
CN115002399A (zh) * 2022-06-24 2022-09-02 中兴通讯股份有限公司 多媒体控制方法、终端、服务器、计算机可读介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102625078B (zh) * 2012-03-08 2014-08-13 华为技术有限公司 一种远程会议控制方法、终端设备、mcu及视讯系统
JP2016006951A (ja) * 2014-05-28 2016-01-14 株式会社リコー 伝送管理システム、伝送システム、中継装置の選択方法、プログラム、及びメンテナンスシステム
CN108989737B (zh) * 2017-07-18 2020-03-20 视联动力信息技术股份有限公司 一种数据播放方法、装置和电子设备
CN111327910A (zh) * 2020-01-21 2020-06-23 广州虎牙科技有限公司 应用程序的操作控制方法、装置、设备及存储介质

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030050506A (ko) * 2001-12-18 2003-06-25 이경근 인터넷 프로토콜 버전6 멀티캐스트를 이용한 가상 학술회의 시스템
CN101610385A (zh) * 2009-07-16 2009-12-23 中兴通讯股份有限公司 一种无线视频会议的实现系统及方法
CN102572218A (zh) * 2012-01-16 2012-07-11 唐桥科技(杭州)有限公司 基于网络视频会议系统的视频标注方法
CN102883135A (zh) * 2012-11-01 2013-01-16 成都飞视美视频技术有限公司 屏幕共享及控制方法
CN112954256A (zh) * 2021-01-29 2021-06-11 深圳壹秘科技有限公司 会议控制方法、装置、系统及计算机可读存储介质
CN114268761A (zh) * 2021-12-22 2022-04-01 北京达佳互联信息技术有限公司 会议控制方法、装置、电子设备、存储介质和程序产品
CN115002399A (zh) * 2022-06-24 2022-09-02 中兴通讯股份有限公司 多媒体控制方法、终端、服务器、计算机可读介质

Also Published As

Publication number Publication date
CN115002399A (zh) 2022-09-02

Similar Documents

Publication Publication Date Title
CN109658932B (zh) 一种设备控制方法、装置、设备及介质
WO2020168499A1 (zh) 一种同屏教学方法、装置和系统、智能设备及存储介质
US9466222B2 (en) System and method for hybrid course instruction
CN110874959B (zh) 一种多终端同屏教学系统及教学方法
US8441515B2 (en) Method and apparatus for minimizing acoustic echo in video conferencing
WO2023246575A1 (zh) 多媒体控制方法、终端、服务器、存储介质
US20120017149A1 (en) Video whisper sessions during online collaborative computing sessions
US8447809B2 (en) System and method for network conference
CN110198478B (zh) 交互录播方法、系统、客户端、装置、设备及存储介质
CN101477754A (zh) 一种无线课堂系统
CN108259922B (zh) 一种互动直播方法、装置及系统
CN111447391A (zh) 会议数据同步方法、装置、计算机设备及存储介质
CN112616066A (zh) 一种基于直播的小组讨论系统及方法
US20130189664A1 (en) Method and apparatus for providing media stream switching based interactive lecture service, and receiving method and apparatus
WO2022193994A1 (zh) 基于多设备的在线互动方法、芯片、电子设备及存储介质
CN110570701A (zh) 一种同步视频的双向语音互动教学系统及方法
US20220308825A1 (en) Automatic toggling of a mute setting during a communication session
CN106210018A (zh) 多媒体传输方法、装置及多媒体盒子
CN113345281A (zh) 智慧教学系统
WO2019210667A1 (zh) 屏幕画面传输方法、装置、服务器、系统及存储介质
US11562761B2 (en) Methods and apparatus for enhancing musical sound during a networked conference
Coccoli Using web-radio in mobile-learning
CN109561319A (zh) 基于旁路的在线教育高并发直播方法及系统
CN112910827B (zh) 多方互动系统，方法、装置、电子设备及存储介质
US20170168661A1 (en) Method for playing multiple channels of streaming media and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23826224

Country of ref document: EP

Kind code of ref document: A1