CN112822433A - Control method and related device in video conference - Google Patents

Control method and related device in video conference Download PDF

Info

Publication number
CN112822433A
CN112822433A CN202110416620.3A CN202110416620A CN112822433A CN 112822433 A CN112822433 A CN 112822433A CN 202110416620 A CN202110416620 A CN 202110416620A CN 112822433 A CN112822433 A CN 112822433A
Authority
CN
China
Prior art keywords
terminal equipment
video conference
time
terminal device
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110416620.3A
Other languages
Chinese (zh)
Other versions
CN112822433B (en
Inventor
陈祥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202110416620.3A priority Critical patent/CN112822433B/en
Publication of CN112822433A publication Critical patent/CN112822433A/en
Application granted granted Critical
Publication of CN112822433B publication Critical patent/CN112822433B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/152Multipoint control units therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/155Conference systems involving storage of or access to video conference sessions

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the application provides a control method and a related device in a video conference, and is applied to the technical field of terminals. The method comprises the following steps: the first terminal equipment and the second terminal equipment are accessed to the video conference through the server; the server monitors the respective states of the first terminal equipment and the second terminal equipment; when the server determines that the first terminal equipment meets a first preset condition, the server records first time; when the server determines that the first terminal equipment meets a second preset condition, the server sends first recorded content in the video conference to the first terminal equipment from a first time to a second time, wherein the second time is the time when the first terminal equipment meets the second preset condition; the first terminal device displays a first interface including the first recorded content and the ongoing content of the video conference. Therefore, the server pushes the conference content of the video conference of the first terminal device during the first preset condition, so that a user can conveniently obtain the conference content, and the quality of the video conference is improved.

Description

Control method and related device in video conference
Technical Field
The present application relates to the field of terminal technologies, and in particular, to a control method and a related apparatus in a video conference.
Background
Video conferencing is a multimedia communication technology that enables real-time, visual, and interactive communication over some transmission medium. With the development of the internet technology, the video conference has abundant functions, and not only can the transmission of audio and video, but also the transmission of auxiliary video can be realized through the dual-video stream transmission technology.
However, when the video conference is in progress, the participants of the video conference may not be able to view the video content in normal progress for active or passive reasons, wherein the reasons may be that the participants are not in front of the conference screen currently, the network quality is poor, and the like.
Disclosure of Invention
The embodiment of the application provides a control method and a related device in a video conference, when a user returns to a terminal device or connection between the terminal device and a server is recovered, the server can push conference content of the video conference during the leaving period or the disconnection period of the user to the terminal device, the user can conveniently obtain the conference content, and the quality of the video conference is improved.
In a first aspect, an embodiment of the present application provides a control method in a video conference, which is applied to a video conference system, where the video conference system includes a server, a first terminal device, and a second terminal device, and the method includes: the first terminal equipment and the second terminal equipment are accessed to the video conference through the server; the server monitors the respective states of the first terminal equipment and the second terminal equipment; when the server determines that the first terminal equipment meets a first preset condition, the server records first time when the first terminal equipment meets the first preset condition; the server sends information used for indicating that the first terminal equipment meets a first preset condition to the second terminal equipment; the second terminal equipment displays information for prompting that the first terminal equipment meets a first preset condition; when the server determines that the first terminal equipment meets a second preset condition, the server sends first recorded content in the video conference to the first terminal equipment from a first time to a second time, wherein the second time is the time when the first terminal equipment meets the second preset condition; the first terminal device displays a first interface, wherein the first interface comprises the first recorded content and the ongoing content of the video conference.
Therefore, the server monitors the respective states of the first terminal device and the second terminal device and sends the recorded content meeting the first condition to the second condition to the first terminal device, so that a user can obtain the conference content of the first terminal device from the first time to the second time in the conference process, the integrity of the video conference process is guaranteed, the quality of the video conference is improved, and the user experience is improved. The server also sends information indicating that the first terminal equipment meets the first preset condition to the second terminal equipment, and informs the second terminal equipment of the state of the first terminal equipment.
Optionally, the first terminal device meeting the first preset condition includes: the method comprises the steps that a person is not detected in front of a screen of a first terminal device; the first terminal equipment meeting the second preset condition comprises the following steps: a person is detected in front of a screen of the first terminal device.
Therefore, the user of the first terminal device can obtain the conference content when the user leaves, the integrity of the video conference process is ensured, and the quality of the video conference is improved.
Optionally, before the server determines that the first terminal device meets the second preset condition, the method further includes: the server controls the first terminal device to screen; and/or the server does not send the content of the video conference to the first terminal equipment; and/or the server controls the first terminal device to mute.
Therefore, the leakage of the conference content of the video conference during the leaving of the user can be avoided, and the security of the conference is improved. The first terminal equipment is muted, so that non-conference sound can be prevented from being transmitted into the equipment, and the experience effect of users of other terminal equipment is improved.
Optionally, the first terminal device meeting the first preset condition includes: the network quality of the first terminal equipment does not meet the condition; the first terminal equipment meeting the second preset condition comprises the following steps: the network quality of the first terminal device meets the condition.
Therefore, the user of the first terminal device can obtain the conference content when the network quality does not meet the conditions, the integrity of the video conference process is ensured, and the quality of the video conference is improved.
Optionally, the video conference system further includes a third terminal device, and the method further includes: the third terminal equipment is accessed to the video conference at the time later than the video conference starting time; the server sends a second recording content to the third terminal device, wherein the second recording content is as follows: and recording the content in the video conference from the video conference starting time to the time when the third terminal equipment accesses the video conference.
Therefore, the user who accesses the conference later can obtain the conference content when the conference is not accessed, the integrity of the video conference process is ensured, and the quality of the video conference is improved.
Optionally, a conference user list of the video conference is stored in the server, and the method further includes: the server determines that the fourth terminal equipment does not access the video conference at the video conference starting time according to the conference participating user list; and when the server determines that the fourth terminal equipment is accessed to the video conference, the server sends a third recorded content to the fourth terminal equipment, wherein the third recorded content is the recorded content in the video conference from the video conference starting time to the time when the fourth terminal equipment is accessed to the video conference.
Therefore, the server can determine the terminal equipment which is accessed to the conference later, so that the user who is accessed to the conference later can obtain the conference content when the conference is not accessed, the integrity of the video conference process is ensured, and the quality of the video conference is improved.
Optionally, the recorded content is automatically played in the first terminal device by default; the method further comprises the following steps: the method comprises the steps that first terminal equipment receives first operation of a user on recorded content; the first operation includes one of: the operation for triggering the playing of the recorded content, the operation for triggering the recording suspension, the operation for triggering the adjustment of the progress of the recorded content, the operation for triggering the adjustment of the playing speed of the recorded content or the operation for triggering the adjustment of the volume of the recorded content; the first terminal device performs a step corresponding to the first operation.
Therefore, the user can conveniently select the proper time to play the conference content in different modes.
Optionally, when the first terminal device receives the multiple recorded contents from the server, the first terminal device displays a list including identifiers of the multiple recorded contents; and when the first terminal equipment receives the trigger of any identifier in the list, the first terminal equipment displays the recorded content corresponding to any identifier.
Therefore, the user can select the missed video conference content conveniently according to the recording content list.
Optionally, when the server determines that the number of times that the first terminal device meets the first preset condition is greater than the number threshold, the server sends the complete recorded content of the video conference to the first terminal device; or when the server determines that the ratio is greater than the ratio threshold, the server sends the complete recorded content of the video conference to the first terminal equipment; the ratio is the ratio of the time length of the first terminal equipment meeting the first preset condition to the total time length of the video conference; or when the server determines that the interval duration of the first terminal device meeting the first preset condition is less than the interval threshold, the server sends the continuously recorded content segment to the first terminal device, wherein the continuously recorded content segment is the complete recorded content corresponding to the first terminal device when the first terminal device is in the period meeting the first preset condition for multiple adjacent times.
Therefore, the number of recorded contents displayed by the terminal equipment can be reduced, and users can be prevented from missing video conference contents. Moreover, the recorded content is continuous, so that the user can conveniently obtain the conference information, and the conference quality is improved.
Optionally, when the video conference is ended, the server sends a message for indicating whether to store the recorded content to the first terminal device; the first terminal equipment displays a second interface, wherein the second interface comprises a control for determining the stored and recorded content and a control for canceling the stored and recorded content; when the first terminal equipment receives the trigger of a control for determining to store the recorded content, the first terminal equipment stores the recorded content; or when the first terminal equipment receives the trigger of the control for canceling the saving of the recorded content, the first terminal equipment discards the recorded content.
Therefore, after the video conference, the user can obtain the video conference content through the recording content pushed by the terminal equipment.
Optionally, the first time is a first time or a certain time before and after the first time, and the second time is a second time or a certain time before and after the second time.
In a second aspect, an embodiment of the present application provides a control method in a video conference, which is applied to a terminal device, and the method includes: the first terminal equipment accesses the video conference through the server; the first terminal equipment receives first recorded content from a server; the first recorded content is the content of a video conference from a first time to a second time; the first time is the time when the first terminal equipment meets a first preset condition, and the second time is the time when the first terminal equipment meets a second preset condition; the first device displays a first interface, which includes the first recorded content and the ongoing content of the video conference.
Optionally, the first terminal device meeting the first preset condition includes: the method comprises the steps that a person is not detected in front of a screen of a first terminal device; the first terminal equipment meeting the second preset condition comprises the following steps: a person is detected in front of a screen of the first terminal device.
Optionally, before the first terminal device meets the second preset condition, the method further includes: the first terminal equipment screens; and/or the first terminal device does not display the content of the video conference; and/or the first terminal device mutes.
Optionally, the first terminal device meeting the first preset condition includes: the network quality of the first terminal equipment does not meet the condition; the first terminal equipment meeting the second preset condition comprises the following steps: the network quality of the first terminal device meets the condition.
Optionally, when the first terminal device accesses the video conference at a time later than the start time of the video conference, the first terminal device receives a second recording content from the server, where the second recording content is: recording content in the video conference from the video conference start time to the time when the first terminal device accesses the video conference.
Optionally, the recorded content is automatically played in the first terminal device by default; the method further comprises the following steps: the method comprises the steps that first terminal equipment receives first operation of a user on recorded content; the first operation includes one of: the operation for triggering the playing of the recorded content, the operation for triggering the recording suspension, the operation for triggering the adjustment of the progress of the recorded content, the operation for triggering the adjustment of the playing speed of the recorded content or the operation for triggering the adjustment of the volume of the recorded content; the first terminal device performs a step corresponding to the first operation.
Optionally, when the first terminal device receives the multiple recorded contents from the server, the first terminal device displays a list including identifiers of the multiple recorded contents; and when the first terminal equipment receives the trigger operation of any identifier in the list, the first terminal equipment displays the recorded content corresponding to any identifier.
Optionally, the first terminal device receives a complete recorded content of the video conference from the server; or the first terminal device receives a continuous recording content segment from the server, wherein the continuous recording content segment is a complete recording content corresponding to the first terminal device when the first terminal device is in a period satisfying a first preset condition for a plurality of adjacent times.
Optionally, when the video conference is ended, the first terminal device receives a message from the server to indicate whether to save the recorded content; the first terminal equipment displays a second interface, wherein the second interface comprises a control for determining the stored and recorded content and a control for canceling the stored and recorded content; when the first terminal equipment receives a trigger operation of a control for determining to store the recorded content, the first terminal equipment stores the recorded content; or when the first terminal equipment receives the trigger operation of the control for canceling the recorded content, the first terminal equipment discards the recorded content.
Optionally, the first time is a first time or a certain time before and after the first time, and the second time is a second time or a certain time before and after the second time.
In a third aspect, an embodiment of the present application provides a control method in a video conference, which is applied to a server, and the method includes: the server coordinates the first terminal equipment and the second terminal equipment to access the video conference; the server monitors the respective states of the first terminal equipment and the second terminal equipment; when the server determines that the first terminal equipment meets a first preset condition, the server records first time when the first terminal equipment meets the first preset condition; the server sends information used for indicating that the first terminal equipment meets a first preset condition to the second terminal equipment; when the server determines that the first terminal equipment meets a second preset condition, the server sends first recorded content in the video conference to the first terminal equipment from a first time to a second time, wherein the second time is the time when the first terminal equipment meets the second preset condition;
optionally, the first terminal device meeting the first preset condition includes: the method comprises the steps that a person is not detected in front of a screen of a first terminal device; the first terminal equipment meeting the second preset condition comprises the following steps: a person is detected in front of a screen of the first terminal device.
Optionally, before the server determines that the first terminal device meets the second preset condition, the method further includes: the server controls the first terminal device to screen; and/or the server does not send the content of the video conference to the first terminal equipment; and/or the server controls the first terminal device to mute.
Optionally, the first terminal device meeting the first preset condition includes: the network quality of the first terminal equipment does not meet the condition; the first terminal equipment meeting the second preset condition comprises the following steps: the network quality of the first terminal device meets the condition.
Optionally, the method further comprises: the server sends a second recording content to a third terminal device, the third terminal device is a terminal device which is accessed to the video conference at a time later than the video conference starting time, and the second recording content is as follows: and recording the content in the video conference from the video conference starting time to the time when the third terminal equipment accesses the video conference.
Optionally, a conference user list of the video conference is stored in the server, and the method further includes: the server determines that the fourth terminal equipment does not access the video conference at the video conference starting time according to the conference participating user list; when the server determines that the fourth terminal device is accessed to the video conference, the server sends a third recording content to the fourth terminal device, wherein the third recording content is as follows: and recording contents in the video conference from the video conference starting time to the time when the fourth terminal equipment accesses the video conference.
Optionally, when the server determines that the number of times that the first terminal device meets the first preset condition is greater than the number threshold, the server sends the complete recorded content of the video conference to the first terminal device; or when the server determines that the ratio is greater than the ratio threshold, the server sends the complete recorded content of the video conference to the first terminal equipment; the ratio is the ratio of the time length of the first terminal equipment meeting the first preset condition to the total time length of the video conference; or when the server determines that the interval duration of the first terminal device meeting the first preset condition is less than the interval threshold, the server sends the continuously recorded content segment to the first terminal device, wherein the continuously recorded content segment is the complete recorded content corresponding to the first terminal device when the first terminal device is in the period meeting the first preset condition for multiple adjacent times.
Optionally, when the video conference is ended, the server sends a message indicating whether to save the recorded content to the first terminal device.
Optionally, the first time is a first time or a certain time before and after the first time, and the second time is a second time or a certain time before and after the second time.
In a fourth aspect, an embodiment of the present application provides a control system for a video conference, including the first terminal device and the second terminal device of the first aspect, and the server of the first aspect, where the system may perform the method of the first aspect.
In a fifth aspect, an embodiment of the present application provides a terminal device, including: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer executable instructions stored by the memory to cause the processor to perform the method of the second aspect described above.
In a sixth aspect, an embodiment of the present application provides a server, including: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer executable instructions stored by the memory to cause the processor to perform the method of the third aspect described above.
In a seventh aspect, embodiments of the present application provide a computer program product containing instructions, which when run on a computer, cause the computer to perform the method of the second or third aspect.
In an eighth aspect, embodiments of the present application provide a computer-readable storage medium having stored therein instructions, which, when executed on a computer, cause the computer to perform the method of the second or third aspect.
Drawings
Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application;
fig. 2 is a schematic view of a video conference interface provided in an embodiment of the present application;
fig. 3 is a schematic diagram of a hardware system architecture of a terminal device according to an embodiment of the present disclosure;
fig. 4 is a schematic flowchart of a control method in a video conference according to an embodiment of the present application;
fig. 5 is a timing diagram of a video conference provided in an embodiment of the present application;
fig. 6 is a schematic view of a video conference interface provided in an embodiment of the present application;
fig. 7 is a schematic view of a display interface of a terminal a according to an embodiment of the present disclosure;
fig. 8 is a schematic view of a display interface of a terminal a according to an embodiment of the present disclosure;
fig. 9 is a schematic view of a display interface of a terminal a according to an embodiment of the present disclosure;
fig. 10 is a schematic view of a display interface of a terminal a according to an embodiment of the present disclosure;
fig. 11 is a schematic view of a display interface of a terminal B according to an embodiment of the present disclosure;
fig. 12 is a schematic display interface diagram of a terminal C according to an embodiment of the present disclosure;
fig. 13 is a schematic view of a video conference interface provided in an embodiment of the present application;
fig. 14 is a schematic structural diagram of hardware of a relevant device in a video conference according to an embodiment of the present application.
Detailed Description
In the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same or similar items having substantially the same function and action. For example, the first device and the second device are only used for distinguishing different devices, and the sequence order thereof is not limited. Those skilled in the art will appreciate that the terms "first," "second," etc. do not denote any order or quantity, nor do the terms "first," "second," etc. denote any order or importance.
It is noted that, in the present application, words such as "exemplary" or "for example" are used to mean exemplary, illustrative, or descriptive. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
It should be noted that the network architecture and the service scenario described in the embodiment of the present application are for more clearly illustrating the technical solution of the embodiment of the present application, and do not constitute a limitation to the technical solution provided in the embodiment of the present application, and it is known by a person skilled in the art that the technical solution provided in the embodiment of the present application is also applicable to similar technical problems along with the evolution of the network architecture and the appearance of a new service scenario.
The control method in the video conference according to the embodiment of the present application can be applied to an electronic device with a communication function, where the electronic device includes a terminal device, and the terminal device may also be referred to as a terminal (terminal), a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), and the like. The terminal device may be a mobile phone (mobile phone), a smart television (or called a large screen or a smart screen), a wearable device, a tablet computer (Pad), a computer with a wireless transceiving function, a Virtual Reality (VR) terminal device, an Augmented Reality (AR) terminal device, a wireless terminal in industrial control (industrial control), a wireless terminal in self-driving (self-driving), a wireless terminal in remote surgery (remote management), a wireless terminal in smart grid (smart grid), a wireless terminal in transportation safety (transportation safety), a wireless terminal in smart city (smart city), a wireless terminal in smart home (smart home), and so on. The embodiment of the present application does not limit the specific technology and the specific device form adopted by the terminal device.
Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application, as shown in fig. 1, fig. 1 includes a server 101 and a terminal device. The terminal devices may include a desktop 1021, a notebook 1022, a cellular phone 1023, a tablet 1024, and the like. The terminal devices may be two or more. The number and the structure of the terminal devices are not limited in the embodiment of the application.
The user can connect to the server 101 through any terminal device of the desktop 1021, the notebook computer 1022, the mobile phone 1023 or the tablet computer 1024, log in the user interface at any terminal device, and perform a video conference with users of other terminal devices through the server 101.
Fig. 2 is a schematic view of a video conference interface provided in an embodiment of the present application. The video conference interface includes: current video conference content 201, participant list 202, and settings 203. The current video conference content 201 is used for displaying pictures shared by other clients, or pictures recorded in real time, and the shared pictures may include a PPT interface, a word interface, a video interface, and the like. Participant list 202 is used to display participant information, such as names of participants. The setting items 203 may include one or more of the following: mute, speaker, video, share, chat, more, away, or other types of settings.
In order to better understand the embodiments of the present application, the following describes a structure of a terminal device according to the embodiments of the present application:
fig. 3 shows a schematic diagram of a hardware system architecture of a terminal device. The terminal device may include: radio Frequency (RF) circuit 310, memory 320, input unit 330, display unit 340, sensor 350, audio circuit 360, wireless fidelity (WiFi) module 370, processor 380, power supply 390, and bluetooth module 3100. Those skilled in the art will appreciate that the terminal device configuration shown in fig. 3 does not constitute a limitation of the terminal device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following specifically describes each constituent component of the terminal device with reference to fig. 3:
the RF circuit 310 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, receives downlink information of a base station and then processes the received downlink information to the processor 380; in addition, the data for designing uplink is transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, RF circuit 310 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to global system for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, and Short Message Service (SMS).
The memory 320 may be used to store software programs and modules, and the processor 380 executes various functional applications and data processing of the terminal device by operating the software programs and modules stored in the memory 320. The memory 320 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, a boot loader (boot loader), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the terminal device, and the like. Further, the memory 320 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. It is understood that, in the embodiment of the present application, the memory 320 stores a program for the bluetooth device to connect back.
The input unit 330 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the terminal device. Specifically, the input unit 330 may include a touch panel 331 and other input devices 332. The touch panel 331, also referred to as a touch screen, can collect touch operations of a user (e.g., operations of the user on the touch panel 331 or near the touch panel 331 using any suitable object or accessory such as a finger, a stylus, etc.) on or near the touch panel 331, and drive the corresponding connection device according to a preset program.
Alternatively, the touch panel 331 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 380, and can receive and execute commands sent by the processor 380. In addition, the touch panel 331 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 330 may include other input devices 332 in addition to the touch panel 331. In particular, other input devices 332 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 340 may be used to display information input by a user or information provided to the user and various menus of the terminal device. The display unit 340 may include a display panel 341, and optionally, the display panel 341 may be configured in the form of a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), or the like. Further, the touch panel 331 can cover the display panel 341, and when the touch panel 331 detects a touch operation on or near the touch panel 331, the touch panel is transmitted to the processor 380 to determine the type of the touch event, and then the processor 380 provides a corresponding visual output on the display panel 341 according to the type of the touch event. Although in fig. 3, the touch panel 331 and the display panel 341 are two separate components to implement the input and output functions of the terminal device, in some embodiments, the touch panel 331 and the display panel 341 may be integrated to implement the input and output functions of the terminal device.
The terminal device may also include at least one sensor 350, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel 341 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 341 or backlight when the terminal device is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration) for recognizing the attitude of the terminal device, and related functions (such as pedometer and tapping) for vibration recognition; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal device, detailed description is omitted here.
Audio circuitry 360, speaker 361, microphone 362 may provide an audio interface between the user and the terminal device. The audio circuit 360 may transmit the electrical signal converted from the received audio data to the speaker 361, and the audio signal is converted by the speaker 361 and output; on the other hand, the microphone 362 converts the collected sound signal into an electrical signal, which is received by the audio circuit 360 and converted into audio data, which is then processed by the audio data output processor 380 and then transmitted to, for example, another terminal device via the RF circuit 310, or output to the memory 320 for further processing.
WiFi belongs to short-distance wireless transmission technology, and the terminal equipment can help users to send and receive e-mails, browse webpages, access streaming media and the like through the WiFi module 370, and provides wireless broadband internet access for the users. Although fig. 3 shows the WiFi module 370, it is understood that it does not belong to the essential constitution of the terminal device, and may be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 380 is a control center of the terminal device, connects various parts of the whole terminal device by using various interfaces and lines, and performs various functions of the terminal device and processes data by running or executing software programs or modules stored in the memory 320 and calling data stored in the memory 320, thereby performing overall monitoring of the terminal device. Optionally, processor 380 may include one or more processing units; preferably, the processor 380 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 380. It is understood that in the embodiment of the present application, the memory 320 stores a program for bluetooth device loopback, and the processor 380 can be configured to call and execute the program for bluetooth device loopback stored in the memory 320, so as to implement the method for bluetooth device loopback in the embodiment of the present application.
The terminal device also includes a power supply 390 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 380 via a power management system to manage charging, discharging, and power consumption management functions via the power management system.
The Bluetooth technology belongs to a short-distance wireless transmission technology, and the terminal equipment can establish Bluetooth connection with other terminal equipment with a Bluetooth module through a Bluetooth module 3100, so that data transmission is carried out based on a Bluetooth communication link. The bluetooth module 3100 may be Bluetooth Low Energy (BLE), or a module according to actual needs. It can be understood that, in the case that the terminal device in the embodiment of the present application is a user terminal and a service tool, the terminal device includes a bluetooth module. It is to be understood that the bluetooth module does not belong to the essential constitution of the terminal device and may be omitted entirely as needed within the scope not changing the essence of the invention, for example, the bluetooth module may not be included in the server.
Although not shown, the terminal device may further include a camera. Optionally, the position of the camera on the terminal device may be front-located, rear-located, or built-in (the camera body may be extended when in use), which is not limited in this embodiment of the present application.
Optionally, the terminal device may include a single camera, a dual camera, or a triple camera, and the like, which is not limited in this embodiment. Cameras include, but are not limited to, wide angle cameras, tele cameras, or depth cameras, among others.
For example, the terminal device may include three cameras, one being a main camera, one being a wide camera, and one being a tele camera.
Optionally, when the terminal device includes a plurality of cameras, the plurality of cameras may be all front-mounted, or all built-in, or at least partially front-mounted, or at least partially back-mounted, or at least partially built-in, and the like, which is not limited in this embodiment of the application.
Video conferencing is a multimedia communication technology that enables people in different places to achieve real-time, visual and interactive functions through a certain transmission medium. The video conference can distribute various information such as static or dynamic images, voice, characters or pictures of people to terminal equipment of each user through various communication transmission media, so that geographically dispersed users can exchange information in various modes such as graphics and sound, the understanding capability of multiple parties on contents is improved, and the conference is just like a conference in the same meeting place.
Illustratively, when the device for implementing the video conference is a large screen, the large screen is rich in functions, and not only audio and video transmission but also auxiliary video transmission can be implemented through a dual video streaming technology (i.e., an h.239 protocol). In general, a main video transmits a character image video, an auxiliary video transmits content to be shared, and a plurality of large screens can realize a plurality of auxiliary video functions, namely, a plurality of parties are allowed to simultaneously transmit the auxiliary videos in the same video conference. In addition, the terminal types of large-screen calling are rich, and besides other large screens, the terminal types can also call network communication tools such as mobile phones, pads and instant messaging (Skype).
In a video conference, a large screen or the like terminal device may not be able to present the content of the video conference to the user for some reason. For example, reasons include: the user leaves the terminal equipment, the connection between the terminal equipment and the server is disconnected, and the like. This may result in the user missing the videoconference content.
In view of this, an embodiment of the present application provides a control method in a video conference, where when a user returns to a terminal device or a connection between the terminal device and a server is restored, the server may push conference content of the video conference to the terminal device during a period in which the user leaves or during a period in which the connection is disconnected, so as to facilitate the user to obtain the conference content, and improve quality of the video conference.
A control method in a video conference provided in the embodiment of the present application is described below with reference to fig. 4 to 13.
Fig. 4 is a schematic flowchart of a control method in a video conference according to an embodiment of the present application, and as shown in fig. 4, the method includes: the video conference begins.
S401, the system monitors the multi-access condition.
In the embodiment of the application, the system may be software for implementing a video conference, and the system may be run in a terminal device and a server. The terminal equipment can access the video conference through the system and acquire the relevant information of the corresponding video conference in the server through the system. The related information may include: audio and video information of the video conference, information of conference participants and the like.
In this embodiment, a terminal device running the system may be referred to as a client, and a server running the system may be referred to as a server.
It can be understood that the system monitoring the multiple access condition refers to the server monitoring the access condition of the client, and may also be understood as the server monitoring the access condition of the terminal device. The access situation may include: whether the connection between the terminal equipment and the server is disconnected or not, whether a user is detected in front of a screen of the terminal equipment or not and the like.
In a possible implementation manner, when the system monitors an important event, the system determines that a conference starts, starts a complete recording function, and monitors a multi-access situation in real time. The important event may be the arrival of a scheduled time for the conference, or the detection of sound in a video conference, or the presence of video content in a video conference, etc.
In a possible implementation, the system monitors the multiple access condition from the beginning of the videoconference until the end of the videoconference.
S402, the system monitors whether a certain path enters an abnormal state or not.
In the embodiment of the present application, the abnormal state includes: poor network quality, late user leave and access to the conference, etc. The poor network quality refers to the situation that in the video conference communication process, normal video communication cannot be guaranteed due to network signal delay, jitter, network packet loss, communication abnormity and the like, or the conference effect is poor due to other situations.
User away refers to when the user is not in front of the screen or the user is unable to participate in the video conference. In a possible implementation manner, when the system monitors a preset behavior through a camera in the terminal device or an external camera, it is determined that the user leaves. The preset behavior includes, but is not limited to, the user leaving the screen and the user taking off the headset.
The access meeting time is later than the meeting starting time. In a possible implementation manner, the video conference includes a conference list, and when the video conference starts, a user in the conference list does not access the conference, and the system determines that the path enters an abnormal state. In a possible implementation manner two, the video conference does not include a conference list, the system compares the access time of a certain road with the start time, and if the access time is later than the start time, the system records that the access time of the road is in a normal state, and the access time is not in an abnormal state before. If the access time is earlier than or equal to the start time, the path is in a normal state.
And S403, the system acquires the abnormal state code and the Tnot, and marks the abnormal state code and the Tnot (X path, state Snot and occurrence time Tnot).
The abnormal state code in the embodiment of the application is used for indicating the state of the client, such as normal, poor network, user leaving and the like.
In a possible implementation, different abnormal state codes correspond to different abnormal state scenes. Illustratively, the status identifier of the client in the system is denoted by S. The state of the client may be represented by a different state code. Specifically, S plus =1 represents a normal state of the client, S minus =2 represents an abnormal state of the client, S difference =4 represents a network difference of the client, S away =8 represents a user departure of the client, and the like. S good or S return may also indicate the client normal state.
Therefore, the system can accurately process different abnormal scenes according to different abnormal codes.
Illustratively, the time stamp of the client in the system is denoted by T. Specifically, tfirt represents the time when the client changes to the abnormal state, ttefor represents the time when the client changes to the normal state, and tfirt or ttefor may also represent the time when the client changes to the normal state. T-ion represents the time the client left the state.
In the embodiment of the application, [ X way, state S non, occurrence time T non ] indicates identification information of a system to a client in a non-normal state, X way, state S non, time of changing into the non-normal state is T non.
In a possible implementation manner, when the duration of the abnormal state exceeds a first threshold, the system acquires the abnormal state code and the tney. The first threshold may be in units of seconds, milliseconds, minutes, etc., and, for example, the first threshold may be 3S. The first threshold is not specifically limited in the embodiment of the present application. Therefore, the misjudgment that the client enters the abnormal state can be avoided.
S404, according to the abnormal state code, correspondingly limiting the client side in the path, and broadcasting the state of the client side to other paths for displaying and reminding.
In this embodiment, S404 is an optional step, and the terminal device may not execute S404.
It can be understood that the system can control the client in the abnormal state according to the state code, for example, limit the sound pickup device to continue sound pickup, avoid the non-conference sound from entering the device, and further improve the experience effect of the user of the client in the normal state. In a possible implementation manner, when the system monitors that a user in a certain path leaves, the system limits screen display and/or sound playing of the client in the path. Therefore, the leakage of the conference content of the video conference during the leaving of the user can be avoided, and the security of the conference is improved.
It will be appreciated that the abnormal status code is broadcast to other way display alerts, such as: a pop-up message "XXX left", a list of participants showing the corresponding status identification, etc. Therefore, other ways can know that the way is in the abnormal state and can not communicate and interact with the user at the abnormal state client.
S405, the system monitors that the X path is recovered to a normal state, and records time T positive.
In a possible implementation manner, when the duration of the normal state exceeds the second threshold, the system determines that the X path is restored to the normal state. The second threshold may be in units of seconds, milliseconds, minutes, etc., and, for example, the second threshold may be 3S. The first threshold is not specifically limited in the embodiment of the present application.
In a possible implementation manner, when the abnormal state of a certain path is that the user leaves, the system may monitor that the user and/or the user wears an earphone and the like through a camera of the terminal device to determine that the user returns, and then confirm that the path is restored to the normal state.
In a possible implementation manner, when the abnormal state of a certain path is a network difference, and the system monitors that the network of the path meets the requirements of the video conference, the system confirms that the path is recovered to the normal state.
S406, the system pushes [ TNOT, TNOT ] recording content to the X path, the limitation of the X path is removed, and the state of the content is broadcasted to the reminding removal of other paths.
Correspondingly, when the terminal device does not execute S404, S406 pushes [ TNOT, T is positive ] recording content to X path for the system.
It will be appreciated that the system pushes the recorded content for the period of the abnormal state to the client and removes the reminder that its state is broadcast to other ways. In this way, the user can obtain the missing conference content by viewing the recorded content. And the users of other paths can also acquire the state of the X path according to the state broadcast. The status broadcast may be a display of a reminder at an interface of the client.
It should be noted that the start time of recording the content may be a time when the client enters the abnormal state, or may be a time when the client enters the abnormal state within a certain range. The time within a certain range may be in seconds or milliseconds. The stop time of recording the content may be the time when the client enters the normal state, or the time when the client enters the normal state within a certain range.
In the embodiment of the application, the system can acquire the recorded content through the recording screen, and also can acquire the recorded content in the memory of the server in a copying manner.
In the embodiment of the application, two methods for extracting the recorded content are provided, and one method is to intercept a complete video according to time points in different paths. Illustratively, in the complete video from the beginning of the conference to the end of the conference, the extraction is based on [ Tnot, Tpositive ] time nodes. Another method is that when a certain path enters an abnormal state, the system starts recording at T, and stops recording at T regular time. Illustratively, when the client a and the client B enter the abnormal state, the system records the video conference during the abnormal state of the client a and the abnormal state of the client B, and pushes the recorded content.
In the embodiment of the application, the display modes of the recorded content in the client interface are various. In a possible implementation manner, the recorded content may be displayed on the interface in a picture-in-picture manner, or displayed in a split screen manner occupying a certain area in a floating window manner. Illustratively, the client defaults to a picture-in-picture widget playing the recorded content. The client can also switch the picture-in-picture to a large window to play and record the content, and the small window broadcasts the video conference in a live mode.
It is understood that the client may enter the abnormal state many times, and the system may push the recorded content in the following two ways.
In a possible implementation manner, when a certain path of client enters an abnormal state and returns to a normal state for many times, the system pushes a plurality of recorded contents to the client, and a client interface may display a list of the plurality of recorded contents, so that a user can conveniently select and obtain corresponding contents.
In a second possible implementation manner, when a certain path of client enters an abnormal state for multiple times, and the time of the abnormal state is long, or the time interval between several adjacent abnormal states is short, the system may push the complete recorded content of the client during several adjacent abnormal states to push the complete recorded content. For example, if the client is in an abnormal state at 13:00-13:05 and 13:06-13:08, the system may push 13:00-13:08 of the recorded content to the client.
And S407, controlling the recorded content of [ T NOT, T NOT ] by the X path.
In the embodiment of the present application, [ tno, tnt ] is used to indicate a time interval from tno to tnt, for example: 13:00-13:10.
In the embodiment of the present application, the functions for controlling the recording of the content may include pause, play, fast forward, double speed, and the like. Therefore, the user can conveniently select the proper time to play the conference content in different modes.
In a possible implementation manner, when a conference is finished, a certain path is in an abnormal state, and at a finishing interface of a client of the path, the system pushes recorded content from the path entering the abnormal state to the end of the conference.
In a possible implementation manner, when the conference is finished, the system pushes the complete conference recording content to a plurality of clients and prompts whether to store the content. Therefore, the user can conveniently acquire the conference content through the conference recording after the conference is finished.
The video conference is ended.
In summary, the control method in the video conference provided by the embodiment of the present application is applied to a system, the system monitors the state of the client, records the time when the client enters the abnormal state and marks the state code of the client when the client enters the abnormal state, and the system displays and/or restricts the sound of the client according to the state code of the client, thereby avoiding the leakage of the conference content and increasing the security of the conference. The system informs other clients in the conference of the abnormal client state. When the system monitors that the client side recovers the normal state, the system pushes the conference recording content of the client side in the abnormal state, so that a user can acquire the missing conference content of the client side in the abnormal state in the conference process, the integrity of the video conference process is ensured, the quality of the video conference is improved, and the user experience is improved.
The following describes a control method in the video conference shown in fig. 4 with reference to fig. 5 to 13.
Illustratively, fig. 5 is a timing diagram of a video conference provided in an embodiment of the present application. As shown in fig. 5, the video conference includes 3 clients, which are client a, client B, and client C. Client a, client B, and client C correspond to user 1, user 2, and user 3, respectively.
At time T0, the video conference begins. At time T1, the system monitors the network difference of the client a, marks the state of the client a as S difference, and records T off-time as T1. And the system synchronizes the state information to the normal state client. The state information sent by the system to client B and client C is "client a is diff".
At time T2, the system monitors that user 2 of client B leaves the screen, marks the status of client B as S-away, and records T-away as T2. And controlling the client B in an abnormal state by the system because the state of the client B is S-away. The control means includes, but is not limited to, limiting the display of client B and/or setting the microphone of client B to mute. The system synchronization status information is sent to the client C in the normal state, "client a is S bad, and client B is S away".
At time T3, the system monitors that the network quality of client a is getting better, and the requirements of the video conference are met. The system marks the status of client a as S good and records the time T good as T3. The system sends the recorded content of T1-T3 to client a. And the system synchronizes the state information to the normal state client. The normal clients are client C and client A. The state information sent by the system to the client C is "client a is S good, client B is S away", and the state information sent by the system to the client a is "client B is S away".
In a possible implementation manner, the client does not receive the trigger operation of the user 1, and the client plays the recorded content of T1-T3 in a picture-in-picture mode after 3 s.
At time T4, the system detects user 2 of client B coming back, marks the status of client B as Checko, and records Tworkback as T4. The system sends the recorded content of T2-T4 to client B. And the system synchronizes the state information to the normal state client. The normal clients are client C and client A. The state information sent by the system to client C and client a is "client B is S times".
In a possible implementation manner, the client receives a trigger operation that the user 2 suspends the watching of the recorded content, and suspends the recorded content of T2-T4.
At time T5, the system monitors the network difference of the client a, marks the state of the client a as S difference, and records T off-time as T5. The system synchronizes state information to the client B and the client C, and the state information is that the client A is S poor.
At time T6, the system monitors that the network quality of client a is getting better, and the requirements of the video conference are met. The system marks the status of client a as S good and records the time T good as T6. The system sends the recorded content of T5-T6 to client a. And the system synchronizes the state information to the normal state client. The normal clients are client A, client B and client C. The state information sent by the system to client B and client C is "client a is S good".
At time T7, the conference ends and the system pushes the recorded content of T0-T7 to client a, client B and client C.
The display interface of the terminal device is explained below with reference to fig. 6 to 13. For the same or similar interfaces, the embodiments of the present application are not described in detail. Illustratively, terminal a corresponds to client a, terminal B corresponds to client B, and terminal C corresponds to client C.
Fig. 6 is a schematic view of a video conference interface provided in an embodiment of the present application. Illustratively, fig. 6 shows the interface display of the terminal at time T0. Fig. 6 includes: a user avatar 601, a participant list 602, and settings 603. The user avatar 601 may display an avatar of the user device, or may display the user and the user environment photographed by each terminal device. Participant list 602 is used to display participant information, such as names of participants. The participant list can be hidden after the terminal device receives the user operation, and the display content of the participant list are not limited in the embodiment of the application. Settings 603 may include one or more of: mute, speaker, video, share, chat, more, away, or other types of settings.
The display interface of the terminal a in the video conference will be described with reference to fig. 7 to 10.
It is understood that the recorded content may be displayed in a variety of ways. The display interfaces of fig. 7 and 8 correspond to two display modes of the recorded content respectively.
When the recorded content is displayed in the interface in the form of a floating window, the display interface of terminal a at time T3 may be as shown in fig. 7. Fig. 7 includes: current video conference content 701, participant list 702, recorded content 703, and settings 704. The current video conference content 701, the participant list 702 and the setting item 704 may refer to the above interface description, and are not described herein again. The recorded content 703 may be displayed in the form of a floating window in any area of the interface, and the display position of the recorded content 703 is not limited in this embodiment.
The recorded content 703 includes a tab bar 705, a recorded content display window 706, a progress bar 707, and a recorded content setting item 708. The label column 705 includes a recording content name, which may be a system recording time or any other name, and this is not limited in this embodiment of the present application. The recorded content display window 706 is used for displaying the conference content recorded by the system when the client a is in an abnormal state. The progress bar 707 is used to adjust the conference content displayed in the recorded content display window 706. The recording content settings 708 may include one or more of: pause, play, speed, volume, selection, previous, next, or other type of recorded content setting.
Illustratively, when the terminal device receives a trigger operation of clicking pause by a user, the terminal device stops playing the recorded content. And when the terminal equipment receives the trigger operation of clicking playing by the user, the terminal equipment plays the recorded content. When the terminal equipment receives the trigger operation of clicking the double speed by the user, the speed of the terminal equipment when the recorded content is played is changed. And when the terminal equipment receives the triggering operation of clicking the volume by the user, the volume is increased when the terminal equipment plays the recorded content. The terminal equipment provides various playing modes, and can meet diversified playing requirements of users.
When the recorded content is displayed in the interface in a picture-in-picture manner, the display interface of terminal a at time T3 may be as shown in fig. 8. Fig. 8 includes: current video conference content 801 and recorded content 802. The current video conference content 801 is displayed full screen and the recorded content 802 is displayed in a picture-in-picture over the area of the current video conference content 801. The current video conference content 801 and the recorded content 802 may be played simultaneously. The terminal equipment pushes the recorded content in the video conference interface, so that a user can conveniently acquire missed video conference content during the video conference.
It will be appreciated that the client may be in the abnormal state many times. The display interface of the terminal equipment also comprises a recording content list. Exemplarily, taking a display interface of a terminal a at time T6 as an example, fig. 9 is a schematic display interface of the terminal a according to an embodiment of the present application. As shown in fig. 9, the interface further includes a recording content list 901 on the basis of fig. 7. The user can select the recorded content in the abnormal state period through the recorded content list. The terminal equipment displays the recording content list, so that a user can select missed video conference content conveniently according to the recording content list.
In a possible implementation manner, the recorded content list includes identifiers of recorded content, and when the terminal device receives a trigger operation on any identifier in the recorded content list, the terminal device displays the recorded content corresponding to any identifier. The identifier of the recorded content may be a start-stop time corresponding to the recorded content, or may be other types of identifiers. The embodiment of the present application does not limit the identifier of the recorded content.
In a possible implementation manner, when the client enters the abnormal state for many times, the system may push the complete recorded content or continuously record content segments during the abnormal state. Therefore, the number of recorded contents pushed by the terminal equipment is reduced, and users can be prevented from missing video conference contents. Moreover, the recorded content is continuous, so that the user can conveniently obtain the conference information, and the conference quality is improved.
In a possible implementation manner, when the system determines that the number of times that the client enters the abnormal state is greater than the number threshold, the server sends the complete recorded content of the video conference to the terminal device.
In a possible implementation manner two, when the system determines that the ratio of the abnormal state duration to the normal state total duration is greater than the ratio threshold, the system sends the complete recording content of the video conference to the terminal device.
In a possible implementation manner, when the system determines that the time interval duration of the multiple adjacent abnormal states of the terminal device is less than the interval threshold, the server sends the continuously recorded content segments to the terminal device. The continuous recording content segment is the corresponding complete recording content when the terminal equipment is in the abnormal state for a plurality of times. Illustratively, taking the above-mentioned event in fig. 5 as an example, when the time of T3-T5 is short, the system pushes the recorded content of T1-T6 to the client a at time T6. As shown in fig. 10, the recording content name 1002 of the recording content 1001 in fig. 10 is T1-T6.
The display interface of terminal B will be described with reference to fig. 11.
When the system detects that the user 2 of the terminal B leaves the screen, the system controls the terminal B. For example, taking the time T2 as an example, the system monitors that the user 2 of the terminal B leaves the screen, and fig. 11 is a schematic view of a display interface of the terminal B according to an embodiment of the present application. As shown in fig. 11, the microphone identification 1101 is in a mute state in the interface, and the video conference content is not displayed in the interface. The mute of the microphone of the terminal equipment can avoid the noise of the abnormal terminal equipment from being transmitted into the video conference, and reduce the interference of the video conference.
In a possible implementation, when the system detects that the user 2 of the terminal B leaves the screen, the system controls the terminal B to turn off the screen or sleep. Therefore, the leakage of the video conference content during the leaving of the user can be avoided, and the safety of the video conference is improved.
The display interface of the terminal C will be described with reference to fig. 12.
The system synchronously sends the abnormal state information to the normal state client, and a reminding notice and/or a state identification may be generated in the interface of the normal state client. Therefore, communication between the user of the normal client and the user of the abnormal client can be reduced.
For example, when the system monitors that the network of the client a is poor, the display interface of the terminal C may be as shown in fig. 12. The interface includes a reminder notification 1201 and a status identification 1202. The reminder 1201 displays "client a network is bad", and so on. The embodiment of the present application does not limit the specific content of the reminding notification.
In a possible implementation, the reminder notification disappears after a preset time, or is continuously displayed. The preset time may be in units of seconds or minutes, which is not limited in the embodiment of the present application.
At the end of a video conference, the system may push the recorded content during the conference to multiple clients. Illustratively, as shown in fig. 13, a bullet box 1301 is included in fig. 13. And displaying that the conference is finished and whether the recorded content is saved or not in a bullet frame. When the system receives a trigger operation of selecting 'yes' by the user, the system saves the recorded content during the meeting to a default address or prompts the user to select a saving path. When the system receives a trigger operation of selecting 'no' by the user, the system discards the recorded content during the conference and exits the video conference. Therefore, after the video conference, the user can obtain the video conference content through the recording content pushed by the terminal equipment.
The control method in the video conference according to the embodiment of the present application has been described above, and the following describes a related apparatus for performing the control method in the video conference according to the embodiment of the present application. Those skilled in the art will understand that the method and the apparatus can be combined and referred to each other, and the related apparatus provided in the embodiments of the present application can perform the steps in the control method in the video conference.
Fig. 14 is a schematic hardware structure diagram of a related apparatus in a video conference according to an embodiment of the present application. Referring to fig. 14, the apparatus includes: a memory 1401, a processor 1402, and an interface circuit 1403. The apparatus may further comprise a display 1404, wherein the memory 1401, the processor 1402, the interface circuit 1403, and the display 1404 may be in communication; illustratively, the memory 1401, the processor 1402, the interface circuit 1403 and the display 1404 can communicate via a communication bus, and the memory 1401 is used for storing computer-executable instructions, and is controlled by the processor 1402 to execute, and the interface circuit 1403 performs communication, thereby implementing the stylus-based control method provided by the embodiments described below in the present application.
In a possible implementation manner, the computer execution instructions in the embodiment of the present application may also be referred to as application program codes, which is not specifically limited in the embodiment of the present application.
Optionally, the interface circuit 1403 may also include a transmitter and/or a receiver. Optionally, the processor 1402 may include one or more CPUs, and may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present application may be embodied directly in a hardware processor, or in a combination of the hardware and software modules in the processor.
The embodiment of the application also provides a computer readable storage medium. The methods described in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media may include computer storage media and communication media, and may include any medium that can communicate a computer program from one place to another. A storage medium may be any target medium that can be accessed by a computer.
In one possible implementation, the computer-readable medium may include RAM, ROM, a compact disk read-only memory (CD-ROM) or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes disc, laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above embodiments are only for illustrating the embodiments of the present invention and are not to be construed as limiting the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made on the basis of the embodiments of the present invention shall be included in the scope of the present invention.

Claims (35)

1. A control method in a video conference is applied to a video conference system, wherein the video conference system comprises a server, a first terminal device and a second terminal device, and the method comprises the following steps:
the first terminal equipment and the second terminal equipment are accessed to a video conference through the server;
the server monitors the respective states of the first terminal equipment and the second terminal equipment;
when the server determines that the first terminal equipment meets a first preset condition, the server records first time when the first terminal equipment meets the first preset condition;
the server sends information used for indicating that the first terminal equipment meets the first preset condition to the second terminal equipment;
the second terminal equipment displays information for prompting that the first terminal equipment meets the first preset condition;
when the server determines that the first terminal equipment meets a second preset condition, the server sends a first recorded content in the video conference to the first terminal equipment from the first time to a second time, wherein the second time is the time when the first terminal equipment meets the second preset condition;
and the first terminal equipment displays a first interface, wherein the first interface comprises the first recorded content and the ongoing content of the video conference.
2. The method of claim 1, wherein the first terminal device satisfying a first preset condition comprises: no person is detected in front of the screen of the first terminal equipment; the first terminal equipment meeting the second preset condition comprises the following steps: and detecting a person in front of the screen of the first terminal equipment.
3. The method according to claim 2, wherein before the server determines that the first terminal device satisfies the second preset condition, the method further comprises:
the server controls the first terminal device to screen;
and/or the server does not send the content of the video conference to the first terminal equipment;
and/or the server controls the first terminal device to mute.
4. The method of claim 1, wherein the first terminal device satisfying a first preset condition comprises: the network quality of the first terminal equipment does not meet the condition; the first terminal equipment meeting the second preset condition comprises the following steps: and the network quality of the first terminal equipment meets the condition.
5. The method of claim 1, wherein the video conference system further comprises a third terminal device, the method further comprising:
the third terminal equipment accesses the video conference at the time later than the video conference starting time;
the server sends a second recording content to the third terminal device, wherein the second recording content is as follows: recording content in the video conference from the video conference start time to the time when the third terminal device accesses the video conference.
6. The method of claim 1, wherein the server stores a list of participating users of the video conference, the method further comprising:
the server determines that fourth terminal equipment does not access the video conference at the video conference starting time according to the conference participating user list;
when the server determines that the fourth terminal device accesses the video conference, the server sends a third recording content to the fourth terminal device, wherein the third recording content is as follows: recording content in the video conference from the video conference start time to the time when the fourth terminal device accesses the video conference.
7. The method according to any of claims 1-6, wherein the recorded content is automatically played by default in the first terminal device; the method further comprises the following steps:
the first terminal equipment receives a first operation of a user on the recorded content; the first operation comprises one of: the operation for triggering the playing of the recorded content, the operation for triggering the pausing of the recorded content, the operation for triggering the adjustment of the progress of the recorded content, the operation for triggering the adjustment of the playing speed of the recorded content or the operation for triggering the adjustment of the volume of the recorded content;
and the first terminal equipment executes the step corresponding to the first operation.
8. The method of any one of claims 1-6, further comprising:
when the first terminal equipment receives a plurality of recorded contents from the server, the first terminal equipment displays a list comprising identifications of the plurality of recorded contents;
and when the first terminal equipment receives the trigger of any identifier in the list, the first terminal equipment displays the recorded content corresponding to any identifier.
9. The method of any one of claims 1-6, further comprising:
when the server determines that the number of times that the first terminal device meets the first preset condition is larger than a number threshold, the server sends the complete recorded content of the video conference to the first terminal device;
or when the server determines that the ratio is greater than the ratio threshold, the server sends the complete recorded content of the video conference to the first terminal equipment; the ratio is the ratio of the time length of the first terminal device meeting the first preset condition to the total time length of the video conference;
or, when the server determines that the interval duration of the first terminal device meeting the first preset condition is less than an interval threshold, the server sends a continuous recording content segment to the first terminal device, where the continuous recording content segment is a complete recording content corresponding to the first terminal device when the first terminal device is located in a period meeting the first preset condition for multiple adjacent times.
10. The method of any one of claims 1-6, further comprising:
when the video conference is finished, the server sends a message for indicating whether recording content is stored or not to the first terminal equipment;
the first terminal equipment displays a second interface, wherein the second interface comprises a control for determining the storage of the recorded content and a control for canceling the storage of the recorded content;
when the first terminal equipment receives the trigger of the control for determining the storage of the recorded content, the first terminal equipment stores the recorded content;
or when the first terminal device receives the trigger of the control for canceling the recorded content, the first terminal device discards the recorded content.
11. The method according to any one of claims 1 to 6, wherein the first time is a first time or a certain time before and after the first time, and the second time is a second time or a certain time before and after the second time.
12. A method of controlling in a video conference, the method comprising:
the first terminal equipment accesses the video conference through the server;
the first terminal equipment receives first recorded content from the server; the first recorded content is content of the video conference from a first time to a second time; the first time is the time when the first terminal equipment meets a first preset condition, and the second time is the time when the first terminal equipment meets a second preset condition;
the first device displays a first interface, wherein the first interface comprises the first recorded content and the ongoing content of the video conference.
13. The method of claim 12, wherein the first terminal device satisfying a first preset condition comprises: no person is detected in front of the screen of the first terminal equipment; the first terminal equipment meeting the second preset condition comprises the following steps: and detecting a person in front of the screen of the first terminal equipment.
14. The method according to claim 13, wherein before the first terminal device satisfies the second preset condition, the method further comprises:
the first terminal equipment screens;
and/or the first terminal device does not display the content of the video conference;
and/or the first terminal device mutes.
15. The method of claim 12, wherein the first terminal device satisfying a first preset condition comprises: the network quality of the first terminal equipment does not meet the condition; the first terminal equipment meeting the second preset condition comprises the following steps: and the network quality of the first terminal equipment meets the condition.
16. The method of claim 12, further comprising:
when the first terminal device accesses the video conference at a time later than the video conference start time,
the first terminal equipment receives a second recorded content from the server, wherein the second recorded content is as follows: recording content in the video conference from the video conference start time to the time when the first terminal device accesses the video conference.
17. The method according to any of claims 12-16, wherein the recorded content is automatically played by default in the first terminal device; the method further comprises the following steps:
the first terminal equipment receives a first operation of a user on the recorded content; the first operation comprises one of: the operation for triggering the playing of the recorded content, the operation for triggering the pausing of the recorded content, the operation for triggering the adjustment of the progress of the recorded content, the operation for triggering the adjustment of the playing speed of the recorded content or the operation for triggering the adjustment of the volume of the recorded content;
and the first terminal equipment executes the step corresponding to the first operation.
18. The method according to any one of claims 12-16, further comprising:
when the first terminal equipment receives and receives a plurality of recorded contents from the server, the first terminal equipment displays a list comprising identifications of the plurality of recorded contents;
and when the first terminal equipment receives the trigger operation of any identifier in the list, the first terminal equipment displays the recorded content corresponding to any identifier.
19. The method according to any one of claims 12-16, further comprising:
the first terminal equipment receives the complete recorded content of the video conference from the server;
or the first terminal device receives a continuous recording content segment from the server, where the continuous recording content segment is a complete recording content corresponding to the first terminal device when the first terminal device is in a period satisfying the first preset condition for a plurality of adjacent times.
20. The method according to any one of claims 12-16, further comprising:
when the video conference is finished, the first terminal equipment receives a message which is used for indicating whether recording content is saved or not from the server;
the first terminal equipment displays a second interface, wherein the second interface comprises a control for determining the storage of the recorded content and a control for canceling the storage of the recorded content;
when the first terminal equipment receives the trigger operation of the control for determining the storage of the recorded content, the first terminal equipment stores the recorded content;
or when the first terminal device receives the trigger operation of the control for canceling the recorded content saving, the first terminal device discards the recorded content.
21. The method according to any one of claims 12-16, wherein the first time is a first time or a certain time before and after the first time, and the second time is a second time or a certain time before and after the second time.
22. A method of controlling in a video conference, the method comprising:
the server coordinates the first terminal equipment and the second terminal equipment to access the video conference;
the server monitors the respective states of the first terminal equipment and the second terminal equipment;
when the server determines that the first terminal equipment meets a first preset condition, the server records first time when the first terminal equipment meets the first preset condition;
the server sends information used for indicating that the first terminal equipment meets the first preset condition to the second terminal equipment;
when the server determines that the first terminal equipment meets a second preset condition, the server sends a first recorded content in the video conference to the first terminal equipment from the first time to a second time, wherein the second time is the time when the first terminal equipment meets the second preset condition.
23. The method of claim 22, wherein the first terminal device satisfying a first preset condition comprises: no person is detected in front of the screen of the first terminal equipment; the first terminal equipment meeting the second preset condition comprises the following steps: and detecting a person in front of the screen of the first terminal equipment.
24. The method of claim 23, wherein before the server determines that the first terminal device satisfies a second preset condition, the method further comprises:
the server controls the first terminal device to screen;
and/or the server does not send the content of the video conference to the first terminal equipment;
and/or the server controls the first terminal device to mute.
25. The method of claim 22, wherein the first terminal device satisfying a first preset condition comprises: the network quality of the first terminal equipment does not meet the condition; the first terminal equipment meeting the second preset condition comprises the following steps: and the network quality of the first terminal equipment meets the condition.
26. The method of claim 22, further comprising:
the server sends a second recording content to a third terminal device, the third terminal device is a terminal device which is accessed to the video conference at a time later than the video conference starting time, and the second recording content is as follows: recording content in the video conference from the video conference start time to the time when the third terminal device accesses the video conference.
27. The method of claim 22, wherein the server has stored therein a list of participating users for the video conference, the method further comprising:
the server determines that fourth terminal equipment does not access the video conference at the video conference starting time according to the conference participating user list;
when the server determines that the fourth terminal device accesses the video conference, the server sends a third recording content to the fourth terminal device, wherein the third recording content is as follows: recording content in the video conference from the video conference start time to the time when the fourth terminal device accesses the video conference.
28. The method of any one of claims 22-27, further comprising:
when the server determines that the number of times that the first terminal device meets the first preset condition is larger than a number threshold, the server sends the complete recorded content of the video conference to the first terminal device;
or when the server determines that the ratio is greater than the ratio threshold, the server sends the complete recorded content of the video conference to the first terminal equipment; the ratio is the ratio of the time length of the first terminal device meeting the first preset condition to the total time length of the video conference;
or, when the server determines that the interval duration of the first terminal device meeting the first preset condition is less than an interval threshold, the server sends a continuous recording content segment to the first terminal device, where the continuous recording content segment is a complete recording content corresponding to the first terminal device when the first terminal device is located in a period meeting the first preset condition for multiple adjacent times.
29. The method of any one of claims 22-27, further comprising:
and when the video conference is finished, the server sends a message for indicating whether recording content is saved or not to the first terminal equipment.
30. The method of any one of claims 22-27, wherein the first time is a first time or a time period before and after the first time, and the second time is a second time or a time period before and after the second time.
31. A terminal device, comprising: a processor and a memory;
the memory stores computer-executable instructions;
the processor executing the computer-executable instructions stored by the memory causes the processor to perform the method of any of claims 12-21.
32. A server, comprising: a processor and a memory;
the memory stores computer-executable instructions;
the processor executes computer-executable instructions stored by the memory, causing the processor to perform the method of any of claims 22-30.
33. A control system for a video conference, comprising: a terminal device according to claim 31 and a server according to claim 32.
34. A computer-readable storage medium, in which a computer program or instructions are stored which, when executed, implement the method of any one of claims 12-21 or the method of any one of claims 22-30.
35. A computer program product comprising a computer program or instructions which, when executed by a processor, performs the method of any one of claims 12 to 21 or performs the method of any one of claims 22 to 30.
CN202110416620.3A 2021-04-19 2021-04-19 Control method and related device in video conference Active CN112822433B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110416620.3A CN112822433B (en) 2021-04-19 2021-04-19 Control method and related device in video conference

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110416620.3A CN112822433B (en) 2021-04-19 2021-04-19 Control method and related device in video conference

Publications (2)

Publication Number Publication Date
CN112822433A true CN112822433A (en) 2021-05-18
CN112822433B CN112822433B (en) 2021-07-23

Family

ID=75863682

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110416620.3A Active CN112822433B (en) 2021-04-19 2021-04-19 Control method and related device in video conference

Country Status (1)

Country Link
CN (1) CN112822433B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113691762A (en) * 2021-08-16 2021-11-23 咪咕文化科技有限公司 Data transmission method and device for video conference and computer readable storage medium
CN114390240A (en) * 2021-12-09 2022-04-22 慧之安信息技术股份有限公司 Safety processing method and device for video conference
CN115150366A (en) * 2022-06-30 2022-10-04 中国电信股份有限公司 Teleconference control method, teleconference control device, storage medium and electronic equipment
CN115190111A (en) * 2022-07-26 2022-10-14 京东方科技集团股份有限公司 Intelligent interaction method and system, computer readable storage medium and computer device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102238160A (en) * 2010-05-06 2011-11-09 腾讯数码(深圳)有限公司 Device and method for replaying scenes after disconnection and reconnection
CN104104910A (en) * 2014-06-26 2014-10-15 北京小鱼儿科技有限公司 Terminal for performing bidirectional live sharing and intelligent monitoring and method thereof
US20140340467A1 (en) * 2013-05-20 2014-11-20 Cisco Technology, Inc. Method and System for Facial Recognition for a Videoconference
CN106657866A (en) * 2016-12-21 2017-05-10 联想(北京)有限公司 Method and device for sharing multimedia data and video conference system
CN110326290A (en) * 2017-02-24 2019-10-11 微软技术许可有限责任公司 It is watched while live content and the content of recording
CN111447392A (en) * 2020-03-04 2020-07-24 视联动力信息技术股份有限公司 Data transmission method, device, server and computer readable storage medium
CN112566228A (en) * 2021-02-20 2021-03-26 全时云商务服务股份有限公司 Method and system for reducing equipment power consumption in network video conference

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102238160A (en) * 2010-05-06 2011-11-09 腾讯数码(深圳)有限公司 Device and method for replaying scenes after disconnection and reconnection
US20140340467A1 (en) * 2013-05-20 2014-11-20 Cisco Technology, Inc. Method and System for Facial Recognition for a Videoconference
CN104104910A (en) * 2014-06-26 2014-10-15 北京小鱼儿科技有限公司 Terminal for performing bidirectional live sharing and intelligent monitoring and method thereof
CN106657866A (en) * 2016-12-21 2017-05-10 联想(北京)有限公司 Method and device for sharing multimedia data and video conference system
CN110326290A (en) * 2017-02-24 2019-10-11 微软技术许可有限责任公司 It is watched while live content and the content of recording
CN111447392A (en) * 2020-03-04 2020-07-24 视联动力信息技术股份有限公司 Data transmission method, device, server and computer readable storage medium
CN112566228A (en) * 2021-02-20 2021-03-26 全时云商务服务股份有限公司 Method and system for reducing equipment power consumption in network video conference

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113691762A (en) * 2021-08-16 2021-11-23 咪咕文化科技有限公司 Data transmission method and device for video conference and computer readable storage medium
CN114390240A (en) * 2021-12-09 2022-04-22 慧之安信息技术股份有限公司 Safety processing method and device for video conference
CN115150366A (en) * 2022-06-30 2022-10-04 中国电信股份有限公司 Teleconference control method, teleconference control device, storage medium and electronic equipment
CN115190111A (en) * 2022-07-26 2022-10-14 京东方科技集团股份有限公司 Intelligent interaction method and system, computer readable storage medium and computer device

Also Published As

Publication number Publication date
CN112822433B (en) 2021-07-23

Similar Documents

Publication Publication Date Title
CN112822433B (en) Control method and related device in video conference
US11025686B2 (en) Network call method and apparatus, terminal, and server
CN110300404B (en) Network control method and mobile terminal
CN107124661B (en) Communication method, device and system in live channel
US9924205B2 (en) Video remote-commentary synchronization method and system, and terminal device
CN106105246B (en) Display methods, apparatus and system is broadcast live
CN109165074B (en) Game screenshot sharing method, mobile terminal and computer-readable storage medium
CN111866433B (en) Video source switching method, video source playing method, video source switching device, video source playing device, video source equipment and storage medium
CN106973330B (en) Screen live broadcasting method, device and system
CN106162236A (en) A kind of method and device of sharing video frequency
US20220007074A1 (en) Method and apparatus for playing videos, and electronic device and storage medium thereof
CN112751971A (en) Voice playing method and device and electronic equipment
CN112689191B (en) Screen projection control method, terminal and computer readable storage medium
CN108933964B (en) Bullet screen display method, playing device and control terminal
CN113766259B (en) Information synchronization system, method, device, equipment and storage medium
CN111741352A (en) Screen projection control method, screen projection playing method and related device
CN107682541B (en) Audio control method for screen projection, mobile terminal and storage medium
CN110830813B (en) Video switching method and device, electronic equipment and storage medium
CN108579081B (en) Event processing method, device and computer storage medium based on game
CN112882622A (en) Data processing method and device, terminal and storage medium
CN112910892B (en) Method and terminal for playing call holding audio and video signals
CN105704174A (en) Information prompting method and device
US7945277B2 (en) Use of media timestamp to indicate delays in push-to-talk over cellular group calls
CN113992786A (en) Audio playing method and device
JP7312337B1 (en) CONFERENCE SYSTEM, CONTROL DEVICE, CONTROL METHOD, PROGRAM, AND RECORDING MEDIUM

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant