CN112312058B - Interaction method and device and electronic equipment - Google Patents

Interaction method and device and electronic equipment Download PDF

Info

Publication number
CN112312058B
CN112312058B CN202010205436.XA CN202010205436A CN112312058B CN 112312058 B CN112312058 B CN 112312058B CN 202010205436 A CN202010205436 A CN 202010205436A CN 112312058 B CN112312058 B CN 112312058B
Authority
CN
China
Prior art keywords
panel
state
conference
control
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010205436.XA
Other languages
Chinese (zh)
Other versions
CN112312058A (en
Inventor
卢姝含
叶伟伟
朱斌
庞浩然
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN202010205436.XA priority Critical patent/CN112312058B/en
Publication of CN112312058A publication Critical patent/CN112312058A/en
Application granted granted Critical
Publication of CN112312058B publication Critical patent/CN112312058B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The embodiment of the invention discloses an interaction method, an interaction device and electronic equipment. One embodiment of the method comprises the following steps: detecting a candidate trigger in a multimedia conference, wherein the candidate trigger comprises at least one of the following: the conference state of the multimedia conference, the current operation state of the user; and switching the display states of the control panels presented in the multimedia conference interface in response to the detected candidate triggering item meeting the switching triggering condition, wherein at least one control is presented in the control panels in each display state. Thus, a new way of interaction can be provided.

Description

Interaction method and device and electronic equipment
Technical Field
The disclosure relates to the technical field of internet, and in particular relates to an interaction method, an interaction device and electronic equipment.
Background
With the development of the internet, users increasingly use functions of terminal devices, so that work and life are more convenient. For example, a user may initiate a multimedia conference with other users online via a terminal device. The users can realize remote interaction through online multimedia conferences, and can also realize that the users can start conferences without being integrated at one place. Multimedia conferences largely avoid the limitations of traditional face-to-face conferences with respect to location and place.
Disclosure of Invention
This disclosure is provided in part to introduce concepts in a simplified form that are further described below in the detailed description. This disclosure is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
The embodiment of the disclosure provides an interaction method, an interaction device and electronic equipment.
In a first aspect, an embodiment of the present disclosure provides an interaction method, including: detecting candidate triggering items in the multimedia conference, wherein the candidate triggering items comprise at least one of the following: the conference state of the multimedia conference and the current operation state of the user; and switching the display states of the control panels presented in the multimedia conference interface in response to the detected candidate triggering item meeting the switching triggering condition, wherein at least one control is presented in the control panels in each display state.
In a second aspect, embodiments of the present disclosure provide an interaction apparatus, including: the detection unit is used for detecting candidate triggering items in the multimedia conference, wherein the candidate triggering items comprise at least one of the following: the conference state of the multimedia conference and the current operation state of the user; and the switching unit is used for switching the display states of the control panels displayed on the multimedia conference interface in response to the detected candidate triggering items meeting the switching triggering conditions, wherein at least one control is displayed in the control panels in each display state.
In a third aspect, an embodiment of the present disclosure provides an electronic device, including: one or more processors; and a storage device for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the interaction method as described in the first aspect.
In a fourth aspect, embodiments of the present disclosure provide a computer readable medium having stored thereon a computer program which, when executed by a processor, implements the steps of the interaction method as described in the first aspect.
According to the interaction method, the device and the electronic equipment provided by the embodiment of the disclosure, candidate triggering items in a multimedia conference are detected firstly, then the display states of control panels presented in a multimedia conference interface are switched in response to the detected candidate triggering items meeting a switching triggering condition, and it is required to be noted that at least one control is presented in the control panels in each display state; the method can provide a new interaction mode, and at least one control is displayed in the control panels in various display states, so that the display states of the control panels can be changed to adjust the shielding condition of the control panels on the multimedia conference interface; and the user can still operate the control to participate in or control the multimedia conference.
Drawings
The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.
FIG. 1 is a flow chart of one embodiment of an interaction method according to the present disclosure;
FIGS. 2 and 3 are schematic diagrams of one application scenario of the interaction method according to the present disclosure;
FIG. 4 is a schematic diagram of another application scenario of an interaction method according to the present disclosure;
FIG. 5 is a schematic structural view of one embodiment of an interaction device according to the present disclosure;
FIG. 6 is an exemplary system architecture in which the interaction method of one embodiment of the present disclosure may be applied;
fig. 7 is a schematic view of a basic structure of an electronic device provided according to an embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.
It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.
The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
Referring to FIG. 1, a flow of one embodiment of an interaction method according to the present disclosure is shown. The interaction method as shown in fig. 1 comprises the following steps:
step 101, detecting candidate triggering items in the multimedia conference.
In this embodiment, the execution subject (e.g., terminal device) of the interaction method may detect a candidate trigger in the multimedia conference.
In this embodiment, the candidate trigger includes at least one of the following: conference state of multimedia conference, current operation state of user.
Here, the multimedia conference may include, but is not limited to, at least one of: audio conferences, video conferences.
Here, the candidate trigger item may be a predefined item for triggering a switching action. The switching action may refer to an action of switching a presentation state of a control panel presented at the multimedia conference interface.
Here, the conference status may indicate the progress of the conference. The specific content of the conference state may be set according to the actual situation, and is not limited herein.
In some application scenarios, the conference state may include, but is not limited to, at least one of:
here, the current operation state of the user may indicate information related to the operation of the user. The specific content of the current operation state of the user may be set according to the actual situation, which is not limited herein.
In some application scenarios, the current operating state of the user may include, but is not limited to, at least one of: the operation of the control panel by the user, the operation of other parts except the control panel in the multimedia conference interface of the user, and the duration of the non-operation of the user.
And step 102, switching the display state of the control panel displayed on the multimedia conference interface in response to the detected candidate triggering item meeting the switching triggering condition.
In this embodiment, the executing body may switch the display state of the control panel presented on the multimedia conference interface in response to the detected candidate trigger item meeting the switch trigger condition.
Here, the above-described switching trigger condition is used to determine whether or not to perform the above-described switching operation.
The specific content of the above-mentioned switching trigger condition may be set according to the actual situation, and is not limited herein.
In some application scenarios, the above-mentioned handover trigger condition may include, but is not limited to, one of the following: conference state switching conditions, user operation state switching conditions.
As an example, the conference state of the above-mentioned multimedia conference satisfies the conference state switching condition, and may include, but is not limited to, at least one of: the duration of the conference reaches the preset duration, and the conference is switched to the shared screen state.
As an example, the current operation state of the user satisfies the user operation state switching condition, may include, but is not limited to, at least one of: the user drags the control panel to a preset area, and clicks a preset switching control.
Here, the control panel may be used to present controls.
Here, the presentation state of the control panel may indicate a presentation style of the control panel. As an example, the presentation style may include the number of controls presented in the control panel.
Here, the presentation state of the control panel may be set to at least two, in other words, the control panel may be switched between two, three or even more states.
Here, at least one control is presented in the control panel of each presentation state.
In the interaction method provided by the embodiment of the application, the candidate triggering item in the multimedia conference is detected firstly, then the display state of the control panel displayed on the multimedia conference interface is switched in response to the detected candidate triggering item meeting the switching triggering condition, and it is to be noted that at least one control is displayed in the control panel in each display state; thus, a new way of interaction can be provided.
It should be noted that, in the interaction manner provided by the present disclosure, the display state of the control panel may be switched according to the change of the candidate trigger item, so that the suitability of the control panel to the multimedia conference may be improved, or the suitability of the control panel to the user expectations represented by the current operation state of the user may be improved.
It should be noted that, at least one control is presented in the control panels in various display states, so that the display state of the control panel can be changed to adjust the shielding condition of the control panel to the multimedia conference interface; and the user can still operate the control to participate in or control the multimedia conference.
Please refer to fig. 2 and 3. A video conference interface 201 is shown in fig. 2, with the video conference interface 201 including a participant video display box 202. The video conference interface also presents a first panel 203, in which a microphone control 205, a shared open control 206, and a video hanging up control 207 are presented in the first panel 203. And a stow control 208 is also presented in the first panel.
The user may click on the stow control 208.
The terminal may then display the video conferencing interface shown in fig. 3, and in fig. 3, the second panel 204 may be displayed. In the second panel 204, a expand control 209 and a microphone control 205 may be presented.
In some embodiments, the control panel in the expanded state is a first panel, and the control panel in the collapsed state is a second panel, wherein the first panel presents at least two functional controls, the second panel presents target controls in the at least two functional controls, and the number of target controls in the second panel is smaller than the number of functional controls in the first panel.
Here, the expanded state may be a panel state in which the panel area is large and the number of presentation controls is large.
Here, the stowed state may be a panel state in which the panel area is small and fewer controls are present.
Here, for convenience of description, the controls in the first panel may be referred to as functionality controls, and the controls in the second panel may be referred to as target controls. The controls in the second panel are part of the controls in the first panel.
Here, how to determine a part of the functional controls from the functional controls in the first panel as target controls may be selected according to actual situations, which is not limited herein.
In some application scenarios, the switching is presented in a display state of a control panel of the multimedia conference interface, and may include at least one of the following: switching from displaying the first panel to displaying the second panel, switching from displaying the second panel to displaying the first panel.
In some embodiments, the method may include: displaying a first panel; step 102, determining that a preset panel stowage condition is satisfied, and determining a target control from the at least two functional controls; and stopping displaying the first panel and displaying the second panel on the multimedia conference interface.
Here, the above-described panel stow condition may be used to determine when the control panel switches from the deployed state to the stowed state.
The specific content of the panel stowing condition may be set according to the actual scene, and is not limited herein.
It should be noted that, the control panel switches from the unfolding state to the folding state, which can reduce the shielding of the multimedia conference interface, improve the display efficiency of the multimedia conference interface, and simultaneously, the control left on the second panel can ensure that the user can participate in or control the multimedia conference through the left control.
In some embodiments, the panel stow condition includes: a predefined stow operation for the first panel is detected.
Here, the above-described predefined stowing operation may indicate a trigger operation of switching the first panel to the second panel.
It should be noted that, in response to the user's stowing operation, switching to the stowing state of the control panel may implement stowing of the control panel when the user desires to stow the control panel.
In some application scenarios, the predefined stow operation described above includes at least one of: triggering operation aiming at a preset stowage control; and indicating a movement operation of moving the first panel to a first preset position.
Here, the stow control may be used to switch the control panel from the deployed state to the stowed state. The style of the stowing control may be set according to an actual application scenario, which is not limited herein.
Here, the terminal may detect a movement operation for the first panel, and trigger to switch the control panel to the stowed state if the movement operation is a first preset position (e.g., a boundary region of the multimedia conference interface) where the first panel is moved.
In some embodiments, the panel stow condition includes: the conference state of the multimedia conference is a first predefined conference state.
Here, the first predefined conference state is used to indicate a timing of switching from the first panel to the second panel.
It should be noted that, by setting the first predefined conference state, the switching from the first panel to the second panel may be automatically performed, and the conference state is adapted to switch the display state of the control panel without user operation, thereby realizing automatic adaptation and reducing interaction steps.
Here, the specific content of the first predefined conference state may be set according to the actual situation scenario, which is not limited herein.
In some application scenarios, the first predefined conference state includes: the duration time of the conference is longer than a preset first time, the state of the shared screen, the state of the shared document, the number of conference participants is greater than a preset number threshold, the number of user images displayed on the multimedia conference interface is greater than a preset number threshold, and the duration time of the first panel which is not operated is longer than a preset second time.
Here, the duration of the conference is longer than the preset first duration, possibly, it may be possible to characterize that a stable conference communication phase is entered between users, the requirement for some adjustment controls (such as volume adjustment controls, etc.) of the conference is reduced, and at this time, the conference is switched to the stowing state, so that accuracy of stowing time can be improved.
Here, the shared screen state may indicate a state in which screen sharing is performed between the reference objects.
Here, the shared document state may indicate a state in which document sharing is performed between the reference objects.
Here, the user image may indicate a user screen or a user avatar. When the number of users displayed on the multimedia conference interface is large, the information in the multimedia conference interface is dense, and the control panel is switched to the stowage state, so that shielding of the control panel on the multimedia conference interface can be timely avoided.
Here, the first panel is not operated for a longer time than the preset second time, which indicates that the operation requirement on the first panel is lower if the first panel is not operated for a longer time, and the first panel is switched to the stowing state at this time, so that the accuracy of stowing time can be improved.
In some embodiments the above method further comprises: responsive to determining that the conference state of the multimedia conference is a second predefined conference state, redefining a target control; and replacing the redefined target control into the second panel.
Here, the second predefined meeting state may indicate an opportunity to redefine the target control.
It should be noted that, by redefining the template control and replacing the redetermined target control in the second panel, the target control in the second panel can be changed according to the conference state, so as to improve the adaptation degree of the target control and the conference state.
Here, the specific content of the second predefined conference state may be set according to the actual situation, which is not limited herein.
In some application scenarios, the second predefined conference state includes at least one of: the duration time of the conference is longer than a preset second duration time, the state of the shared screen, the state of the shared document, the number of conference participants is greater than a preset number threshold, and the user image displayed on the multimedia conference interface is greater than a preset image threshold.
Here, if the conference state is changed in the display process of the second panel and reaches the second predefined conference state, the target control may be redetermined, so that the suitability of the target control to the actual situation is improved as the target control is replaced in the actual situation.
In some embodiments, the above-described switch trigger condition includes a panel deployment condition; and the step 102 may include: displaying the second panel; and stopping displaying the second panel and displaying the first panel on the multimedia conference interface in response to determining that the preset panel unfolding condition is met.
Here, the panel expansion condition described above may be used to determine the timing at which the control panel is switched from the stowed state to the deployed state.
Here, the specific content of the panel expansion condition may be set according to an actual scene, and is not limited herein.
It should be noted that, the control panel is switched from the stowed state to the deployed state, so that when the panel deployment condition is satisfied, a comprehensive control is provided on the multimedia conference interface, so that the user can participate in or control the multimedia conference conveniently by operating the control.
In some embodiments, the panel deployment conditions described above include: a predefined unfolding operation for the second panel is detected.
Here, the predefined expansion operation may indicate a trigger operation for switching the second panel to the first panel.
It should be noted that, in response to the expansion operation of the user, the control panel is switched to the expansion state of the control panel, so that the control panel can be expanded when the user desires to expand the control panel.
In some application scenarios, the predefined unfolding operation includes at least one of the following: triggering operation aiming at a preset unfolding control; and indicating a movement operation of moving the second panel to a second preset position.
Here, the stow control may be used to switch the control panel from the stowed state to the deployed state. The style of the expansion control can be set according to the actual application scene, and is not limited herein.
Here, the terminal may detect a movement operation for the second panel, and trigger the control panel to be switched to the expanded state if the movement operation is a second preset position (e.g., a main content area of the multimedia conference interface) where the second panel is moved.
In some embodiments, the panel deployment conditions described above include: the conference state of the multimedia conference is a third predefined conference state. Here, the third predefined conference state is used to indicate the opportunity to switch from the second panel to the first panel.
It should be noted that, by setting the third predefined conference state, the switching from the second panel to the first panel may be automatically performed, and the conference state is adapted to switch the display state of the control panel without requiring a user operation, thereby, automatic adaptation may be realized, and interaction steps are reduced.
Here, the specific content of the third predefined conference state may be set according to the actual situation scenario, which is not limited herein.
In some application scenarios, the third predefined conference state includes: the duration time of the conference is longer than a preset third duration time, the number of conference participants is not greater than a preset number threshold, and the number of user images displayed on the multimedia conference interface is not greater than a preset number threshold.
Here, the duration of the conference is longer than the preset third duration, which may possibly indicate that the conference may reach the tail sound, and the requirement for some adjustment controls (such as volume adjustment controls and the like) of the conference is increased, and at this time, the conference is switched to the unfolding state, so that the accuracy of the unfolding time can be improved.
Here, the user image may indicate a user screen or a user avatar. When the number of users displayed on the multimedia conference interface is small, the information in the multimedia conference interface is sparse, and the control panel is switched to the unfolding state, so that the control panel can not excessively shade the effective information of the multimedia conference interface.
In some embodiments, the above-described target control is determined by: acquiring selection information of a user, wherein the selection information is used for indicating a target control in the at least two functional controls; and determining the target control according to the selection information.
Here, the user may provide selection information before the multimedia conference is started. The terminal can also display target control inquiry information to the user in response to determining the display state of the switching control panel in the process of the multimedia conference, and the user replies the target control inquiry information to provide selection information.
Here, the target control indicated by the selection information of the user may be used as the target control displayed on the second panel. Or selecting the target control indicated by the selection information of the user as the target control displayed on the second panel.
The target control is determined through the selection information provided by the user, the control which accords with the user expectation can be displayed on the second panel, the individual pertinence of the control display is improved, the user is prevented from exchanging again manually, and the interaction steps are reduced.
In some embodiments, the above-described target control is determined by: acquiring historical operation information of a user aiming at a first panel; determining the operation frequency of each functional control according to the historical operation information; and determining a preset number of target controls according to each operation frequency.
Here, the determining the target control in the functional controls according to the operation frequency of each functional control may be performed for the user before the multimedia conference is started; or may be determined on the fly in response to determining to switch the presentation state of the control panel.
Here, in the second panel, all or part of the above-described predefined number of target controls may be presented.
It should be noted that, by determining the target control for the user according to the operation frequency, the determined target control can adapt to the operation habit of the user, so that the target control can be displayed by automatically adapting to the operation habit of the user, and the individual pertinence of control display can be improved, user setting can be avoided, and interaction links are saved.
In some embodiments, the above-described target control is determined by: and determining the functional control related to the conference state as a target control according to the conference state of the multimedia conference.
Here, the conference status of the multimedia conference may indicate a conference condition during the multimedia conference. The division or definition of the conference state can be set according to the actual situation.
Here, the conference state-related functionality control may indicate a functionality control of user operability in the conference state. The correlation between the conference state and the function control can be preset.
It should be noted that, for the conference state, the target control displayed in the second panel is determined, so that the suitability of the target control to the conference state can be improved, the user is prevented from manually calling out related controls in the conference state, and interaction steps are saved.
In some application scenarios, determining, according to the conference state of the multimedia conference, that the functional control related to the conference state is a target control includes: in response to determining that the conference state is a shared state, a functionality control associated with the shared state is determined to be a target control.
Here, the above-described sharing state indicates a state in which there is shared content in the screen sharing area of the multimedia conference.
It should be noted that, for the sharing state of the multimedia conference, the second panel presents the related control of the sharing state, so that the related control can be conveniently used in the sharing state while shielding of the screen is reduced, and the user is prevented from manually calling the related control of the sharing state.
In some application scenarios, the functionality control of the sharing state includes at least one of the following: the system comprises a labeling control, a sharing state switching control and a sharing object switching control.
Referring to fig. 4, a shared state switch control 401 is shown in a shared state. It should be noted that, by way of example, the "Tengest sequencer" in FIG. 4 is a shared document.
Here, the annotation control may annotate the shared content by a user.
Here, the sharing state switching control described above may be used to switch between following sharing for screen browsing and free browsing.
Here, the above-described object switching control may be used to switch a shared object (presenter of content).
In some embodiments, the determining, according to the conference state of the multimedia conference, that the function control for the conference state is a target control includes: and in response to determining that the preset expected meeting end condition is met, determining the functional control related to meeting end as the target control.
Here, the above-described expected conference end condition may indicate a timing at which the computer judges that the conference is about to end.
In some application scenarios, the meeting end related controls may include, but are not limited to, at least one of: a hang-up control and a call quality evaluation control.
It should be noted that, for the meeting near-ending scene of the multimedia meeting, the relevant control of the meeting near-ending state is presented on the second panel, so that the screen shielding can be reduced, the relevant control can be conveniently used in the meeting near-ending state, and the user is prevented from manually calling the relevant control of the meeting near-ending state.
In some application scenarios, the expected meeting end conditions include at least one of, but are not limited to: the duration of the multimedia conference is greater than a preset fourth time threshold; determining that the voice recognition result indicates a meeting according to the voice recognition result of the participated object of the multimedia conference; and determining that the preset meeting ending time is reached according to the meeting arrangement information of the multimedia meeting.
In some embodiments, the above-described target control is determined or redetermined by: and determining the function control related to the current state of the user as a target control according to the current state of the user.
Here, the user current state may indicate a state of the user in the multimedia conference. The correlation between the current state of the user and the function control can be preset.
It should be noted that, for the current state of the user, the second panel presents the relevant control of the current state of the user, so that the screen shielding can be reduced, the user can use the relevant control in the current state conveniently, and the user is prevented from manually calling the relevant control of the current state.
In some application scenarios, the user current state includes at least one of: whether the current multimedia conference interface is in a voice input state or not is in a thumbnail display state.
Here, the user is in a voice input state, and the related control may not include a microphone control but include a volume adjustment control; if the user is not in a voice input state, the associated controls may include microphone controls.
Here, when the current multimedia conference interface is in a thumbnail display state, a return control is displayed, and the return control can be used for returning to the multimedia conference interface.
In some embodiments, the above-described target control is determined by: and determining a target control according to the authority of the user in the multimedia conference.
The related control of the authority is presented on the second panel according to the authority of the user in the multimedia conference, so that the user can conveniently use the control related to the authority of the user while shielding the screen is reduced, and the user is prevented from manually calling the related control for the authority of the user. And, the user can be prompted to have the authority, and the user is reminded of using the authority of the user.
In some application scenarios, the determining the target control according to the authority of the user in the media conference includes: in response to determining that the user has conference management rights, a related control of the conference management rights is determined as a target control.
Here, the conference management authority may indicate authority to manage related matters of the multimedia conference. The specific content of the conference management authority can be set according to the actual application scene. As an example, the conference management rights may include, but are not limited to, at least one of: the participating users manage the right and the conference end right.
Here, the correlation between the conference management authority and the control may be set in advance.
As an example, the relevant controls for meeting management rights may include at least one of, but are not limited to: a meeting user management control and a meeting end control. The meeting user management control is triggered, a plurality of meeting user identifications can be displayed, and then operations such as deleting the meeting user (namely playing the multimedia meeting) or disabling the meeting user can be implemented aiming at the meeting user identifications.
In some application scenarios, the determining the target control according to the authority of the user in the media conference includes: and in response to the user having the sharing rights, determining the sharing rights related control as the target control.
Here, the above-described sharing authority may indicate an authority to share shared content (e.g., shared screen or document) to participating users of the multimedia conference.
As an example, the related controls for sharing rights may include, but are not limited to, at least one of: the open control is shared. After triggering the share open control, the user may share a screen or document with the attendees.
In some embodiments, the target control presented in the second panel is obtained by a target control determining manner, where the target control determining manner at least includes at least one of the following steps: determining the target control according to the conference state of the multimedia conference; determining the target control according to configuration operation of a user; determining the target control according to the current state of the user; and determining a target control according to the authority of the user in the multimedia conference.
By means of the target control determining mode, the target control can be determined according to the multiple information, so that the possibility that the control expected by the user is not displayed on the second panel is further reduced from a plurality of controls which are determined according to the possible operation of the matched user, and interaction efficiency is improved.
In some embodiments, the number of the target controls is a preset first number, each step in the target control determining manner has a preset priority, and the target control determining manner is performed in the following manner: and executing all steps in the target control determining mode according to the preset priority level until the number of the target controls reaches the first number.
It should be noted that, by executing the first number of target controls determined in each step according to the priority, on one hand, the target controls conforming to the priority may be determined according to the determination order indicated by the priority; the order of priority indication can indicate the order from high to low according to the influence on the operation of the user, so that the priority target control is more accordant, the operation of the user is more likely, the probability of calling the expected control again by the user can be reduced, and the interaction efficiency is improved. On one hand, the determined target control can be ensured to be more diversified (the control of the same type determined according to one type of information is avoided as the target control).
In some embodiments, the method further includes, in response to reaching a preset execution trigger condition, executing the target control determination mode.
Here, the execution triggering condition may include, but is not limited to: the conference state of the multimedia conference is a second predefined conference state.
It should be noted that, by executing the target control determining mode when the execution triggering condition is satisfied, the execution of the target control determining mode may be initiated at any time related to the multimedia conference, for example, before the conference, when the first panel is displayed, and when the second panel is displayed. Determining the target control prior to the meeting may increase the speed of switching from the first panel to the second panel. And executing the target control determining mode when the second panel is displayed, and re-determining the target control according to the current meeting or user state and replacing the target control in the second panel, so that the target control displayed in the second panel is matched with the current meeting or user state.
In some embodiments, the above method further comprises: in response to detecting a first movement operation for a first panel, determining a first target position indicated by the first movement operation; determining a panel display style associated with the first target position as a first panel display style of the first panel; and displaying the first panel by adopting the first panel display style on the multimedia conference interface.
Here, the association relationship between the first target position and the panel display style may be preset.
Here, the panel presentation style may include, but is not limited to, at least one of the following of the panel: area, aspect ratio, size, color, pattern.
It should be noted that, according to the first target position, the panel display style is determined, so that the panel display style can adapt to the expected position of the panel in the conference interface.
In some application scenarios, the first panel display style includes a landscape display style and a portrait display style.
Here, the landscape presentation style is related to the top and bottom regions of the conference interface.
Here, the portrait presentation style is associated with a side region of the conference video interface.
Here, the above-mentioned lateral presentation style indicates that the functionality controls are arranged laterally, the lateral arrangement indicating that the functionality controls are arranged approximately parallel to the top (or bottom) edge of the conference interface. The longitudinal display style indicates that the functional controls are longitudinally arranged, and the longitudinal arrangement indicates that the arrangement of the functional controls is approximately parallel to the side edge of the conference interface. The transverse display pattern indicates that the aspect ratio of the first panel is greater than 1, and the longitudinal display pattern indicates that the aspect ratio of the first panel is less than 1.
It should be noted that the first panel is in a landscape display format when in the top or bottom region. The first panel is in a portrait display style when in the side region. The first panel can be displayed as close to the boundary of the conference interface as possible, and shielding of the first panel to main content in the conference interface is reduced.
In some embodiments, the above method further comprises: in response to detecting a first movement operation for the first panel, determining whether to display the first panel at the target position according to whether the target position indicated by the first movement operation is in the displayable region.
Here, the displayable area may be preset, or may be determined by detecting the conference interface in real time.
In some application scenarios, primary content (e.g., video images, shared documents) may not be included in the presentable area.
In some application scenarios, if the target location is within the displayable region, determining to display the first panel at the target location; if the target position is not in the displayable region, the first panel is determined not to be displayed at the target position, and prompt information is displayed to the user for the user to refer to and change the target position.
It should be noted that, setting the displayable area on the first panel can reduce the shielding of the first panel to the main content in the conference interface.
In some embodiments, the above method further comprises: in response to detecting a second movement operation for the second panel, determining a second display position of the second panel according to the target position indicated by the second movement operation; and displaying the second panel at the second display position.
Here, the second display position of the second panel is not limited.
In some embodiments, the displaying the second panel includes: and determining a second panel display style of the second panel according to the number of the target controls, and displaying the second panel by adopting the determined second panel display style.
Here, the number of target controls may be one or at least two.
The second panel display style determined according to the number of the target controls can ensure that the area of the second panel is as small as possible under the condition that the second panel can present all the target controls, so that shielding of a conference interface is reduced.
In some embodiments, the determining a second panel display style of the second panel according to the number of target controls, and displaying the second panel using the determined second panel display style, includes: and in response to determining that the number of the target controls is greater than a preset number threshold, displaying each target control in the stowage state in a split mode.
The target control which is displayed in a split mode can be arranged in the area, such as the corner of the conference interface, which does not comprise main content, so that the corner space of the conference interface can be fully utilized, the space utilization rate of the conference interface is improved, and the shielding of the second panel to the conference interface is further reduced.
In some application scenarios, in response to determining that the number of the target controls is greater than a preset number threshold, the method includes the steps of: and each target control is adsorbed to the side edge of the multimedia conference interface for display. Each target control is adsorbed to the side for displaying, so that the characteristic that the side area does not normally display main contents of the conference can be utilized, the utilization rate of the side area is improved, and shielding of the target control to the conference interface is avoided.
In some embodiments, the determining the second panel display style of the second panel according to the number of the target controls, and displaying the second panel using the determined second panel display style, includes: in response to determining that the number of the target controls is not greater than a preset number threshold, determining the overall display style as a second panel display style; and displaying the second panel according to the integral display mode.
Here, if the number of the target controls is not greater than a preset threshold, for example, not greater than 2, it may be understood that the area of the second panel is insufficient to form a shielding for the multimedia conference interface, so that the second panel may be integrally displayed, and further, a user is prevented from searching for the target controls when operating the target controls, and the operation efficiency is improved.
With further reference to fig. 5, as an implementation of the method shown in the foregoing figures, the present disclosure provides an embodiment of an interaction apparatus, where an embodiment of the apparatus corresponds to the embodiment of the method shown in fig. 1, and the apparatus may be specifically applied to various electronic devices.
As shown in fig. 5, the interaction device of the present embodiment includes: a detection unit 501, a first determination unit and a switching unit 502. The detection unit is used for detecting candidate triggering items in the multimedia conference, wherein the candidate triggering items comprise at least one of the following: the conference state of the multimedia conference and the current operation state of the user; and the switching unit is used for switching the display states of the control panels displayed on the multimedia conference interface in response to the detected candidate triggering items meeting the switching triggering conditions, wherein at least one control is displayed in the control panels in each display state.
In this embodiment, the specific processing and the technical effects of the detection unit 501 and the switching unit 502 of the interaction device may refer to the description related to the steps 101 and 102 in the corresponding embodiment of fig. 1, which is not repeated herein.
In some embodiments, the control panel in the expanded state is a first panel, and the control panel in the collapsed state is a second panel, wherein the first panel presents at least two functional controls, the second panel presents target controls in the at least two functional controls, and the number of target controls in the second panel is smaller than the number of functional controls in the first panel.
In some embodiments, the above-described switch trigger condition includes a panel stow condition; and responding to the detected candidate triggering item meeting the switching triggering condition, switching the display state of the control panel presented on the multimedia conference interface, wherein the display state comprises the following steps: displaying a first panel; determining that a preset panel retraction condition is met, and determining a target control from the at least two functional controls; and stopping displaying the first panel and displaying the second panel on the multimedia conference interface.
In some embodiments, the panel stow condition includes: a predefined stow operation for the first panel is detected.
In some embodiments, the predefined stow operation described above includes at least one of: triggering operation aiming at a preset stowage control; and indicating a movement operation of moving the first panel to a first preset position.
In some embodiments, the panel stow condition includes: the conference state of the multimedia conference is a first predefined conference state.
In some embodiments, the first predefined conference state includes: the duration time of the conference is longer than a preset first time, the state of the shared screen, the state of the shared document, the number of conference participants is greater than a preset number threshold, the number of user images displayed on the multimedia conference interface is greater than a preset number threshold, and the duration time of the first panel which is not operated is longer than a preset second time.
In some embodiments, the apparatus is further configured to: responsive to determining that the conference state of the multimedia conference is a second predefined conference state, redefining a target control; and replacing the redefined target control into the second panel.
In some embodiments, the second predefined conference state includes at least one of: the duration time of the conference is longer than a preset second duration time, the state of the shared screen, the state of the shared document, the number of conference participants is greater than a preset number threshold, and the user image displayed on the multimedia conference interface is greater than a preset image threshold.
In some embodiments, the above-described switch trigger condition includes a panel deployment condition; and responding to the detected candidate triggering item meeting the switching triggering condition, switching the display state of the control panel presented on the multimedia conference interface, wherein the display state comprises the following steps: displaying the second panel; and stopping displaying the second panel and displaying the first panel on the multimedia conference interface in response to determining that the preset panel unfolding condition is met.
In some embodiments, the panel deployment conditions described above include: a predefined unfolding operation for the second panel is detected.
In some embodiments, the predefined unfolding operation described above includes at least one of: triggering operation aiming at a preset unfolding control; and indicating a movement operation of moving the second panel to a second preset position.
In some embodiments, the panel deployment conditions described above include: the conference state of the multimedia conference is a third predefined conference state.
In some embodiments, the third predefined conference state includes: the duration time of the conference is longer than a preset third duration time, the number of conference participants is not greater than a preset number threshold, and the number of user images displayed on the multimedia conference interface is not greater than a preset number threshold.
In some embodiments, the above-described target control is determined by: acquiring selection information of a user, wherein the selection information is used for indicating a target control in the at least two functional controls; and determining the target control according to the selection information.
In some embodiments, the above-described target control is determined by: acquiring historical operation information of a user aiming at a first panel; determining the operation frequency of each functional control according to the historical operation information; and determining a preset number of target controls according to each operation frequency.
In some embodiments, the above-described target control is determined by: and determining the functional control related to the conference state as a target control according to the conference state of the multimedia conference.
In some embodiments, the determining, according to the conference state of the multimedia conference, that the functional control related to the conference state is a target control includes: and in response to determining that the conference state is a sharing state, determining a function control related to the sharing state as a target control, wherein the sharing state indicates that a screen sharing area of the multimedia conference has a state of sharing content.
In some embodiments, the functionality control of the sharing state includes at least one of: the system comprises a labeling control, a sharing state switching control and a sharing object switching control.
In some embodiments, the determining, according to the conference state of the multimedia conference, that the function control for the conference state is a target control includes: and in response to determining that the preset expected meeting end condition is met, determining the functional control related to meeting end as the target control.
In some embodiments, the expected meeting end conditions described above include at least one of: the duration of the multimedia conference is greater than a preset fourth time threshold; determining that the voice recognition result indicates a meeting according to the voice recognition result of the participated object of the multimedia conference; and determining that the preset meeting ending time is reached according to the meeting arrangement information of the multimedia meeting.
In some embodiments, the above-described target control is determined by: and determining the function control related to the current state of the user as a target control according to the current state of the user.
In some embodiments, the user current state includes at least one of: whether the current multimedia conference interface is in a voice input state or not is in a thumbnail display state.
In some embodiments, the above-described target control is determined by: and determining a target control according to the authority of the user in the media conference.
In some embodiments, the determining the target control according to the authority of the user in the media conference includes: in response to determining that the user has conference management rights, a related control of the conference management rights is determined as a target control.
In some embodiments, the determining the target control according to the authority of the user in the media conference includes: and in response to the user having the sharing rights, determining the sharing rights related control as the target control.
In some embodiments, the apparatus is further configured to: in response to detecting a first movement operation for a first panel, determining a first target position indicated by the first movement operation; determining a panel display style associated with the first target position as a first panel display style of the first panel; and displaying the first panel by adopting the first panel display style on the multimedia conference interface.
In some embodiments, the first panel display style includes a landscape display style and a portrait display style, the landscape display style is related to a top area and a bottom area of the conference interface, the portrait display style is related to a side area of the conference video interface, wherein the landscape display style indicates that the functionality controls are horizontally arranged, and the portrait display style indicates that the functionality controls are vertically displayed.
In some embodiments, the apparatus is further configured to: in response to detecting a first movement operation for the first panel, determining whether to display the first panel at the target position according to whether the target position indicated by the first movement operation is in the displayable region.
In some embodiments, the apparatus is further configured to: in response to detecting a second movement operation for the second panel, determining a second display position of the second panel according to the target position indicated by the second movement operation; and displaying the second panel at the second display position.
In some embodiments, the displaying the second panel includes: and determining a second panel display style of the second panel according to the number of the target controls, and displaying the second panel by adopting the determined second panel display style.
In some embodiments, the determining the second panel display style of the second panel according to the number of the target controls, and displaying the second panel using the determined second panel display style, includes: and in response to determining that the number of the target controls is greater than a preset number threshold, displaying each target control in the stowage state in a split mode.
In some embodiments, in response to determining that the number of the target controls is greater than a preset number threshold, the displaying the target controls in the stowed state separately includes: and each target control is adsorbed to the side edge of the multimedia conference interface for display.
In some embodiments, the determining the second panel display style of the second panel according to the number of the target controls, and displaying the second panel using the determined second panel display style, includes: in response to determining that the number of the target controls is not greater than a preset number threshold, determining the overall display style as a second panel display style; and displaying the second panel according to the integral display mode.
In some embodiments, the target control presented in the second panel is obtained by a target control determining manner, where the target control determining manner at least includes at least one of the following steps: determining the target control according to the conference state of the multimedia conference; determining the target control according to configuration operation of a user; determining the target control according to the current state of the user; and determining a target control according to the authority of the user in the multimedia conference.
In some embodiments, the number of the target controls is a preset first number, each step in the target control determining manner has a preset priority, and the target control determining manner is performed in the following manner: and executing all steps in the target control determining mode according to the preset priority level until the number of the target controls reaches the first number.
In some embodiments, the apparatus is further configured to execute the target control determining manner in response to reaching a preset execution triggering condition.
Referring to fig. 6, fig. 6 illustrates an exemplary system architecture in which the interaction method of one embodiment of the present disclosure may be applied.
As shown in fig. 6, the system architecture may include terminal devices 601, 602, 603, a network 604, and a server 605. The network 604 is used as a medium to provide communication links between the terminal devices 601, 602, 603 and the server 605. The network 604 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
The terminal devices 601, 602, 603 may interact with the server 605 via the network 604 to receive or send messages or the like. Various client applications, such as a web browser application, a search class application, a news information class application, may be installed on the terminal devices 601, 602, 603. The client application in the terminal device 601, 602, 603 may receive the instruction of the user and perform the corresponding function according to the instruction of the user, for example, adding the corresponding information in the information according to the instruction of the user.
The terminal devices 601, 602, 603 may be hardware or software. When the terminal devices 601, 602, 603 are hardware, they may be various electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablet computers, electronic book readers, MP3 players (Moving Picture Experts Group Audio Layer III, dynamic video expert compression standard audio plane 3), MP4 (Moving Picture Experts Group Audio Layer IV, dynamic video expert compression standard audio plane 4) players, laptop and desktop computers, and the like. When the terminal devices 601, 602, 603 are software, they can be installed in the above-listed electronic devices. Which may be implemented as multiple software or software modules (e.g., software or software modules for providing distributed services) or as a single software or software module. The present invention is not particularly limited herein.
The server 605 may be a server that provides various services, for example, receives information acquisition requests sent by the terminal devices 601, 602, 603, and acquires presentation information corresponding to the information acquisition requests in various ways according to the information acquisition requests. And related data showing the information is transmitted to the terminal devices 601, 602, 603.
It should be noted that, the interaction method provided by the embodiments of the present disclosure may be performed by the terminal device, and accordingly, the interaction apparatus may be provided in the terminal devices 601, 602, 603. In addition, the interaction method provided by the embodiment of the present disclosure may also be performed by the server 605, and accordingly, the interaction device may be disposed in the server 605.
It should be understood that the number of terminal devices, networks and servers in fig. 6 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring now to fig. 7, a schematic diagram of an electronic device (e.g., a terminal device or server in fig. 5) suitable for use in implementing embodiments of the present disclosure is shown. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 7 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.
As shown in fig. 7, the electronic device may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 701, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 702 or a program loaded from a storage means 708 into a Random Access Memory (RAM) 703. In the RAM703, various programs and data required for the operation of the electronic device 700 are also stored. The processing device 701, the ROM 702, and the RAM703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
In general, the following devices may be connected to the I/O interface 705: input devices 706 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, and the like; an output device 707 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 708 including, for example, magnetic tape, hard disk, etc.; and a communication device 709. The communication means 709 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. While fig. 7 shows an electronic device having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via communication device 709, or installed from storage 708, or installed from ROM 702. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by the processing device 701.
It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: the method is used for detecting candidate triggering items in the multimedia conference, wherein the candidate triggering items comprise at least one of the following: the conference state of the multimedia conference and the current operation state of the user; and switching the display states of the control panels presented in the multimedia conference interface in response to the detected candidate triggering item meeting the switching triggering condition, wherein at least one control is presented in the control panels in each display state.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The name of the unit is not limited to the unit itself in some cases, and for example, the first display unit may be also described as "a unit displaying a browsing object".
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).
Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims (36)

1. An interaction method, comprising:
detecting a candidate trigger in a multimedia conference, wherein the candidate trigger comprises at least one of the following: the conference state of the multimedia conference and the current operation state of the user;
responding to the detected candidate triggering item meeting the switching triggering condition, and switching the display states of the control panels presented in the multimedia conference interface, wherein at least one control is presented in the control panels in each display state;
the control panel in the unfolding state is a first panel, the control panel in the folding state is a second panel, wherein the first panel presents at least two functional controls, the second panel presents target controls in the at least two functional controls, and the number of the target controls of the second panel is smaller than that of the functional controls of the first panel;
The method further comprises the steps of: responsive to determining that the conference state of the multimedia conference is a second predefined conference state, redefining a target control; replacing the redefined target control in the second panel;
the second predefined meeting state includes at least one of: the duration time of the conference is longer than a preset second duration time, the number of conference participants is greater than a preset number threshold, and the number of user images displayed on the multimedia conference interface is greater than a preset number threshold;
the target control is determined by: and determining the functional control related to the conference state as a target control according to the conference state of the multimedia conference.
2. The method of claim 1, wherein the switch trigger condition comprises a panel stow condition; and
the method further comprises the steps of: displaying a first panel; and
and responding to the detected candidate triggering item meeting the switching triggering condition, switching the display state of the control panel displayed on the multimedia conference interface, wherein the display state comprises the following steps:
and determining that a preset panel stowing condition is met, stopping displaying the first panel and displaying the second panel on the multimedia conference interface.
3. The method of claim 2, wherein the panel stow condition comprises:
a predefined stow operation for the first panel is detected.
4. A method according to claim 3, wherein the predefined stow operation comprises at least one of:
triggering operation aiming at a preset stowage control;
and indicating a moving operation of moving the first panel to a first preset position.
5. The method of claim 2, wherein the panel stow condition comprises:
the conference state of the multimedia conference is a first predefined conference state.
6. The method of claim 5, wherein the first predefined conference state comprises: the duration time of the conference is longer than a preset first time, the state of the shared screen, the state of the shared document, the number of conference participants is greater than a preset number threshold, the number of user images displayed on the multimedia conference interface is greater than a preset number threshold, and the duration time of the first panel which is not operated is longer than a preset second time.
7. The method of claim 1, wherein the switch trigger condition comprises a panel deployment condition; and
And responding to the detected candidate triggering item meeting the switching triggering condition, switching the display state of the control panel displayed on the multimedia conference interface, wherein the display state comprises the following steps:
displaying the second panel;
and in response to determining that a preset panel unfolding condition is met, stopping displaying the second panel and displaying the first panel on the multimedia conference interface.
8. The method of claim 7, wherein the panel deployment condition comprises:
a predefined unfolding operation for the second panel is detected.
9. The method of claim 8, wherein the predefined unfolding operation comprises at least one of:
triggering operation aiming at a preset unfolding control;
and indicating a movement operation of moving the second panel to a second preset position.
10. The method of claim 7, wherein the panel deployment condition comprises:
the conference state of the multimedia conference is a third predefined conference state.
11. The method of claim 10, wherein the third predefined conference state comprises: the duration time of the conference is longer than a preset third duration time, the number of conference participants is not greater than a preset number threshold, and the number of user images displayed on the multimedia conference interface is not greater than a preset number threshold.
12. The method of claim 1, wherein the target control is determined by:
acquiring selection information of a user, wherein the selection information is used for indicating a target control in the at least two functional controls;
and determining a target control according to the selection information.
13. The method of claim 1, wherein the target control is determined by:
acquiring historical operation information of a user aiming at a first panel;
determining the operation frequency of each functional control according to the historical operation information;
and determining a preset number of target controls according to each operation frequency.
14. The method according to claim 1, wherein the determining that the functional control related to the conference state is the target control according to the conference state of the multimedia conference includes:
and in response to determining that the conference state is a sharing state, determining a function control related to the sharing state as a target control, wherein the sharing state indicates that a screen sharing area of the multimedia conference has a state of sharing content.
15. The method of claim 14, wherein the shared state functionality control comprises at least one of: the system comprises a labeling control, a sharing state switching control and a sharing object switching control.
16. The method according to claim 1, wherein the determining that the functional control for the conference state is the target control according to the conference state of the multimedia conference includes:
and in response to determining that the preset expected meeting end condition is met, determining the functional control related to meeting end as the target control.
17. The method of claim 16, wherein the expected conference end condition comprises at least one of:
the duration of the multimedia conference is greater than a preset fourth time length threshold;
determining that the voice recognition result indicates a meeting according to the voice recognition result of the participated object of the multimedia conference;
and determining that the preset meeting ending time is reached according to the meeting arrangement information of the multimedia meeting.
18. The method of claim 1, wherein the target control is determined by:
and according to the current state of the user, determining the function control related to the current state of the user as a target control.
19. The method of claim 18, wherein the user current state comprises at least one of: whether the current multimedia conference interface is in a voice input state or not is in a thumbnail display state.
20. The method of claim 1, wherein the target control is determined by:
and determining a target control according to the authority of the user in the multimedia conference.
21. The method of claim 20, wherein the determining the target control according to the rights of the user in the multimedia conference comprises:
in response to determining that the user has conference management rights, a related control of the conference management rights is determined as a target control.
22. The method of claim 20, wherein the determining the target control according to the rights of the user in the multimedia conference comprises:
and in response to the user having the sharing rights, determining the sharing rights related control as the target control.
23. The method according to claim 1, wherein the method further comprises:
in response to detecting a first movement operation for a first panel, determining a first target location indicated by the first movement operation;
determining a panel presentation style associated with the first target location as a first panel presentation style of the first panel;
and displaying the first panel by adopting the first panel display style on the multimedia conference interface.
24. The method of claim 23, wherein the first panel presentation style comprises a landscape presentation style and a portrait presentation style, the landscape presentation style being associated with a top region and a bottom region of the conference interface, the portrait presentation style being associated with a side region of the conference video interface, wherein the landscape presentation style indicates that the functionality controls are arranged landscape, and wherein the portrait presentation style indicates that the functionality controls are presented portrait.
25. The method according to claim 1, wherein the method further comprises:
in response to detecting a first movement operation for a first panel, determining whether to display the first panel at a target position according to whether the target position indicated by the first movement operation is within a displayable region.
26. The method according to claim 1, wherein the method further comprises:
in response to detecting a second movement operation for a second panel, determining a second display position of the second panel according to a target position indicated by the second movement operation;
the second panel is displayed in the second display position.
27. The method of claim 2, wherein displaying the second panel comprises:
And determining a second panel display style of the second panel according to the number of the target controls, and displaying the second panel by adopting the determined second panel display style.
28. The method of claim 27, wherein the determining a second panel display style of the second panel according to the number of target controls and displaying the second panel using the determined second panel display style comprises:
and in response to determining that the number of the target controls is greater than a preset number threshold, displaying each target control in the stowage state in a split mode.
29. The method of claim 28, wherein responsive to determining that the number of target controls is greater than a preset number threshold, displaying each target control in the stowed state separately comprises:
and each target control is adsorbed to the side edge of the multimedia conference interface for display.
30. The method of claim 27, wherein the determining a second panel display style of the second panel according to the number of target controls and displaying the second panel using the determined second panel display style comprises:
Responsive to determining that the number of target controls is not greater than a preset number threshold, determining an overall display style as a second panel display style;
and displaying the second panel according to the integral display style.
31. The method of claim 1, wherein the target control presented in the second panel is obtained by a target control determination method, the target control determination method at least comprising at least one of the following steps:
determining the target control according to the conference state of the multimedia conference;
determining the target control according to configuration operation of a user;
determining the target control according to the current state of the user;
and determining a target control according to the authority of the user in the multimedia conference.
32. The method of claim 31, wherein the number of target controls is a preset first number, each step in the target control determination is of a preset priority, and the target control determination is performed in the following manner:
and executing all steps in the target control determining mode according to the preset priority level until the number of the target controls reaches the first number.
33. The method of claim 32, wherein the method further comprises executing the target control determination mode in response to reaching a preset execution trigger condition.
34. An interactive apparatus, comprising:
the detection unit is used for detecting candidate triggering items in the multimedia conference, wherein the candidate triggering items comprise at least one of the following: the conference state of the multimedia conference and the current operation state of the user;
the switching unit is used for switching the display states of the control panels presented in the multimedia conference interface in response to the detected candidate triggering items meeting the switching triggering conditions, wherein at least one control is presented in the control panels in each display state;
the control panel in the unfolding state is a first panel, the control panel in the folding state is a second panel, wherein the first panel presents at least two functional controls, the second panel presents target controls in the at least two functional controls, and the number of the target controls of the second panel is smaller than that of the functional controls of the first panel;
the device is also for: responsive to determining that the conference state of the multimedia conference is a second predefined conference state, redefining a target control; replacing the redefined target control in the second panel;
The second predefined meeting state includes at least one of: the duration time of the conference is longer than a preset second duration time, the number of conference participants is greater than a preset number threshold, and the number of user images displayed on the multimedia conference interface is greater than a preset number threshold;
the target control is determined by: and determining the functional control related to the conference state as a target control according to the conference state of the multimedia conference.
35. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1-33.
36. A computer readable medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any one of claims 1-33.
CN202010205436.XA 2020-03-22 2020-03-22 Interaction method and device and electronic equipment Active CN112312058B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010205436.XA CN112312058B (en) 2020-03-22 2020-03-22 Interaction method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010205436.XA CN112312058B (en) 2020-03-22 2020-03-22 Interaction method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN112312058A CN112312058A (en) 2021-02-02
CN112312058B true CN112312058B (en) 2023-06-27

Family

ID=74336519

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010205436.XA Active CN112312058B (en) 2020-03-22 2020-03-22 Interaction method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN112312058B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113220179A (en) * 2021-05-07 2021-08-06 Oppo广东移动通信有限公司 Sidebar display method and device, terminal and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105763342A (en) * 2006-09-21 2016-07-13 西门子通讯公司 Apparatus and method for automatic conference initiation
CN108182016A (en) * 2016-12-08 2018-06-19 Lg电子株式会社 Mobile terminal and its control method
CN109669924A (en) * 2018-12-24 2019-04-23 天津字节跳动科技有限公司 Sharing method, device, electronic equipment and the storage medium of online document
CN110708425A (en) * 2019-09-27 2020-01-17 北京字节跳动网络技术有限公司 Message display method and device and electronic equipment

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120150863A1 (en) * 2010-12-13 2012-06-14 Microsoft Corporation Bookmarking of meeting context
US8890929B2 (en) * 2011-10-18 2014-11-18 Avaya Inc. Defining active zones in a traditional multi-party video conference and associating metadata with each zone
US8937636B2 (en) * 2012-04-20 2015-01-20 Logitech Europe S.A. Using previous selection information in a user interface having a plurality of icons
US20150085060A1 (en) * 2013-09-20 2015-03-26 Microsoft Corporation User experience for conferencing with a touch screen display
US9716680B2 (en) * 2014-04-25 2017-07-25 Jordan H. Taler Expandable graphical icon for response to electronic text transmission
US11310294B2 (en) * 2016-10-31 2022-04-19 Microsoft Technology Licensing, Llc Companion devices for real-time collaboration in communication sessions
US10509964B2 (en) * 2017-01-11 2019-12-17 Microsoft Technology Licensing, Llc Toggle view functions for teleconferencing sessions
CN110297574B (en) * 2018-03-23 2022-06-14 斑马智行网络(香港)有限公司 User interface operation method and device
US10895970B2 (en) * 2018-06-13 2021-01-19 Microsoft Technology Licensing, Llc Display control to implement a control bar
CN109101160B (en) * 2018-08-20 2021-07-09 深圳市创凯智能股份有限公司 Terminal control method, terminal, and computer-readable storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105763342A (en) * 2006-09-21 2016-07-13 西门子通讯公司 Apparatus and method for automatic conference initiation
CN108182016A (en) * 2016-12-08 2018-06-19 Lg电子株式会社 Mobile terminal and its control method
CN109669924A (en) * 2018-12-24 2019-04-23 天津字节跳动科技有限公司 Sharing method, device, electronic equipment and the storage medium of online document
CN110708425A (en) * 2019-09-27 2020-01-17 北京字节跳动网络技术有限公司 Message display method and device and electronic equipment

Also Published As

Publication number Publication date
CN112312058A (en) 2021-02-02

Similar Documents

Publication Publication Date Title
CN112135059B (en) Shooting method, shooting device, electronic equipment and storage medium
KR102350329B1 (en) Real-time sharing during a phone call
CN113489937B (en) Video sharing method, device, equipment and medium
CN111510760A (en) Video information display method and device, storage medium and electronic equipment
CN113076048B (en) Video display method and device, electronic equipment and storage medium
CN113891164A (en) Video list display method and device, electronic equipment and storage medium
CN114491349B (en) Page display method, page display device, electronic device, storage medium and program product
WO2023138294A1 (en) Information display method and apparatus, device, and medium
CN114363686B (en) Method, device, equipment and medium for publishing multimedia content
CN113301157A (en) Cloud mobile phone group control method, equipment and storage medium based on android system
CN113521728A (en) Cloud application implementation method and device, electronic equipment and storage medium
CN115379105B (en) Video shooting method, device, electronic equipment and storage medium
CN110611847A (en) Video preview method and device, storage medium and electronic equipment
CN112312058B (en) Interaction method and device and electronic equipment
CN113608816B (en) Progress adjustment method and device, electronic equipment and storage medium
CN113204299B (en) Display method, display device, electronic equipment and storage medium
CN112672092B (en) Display method and device and electronic equipment
CN114095670A (en) Method, device, equipment and medium for switching video personal works
CN112083840A (en) Method, device, terminal and storage medium for controlling electronic equipment
CN110568976A (en) Method, device, equipment and storage medium for controlling application display
CN113286038B (en) Information interaction method and device, electronic equipment and computer readable medium
CN110162265B (en) Sliding control method, device, equipment and storage medium of view control
CN110674624B (en) Method and system for editing graphics context
CN116820311A (en) Cover setting method and device, electronic equipment and storage medium
CN118042205A (en) Interface interaction method, device, medium, electronic equipment and program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant