WO2021238679A1 - 视频通话界面显示控制方法、装置、存储介质及设备 - Google Patents

视频通话界面显示控制方法、装置、存储介质及设备 Download PDF

Info

Publication number
WO2021238679A1
WO2021238679A1 PCT/CN2021/093812 CN2021093812W WO2021238679A1 WO 2021238679 A1 WO2021238679 A1 WO 2021238679A1 CN 2021093812 W CN2021093812 W CN 2021093812W WO 2021238679 A1 WO2021238679 A1 WO 2021238679A1
Authority
WO
WIPO (PCT)
Prior art keywords
window
sub
layout mode
video call
call interface
Prior art date
Application number
PCT/CN2021/093812
Other languages
English (en)
French (fr)
Inventor
张展尘
Original Assignee
北京字节跳动网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京字节跳动网络技术有限公司 filed Critical 北京字节跳动网络技术有限公司
Priority to EP21813626.5A priority Critical patent/EP4161065A4/en
Priority to JP2022572366A priority patent/JP2023528311A/ja
Priority to BR112022023996A priority patent/BR112022023996A2/pt
Priority to KR1020227042163A priority patent/KR20230004851A/ko
Publication of WO2021238679A1 publication Critical patent/WO2021238679A1/zh
Priority to US17/818,629 priority patent/US11853543B2/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486—Drag-and-drop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438—Window management, e.g. event handling following interaction with the user interface
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation

Definitions

  • the embodiments of the present disclosure relate to the field of computer technology, and in particular to a method, device, storage medium, and equipment for controlling the display of a video call interface.
  • video call functions are becoming more and more popular.
  • multiple video windows are usually used to display the video images of both or multiple parties at the same time.
  • the display method of each window may affect the final display effect. Therefore, reasonable control of the display of the video call interface is required .
  • buttons and other controls fixed on the video call interface Buttons not only occupy the space of the video call interface, but also affect the beauty of the video call interface. Therefore, the existing video call interface
  • the display control scheme is not perfect and needs to be improved.
  • the embodiments of the present disclosure provide a video call interface display control method, device, storage medium, and equipment, which can optimize the existing video call interface display control scheme.
  • embodiments of the present disclosure provide a method for controlling the display of a video call interface, including:
  • a video call interface display control device including:
  • the video call interface includes at least two windows for displaying video images, and the device includes:
  • the layout mode determination module is used to determine the current layout mode of the video call interface
  • the gesture operation detection module is used to detect the gesture operation acting on the video call interface
  • the display control module is configured to control the video call interface to switch to another corresponding layout mode when it is determined that the gesture operation meets the preset switching condition corresponding to the current layout mode.
  • embodiments of the present disclosure provide a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, it implements the video call interface display control method provided in the embodiments of the present disclosure.
  • the embodiments of the present disclosure provide an electronic device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor.
  • the embodiment provides a video call interface display control method.
  • embodiments of the present disclosure provide a computer program product, the computer program product includes: a computer program, the computer program is stored in a readable storage medium, and at least one processor of an electronic device can download A storage medium is read to read the computer program, and the at least one processor executes the computer program, so that the electronic device executes the method of any one of the above-mentioned first aspects.
  • the embodiments of the present disclosure provide a computer program, the computer program is stored in a readable storage medium, and at least one processor of an electronic device can read the above computer program from the readable storage medium.
  • the at least one processor executes the computer program, so that the electronic device executes the method of any one of the above-mentioned first aspects.
  • the video call interface display control solution provided in the embodiments of the present disclosure determines the current layout mode of the video call interface, detects gesture operations acting on the video call interface, and determines that the gesture operations meet the preset switching conditions corresponding to the current layout mode When, control the video call interface to switch to another corresponding layout mode.
  • the layout mode of the video call interface can be switched efficiently and conveniently using gesture operations, and switching entries such as buttons are omitted, which can save the space of the video call interface and make the video call interface more beautiful.
  • FIG. 1 is a schematic flowchart of a method for controlling display of a video call interface according to an embodiment of the present disclosure
  • FIG. 2 is a schematic flowchart of another method for controlling display of a video call interface provided by an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of a layout mode switching process provided by an embodiment of the present disclosure.
  • FIG. 4 is a schematic flowchart of another method for controlling display of a video call interface according to an embodiment of the present disclosure
  • FIG. 5 is a schematic diagram of another layout mode switching process provided by an embodiment of the present disclosure.
  • FIG. 6 is a structural block diagram of a video call interface display control device provided by an embodiment of the disclosure.
  • FIG. 7 is a structural block diagram of an electronic device provided by an embodiment of the disclosure.
  • each embodiment provides optional features and examples at the same time.
  • the various features recorded in the embodiments can be combined to form multiple alternative solutions.
  • Each numbered embodiment should not be regarded as It is a technical solution.
  • Figure 1 is a schematic flow chart of a method for controlling the display of a video call interface provided by an embodiment of the present disclosure.
  • the method can be executed by a video call interface display control device, where the device can be implemented by software and/or hardware, and generally can be integrated in an electronic device. middle.
  • the electronic device may be, for example, a mobile phone, a tablet computer, a notebook computer, a personal digital assistant, and other devices with a video call function.
  • the method includes:
  • Step 101 Determine the current layout mode of the video call interface.
  • the video call function can usually support a one-to-one two-person call mode, and can also support a multi-person call mode.
  • the video call interface may include at least two windows for displaying video images.
  • the two-person call mode there can be two video windows (hereinafter referred to as windows), which are used to display the video images of the two parties in the call; in the multi-person call mode, there can be two or more windows, which are used to display the multiple parties Video screens of at least two parties in.
  • windows video windows
  • the video image is generally a real-time call image, such as an image captured in real time by an image capture device (such as a camera, etc.) in an electronic device used by the caller.
  • the window layout rules are different.
  • the layout rules may include at least one or a combination of the following: nesting relationship between windows, adjacency relationship between windows, plane arrangement order of windows, stacking order of window levels, window display position, window The display size and the shape of the window, etc.
  • Step 102 Detect the gesture operation acting on the video call interface.
  • the screen of the electronic device may be a touch screen
  • the gesture operation may be a touch gesture operation acting on the video call interface displayed on the screen
  • the screen of the electronic device may also be another type of screen.
  • the gesture The operation may also be an air gesture operation corresponding to the video call interface displayed on the screen.
  • the gesture operation can also be an air gesture operation.
  • the detection methods corresponding to different types of gesture operations can be different, and the specific settings can be set according to the actual situation. For example, touch gesture operations can be detected through the touch screen; space gesture operations can be detected through components such as ultrasonic sensors on electronic devices.
  • Step 103 When it is determined that the gesture operation meets the preset switching condition corresponding to the current layout mode, control the video call interface to switch to another corresponding layout mode.
  • switching conditions when switching between different layout modes may be preset, and the switching conditions may include specific gesture operation information.
  • the gesture operation information can include gesture types (such as tap, double tap, long press, drag, and two-finger or multi-finger sliding and other multi-touch gestures), and can also include sliding track, gesture action area, and gesture action Duration and so on.
  • a first layout mode corresponds to the first preset switching condition
  • switching from the second layout mode to the first layout mode corresponds to the second preset switching condition
  • switching from the first layout mode to the third layout mode corresponds to the fourth preset switching condition
  • switching from the second layout mode to the third layout mode corresponds to the fifth preset switching condition, from the third layout
  • the mode switching to the second layout mode corresponds to the sixth preset switching condition.
  • the current layout mode After determining the current layout mode, you can determine which layout modes the current layout mode can switch to, and then compare the detected gesture operations with the corresponding preset switching conditions. When the corresponding preset switching conditions are met, Control the video call interface to switch to another corresponding layout mode. For example, taking the above-mentioned three layout modes as an example, assuming that the current layout mode is the first layout mode, it is possible to switch to the second layout mode or the third layout mode, and it can be determined that the preset switching condition that needs to be compared is The first preset switching condition and the third preset switching condition.
  • the video call interface includes at least two windows for displaying video images, determines the current layout mode of the video call interface, and detects gestures acting on the video call interface Operation, when it is determined that the gesture operation meets the preset switching condition corresponding to the current layout mode, control the video call interface to switch to another corresponding layout mode.
  • the video call interface has at least a first layout mode and a second layout mode.
  • the first layout mode includes a main window and at least one sub-window, and at least one sub-window is nested in the main window;
  • the second layout mode includes at least two side-by-side windows, and each side-by-side window displays a complete video screen of the calling party .
  • the advantage of this setting is that the two modes can basically meet the needs of different scenarios, reduce the amount of calculation, and improve the switching speed.
  • the main window generally occupies the entire video call interface. If each window corresponds to a layer, the main window is located at the bottom layer, and the sub-windows are located at the top or middle layer.
  • the display size of the sub-windows is generally small. For example, 1/16 of the main window, therefore, the sub-window will only cover a smaller part of the video screen in the main window.
  • the arrangement of side-by-side windows is not limited, and can be determined according to the screen size or screen display mode of the electronic device (such as horizontal screen display or vertical screen display). Taking the existence of two parallel windows as an example, they can be arranged up and down. For example, the first side-by-side window occupies the upper half of the video call interface, the second side-by-side window occupies the lower half of the video call interface, and the two can also be arranged side by side. . Taking the existence of four parallel windows as an example, the four windows may be arranged in a "tian" font, etc., and the display sizes of the four windows may be equal or unequal.
  • control the video call interface to switch to the corresponding Another layout mode of the includes: when it is determined according to the gesture operation that the first sub-window is dragged within the first preset area in the center of the video call interface, switching and displaying the main window to the second layout The first side-by-side window in the mode, and the first sub-window is displayed in its original size in the video frame corresponding to the second side-by-side window; after determining that the first sub-window is released according to the gesture operation, the The first sub-window is switched and displayed to occupy the video frame.
  • the advantage of this setting is that it can conveniently and accurately switch from the first layout mode to the second layout mode.
  • the position of the first parallel window may be determined according to the position of the first sub-window within the range of the first preset area.
  • the first preset area range can be set according to actual needs.
  • the video call interface can be divided into three equal parts from left to right, and the area corresponding to the middle area can be regarded as the first preset area range.
  • the drag can be understood as pressing and sliding, and can be a single-finger or multi-finger operation.
  • the video frame can be understood as the boundary corresponding to the second side-by-side window, and can be regarded as the indicator of the corresponding result given by the system, prompting the user to switch the display effect.
  • the background of the video frame is not limited, for example, it can be black or white. If the user is satisfied with the effect of the switch, he can release his finger, so that the size of the first sub-window can become the same as the video frame, completing the final switch.
  • the method further includes: The sub-window is displayed in the video frame corresponding to the third parallel window according to its original size, or the second sub-window is switched and displayed as the third parallel window.
  • the second sub-window can generally refer to sub-windows other than the first sub-window, and the specific number can be one or more;
  • the third side-by-side window can generally refer to side-by-side windows other than the first side-by-side window and the second side-by-side window,
  • the specific number can be one or more.
  • the number of the second sub-window and the third side-by-side window can generally be the same.
  • control the video call interface to switch to the corresponding Another layout mode of the method includes: switching and displaying the second parallel window as the The main window in the first layout mode, the first side-by-side window is switched and displayed as the first sub-window; after determining that the first sub-window is released according to the gesture operation, the first sub-window
  • the display position of is fixed. The advantage of this setting is that it can conveniently and accurately switch from the second layout mode to the first layout mode. Further, the fixed display position of the first sub-window can be determined according to the position of the first sub-window before being released.
  • the second preset area range can be set according to actual needs. For example, after the video call interface is divided into three equal parts from left to right, the areas corresponding to the left area and the right area are taken as the first preset area range.
  • the method further includes: when it is determined that the gesture operation is a zooming operation acting on the first window, adjusting the zooming operation according to the zooming operation. Describe the display size of the first window.
  • the zoom operation can be, for example, two-finger zoom or multi-finger zoom.
  • the contact point is the starting point and slides toward the center.
  • the first window can be a window in any layout mode.
  • the display size of the first window can be dynamically changed with the zoom operation, and when the first window is released, the display size of the first window is fixed. If the first window is a window in the second layout mode, when the size of the first window changes, the sizes of other parallel windows can be adjusted adaptively.
  • control the video call interface to switch to the corresponding Another layout mode includes: when it is determined according to the gesture operation that the size of the first sub-window is enlarged to a first preset size threshold, switching and displaying the main window as the first side-by-side window in the second layout mode At the same time, the first sub-window is displayed in the video frame corresponding to the second side-by-side window according to the current size; after the first sub-window is determined to be released according to the gesture operation, the first sub-window is switched Display until it fills up the video frame.
  • the advantage of such a setting is that the switch from the first layout mode to the second layout mode can be conveniently and accurately realized, and it can be combined with the above-mentioned solution of adjusting the window display size through a zooming operation.
  • the first preset size threshold can be set according to actual needs, and the size can be characterized by length, width, or area. For example, the area corresponding to the first preset size threshold is one third of the video call interface.
  • the position of the first parallel window can be determined according to the position of the first sub-window after being enlarged.
  • control the video call interface to switch to the corresponding Another layout mode includes: when it is determined according to the gesture operation that the size of the first side-by-side window is reduced to a second preset size threshold, switching and displaying the second side-by-side window as the main window in the first layout mode , Simultaneously switching and displaying the first side-by-side window as a first sub-window; after determining that the first sub-window is released according to the gesture operation, the display position of the first sub-window is fixed.
  • the advantage of such a setting is that the switch from the second layout mode to the first layout mode can be conveniently and accurately realized, and it can be combined with the above-mentioned solution of adjusting the window display size through a zooming operation.
  • the second preset size threshold can be set according to actual needs, and the size can be characterized by length, width, or area. For example, the area corresponding to the second preset size threshold is one-fourth of the video call interface.
  • the position of the first sub-window can be determined according to the position where the first parallel window is reduced.
  • the method may further include: Display in the video frame corresponding to the third side-by-side window according to the original size, or switch and display the second sub-window as the third side-by-side window.
  • gesture operations can also be used to adjust the display position of the window.
  • the method further includes: determining that the first parallel window is directed to the second When the two parallel windows are moved and the overlapping area of the first parallel window and the second parallel window reaches the first area threshold, the display positions of the first parallel window and the second parallel window are exchanged.
  • the advantage of such a setting is that the display position of the parallel windows can be adjusted conveniently and the flexibility of the layout mode can be enhanced.
  • the first area threshold may be a fixed value, or may be the product of the area of the first parallel window or the second parallel window and a preset coefficient, which can be set according to actual requirements.
  • the current layout mode is the first layout mode
  • the display position of a sub-window when it is detected that the first sub-window is released, the first sub-window is fixed.
  • the advantage of such a setting is that the display position of the sub-window can be adjusted conveniently and the flexibility of the layout mode can be enhanced.
  • the main window is switched to display in the second layout mode.
  • the first side-by-side window for another example, when it is determined according to the gesture operation that the first sub-window is dragged to the first preset area in the center of the screen with two fingers, the main window is switched and displayed as the first in the second layout mode Parallel windows.
  • the method further includes: determining a first sub-window according to the gesture operation When being dragged into the range of the third preset area in the main window, the display positions of the first sub-window and the main window are exchanged.
  • the advantage of this setting is that the switching methods of the main window can be enriched, and the operation process is more intuitive.
  • the center of the third preset area range may coincide with the center of the main window, and the specific boundary may be set according to actual needs.
  • the method further includes: When the first preset gesture operation is performed on the first sub-window, other sub-windows are hidden under the first sub-window; when the second preset gesture operation acting on the first sub-window is detected, mutual Change the video images of the first sub-window and the second sub-window hidden under the first sub-window; when the third preset gesture operation acting on the first sub-window is detected, it will be hidden in All the sub-windows under the first sub-window are switched to the topmost layer of the video call interface for display.
  • the advantage of this setting is that in the multi-person call mode, the sub-windows corresponding to some call parties can be stacked, reducing the occupation of the display area of the main window, and at the same time, the stacking mode and stacking order can be flexibly controlled by gesture operations.
  • the above three preset gesture operations can be set freely.
  • the first preset gesture operation may be a long press
  • the second preset gesture operation may be a tap
  • the third preset gesture operation may also be a long press.
  • FIG. 2 is a schematic flowchart of another method for controlling the display of a video call interface provided by an embodiment of the present disclosure. Taking the one-to-one call mode as an example, as shown in FIG. 2, the method includes:
  • Step 201 Determine that the current layout mode of the video call interface is the first layout mode.
  • FIG 3 is a schematic diagram of a layout mode switching process provided by an embodiment of the present disclosure.
  • the video call interface in the first layout mode (also known as the large screen mode) is shown in the interface a in Figure 3, which contains the main window 301 (that is, the large Screen, indicated by diagonal shading) and sub-window 302 (small screen).
  • Step 202 Detect the gesture operation acting on the video call interface.
  • Step 203 When it is determined according to the gesture operation that the sub-window is dragged to the range of the first preset area in the center of the video call interface, the main window is switched and displayed as the first side-by-side window in the second layout mode, and the sub-window is displayed according to the The original size is displayed in the video frame corresponding to the second side-by-side window.
  • the video call interface is divided into three areas by two dotted lines, and the middle area may correspond to the first preset area range.
  • the display position of the sub-window can be changed in real time during the dragging process.
  • the main window is displayed as the first side by side in the second layout mode (there are two side-by-side windows distributed vertically, also known as the upper and lower screen mode) Window 303. Since the sub-window 302 is dragged to the upper half of the first preset area, the main window can be displayed as the first side-by-side window 303 located in the lower half of the entire video call interface, and is located on the upper side.
  • the corresponding video frame 304 is displayed at the position of the second side-by-side window of half, and the sub-window 302 is displayed in the video frame 304. In this way, the user can more intuitively see the expected effect after the switch, which is more in line with the user's intuition than the switch method directly by clicking a button.
  • Step 204 After determining that the sub-window is released according to the gesture operation, switch and display the sub-window to a full video frame.
  • the user when the user feels that it meets his switching expectations, he can release his finger to complete the switching from the first layout mode to the second layout mode.
  • the effect after the switching is shown in the c interface in Figure 3, the sub-window After 302 occupies the video frame, it becomes the second parallel window 305 in the second layout mode.
  • a zoom operation can also be applied to the sub-window with two fingers, thereby dynamically adjusting the display size of the sub-window.
  • the internally displayed video screen can be adjusted adaptively according to the size of the window. If the size is reduced, the display of video screens other than the portrait part can be reduced.
  • Step 205 When it is determined according to the gesture operation that the first side-by-side window moves to the second side-by-side window and the overlapping area of the first side-by-side window and the second side-by-side window reaches the first area threshold, the first side-by-side window and the second side-by-side window are exchanged Display position.
  • the second layout mode you can use gesture operations such as drag to move one of the side-by-side windows to the other side-by-side window, thereby realizing the exchange of the display positions of the two.
  • drag the first parallel window 303 to move to the second parallel window 305.
  • part of the window can be allowed to be hidden.
  • the display area of the first parallel window 303 in the interface d is smaller than c The display area of the first parallel window 303 in the interface. If the overlapping area of the first parallel window 303 and the second parallel window 305 reaches the first area threshold, the positions are exchanged.
  • the positions can be exchanged.
  • the display effect is as shown in the e interface in Figure 3.
  • Step 206 When it is determined according to the gesture operation that the first side-by-side window is dragged to the second preset area on both sides of the video call interface, the second side-by-side window is switched and displayed as the main window in the first layout mode, and the The first side-by-side window is switched and displayed as a sub-window.
  • the first side-by-side window 303 in the f interface has been dragged to Within the range of the second preset area, the second side-by-side window 305 can be switched and displayed as the new main window 306 in the first layout mode.
  • the first parallel window 303 is switched and displayed as a new sub-window 307.
  • Step 207 After determining that the first sub-window is released according to the gesture operation, fix the display position of the first sub-window.
  • the video call interface display control method provided by the embodiments of the present disclosure can use gesture operations such as dragging to flexibly and conveniently switch between the large and small screen layout modes and the top and bottom screen layout modes, and in different layout modes, gesture operations can also be used Flexible adjustment of the display size or display position of each window makes the display mode of the video call interface more diversified, and switches such as buttons are omitted, which can save the space of the video call interface and make the video call interface more beautiful.
  • FIG. 4 is a schematic flowchart of another method for controlling the display of a video call interface provided by an embodiment of the present disclosure. Taking a multi-call mode (for the sake of explanation, it is assumed to be a three-party call) as an example, as shown in FIG. 4, the method includes:
  • Step 401 Determine that the current layout mode of the video call interface is the first layout mode.
  • FIG. 5 is a schematic diagram of another layout mode switching process provided by an embodiment of the present disclosure.
  • the video call interface in the first layout mode is the interface a in FIG. 5, which includes a main window 501, a first sub-window 502, and a second Child window 503.
  • the second sub-window 503 can be hidden under the first sub-window 502 through gesture operations (such as long pressing the first sub-window 502), and it can also be switched (such as clicking the first sub-window 502). )
  • the stacking sequence of the second sub-window 503 and the first sub-window 502, that is, the first sub-window 502 is hidden under the second sub-window 503, and both sub-windows can also be restored to display, such as long pressing the currently displayed sub-window.
  • Step 402 Detect the gesture operation acting on the video call interface.
  • Step 403 When it is determined according to the gesture operation that the size of the first sub-window is enlarged to the first preset size threshold, switch and display the main window as the first side-by-side window in the second layout mode, and switch and display the second sub-window as The third side-by-side window in the second layout mode simultaneously displays the first sub-window in the video frame corresponding to the second side-by-side window according to the current size.
  • the main window 501 is switched and displayed as the first side-by-side window 504 in the second layout mode, and the second sub-window The window switching is displayed as the third side-by-side window 505, and the first sub-window 502 is displayed in the video frame 506 corresponding to the second side-by-side window according to the current size.
  • Step 404 After determining that the sub-window is released according to the gesture operation, switch and display the first sub-window to a full video frame.
  • the user when the user feels that they meet their switching expectations, they can release their finger to complete the switching from the first layout mode to the second layout mode.
  • the effect after the switching is shown in the c interface in Figure 5, the sub-window After 502 occupies the video frame, it becomes the second parallel window 507 in the second layout mode.
  • Step 405 When it is determined according to the gesture operation that the size of the first side-by-side window is reduced to the second preset size threshold, switch and display the second side-by-side window as the main window in the first layout mode, and at the same time switch and display the first side-by-side window It is the first sub-window, and the third side-by-side window is switched and displayed as the second sub-window.
  • the size of the first parallel window 504 is reduced, and is about to reach the second preset size threshold.
  • the second side-by-side window is switched and displayed as the new main window 508 in the first layout mode, and the first side-by-side window 504 is switched and displayed as the new The first sub-window 509 switches and displays the third parallel window 505 as a new second sub-window 510.
  • the position of the new second sub-window 510 can be restored to the original position first, that is, the position in the a interface, of course, it can also be other positions, which can be set according to actual needs.
  • Step 406 After determining that the first sub-window is released according to the gesture operation, fix the display positions of the first sub-window and the second sub-window.
  • the video call interface display control method provided by the embodiments of the present disclosure can use gesture operations such as finger zooming to flexibly and conveniently switch between the large and small screen layout modes and the upper and lower screen layout modes, and in different layout modes, gesture operations can also be used Flexible adjustment of the display size or display position of each window makes the display mode of the video call interface more diversified, and switches such as buttons are omitted, which can save the space of the video call interface and make the video call interface more beautiful.
  • gesture operations such as finger zooming to flexibly and conveniently switch between the large and small screen layout modes and the upper and lower screen layout modes, and in different layout modes, gesture operations can also be used
  • Flexible adjustment of the display size or display position of each window makes the display mode of the video call interface more diversified, and switches such as buttons are omitted, which can save the space of the video call interface and make the video call interface more beautiful.
  • FIG. 6 is a structural block diagram of a video call interface display control device provided by an embodiment of the present disclosure.
  • the device can be implemented by software and/or hardware, generally can be integrated in electronic equipment, and can be performed by executing a video call interface display control method The display control of the video call interface.
  • the device includes:
  • the layout mode determining module 601 is used to determine the current layout mode of the video call interface
  • the gesture operation detection module 602 is configured to detect gesture operations acting on the video call interface
  • the display control module 603 is configured to control the video call interface to switch to another corresponding layout mode when it is determined that the gesture operation meets the preset switching condition corresponding to the current layout mode.
  • the video call interface display control device provided in the embodiments of the present disclosure can use gesture operations to efficiently and conveniently switch the layout mode of the video call interface, and omits the switch entry such as buttons, which can save the space of the video call interface and make the video call interface More beautiful.
  • the video call interface has at least a first layout mode and a second layout mode;
  • the first layout mode includes a main window and at least one sub-window, and the at least one sub-window is nested in the main window.
  • Window includes at least two parallel windows, each of the parallel windows displays a complete video picture of the calling party.
  • the display control module may be configured to: if the current layout mode is the first layout mode, determine according to the gesture operation that the first sub-window is dragged to the first preset area in the center of the video call interface When the main window is switched and displayed as the first side-by-side window in the second layout mode, and at the same time, the first sub-window is displayed in the video frame corresponding to the second side-by-side window according to the original size; After the operation determines that the first sub-window is released, the first sub-window is switched and displayed to fill the video frame.
  • the display control module is further configured to: if a second sub-window is included in the current layout mode, while displaying the first sub-window in the video frame corresponding to the second side-by-side window, The second sub-window is displayed in the video frame corresponding to the third parallel window according to its original size, or the second sub-window is switched and displayed as the third parallel window.
  • the display control module may be configured to: if the current layout mode is the second layout mode, determine according to the gesture operation that the first parallel window is dragged to the second preset area on both sides of the video call interface When it is within the range, the second side-by-side window is switched and displayed as the main window in the first layout mode, and the first side-by-side window is switched and displayed as the first sub-window; after determining the first side-by-side window according to the gesture operation After the sub-window is released, the display position of the first sub-window is fixed.
  • the display control module may be configured to: if the current layout mode is the first layout mode, switch the main window when it is determined according to the gesture operation that the size of the first sub-window is enlarged to a first preset size threshold Is displayed as the first side-by-side window in the second layout mode, and at the same time, the first sub-window is displayed in the video frame corresponding to the second side-by-side window according to the current size; and the first sub-window is determined according to the gesture operation. After the window is released, the first sub-window is switched and displayed to fill the video frame.
  • the display control module may be used for: if the current layout mode is the second layout mode, when it is determined according to the gesture operation that the size of the first parallel window is reduced to a second preset size threshold, the second parallel window Window switching is displayed as the main window in the first layout mode, and the first side-by-side window is switched and displayed as the first sub-window; after determining that the first sub-window is released according to the gesture operation, the The display position of the first sub-window is fixed.
  • the display control module may be configured to: if the current layout mode is the second layout mode, after the detection of the gesture operation acting on the video call interface, the first parallel is determined according to the gesture operation When the window is moved to the second parallel window and the overlapping area of the first parallel window and the second parallel window reaches the first area threshold, the display positions of the first parallel window and the second parallel window are exchanged.
  • the display control module may be configured to: after detecting the gesture operation acting on the video call interface, when it is determined that the gesture operation is a zoom operation acting on the first window, adjust according to the zoom operation The display size of the first window.
  • the display control module may be configured to: if the current layout mode is the first layout mode, after the detection of the gesture operation acting on the video call interface, determine the first sub-mode according to the gesture operation When the window is dragged into the third preset area in the main window, the display positions of the first sub-window and the main window are exchanged.
  • the display control module may be configured to: if the current layout mode is the first layout mode and there are at least two sub-windows, after detecting the gesture operation acting on the video call interface, after detecting the effect During the first preset gesture operation on the first sub-window, hide other sub-windows under the first sub-window; when the second preset gesture operation acting on the first sub-window is detected, Exchange the video images of the first sub-window and the second sub-window hidden under the first sub-window; when the third preset gesture operation acting on the first sub-window is detected, it will be hidden All sub-windows under the first sub-window are switched to the topmost layer of the video call interface for display.
  • FIG. 7 shows a schematic structural diagram of an electronic device 700 suitable for implementing embodiments of the present disclosure.
  • the electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals (e.g. Mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, etc.
  • the electronic device shown in FIG. 7 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
  • the electronic device 700 may include a processing device (such as a central processing unit, a graphics processor, etc.) 701, which may be based on a program stored in a read-only memory (read-only memory, ROM) 702 or from a storage device 708 is loaded into a program in a random access memory (RAM) 703 to execute various appropriate actions and processing.
  • a processing device such as a central processing unit, a graphics processor, etc.
  • ROM read-only memory
  • RAM random access memory
  • various programs and data required for the operation of the electronic device 700 are also stored.
  • the processing device 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704.
  • An input/output (I/O) interface 705 is also connected to the bus 704.
  • the following devices can be connected to the I/O interface 705: including input devices 706 such as touch screens, touch panels, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; including, for example, liquid crystal displays (LCD) , Output devices 707 such as speakers, vibrators, etc.; storage devices 708 including, for example, magnetic tapes, hard disks, etc.; and communication devices 709.
  • the communication device 709 may allow the electronic device 700 to perform wireless or wired communication with other devices to exchange data.
  • FIG. 7 shows an electronic device 700 having various devices, it should be understood that it is not required to implement or have all of the illustrated devices. It may be implemented alternatively or provided with more or fewer devices.
  • an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer readable medium, and the computer program contains program code for executing the method shown in the flowchart.
  • the computer program may be downloaded and installed from the network through the communication device 709, or installed from the storage device 708, or installed from the ROM 702.
  • the processing device 701 the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
  • the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium.
  • the computer-readable signal medium may send, propagate or transmit the program for use by or in combination with the instruction execution system, apparatus, or device .
  • the program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device.
  • the above-mentioned computer-readable medium carries one or more programs.
  • the electronic device determines the current layout mode of the video call interface; Gesture operation on the interface; when it is determined that the gesture operation satisfies the preset switching condition corresponding to the current layout mode, control the video call interface to switch to another corresponding layout mode.
  • the computer program code used to perform the operations of the present disclosure can be written in one or more programming languages or a combination thereof.
  • the above-mentioned programming languages include, but are not limited to, object-oriented programming languages—such as Java, Smalltalk, C++, and Including conventional procedural programming languages-such as "C" language or similar programming languages.
  • the program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server.
  • the remote computer can be connected to the user's computer through any kind of network-including local area network (LAN) or wide area network (WAN)-or it can be connected to an external computer (for example, use an Internet service provider to connect via the Internet).
  • LAN local area network
  • WAN wide area network
  • the embodiments of the present disclosure also provide a computer program, the computer program is stored in a readable storage medium, at least one processor of an electronic device can read the computer program from the readable storage medium, and the at least A processor executes the computer program, so that the electronic device executes the method provided in any of the foregoing embodiments.
  • each block in the flowchart or block diagram can represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logic function.
  • Executable instructions can also occur in a different order from the order marked in the drawings. For example, two blocks shown one after the other can actually be executed substantially in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved.
  • each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by a combination of dedicated hardware and computer instructions.
  • the modules involved in the embodiments described in the present disclosure can be implemented in software or hardware. Among them, the name of the module does not constitute a limitation on the module itself under certain circumstances.
  • the layout mode determination module can also be described as "a module that determines the current layout mode of the video call interface.”
  • exemplary types of hardware logic components include: field programmable gate array (FPGA), application specific integrated circuit (ASIC), and application specific standard products (application specific standard parts, ASSP), system on chip (SOC), complex programmable logic device (CPLD), etc.
  • FPGA field programmable gate array
  • ASIC application specific integrated circuit
  • ASSP application specific standard parts
  • SOC system on chip
  • CPLD complex programmable logic device
  • a machine-readable medium may be a tangible medium, which may contain or store a program for use by the instruction execution system, apparatus, or device or in combination with the instruction execution system, apparatus, or device.
  • the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • the machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing.
  • machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read-only memory
  • EPROM or flash memory erasable programmable read-only memory
  • CD-ROM compact disk read only memory
  • magnetic storage device or any suitable combination of the foregoing.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本公开实施例公开了视频通话界面显示控制方法、装置、存储介质及设备。该方法包括：确定视频通话界面所处的当前布局模式，检测作用于所述视频通话界面上的手势操作，在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式。通过采用上述技术方案，可以利用手势操作高效便捷地切换视频通话界面的布局模式，且省略了按钮等切换入口，可以节省视频通话界面的空间，也使得视频通话界面更加美观。

Description

视频通话界面显示控制方法、装置、存储介质及设备
相关申请的交叉引用
本申请要求于2020年5月25日提交中国专利局、申请号为202010458529.3、申请名称为“视频通话界面显示控制方法、装置、存储介质及设备”的中国专利申请的优先权，其全部内容通过引用并入本文。
技术领域
本公开实施例涉及计算机技术领域，尤其涉及视频通话界面显示控制方法、装置、存储介质及设备。
背景技术
随着互联网和智能终端的快速发展，视频通话功能越来越普及。在视频通话界面中通常会利用多个视频窗口同时显示通话双方或多方的视频画面，每个窗口的显示方式均可能会影响最终的显示效果，因此，需要针对视频通话界面的显示进行合理的控制。
例如，针对多个窗口可以设置不同的布局模式，根据实际情况进行切换。目前，实现视频通话界面布局切换的方案需要依赖固定在视频通话界面上的按钮等控件实现，按钮不仅占用视频通话界面的空间，且会影响视频通话界面的美观，因此，现有的视频通话界面显示控制方案不够完善，需要改进。
发明内容
本公开实施例提供了视频通话界面显示控制方法、装置、存储介质及设备，可以优化现有的视频通话界面显示控制方案。
第一方面，本公开实施例提供了一种视频通话界面显示控制方法，包括：
确定视频通话界面所处的当前布局模式；
检测作用于所述视频通话界面上的手势操作；
在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式。
第二方面，本公开实施例提供了一种视频通话界面显示控制装置，包括：
所述视频通话界面中包含至少两个用于显示视频画面的窗口，所述装置包括：
布局模式确定模块，用于确定视频通话界面所处的当前布局模式；
手势操作检测模块，用于检测作用于所述视频通话界面上的手势操作；
显示控制模块，用于在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式。
第三方面，本公开实施例提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本公开实施例提供的视频通话界面显示控制方法。
第四方面，本公开实施例提供了一种电子设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述计算机程序时实现如本公开实施例提供的视频通话界面显示控制方法。
第五方面，本公开实施例提供了一种计算机程序产品，所述计算机程序产品包括：计算机程序，所述计算机程序存储在可读存储介质中，电子设备的至少一个处理器可以从所述可读存储介质读取所述计算机程序，所述至少一个处理器执行所述计算机程序，使得所述电子设备执行上述第一方面中任一项的方法。
第六方面，本公开实施例提供了一种计算机程序，所述计算机程序存储在可读存储介质中，电子设备的至少一个处理器可以从所述可读存储介质中读取上述计算机程序，所述至少一个处理器执行所述计算机程序，使得所述电子设备执行上述第一方面中任一项的方法。本公开实施例中提供的视频通话界面显示控制方案，确定视频通话界面所处的当前布局模式，检测作用于视频通话界面上的手势操作，在确定手势操作满足当前布局模式对应的预设切换条件时，控制视频通话界面切换至对应的另一布局模式。通过采用上述技术方案，可以利用手势操作高效便捷地切换视频通话界面的布局模式，且省略了按钮等切换入口，可以节省视频通话界面的空间，也使得视频通话界面更加美观。
附图说明
图1为本公开实施例提供的一种视频通话界面显示控制方法的流程示意图；
图2为本公开实施例提供的又一种视频通话界面显示控制方法的流程示意图；
图3本公开实施例提供的一种布局模式切换过程示意图；
图4为本公开实施例提供的另一种视频通话界面显示控制方法的流程示意图；
图5本公开实施例提供的又一种布局模式切换过程示意图；
图6为本公开实施例提供的一种视频通话界面显示控制装置的结构框图；
图7为本公开实施例提供的一种电子设备的结构框图。
具体实施方式
下面将参照附图更详细地描述本公开的实施例。虽然附图中显示了本公开的某些实施例，然而应当理解的是，本公开可以通过各种形式来实现，而且不应该被解释为限于这里阐述的实施例，相反提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是，本公开的附图及实施例仅用于示例性作用，并非用于限制本公开的保护范围。
应当理解，本公开的方法实施方式中记载的各个步骤可以按照不同的顺序执行，和/或并行执行。此外，方法实施方式可以包括附加的步骤和/或省略执行示出的步骤。本公开的范围在此方面不受限制。
本文使用的术语“包括”及其变形是开放性包括，即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”；术语“另一实施例”表示“至少一个另外的实施例”；术语“一些实施例”表示“至少一些实施例”。其他术语的相关定义将在下文描述中给出。
需要注意，本公开中提及的“第一”、“第二”等概念仅用于对不同的装置、模块或单元进行区分，并非用于限定这些装置、模块或单元所执行的功能的顺序或者相互依存关系。
需要注意，本公开中提及的“一个”、“多个”的修饰是示意性而非限制性的，本领域技术人员应当理解，除非在上下文另有明确指出，否则应该理解为“一个或多个”。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的，而并不是用于对这些消息或信息的范围进行限制。
下述各实施例中，每个实施例中同时提供了可选特征和示例，实施例中记载的各个特征可进行组合，形成多个可选方案，不应将每个编号的实施例仅视为一个技术方案。
图1为本公开实施例提供的一种视频通话界面显示控制方法的流程示意图，该方法可以由视频通话界面显示控制装置执行，其中该装置可由软件和/或硬件实现，一般可集成在电子设备中。其中，电子设备例如可以是手机、平板电脑、笔记本电脑以及个人数字助理等具备视频通话功能的设备。
如图1所示，该方法包括：
步骤101、确定视频通话界面所处的当前布局模式。
示例性的，视频通话功能通常可支持一对一的双人通话模式，还可支持多人通话模式。一般的，视频通话界面中可以包含至少两个用于显示视频画面的窗口。例如，双人通话模式中，可以有两个视频窗口(以下简称窗口)，分别用于显示通话双方的视频画面；多人通话模式中，可以有两个或多个窗口，分别用于显示通话多方中的至少两方的视频画面。当然，根据实际需求，也可仅显示一个窗口，例如，显示一个对端通话方的窗口。视频画面一般为实时通话画面，例如通话方所采用的电子设备中的图像采集装置(如摄像头等)实时采集到的图像。
示例性的，为了使视频通话界面更加多样化，也更能够满足用户的不同需求，通常可以为视频通话界面配置两种或多种布局模式。不同的布局模式中，窗口的布局规则不同。其中，布局规则可包括以下至少一方面或多个方面的组合：窗口之间的嵌套关系、窗口之间的邻接关系、窗口的平面排列顺序、窗口层次的叠加顺序、窗口的显示位置、窗口的显示尺寸以及窗口的形状等等。
步骤102、检测作用于视频通话界面上的手势操作。
示例性的，电子设备的屏幕可以为触控屏，手势操作可以是作用于屏幕中显示的视频通话界面上的触控手势操作；电子设备的屏幕还可以是其他类型的屏幕，此时，手势操作还可以是与屏幕中显示的视频通话界面相对应的隔空手势操作。当然，若为触控屏，手势操作也可以是隔空手势操作。不同类型的手势操作对应的检测方式可以不同，具体可根据实际情况进行设置。例如，触控手势操作可通过触控屏进行检测；隔空手势操作可通过电子设备上的如超声波传感器等部件进行检测。
步骤103、在确定手势操作满足当前布局模式对应的预设切换条件时，控制视频通话界面切换至对应的另一布局模式。
示例性的，可以预先设置在不同的布局模式之间进行切换时的切换条件，切换条件中可以包括具体的手势操作信息。其中，手势操作信息中可包括手势类型(如点击、双击、长按、拖动、以及双指或多指滑动等多点触控手势)、还可包括滑动轨迹、手势作用区域、以及手势作用时长等等。
需要说明的是，从一种布局模式切换至另一布局模式所对应的预设切换条件可以存在一种或多种，若存在多种，则可在满足其中任意一种时，进行切换。为了便于理解，下面以存在一种为例进行说明。
假设存在两种布局模式，如第一布局模式和第二布局模式。那么从第一布局模式切换至第二布局模式对应第一预设切换条件，从第二布局模式切换至第一布局模式对应第二预设切换条件。
假设存在三种布局模式，如第一布局模式、第二布局模式和第三布局模式。那么从第一布局模式切换至第二布局模式对应第一预设切换条件，从第二布局模式切换至第一布局模式对应第二预设切换条件；从第一布局模式切换至第三布局模式对应第三预设切换条件，从第三布局模式切换至第一布局模式对应第四预设切换条件；从第二布局模式切换至第三布局模式对应第五预设切换条件，从第三布局模式切换至第二布局模式对应第六预设切换条件。
在确定了当前布局模式后，便可确定当前布局模式可以向哪些布局模式进行切换，进而将检测到的手势操作与对应的预设切换条件进行比对，在满足对应的预设切换条件时，控制视频通话界面切换至对应的另一布局模式。例如，以上述的存在三种布局模式为例，假设当前布局模式为第一布局模式，那么可能向第二布局模式或第三布局模式进行切换，可以确定需要进行比对的预设切换条件为第一预设切换条件和第三预设切换条件。
本公开实施例中提供的视频通话界面显示控制方法，视频通话界面中包含至少两个用于显示视频画面的窗口，确定视频通话界面所处的当前布局模式，检测作用于视频通话界面上的手势操作，在确定手势操作满足当前布局模式对应的预设切换条件时，控制视频通话界面切换至对应的另一布局模式。通过采用上述技术方案，可以利用手势操作高效便捷地切换视频通话界面的布局模式，且省略了按钮等切换入口，可以节省视频通话界面的空间，也使得视频通话界面更加美观。
在一个实施例中，视频通话界面至少存在第一布局模式和第二布局模式。第一布局模式中包含一个主窗口和至少一个子窗口，至少一个子窗口嵌套在主窗口中；第二布局模式中包含至少两个并列窗口，每个并列窗口中显示通话一方的完整视频画面。这样设置的好处在于，两种模式可以基本满足不同场景下的使用需求，减少运算量，提升切换速度。其中，在第一布局模式中，主窗口一般占满整个视频通话界面，若每个窗口对应一层，则主窗口位于底层，子窗口位于顶层或中间层，子窗口的显示尺寸一般较小，例如为主窗口的1/16，因此，子窗口仅会遮挡住主窗口内的较小一部分的视频画面。在第二布局模式中，并列窗口的排列方式不做限定，可以根据电子设备的屏幕尺寸或屏幕显示方式(如横屏显示或竖屏显示)确定。以存在两个并列窗口为例，两者可以是上下排列，如第一并列窗口占用视频通话界面的上半部分，第二并列窗口占用视频通话界面的下半部分，两者也可以 是左右排列。以存在四个并列窗口为例，四个窗口可以是以“田”字型方式进行排列等，四个窗口的显示尺寸可以相等也可以不等。
在一个实施例中，若所述当前布局模式为第一布局模式，则所述在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式，包括：在根据所述手势操作确定第一子窗口被拖动至所述视频通话界面中央的第一预设区域范围内时，将主窗口切换显示为所述第二布局模式中的第一并列窗口，同时将所述第一子窗口按照原尺寸显示于第二并列窗口对应的视频框内；在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口切换显示至占满所述视频框。这样设置的好处在于，可以便捷准确地实现从第一布局模式向第二布局模式的切换。进一步的，可根据第一子窗口在第一预设区域范围内的位置确定第一并列窗口的位置。其中，第一预设区域范围可根据实际需求设置，例如可以对视频通话界面进行从左至右的三等分划分，将中间的区域对应的范围作为第一预设区域范围。所述拖动可理解为按住并滑动，可以是单指或多指操作。视频框可理解为第二并列窗口对应的边界，可视为系统给出的相应结果的标识，提示用户切换后的显示效果。视频框的背景不做限定，例如可以是黑色或白色等。若用户满意切换后的效果，可以松开手指，这样第一子窗口的尺寸就可以变成与视频框相同，完成最终的切换。
在一个实施例中，若所述当前布局模式中包含第二子窗口，则在将所述第一子窗口显示于第二并列窗口对应的视频框内的同时，还包括：将所述第二子窗口按照原尺寸显示于第三并列窗口对应的视频框内，或者，将所述第二子窗口切换显示为第三并列窗口。这样设置的好处在于，可以适用于多方视频通话的场景。其中，第二子窗口可以泛指除第一子窗口外的子窗口，具体数量可以是一个或多个；第三并列窗口可以泛指除第一并列窗口和第二并列窗口外的并列窗口，具体数量可以是一个或多个。第二子窗口和第三并列窗口的数量一般可以相同。
在一个实施例中，若所述当前布局模式为第二布局模式，则所述在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式，包括：在根据所述手势操作确定第一并列窗口被拖动至所述视频通话界面两侧的第二预设区域范围内时，将第二并列窗口切换显示为所述第一布局模式中的主窗口，同时将所述第一并列窗口切换显示为第一子窗口；在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口的显示位置固定。这样设置的好处在于，可以便捷准确地实现从第二布局模式向第一布局模式的切换。进一步的，可根据第一子窗口松开前所处的位 置确定第一子窗口被固定后的显示位置。其中，第二预设区域范围可根据实际需求设置，例如上述对视频通话界面进行从左至右的三等分划分后，将左边区域和右边区域对应的范围作为第而预设区域范围。
在一个实施例中，在所述检测作用于所述视频通话界面上的手势操作之后，还包括：在确定所述手势操作为作用于第一窗口的缩放操作时，根据所述缩放操作调整所述第一窗口的显示尺寸。这样设置的好处在于，可以利用手势操作来调整窗口的显示尺寸，使得各窗口的显示更加灵活，适用更多的使用场景，也能够满足用户更多的使用需求。其中，缩放操作例如可以是双指缩放或多指缩放，如放大操作指双指或多指在接触屏幕后以接触点为中心向外滑动，缩小操作指双指或多指在接触屏幕后以接触点为起点向中心滑动。第一窗口可以是任意布局模式中的窗口。第一窗口的显示尺寸可以随着缩放操作动态变化，第一窗口被松开时，第一窗口的显示尺寸固定。若第一窗口为第二布局模式中的窗口，当第一窗口的尺寸发生变化时，可适应性调整其他并列窗口的尺寸。
在一个实施例中，若所述当前布局模式为第一布局模式，则所述在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式，包括：在根据所述手势操作确定第一子窗口的尺寸被放大至第一预设尺寸阈值时，将主窗口切换显示为所述第二布局模式中的第一并列窗口，同时将所述第一子窗口按照当前尺寸显示于第二并列窗口对应的视频框内；在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口切换显示至占满所述视频框。这样设置的好处在于，可以便捷准确地实现从第一布局模式向第二布局模式的切换，且可以与上述通过缩放操作调整窗口显示尺寸的方案进行结合。第一预设尺寸阈值可根据实际需求设置，可以以长、宽或面积等来表征尺寸，例如第一预设尺寸阈值对应的面积为视频通话界面的三分之一。可根据第一子窗口被放大后的所在位置确定第一并列窗口的位置。
在一个实施例中，若所述当前布局模式为第二布局模式，则所述在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式，包括：在根据所述手势操作确定第一并列窗口的尺寸被缩小至第二预设尺寸阈值时，将第二并列窗口切换显示为所述第一布局模式中的主窗口，同时将所述第一并列窗口切换显示为第一子窗口；在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口的显示位置固定。这样设置的好处在于，可以便捷准确地实现从第二布局模式向第一布局模式的切换，且可以与上述通过缩放操作调整窗口显示尺寸的方案进行结合。第二预设尺寸阈值可根据实际需求设置，可以以长、宽或面积等来表征尺寸，例如第二预设 尺寸阈值对应的面积为视频通话界面的四分之一。可根据第一并列窗口被缩小后的所在位置确定第一子窗口的位置。
在一个实施例中，若当前布局模式中包含第二子窗口，则在将第一子窗口按照当前尺寸显示于第二并列窗口对应的视频框内的同时，还可包括：将第二子窗口按照原尺寸显示于第三并列窗口对应的视频框内，或者，将第二子窗口切换显示为第三并列窗口。这样设置的好处在于，可以适用于多方视频通话的场景。
在一个实施例中，还可利用手势操作来实现窗口的显示位置的调整。可选的，若所述当前布局模式为第二布局模式，则在所述检测作用于所述视频通话界面上的手势操作之后，还包括：在根据所述手势操作确定第一并列窗口向第二并列窗口移动并使得所述第一并列窗口和第二并列窗口的重叠面积达到第一面积阈值时，互换所述第一并列窗口和第二并列窗口的显示位置。这样设置的好处在于，可以便捷的调整并列窗口的显示位置，增强该布局模式的灵活性。第一面积阈值可以是固定值，也可以是第一并列窗口或第二并列窗口的面积与预设系数的乘积，可根据实际需求进行设定。
可选的，若当前布局模式为第一布局模式，在检测作用于视频通话界面上的手势操作之后，还包括：在检测到第一子窗口被拖动时，在拖动过程中实时改变第一子窗口的显示位置，在检测到第一子窗口被松开时，第一子窗口被固定。这样设置的好处在于，可以便捷的调整子窗口的显示位置，增强该布局模式的灵活性。此外，为了更好地与布局模式切换的方案兼容，可以增加如停留时长或执行拖动操作的手指数量的判定。例如，在根据手势操作确定第一子窗口被拖动至屏幕中央的第一预设区域范围内且停留时长达到第一预设时长时，将主窗口切换显示为所述第二布局模式中的第一并列窗口；又如，在根据手势操作确定第一子窗口被双指拖动至屏幕中央的第一预设区域范围时，将主窗口切换显示为所述第二布局模式中的第一并列窗口。
在一个实施例中，若所述当前布局模式为第一布局模式，则在所述检测作用于所述视频通话界面上的手势操作之后，还包括：在根据所述手势操作确定第一子窗口被拖动至主窗口中的第三预设区域范围内时，互换所述第一子窗口和所述主窗口的显示位置。这样设置的好处在于，可以丰富主窗口的切换方式，且操作过程更加直观。第三预设区域范围的中心可以与主窗口的中心重合，具体边界可根据实际需求设置。
在一个实施例中，若所述当前布局模式为第一布局模式且存在至少两个子窗口，则在所述检测作用于所述视频通话界面上的手势操作之后，还包括：在检测到作用在第一子窗口上的第一预设手势操作时，将其他子窗口隐藏至所述第一子窗口下；在检测到作用在所 述第一子窗口上的第二预设手势操作时，互换所述第一子窗口和隐藏在所述第一子窗口下的第二子窗口的视频画面；在检测到作用在所述第一子窗口上的第三预设手势操作时，将隐藏在所述第一子窗口下的所有子窗口切换至所述视频通话界面的最顶层进行显示。这样设置的好处在于，在多人通话模式下，可以将部分通话方对应的子窗口进行堆叠，减少对主窗口显示面积的占用，同时可以利用手势操作灵活地控制堆叠方式以及堆叠顺序。上述三个预设手势操作可以自由设置，例如，第一预设手势操作可以是长按，第二预设手势操作可以是点击，第三预设手势操作也可以是长按。
图2为本公开实施例提供的又一种视频通话界面显示控制方法的流程示意图，以一对一通话模式为例，如图2所示，该方法包括：
步骤201、确定视频通话界面所处的当前布局模式为第一布局模式。
图3本公开实施例提供的一种布局模式切换过程示意图，第一布局模式(又称大小屏模式)下的视频通话界面如图3中的a界面，其中，包含了主窗口301(即大屏，用斜线阴影表示)和子窗口302(小屏)。
步骤202、检测作用于视频通话界面上的手势操作。
步骤203、在根据手势操作确定子窗口被拖动至视频通话界面中央的第一预设区域范围内时，将主窗口切换显示为第二布局模式中的第一并列窗口，同时将子窗口按照原尺寸显示于第二并列窗口对应的视频框内。
如图3中的b界面所示，视频通话界面中被两条虚线划分为三个区域，其中中间的区域可以对应于第一预设区域范围。示例性的，可以在拖动过程中实时改变子窗口的显示位置。当子窗口302被拖动至第一预设区域范围内时，将主窗口显示为第二布局模式(该模式中存在两个上下分布的并列窗口，又称上下屏模式)中的第一并列窗口303，由于子窗口302被拖动至第一预设区域范围内的上半部分，因此，可将主窗口显示为位于整个视频通话界面下半部分的第一并列窗口303，并在位于上半部分的第二并列窗口所在位置显示对应的视频框304，将子窗口302显示在视频框304内。这样，用户能够更加直观的看到切换后的预期效果，相比于直接通过点击按钮等切换方式，更加符合用户的直觉。
步骤204、在根据手势操作确定子窗口被松开后，将子窗口切换显示至占满视频框。
示例性的，当用户觉得符合自己的切换预期时，可以松开手指，进而完成从第一布局模式到第二布局模式的切换，切换后的效果如图3中的c界面所示，子窗口302占满视频框后，成为第二布局模式中的第二并列窗口305。
在第一布局模式下，还可通过双指对子窗口施加缩放操作，进而动态调整子窗口的显示尺寸。需要说明的是，在切换过程中或调整显示尺寸过程中，可根据窗口的尺寸变换适应性调整内部显示的视频画面，如若尺寸变小可减少除人像部分以外的视频画面的显示等。
步骤205、在根据手势操作确定第一并列窗口向第二并列窗口移动并使得第一并列窗口和第二并列窗口的重叠面积达到第一面积阈值时，互换第一并列窗口和第二并列窗口的显示位置。
在第二布局模式下，可以利用拖动等手势操作将其中一个并列窗口移向另一个并列窗口，进而实现两者显示位置的互换。如图3中的d界面，拖动第一并列窗口303向第二并列窗口305移动，移动过程中可以允许窗口的部分区域被隐藏，如d界面中的第一并列窗口303的显示面积小于c界面中第一并列窗口303的显示面积。若第一并列窗口303与第二并列窗口305的重叠面积达到第一面积阈值，则互换位置。可选的，也可在检测到第一并列窗口被松开后，再互换位置。显示效果如图3中的e界面所示。
步骤206、在根据手势操作确定第一并列窗口被拖动至视频通话界面两侧的第二预设区域范围内时，将第二并列窗口切换显示为第一布局模式中的主窗口，同时将第一并列窗口切换显示为子窗口。
如图3中的f界面所示，假设虚线划分后的三个区域中的左边区域和右边区域均对应于第二预设区域范围，那么f界面中的第一并列窗口303已被拖动至第二预设区域范围内，那么可以将第二并列窗口305切换显示为第一布局模式中的新的主窗口306。同时，如图3中的界面g所示，第一并列窗口303切换显示为新的子窗口307。
步骤207、在根据手势操作确定第一子窗口被松开后，将第一子窗口的显示位置固定。
本公开实施例提供的视频通话界面显示控制方法，可以利用拖动等手势操作灵活便捷地实现大小屏布局模式和上下屏布局模式之间的切换，且在不同布局模式下，还可以利用手势操作灵活调整各窗口的显示尺寸或显示位置，使得视频通话界面的显示方式更加多样化，且省略了按钮等切换入口，可以节省视频通话界面的空间，也使得视频通话界面更加美观。
图4为本公开实施例提供的另一种视频通话界面显示控制方法的流程示意图，以多通话模式(为了便于说明，假设为三方通话)为例，如图4所示，该方法包括：
步骤401、确定视频通话界面所处的当前布局模式为第一布局模式。
图5本公开实施例提供的又一种布局模式切换过程示意图，第一布局模式下的视频通话界面如图5中的a界面，其中，包含了主窗口501、第一子窗口502和第二子窗口503。
示例性的，在该布局模式下，可以通过手势操作(如长按第一子窗口502)将第二子窗口503隐藏到第一子窗口502下，还可切换(如点击第一子窗口502)第二子窗口503和第一子窗口502的堆叠顺序，即将第一子窗口502隐藏到第二子窗口503下，还可恢复全部显示两个子窗口，如长按当前显示的子窗口。
步骤402、检测作用于视频通话界面上的手势操作。
步骤403、在根据手势操作确定第一子窗口的尺寸被放大至第一预设尺寸阈值时，将主窗口切换显示为第二布局模式中的第一并列窗口，将第二子窗口切换显示为第二布局模式中的第三并列窗口，同时将第一子窗口按照当前尺寸显示于第二并列窗口对应的视频框内。
如图5中的b界面所示，当第一子窗口502被放大到尺寸达到第一预设尺寸阈值时，主窗口501切换显示为第二布局模式中的第一并列窗口504，第二子窗口切换显示为第三并列窗口505，而第一子窗口502按照当前尺寸显示于第二并列窗口对应的视频框506内。
步骤404、在根据手势操作确定子窗口被松开后，将第一子窗口切换显示至占满视频框。
示例性的，当用户觉得符合自己的切换预期时，可以松开手指，进而完成从第一布局模式到第二布局模式的切换，切换后的效果如图5中的c界面所示，子窗口502占满视频框后，成为第二布局模式中的第二并列窗口507。
步骤405、在根据手势操作确定第一并列窗口的尺寸被缩小至第二预设尺寸阈值时，将第二并列窗口切换显示为第一布局模式中的主窗口，同时将第一并列窗口切换显示为第一子窗口，将第三并列窗口切换显示为第二子窗口。
如图5中的d界面所示，第一并列窗口504的尺寸被缩小，即将到达第二预设尺寸阈值。如图5中的e界面所示，在到达第二预设尺寸阈值时，将第二并列窗口切换显示为第一布局模式中新的主窗口508，将第一并列窗口504切换显示为新的第一子窗口509，将第三并列窗口505切换显示为新的第二子窗口510。其中，新的第二子窗口510的位置可优先还原为原位置，即在a界面中的位置，当然，也可以是其他位置，可根据实际需求进行设定。
步骤406、在根据手势操作确定第一子窗口被松开后，将第一子窗口和第二子窗口的显示位置固定。
本公开实施例提供的视频通话界面显示控制方法，可以利用手指缩放等手势操作灵活便捷地实现大小屏布局模式和上下屏布局模式之间的切换，且在不同布局模式下，还可以利用手势操作灵活调整各窗口的显示尺寸或显示位置，使得视频通话界面的显示方式更加多样化，且省略了按钮等切换入口，可以节省视频通话界面的空间，也使得视频通话界面更加美观。
图6为本公开实施例提供的一种视频通话界面显示控制装置的结构框图，该装置可由软件和/或硬件实现，一般可集成在电子设备中，可通过执行视频通话界面显示控制方法来进行视频通话界面的显示控制。如图6所示，该装置包括：
布局模式确定模块601，用于确定视频通话界面所处的当前布局模式；
手势操作检测模块602，用于检测作用于所述视频通话界面上的手势操作；
显示控制模块603，用于在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式。
本公开实施例中提供的视频通话界面显示控制装置，可以利用手势操作高效便捷地切换视频通话界面的布局模式，且省略了按钮等切换入口，可以节省视频通话界面的空间，也使得视频通话界面更加美观。
可选的，所述视频通话界面至少存在第一布局模式和第二布局模式；所述第一布局模式中包含一个主窗口和至少一个子窗口，所述至少一个子窗口嵌套在所述主窗口中；所述第二布局模式中包含至少两个并列窗口，每个所述并列窗口中显示通话一方的完整视频画面。
可选的，显示控制模块可用于：若所述当前布局模式为第一布局模式，在根据所述手势操作确定第一子窗口被拖动至所述视频通话界面中央的第一预设区域范围内时，将主窗口切换显示为所述第二布局模式中的第一并列窗口，同时将所述第一子窗口按照原尺寸显示于第二并列窗口对应的视频框内；在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口切换显示至占满所述视频框。
可选的，所述显示控制模块还用于：若所述当前布局模式中包含第二子窗口，则在将所述第一子窗口显示于第二并列窗口对应的视频框内的同时，将所述第二子窗口按照原尺寸显示于第三并列窗口对应的视频框内，或者，将所述第二子窗口切换显示为第三并列窗口。
可选的，显示控制模块可用于：若所述当前布局模式为第二布局模式，在根据所述手势操作确定第一并列窗口被拖动至所述视频通话界面两侧的第二预设区域范围内时，将 第二并列窗口切换显示为所述第一布局模式中的主窗口，同时将所述第一并列窗口切换显示为第一子窗口；在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口的显示位置固定。
可选的，显示控制模块可用于：若所述当前布局模式为第一布局模式，在根据所述手势操作确定第一子窗口的尺寸被放大至第一预设尺寸阈值时，将主窗口切换显示为所述第二布局模式中的第一并列窗口，同时将所述第一子窗口按照当前尺寸显示于第二并列窗口对应的视频框内；在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口切换显示至占满所述视频框。
可选的，显示控制模块可用于：若所述当前布局模式为第二布局模式，在根据所述手势操作确定第一并列窗口的尺寸被缩小至第二预设尺寸阈值时，将第二并列窗口切换显示为所述第一布局模式中的主窗口，同时将所述第一并列窗口切换显示为第一子窗口；在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口的显示位置固定。
可选的，显示控制模块可用于：若所述当前布局模式为第二布局模式，则在所述检测作用于所述视频通话界面上的手势操作之后，在根据所述手势操作确定第一并列窗口向第二并列窗口移动并使得所述第一并列窗口和第二并列窗口的重叠面积达到第一面积阈值时，互换所述第一并列窗口和第二并列窗口的显示位置。
可选的，显示控制模块可用于：在所述检测作用于所述视频通话界面上的手势操作之后，在确定所述手势操作为作用于第一窗口的缩放操作时，根据所述缩放操作调整所述第一窗口的显示尺寸。
可选的，显示控制模块可用于：若所述当前布局模式为第一布局模式，则在所述检测作用于所述视频通话界面上的手势操作之后，在根据所述手势操作确定第一子窗口被拖动至主窗口中的第三预设区域范围内时，互换所述第一子窗口和所述主窗口的显示位置。
可选的，显示控制模块可用于：若所述当前布局模式为第一布局模式且存在至少两个子窗口，则在所述检测作用于所述视频通话界面上的手势操作之后，在检测到作用在第一子窗口上的第一预设手势操作时，将其他子窗口隐藏至所述第一子窗口下；在检测到作用在所述第一子窗口上的第二预设手势操作时，互换所述第一子窗口和隐藏在所述第一子窗口下的第二子窗口的视频画面；在检测到作用在所述第一子窗口上的第三预设手势操作时，将隐藏在所述第一子窗口下的所有子窗口切换至所述视频通话界面的最顶层进行显示。
下面参考图7，其示出了适于用来实现本公开实施例的电子设备700的结构示意图。本公开实施例中的电子设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。图7示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
如图7所示，电子设备700可以包括处理装置(例如中央处理器、图形处理器等)701，其可以根据存储在只读存储器(read-only memory，ROM)702中的程序或者从存储装置708加载到随机访问存储器(random access memory，RAM)703中的程序而执行各种适当的动作和处理。在RAM 703中，还存储有电子设备700操作所需的各种程序和数据。处理装置701、ROM 702以及RAM 703通过总线704彼此相连。输入/输出(I/O)接口705也连接至总线704。
通常，以下装置可以连接至I/O接口705：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置706；包括例如液晶显示器(liquid crystal display，LCD)、扬声器、振动器等的输出装置707；包括例如磁带、硬盘等的存储装置708；以及通信装置709。通信装置709可以允许电子设备700与其他设备进行无线或有线通信以交换数据。虽然图7示出了具有各种装置的电子设备700，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在非暂态计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信装置709从网络上被下载和安装，或者从存储装置708被安装，或者从ROM 702被安装。在该计算机程序被处理装置701执行时，执行本公开实施例的方法中限定的上述功能。
需要说明的是，本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、 光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、RF(射频)等等，或者上述的任意合适的组合。
上述计算机可读介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该电子设备执行时，使得该电子设备：确定视频通话界面所处的当前布局模式；检测作用于所述视频通话界面上的手势操作；在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(local area network，LAN)或广域网(wide area network，WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
本公开实施例还提供了一种计算机程序，所述计算机程序存储在可读存储介质中，电子设备的至少一个处理器可以从所述可读存储介质中读取所述计算机程序，所述至少一个处理器执行所述计算机程序，使得所述电子设备执行上述任一实施例提供的方法。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中 所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的模块可以通过软件的方式实现，也可以通过硬件的方式来实现。其中，模块的名称在某种情况下并不构成对该模块本身的限定，例如，布局模式确定模块还可以被描述为“确定视频通话界面所处的当前布局模式的模块”。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(field programmable gate array，FPGA)、专用集成电路(application specific integrated circuit，ASIC)、专用标准产品(application specific standard parts，ASSP)、片上系统(system on chip，SOC)、复杂可编程逻辑设备(complex programmable logic device，CPLD)等等。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解，本公开中所涉及的公开范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离上述公开构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
此外，虽然采用特定次序描绘了各操作，但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行来执行。在一定环境下，多任务和并行处理可能是有利的。同样地，虽然在上面论述中包含了若干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施 例中。相反地，在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。

Claims (16)

  1. 一种视频通话界面显示控制方法，其特征在于，包括：
    确定视频通话界面所处的当前布局模式；
    检测作用于所述视频通话界面上的手势操作；
    在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式。
  2. 根据权利要求1所述的方法，其特征在于，所述视频通话界面至少存在第一布局模式和第二布局模式；
    所述第一布局模式中包含一个主窗口和至少一个子窗口，所述至少一个子窗口嵌套在所述主窗口中；
    所述第二布局模式中包含至少两个并列窗口，每个所述并列窗口中显示通话一方的完整视频画面。
  3. 根据权利要求2所述的方法，其特征在于，若所述当前布局模式为所述第一布局模式，则所述在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式，包括：
    在根据所述手势操作确定第一子窗口被拖动至所述视频通话界面中央的第一预设区域范围内时，将所述主窗口切换显示为所述第二布局模式中的第一并列窗口，同时将所述第一子窗口按照原尺寸显示于第二并列窗口对应的视频框内；
    在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口切换显示至占满所述视频框。
  4. 根据权利要求3所述的方法，其特征在于，若所述当前布局模式中包含第二子窗口，则在将所述第一子窗口按照原尺寸显示于第二并列窗口对应的视频框内的同时，所述方法还包括：
    将所述第二子窗口按照原尺寸显示于第三并列窗口对应的视频框内，或者，将所述第二子窗口切换显示为第三并列窗口。
  5. 根据权利要求2所述的方法，其特征在于，若所述当前布局模式为所述第二布局模式，则所述在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式，包括：
    在根据所述手势操作确定第一并列窗口被拖动至所述视频通话界面两侧的第二预设区域范围内时，将第二并列窗口切换显示为所述第一布局模式中的主窗口，同时将所述第一并列窗口切换显示为第一子窗口；
    在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口的显示位置固定。
  6. 根据权利要求2所述的方法，其特征在于，若所述当前布局模式为所述第一布局模式，则所述在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式，包括：
    在根据所述手势操作确定第一子窗口的尺寸被放大至第一预设尺寸阈值时，将所述主窗口切换显示为所述第二布局模式中的第一并列窗口，同时将所述第一子窗口按照当前尺寸显示于第二并列窗口对应的视频框内；
    在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口切换显示至占满所述视频框。
  7. 根据权利要求2所述的方法，其特征在于，若所述当前布局模式为所述第二布局模式，则所述在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式，包括：
    在根据所述手势操作确定第一并列窗口的尺寸被缩小至第二预设尺寸阈值时，将第二并列窗口切换显示为所述第一布局模式中的主窗口，同时将所述第一并列窗口切换显示为第一子窗口；
    在根据所述手势操作确定所述第一子窗口被松开后，将所述第一子窗口的显示位置固定。
  8. 根据权利要求2-7中任一项所述的方法，其特征在于，若所述当前布局模式为第二布局模式，则在所述检测作用于所述视频通话界面上的手势操作之后，所述方法还包括：
    在根据所述手势操作确定第一并列窗口向第二并列窗口移动并使得所述第一并列窗口和所述第二并列窗口的重叠面积达到第一面积阈值时，互换所述第一并列窗口和第二并列窗口的显示位置。
  9. 根据权利要求2-7中任一项所述的方法，其特征在于，在所述检测作用于所述视频通话界面上的手势操作之后，所述方法还包括：
    在确定所述手势操作为作用于第一窗口的缩放操作时，根据所述缩放操作调整所述第一窗口的显示尺寸。
  10. 根据权利要求2-7中任一项所述的方法，其特征在于，若所述当前布局模式为第一布局模式，则在所述检测作用于所述视频通话界面上的手势操作之后，所述方法还包括：
    在根据所述手势操作确定第一子窗口被拖动至主窗口中的第三预设区域范围内时，互换所述第一子窗口和所述主窗口的显示位置。
  11. 根据权利要求2-7中任一项所述的方法，其特征在于，若所述当前布局模式为第一布局模式且存在至少两个子窗口，则在所述检测作用于所述视频通话界面上的 手势操作之后，所述方法还包括：
    在检测到作用在第一子窗口上的第一预设手势操作时，将其他子窗口隐藏至所述第一子窗口下；
    在检测到作用在所述第一子窗口上的第二预设手势操作时，互换所述第一子窗口和隐藏在所述第一子窗口下的第二子窗口的视频画面；
    在检测到作用在所述第一子窗口上的第三预设手势操作时，将隐藏在所述第一子窗口下的所有子窗口切换至所述视频通话界面的最顶层进行显示。
  12. 一种视频通话界面显示控制装置，其特征在于，包括：
    布局模式确定模块，用于确定视频通话界面所处的当前布局模式；
    手势操作检测模块，用于检测作用于所述视频通话界面上的手势操作；
    显示控制模块，用于在确定所述手势操作满足所述当前布局模式对应的预设切换条件时，控制所述视频通话界面切换至对应的另一布局模式。
  13. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现如权利要求1-11中任一项所述的方法。
  14. 一种电子设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，其特征在于，所述处理器执行所述计算机程序时实现如权利要求1-11中任一项所述的方法。
  15. 一种计算机程序产品，其特征在于，包括计算机程序指令，所述计算机程序指令使得计算机执行如权利要求1-11中任一项所述的方法。
  16. 一种计算机程序，其特征在于，所述计算机程序使得计算机执行如权利要求1-11中任一项所述的方法。
PCT/CN2021/093812 2020-05-25 2021-05-14 视频通话界面显示控制方法、装置、存储介质及设备 WO2021238679A1 (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP21813626.5A EP4161065A4 (en) 2020-05-25 2021-05-14 VIDEO CALL INTERFACE DISPLAY CONTROL METHOD AND APPARATUS, STORAGE MEDIUM AND DEVICE
JP2022572366A JP2023528311A (ja) 2020-05-25 2021-05-14 ビデオ通話インタフェース表示制御方法、装置、記憶媒体及び機器
BR112022023996A BR112022023996A2 (pt) 2020-05-25 2021-05-14 Método e aparelho de controle de exibição de interface de chamada de vídeo, meio de armazenamento e dispositivo
KR1020227042163A KR20230004851A (ko) 2020-05-25 2021-05-14 영상 통화 인터페이스 표시 제어 방법, 장치, 저장매체 및 기기
US17/818,629 US11853543B2 (en) 2020-05-25 2022-08-09 Method and apparatus for controlling display of video call interface, storage medium and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010458529.3 2020-05-25
CN202010458529.3A CN111641797B (zh) 2020-05-25 2020-05-25 视频通话界面显示控制方法、装置、存储介质及设备

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/818,629 Continuation US11853543B2 (en) 2020-05-25 2022-08-09 Method and apparatus for controlling display of video call interface, storage medium and device

Publications (1)

Publication Number Publication Date
WO2021238679A1 true WO2021238679A1 (zh) 2021-12-02

Family

ID=72331328

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/093812 WO2021238679A1 (zh) 2020-05-25 2021-05-14 视频通话界面显示控制方法、装置、存储介质及设备

Country Status (7)

Country Link
US (1) US11853543B2 (zh)
EP (1) EP4161065A4 (zh)
JP (1) JP2023528311A (zh)
KR (1) KR20230004851A (zh)
CN (1) CN111641797B (zh)
BR (1) BR112022023996A2 (zh)
WO (1) WO2021238679A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111641797B (zh) * 2020-05-25 2022-02-18 北京字节跳动网络技术有限公司 视频通话界面显示控制方法、装置、存储介质及设备
CN112261486A (zh) * 2020-10-15 2021-01-22 信利半导体有限公司 一种视频通话的视频图像比例调节方法、装置和计算机可读存储介质
CN112241230B (zh) * 2020-10-20 2022-04-12 北京字节跳动网络技术有限公司 电子设备的窗口显示方法、装置、终端和存储介质
US12008051B1 (en) 2022-12-19 2024-06-11 Dropbox, Inc. Generating digital content clusters based on web activity
US11960911B1 (en) 2022-12-19 2024-04-16 Dropbox, Inc. Storing and restoring desktop application scenes
US11928320B1 (en) * 2022-12-19 2024-03-12 Dropbox, Inc. Storing and arranging application windows for video call scenes

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120084717A1 (en) * 2009-12-18 2012-04-05 Beijing Lenovo Software Ltd. Window management method, apparatus and computing device
US20150309668A1 (en) * 2014-04-24 2015-10-29 Hisense Mobile Communications Technology Co., Ltd. Methods for operating multiple windows on a handheld mobile terminal and the handheld mobile terminal conducting the same
CN105159578A (zh) * 2015-08-24 2015-12-16 小米科技有限责任公司 视频显示模式的切换方法和装置
CN105892845A (zh) * 2015-12-14 2016-08-24 乐视致新电子科技（天津）有限公司 多点触控调整视频窗口的方法及设备
CN106598429A (zh) * 2016-11-29 2017-04-26 北京小米移动软件有限公司 移动终端的窗口调整方法及装置
CN109089070A (zh) * 2018-09-26 2018-12-25 福建星网智慧科技股份有限公司 一种视讯会议终端的布局切换方法及系统
CN109814802A (zh) * 2019-02-01 2019-05-28 北京字节跳动网络技术有限公司 一种界面中的窗口显示方法、装置、设备及存储介质
CN111641797A (zh) * 2020-05-25 2020-09-08 北京字节跳动网络技术有限公司 视频通话界面显示控制方法、装置、存储介质及设备

Family Cites Families (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07111675B2 (ja) * 1992-02-28 1995-11-29 インターナショナル・ビジネス・マシーンズ・コーポレイション ウィンドウ表示装置および方法
US20050099492A1 (en) * 2003-10-30 2005-05-12 Ati Technologies Inc. Activity controlled multimedia conferencing
US7779361B2 (en) * 2004-02-09 2010-08-17 Malmstrom R Dean Change-alarmed, integrated console apparatus and method
JP4434973B2 (ja) * 2005-01-24 2010-03-17 株式会社東芝 映像表示装置、映像合成配信装置、プログラム、システム及び方法
US7692682B2 (en) * 2005-04-28 2010-04-06 Apple Inc. Video encoding in a video conference
US8527907B2 (en) * 2006-07-31 2013-09-03 Adobe Systems Incorporated Screen relayout
JP4858313B2 (ja) * 2007-06-01 2012-01-18 富士ゼロックス株式会社 ワークスペース管理方式
JP5229084B2 (ja) * 2009-04-14 2013-07-03 ソニー株式会社 表示制御装置、表示制御方法およびコンピュータプログラム
NO331338B1 (no) * 2009-06-24 2011-11-28 Cisco Systems Int Sarl Fremgangsmate og anordning for endring av en videokonferanse-layout
US8350891B2 (en) * 2009-11-16 2013-01-08 Lifesize Communications, Inc. Determining a videoconference layout based on numbers of participants
US8744420B2 (en) * 2010-04-07 2014-06-03 Apple Inc. Establishing a video conference during a phone call
KR101199618B1 (ko) * 2011-05-11 2012-11-08 주식회사 케이티테크 화면 분할 표시 장치 및 방법
US20130002799A1 (en) * 2011-06-28 2013-01-03 Mock Wayne E Controlling a Videoconference Based on Context of Touch-Based Gestures
NO333282B1 (no) * 2011-07-29 2013-04-29 Cisco Systems Int Sarl Metode og endepunkt for a endre komposisjonen av et sammensatt videosignal
JP6159078B2 (ja) * 2011-11-28 2017-07-05 京セラ株式会社 装置、方法、及びプログラム
KR101852433B1 (ko) 2012-02-07 2018-04-26 엘지전자 주식회사 이동 단말기 및 그것의 제어방법
US9093012B2 (en) 2012-02-29 2015-07-28 Lenovo (Beijing) Co., Ltd. Operation mode switching method and electronic device
US9898155B2 (en) * 2012-05-11 2018-02-20 Samsung Electronics Co., Ltd. Multiple window providing apparatus and method
JP2014010263A (ja) * 2012-06-29 2014-01-20 Mitsubishi Electric Corp マルチディスプレイシステム
KR101957173B1 (ko) * 2012-09-24 2019-03-12 삼성전자 주식회사 터치 디바이스에서 멀티윈도우 제공 방법 및 장치
KR102099646B1 (ko) * 2012-09-25 2020-04-13 삼성전자 주식회사 휴대단말의 분할화면 전환 장치 및 방법
EP2741201A3 (en) * 2012-12-06 2017-05-17 Samsung Electronics Co., Ltd Display device and method of controlling the same
KR102146244B1 (ko) * 2013-02-22 2020-08-21 삼성전자주식회사 휴대 단말에 대한 동작 관련 입력에 따라 복수개의 객체들의 표시를 제어하는 방법 및 이를 위한 휴대 단말
CN103324435B (zh) * 2013-05-24 2017-02-08 华为技术有限公司 分屏显示的方法、装置及其电子设备
KR102153366B1 (ko) * 2013-08-30 2020-10-15 삼성전자 주식회사 전자 기기의 화면 전환 방법 및 장치
KR102202899B1 (ko) * 2013-09-02 2021-01-14 삼성전자 주식회사 복수의 어플리케이션 제공 방법 및 장치
KR102203473B1 (ko) * 2013-12-13 2021-01-18 엘지전자 주식회사 전자 기기 및 전자 기기의 제어 방법
WO2015092489A1 (en) * 2013-12-20 2015-06-25 Sony Corporation Method of controlling a graphical user interface for a mobile electronic device
US20150253937A1 (en) * 2014-03-05 2015-09-10 Samsung Electronics Co., Ltd. Display apparatus and method of performing a multi view display thereof
CN104010158A (zh) * 2014-03-11 2014-08-27 宇龙计算机通信科技(深圳)有限公司 移动终端及多方视频通话的实现方法
US9392217B2 (en) * 2014-03-20 2016-07-12 Blackberry Limited Automatically relocating picture-in-picture window in video calls
PL408468A1 (pl) * 2014-06-09 2015-12-21 Aktywator Innowacji Spółka Z Ograniczoną Odpowiedzialnością System prezentowania przepisów kulinarnych i sposób prezentowania przepisów kulinarnych
KR102383103B1 (ko) * 2014-08-13 2022-04-06 삼성전자 주식회사 전자 장치 및 이의 화면 표시 방법
KR102391772B1 (ko) * 2014-08-28 2022-04-28 삼성전자 주식회사 터치 감응 디스플레이를 포함하는 전자 장치 및 이 전자 장치를 동작하는 방법
KR20160026141A (ko) * 2014-08-29 2016-03-09 삼성전자주식회사 윈도우 운용 방법 및 이를 지원하는 전자 장치
CN104281409B (zh) * 2014-09-16 2018-01-26 天津三星通信技术研究有限公司 界面切换的方法、装置和终端
CN104503682A (zh) * 2014-11-07 2015-04-08 联发科技（新加坡）私人有限公司 一种屏幕显示窗口的处理方法以及移动终端
KR102297330B1 (ko) * 2015-01-16 2021-09-02 삼성전자주식회사 화면 제어 방법 및 그 방법을 처리하는 전자 장치
US9910571B2 (en) * 2015-01-30 2018-03-06 Google Llc Application switching and multitasking
US20160239200A1 (en) * 2015-02-16 2016-08-18 Futurewei Technologies, Inc. System and Method for Multi-Touch Gestures
US20170017451A1 (en) * 2015-07-17 2017-01-19 Samsung Electronics Co., Ltd. Method and system for managing applications running on smart device using a wearable device
KR20170013555A (ko) * 2015-07-28 2017-02-07 엘지전자 주식회사 이동단말기 및 그 제어방법
KR20170029329A (ko) * 2015-09-07 2017-03-15 엘지전자 주식회사 이동단말기 및 그 제어방법
US20170102857A1 (en) * 2015-10-09 2017-04-13 Raghav Badiger Multimedia View With Dynamic Resizing and Scaling Upon User Interaction or Non-Human Event Triggers
CN105578111A (zh) * 2015-12-17 2016-05-11 掌赢信息科技（上海）有限公司 一种即时视频通话中的网页分享方法及电子设备
US10419601B2 (en) * 2015-12-28 2019-09-17 Verizon Patent And Licensing Inc. Methods and systems for managing multiple communication sessions from a single on-screen user interface
US10674187B2 (en) * 2016-07-26 2020-06-02 Facebook, Inc. Systems and methods for shared broadcasting
CN106227415A (zh) * 2016-07-29 2016-12-14 努比亚技术有限公司 图标显示方法、装置及终端
US10754417B2 (en) * 2016-11-14 2020-08-25 Logitech Europe S.A. Systems and methods for operating an input device in an augmented/virtual reality environment
US9819877B1 (en) * 2016-12-30 2017-11-14 Microsoft Technology Licensing, Llc Graphical transitions of displayed content based on a change of state in a teleconference session
US10509964B2 (en) * 2017-01-11 2019-12-17 Microsoft Technology Licensing, Llc Toggle view functions for teleconferencing sessions
US10606925B2 (en) * 2017-03-27 2020-03-31 Adobe Inc. Responsive grid layouts for graphic design
CN107528938B (zh) * 2017-07-26 2020-09-29 维沃移动通信有限公司 一种视频通话方法、终端及计算机可读存储介质
CN107483721B (zh) * 2017-07-28 2019-10-25 Oppo广东移动通信有限公司 基于黑屏手势的控制方法、装置、存储介质及移动终端
CN107580143B (zh) * 2017-09-30 2019-03-01 维沃移动通信有限公司 一种显示方法及移动终端
JP2019133605A (ja) * 2018-02-02 2019-08-08 富士ゼロックス株式会社 情報処理装置及び情報処理プログラム
KR102266152B1 (ko) * 2018-02-22 2021-06-17 삼성전자주식회사 디스플레이 영역의 크기 변경이 가능한 플렉시블 디스플레이를 포함하는 전자 장치 및 그 제어 방법
CN108632462A (zh) * 2018-04-19 2018-10-09 Oppo广东移动通信有限公司 分屏显示的处理方法、装置、存储介质及电子设备
DK201870364A1 (en) * 2018-05-07 2019-12-03 Apple Inc. MULTI-PARTICIPANT LIVE COMMUNICATION USER INTERFACE
US20200371673A1 (en) * 2019-05-22 2020-11-26 Microsoft Technology Licensing, Llc Adaptive interaction models based on eye gaze gestures
CN110196669A (zh) * 2019-06-11 2019-09-03 北京字节跳动网络技术有限公司 窗口排列方法、装置、终端及存储介质
US20220197675A1 (en) * 2020-12-17 2022-06-23 Open Workspace, LLC System-Independent User Interface Framework

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120084717A1 (en) * 2009-12-18 2012-04-05 Beijing Lenovo Software Ltd. Window management method, apparatus and computing device
US20150309668A1 (en) * 2014-04-24 2015-10-29 Hisense Mobile Communications Technology Co., Ltd. Methods for operating multiple windows on a handheld mobile terminal and the handheld mobile terminal conducting the same
CN105159578A (zh) * 2015-08-24 2015-12-16 小米科技有限责任公司 视频显示模式的切换方法和装置
CN105892845A (zh) * 2015-12-14 2016-08-24 乐视致新电子科技（天津）有限公司 多点触控调整视频窗口的方法及设备
CN106598429A (zh) * 2016-11-29 2017-04-26 北京小米移动软件有限公司 移动终端的窗口调整方法及装置
CN109089070A (zh) * 2018-09-26 2018-12-25 福建星网智慧科技股份有限公司 一种视讯会议终端的布局切换方法及系统
CN109814802A (zh) * 2019-02-01 2019-05-28 北京字节跳动网络技术有限公司 一种界面中的窗口显示方法、装置、设备及存储介质
CN111641797A (zh) * 2020-05-25 2020-09-08 北京字节跳动网络技术有限公司 视频通话界面显示控制方法、装置、存储介质及设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4161065A4 *

Also Published As

Publication number Publication date
KR20230004851A (ko) 2023-01-06
EP4161065A4 (en) 2023-11-15
BR112022023996A2 (pt) 2023-02-07
CN111641797B (zh) 2022-02-18
EP4161065A1 (en) 2023-04-05
JP2023528311A (ja) 2023-07-04
CN111641797A (zh) 2020-09-08
US20220382427A1 (en) 2022-12-01
US11853543B2 (en) 2023-12-26

Similar Documents

Publication Publication Date Title
WO2021238679A1 (zh) 视频通话界面显示控制方法、装置、存储介质及设备
US20220377128A1 (en) File transfer display control method and apparatus, and corresponding terminal
KR102085181B1 (ko) 데이터 전송 방법, 데이터 수신 방법, 및 디바이스
US20200371685A1 (en) Graphical User Interface Display Method And Electronic Device
CN110471596B (zh) 一种分屏切换方法、装置、存储介质及电子设备
WO2021052255A1 (zh) 热点推荐弹窗的控制方法、装置、介质及电子设备
US20200210061A1 (en) Method, device and storage medium for sharing multimedia resource
US9715339B2 (en) Display apparatus displaying user interface and method of providing the user interface
CN109460177A (zh) 一种图片处理方法及终端设备
WO2020249023A1 (zh) 窗口排列方法、装置、终端及存储介质
KR20130119172A (ko) 이동 단말기 및 그 제어방법
WO2020253453A1 (zh) 图像切换方法、装置、电子设备及存储介质
KR20150069801A (ko) 화면 제어 방법 및 그 전자 장치
CN106445354A (zh) 终端设备的触摸控制方法及装置
AU2014201249B2 (en) Method for controlling display function and an electronic device thereof
WO2020000971A1 (zh) 切换全局特效的方法、装置、终端设备及存储介质
WO2021073327A1 (zh) 窗口显示方法、装置、终端及存储介质
US20230273711A1 (en) Electronic device control method and apparatus, and terminal and storage medium
CN108509105A (zh) 一种应用程序管理方法和终端
US12019669B2 (en) Method, apparatus, device, readable storage medium and product for media content processing
WO2022022689A1 (zh) 交互方法、装置和电子设备
WO2024037563A1 (zh) 内容展示方法、装置、设备及存储介质
WO2022179409A1 (zh) 控件显示方法、装置、设备及介质
CN110647286A (zh) 屏幕元素控制方法、装置、设备、存储介质
WO2021244651A1 (zh) 信息显示方法、装置、终端及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21813626

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022572366

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 20227042163

Country of ref document: KR

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112022023996

Country of ref document: BR

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2021813626

Country of ref document: EP

Effective date: 20230102

ENP Entry into the national phase

Ref document number: 112022023996

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20221124