WO2016000359A1 - 移动终端图像的自适应显示方法、装置和计算机存储介质 - Google Patents

移动终端图像的自适应显示方法、装置和计算机存储介质 Download PDF

Info

Publication number
WO2016000359A1
WO2016000359A1 PCT/CN2014/089438 CN2014089438W WO2016000359A1 WO 2016000359 A1 WO2016000359 A1 WO 2016000359A1 CN 2014089438 W CN2014089438 W CN 2014089438W WO 2016000359 A1 WO2016000359 A1 WO 2016000359A1
Authority
WO
WIPO (PCT)
Prior art keywords
sub
mobile terminal
display
pictures
placement state
Prior art date
Application number
PCT/CN2014/089438
Other languages
English (en)
French (fr)
Inventor
罗晓燕
冯斌
朱存望
刘木
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to US15/323,229 priority Critical patent/US20170257599A1/en
Priority to KR1020177002684A priority patent/KR101905182B1/ko
Priority to EP14896885.2A priority patent/EP3163866B1/en
Priority to JP2016575926A priority patent/JP6456411B2/ja
Publication of WO2016000359A1 publication Critical patent/WO2016000359A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N2007/145—Handheld terminals

Definitions

  • the present invention relates to video conferencing technology, and in particular, to an adaptive display method, apparatus, and computer storage medium for implementing an image of a mobile terminal.
  • the Chinese patent document with the publication number CN101673537 and the invention name "A device and method for selecting a screen image” has solved the problem of automatic rotation of the screen by using a gravity sensing device, but the two are common.
  • the problem is that when the picture is rotated, the entire picture image is used as a processing unit, and it is rotated and scaled, and the layout of each sub-picture in the multi-picture cannot be adjusted. Due to the limitation of the size of the mobile terminal, the size and area of the display screen are limited. Especially when multi-point video communication is performed and there are many participants, the small display cannot see the contents of each picture when the multi-screen is displayed.
  • embodiments of the present invention are expected to provide an adaptive display method, apparatus, and computer storage medium for a mobile terminal image.
  • An embodiment of the present invention provides an adaptive display method for a mobile terminal image, where the method includes:
  • the multi-point control terminal determines the number K of sub-screens that the mobile terminal is allowed to display in the current placement state, and selects K sub-pictures to be sent to the mobile terminal for display.
  • the embodiment of the invention further provides an adaptive display device for a mobile terminal image, the device comprising: a sub-screen determination module and a sub-screen selection module; wherein
  • the sub-screen determination module is configured to determine a number K of sub-screens that the mobile terminal is allowed to display in the current placement state;
  • the sub-picture selection module is configured to select K sub-pictures and send them to the mobile terminal for display.
  • Embodiments of the present invention also provide a computer storage medium in which a computer program is stored, the computer program being configured to perform the above-described adaptive display method of a mobile terminal image.
  • the embodiment of the invention provides an adaptive display method and device for a mobile terminal image, and a computer storage medium.
  • the multi-point control terminal determines the number K of sub-screens that the mobile terminal is allowed to display in the current placement state, and selects K sub-pictures to be sent to the mobile device.
  • the terminal performs display; in this way, according to the change of the placement state of the mobile terminal (such as horizontal or vertical), the layout and content of the multi-screen displayed by the mobile terminal are dynamically adjusted in real time, thereby improving the customer-to-screen of the video communication using the mobile terminal. comfortability.
  • FIG. 1 is a schematic flowchart of an adaptive display method for a mobile terminal image according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of an adaptive display method for a mobile terminal image according to Embodiment 1 of the present invention
  • FIG. 3 is a schematic diagram of multi-screen layout adjustment according to Embodiment 2 of the present invention.
  • FIG. 4 is a schematic diagram of multi-screen layout adjustment according to Embodiment 3 of the present invention.
  • FIG. 5 is a flowchart of A when receiving screen rotation information of D according to Embodiment 3 of the present invention. Method flow chart;
  • FIG. 6 is a schematic structural diagram of an apparatus for adaptively displaying an image of a mobile terminal according to an embodiment of the present invention.
  • the multi-point control terminal determines the number K of sub-screens that the mobile terminal is allowed to display in the current placement state, and selects K sub-pictures to be sent to the mobile terminal for display.
  • the embodiment of the invention implements an adaptive display method for a mobile terminal image. As shown in FIG. 1 , the method includes the following steps:
  • Step 101 The multipoint control terminal determines the number K of sub-screens that the mobile terminal is allowed to display in the current placement state;
  • the multi-point control terminal indicates, according to the current placement state of the mobile terminal in the multi-point video conference, the screen information of the mobile terminal, and the resolution of the video images of the N conference terminals, where N represents all conferences.
  • the number of the terminals determines the number of sub-pictures K that the mobile terminal is allowed to display in the placement state; or the multi-point control terminal receives the number of sub-pictures that are allowed to be displayed in the current placement state by the mobile terminal in the multi-point video conference.
  • the number K of sub-screens that are allowed to be displayed in the current placement state sent by the mobile terminal is: the mobile terminal determines the placement state according to the current placement state, the self screen information, and the resolution of the self video image.
  • the number of sprites allowed to be displayed is K.
  • all the conference terminals include: a multipoint control terminal, a mobile terminal, and a normal video terminal, and the multipoint control terminal refers to a terminal provided with a Multi Control Unit (MCU).
  • MCU Multi Control Unit
  • the multi-point control terminal may further identify the mobile terminal in the conference terminal, and determine the mobile terminal in the conference terminal according to the identifier in the interaction information.
  • the placement state includes: horizontal placement and vertical placement
  • the screen information includes: a physical size and an aspect ratio of the screen
  • the multi-point control terminal can obtain the interaction information when interacting with the mobile terminal, and the mobile terminal can obtain its own placement state through the self-contained gravity sensing device, and can obtain Obtaining screen information in the device parameter stored by itself, and carrying the placement state and the screen information in the interaction information when interacting with the multi-point control terminal; and controlling the resolution of the video image of the N conference terminals, the multi-point control terminal Can be obtained when decoding video images of N conference terminals;
  • the multipoint control terminal determines, according to the current placement state of the mobile terminal in the multipoint video conference, the screen information of the mobile terminal, and the resolution of the video image sent by the N conference terminals, that the mobile terminal is in the placed state.
  • the number of sprites allowed to be displayed including:
  • the physical size of the screen of the mobile terminal is S (unit in)
  • the aspect ratio of the screen is Wr:Hr
  • the placement state is C
  • the reference image resolution Rw*Rh and the parameter t are set;
  • the number K of sub-screens that can be displayed by the mobile terminal is obtained.
  • N1 floor(H/(Rw*t))
  • N2 floor(W/(Rh*t)).
  • the setting of the reference image resolution Rw*Rh described above may be dynamically set according to the resolution of the video image transmitted by the N-1 conference terminals and the video image resolution of the multipoint control terminal, or may be set to be fixed. value.
  • Step 102 The multi-point control terminal selects K sub-pictures and sends them to the mobile terminal for display.
  • the multi-point control terminal selects K sub-pictures to be sent to the mobile terminal for display according to the selection criterion, and the selection criteria include: a volume size, a resolution of the video image, a bandwidth, a chairman, a broadcast source, an importance degree, and the like. a criterion; or a criterion obtained by combining at least two criteria of a volume level, a resolution of a video image, a bandwidth, a chairman, a broadcast source, an importance degree, and the like in a weighted manner; or, the multipoint control terminal passes Select a sub-screen in a way that interacts with other conference terminals.
  • the multi-point control terminal may select K sub-pictures to be sent to the mobile terminal for display according to the volume of the video images of the N conference terminals, such as sorting the video images of the N conference terminals according to the volume, selecting a volume or a small volume.
  • K video images are sent as a sub-picture to the mobile terminal for display;
  • the multi-point control terminal may select K sub-pictures for display according to the resolution of the video images of the N conference terminals, such as sorting the video images sent by the N conference terminals according to the resolution, and selecting a large resolution or a small resolution.
  • K video images are sent as a sub-picture to the mobile terminal for display;
  • the multi-point control terminal may select K sub-pictures for display according to the bandwidth of the video images of the N conference terminals, for example, sorting the video images of the N conference terminals according to the bandwidth size, and selecting K video images with large bandwidth or small bandwidth as The sub-picture is sent to the mobile terminal for display;
  • the multi-point control terminal may select K sub-pictures to be displayed according to the chair end of the N conference terminals, such as marking the video images sent by the chair end in the video images of the N conference terminals, and selecting to include the The K video images including the video image are sent to the mobile terminal as a sub-picture for display;
  • the multipoint control terminal may select K sub-pictures for display according to the broadcast source in the N conference terminals, such as marking the broadcast source in the N conference terminals, and selecting K including the video image sent by the broadcast source.
  • Video images are sent to the mobile terminal as sub-pictures for display Show
  • the multi-point control terminal may select K sub-pictures for display according to the importance degree of the video images of the N conference terminals, such as marking the importance degree of the video images of the N conference terminals, and selecting K video images with high importance. Sending as a sub-picture to the mobile terminal for display;
  • the multi-point control terminal may select K sub-pictures for display according to the volume and resolution of the video images of the N conference terminals, for example, sorting the video images of the N conference terminals according to the volume, and recording the ranking of each conference terminal. Then, the video images of the N conference terminals are sorted according to the resolution, and the ranking of each conference terminal is recorded. Finally, the rankings of the N conference terminals sorted according to the volume size and the rankings sorted according to the resolution are weighted, and the weighting value is selected. K video images with high or low weight values are sent as sub-pictures to the mobile terminal for display;
  • the multi-point control terminal may display the K sub-pictures according to the bandwidth of the video images sent by the N conference terminals and the chairman terminals of the N conference terminals, for example, sorting the video images of the N conference terminals according to the bandwidth size, and selecting The video image sent by the chairman is displayed as a sub-screen, and K-1 video images with large bandwidth or small bandwidth are selected as sub-pictures and sent to the mobile terminal for display;
  • the multi-point control terminal may combine in a weighted manner according to at least two criteria of a volume level, a resolution of a video image, a bandwidth, a chairman, a broadcast source, an importance degree, and the like, and select a video image of the N conference terminals.
  • K video images are sent as a sub-picture to the mobile terminal for display;
  • the multi-point control terminal may send a request message to be displayed to other conference terminals.
  • K video images are selected as sub-pictures and transmitted to the mobile terminal for display.
  • the sending the K sub-pictures to the mobile terminal includes: adjusting a display layout of the K sub-pictures, and transmitting the video images of the K sub-pictures and the adjusted display layout to the mobile
  • the terminal may specifically: pre-store a layout template for different numbers of sub-pictures, determine a layout template to be used according to the selected K sub-pictures, and adjust a display size of the K video images according to the size of each sub-picture in the used layout template.
  • the layout template includes: a vertical layout template, a horizontal layout template, a grid layout template, an irregular shape sub-screen layout template, and the like.
  • the adjusting the display layout of the K sub-pictures further includes: adjusting a display layout of a part of the sub-pictures in the K sub-pictures, and specifically: maintaining, in the K sub-pictures, L children in a previous placement state relative to the current placement state.
  • the display position of the screen is unchanged, and the M sub-pictures are adjusted to an empty display area adapted to the current placement state of the mobile terminal. If the current placement is horizontal, the M sub-pictures are adjusted to a horizontal empty display area, and the M sub-pictures and L are The sum of the sub-pictures is K sub-pictures.
  • the method further includes: determining, by the multi-point control terminal, the number of sub-pictures R that the mobile terminal is allowed to display in the current placement state, and selecting the R sub-pictures to be sent to the mobile terminal for display.
  • An adaptive display method for realizing an image of a mobile terminal includes:
  • Step S10 A determines the sub-picture that E allows to display according to the current placement state of E, the horizontal placement of the screen, the physical size and aspect ratio of the screen of E, and the video image resolutions of A, B, C, D, and E.
  • the number K 2.
  • the set sub-picture selection criterion is to select the sub-picture according to the resolution of the video image, and the video resolution relationship of the five mobile terminals is: RA_B>RA_D>RA_A>RA_C>RA_E, then the resolution is selected according to the selection criterion.
  • A is a multi-point control terminal
  • C is a mobile terminal
  • B is a normal video terminal.
  • This embodiment implements adaptive display of a mobile terminal image. Methods include:
  • the sub-pictures of C and C are adjusted to the empty display area in the vertical direction, and the adjusted multi-picture layout is as shown in the right figure of FIG. In this embodiment, it is assumed that each sub-picture occupies 1/3 of the entire screen.
  • the middle schematic diagram in FIG. 3 is a multi-screen display effect obtained in the prior art, and the final image frame of the technology occupies a small proportion of the screen area, and the entire display screen is not fully utilized.
  • A is a multipoint control terminal
  • D is a mobile terminal
  • B and C are ordinary video terminals
  • the screen size of D is 3.5.
  • the aspect ratio of the screen is 3:2, and the placement position before the rotation is horizontally placed. It is assumed that the number of sub-pictures that can be displayed by D is 1 at this time, and the screen of A is selected according to the selection criteria for display.
  • D is rotated, the placement state is changed from the horizontal position to the vertical position, and the processing of A when receiving the screen rotation information of D is as shown in FIG. 5, including:
  • step S20 A receives the screen rotation information of D.
  • the selection criterion is: according to the amount of speech of the upper participant, the size of the voice is determined as follows: VA>VB>VC>VD, according to the selection criterion, the A end is finally selected.
  • the picture on the B side and the picture on the B side are displayed as sub pictures of D.
  • step S23 A performs multi-screen layout adjustment.
  • A can adjust the screen of the display layout A and the vertical discharge of the B, regenerate the sub-screen layout of D, and the screen of A, the screen of B, and the regenerated
  • the sub screen layout is sent to D for display.
  • An adaptive display method for realizing an image of a mobile terminal includes:
  • the interaction information may be a conference video. Connection confirmation, or conference video connection request, etc.
  • the set sub-picture selection criterion is to select a sub-picture according to the resolution of the video image, and the video resolution relationship of the five mobile terminals is: RA_B>RA_D>RA_A>RA_C>RA_E, then the resolution is selected according to the selection criterion.
  • the embodiment of the present invention further provides an adaptive display device for a mobile terminal image.
  • the device is disposed in a multi-point control terminal. As shown in FIG. 6, the device includes: a sub-picture. a determining module 61, a sub-screen selecting module 62; wherein
  • the sub-screen determination module 61 may be implemented by a combination of a communication interface and a processor, and configured to determine a number K of sub-screens that the mobile terminal is allowed to display in a current placement state;
  • the sub-screen determination module 61 indicates, according to the current placement state of the mobile terminal in the multi-point video conference, the screen information of the mobile terminal, and the resolution of the video images of the N conference terminals, the N represents all conferences.
  • the number of terminals determines the number of sub-pictures K that the mobile terminal is allowed to display in the placement state; here, all the conference terminals include: a multi-point control terminal, a mobile terminal, and a normal video terminal.
  • the sub-screen determination module 61 can obtain the interaction information when the multi-point control terminal interacts with the mobile terminal, and the mobile terminal can pass the gravity sensing device. Obtaining its own placement state, and obtaining screen information from the device parameters stored by itself, and carrying the placement state and the screen information in the interaction information when interacting with the multi-point control terminal; for the video of the N conference terminals Image division The resolution, the sub-picture determination module 61 can be obtained when decoding the video images of the N conference terminals.
  • the sub-screen determination module 61 may also receive the number of sub-screens K that are allowed to be displayed in the current placement state sent by the mobile terminal in the multi-point video conference; the number of sub-screens K that the mobile terminal transmits in the current placement state is allowed to be displayed.
  • the mobile terminal determines the number K of sub-screens that are allowed to be displayed in the placement state according to the current placement state, the self screen information, and the resolution of the own video image.
  • the sub-picture selection module 62 may be implemented by a combination of a communication interface and a processor, and configured to select K sub-pictures to be sent to the mobile terminal for display;
  • the sub-picture selection module 62 selects K sub-pictures to be sent to the mobile terminal for display according to the selection criterion, and the selection criteria include: volume level, resolution of the video image, bandwidth, chairman, broadcast source, importance degree, and the like. Any one of the criteria; or a criterion obtained by combining the weighted manner according to at least two of the volume, the resolution of the video image, the bandwidth, the chairman, the broadcast source, the importance, and the like; or the multipoint
  • the control terminal selects a sub-picture by interacting with the N-1 conference terminals.
  • the sub-screen determination module 61 is further configured to re-determine the number of sub-pictures R that the mobile terminal is allowed to display in the current placement state when the placement state of the mobile terminal is changed;
  • the sub-screen selection module 62 is further configured to select R sub-pictures and send them to the mobile terminal for display.
  • the adaptive display method of the mobile terminal image according to the embodiment of the present invention may also be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as an independent product.
  • a computer readable storage medium if it is implemented in the form of a software function module and sold or used as an independent product.
  • embodiments of the present application can be provided as a method, system, or computer program product.
  • the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware.
  • the application may employ one or more of the computer usable program code contained therein.
  • the computer may be in the form of a computer program product embodied on a storage medium, including but not limited to a USB flash drive, a removable hard drive, a Read-Only Memory (ROM), a disk storage, a CD-ROM, an optical storage, etc. .
  • a storage medium including but not limited to a USB flash drive, a removable hard drive, a Read-Only Memory (ROM), a disk storage, a CD-ROM, an optical storage, etc.
  • an embodiment of the present invention further provides a computer storage medium, wherein a computer program is configured, and the computer program is configured to perform an adaptive display method of a mobile terminal image according to an embodiment of the present invention.
  • the present invention can dynamically adjust the layout and content of the multi-screen displayed by the mobile terminal in real time according to the change of the placement state of the mobile terminal (such as horizontal placement or vertical placement), thereby improving the video using the mobile terminal.
  • the communication customer has a comfortable picture.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Telephone Function (AREA)

Abstract

本发明公开了一种移动终端图像的自适应显示方法，多点控制终端确定移动终端在当前放置状态下允许显示的子画面数量K，选择K个子画面发送给移动终端进行显示。本发明同时还公开了一种移动终端图像的自适应显示装置和计算机存储介质。

Description

移动终端图像的自适应显示方法、装置和计算机存储介质 技术领域
本发明涉及视频会议技术，尤其涉及一种实现移动终端图像的自适应显示方法、装置和计算机存储介质。
背景技术
随着通信技术和移动终端技术的发展，移动终端也可以加入到视频会议中，实时的进行视频和语音的通信。然而当移动终端进行多点视频会议时，由于移动终端的灵活性，如可以随意旋转，当移动终端旋转时，移动终端显示的多画面也应随着产生相应的旋转，以满足移动终端用户的体验和需求。然而，现在的技术，如公开号为CN103220485A、发明名称为《视频播放旋转画面的方法及系统》的中国专利文献提出的视频播放画面旋转的方法中，终端发送的画面旋转请求需要用户参与，没有做到自适应，而公开号为CN101673537、发明名称为《一种屏幕画面选择的实现装置及方法》的中国专利文献，虽然利用重力感应装置解决了画面自动旋转的问题，但是上述两者的共同问题在于画面旋转时是以整个画面图像为处理单位，对其进行旋转和缩放，而无法调整多画面中各子画面的布局。由于受到移动终端体积的限制，其显示屏幕的尺寸和面积有限，尤其当进行多点视频通信、且与会者较多时，小的显示屏无法看清多画面时各画面的内容。
发明内容
为解决现有存在的技术问题，本发明实施例期望提供一种移动终端图像的自适应显示方法、装置和计算机存储介质。
本发明实施例的技术方案是这样实现的：
本发明实施例提供一种移动终端图像的自适应显示方法，该方法包括：
多点控制终端确定移动终端在当前放置状态下允许显示的子画面数量K，选择K个子画面发送给移动终端进行显示。
本发明实施例还提供一种移动终端图像的自适应显示装置，该装置包括：子画面确定模块、子画面选择模块；其中，
所述子画面确定模块，配置为确定移动终端在当前放置状态下允许显示的子画面数量K；
所述子画面选择模块，配置为选择K个子画面发送给移动终端进行显示。
本发明实施例还提供一种计算机存储介质，其中存储有计算机程序，该计算机程序配置为执行上述的移动终端图像的自适应显示方法。
本发明实施例提供了一种移动终端图像的自适应显示方法、装置和计算机存储介质，多点控制终端确定移动终端在当前放置状态下允许显示的子画面数量K，选择K个子画面发送给移动终端进行显示；如此，可根据移动终端放置状态的变化(如横放或竖放)，实时动态调整移动终端显示的多画面的布局和内容，从而提升使用移动终端进行视频通讯的客户对画面的舒适感。
附图说明
图1为本发明实施例提供的移动终端图像的自适应显示方法的流程示意图；
图2为为本发明实施例一提供的移动终端图像的自适应显示方法的流程示意图；
图3为本发明实施例二提供的多画面布局调整的示意图；
图4为本发明实施例三提供的多画面布局调整的示意图；
图5为本发明实施例三提供的A在接收到D的屏幕旋转信息时的处理 方法流程图；
图6为本发明实施例提供的移动终端图像的自适应显示装置结构示意图。
具体实施方式
本发明实施例中，多点控制终端确定移动终端在当前放置状态下允许显示的子画面数量K，选择K个子画面发送给移动终端进行显示。
下面通过附图及具体实施例对本发明做进一步的详细说明。
本发明实施例实现一种移动终端图像的自适应显示方法，如图1所示，该方法包括以下几个步骤：
步骤101：多点控制终端确定移动终端在当前放置状态下允许显示的子画面数量K；
具体的，在多点视频会议中，多点控制终端根据多点视频会议中移动终端的当前放置状态、移动终端的屏幕信息、以及N个会议终端的视频图像的分辨率，所述N表示所有会议终端的数量，确定所述移动终端在所述放置状态下允许显示的子画面数量K；或者，多点控制终端接收多点视频会议中移动终端发送的在当前放置状态下允许显示的子画面数量K；所述移动终端发送的在当前放置状态下允许显示的子画面数量K为：所述移动终端根据自身当前放置状态、自身屏幕信息、以及自身视频图像的分辨率，确定出在所述放置状态下允许显示的子画面数量K。这里，所述所有会议终端包括：多点控制终端、移动终端、和普通视频终端，所述多点控制终端是指设置有多点控制单元(MCU，Multi Control Unit)的终端。
此外，在多点视频会议中，多点控制终端还可以对会议终端中的移动终端进行标识，根据交互信息中的所述标识确定会议终端中的移动终端。
本步骤中，所述放置状态包括：水平放置和竖直放置，所述屏幕信息包括：屏幕的物理尺寸和宽高比；
对于所述放置状态、所述屏幕信息的获得，多点控制终端可以通过与移动终端交互时的交互信息获得，所述移动终端可以通过自带的重力感应器件获得自身的放置状态，并可以从自身存储的设备参数中获得屏幕信息，在与多点控制终端交互时将所述放置状态、所述屏幕信息携带在交互信息中；对于N个会议终端的视频图像的分辨率，多点控制终端可以在对N个会议终端的视频图像进行解码时获得；
这里，所述多点控制终端根据多点视频会议中移动终端的当前放置状态、移动终端的屏幕信息、以及N个会议终端发送的视频图像的分辨率，确定所述移动终端在所述放置状态下允许显示的子画面数量K，包括：
假设接收到移动终端的屏幕物理尺寸为S(单位in)，屏幕的宽高比为Wr:Hr，放置状态为C，设定参考的图像分辨率Rw*Rh和参数t；
首先，求出移动终端屏幕的宽(W)和高(H)，
W/H＝Wr/Hr
W2+H2＝(S*2.54)2。
上述方程组的解为求得的屏幕宽和高(单位cm)。
然后，求出移动终端可显示的子画面数K。
屏幕放置状态C为水平放置时，N1＝floor(W/(Rw*t))，N2＝floor(H/(Rh*t))。
屏幕放置状态C为竖直放置时，N1＝floor(H/(Rw*t))，N2＝floor(W/(Rh*t))。
其中，floor为返回小于或者等于指定表达式的最大整数的函数；N1，N2的最小值为1。
K＝N1*N2。
上面所述参考图像分辨率Rw*Rh的设定，可以根据N-1个会议终端发送的视频图像分辨率和多点控制终端的视频图像分辨率进行动态设定，也可设定为一个固定值。
步骤102：多点控制终端选择K个子画面发送给移动终端进行显示；
具体的，多点控制终端根据选择准则选择K个子画面发送给移动终端进行显示，所述选择准则包括：音量大小、视频图像的分辨率、带宽、主席端、广播源、重要程度等中的任意一个准则；或者，根据音量大小、视频图像的分辨率、带宽、主席端、广播源、重要程度等中的至少两个准则以加权方式进行组合得到的准则；或者，所述多点控制终端通过与其他会议终端交互的方式选择子画面。
例如，多点控制终端可以根据N个会议终端的视频图像的音量大小选择K个子画面发送给移动终端进行显示，如对N个会议终端的视频图像按照音量大小排序，选择音量大或音量小的K个视频图像作为子画面发送给移动终端进行显示；
或者，多点控制终端可以根据N个会议终端的视频图像的分辨率选择K个子画面进行显示，如对N个会议终端发送的视频图像按照分辨率大小排序，选择分辨率大或分辨率小的K个视频图像作为子画面发送给移动终端进行显示；
或者，多点控制终端可以根据N个会议终端的视频图像的带宽选择K个子画面进行显示，如对N个会议终端的视频图像按照带宽大小排序，选择带宽大或带宽小的K个视频图像作为子画面发送给移动终端进行显示；
或者，多点控制终端可以根据N个会议终端中的主席端选择K个子画面进行显示，如对N个会议终端的视频图像中主席端发送的视频图像进行标记，选择包括所述主席端发送的视频图像在内的K个视频图像作为子画面发送给移动终端进行显示；
或者，多点控制终端可以根据N个会议终端中的广播源选择K个子画面进行显示，如对N个会议终端中的广播源进行标记，选择包括所述广播源发送的视频图像在内的K个视频图像作为子画面发送给移动终端进行显 示；
或者，多点控制终端可以根据N个会议终端的视频图像的重要程度选择K个子画面进行显示，如对N个会议终端的视频图像的重要程度进行标记，选择包括重要程度高的K个视频图像作为子画面发送给移动终端进行显示；
或者，多点控制终端可以根据N个会议终端的视频图像的音量大小和分辨率选择K个子画面进行显示，如对N个会议终端的视频图像按照音量大小排序，记录各会议终端的排位，再对N个会议终端的视频图像按照分辨率排序，记录各会议终端的排位，最后将N个会议终端的按照音量大小排序的排位与按照分辨率排序的排位进行加权，选择加权值高或加权值低的K个视频图像作为子画面发送给移动终端进行显示；
或者，多点控制终端可以根据N个会议终端发送的视频图像的带宽、N个会议终端中的主席端选择K个子画面进行显示，如对N个会议终端的视频图像按照带宽大小排序，选择所述主席端发送的视频图像作为一个子画面进行显示，并选择带宽大或带宽小的K-1个视频图像作为子画面发送给移动终端进行显示；
类似的，多点控制终端可以根据音量大小、视频图像的分辨率、带宽、主席端、广播源、重要程度等中的至少两个准则以加权方式进行组合，选择N个会议终端的视频图像中K个视频图像作为子画面发送给移动终端进行显示；
另外，多点控制终端可以向其他会议终端发送是否需要显示的请求消息，在需要显示的会议终端发送的视频图像中，选择K个视频图像作为子画面发送给移动终端进行显示。
本步骤中，所述选择K个子画面发送给移动终端包括：调整K个子画面的显示布局，将K个子画面的视频图像和调整后的显示布局发送给移动 终端；具体可以是：预先存储针对不同数量子画面的布局模板，根据选择的K个子画面确定所使用的布局模板，根据所使用的布局模板中各子画面大小，调整K个视频图像的显示大小，将所述K个视频图像和所使用的布局模板发送给移动终端；所述布局模板包括：竖排布局模板、水平布局模板、网格布局模板、不规则形状子画面布局模板等。
所述调整K个子画面的显示布局还包括：调整K个子画面中的部分子画面的显示布局，具体可以是：在K个子画面中，保持相对于当前放置状态的前一放置状态下的L个子画面的显示位置不变，将M个子画面调整到适应移动终端当前放置状态的空显示区域，如当前为水平放置，则将M个子画面调整到水平的空显示区域，所述M个子画面与L个子画面的和为K个子画面。
在移动终端的放置状态改变时，上述方法还包括：多点控制终端重新确定移动终端在当前放置状态下允许显示的子画面数量R，选择R个子画面发送给移动终端进行显示。
为了更好地理解本发明，下面结合具体实施例对本发明作进一步地描述。
实施例1
下面以5个会议终端(A、B、C、D和E)进行视频会议为例，其中，A为多点控制终端，E为移动终端，B、C、D为普通视频终端，本实施例实现移动终端图像的自适应显示方法，如图2所示，包括：
步骤S10，A根据E的当前放置状态为水平放置、E的屏幕的物理尺寸和宽高比、以及A、B、C、D和E的视频图像分辨率，确定此时E允许显示的子画面数量K＝2。
步骤S11，A选择K＝2个子画面发送给E进行显示；
这里，由于K<N(N＝5)，则需要根据选择准则对子画面进行选择。假 设设定的子画面选择准则为根据视频图像的分辨率选择子画面，五个移动终端的视频分辨率关系为：RA_B>RA_D>RA_A>RA_C>RA_E，则根据选择准则，选择分辨率大的两个子画面，即B和D的画面作为E的显示子画面。
实施例2
下面以3个会议终端(A、B和C)进行视频会议为例，其中，A为多点控制终端，C为移动终端，B为普通视频终端，本实施例实现移动终端图像的自适应显示方法包括：
A根据C的当前放置状态为水平放置、C的屏幕的物理尺寸和宽高比、以及A、B和C的视频图像分辨率，确定此时C可显示的子画面数量K＝3，即可显示此时上会终端的全部会议终端。
根据选择准则选择要显示的K个子画面，此时，K＝N＝3，则选择A、B、C三个画面作为C的显示子画面，将选择的K个子画面发送给C进行显示。
假设此时C的多画面布局为图3中的左图所示，A、B、C三个端的布局为从左到右排列，图3仅用于说明多画面的布局调整策略，并不限定使用其他布局调整策略的情况。若在视频会议过程中C发生了旋转，由最初的水平放置旋转成竖直放置，则A会接收到C的放置状态的变化信息，从而重新计算在竖直状态下C可显示的子画面数量R，假设此时计算得到的R＝3，则选择A、B、C三个画面作为C的显示子画面，此时需要调整子画面布局，可以保持B的子画面的位置不变，将A和C的子画面调整到竖直方向的空显示区域，调整后的多画面布局如图3中的右图所示。在此实施例中，假设每个子画面占整个屏幕的1/3。图3中的中间示意图为现有技术下得到的多画面显示效果，该技术最终的图像画面所占屏幕面积的比例小，并没有充分利用整个显示屏幕。
实施例3
下面以4个会议终端(A、B、C和D)进行视频会议为例，其中，A为多点控制终端，D为移动终端，B和C为普通视频终端，假设D的屏幕尺寸为3.5in，屏幕宽高比为3:2，在旋转前的放置位置为水平放置，假设此时计算得到D可显示的子画面数量为1，且根据选择准则选择A的画面进行显示，显示示意图如图4中的左图所示，在上会过程中D发生旋转，放置状态由水平位置变成竖直放置，A在接收到D的屏幕旋转信息时的处理如图5所示，包括：
步骤S20，A接收D的屏幕旋转信息。
步骤S21，A确定D在竖直状态下可显示的子画面数量R＝2，该R的计算需要根据D的屏幕的尺寸、宽高比、以及A、B、C和D四个会议终端的视频图像的分辨率等信息进行计算。
步骤S22，A根据设定的选择准则选择要显示的R＝2个子画面；
这里，假设选择准则为：按上会者语音量从大到小进行选择，则如果此时各端的语音量大小关系为：VA>VB>VC>VD，根据所述选择准则，最终选择A端和B端的画面作为D的显示子画面。
步骤S23，A进行多画面布局调整。
这里，如图4中的右图所示，A可以调整显示布局为A的画面和B的画面竖直排放，重新生成D的子画面布局，A将A的画面、B的画面以及重新生成的子画面布局发送给D进行显示。
实施例4
下面以5个会议终端(A、B、C、D和E)进行视频会议为例，其中，A为多点控制终端，E为移动终端，B、C、D为普通视频终端，本实施例实现移动终端图像的自适应显示方法包括：
E根据自身的当前放置状态为水平放置、自身屏幕的物理尺寸和宽高 比、以及自身视频图像分辨率，确定此时E允许显示的子画面数量K＝2，将允许显示的子画面数量K＝2在与A的交互信息中携带，所述交互信息可以是会议视频连接确认、或会议视频连接请求等。
A接收E允许显示的子画面数量K＝2，选择K＝2个子画面发送给E进行显示；
这里，由于K<N(N＝5)，则需要根据选择准则对子画面进行选择。假设设定的子画面选择准则为根据视频图像的分辨率选择子画面，五个移动终端的视频分辨率关系为：RA_B>RA_D>RA_A>RA_C>RA_E，则根据选择准则，选择分辨率大的两个子画面，即B和D的画面作为E的显示子画面。
基于上述的移动终端图像的自适应显示方法，本发明实施例还提供一种移动终端图像的自适应显示装置，该装置设置在多点控制终端，如图6所示，该装置包括：子画面确定模块61、子画面选择模块62；其中，
所述子画面确定模块61，可以由通信接口和处理器结合实现，配置为确定移动终端在当前放置状态下允许显示的子画面数量K；
在多点视频会议中，所述子画面确定模块61根据多点视频会议中移动终端的当前放置状态、移动终端的屏幕信息、以及N个会议终端的视频图像的分辨率，所述N表示所有会议终端的数量，确定所述移动终端在所述放置状态下允许显示的子画面数量K；这里，所述所有会议终端包括：多点控制终端、移动终端、和普通视频终端。
对于所述放置状态、所述屏幕信息的获得，所述子画面确定模块61可以通过自身所在多点控制终端与移动终端交互时的交互信息获得，所述移动终端可以通过自带的重力感应器件获得自身的放置状态，并可以从自身存储的设备参数中获得屏幕信息，在与多点控制终端交互时将所述放置状态、所述屏幕信息携带在交互信息中；对于N个会议终端的视频图像的分 辨率，所述子画面确定模块61可以在对N个会议终端的视频图像进行解码时获得。
所述子画面确定模块61也可以接收多点视频会议中移动终端发送的在当前放置状态下允许显示的子画面数量K；所述移动终端发送的在当前放置状态下允许显示的子画面数量K为：所述移动终端根据自身当前放置状态、自身屏幕信息、以及自身视频图像的分辨率，确定出在所述放置状态下允许显示的子画面数量K。
所述子画面选择模块62，可以由通信接口和处理器结合实现，配置为选择K个子画面发送给移动终端进行显示；
具体的，所述子画面选择模块62根据选择准则选择K个子画面发送给移动终端进行显示，所述选择准则包括：音量大小、视频图像的分辨率、带宽、主席端、广播源、重要程度等中的任意一个准则；或者，根据音量大小、视频图像的分辨率、带宽、主席端、广播源、重要程度等中的至少两个准则以加权方式进行组合得到的准则；或者，所述多点控制终端通过与所述N-1个会议终端交互的方式选择子画面。
所述子画面确定模块61，还配置为在移动终端的放置状态改变时，重新确定移动终端在当前放置状态下允许显示的子画面数量R；
所述子画面选择模块62，还配置为选择R个子画面发送给移动终端进行显示。
本发明实施例所述移动终端图像的自适应显示方法如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。基于这样的理解，本领域内的技术人员应明白，本申请的实施例可提供为方法、系统、或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码 的计算机可用存储介质上实施的计算机程序产品的形式，所述存储介质包括但不限于U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、磁盘存储器、CD-ROM、光学存储器等。
相应的，本发明实施例还提供一种计算机存储介质，其中存储有计算机程序，该计算机程序配置为执行本发明实施例的移动终端图像的自适应显示方法。
以上所述，仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围，凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等，均应包含在本发明的保护范围之内。
工业实用性
综合各实施例描述的技术方案，本发明能够根据移动终端放置状态的变化(如水平放置或竖直放置)，实时动态调整移动终端显示的多画面的布局和内容，从而提升使用移动终端进行视频通讯的客户对画面的舒适感。

Claims (14)

  1. 一种移动终端图像的自适应显示方法，该方法包括：
    多点控制终端确定移动终端在当前放置状态下允许显示的子画面数量K，选择K个子画面发送给移动终端进行显示。
  2. 根据权利要求1所述的自适应显示方法，其中，所述多点控制终端确定移动终端在当前放置状态下允许显示的子画面数量K包括：多点控制终端根据多点视频会议中移动终端的当前放置状态、移动终端的屏幕信息、以及N个会议终端的视频图像的分辨率，所述N表示所有会议终端的数量，确定所述移动终端在所述放置状态下允许显示的子画面数量K。
  3. 根据权利要求1所述的自适应显示方法，其中，所述多点控制终端确定移动终端在当前放置状态下允许显示的子画面数量K包括：多点控制终端接收多点视频会议中移动终端发送的在当前放置状态下允许显示的子画面数量K；所述移动终端发送的在当前放置状态下允许显示的子画面数量K为：所述移动终端根据自身当前放置状态、自身屏幕信息、以及自身视频图像的分辨率，确定出在所述放置状态下允许显示的子画面数量K。
  4. 根据权利要求1所述的自适应显示方法，其中，所述选择K个子画面发送给移动终端进行显示包括：根据选择准则选择K个子画面发送给移动终端进行显示。
  5. 根据权利要求4所述的自适应显示方法，其中，所述选择准则包括：音量大小、视频图像的分辨率、带宽、主席端、广播源、重要程度中的任意一个准则；或者，根据音量大小、视频图像的分辨率、带宽、主席端、广播源、重要程度中的至少两个准则以加权方式进行组合得到的准则；或者，所述多点控制终端通过与其他会议终端交互的方式选择子画面。
  6. 根据权利要求5所述的自适应显示方法，其中，所述选择K个子画面发送给移动终端包括：调整K个子画面的显示布局，将K个子画面的视 频图像和调整后的显示布局发送给移动终端。
  7. 根据权利要求6所述的自适应显示方法，其中，所述调整K个子画面的显示布局包括：调整K个子画面中的部分子画面的显示布局。
  8. 根据权利要求1所述的自适应显示方法，其中，在移动终端的放置状态改变时，该方法还包括：多点控制终端重新确定移动终端在当前放置状态下允许显示的子画面数量R，选择R个子画面发送给移动终端进行显示。
  9. 一种移动终端图像的自适应显示装置，该装置包括：子画面确定模块、子画面选择模块；其中，
    所述子画面确定模块，配置为确定移动终端在当前放置状态下允许显示的子画面数量K；
    所述子画面选择模块，配置为选择K个子画面发送给移动终端进行显示。
  10. 根据权利要求9所述的自适应显示装置，其中，所述子画面确定模块，配置为根据多点视频会议中移动终端的当前放置状态、移动终端的屏幕信息、以及N个会议终端的视频图像的分辨率，所述N表示所有会议终端的数量，确定所述移动终端在所述放置状态下允许显示的子画面数量K。
  11. 根据权利要求9所述的自适应显示装置，其中，所述子画面确定模块，配置为接收多点视频会议中移动终端发送的在当前放置状态下允许显示的子画面数量K；所述移动终端发送的在当前放置状态下允许显示的子画面数量K为：所述移动终端根据自身当前放置状态、自身屏幕信息、以及自身视频图像的分辨率，确定出在所述放置状态下允许显示的子画面数量K。
  12. 根据权利要求8所述的自适应显示装置，其中，所述子画面选择 模块，配置为根据选择准则选择K个子画面发送给移动终端进行显示。
  13. 根据权利要求8所述的自适应显示装置，其中，
    所述子画面确定模块，还配置为在移动终端的放置状态改变时，重新确定移动终端在当前放置状态下允许显示的子画面数量R；
    所述子画面选择模块，还配置为选择R个子画面发送给移动终端进行显示。
  14. 一种计算机存储介质，其中存储有计算机程序，该计算机程序配置为执行权利要求1至8任一项所述的移动终端图像的自适应显示方法。
PCT/CN2014/089438 2014-06-30 2014-10-24 移动终端图像的自适应显示方法、装置和计算机存储介质 WO2016000359A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US15/323,229 US20170257599A1 (en) 2014-06-30 2014-10-24 Self-Adaptive Display Method and Device for Image of Mobile Terminal, and Computer Storage Medium
KR1020177002684A KR101905182B1 (ko) 2014-06-30 2014-10-24 이동 단말 이미지의 자체 적응 디스플레이 방법, 장치와 컴퓨터 저장 매체
EP14896885.2A EP3163866B1 (en) 2014-06-30 2014-10-24 Self-adaptive display method and device for image of mobile terminal, and computer storage medium
JP2016575926A JP6456411B2 (ja) 2014-06-30 2014-10-24 移動端末画像の自己適応表示方法、装置及びコンピュータ記憶媒体

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410309612.9A CN105323532B (zh) 2014-06-30 2014-06-30 一种移动终端图像的自适应显示方法和装置
CN201410309612.9 2014-06-30

Publications (1)

Publication Number Publication Date
WO2016000359A1 true WO2016000359A1 (zh) 2016-01-07

Family

ID=55018374

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/089438 WO2016000359A1 (zh) 2014-06-30 2014-10-24 移动终端图像的自适应显示方法、装置和计算机存储介质

Country Status (6)

Country Link
US (1) US20170257599A1 (zh)
EP (1) EP3163866B1 (zh)
JP (1) JP6456411B2 (zh)
KR (1) KR101905182B1 (zh)
CN (1) CN105323532B (zh)
WO (1) WO2016000359A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017128517A1 (zh) * 2016-01-26 2017-08-03 邦彦技术股份有限公司 一种基于sip协议的视频会议的实现方法及其系统
JP2019021517A (ja) * 2017-07-18 2019-02-07 関西ペイント株式会社 リチウムイオン電池正極用導電ペースト及びリチウムイオン電池正極用合材ペーストの製造方法

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4365725A2 (en) 2014-05-30 2024-05-08 Apple Inc. Continuity
CN105828130A (zh) * 2016-03-23 2016-08-03 深圳Tcl数字技术有限公司 多终端节目同步预览方法和装置
KR101967819B1 (ko) * 2017-11-02 2019-04-10 주식회사 코난테크놀로지 타일 영상 기반 다중 재생을 위한 영상 처리장치 및 그 타일 영상 구성방법
US11328720B2 (en) * 2017-12-26 2022-05-10 Mitsubishi Electric Corporation Inter-occupant conversation device and inter-occupant conversation method
DK201870364A1 (en) 2018-05-07 2019-12-03 Apple Inc. MULTI-PARTICIPANT LIVE COMMUNICATION USER INTERFACE
US11128792B2 (en) 2018-09-28 2021-09-21 Apple Inc. Capturing and displaying images with multiple focal planes
CN110248145A (zh) * 2019-06-25 2019-09-17 武汉冠科智能科技有限公司 一种无纸化会议显示控制方法、装置和存储介质
US11513667B2 (en) 2020-05-11 2022-11-29 Apple Inc. User interface for audio message
US11431891B2 (en) 2021-01-31 2022-08-30 Apple Inc. User interfaces for wide angle video conference
CN113891032A (zh) * 2021-03-17 2022-01-04 广州市保伦电子有限公司 一种自动切换移动终端视频会议终端布局的方法和服务器
US11907605B2 (en) 2021-05-15 2024-02-20 Apple Inc. Shared-content session user interfaces
US11893214B2 (en) 2021-05-15 2024-02-06 Apple Inc. Real-time communication user interface
US20220368548A1 (en) 2021-05-15 2022-11-17 Apple Inc. Shared-content session user interfaces
KR20230173148A (ko) * 2021-05-18 2023-12-26 애플 인크. 적응적 화상 회의 사용자 인터페이스들
CN114286152A (zh) * 2021-08-02 2022-04-05 海信视像科技股份有限公司 显示设备、通信终端及投屏画面动态显示方法
US11770600B2 (en) 2021-09-24 2023-09-26 Apple Inc. Wide angle video conference

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1620133A (zh) * 2003-11-21 2005-05-25 华为技术有限公司 在会议电视系统中实现单画面和多画面切换的方法
CN101031065A (zh) * 2007-04-27 2007-09-05 华为技术有限公司 一种在视频业务中实现画面切换的方法、装置及系统
US20100056219A1 (en) * 2008-09-01 2010-03-04 Tae Jung Kwon Terminal, controlling method thereof and recordable medium for the same
CN102833518A (zh) * 2011-06-13 2012-12-19 华为终端有限公司 一种mcu多画面优化配置的方法及装置
CN103763505A (zh) * 2013-12-31 2014-04-30 华为技术有限公司 一种在视频通话中适应屏幕方向切换的方法和装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3097736B2 (ja) * 1996-11-29 2000-10-10 日本電気株式会社 多画面伝送式多地点テレビ会議システム
US20020093531A1 (en) * 2001-01-17 2002-07-18 John Barile Adaptive display for video conferences
JP3804766B2 (ja) * 2001-03-15 2006-08-02 シャープ株式会社 画像通信装置および携帯型電話機
US7492386B2 (en) * 2004-11-05 2009-02-17 Sony Ericsson Mobile Communications Ab Display management during a multi-party conversation
JP4504302B2 (ja) * 2005-11-17 2010-07-14 シャープ株式会社 携帯端末装置
JP4815503B2 (ja) * 2009-03-31 2011-11-16 株式会社ディップス 通信システム、提供装置およびプログラム
US8917632B2 (en) * 2010-04-07 2014-12-23 Apple Inc. Different rate controller configurations for different cameras of a mobile device
KR101702949B1 (ko) * 2010-04-21 2017-02-06 엘지전자 주식회사 영상표시장치의 동작 방법
CN102685415A (zh) * 2011-03-18 2012-09-19 华为终端有限公司 一种视频画面处理方法、系统、设备及终端
US9369667B2 (en) * 2012-04-11 2016-06-14 Jie Diao Conveying gaze information in virtual conference
JP5921404B2 (ja) * 2012-09-28 2016-05-24 株式会社東芝 情報表示装置、情報表示方法及びプログラム
CN103345390A (zh) * 2013-06-17 2013-10-09 北京金山安全软件有限公司 用于移动终端的图片输出方法、装置和移动终端

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1620133A (zh) * 2003-11-21 2005-05-25 华为技术有限公司 在会议电视系统中实现单画面和多画面切换的方法
CN101031065A (zh) * 2007-04-27 2007-09-05 华为技术有限公司 一种在视频业务中实现画面切换的方法、装置及系统
US20100056219A1 (en) * 2008-09-01 2010-03-04 Tae Jung Kwon Terminal, controlling method thereof and recordable medium for the same
CN102833518A (zh) * 2011-06-13 2012-12-19 华为终端有限公司 一种mcu多画面优化配置的方法及装置
CN103763505A (zh) * 2013-12-31 2014-04-30 华为技术有限公司 一种在视频通话中适应屏幕方向切换的方法和装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3163866A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017128517A1 (zh) * 2016-01-26 2017-08-03 邦彦技术股份有限公司 一种基于sip协议的视频会议的实现方法及其系统
JP2019021517A (ja) * 2017-07-18 2019-02-07 関西ペイント株式会社 リチウムイオン電池正極用導電ペースト及びリチウムイオン電池正極用合材ペーストの製造方法
JP7185997B2 (ja) 2017-07-18 2022-12-08 関西ペイント株式会社 リチウムイオン電池正極用導電ペースト及びリチウムイオン電池正極用合材ペーストの製造方法

Also Published As

Publication number Publication date
KR101905182B1 (ko) 2018-10-08
US20170257599A1 (en) 2017-09-07
JP6456411B2 (ja) 2019-01-23
EP3163866B1 (en) 2020-05-06
CN105323532B (zh) 2019-10-15
EP3163866A4 (en) 2017-07-12
KR20170026560A (ko) 2017-03-08
JP2017526239A (ja) 2017-09-07
EP3163866A1 (en) 2017-05-03
CN105323532A (zh) 2016-02-10

Similar Documents

Publication Publication Date Title
WO2016000359A1 (zh) 移动终端图像的自适应显示方法、装置和计算机存储介质
JP5508450B2 (ja) マルチストリームかつマルチサイトのテレプレゼンス会議システムのための自動的なビデオレイアウト
JP5852157B2 (ja) スケーラブルなビデオ通信システムおよび音声通信システムにおけるビューレイアウト管理の改良
JP4994646B2 (ja) 通信端末および通信システム、並びに通信端末の表示方法
WO2013174115A1 (zh) 一种多画面视讯会议中的画面控制方法、设备及系统
JP2017527230A (ja) コンテンツを配信および／または再生するための方法及び装置
US9438856B2 (en) Method and system for optimal balance and spatial consistency
US20130271560A1 (en) Conveying gaze information in virtual conference
US20070299981A1 (en) Techniques for managing multi-window video conference displays
WO2012171459A1 (zh) 一种mcu多画面优化配置的方法及装置
WO2012103820A2 (zh) 视频会议中突显关注者的方法、设备及系统
US8836753B2 (en) Method, apparatus, and system for processing cascade conference sites in cascade conference
WO2019052306A1 (zh) 一种视频处理方法、装置和存储介质
CN106162232A (zh) 视频播放控制方法及装置
BR112015004474B1 (pt) Método de gravação de conferência de vídeo, terminal de usuário, servidor de gravação, e sistema de gravação de conferência de vídeo
JP2023508130A (ja) テレカンファレンスの方法
WO2018112720A1 (zh) 一种播放界面调整方法及装置
KR101658098B1 (ko) 모션의자의 강도정보를 포함한 예매정보를 제공하는 예매 시스템 및 예매정보 제공방법
JP6666774B2 (ja) 映像表示システム及び映像表示方法
JP5700998B2 (ja) 立体映像表示装置及びその制御方法
US20130195184A1 (en) Scalable video coding method and apparatus
JP6592676B2 (ja) プログラム、情報処理方法、及び通信システム
JP6324829B2 (ja) 映像提供システムおよびプロラム
CN116366798A (zh) 视频会议中显示视频画面的方法、装置、设备及介质
CN111949122A (zh) 一种虚拟漫游数据的生成方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14896885

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2016575926

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2014896885

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014896885

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20177002684

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 15323229

Country of ref document: US