WO2015101126A1 - 一种在视频通话中适应屏幕方向切换的方法和装置 - Google Patents

一种在视频通话中适应屏幕方向切换的方法和装置 Download PDF

Info

Publication number
WO2015101126A1
WO2015101126A1 PCT/CN2014/092795 CN2014092795W WO2015101126A1 WO 2015101126 A1 WO2015101126 A1 WO 2015101126A1 CN 2014092795 W CN2014092795 W CN 2014092795W WO 2015101126 A1 WO2015101126 A1 WO 2015101126A1
Authority
WO
WIPO (PCT)
Prior art keywords
resolution
terminal
screen
video
screen direction
Prior art date
Application number
PCT/CN2014/092795
Other languages
English (en)
French (fr)
Inventor
李德守
王明武
荣多君
李玉林
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP14876462.4A priority Critical patent/EP3082336A4/en
Publication of WO2015101126A1 publication Critical patent/WO2015101126A1/zh
Priority to US15/198,047 priority patent/US20160309118A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a method and apparatus for adapting to screen direction switching during a video call.
  • video call applications have become more mature.
  • mobile terminals such as mobile phones, tablets, etc.
  • video call applications such as Skype, Facetime, etc.
  • Skype, Facetime, etc. already have a large user base in the mobile Internet.
  • the screen orientation may change as the user's hand posture changes.
  • the screen direction switching means that the terminal switches between the horizontal screen and the vertical screen, such as switching from the horizontal screen to the vertical screen or from the vertical screen to the horizontal screen.
  • most video call applications switch between the horizontal and vertical directions of the video screen when the terminal performs screen orientation switching.
  • the horizontal and vertical screen switching of the terminal will affect the video quality of the video call. For example, when the terminal switches from landscape to portrait, the video image will be stretched in the vertical direction, resulting in impaired video effects and reduced video call quality.
  • Embodiments of the present invention provide a method and apparatus for adapting to screen direction switching in a video call to solve the problem that video call quality is damaged due to screen orientation switching of the terminal.
  • a terminal includes:
  • a monitoring unit configured to monitor a switching of a screen direction of the terminal during a video call; and after monitoring the occurrence of a screen direction switching, provide a monitoring result of the screen direction switching to the negotiating unit;
  • the negotiating unit is configured to: after receiving the monitoring result provided by the monitoring unit, send a screen direction after switching to a peer terminal that performs a video call;
  • a video unit configured to receive a video stream that is sent by the peer terminal according to a video requirement corresponding to the screen direction.
  • the monitoring unit is further configured to determine that the monitored screen direction is switched to an effective screen direction switch before providing the monitoring result to the negotiating unit;
  • the effective screen direction is switched such that the screen direction switching does not occur again within a preset time after the screen direction switching occurs.
  • the video requirement corresponding to the screen orientation specifically includes: a resolution corresponding to the screen orientation;
  • the negotiating unit is configured to send, to the peer terminal, a negotiation request that carries the screen direction, where the negotiation request is used to request the peer terminal to adjust an acquisition resolution of the peer terminal according to the screen orientation.
  • the video unit is specifically configured to receive a video stream that is collected and encoded by the peer terminal after adjusting the acquisition resolution according to a resolution corresponding to the screen direction.
  • the negotiating unit is further configured to send a screen resolution to the peer terminal; the screen resolution is used to determine a resolution corresponding to the screen direction; wherein, the horizontal pixel of the resolution corresponding to the screen orientation is a length pixel of the screen resolution, and the vertical pixel number is the width pixel number of the screen resolution The horizontal pixel of the resolution corresponding to the vertical direction of the screen is the width pixel number of the screen resolution, and the vertical pixel number is the length pixel number of the screen resolution.
  • the negotiating unit is further configured to establish a video call Obtaining an initial screen orientation, and transmitting the initial screen orientation to the peer terminal;
  • the video unit is further configured to receive a video stream that is provided by the peer terminal according to a video request corresponding to the initial screen direction before receiving the switched screen direction.
  • a terminal includes: a receiving unit, configured to receive, after a video call, a screen direction after the switching of the peer terminal in the video call after the screen direction switch occurs;
  • a determining unit configured to determine a video request corresponding to the screen direction received by the receiving unit
  • a video unit configured to provide a video stream to the peer terminal according to a video request corresponding to the screen direction determined by the determining unit.
  • the video requirement corresponding to the screen orientation specifically includes: a resolution corresponding to the screen orientation;
  • the video unit specifically includes an adjustment subunit, an acquisition component, and a video subunit:
  • the adjusting subunit is configured to adjust an acquisition resolution of the collecting component according to a resolution corresponding to the screen orientation
  • the collecting component is configured to collect a video image according to the adjusted resolution of the adjustment subunit
  • the video sub-unit is configured to encode the video image collected by the collection component into a video stream and send the video image to the peer terminal.
  • the adjusting subunit specifically includes:
  • An obtaining module configured to acquire an acquisition resolution supported by the collection component
  • a selection module configured to select, in an acquisition resolution acquired by the acquisition module, an acquisition resolution that is closest to a resolution corresponding to the screen orientation
  • an adjustment module configured to adjust an acquisition resolution of the acquisition component to an acquisition resolution selected by the selection module.
  • the selecting module specifically includes:
  • a sub-module configured to select, in an acquisition resolution acquired by the acquiring module, an acquisition resolution that is closest to the first pixel number and an acquisition resolution that is closest to the second pixel number;
  • a pixel number is a horizontal pixel number of a resolution corresponding to the screen direction, and the second pixel number is a vertical pixel number of a resolution corresponding to the screen direction;
  • a comparison submodule configured to compare a ratio of a horizontal pixel number and a vertical pixel number of the acquisition resolution selected by the selection submodule to a ratio of a horizontal pixel number and a vertical pixel number of the resolution corresponding to the screen direction,
  • the acquisition resolution of the ratio of the number of horizontal pixels and the number of vertical pixels closest to the resolution corresponding to the screen direction is taken as the acquisition resolution closest to the resolution corresponding to the screen direction.
  • the selecting sub-module is specifically configured to: when the number of horizontal pixels is greater than the first number of pixels and the number of vertical pixels is greater than the first In the acquisition resolution of the two-pixel number, the acquisition resolution in which the number of horizontal pixels is closest to the first pixel number and the acquisition resolution in which the number of vertical pixels is closest to the second pixel number are respectively selected.
  • the video subunit specifically includes:
  • a trimming module configured to cut a video image collected by the collecting component into a video image having exactly the same resolution as the screen orientation
  • an encoding module configured to encode the video image that is clipped by the trimming module into a video stream and send the video image to the peer terminal.
  • the terminal further includes:
  • a switching unit configured to switch the locally displayed video picture provided to the opposite terminal to be consistent with the screen direction of the opposite terminal.
  • the receiving unit is further configured to receive a screen resolution of the peer terminal
  • the determining unit is specifically configured to determine a resolution corresponding to the screen direction according to the screen resolution; wherein, the horizontal pixel of the resolution corresponding to the screen direction is a horizontal screen is The length of the screen resolution, the number of vertical pixels is the number of width pixels of the screen resolution; the horizontal pixels of the resolution corresponding to the vertical direction of the screen is the width of the screen resolution The number of vertical pixels is the number of pixels of the length of the screen resolution.
  • the receiving unit is further configured to receive the The initial screen orientation of the peer terminal;
  • the video unit is further configured to provide a video stream to the opposite terminal according to a video requirement corresponding to the initial screen direction before receiving the switched screen direction.
  • a third aspect is a method for adapting a screen direction switch during a video call, the method comprising:
  • the first terminal monitors a switch of a screen orientation of the first terminal
  • the first terminal After detecting the screen direction switching of the first terminal, the first terminal sends the screen orientation after the switching to the second terminal;
  • the first terminal receives a video stream that is sent by the second terminal according to a video request corresponding to the screen direction.
  • the method before the sending the switched screen orientation to the second terminal, the method further includes: determining that the monitored screen direction is switched to an effective screen direction switching; The effective screen direction is switched such that the screen direction switching does not occur again within a preset time after the screen direction switching occurs.
  • the video requirement corresponding to the screen orientation specifically includes: a resolution corresponding to the screen orientation.
  • the sending the screen direction after the switching to the second terminal specifically includes: sending, to the second terminal, a negotiation request that carries the screen direction, where the negotiation request is used to request the second terminal to follow the screen direction Adjusting an acquisition resolution of the second terminal;
  • Receiving the video stream that is sent by the second terminal according to the video requirement corresponding to the screen direction specifically: receiving, by the second terminal, adjusting the resolution according to a resolution corresponding to the screen direction.
  • a video stream that is acquired and encoded after resolution is set.
  • the method further includes:
  • the screen resolution is used to determine a resolution corresponding to the screen direction; wherein the screen direction is a horizontal screen
  • the horizontal pixel corresponding to the resolution is the length pixel of the screen resolution
  • the vertical pixel number is the width pixel number of the screen resolution
  • the horizontal pixel corresponding to the resolution corresponding to the vertical screen direction is the The number of width pixels of the screen resolution
  • the number of vertical pixels is the number of pixels of the length of the screen resolution.
  • the method further includes:
  • the first terminal acquires an initial screen orientation, and sends the initial screen orientation to the second terminal;
  • the first terminal receives a video stream that is provided by the second terminal according to the video requirement corresponding to the initial screen direction before receiving the switched screen direction.
  • a fourth aspect is a method for adapting a screen direction switch during a video call, the method comprising:
  • the second terminal receives the switched screen direction sent by the first terminal after the screen orientation is changed;
  • the second terminal provides a video stream to the first terminal according to the video requirement corresponding to the screen direction.
  • the video requirement corresponding to the screen orientation specifically includes: a resolution corresponding to the screen orientation;
  • the providing, by the second terminal, the video stream to the first terminal according to the video requirement corresponding to the screen direction specifically includes:
  • the second terminal adjusts its own acquisition resolution according to the resolution corresponding to the screen direction
  • the video image is collected according to the adjusted acquisition resolution, and the captured video image is encoded into a video stream and sent to the first terminal.
  • the determining, by the second terminal, the resolution of the second terminal according to the resolution corresponding to the screen direction includes:
  • the second terminal acquires the collection resolution supported by the second terminal
  • the selecting the resolution that is closest to the resolution corresponding to the screen direction in the acquired acquisition resolution includes:
  • the acquisition resolution of the ratio of the number of horizontal pixels to the number of vertical pixels is the acquisition resolution closest to the resolution corresponding to the screen direction.
  • the acquiring, in the acquired acquisition resolution, selecting an acquisition resolution that is the closest to the first pixel number And the number of vertical pixels closest to the second number of pixels specifically includes:
  • the video image that is collected is encoded into a video stream and sent to the first terminal specific package.
  • the clipped video image is encoded into a video stream and sent to the first terminal.
  • the method further includes:
  • the second terminal switches the locally displayed video picture provided to the first terminal to be consistent with the screen orientation of the first terminal.
  • the method further includes: the second terminal receiving a screen resolution of the first terminal;
  • Determining, by the second terminal, the video requirement corresponding to the screen direction specifically includes: determining, by the second terminal, a resolution corresponding to the screen direction according to the screen resolution; wherein the screen direction is a horizontal screen
  • the horizontal pixel corresponding to the resolution is the length pixel of the screen resolution
  • the vertical pixel number is the width pixel number of the screen resolution
  • the horizontal pixel corresponding to the resolution corresponding to the vertical screen direction is the The number of width pixels of the screen resolution
  • the number of vertical pixels is the number of pixels of the length of the screen resolution.
  • the method further includes:
  • the second terminal receives an initial screen orientation of the first terminal
  • the second terminal provides a video stream to the first terminal according to a video requirement corresponding to the initial screen direction before receiving the switched screen direction.
  • the terminal screen direction is monitored during the video call, and the switched screen direction is sent to the peer terminal, so that the peer terminal can provide the video stream according to the video requirement corresponding to the screen direction, thereby avoiding the video stream.
  • the quality of the video call is improved due to the problem that the effect of the screen is impaired when the screen is switched.
  • FIG. 1 is a system architecture diagram of implementing a video call service according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a terminal according to another embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a terminal according to another embodiment of the present invention.
  • FIG. 5 is a flowchart of a method for adapting to screen direction switching in a video call according to an embodiment of the present invention
  • FIG. 6 is a flowchart of a method for adapting to screen direction switching in a video call according to another embodiment of the present invention.
  • FIG. 7 is a flowchart of a method for adapting to horizontal and vertical screen switching in a video call according to another embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of hardware of a terminal according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic structural diagram of hardware of a terminal according to another embodiment of the present invention.
  • FIG. 1 is a system architecture diagram of implementing a video call service according to an embodiment of the present invention.
  • the system includes a video server 11 and a terminal 12 and a terminal 13.
  • the terminal 12 and the terminal 13 are terminals having a video call function.
  • the video server 11 is responsible for the call service. User management, service management, call routing, call negotiation, call connection and other functions.
  • the terminal 12 and the terminal 13 interact through the video server 11.
  • the interaction between the terminal and the video server can be implemented based on a Session Initiation Protocol (SIP).
  • SIP Session Initiation Protocol
  • the solution provided by the embodiment of the present invention can be applied to the terminal 12 and the terminal 13.
  • the terminal 12 When one of the terminal 12 and the terminal 13 performing the video call, for example, the terminal 12, screen direction switching occurs, the terminal 12 notifies the terminal 13 of the screen direction after the switching.
  • the terminal 13 adjusts parameters affecting the quality of the video image according to the screen orientation sent from the terminal 12.
  • the parameter that affects the quality of the video image may specifically be a parameter that is affected by the direction of the screen during playback, such as resolution.
  • the terminal 12 and the terminal 13 in FIG. 1 are only illustrative. In the actual application, there may be multiple terminals for performing a video call, and the multi-party video call terminal may also apply the solution provided by the embodiment of the present invention when the screen direction switch occurs. Specifically, when performing a multi-party video call, the terminal that performs the screen direction switching may separately send the switched screen direction to other terminals participating in the video call, and each terminal that receives the screen direction may correspond to the screen direction. The video requires a video stream to be provided to the terminal that is switching in the direction of the screen.
  • FIG. 2 is a schematic structural diagram of a terminal 20 according to an embodiment of the present invention.
  • the terminal 20 in this embodiment is a terminal that generates screen direction switching.
  • the terminal 20 includes a monitoring unit 21, a negotiating unit 22, and a video unit 23. among them,
  • the monitoring unit 21 is configured to monitor the switching of the screen direction during the video call; after monitoring the occurrence of the screen direction switching, the monitoring result of the screen direction switching is provided to the negotiating unit 22.
  • the negotiating unit 22 is configured to send the switched screen direction to the opposite terminal that performs the video call after receiving the monitoring result provided by the monitoring unit 21.
  • the video unit 23 is configured to receive a video stream that is sent by the opposite terminal according to the video requirement corresponding to the screen direction.
  • the peer terminal can provide the video stream according to the video requirement corresponding to the screen direction. It avoids the problem that the effect is impaired when displaying video due to screen orientation switching, and improves the quality of video call.
  • the screen direction is frequently sent to the opposite terminal.
  • the monitoring unit 21 in the embodiment shown in FIG. 1 is further used to determine that the monitored screen direction is switched to a valid screen before the monitoring result is submitted to the negotiation unit 22.
  • Direction switching In a specific example, the effective screen direction is switched such that the screen direction switching does not occur again within a preset time after the screen direction switching occurs.
  • the preset time can be set according to actual needs, and the preset screen time can delay sending the screen direction after switching to the peer terminal.
  • the foregoing embodiment uses the delay mechanism, that is, the screen direction switching does not occur again in the preset time period, and the screen direction after the switching is sent to the opposite terminal, which can avoid frequently sending the screen direction to the opposite terminal and avoid frequent adjustment of the peer terminal.
  • the related parameters of the video picture thereby saving network resources and reducing the impact on the performance of the peer terminal.
  • the peer device by sending the screen direction to the peer terminal, the peer device can adjust related parameters that are affected by the screen direction during playback, so that the adjusted video meets the video requirement corresponding to the screen direction, thereby making The video quality can be switched to the screen orientation of the adaptive terminal.
  • the video requirement corresponding to the screen direction specifically includes: a resolution corresponding to the screen direction. among them,
  • the negotiating unit 22 is configured to send a negotiation request carrying a screen orientation to the peer terminal, where the negotiation request is used to request the peer terminal to adjust the acquisition resolution of the peer terminal according to the screen orientation.
  • the specific example may include that the peer terminal adjusts the acquisition resolution of the collection component (such as the camera) of the peer terminal according to the screen orientation.
  • the video unit 23 is specifically configured to receive a video stream that is collected and encoded by the opposite terminal after adjusting the acquisition resolution according to the resolution corresponding to the screen direction.
  • the negotiating unit 22 may send a SIP protocol-based negotiation request to the opposite terminal.
  • the re-INVITE message in the SIP protocol may be extended as the negotiation request in the embodiment of the present invention, and the screen direction is carried in the extension part.
  • Table 1 is an extension of the re-INVITE message:
  • the terminal 20 requests the peer terminal to adjust the acquisition resolution according to the screen direction carried in the negotiation request by sending a negotiation request to the opposite terminal, and the video image collected from the opposite terminal can satisfy both the horizontal and vertical directions.
  • the screen requirements after switching avoid the processing of stretching the video image and provide the quality of the video call.
  • the adjustment of the acquisition resolution is taken as an example for description.
  • the video corresponding to the screen orientation is required to be the resolution
  • the acquisition resolution may not be adjusted, but the video image may be adjusted by clipping or the like.
  • the video requirement corresponding to the screen direction is not only a requirement in terms of resolution, but also a factor that affects the playback screen when the screen direction is switched.
  • the implementation example of adjusting the acquisition resolution can be similarly implemented. , no longer repeat them here.
  • the resolution corresponding to the screen direction may be based on the screen resolution of the terminal. to make sure.
  • the horizontal pixel of the resolution corresponding to the screen direction is a horizontal screen is the length pixel number of the screen resolution, and the vertical pixel number is the width pixel number of the screen resolution; the screen direction is a vertical screen
  • the horizontal pixel of the resolution corresponding to the time is the number of width pixels of the screen resolution, and the number of vertical pixels is the number of length pixels of the screen resolution.
  • the resolution in the art is usually represented by the number of horizontal pixels and the number of vertical pixels.
  • the resolution can be expressed as M (the number of horizontal pixels) * N (the number of vertical pixels), that is, the first parameter is the number of pixels in the lateral direction.
  • the second parameter is the number of pixels in the portrait direction.
  • the screen resolution is represented by the length and width of the screen (where length and width are expressed in pixels), regardless of direction. For example, suppose the terminal has a screen resolution of 1280 in length and 720 in width; since the horizontal direction is the length of the screen and the vertical direction is the width of the screen, the horizontal screen corresponds to a resolution of 1280*720; In the vertical screen, the horizontal direction is the width of the screen, and the vertical direction is the length of the screen. Therefore, the vertical screen corresponds to a resolution of 720*1280.
  • the peer terminal can obtain the screen resolution of the terminal that generates the screen direction switching in different manners.
  • the screen resolution of the terminal of different models can be pre-stored in the peer terminal.
  • the terminal 20 can provide the terminal model of the terminal to the peer terminal according to the existing negotiation mechanism, and the peer terminal can be based on the terminal model.
  • the terminal 20 can also transmit its own screen resolution to the opposite terminal. It should be noted that the terminal 20 may send the screen resolution to the peer terminal during the negotiation process of the video session establishment phase, or may send the screen resolution to the peer terminal together with the screen direction after the screen switch occurs.
  • Table 2 is an extension of the re-INVITE message sent with the screen resolution along with the screen orientation:
  • the peer terminal can determine the resolution corresponding to the screen direction by combining the received screen resolution and the screen orientation.
  • the terminal 20 and the opposite terminal can perform session negotiation. During the negotiation, the terminal determines that the required resolution is directly sent to the peer terminal, and therefore, the screen is monitored. Before the direction switching, the video call between the terminal 20 and the opposite terminal can be performed according to the prior art.
  • the present invention only needs to solve the problem caused by the screen direction switching during the video call. Therefore, the processing of the video call setup phase is not involved in the above embodiment.
  • the solution provided by the embodiment of the present invention may also be implemented in the video call setup phase.
  • the negotiation unit 22 may be further configured to obtain an initial screen orientation during the process of establishing a video call, and send the initial screen orientation to the peer terminal.
  • the video unit 23 is further configured to receive a video stream that is provided by the peer terminal according to the video requirement corresponding to the initial screen direction before receiving the switched screen direction.
  • the peer terminal in the embodiment shown in FIG. 2 is a terminal that sends a video stream to the terminal 20 shown in FIG. 2.
  • FIG. 3 is a schematic structural diagram of a terminal 30 according to an embodiment of the present invention.
  • the terminal in this embodiment is a peer terminal of the terminal that performs screen direction switching.
  • the terminal 30 includes a receiving unit 31, a determining unit 32, and a video unit 33. among them,
  • the receiving unit 31 is configured to receive, after the video call, the switched screen direction sent by the opposite terminal in the video call after the screen direction switch occurs.
  • the determining unit 32 is configured to determine a video request corresponding to the screen direction received by the receiving unit 31.
  • the video unit 33 is configured to provide a video stream to the opposite terminal according to the video requirement corresponding to the screen direction determined by the determining unit 32.
  • the provided video stream can dynamically adapt to the screen direction switching of the opposite terminal, thereby avoiding switching due to the screen direction.
  • the problem that the peer device is impaired when displaying the video improves the quality of the video call.
  • FIG. 4 is a schematic structural diagram of a terminal 30 according to another embodiment of the present invention.
  • the video requirement corresponding to the screen direction specifically includes: a resolution corresponding to the screen direction.
  • the video unit 33 specifically includes an adjustment subunit 41, an acquisition unit 42, and a video subunit 43. among them,
  • the adjustment subunit 41 is configured to adjust the acquisition resolution of the acquisition component 42 according to the resolution corresponding to the screen orientation.
  • the collecting component 42 is configured to collect video according to the adjusted resolution of the adjusting subunit 41. image.
  • the video sub-unit 43 is configured to encode the video image collected by the acquisition component 42 into a video stream and send the video image to the peer terminal.
  • the collecting component 42 may be a component having a function of capturing a video image, such as a camera.
  • the adjusting subunit 41 may specifically include:
  • the obtaining module 411 is configured to acquire an acquisition resolution supported by the collecting component 42.
  • the selecting module 412 is configured to select, in an acquisition resolution acquired by the acquiring module, an acquisition resolution that is closest to a resolution corresponding to the screen direction.
  • the adjustment module 413 is configured to adjust an acquisition resolution of the collection component 42 to an acquisition resolution selected by the selection module.
  • the selection module 412 selects an acquisition resolution that is closest to the resolution corresponding to the screen orientation.
  • the selection module 412 can select from the value of the resolution when selecting the acquisition resolution closest to the resolution corresponding to the screen direction. For example, the number of horizontal pixels and the number of vertical pixels of the resolution corresponding to the screen direction in the horizontal pixel number and the vertical pixel number of the acquisition resolution may be compared, and the resolution corresponding to the screen direction is selected to be the closest to the screen direction.
  • the acquisition resolution of the horizontal number of pixels of the rate and the acquisition resolution of the number of vertical pixels closest to the resolution corresponding to the screen direction is referred to as the first pixel number
  • the number of vertical pixels corresponding to the resolution of the screen direction is referred to as the second pixel number.
  • the selection module 412 may further select the horizontal pixel number of the selected acquisition resolution. Comparing the ratio of the number of vertical pixels to the ratio of the number of horizontal pixels and the number of vertical pixels of the resolution corresponding to the screen direction, and the acquisition resolution of the ratio of the resolution corresponding to the screen direction closest to the screen direction is taken as the closest to the screen direction.
  • the resolution of the resolution can include:
  • the sub-module 4121 is selected for selecting respectively in the acquisition resolution acquired by the acquisition module 411.
  • the acquisition resolution in which the number of horizontal pixels is closest to the first pixel number and the acquisition resolution in which the number of vertical pixels is closest to the second pixel number; wherein, the first pixel number is the number of horizontal pixels of the resolution corresponding to the screen direction, and the second pixel The number is the number of vertical pixels of the resolution corresponding to the screen orientation.
  • the comparison sub-module 4122 is configured to compare the ratio of the horizontal pixel number and the vertical pixel number of the acquisition resolution selected by the selection sub-module 4121 to the ratio of the horizontal pixel number and the vertical pixel number of the resolution corresponding to the screen direction, and
  • the acquisition resolution of the ratio of the number of horizontal pixels and the number of vertical pixels closest to the resolution corresponding to the screen direction is the acquisition resolution closest to the resolution corresponding to the screen direction.
  • the acquisition resolution selected in the above manner and corresponding to the resolution corresponding to the screen orientation may be the same.
  • the resolution of the screen corresponding to the resolution is exactly the same. If the acquisition resolution of the resolution corresponding to the screen direction does not exist in the acquisition resolution, the selected resolution closest to the resolution corresponding to the screen direction may be greater than the resolution corresponding to the screen direction. It may be smaller than the resolution corresponding to the screen orientation.
  • the selection sub-module 4121 may be specifically configured to use the number of horizontal pixels larger than the first pixel number. In the acquisition resolution in which the number of vertical pixels is larger than the number of second pixels, the acquisition resolution in which the number of horizontal pixels is closest to the first pixel number and the acquisition resolution in which the number of vertical pixels is closest to the second pixel number are respectively selected.
  • the embodiment of the present invention may also collect in the collecting component 42. After the video image is obtained, the captured video image is further cropped, and the captured video image is cropped into a video image having exactly the same resolution as the screen orientation.
  • the video sub-unit 43 in this embodiment may specifically include: a trimming module 431 and an encoding module 432. among them,
  • the trimming module 431 is configured to crop the video image captured by the capturing component 42 into a video image having exactly the same resolution as the screen orientation.
  • the encoding module 432 is configured to encode the video image clipped by the trimming module 431 into a video stream and send the video stream to the peer terminal.
  • the resolution corresponding to the screen direction may be determined according to the screen resolution of the peer terminal.
  • the determining unit 42 is configured to determine, according to a screen resolution of the peer terminal, a resolution corresponding to the screen direction, where the horizontal pixel of the resolution corresponding to the screen orientation is a horizontal screen is the screen resolution.
  • the number of pixels of the length, the number of vertical pixels is the number of pixels of the width of the screen resolution; the horizontal pixels of the resolution corresponding to the vertical direction of the screen is the number of pixels of the width of the screen resolution, and the number of vertical pixels is The number of pixels in the length of the screen resolution.
  • the terminal 30 shown in FIG. 4 can obtain the screen resolution of the peer terminal in different manners. For example, the screen resolution of the terminals of different models may be saved in the terminal 30 in advance. During the process of establishing a video call, the terminal 30 can obtain the terminal model of the peer terminal according to the existing negotiation mechanism, and then obtain the screen resolution of the peer terminal according to the model of the peer terminal.
  • the terminal 30 can also receive the screen resolution of the peer terminal directly from the peer terminal.
  • the receiving unit 41 is further configured to receive a screen resolution of the peer terminal.
  • the peer terminal may send the screen resolution to the terminal 30 during the negotiation process of the video session establishment phase, or may send the screen resolution to the terminal 30 together with the screen direction after the screen switch occurs.
  • the terminal 30 may further adjust the locally displayed video screen provided to the peer terminal.
  • the terminal 30 may further include: a switching unit 34, configured to switch the locally displayed video picture provided to the opposite terminal to be consistent with the screen direction of the opposite terminal.
  • the terminal 30 and the opposite end can perform session negotiation. During the negotiation, the peer terminal determines that the required resolution is directly sent to the terminal 30. Therefore, before monitoring the screen direction switching, the video call of the terminal 30 and the opposite terminal can be performed according to the prior art.
  • the invention only needs to solve the problem caused by the switching of the screen direction during the video call. Therefore, the processing of the video call setup phase is not involved in the above embodiment.
  • the solution provided by the embodiment of the present invention may also be implemented in the video call setup phase.
  • the receiving unit 31 in the terminal 30 is further configured to receive the initial screen orientation of the peer terminal in the process of establishing a video call.
  • the video unit 33 is further configured to provide a video stream to the opposite terminal according to the video requirement corresponding to the initial screen direction before receiving the switched screen direction.
  • the parameters such as the resolution are adjusted according to the screen direction, so that the provided video stream can dynamically adapt to the screen direction switching of the peer terminal, thereby avoiding the effect of the peer device being damaged when displaying the video due to the screen direction switching.
  • the problem is that the quality of the video call is improved.
  • FIG. 5 is a flowchart of a method for adapting to screen direction switching in a video call according to an embodiment of the present invention. This embodiment will be described from the perspective of a terminal that switches screen direction. As described in FIG. 5, the method includes:
  • the first terminal monitors a screen orientation of the first terminal during a video call between the first terminal and the second terminal.
  • the screen direction switching refers to the switching of the screen between the horizontal screen and the vertical screen.
  • Horizontal screen usually means that the long side of the screen is in the horizontal direction and the short side is in the vertical direction;
  • the vertical screen usually means that the short side of the screen is in the horizontal direction and the long side is in the vertical direction.
  • the first terminal may monitor the screen direction switching of the first terminal by using a gravity sensing component in the first terminal.
  • the first terminal can also directly monitor the video picture of the video call, and when it is found that the video picture is transposed, it is confirmed that the screen direction switching occurs. Specifically, when the video picture is transposed When the longitudinal stretch is performed, it is determined that the horizontal screen is switched to the vertical screen; when the video image is laterally stretched after the transposition, it is determined that the vertical screen is switched to the horizontal screen.
  • the first terminal After detecting that the first terminal generates a screen direction switch, the first terminal sends the switched screen direction to the second terminal.
  • the first terminal may send a negotiation request carrying the screen direction to the second terminal.
  • the negotiation request may be implemented based on the SIP protocol, for example, extending the re-INVITE message in the SIP protocol, and carrying the switched screen direction in the extension field.
  • the first terminal receives a video stream that is sent by the second terminal according to the video requirement corresponding to the screen direction.
  • the second terminal After receiving the switched screen direction sent by the first terminal, the second terminal determines a video request corresponding to the screen direction, and provides a video stream to the first terminal according to the determined video requirement.
  • the terminal screen direction is monitored during the video call, and the switched screen direction is sent to the peer terminal, so that the peer terminal can provide the video stream according to the video requirement corresponding to the screen direction, thereby avoiding the video stream.
  • the quality of the video call is improved due to the problem that the effect of the screen is impaired when the screen is switched.
  • the method may further comprise: determining that the monitored screen direction is switched to the effective screen direction switching. Wherein, the effective screen direction is switched such that the screen direction switching does not occur again within the preset time after the screen direction switching occurs.
  • the preset time may be set according to actual needs, and the preset screen time may delay sending the switched screen direction to the second terminal.
  • the foregoing embodiment uses the delay mechanism, that is, the screen direction switching does not occur again in the preset time, but the screen direction after the switching is sent to the second terminal, which can avoid frequently sending the screen direction to the second terminal and avoid frequent adjustment of the second terminal.
  • the relevant parameters of the video picture thereby saving network resources and reducing the impact on the performance of the second terminal.
  • the first terminal may make the second direction by sending the screen direction to the second terminal.
  • the terminal adjusts related parameters that are affected by the screen direction during playback, so that the adjusted video meets the video requirements corresponding to the screen direction, so that the video quality can be adaptively switched to the screen direction of the terminal.
  • the video requirement corresponding to the screen direction specifically includes: a resolution corresponding to the screen direction.
  • Step S504 specifically includes: receiving, by the first terminal, a video stream that is collected and encoded by the second terminal according to the resolution adjusted by the resolution corresponding to the screen direction.
  • the first terminal sends a negotiation request to the second terminal, requesting the second terminal to adjust the acquisition resolution according to the screen direction carried in the negotiation request, and the video image collected from the opposite terminal may be in the horizontal direction and the vertical direction. It satisfies the screen requirements after switching, avoids stretching the video image, and provides the quality of the video call.
  • the adjustment of the acquisition resolution is taken as an example for description.
  • the video corresponding to the screen orientation is required to be the resolution
  • the acquisition resolution may not be adjusted, but the video image may be adjusted by clipping or the like.
  • the video requirement corresponding to the screen direction is not only a requirement in terms of resolution, but also a factor that affects the playback screen when the screen direction is switched.
  • the implementation example of adjusting the acquisition resolution can be similarly implemented. , no longer repeat them here.
  • the resolution corresponding to the screen orientation may be determined according to the screen resolution of the first terminal.
  • the horizontal pixel whose resolution corresponds to the horizontal direction of the screen is the length pixel of the screen resolution
  • the vertical pixel number is the width pixel of the screen resolution.
  • the number of the horizontal pixels of the resolution corresponding to the screen orientation being the vertical screen is the number of width pixels of the screen resolution
  • the number of vertical pixels is the number of length pixels of the screen resolution.
  • the first terminal may also provide a screen resolution to the second terminal. The first terminal may send the screen resolution to the second terminal during the negotiation process of the video session establishment phase, or may send the screen resolution to the second terminal together with the screen direction after the screen switching occurs.
  • the second terminal saves the received screen resolution. After the second terminal receives the switched screen orientation, the pre-save screen resolution is acquired.
  • the specific implementation may refer to Table 2, and details are not described herein again.
  • the second terminal may also not acquire the screen resolution of the first terminal from the first terminal.
  • the second terminal may pre-store the correspondence between the terminals of different models and the screen resolution.
  • the second terminal may obtain the terminal model of the first terminal according to the existing negotiation mechanism, and the second terminal according to the second terminal
  • the screen resolution of the first terminal is determined by the terminal model of a terminal and the correspondence between the terminal model saved by itself and the screen resolution.
  • the first terminal and the second terminal may perform session negotiation.
  • the first terminal determines that the required resolution is directly sent to the second terminal, and therefore,
  • the video call of the first terminal and the second terminal can be performed according to the prior art, and the present invention only needs to solve the problem caused by the screen direction switching during the video call. Therefore, the processing of the video call setup phase is not involved in the embodiment shown in FIG.
  • the solution provided by the embodiment of the present invention may also be implemented in the video call setup phase.
  • the method may further include: in the process of establishing a video call, the first terminal acquires an initial screen orientation, and sends the initial screen orientation to the second terminal; Receiving a video stream provided by the second terminal according to the video requirement corresponding to the initial screen direction before receiving the switched screen direction.
  • FIG. 6 is a flowchart of a method for adapting to screen direction switching in a video call according to another embodiment of the present invention. This embodiment will be described from the perspective of a terminal that provides a video stream. As described in Figure 6, the method includes:
  • the second terminal receives the switched screen direction sent by the first terminal after the screen direction switch occurs.
  • the first terminal may send a negotiation request carrying the screen direction to the second terminal.
  • the negotiation request may be implemented based on the SIP protocol, for example, extending the re-INVITE message in the SIP protocol, and carrying the switched screen direction in the extension field.
  • the second terminal determines a video requirement corresponding to the screen orientation.
  • the video requirement corresponding to the screen direction may be a requirement for a related parameter affected by the screen direction, such as a resolution.
  • the second terminal provides a video stream to the first terminal according to the video requirement corresponding to the screen direction.
  • the second terminal After determining the video requirement corresponding to the screen direction, the second terminal adjusts the relevant parameters according to the video request to obtain a video stream that is adapted to the screen direction.
  • the second terminal may provide the function of the video stream according to the video requirement corresponding to the screen direction of the first terminal, so that the provided video stream can dynamically adapt to the screen direction switching of the peer terminal, thereby avoiding the switch due to the screen direction.
  • the problem that the peer device is impaired when displaying video improves the quality of the video call.
  • the video requirement corresponding to the screen direction specifically includes: a resolution corresponding to the screen direction.
  • Step 604 specifically includes: the second terminal adjusts its own acquisition resolution according to the resolution corresponding to the screen direction; collects the video image according to the adjusted acquisition resolution, and encodes the collected video image into a video stream and sends the video stream to the first terminal.
  • the second terminal adjusts its own acquisition resolution according to the resolution corresponding to the screen direction.
  • the body is implemented as follows:
  • the second terminal acquires the acquisition resolution supported by the second terminal; selects the acquisition resolution closest to the resolution corresponding to the screen direction in the acquired acquisition resolution; and adjusts the acquisition resolution of the self to the selected acquisition resolution.
  • the second terminal may select from the value of the resolution (ie, the number of horizontal pixels and the number of vertical pixels of the resolution) when selecting the acquisition resolution closest to the resolution corresponding to the screen direction.
  • the value of the resolution ie, the number of horizontal pixels and the number of vertical pixels of the resolution
  • selecting an acquisition resolution that is closest to the resolution corresponding to the screen direction among the acquired acquisition resolutions may include the following steps:
  • an acquisition resolution in which the number of horizontal pixels is closest to the first pixel number and an acquisition resolution in which the number of vertical pixels is closest to the second pixel number are respectively selected; wherein the first pixel number is a resolution corresponding to the screen direction
  • the number of horizontal pixels of the rate, and the number of second pixels is the number of vertical pixels of the resolution corresponding to the screen direction.
  • the acquisition resolution of the ratio of the number of horizontal pixels to the number of vertical pixels is the acquisition resolution closest to the resolution corresponding to the screen direction.
  • the second terminal may further compare the ratio of the number of horizontal pixels and the number of vertical pixels of the selected acquisition resolution to the ratio of the number of horizontal pixels and the number of vertical pixels of the resolution corresponding to the screen direction. If the compared closest horizontal pixel number and the closest vertical pixel number belong to the same acquisition resolution, it is no longer necessary to compare the ratio of the horizontal pixel number to the vertical pixel number.
  • the one selected in the above manner is closest to the screen orientation.
  • the resolution of the resolution will be the acquisition resolution that is exactly the same as the resolution corresponding to the screen orientation. If the acquisition resolution of the resolution corresponding to the screen direction does not exist in the acquisition resolution, the selected resolution closest to the resolution corresponding to the screen direction may be greater than the resolution corresponding to the screen direction. It may be smaller than the resolution corresponding to the screen orientation.
  • the number of horizontal pixels selected in the acquired acquisition resolution is the closest to the first.
  • the acquisition resolution of the number of pixels and the acquisition resolution of the number of vertical pixels closest to the second number of pixels may specifically include:
  • the acquisition resolution and the number of vertical pixels closest to the first pixel number are selected to be closest to the second in the acquisition resolution in which the number of horizontal pixels is greater than the first pixel number and the number of vertical pixels is greater than the second pixel number.
  • the video image collected above is encoded into a video.
  • the sending of the stream to the first terminal may specifically include:
  • the clipped video image is encoded into a video stream and sent to the first terminal.
  • the second terminal may determine the resolution corresponding to the screen direction in combination with the screen resolution. Accordingly, the method of FIG. 6 may further include the second terminal receiving the screen resolution of the first terminal.
  • the step 602 specifically includes: determining, by the second terminal, the resolution corresponding to the screen direction according to the screen resolution; wherein, the horizontal pixel of the resolution corresponding to the screen direction is a horizontal screen is a length pixel number of the screen resolution, the number of vertical pixels is the width pixel number of the screen resolution; the horizontal pixel of the resolution corresponding to the vertical direction of the screen direction is the width pixel number of the screen resolution, The number of vertical pixels is the length image of the screen resolution Prime number.
  • the first terminal may send the screen resolution to the second terminal during the negotiation process of the video session establishment phase, or may send the screen resolution to the second terminal together with the screen direction after the screen switching occurs.
  • the second terminal saves the received screen resolution.
  • the pre-save screen resolution is acquired.
  • the specific implementation may refer to Table 2, and details are not described herein again.
  • the second terminal may also not acquire the screen resolution of the first terminal from the first terminal.
  • the second terminal may pre-store the correspondence between the terminals of different models and the screen resolution.
  • the second terminal may obtain the terminal model of the first terminal according to the existing negotiation mechanism, and the second terminal according to the second terminal
  • the screen resolution of the first terminal is determined by the terminal model of a terminal and the correspondence between the terminal model saved by itself and the screen resolution.
  • the second terminal may further switch the locally displayed video screen provided to the first terminal to be consistent with the screen orientation of the first terminal.
  • the first terminal and the second terminal may perform session negotiation.
  • the first terminal determines that the required resolution is directly sent to the second terminal, and therefore,
  • the video call of the first terminal and the second terminal can be performed according to the prior art, and the present invention only needs to solve the problem caused by the screen direction switching during the video call. Therefore, the processing of the video call setup phase is not involved in the embodiment shown in FIG.
  • the solution provided by the embodiment of the present invention may also be implemented in the video call setup phase.
  • the method may further include: in the process of establishing a video call, the second terminal receives an initial screen orientation of the first terminal; the second terminal is receiving Follow the initial screen before switching to the screen orientation
  • the video corresponding to the direction requires a video stream to be provided to the first terminal.
  • the video stream can be dynamically adapted to the screen orientation of the peer terminal, thereby avoiding the effect of the peer terminal being damaged when displaying the video due to the screen direction switching.
  • the problem is that the quality of the video call is improved.
  • FIG. 7 is a flowchart of a method for adapting to screen direction switching in a video call according to another embodiment of the present invention. As shown in FIG. 7, the method includes:
  • the first terminal establishes a video call with the second terminal by using the video server.
  • Step S700 can be implemented by using a video call establishment process in the existing SIP protocol, and details are not described herein again.
  • the first terminal monitors screen direction switching of the first terminal in real time.
  • the first terminal can monitor the switching of the screen direction by gravity sensing transposition.
  • the first terminal detects that a screen direction switch occurs, starts a timer, and continues to monitor whether a screen direction switch occurs.
  • the purpose of starting the timer is to determine whether the screen direction switching occurs again within the preset time to determine whether the monitored screen direction switching is an effective screen direction switching.
  • the video requirement corresponding to the screen direction is taken as an example of the resolution requirement.
  • step S706 is performed. If the screen direction switching occurs again when the preset time of the timer is not reached, then execution proceeds to S704.
  • x-dimensions-length/x-dimensions-width identifies the length and width of the screen of the first terminal, and the unit is the number of pixels.
  • the x-orientation identifies the screen orientation after the terminal screen is switched.
  • the second terminal acquires a screen resolution and a screen orientation of the first terminal from the re-INVITE message.
  • the second terminal After receiving the re-INVITE message, the second terminal parses the extended field of the re-INVITE message to obtain the screen resolution and the screen direction of the first terminal.
  • the second terminal determines a resolution corresponding to the screen direction according to the acquired screen resolution and the screen direction.
  • the second terminal acquires an acquisition resolution supported by itself.
  • the acquisition resolution supported by the second terminal is the acquisition resolution supported by the acquisition component in the second terminal.
  • the acquisition component can be a camera.
  • the second terminal may invoke the underlying driver interface of the acquisition component to obtain a list of acquisition resolutions supported by the acquisition component.
  • the resolution supported by the acquisition component is: 1280*720, 720*480, 640*400, 352*288, and 320*240.
  • the second terminal selects an acquisition resolution that is closest to a resolution corresponding to the screen direction among the supported acquisition resolutions.
  • the second terminal preferentially selects the acquisition resolution of the number of horizontal pixels whose resolution of the horizontal pixel is closest to the resolution corresponding to the screen direction and the acquisition resolution of the number of vertical pixels whose number of vertical pixels is closest to the resolution corresponding to the screen direction. For example, if the screen orientation corresponds to a resolution of 600*480, then the selected acquisition resolution is 720*480, 640*400.
  • the resolution of the aspect ratio of the resolution corresponding to the screen direction closest to the screen direction is selected.
  • the aspect ratio here refers to the ratio of the number of horizontal pixels to the number of vertical pixels.
  • Z
  • X and Y are the number of horizontal pixels and the number of vertical pixels of the resolution corresponding to the screen direction, respectively
  • a and B are the number of horizontal pixels and the number of vertical pixels of the selected acquisition resolution, respectively
  • Z is the horizontal and vertical ratio of the two.
  • the difference is taken as the absolute value of X/YA/B.
  • the camera video capture resolution with the smallest Z value is the acquisition resolution closest to the resolution corresponding to the screen direction. In this embodiment, the acquisition resolution of 720*480 is finally selected.
  • the second terminal adjusts its resolution to the selected acquisition resolution.
  • the second terminal returns a successful response to the first terminal.
  • the successful response can be a 200 OK message.
  • S720 The second terminal performs video image collection according to the adjusted acquisition resolution.
  • the second terminal clips the captured video image according to a resolution corresponding to the screen orientation, and encodes the clipped video image into a video stream.
  • the second terminal clips the captured video image with a resolution of 720*480 to a video image of 600*480.
  • the second terminal sends the encoded video stream to the first terminal.
  • the first terminal and the second terminal dynamically perform the negotiation of the screen direction switching, thereby avoiding the problem that the first terminal is damaged when displaying the video due to the screen direction switching, and improving the video call quality.
  • FIG. 8 is a hardware structural diagram of a terminal according to an embodiment of the present invention.
  • the terminal in this embodiment is a terminal that performs screen direction switching.
  • the terminal includes a memory 81, a communication interface 82, a processor 83, and a bus 84.
  • the processor 83, the memory 81 and the communication interface 82 are communicatively connected via a bus 84.
  • Communication interface 82 is used to enable communication between the terminal and other devices or communication networks such as, but not limited to, PLMN/PSTN, the Internet, and the like.
  • the memory 81 can be a read only memory (ROM), which is statically stored. Storage device, dynamic storage device or random access memory (RAM).
  • the memory 81 can store instructions of the operating system and other applications as well as application data. The instructions stored in the memory 81 are executed by the processor 83.
  • the processor 83 can be a general-purpose central processing unit (CPU), a microprocessor, an application specific integrated circuit (ASIC), or one or more integrated circuits for executing related programs.
  • CPU central processing unit
  • ASIC application specific integrated circuit
  • Bus 84 may include a path for communicating information between various components, such as processor 83, memory 81, and communication interface 82.
  • the processor 83 is configured to execute an instruction in the memory 81 to implement the following functions: during the video call, monitoring the screen orientation of the first terminal; after monitoring the occurrence of the screen direction switching, The communication interface 82 sends the switched screen direction to the second terminal; and receives the video stream sent by the second terminal according to the video requirement corresponding to the screen direction through the communication interface 82.
  • the processor 83 further determines that the monitored screen direction is switched to an effective screen direction switch before transmitting the switched screen direction. Wherein, the effective screen direction is switched such that the screen direction switching does not occur again within the preset time after the screen direction switching occurs.
  • FIG. 9 is a schematic structural diagram of a hardware of a terminal according to an embodiment of the present invention.
  • the terminal in this embodiment is a terminal that provides a video stream.
  • the terminal includes a memory 91, a communication interface 92, a processor 93, a bus 94, and a camera 95.
  • the processor 93, the memory 91, the camera 95, and the communication interface 92 are communicably connected by a bus 94.
  • Communication interface 92 is used to enable communication between the terminal and other devices or communication networks such as, but not limited to, PLMN/PSTN, the Internet, and the like.
  • the memory 91 can be a read only memory (ROM), which is statically stored. Storage device, dynamic storage device or random access memory (RAM).
  • the memory 91 can store instructions of the operating system and other applications as well as application data. The instructions stored in the memory 91 are executed by the processor 93.
  • the processor 93 can be a general-purpose central processing unit (CPU), a microprocessor, an application specific integrated circuit (ASIC), or one or more integrated circuits for executing related programs.
  • CPU central processing unit
  • ASIC application specific integrated circuit
  • Bus 94 may include a path for communicating information between various components (e.g., processor 93, memory 91, communication interface 92, and camera 95).
  • the camera 95 is an acquisition component for capturing video images.
  • the processor 93 is configured to execute an instruction in the memory 91, to implement the following function: in the process of a video call, receiving a screen direction after the switching of the first terminal after the screen direction switch occurs; determining The video requirement corresponding to the screen orientation; providing a video stream to the first terminal according to the video requirement corresponding to the screen orientation.
  • FIG. 9 the specific processing procedure of the processor shown in FIG. 9 may be referred to the method embodiment part shown in FIG. 6, and details are not described herein again.
  • the video stream can be dynamically adapted to the screen orientation of the peer terminal, thereby avoiding the effect of the peer terminal being damaged when displaying the video due to the screen direction switching.
  • the problem is that the quality of the video call is improved.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明实施例提供了一种在视频通话中适应屏幕方向切换的方法和装置，该方法包括：在第一终端与第二终端进行视频通话的过程中，所述第一终端监测所述第一终端的屏幕方向切换；在监测到所述第一终端发生屏幕方向切换后，向所述第二终端发送切换后的屏幕方向；接收所述第二终端按照所述屏幕方向对应的视频要求发送的视频流。本发明实施例可以使视频质量自适应终端的屏幕方向切换。

Description

一种在视频通话中适应屏幕方向切换的方法和装置
本申请要求2013年12月31日递交的申请号为201310753502.7、发明名称为“一种在视频通话中适应屏幕方向切换的方法和装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及通信技术领域，特别涉及一种在视频通话中适应屏幕方向切换的方法和装置。
背景技术
随着网络及媒体技术的发展，视频通话类应用越发成熟。特别是在移动终端，如手机、平板电脑等，上的视频通话应用，如Skype、Facetime等，已经在移动互联网拥有庞大的用户群。
手机、平板电脑等终端在视频通话过程中，随着用户手持姿势的变化，可能会发生屏幕方向切换。其中，屏幕方向切换是指终端在横屏和竖屏之间进行切换，如从横屏切换到竖屏或从竖屏切换到横屏。目前大多数视频通话应用都在终端进行屏幕方向切换时，也对视频画面的横竖方向进行切换。由此，终端的横竖屏切换就会对视频通话的视频质量造成影响。比如，当终端从横屏切换至竖屏时，视频画面在纵向方向上就会产生拉伸，从而导致视频效果受损，降低视频通话质量。
发明内容
本发明实施例提供一种在视频通话中适应屏幕方向切换的方法和装置以解决由于终端发生屏幕方向切换导致的视频通话质量受损的问题。
第一方面，一种终端，包括：
监测单元，用于在视频通话的过程中，监测所述终端的屏幕方向的切换；在监测到发生屏幕方向切换后，将发生屏幕方向切换的监测结果提供给协商单元；
所述协商单元，用于在接收到所述监测单元提供的所述监测结果后，向进行视频通话的对端终端发送切换后的屏幕方向；
视频单元，用于接收所述对端终端按照所述屏幕方向对应的视频要求发送的视频流。
在第一方面的第一种可能的实现方式中，所述监测单元在将所述监测结果提供给所述协商单元前，还用于确定监测到的所述屏幕方向切换为有效屏幕方向切换；所述有效屏幕方向切换为在所述屏幕方向切换发生后的预设时间内未再次才发生屏幕方向切换。
结合第一方面或第一方面的第一种可能的实现方式，在第二种可能的实现方式中，所述屏幕方向对应的视频要求具体包括：所述屏幕方向对应的分辨率；
所述协商单元具体用于向所述对端终端发送携带所述屏幕方向的协商请求，所述协商请求用于请求所述对端终端根据所述屏幕方向调整所述对端终端的采集分辨率；
所述视频单元具体用于接收所述对端终端按照所述屏幕方向对应的分辨率调整所述采集分辨率后采集并编码的视频流。
结合第一方面的第二种可能的实现方式，在第三种可能的实现方式中，所述协商单元还用于向所述对端终端发送屏幕分辨率；所述屏幕分辨率用于确定所述屏幕方向对应的分辨率；其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。
结合第一方面或第一方面的第一种可能至第三种可能的实现方式，在第四种可能的实现方式中，所述协商单元还用于在建立视频通话的过程 中，获取初始的屏幕方向，并向所述对端终端发送所述初始的屏幕方向；
所述视频单元还用于接收所述对端终端在接收到所述切换后的屏幕方向前按照所述初始的屏幕方向对应的视频要求提供的视频流。
第二方面，一种终端，包括：接收单元，用于在视频通话的过程中，接收所述视频通话中的对端终端在发生屏幕方向切换后发送的切换后的屏幕方向；
确定单元，用于确定所述接收单元接收到的所述屏幕方向对应的视频要求；
视频单元，用于按照所述确定单元确定的所述屏幕方向对应的视频要求向所述对端终端提供视频流。
在第二方面的第一种可能的实现方式中，所述屏幕方向对应的视频要求具体包括：所述屏幕方向对应的分辨率；
所述视频单元具体包括调整子单元，采集部件，以及视频子单元：
所述调整子单元，用于按照所述屏幕方向对应的分辨率调整所述采集部件的采集分辨率；
所述采集部件，用于按照所述调整子单元调整后的采集分辨率采集视频图像；
所述视频子单元，用于将所述采集部件采集的视频图像编码成视频流发送给所述对端终端。
结合第二方面的第一种可能的实现方式，在第二种可能的实现方式中，所述调整子单元具体包括：
获取模块，用于获取所述采集部件支持的采集分辨率；
选择模块，用于在所述获取模块获取的采集分辨率中选择出最接近所述屏幕方向对应的分辨率的采集分辨率；
调整模块，用于将所述采集部件的采集分辨率调整为所述选择模块选择出的采集分辨率。
结合第二方面的第二种可能的实现方式，在第三种可能的实现方式中，所述选择模块具体包括：
选择子模块，用于在所述获取模块获取的采集分辨率中分别选择横向像素数最接近第一像素数的采集分辨率和纵向像素数最接近第二像素数的采集分辨率；所述第一像素数为所述屏幕方向对应的分辨率的横向像素数，所述第二像素数为所述屏幕方向对应的分辨率的纵向像素数；
比较子模块，用于将所述选择子模块选择出的采集分辨率的横向像素数和纵向像素数的比值与所述屏幕方向对应的分辨率的横向像素数和纵向像素数的比值进行比较，将最接近所述屏幕方向对应的分辨率的横向像素数和纵向像素数的比值的采集分辨率作为最接近所述屏幕方向对应的分辨率的采集分辨率。
结合第二方面的第三种可能的实现方式，在第四种可能的实现方式中，所述选择子模块具体用于在横向像素数大于所述第一像素数且纵向像素数大于所述第二像素数的采集分辨率中分别选择出横向像素数最接近所述第一像素数的采集分辨率和纵向像素数最接近所述第二像素数的采集分辨率。
结合第二方面的第四种可能的实现方式，在第五种可能的实现方式中，所述视频子单元具体包括：
剪裁模块，用于将所述采集部件采集的视频图像裁剪为与所述屏幕方向对应的分辨率完全一致的视频图像；
编码模块，用于将所述剪裁模块剪裁后的视频图像编码成视频流发送给所述对端终端。
结合第二方面或第二方面的第一种可能至第五种可能的实现方式，在第六种可能的实现方式中，所述终端还包括：
切换单元，用于将本地显示的提供给所述对端终端的视频画面切换为与所述对端终端的屏幕方向一致。
结合第二方面的第一种可能至第六种可能的实现方式，在第七种可能的实现方式中，所述接收单元还用于接收所述对端终端的屏幕分辨率；
所述确定单元具体用于根据所述屏幕分辨率来确定所述屏幕方向对应的分辨率；其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为 所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。
结合第二方面或第二方面的第一种可能至第七种可能的实现方式，在第八种可能的实现方式中，所述接收单元还用于在建立视频通话的过程中，接收所述对端终端的初始的屏幕方向；
所述视频单元还用于在接收到所述切换后的屏幕方向前按照所述初始的屏幕方向对应的视频要求向所述对端终端提供视频流。
第三方面，一种在视频通话中适应屏幕方向切换的方法，所述方法包括：
在第一终端与第二终端进行视频通话的过程中，所述第一终端监测所述第一终端的屏幕方向的切换；
在监测到所述第一终端发生屏幕方向切换后，所述第一终端向所述第二终端发送切换后的屏幕方向；
所述第一终端接收所述第二终端按照所述屏幕方向对应的视频要求发送的视频流。
在第三方面的第一种可能的实现方式中，在向所述第二终端发送切换后的屏幕方向前，所述方法还包括：确定监测到的所述屏幕方向切换为有效屏幕方向切换；所述有效屏幕方向切换为在所述屏幕方向切换发生后的预设时间内未再次才发生屏幕方向切换。
结合第三方面或第三方面的第一种可能的实现方式，在第二种可能的实现方式中，所述屏幕方向对应的视频要求具体包括：所述屏幕方向对应的分辨率。
所述向所述第二终端发送切换后的屏幕方向具体包括：向所述第二终端发送携带所述屏幕方向的协商请求，所述协商请求用于请求所述第二终端按照所述屏幕方向调整所述第二终端的采集分辨率；
接收所述第二终端按照所述屏幕方向对应的视频要求发送的视频流具体包括：接收所述第二终端按照所述屏幕方向对应的分辨率调整所述采 集分辨率后采集并编码的视频流。
结合第三方面的第二种可能的实现方式，在第三种可能的实现方式中所述方法还包括：
所述第一终端向所述第二终端发送所述第一终端的屏幕分辨率；所述屏幕分辨率用于确定所述屏幕方向对应的分辨率；其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。
结合第三方面或第三方面的第一种可能至第三中可能的实现方式，在第四种可能的实现方式中所述方法还包括：
在建立视频通话的过程中，所述第一终端获取初始的屏幕方向，向所述第二终端发送所述初始的屏幕方向；
所述第一终端接收所述第二终端在接收到所述切换后的屏幕方向前按照所述初始的屏幕方向对应的视频要求提供的视频流。
第四方面，一种在视频通话中适应屏幕方向切换的方法，所述方法包括：
在第一终端与第二终端进行视频通话的过程中，所述第二终端接收所述第一终端在发生屏幕方向吧换后发送的切换后的屏幕方向；
所述第二终端确定所述屏幕方向对应的视频要求；
所述第二终端按照所述屏幕方向对应的视频要求向所述第一终端提供视频流。
在第四方面的第一种可能的实现方式中，所述屏幕方向对应的视频要求具体包括：所述屏幕方向对应的分辨率；
所述第二终端按照所述屏幕方向对应的视频要求向所述第一终端提供视频流具体包括：
所述第二终端按照所述屏幕方向对应的分辨率调整自身的采集分辨率；
按照调整后的采集分辨率采集视频图像，将采集的所述视频图像编码成视频流发送给所述第一终端。
结合第四方面的第一种可能的实现方式，在第二种可能的实现方式中所述所述第二终端按照所述屏幕方向对应的分辨率调整自身的采集分辨率具体包括：
所述第二终端获取所述自身支持的采集分辨率；
在获取的采集分辨率中选择出最接近所述屏幕方向对应的分辨率的采集分辨率；
将自身的采集分辨率调整为选择出的采集分辨率。
结合第四方面的第二种可能的实现方式，在第三种可能的实现方式中所述在获取的采集分辨率中选择出最接近所述屏幕方向对应的分辨率的采集分辨率具体包括：
在获取的采集分辨率中分别选择出横向像素数最接近第一像素数的采集分辨率和纵向像素数最接近第二像素数的采集分辨率；所述第一像素数为所述屏幕方向对应的分辨率的横向像素数，所述第二像素数为所述屏幕方向对应的分辨率的纵向像素数；
将选择出的采集分辨率的横向像素数和纵向像素数的比值与所述屏幕方向对应的分辨率的横向像素数和纵向像素数的比值进行比较，将最接近所述屏幕方向对应的分辨率的横向像素数和纵向像素数的比值的采集分辨率作为最接近所述屏幕方向对应的分辨率的采集分辨率。
结合第四方面的第三种可能的实现方式，在第四种可能的实现方式中，所述在获取的采集分辨率中分别选择出横向像素数最接近所述第一像素数的采集分辨率和纵向像素数最接近所述第二像素数具体包括：
在横向像素数大于所述第一像素数且纵向像素数均大于所述第二像素数的采集分辨率中分别选择出横向像素数最接近所述第一像素数的采集分辨率所述第二像素数的采集分辨率。
结合第四方面的第四种可能的实现方式，在第五种可能的实现方式中，所述将采集的所述视频图像编码成视频流发送给所述第一终端具体包 括：
将采集的所述视频图像裁剪为与所述屏幕方向对应的分辨率完全匹配的视频图像；
将剪裁后的视频图像编码成视频流发送给所述第一终端。
结合第四方面或第四方面的第一种可能至第五种可能的实现方式，在第六种可能的实现方式中，所述方法还包括：
所述第二终端将本地显示的提供给所述第一终端的视频画面切换为与所述第一终端的屏幕方向一致。
结合第四方面的第一种可能至第六种可能的实现方式，在第七种可能的实现方式中，所述方法还包括：所述第二终端接收所述第一终端的屏幕分辨率；
所述第二终端确定所述屏幕方向对应的视频要求具体包括：所述第二终端根据所述屏幕分辨率来确定所述屏幕方向对应的分辨率；其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。
结合第四方面或第四方面的第一种可能至第七种可能的实现方式，在第八种可能的实现方式中，所述方法还包括：
在建立视频通话的过程中，所述第二终端接收所述第一终端的初始的屏幕方向；
所述第二终端在接收到所述切换后的屏幕方向前按照所述初始的屏幕方向对应的视频要求向所述第一终端提供视频流。
在上述实施例中，通过在视频通话过程中监测终端屏幕方向切换，并将切换后的屏幕方向发送给对端终端，使得对端终端可以根据屏幕方向对应的视频要求来提供视频流，避免了由于屏幕方向切换导致在展示视频时效果受损的问题，提高了视频通话质量。
附图说明
为了更清楚地说明本发明实施例的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的实现视频通话业务的系统架构图；
图2是本发明实施例提供的终端的结构示意图；
图3是本发明另一实施例提供的终端的结构示意图；
图4是本发明另一实施例提供的终端的结构示意图；
图5是本发明实施例提供的在视频通话中适应屏幕方向切换的方法流程图；
图6是本发明另一实施例提供的在视频通话中适应屏幕方向切换的方法流程图；
图7是本发明另一实施例提供的在视频通话中适应横竖屏切换的方法流程图；
图8是本发明实施例提供的终端的硬件结构示意图；
图9是本发明另一实施例提供的终端的硬件结构示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
图1为本发明实施例提供的实现视频通话业务的系统架构图。如图1所示，该系统包括视频服务器11以及终端12、终端13。其中，终端12和终端13为具有视频通话功能的终端。视频服务器11负责呼叫业务中的 用户管理、业务管理、呼叫路由、呼叫协商、呼叫接续等功能。终端12和终端13通过视频服务器11进行交互。终端与视频服务器之间的交互可基于会话发起协议(Session Initiation Protocol，SIP)来实现。
本发明实施例提供的方案可应用在终端12和终端13上。当进行视频通话的终端12和终端13中的一方，如，终端12，发生屏幕方向切换时，终端12将切换后的屏幕方向通知给终端13。终端13根据终端12发来的屏幕方向对影响视频图像质量的参数进行调整。其中，影响视频图像质量的参数具体可以是在播放时会受屏幕方向影响的参数，比如，分辨率等。
需要说明的是，图1中的终端12和终端13仅是示意性的说明。在实际应用中，进行视频通话的终端可以有多个，而进行多方视频通话终端在发生屏幕方向切换时也可以应用本发明实施例提供的方案。具体的，当进行多方视频通话时，发生屏幕方向切换的终端可以将切换后的屏幕方向分别发送给参与该视频通话的其它终端，接收到该屏幕方向的每个终端都可按照该屏幕方向对应的视频要求向发生屏幕方向切换的终端提供视频流。
下面结合附图分别对发生屏幕方向切换的终端以及其对端终端的具体结构进行详细说明。
图2为本发明实施例提供的终端20的结构示意图。本实施例中的终端20为发生屏幕方向切换的终端。如图2所示，该终端20包括监测单元21、协商单元22、视频单元23。其中，
监测单元21，用于在视频通话的过程中，监测屏幕方向的切换；在监测到发生屏幕方向切换后，将发生屏幕方向切换的监测结果提供给协商单元22。
协商单元22，用于在接收到监测单元21提供的监测结果后，向进行视频通话的对端终端发送切换后的屏幕方向。
视频单元23，用于接收对端终端按照所述屏幕方向对应的视频要求发送的视频流。
在上述实施例中，通过在终端中实现监测视频通话中的屏幕方向切换以及向对端终端提供切换后的屏幕方向的功能，使得对端终端可以根据屏幕方向对应的视频要求来提供视频流，避免了由于屏幕方向切换导致在展示视频时效果受损的问题，提高了视频通话质量。
为了避免终端误操作导致频繁向对端终端发送屏幕方向，图1所示实施例中的监测单元21在将监测结果提协商单元22前，还进一步用于确定监测到的屏幕方向切换为有效屏幕方向切换。其中，一个具体的实例中，有效屏幕方向切换为在屏幕方向切换发生后的预设时间内未再次才发生屏幕方向切换。
上述预设时间可以根据实际需要来设置，通过该预设时间可以延迟发送切换后的屏幕方向到对端终端。
上述实施例通过延时机制，即在预设时间内未再次才发生屏幕方向切换才向对端终端发送切换后的屏幕方向，可以避免频繁向对端终端发送屏幕方向以及避免对端终端频繁调整视频画面的相关参数，从而节约了网络资源，降低了对对端终端性能的影响。
本发明实施例中，通过向对端终端发送屏幕方向可以使对端设备对在播放时会受屏幕方向影响的相关参数进行调整，使调整后的视频符合该屏幕方向对应的视频要求，从而使得视频质量可以自适应终端的屏幕方向切换。
下面以受屏幕方向影响的相关参数为分辨率为例对本发明实施例的方案进行详细说明。在此实施例中，屏幕方向对应的视频要求具体包括：屏幕方向对应的分辨率。其中，
协商单元22具体用于向对端终端发送携带屏幕方向的协商请求，该协商请求用于请求对端终端根据该屏幕方向调整该对端终端的采集分辨率。具体的实例中可以包括对端终端根据该屏幕方向调整该对端终端的采集部件(如摄像头)的采集分辨率。
视频单元23具体用于接收对端终端按照该屏幕方向对应的分辨率调整采集分辨率后采集并编码的视频流。
在具体实现时，协商单元22可以向对端终端发送基于SIP协议的协商请求。例如，可以扩展SIP协议中的re-INVITE消息作为本发明实施例中的协商请求，并在扩展部分中携带屏幕方向。如表1所示，表1为re-INVITE消息的扩展部分：
表1
Figure PCTCN2014092795-appb-000001
上述实施例中，终端20通过向对端终端发送协商请求，请求对端终端按照协商请求中携带的屏幕方向来调整采集分辨率，从对端终端采集的视频图像在横向和纵向上都可以满足切换后的屏幕要求，避免了对视频图像做拉伸等处理，提供了视频通话的质量。
需要说明的是，上述实施例中仅以调整采集分辨率为例进行说明。当屏幕方向对应的视频要求为分辨率时，如果当前采集分辨率在横向和纵向上都大于屏幕方向对应的分辨率，也可以不调整采集分辨率，而是通过剪裁的等手段来调整视频图像，使其符合切换后的屏幕要求。当然，屏幕方向对应的视频要求也不仅仅是分辨率方面的要求，也可以是其它在屏幕方向切换时影响播放画面的因素，在具体实现时均可参考上述调整采集分辨率的实施例类似实现，这里不再赘述。
在上述实施例中，屏幕方向对应的分辨率可以根据终端的屏幕分辨率 来确定。其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。本领域中分辨率通常采用横向像素数和纵向像素数来表示，例如，分辨率可表示为M(横向像素数)*N(纵向像素数)，即第一个参数为横向方向的像素数，第二个参数为纵向方向的像素数。而屏幕分辨率是以屏幕的长和宽(其中，长和宽以像素数来表示)来表示，与方向无关。例如，假设终端的屏幕分辨率的长度像素数为1280，宽度像素数为720；因为横屏时横向为屏幕的长，纵向为屏幕的宽，因此，横屏对应的分辨率为1280*720；竖屏时，横向为屏幕的宽，纵向为屏幕的长，因此，竖屏对应的分辨率为720*1280。
对端终端可以通过不同的方式获取发生屏幕方向切换的终端的屏幕分辨率。例如，对端终端中可以预先保存不同型号的终端的屏幕分辨率，在视频通话建立过程中终端20可以按照现有的协商机制向对端终端提供自身的终端型号，对端终端可以根据终端型号来确定发生屏幕方向切换的终端的屏幕分辨率。在另一实施例中，也可以由终端20向对端终端发送自身的屏幕分辨率。需要说明的是，终端20可以在视频会话建立阶段的协商过程中将屏幕分辨率发送给对端终端，也可以在发生屏幕切换后将屏幕分辨率与屏幕方向一起发送给对端终端。如表2所示，表2为将屏幕分辨率与屏幕方向一起发送的re-INVITE消息的扩展部分：
表2
Figure PCTCN2014092795-appb-000002
Figure PCTCN2014092795-appb-000003
对端终端结合接收到的屏幕分辨率和屏幕方向就可确定出该屏幕方向所对应的分辨率。
需要说明的是，由于现有技术在建立视频通话阶段，终端20和对端终端可以进行会话协商，在协商时终端会判断出需要的分辨率直接发送给对端终端，因此，在监测到屏幕方向切换前，终端20和对端终端的视频通话可按照现有技术进行，本发明只需解决在视频通话过程中，由屏幕方向切换导致的问题即可。因此，上述实施例中未涉及视频通话建立阶段的处理。而在另一实施例中，在视频通话建立阶段也可以应用本发明实施例提供的方案来实现。
在视频通话建立阶段采用本发明实施例提供的方案时，协商单元22还可以进一步用于在建立视频通话的过程中，获取初始的屏幕方向，并向对端终端发送该初始的屏幕方向。
相应的，视频单元23还可以进一步用于接收对端终端在接收到切换后的屏幕方向前按照该初始的屏幕方向对应的视频要求提供的视频流。
需要说明的是，由于图2所示实施例是从发生屏幕方向切换的终端的 角度来写的，因此图2所示实施例中对端终端是指向图2所示终端20发送视频流的终端。
图3为本发明实施例提供的终端30的结构示意图。本实施例中的终端为发生屏幕方向切换的终端的对端终端。如图3所示，该终端30包括：接收单元31、确定单元32以及视频单元33。其中，
接收单元31，用于在视频通话的过程中，接收该视频通话中的对端终端在发生屏幕方向切换后发送的切换后的屏幕方向。
确定单元32，用于确定接收单元31接收到的该屏幕方向对应的视频要求。
视频单元33，用于按照确定单元32确定的该屏幕方向对应的视频要求向对端终端提供视频流。
在上述实施例中，通过在终端中增加接收屏幕方向以及按照屏幕方向对应的视频要求来提供视频流的功能，使得提供视频流可以动态适应对端终端的屏幕方向切换，避免了由于屏幕方向切换导致对端设备在展示视频时效果受损的问题，提高了视频通话质量。
需要说明的是，因为图3所示实施例是从向图2所示终端发送视频流的终端的角度来写的，因此图3所示实施例中的对端终端是指如图2所示的发生屏幕方向切换的终端。
下面以受屏幕方向影响的相关参数为分辨率为例对本发明实施例的方案进行详细说明。如图4所示，图4为本发明另一实施例提供的终端30的结构示意图。在此实施例中，屏幕方向对应的视频要求具体包括：屏幕方向对应的分辨率。视频单元33具体包括：调整子单元41，采集部件42以及视频子单元43。其中，
调整子单元41，用于按照屏幕方向对应的分辨率调整采集部件42的采集分辨率。
采集部件42，用于按照调整子单元41调整后的采集分辨率采集视频 图像。
视频子单元43，用于将采集部件42采集的视频图像编码成视频流发送给所述对端终端。
本发明实施例中，采集部件42可以是摄像头等具有扑捉视频图像功能的部件。
在具体实现时，调整子单元41具体可包括：
获取模块411，用于获取采集部件42支持的采集分辨率；
选择模块412，用于在所述获取模块获取的采集分辨率中选择出最接近该屏幕方向对应的分辨率的采集分辨率。
调整模块413，用于将所述采集部件42的采集分辨率调整为所述选择模块选择出的采集分辨率。
选择模块412在选择最接近该屏幕方向对应的分辨率的采集分辨率
其中，选择模块412在选择最接近该屏幕方向对应的分辨率的采集分辨率时，可以从分辨率的值来选择。比如，可以将采集分辨率的横向像素数和纵向像素数中分别与该屏幕方向对应的分辨率的横向像素数和纵向像素数进行比较，分别选择出横向像素数最接近该屏幕方向对应的分辨率的横向像素数的采集分辨率和纵向像素数最接近该屏幕方向对应的分辨率的纵向像素数的采集分辨率。为了描述方便，本发明实施例中将屏幕方向对应的分辨率的横向像素数称为第一像素数，屏幕方向对应的分辨率的纵向像素数称为第二像素数。需要说明的是，如果选择出的最接近第一像素数的采集分辨率和最接近第二像素数的采集分辨率不是同一个，选择模块412可以进一步将选择出的采集分辨率的横向像素数和纵向像素数的比值与屏幕方向对应的分辨率的横向像素数和纵向像素数的比值进行比较，将比值最接近屏幕方向对应的分辨率的比值的采集分辨率作为最接近该屏幕方向对应的分辨率的采集分辨率。具体的，选择模块412可包括：
选择子模块4121，用于在获取模块411获取的采集分辨率中分别选择 出横向像素数最接近第一像素数的采集分辨率和纵向像素数最接近第二像素数的采集分辨率；其中，第一像素数为屏幕方向对应的分辨率的横向像素数，第二像素数为屏幕方向对应的分辨率的纵向像素数。
比较子模块4122，用于将选择子模块4121选择出的采集分辨率的横向像素数和纵向像素数的比值与该屏幕方向对应的分辨率的横向像素数和纵向像素数的比值进行比较，将最接近该屏幕方向对应的分辨率的横向像素数和纵向像素数的比值的采集分辨率作为最接近该屏幕方向对应的分辨率的采集分辨率。
需要说明的时，如果采集分辨率中存在与屏幕方向对应的分辨率完全一致的采集分辨率，那么按照上述方式选择出的最接近该屏幕方向对应的分辨率的采集分辨率会是与该该屏幕方向对应的分辨率完全一致的采集分辨率。如果采集分辨率中不存在与该屏幕方向对应的分辨率完全一致的采集分辨率，选择出的最接近该屏幕方向对应的分辨率的采集分辨率可能会大于该屏幕方向对应的分辨率，也可能会小于该屏幕方向对应的分辨率。
在采集分辨率中不存在与该屏幕方向对应的分辨率完全一致的采集分辨率的应用场景下，为了进一步提高视频质量，选择子模块4121可具体用于在横向像素数大于第一像素数且纵向像素数大于第二像素数的采集分辨率中分别选择出横向像素数最接近第一像素数的采集分辨率和纵向像素数最接近第二像素数的采集分辨率。
进一步的，当选择出的最接近该屏幕方向对应的分辨率的采集分辨率大于该屏幕方向对应的分辨率时，为了既保证视频质量又节约带宽，本发明实施例还可以在采集部件42采集到视频图像后，进一步对采集到的视频图像做裁剪，将采集到的视频图像裁剪为与屏幕方向对应的分辨率完全一致的视频图像。其中，本实施例中的视频子单元43可以具体包括：剪裁模块431和编码模块432。其中，
剪裁模块431，用于将采集部件42采集的视频图像裁剪为与屏幕方向对应的分辨率完全一致的视频图像。
编码模块432，用于将剪裁模块431剪裁后的视频图像编码成视频流发送给所述对端终端。
在本发明实施例中，屏幕方向对应的分辨率可以根据对端终端的屏幕分辨率来确定。具体的，确定单元42用于根据对端终端的屏幕分辨率来确定屏幕方向对应的分辨率；其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。
图4所示终端30可以通过不同的方式获取对端终端的屏幕分辨率。例如，终端30中可以预先保存不同型号的终端的屏幕分辨率。在视频通话建立过程中，终端30可以按照现有的协商机制获取对端终端的终端型号，然后根据对端终端的型号来获取对端终端的屏幕分辨率。
在另一实施例中，终端30也可以直接从对端终端接收对端终端的屏幕分辨率。采用此方式时，接收单元41还进一步用于接收对端终端的屏幕分辨率。
需要说明的是，对端终端可以在视频会话建立阶段的协商过程中将屏幕分辨率发送给终端30，也可以在发生屏幕切换后将屏幕分辨率与屏幕方向一起发送给终端30。
为了提高用户体验，在对端终端发生屏幕方向切换后，终端30还可以进一步对本地显示的提供给对端终端的视频画面进行相应调整。具体的，终端30还可包括：切换单元34，用于将本地显示的提供给对端终端的视频画面切换为与对端终端的屏幕方向一致。
需要说明的是，由于现有技术在建立视频通话阶段，终端30和对端 终端可以进行会话协商，在协商时对端终端会判断出需要的分辨率直接发送给终端30，因此，在监测到屏幕方向切换前，终端30和对端终端的视频通话可按照现有技术进行，本发明只需解决在视频通话过程中，由屏幕方向切换导致的问题即可。因此，上述实施例中未涉及视频通话建立阶段的处理。而在另一实施例中，在视频通话建立阶段也可以应用本发明实施例提供的方案来实现。
在视频通话建立阶段采用本发明实施例提供的方案时，终端30中的接收单元31还用于在建立视频通话的过程中，接收对端终端的初始的屏幕方向。
相应的，视频单元33还用于在接收到切换后的屏幕方向前按照该初始的屏幕方向对应的视频要求向对端终端提供视频流。
上述实施例中，通过根据屏幕方向对分辨率等参数进行调整，使得提供视频流可以动态适应对端终端的屏幕方向切换，避免了由于屏幕方向切换导致对端设备在展示视频时效果受损的问题，提高了视频通话质量。
图5为本发明实施例提供的在视频通话中适应屏幕方向切换的方法流程图。本实施例从发生屏幕方向切换的终端的角度进行说明。如图5所述，该方法包括：
S500,在第一终端与第二终端进行视频通话的过程中，第一终端监测第一终端的屏幕方向切换。
其中，屏幕方向切换是指屏幕在横屏和竖屏之间的切换。横屏通常指屏幕的长边位于横向，短边位于纵向；竖屏通常指屏幕的短边位于横向，长边位于纵向。
第一终端可以通过第一终端中的重力感应部件来监测第一终端的屏幕方向切换。
第一终端也可以直接对视频通话的视频画面进行监控，当发现视频画面发生转置时，确认发生屏幕方向切换。具体的，当视频画面在转置后发 生纵向拉伸，则确定是横屏切换为竖屏；当视频画面在转置后发生横向拉伸，确定是竖屏切换为横屏。
S502，第一终端在监测到第一终端发生屏幕方向切换后，向第二终端发送切换后的屏幕方向。
具体的，第一终端可以向第二终端发送携带屏幕方向的协商请求。该协商请求可以基于SIP协议来实现，比如，扩展SIP协议中的re-INVITE消息，在扩展字段中携带切换后的屏幕方向。
S504，第一终端接收第二终端按照所述屏幕方向对应的视频要求发送的视频流。
第二终端在接收到第一终端发送的切换后的屏幕方向后，确定该屏幕方向对应的视频要求，按照确定的视频要求向第一终端提供视频流。
在上述实施例中，通过在视频通话过程中监测终端屏幕方向切换，并将切换后的屏幕方向发送给对端终端，使得对端终端可以根据屏幕方向对应的视频要求来提供视频流，避免了由于屏幕方向切换导致在展示视频时效果受损的问题，提高了视频通话质量。
为了避免对第一终端的误操作导致频繁向第二终端发送屏幕方向，在步骤S502之前，该方法还可以进一步包括：确定监测到的屏幕方向切换为有效屏幕方向切换。其中，有效屏幕方向切换为在该屏幕方向切换发生后的预设时间内未再次才发生屏幕方向切换。
上述预设时间可以根据实际需要来设置，通过该预设时间可以延迟发送切换后的屏幕方向到第二终端。
上述实施例通过延时机制，即在预设时间内未再次才发生屏幕方向切换才向第二终端发送切换后的屏幕方向，可以避免频繁向第二终端发送屏幕方向以及避免第二终端频繁调整视频画面的相关参数，从而节约了网络资源，降低了对第二终端性能的影响。
本发明实施例中，第一终端通过向第二终端发送屏幕方向可以使第二 终端对在播放时会受屏幕方向影响的相关参数进行调整，使调整后的视频符合该屏幕方向对应的视频要求，从而使得视频质量可以自适应终端的屏幕方向切换。
下面以受屏幕方向影响的相关参数为分辨率为例对本发明实施例的方案进行详细说明。在此实施例中，屏幕方向对应的视频要求具体包括：屏幕方向对应的分辨率。
步骤S502中的第一终端向所述第二终端发送切换后的屏幕方向具体包括：第一终端向第二终端发送携带屏幕方向的协商请求，该协商请求用于请求第二终端按照该屏幕方向调整第二终端的采集分辨率。
其中，协商请求的具体实现方式可参照表1，这里不再赘述。
步骤S504具体包括：第一终端接收第二终端按照所述屏幕方向对应的分辨率调整的采集分辨率后采集并编码的视频流。
上述实施例中，第一终端通过向第二终端发送协商请求，请求第二终端按照协商请求中携带的屏幕方向来调整采集分辨率，从对端终端采集的视频图像在横向和纵向上都可以满足切换后的屏幕要求，避免了对视频图像做拉伸等处理，提供了视频通话的质量。
需要说明的是，上述实施例中仅以调整采集分辨率为例进行说明。当屏幕方向对应的视频要求为分辨率时，如果当前采集分辨率在横向和纵向上都大于屏幕方向对应的分辨率，也可以不调整采集分辨率，而是通过剪裁的等手段来调整视频图像，使其符合切换后的屏幕要求。当然，屏幕方向对应的视频要求也不仅仅是分辨率方面的要求，也可以是其它在屏幕方向切换时影响播放画面的因素，在具体实现时均可参考上述调整采集分辨率的实施例类似实现，这里不再赘述。
在上述实施例中，屏幕方向对应的分辨率可以根据第一终端的屏幕分辨率来确定。其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素 数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。在图5所示的方法中，第一终端还可以向第二终端提供屏幕分辨率。其中，第一终端可以在视频会话建立阶段的协商过程中将屏幕分辨率发送给第二终端，也可以在发生屏幕切换后将屏幕分辨率与屏幕方向一起发送给第二终端。当采用第一终端在视频会话建立阶段的将屏幕分辨率发送给第二终端的方案时，第二终端将接收到的屏幕分辨率保存下来。在第二终端接收到切换后的屏幕方向后，获取预先保存屏幕分辨率。当采用第一终端将屏幕分辨率与屏幕方向一起发送给第二终端的方案时，具体实现可参考表2，这里不再赘述。
在具体实现时，第二终端也可以不从第一终端获取第一终端的屏幕分辨率。例如，第二终端中可以预先保存不同型号的终端与屏幕分辨率的对应关系，在视频通话建立过程中第二终端可以按照现有的协商机制获取第一终端的终端型号，第二终端根据第一终端的终端型号以及自身保存的终端型号与屏幕分辨率的对应关系来确定第一终端的屏幕分辨率。
需要说明的是，由于现有技术在建立视频通话阶段，第一终端和第二终端可以进行会话协商，在协商时第一终端会判断出需要的分辨率直接发送给第二终端，因此，在监测到屏幕方向切换前，第一终端和第二终端的视频通话可按照现有技术进行，本发明只需解决在视频通话过程中，由屏幕方向切换导致的问题即可。因此，图5所示实施例中未涉及视频通话建立阶段的处理。而在另一实施例中，在视频通话建立阶段也可以应用本发明实施例提供的方案来实现。
在视频通话建立阶段采用本发明实施例提供的方案时，该方法还可以进一步包括：在建立视频通话的过程中，第一终端获取初始的屏幕方向，向第二终端发送该初始的屏幕方向；接收第二终端在接收到切换后的屏幕方向前按照该初始的屏幕方向对应的视频要求提供的视频流。
图6为本发明另一实施例提供的在视频通话中适应屏幕方向切换的方法流程图。本实施例从提供视频流的终端的角度进行说明。如图6所述，该方法包括：
S600，在第一终端与第二终端进行视频通话的过程中，第二终端接收第一终端在发生屏幕方向切换后发送的切换后的屏幕方向。
具体的，第一终端可以向第二终端发送携带屏幕方向的协商请求。该协商请求可以基于SIP协议来实现，比如，扩展SIP协议中的re-INVITE消息，在扩展字段中携带切换后的屏幕方向。
S602，第二终端确定该屏幕方向对应的视频要求。
其中，屏幕方向对应的视频要求可以是对受屏幕方向影响的相关参数的要求，如分辨率。
S604，第二终端按照该屏幕方向对应的视频要求向第一终端提供视频流。
第二终端在确定出该屏幕方向对应的视频要求后会按照该视频要求对相关参数进行调整以获得适应该屏幕方向的视频流。
在上述实施例中，第二终端可以按照第一终端的屏幕方向对应的视频要求来提供视频流的功能，使得提供视频流可以动态适应对端终端的屏幕方向切换，避免了由于屏幕方向切换导致对端设备在展示视频时效果受损的问题，提高了视频通话质量。
下面同样以受屏幕方向影响的相关参数为分辨率为例对本发明实施例的方案进行详细说明。在此实施例中，屏幕方向对应的视频要求具体包括：屏幕方向对应的分辨率。
步骤604具体包括：第二终端按照屏幕方向对应的分辨率调整自身的采集分辨率；按照调整后的采集分辨率采集视频图像，将采集的所述视频图像编码成视频流发送给第一终端。
其中，第二终端按照屏幕方向对应的分辨率调整自身的采集分辨率具 体实现如下：
第二终端获取自身支持的采集分辨率；在获取的采集分辨率中选择出最接近屏幕方向对应的分辨率的采集分辨率；将自身的采集分辨率调整为选择出的采集分辨率。
其中，第二终端在选择最接近该屏幕方向对应的分辨率的采集分辨率时，可以从分辨率的值(即该分辨率的横向像素数和纵向像素数)来选择。
具体的，在获取的采集分辨率中选择出最接近所述屏幕方向对应的分辨率的采集分辨率可包括以下步骤：
在获取的采集分辨率中分别选择出横向像素数最接近第一像素数的采集分辨率和纵向像素数最接近第二像素数的采集分辨率；其中，第一像素数为屏幕方向对应的分辨率的横向像素数，第二像素数为屏幕方向对应的分辨率的纵向像素数。
将选择出的采集分辨率的横向像素数和纵向像素数的比值与所述屏幕方向对应的分辨率的横向像素数和纵向像素数的比值进行比较，将最接近所述屏幕方向对应的分辨率的横向像素数和纵向像素数的比值的采集分辨率作为最接近所述屏幕方向对应的分辨率的采集分辨率。
由于上述过程是将采集分辨率的横向像素数和纵向像素数中分别与该屏幕方向对应的分辨率的横向像素数和纵向像素数进行比较，因此，比较出的最接近的横向像素数和最接近的纵向像素数可能不属于同一个采集分辨率。在此情况下，第二终端可以进一步将选择出的采集分辨率的横向像素数和纵向像素数的比值与屏幕方向对应的分辨率的横向像素数和纵向像素数的比值进行比较。如果比较出的最接近的横向像素数和最接近的纵向像素数属于同一个采集分辨率，则无需再比较横向像素数和纵向像素数的比值。
需要说明的时，如果采集分辨率中存在与屏幕方向对应的分辨率完全一致的采集分辨率，那么按照上述方式选择出的最接近该屏幕方向对应的 分辨率的采集分辨率会是与该该屏幕方向对应的分辨率完全一致的采集分辨率。如果采集分辨率中不存在与该屏幕方向对应的分辨率完全一致的采集分辨率，选择出的最接近该屏幕方向对应的分辨率的采集分辨率可能会大于该屏幕方向对应的分辨率，也可能会小于该屏幕方向对应的分辨率。
在采集分辨率中不存在与该屏幕方向对应的分辨率完全一致的采集分辨率的应用场景下，为了进一步提高视频质量，上述在获取的采集分辨率中分别选择出横向像素数最接近第一像素数的采集分辨率和纵向像素数最接近第二像素数的采集分辨率具体可包括：
在横向像素数大于第一像素数且纵向像素数均大于第二像素数的采集分辨率中分别选择出横向像素数最接近所述第一像素数的采集分辨率和纵向像素数最接近第二像素数的采集分辨率。
进一步的，当选择出的最接近该屏幕方向对应的分辨率的采集分辨率大于该屏幕方向对应的分辨率时，为了既保证视频质量又节约带宽，上述将采集的所述视频图像编码成视频流发送给第一终端具体可包括：
将采集的所述视频图像裁剪为与所述屏幕方向对应的分辨率完全匹配的视频图像；
将剪裁后的视频图像编码成视频流发送给所述第一终端。
在本发明实施例中，第二终端可以结合屏幕分辨率来确定屏幕方向对应的分辨率。因此，图6所述的方法还可进一步包括：第二终端接收第一终端的屏幕分辨率。
相应的，步骤602具体包括：所述第二终端根据所述屏幕分辨率来确定所述屏幕方向对应的分辨率；其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像 素数。
需要说明的是，第一终端可以在视频会话建立阶段的协商过程中将屏幕分辨率发送给第二终端，也可以在发生屏幕切换后将屏幕分辨率与屏幕方向一起发送给第二终端。当采用第一终端在视频会话建立阶段的将屏幕分辨率发送给第二终端的方案时，第二终端将接收到的屏幕分辨率保存下来。在第二终端接收到切换后的屏幕方向后，获取预先保存屏幕分辨率。当采用第一终端将屏幕分辨率与屏幕方向一起发送给第二终端的方案时，具体实现可参考表2，这里不再赘述。
在具体实现时，第二终端也可以不从第一终端获取第一终端的屏幕分辨率。例如，第二终端中可以预先保存不同型号的终端与屏幕分辨率的对应关系，在视频通话建立过程中第二终端可以按照现有的协商机制获取第一终端的终端型号，第二终端根据第一终端的终端型号以及自身保存的终端型号与屏幕分辨率的对应关系来确定第一终端的屏幕分辨率。
为了提高用户体验，在第一终端发生屏幕方向切换后，第二终端还可以进一步将本地显示的提供给第一终端的视频画面切换为与第一终端的屏幕方向一致。
需要说明的是，由于现有技术在建立视频通话阶段，第一终端和第二终端可以进行会话协商，在协商时第一终端会判断出需要的分辨率直接发送给第二终端，因此，在监测到屏幕方向切换前，第一终端和第二终端的视频通话可按照现有技术进行，本发明只需解决在视频通话过程中，由屏幕方向切换导致的问题即可。因此，图6所示实施例中未涉及视频通话建立阶段的处理。而在另一实施例中，在视频通话建立阶段也可以应用本发明实施例提供的方案来实现。
在视频通话建立阶段采用本发明实施例提供的方案时，该方法还可以进一步包括：在建立视频通话的过程中，第二终端接收所述第一终端的初始的屏幕方向；第二终端在接收到切换后的屏幕方向前按照该初始的屏幕 方向对应的视频要求向第一终端提供视频流。
上述实施例中，通过根据屏幕方向对分辨率等参数进行调整，使得提供视频流可以动态适应对端终端的屏幕方向切换，避免了由于屏幕方向切换导致对端终端在展示视频时效果受损的问题，提高了视频通话质量。
下面以基于SIP协议的视频通话业务为例对本发明实施例提供的方案进行更详细的说明。图7为本发明另一实施例提供的在视频通话中适应屏幕方向切换的方法流程图。如图7所示，该方法包括：
S700，第一终端通过视频服务器与第二终端建立视频通话。
其中，步骤S700可以采用现有的SIP协议中的视频通话建立流程来实现，这里不再赘述。
S702，第一终端实时监测第一终端的屏幕方向切换。
第一终端可以通过重力感应转置来监控屏幕方向的切换。
S704，第一终端监测到发生屏幕方向切换，启动定时器，继续监测是否发生屏幕方向切换。
其中，启动定时器的目的是为了判断在预设时间内是否再次发生屏幕方向切换，以确定监测到的屏幕方向切换是否为有效屏幕方向切换。
S706，通过视频服务器向第二终端发送携带屏幕分辨率和屏幕方向的协商消息re-INVITE。
需要说明的是，本实施例以屏幕方向对应的视频要求为分辨率要求为例进行说明。
在到达定时器的预设时间时，如果未再次发生屏幕方向切换，则执行步骤S706。如果在未到达定时器的预设时间时，再次发生屏幕方向切换，则继续执行S704。
re-INVITE的消息样例如下：
m＝video 10520RTP/AVP 106
a＝rtpmap:106H264/90000
a＝fmtp:106,x-dimensions-length＝600；
x-dimensions-width＝480；
a＝fmtp:106x-orientation＝1
其中，x-dimensions-length/x-dimensions-width标识第一终端的屏幕的长和宽，单位为像素数。
x-orientation标识终端屏幕方向切换后的屏幕方向，比如当前举例是第一终端从竖屏切换到横屏，则x-orientation＝1标识当前屏幕方向为横屏。
S708，第二终端从re-INVITE消息获取第一终端的屏幕分辨率和屏幕方向。
第二终端接收到re-INVITE消息后解析re-INVITE消息的扩展字段，获得第一终端的屏幕分辨率和屏幕方向。
S710，第二终端根据获取到的屏幕分辨率和屏幕方向确定屏幕方向对应的分辨率。
比如，按照上述举例中，第二终端将屏幕方向对应的分辨率确定为横向像素数X＝600，纵向像素数Y＝480，即600*480。
S712，第二终端获取自身支持的采集分辨率。
其中，第二终端支持的采集分辨率即为第二终端中的采集部件支持的采集分辨率。采集部件可以是摄像头。第二终端可以调用采集部件的底层驱动接口来获取采集部件支持的采集分辨率列表。本实施例中，假设采集部件支持的分辨率为：1280*720、720*480、640*400、352*288以及320*240。
S714，第二终端在支持的采集分辨率中选择出最接近屏幕方向对应的分辨率的采集分辨率。
a)第二终端优先选择横向像素数最接近屏幕方向对应的分辨率的横向像素数的采集分辨率和竖向像素数最接近屏幕方向对应的分辨率的纵向像素数的采集分辨率。比如，屏幕方向对应的分辨率600*480，那么选择出的采集分辨率为720*480、640*400。
b)在满足a)的前提下，选择横竖比最接近屏幕方向对应的分辨率的横竖比的分辨率。这里的横竖比是指横向像素数和纵向像素数的比值。
可通过如下计算公式进行比较：Z＝|X/Y-A/B|。其中X和Y分别是屏幕方向对应的分辨率的横向像素数和竖向像素数，A和B分别是选择出的采集分辨率的横向像素数和竖向像素数，Z为两者的横竖比差值，取X/Y-A/B的绝对值。Z值最小的摄像视频采集分辨率为最接近屏幕方向对应的分辨率的采集分辨率。本实施例中最终选择720*480的采集分辨率。
S716，第二终端将自身的分辨率调整为选择出的采集分辨率。
S718，第二终端向第一终端返回成功响应。
该成功响应可以为200OK消息。
S720，第二终端按照调整后的采集分辨率进行视频图像的采集。
S722，第二终端按照屏幕方向对应的分辨率对采集到的视频图像进行裁剪，并将剪裁后的视频图像编码为视频流。
本实施例中，第二终端将采集的分辨率为720*480的视频图像裁剪为600*480的视频图像。
S724，第二终端向第一终端发送编码后的视频流。
上述实施例通过第一终端和第二终端动态进行屏幕方向切换的协商，避免了由于屏幕方向切换导致第一终端在展示视频时效果受损的问题，提高了视频通话质量。
图8为本发明实施例提供的终端的硬件结构图。本实施例中的终端为发生屏幕方向切换的终端。如图8所示，该终端包括存储器81、通信接口82，处理器83、总线84。
其中，处理器83、存储器81和通信接口82通过总线84通信连接。
通信接口82用来实现终端与其他设备或通信网络(例如但不限于PLMN/PSTN，互联网等)之间的通信。
存储器81可以是只读存储器(Read Only Memory，ROM)，静态存 储设备，动态存储设备或者随机存取存储器(Random Access Memory，RAM)。存储器81可以存储操作系统和其他应用程序的指令以及应用数据。存储器81中存储的指令由处理器83来运行执行。
处理器83可以采用通用的中央处理器(Central Processing Unit，CPU)，微处理器，应用专用集成电路(Application Specific Integrated Circuit，ASIC)，或者一个或多个集成电路，用于执行相关程序。
总线84可包括一通路，在各个部件(例如处理器83、存储器81和通信接口82、)之间传送信息。
本发明实施例中，处理器83用于执行存储器81中的指令，用于实现以下功能：在视频通话的过程中，监测第一终端的屏幕方向切换；在监测到发生屏幕方向切换后，通过通信接口82向第二终端发送切换后的屏幕方向；通过通信接口82接收第二终端按照所述屏幕方向对应的视频要求发送的视频流。
所述处理器83在发送切换后的屏幕方向前还进一步确定监测到的屏幕方向切换为有效屏幕方向切换。其中，有效屏幕方向切换为在该屏幕方向切换发生后的预设时间内未再次才发生屏幕方向切换。
图8所示处理器的具体处理过程可参考图5所示的方法实施例部分，这里不再赘述。
图9为本发明实施例提供的终端的硬件结构图。本实施例中的终端为提供视频流的终端。如图9所示，该终端包括存储器91、通信接口92，处理器93、总线94和摄像头95。
其中，处理器93、存储器91、摄像头95和通信接口92通过总线94通信连接。
通信接口92用来实现终端与其他设备或通信网络(例如但不限于PLMN/PSTN，互联网等)之间的通信。
存储器91可以是只读存储器(Read Only Memory，ROM)，静态存 储设备，动态存储设备或者随机存取存储器(Random Access Memory，RAM)。存储器91可以存储操作系统和其他应用程序的指令以及应用数据。存储器91中存储的指令由处理器93来运行执行。
处理器93可以采用通用的中央处理器(Central Processing Unit，CPU)，微处理器，应用专用集成电路(Application Specific Integrated Circuit，ASIC)，或者一个或多个集成电路，用于执行相关程序。
总线94可包括一通路，在各个部件(例如处理器93、存储器91、通信接口92和摄像头95)之间传送信息。
摄像头95为采集部件，用于采集视频图像。
本发明实施例中，处理器93用于执行存储器91中的指令，用于实现以下功能：在视频通话的过程中，接收第一终端在发生屏幕方向切换后发送的切换后的屏幕方向；确定该屏幕方向对应的视频要求；按照该屏幕方向对应的视频要求向第一终端提供视频流。
具体的，图9所示处理器的具体处理过程可参考图6所示的方法实施例部分，这里不再赘述。
上述实施例中，通过根据屏幕方向对分辨率等参数进行调整，使得提供视频流可以动态适应对端终端的屏幕方向切换，避免了由于屏幕方向切换导致对端终端在展示视频时效果受损的问题，提高了视频通话质量。
通过以上的实施例的描述，本领域普通技术人员可以理解：实现上述实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，所述的程序可以存储于一计算机可读取存储介质中，该程序在执行时，包括如上述方法实施例的步骤，所述的存储介质，如：ROM/RAM、磁碟、光盘等。
以上所述，仅为本发明的具体实施例，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本发明的保护范围之内。因此，本发明的 保护范围应以权利要求的保护范围为准。

Claims (28)

  1. 一种终端，其特征在于，包括：
    监测单元，用于在视频通话的过程中，监测所述终端的屏幕方向的切换；在监测到发生屏幕方向切换后，将发生屏幕方向切换的监测结果提供给协商单元；
    所述协商单元，用于在接收到所述监测单元提供的所述监测结果后，向进行视频通话的对端终端发送切换后的屏幕方向；
    视频单元，用于接收所述对端终端按照所述屏幕方向对应的视频要求发送的视频流。
  2. 如权利要求1所述的终端，其特征在于，所述监测单元在将所述监测结果提供给所述协商单元前，还用于确定监测到的所述屏幕方向切换为有效屏幕方向切换；所述有效屏幕方向切换为在所述屏幕方向切换发生后的预设时间内未再次才发生屏幕方向切换。
  3. 如权利要求1或2所述的终端，其特征在于，所述屏幕方向对应的视频要求具体包括：所述屏幕方向对应的分辨率；
    所述协商单元具体用于向所述对端终端发送携带所述屏幕方向的协商请求，所述协商请求用于请求所述对端终端根据所述屏幕方向调整所述对端终端的采集分辨率；
    所述视频单元具体用于接收所述对端终端按照所述屏幕方向对应的分辨率调整所述采集分辨率后采集并编码的视频流。
  4. 如权利要求3所述的终端，其特征在于，所述协商单元还用于向所述对端终端发送屏幕分辨率；所述屏幕分辨率用于确定所述屏幕方向对应的分辨率；其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。
  5. 如权利要求1-4任一项所述的终端，其特征在于，所述协商单元还用于在建立视频通话的过程中，获取初始的屏幕方向，并向所述对端终端发送所述初始的屏幕方向；
    所述视频单元还用于接收所述对端终端在接收到所述切换后的屏幕方向前按照所述初始的屏幕方向对应的视频要求提供的视频流。
  6. 一种终端，其特征在于，包括：
    接收单元，用于在视频通话的过程中，接收所述视频通话中的对端终端在发生屏幕方向切换后发送的切换后的屏幕方向；
    确定单元，用于确定所述接收单元接收到的所述屏幕方向对应的视频要求；
    视频单元，用于按照所述确定单元确定的所述屏幕方向对应的视频要求向所述对端终端提供视频流。
  7. 如权利要求6所述的终端，其特征在于，所述屏幕方向对应的视频要求具体包括：所述屏幕方向对应的分辨率；
    所述视频单元具体包括调整子单元，采集部件，以及视频子单元：
    所述调整子单元，用于按照所述屏幕方向对应的分辨率调整所述采集部件的采集分辨率；
    所述采集部件，用于按照所述调整子单元调整后的采集分辨率采集视频图像；
    所述视频子单元，用于将所述采集部件采集的视频图像编码成视频流发送给所述对端终端。
  8. 如权利要求7所述的终端，其特征在于，所述调整子单元具体包括：
    获取模块，用于获取所述采集部件支持的采集分辨率；
    选择模块，用于在所述获取模块获取的采集分辨率中选择出最接近所述屏幕方向对应的分辨率的采集分辨率；
    调整模块，用于将所述采集部件的采集分辨率调整为所述选择模块选择出的采集分辨率。
  9. 如权利要求8所述的终端，其特征在于，所述选择模块具体包括：
    选择子模块，用于在所述获取模块获取的采集分辨率中分别选择横向像素数最接近第一像素数的采集分辨率和纵向像素数最接近第二像素数的采集分辨率；所述第一像素数为所述屏幕方向对应的分辨率的横向像素数，所述第二像素数为所述屏幕方向对应的分辨率的纵向像素数；
    比较子模块，用于将所述选择子模块选择出的采集分辨率的横向像素数和纵向像素数的比值与所述屏幕方向对应的分辨率的横向像素数和纵向像素数的比值进行比较，将最接近所述屏幕方向对应的分辨率的横向像素数和纵向像素数的比值的采集分辨率作为最接近所述屏幕方向对应的分辨率的采集分辨率。
  10. 如权利要求9所述的终端，其特征在于，所述选择子模块具体用于在横向像素数大于所述第一像素数且纵向像素数大于所述第二像素数的采集分辨率中分别选择出横向像素数最接近所述第一像素数的采集分辨率和纵向像素数最接近所述第二像素数的采集分辨率。
  11. 如权利要求10所述的终端，其特征在于，所述视频子单元具体包括：
    剪裁模块，用于将所述采集部件采集的视频图像裁剪为与所述屏幕方向对应的分辨率完全一致的视频图像；
    编码模块，用于将所述剪裁模块剪裁后的视频图像编码成视频流发送给所述对端终端。
  12. 如权利要求6-11任一项所述的终端，其特征在于，所述终端还包括：
    切换单元，用于将本地显示的提供给所述对端终端的视频画面切换为与所述对端终端的屏幕方向一致。
  13. 如权利要求7-12任一项所述的终端，其特征在于，所述接收单元还用于接收所述对端终端的屏幕分辨率；
    所述确定单元具体用于根据所述屏幕分辨率来确定所述屏幕方向对应的分辨率；其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。
  14. 如权利要求6-13任一项所述的终端，其特征在于，所述接收单元还用于在建立视频通话的过程中，接收所述对端终端的初始的屏幕方向；
    所述视频单元还用于在接收到所述切换后的屏幕方向前按照所述初始的屏幕方向对应的视频要求向所述对端终端提供视频流。
  15. 一种在视频通话中适应屏幕方向切换的方法，其特征在于，所述方法包括：
    在第一终端与第二终端进行视频通话的过程中，所述第一终端监测所述第一终端的屏幕方向的切换；
    在监测到所述第一终端发生屏幕方向切换后，所述第一终端向所述第二终端发送切换后的屏幕方向；
    所述第一终端接收所述第二终端按照所述屏幕方向对应的视频要求发送的视频流。
  16. 如权利要求15所述的方法，其特征在于，在向所述第二终端发送切换后的屏幕方向前，所述方法还包括：确定监测到的所述屏幕方向切换为有效屏幕方向切换；所述有效屏幕方向切换为在所述屏幕方向切换发生后的预设时间内未再次才发生屏幕方向切换。
  17. 如权利要求15或16所述的方法，其特征在于，所述屏幕方向对应的视频要求具体包括：所述屏幕方向对应的分辨率。
    所述向所述第二终端发送切换后的屏幕方向具体包括：向所述第二终 端发送携带所述屏幕方向的协商请求，所述协商请求用于请求所述第二终端按照所述屏幕方向调整所述第二终端的采集分辨率；
    接收所述第二终端按照所述屏幕方向对应的视频要求发送的视频流具体包括：接收所述第二终端按照所述屏幕方向对应的分辨率调整所述采集分辨率后采集并编码的视频流。
  18. 如权利要求17所述的方法，其特征在于，所述方法还包括：
    所述第一终端向所述第二终端发送所述第一终端的屏幕分辨率；所述屏幕分辨率用于确定所述屏幕方向对应的分辨率；其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。
  19. 如权利要求15-18任一项所述的方法，其特征在于，所述方法还包括：
    在建立视频通话的过程中，所述第一终端获取初始的屏幕方向，向所述第二终端发送所述初始的屏幕方向；
    所述第一终端接收所述第二终端在接收到所述切换后的屏幕方向前按照所述初始的屏幕方向对应的视频要求提供的视频流。
  20. 一种在视频通话中适应屏幕方向切换的方法，其特征在于，所述方法包括：
    在第一终端与第二终端进行视频通话的过程中，所述第二终端接收所述第一终端在发生屏幕方向吧换后发送的切换后的屏幕方向；
    所述第二终端确定所述屏幕方向对应的视频要求；
    所述第二终端按照所述屏幕方向对应的视频要求向所述第一终端提供视频流。
  21. 如权利要求20所述的方法，其特征在于，所述屏幕方向对应的 视频要求具体包括：所述屏幕方向对应的分辨率；
    所述第二终端按照所述屏幕方向对应的视频要求向所述第一终端提供视频流具体包括：
    所述第二终端按照所述屏幕方向对应的分辨率调整自身的采集分辨率；
    按照调整后的采集分辨率采集视频图像，将采集的所述视频图像编码成视频流发送给所述第一终端。
  22. 如权利要求21所述的方法，其特征在于，所述所述第二终端按照所述屏幕方向对应的分辨率调整自身的采集分辨率具体包括：
    所述第二终端获取所述自身支持的采集分辨率；
    在获取的采集分辨率中选择出最接近所述屏幕方向对应的分辨率的采集分辨率；
    将自身的采集分辨率调整为选择出的采集分辨率。
  23. 如权利要求22所述的方法，其特征在于，所述在获取的采集分辨率中选择出最接近所述屏幕方向对应的分辨率的采集分辨率具体包括：
    在获取的采集分辨率中分别选择出横向像素数最接近第一像素数的采集分辨率和纵向像素数最接近第二像素数的采集分辨率；所述第一像素数为所述屏幕方向对应的分辨率的横向像素数，所述第二像素数为所述屏幕方向对应的分辨率的纵向像素数；
    将选择出的采集分辨率的横向像素数和纵向像素数的比值与所述屏幕方向对应的分辨率的横向像素数和纵向像素数的比值进行比较，将最接近所述屏幕方向对应的分辨率的横向像素数和纵向像素数的比值的采集分辨率作为最接近所述屏幕方向对应的分辨率的采集分辨率。
  24. 如权利要求23所述的方法，其特征在于，所述在获取的采集分辨率中分别选择出横向像素数最接近所述第一像素数的采集分辨率和纵向像素数最接近所述第二像素数具体包括：
    在横向像素数大于所述第一像素数且纵向像素数均大于所述第二像素数的采集分辨率中分别选择出横向像素数最接近所述第一像素数的采集分辨率所述第二像素数的采集分辨率。
  25. 如权利要求24所述的方法，其特征在于，所述将采集的所述视频图像编码成视频流发送给所述第一终端具体包括：
    将采集的所述视频图像裁剪为与所述屏幕方向对应的分辨率完全匹配的视频图像；
    将剪裁后的视频图像编码成视频流发送给所述第一终端。
  26. 如权利要求20-25任一项所述的方法，其特征在于，所述方法还包括：
    所述第二终端将本地显示的提供给所述第一终端的视频画面切换为与所述第一终端的屏幕方向一致。
  27. 如权利要求21-26任一项所述的方法，其特征在于，所述方法还包括：所述第二终端接收所述第一终端的屏幕分辨率；
    所述第二终端确定所述屏幕方向对应的视频要求具体包括：所述第二终端根据所述屏幕分辨率来确定所述屏幕方向对应的分辨率；其中，所述屏幕方向为横屏时所对应的分辨率的横向像素为所述屏幕分辨率的长度像素数，纵向像素数为所述屏幕分辨率的宽度像素数；所述屏幕方向为竖屏时所对应的分辨率的横向像素为所述屏幕分辨率的宽度像素数，纵向像素数为所述屏幕分辨率的长度像素数。
  28. 如权利要求20-27所述的方法，其特征在于，所述方法还包括：
    在建立视频通话的过程中，所述第二终端接收所述第一终端的初始的屏幕方向；
    所述第二终端在接收到所述切换后的屏幕方向前按照所述初始的屏幕方向对应的视频要求向所述第一终端提供视频流。
PCT/CN2014/092795 2013-12-31 2014-12-02 一种在视频通话中适应屏幕方向切换的方法和装置 WO2015101126A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP14876462.4A EP3082336A4 (en) 2013-12-31 2014-12-02 Method and device for adapting to screen orientation switching during video call
US15/198,047 US20160309118A1 (en) 2013-12-31 2016-06-30 Method and Apparatus for Adapting To Screen Orientation Switching During Video Call

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310753502.7 2013-12-31
CN201310753502.7A CN103763505A (zh) 2013-12-31 2013-12-31 一种在视频通话中适应屏幕方向切换的方法和装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/198,047 Continuation US20160309118A1 (en) 2013-12-31 2016-06-30 Method and Apparatus for Adapting To Screen Orientation Switching During Video Call

Publications (1)

Publication Number Publication Date
WO2015101126A1 true WO2015101126A1 (zh) 2015-07-09

Family

ID=50530656

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/092795 WO2015101126A1 (zh) 2013-12-31 2014-12-02 一种在视频通话中适应屏幕方向切换的方法和装置

Country Status (4)

Country Link
US (1) US20160309118A1 (zh)
EP (1) EP3082336A4 (zh)
CN (1) CN103763505A (zh)
WO (1) WO2015101126A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111158624A (zh) * 2019-12-31 2020-05-15 维沃移动通信有限公司 一种应用分享方法、电子设备及计算机可读存储介质
CN113079390A (zh) * 2016-07-01 2021-07-06 斯纳普公司 处理和格式化视频用于交互式呈现

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103763505A (zh) * 2013-12-31 2014-04-30 华为技术有限公司 一种在视频通话中适应屏幕方向切换的方法和装置
CN103997519A (zh) * 2014-05-14 2014-08-20 小米科技有限责任公司 传输图像的方法及装置
CN104020928A (zh) * 2014-06-09 2014-09-03 联想(北京)有限公司 一种画面的呈现方法和装置
CN105323532B (zh) * 2014-06-30 2019-10-15 中兴通讯股份有限公司 一种移动终端图像的自适应显示方法和装置
CN104936017A (zh) * 2015-06-17 2015-09-23 Tcl移动通信科技（宁波）有限公司 一种基于无线的快速传输图像的方法及系统
CN106899620A (zh) * 2015-12-17 2017-06-27 西安中兴新软件有限责任公司 一种数据共享系统
CN105959612A (zh) * 2016-04-22 2016-09-21 惠州Tcl移动通信有限公司 一种移动终端视频通讯中画面角度自动修正方法及系统
CN106454477A (zh) * 2016-08-10 2017-02-22 北京金山安全软件有限公司 直播视频处理方法、装置及终端设备
CN106331489A (zh) * 2016-08-25 2017-01-11 天脉聚源(北京)传媒科技有限公司 一种拍摄界面的调整方法及装置
CN106303571B (zh) * 2016-08-29 2019-03-15 武汉斗鱼网络科技有限公司 图像采集过程中实现自适应屏幕旋转的方法及系统
CN106484349A (zh) * 2016-09-26 2017-03-08 腾讯科技（深圳）有限公司 直播信息的处理方法和装置
CN107888964B (zh) * 2016-09-30 2021-04-02 杭州海康威视数字技术股份有限公司 一种视频播放的码流类型切换方法及装置
CN108076301A (zh) * 2016-11-11 2018-05-25 联芯科技有限公司 VoLTE视频多方电话的视频处理方法和系统
CN106792167B (zh) * 2016-12-08 2021-02-12 广州方硅信息技术有限公司 在线直播应用的播放界面的调整方法及系统
CN106506554A (zh) * 2016-12-29 2017-03-15 广州华多网络科技有限公司 直播编码的方法、装置、终端、联动编码服务器及系统
CN107147927B (zh) * 2017-04-14 2020-04-03 北京小米移动软件有限公司 基于直播连麦的直播方法及装置
CN107360389B (zh) * 2017-08-24 2020-11-06 北京奇艺世纪科技有限公司 一种视频通信方法、装置和终端
CN108289186A (zh) * 2017-12-20 2018-07-17 维沃移动通信有限公司 一种视频图像调整方法、移动终端
CN108200572A (zh) * 2018-01-09 2018-06-22 西安万像电子科技有限公司 终端的切换方法、装置及系统
CN110602440A (zh) * 2018-06-13 2019-12-20 视联动力信息技术股份有限公司 一种音视频数据流的传输方法、装置及终端
CN111953918B (zh) * 2019-05-17 2022-06-24 成都鼎桥通信技术有限公司 一种视频单呼中的视频采集处理方法和系统
CN110533628B (zh) * 2019-07-10 2022-05-13 中移（杭州）信息技术有限公司 一种确定屏幕方向的方法、装置及可读存储介质
CN110505428B (zh) * 2019-08-28 2021-06-15 联想(北京)有限公司 一种信息处理方法及电子设备
CN111163293B (zh) * 2019-12-12 2021-09-21 深圳市海雀科技有限公司 智能门铃传感器控制方法及相关产品
US11106571B2 (en) 2019-12-12 2021-08-31 Micro Focus Llc Identification of input object in a graphical user interface
CN111050108A (zh) * 2019-12-19 2020-04-21 维沃移动通信有限公司 多路视频通话的实现方法、装置及电子设备
CN113497909B (zh) * 2020-03-18 2022-12-02 华为技术有限公司 一种设备交互的方法和电子设备
CN111711833B (zh) * 2020-07-28 2022-04-26 广州方硅信息技术有限公司 直播视频流推送控制方法、装置、设备及存储介质
CN112437243A (zh) * 2020-11-20 2021-03-02 联想(北京)有限公司 一种输出控制方法、装置及电子设备
CN112866828B (zh) * 2020-12-22 2022-08-23 深圳市创成微电子有限公司 音频传输控制方法、装置、声卡、系统及可读存储介质
CN112969083A (zh) * 2021-02-20 2021-06-15 深圳市颍创科技有限公司 Pip画面中主画面和子画面同时竖屏显示的方法及系统
CN113434101B (zh) * 2021-06-22 2023-06-09 青岛海尔科技有限公司 设备的控制方法、装置、存储介质及电子装置
WO2023064139A1 (en) * 2021-10-17 2023-04-20 Apple Inc. Camera format selection
US11949529B2 (en) * 2021-10-17 2024-04-02 Apple Inc. Camera format selection
CN114143388A (zh) * 2021-11-17 2022-03-04 维沃移动通信有限公司 通话方法、装置和电子设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102222454A (zh) * 2011-05-13 2011-10-19 数源科技股份有限公司 能对屏幕横竖状态做自动检测和调整的信息发布终端及其实现方法
WO2012137327A1 (ja) * 2011-04-06 2012-10-11 船井電機株式会社 携帯情報表示端末
CN103096011A (zh) * 2011-11-08 2013-05-08 中国电信股份有限公司 视频通信协商方法、系统及视频终端
CN103763505A (zh) * 2013-12-31 2014-04-30 华为技术有限公司 一种在视频通话中适应屏幕方向切换的方法和装置

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5689800A (en) * 1995-06-23 1997-11-18 Intel Corporation Video feedback for reducing data rate or increasing quality in a video processing system
JP2003111040A (ja) * 2001-09-28 2003-04-11 Matsushita Electric Ind Co Ltd 動画像通信方法及び動画像通信装置
US8823743B2 (en) * 2009-10-02 2014-09-02 Sony Corporation Image processing device and method, and program
US8350919B2 (en) * 2010-09-09 2013-01-08 Vizio, Inc. Configuration of a device based upon orientation
CA2754841C (en) * 2010-10-12 2016-11-01 Research In Motion Limited Method and apparatus for image orientation indication and correction
US9215405B2 (en) * 2011-12-09 2015-12-15 Hewlett-Packard Development Company, L.P. Modification of images based on orientation
CN103959763B (zh) * 2011-12-09 2017-06-09 惠普发展公司，有限责任合伙企业 用于基于定向来生成图像的装置和方法
US9007426B2 (en) * 2012-10-04 2015-04-14 Blackberry Limited Comparison-based selection of video resolutions in a video call
CN102984494B (zh) * 2012-12-06 2015-11-25 小米科技有限责任公司 一种视频通讯方法及装置
US9411378B1 (en) * 2015-02-05 2016-08-09 Dell Products, Lp Protection layer on a flexible substrate

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012137327A1 (ja) * 2011-04-06 2012-10-11 船井電機株式会社 携帯情報表示端末
CN102222454A (zh) * 2011-05-13 2011-10-19 数源科技股份有限公司 能对屏幕横竖状态做自动检测和调整的信息发布终端及其实现方法
CN103096011A (zh) * 2011-11-08 2013-05-08 中国电信股份有限公司 视频通信协商方法、系统及视频终端
CN103763505A (zh) * 2013-12-31 2014-04-30 华为技术有限公司 一种在视频通话中适应屏幕方向切换的方法和装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3082336A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113079390A (zh) * 2016-07-01 2021-07-06 斯纳普公司 处理和格式化视频用于交互式呈现
CN113079390B (zh) * 2016-07-01 2024-04-05 斯纳普公司 一种用于处理视频源的方法、服务器计算机以及计算机可读介质
CN111158624A (zh) * 2019-12-31 2020-05-15 维沃移动通信有限公司 一种应用分享方法、电子设备及计算机可读存储介质

Also Published As

Publication number Publication date
EP3082336A1 (en) 2016-10-19
EP3082336A4 (en) 2017-01-11
CN103763505A (zh) 2014-04-30
US20160309118A1 (en) 2016-10-20

Similar Documents

Publication Publication Date Title
WO2015101126A1 (zh) 一种在视频通话中适应屏幕方向切换的方法和装置
US11356638B2 (en) User-adaptive video telephony
US10148868B2 (en) Interactive video conferencing
EP3866474B1 (en) Video self-adaptation method, related device and storage medium
EP2285068B1 (en) Method, mobile device and computer readable medium for mobile telepresence
RU2598800C2 (ru) Сигнализация обмена характеристиками ориентации устройства и адаптация мультимедийного содержания, в ответ на ориентацию устройства, сервером
JP5812634B2 (ja) 送信装置及び送信方法、並びにプログラム
JP4810088B2 (ja) 画像処理装置、画像処理方法及びそのプログラム
KR20120078649A (ko) 카메라를 구비한 휴대용 영상 통화 장치 및 그 방법
EP2884742B1 (en) Process for increasing the resolution and the visual quality of video streams exchanged between users of a video conference service
WO2012151854A1 (zh) 视频数据传输方法及装置
WO2023051739A1 (zh) 图像显示方法及装置、存储介质及电子装置
JP6455121B2 (ja) 情報処理装置、情報処理方法およびプログラム
KR20150027040A (ko) 고속 및 저속 장치의 균형을 맞추기 위한 cpu 사용 제어
TW201626789A (zh) 視訊會議控制方法及系統

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14876462

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2014876462

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014876462

Country of ref document: EP