CN111953918B - Video acquisition processing method and system in video single call - Google Patents

Video acquisition processing method and system in video single call Download PDF

Info

Publication number
CN111953918B
CN111953918B CN201910411478.6A CN201910411478A CN111953918B CN 111953918 B CN111953918 B CN 111953918B CN 201910411478 A CN201910411478 A CN 201910411478A CN 111953918 B CN111953918 B CN 111953918B
Authority
CN
China
Prior art keywords
terminal
mode
image output
output mode
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910411478.6A
Other languages
Chinese (zh)
Other versions
CN111953918A (en
Inventor
汪远
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu TD Tech Ltd
Original Assignee
Chengdu TD Tech Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu TD Tech Ltd filed Critical Chengdu TD Tech Ltd
Priority to CN201910411478.6A priority Critical patent/CN111953918B/en
Publication of CN111953918A publication Critical patent/CN111953918A/en
Application granted granted Critical
Publication of CN111953918B publication Critical patent/CN111953918B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

The application discloses a video acquisition processing method and a system in video single call, wherein the method comprises the following steps: before video acquisition, equipment at two ends of a video single call negotiates an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the two end devices is a large-screen terminal, a landscape mode is preferentially adopted; when the negotiation is successful, the two-end equipment generates video data output to the opposite end according to the negotiated image output mode and sends the video data to the opposite end; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode. By adopting the invention, when video single call is carried out between the handheld terminal and the large-screen terminal, the terminals of the two parties can obtain full-screen display effect as much as possible, and the picture is upright.

Description

Video acquisition processing method and system in video single call
Technical Field
The present application relates to the field of communications technologies, and in particular, to a method and a system for video capture processing in a video call.
Background
Currently, the Btrunc standard defines the signaling flow of a video call (video call is made one-to-one), but the media processing of the video call is not described.
The inventor discovers that in the process of implementing the invention: in the video single call, under certain scenes, the terminals of the two parties cannot achieve the best full-screen display effect, and the picture displayed on the large-screen terminal is inconsistent with the picture actually presented by the shot object under certain scenes. The specific analysis is as follows:
the types of terminals participating in the call in the video single call scene are divided into two types, namely a handheld terminal and a large-screen terminal. The handheld terminal is usually a mobile phone and is a vertical screen device (the aspect ratio of the screen is generally 9:16), the terminal is small and exquisite, and a user can rotate the terminal freely; the large-screen terminal comprises a dispatching Desk (DC) and a video conference terminal, which are horizontal-screen devices (the aspect ratio of the screen is generally 16:9), and the terminal screen is large and is fixed and cannot rotate.
Due to the difference of the screens, the two types of terminals have the following different requirements on the screen when the video calls in a single call mode:
for handheld terminals, it is desirable that the picture be vertical (aspect ratio is typically 9:16) to enable full screen display, limited to the screen size, and the video resolution need not be too high, D1.
For large screen terminals, it is desirable that the picture is horizontal (aspect ratio is typically 16:9) to enable full screen display, since the screen is large and requires high definition video resolution, such as 1080P.
At present, when a camera is installed on a handheld terminal, considering that output pictures of the camera are wide-screen pictures in Landscape mode (i.e. width > height, i.e. 16:9), which are inconsistent with requirements of a vertical full-screen display picture of the handheld terminal, in order to enable pictures collected by the camera to be matched with a screen of the handheld terminal and meet the requirements of the vertical full-screen display picture (i.e. pictures collected by the camera can be displayed on the vertical screen of the handheld terminal in full-screen mode), installation angles of the camera are 90 degrees, so that pictures recorded and output by the camera are 'lying down' pictures (i.e. pictures displayed after an actually shot object rotates 90 degrees on a vertical plane, in order to be displayed correctly when a video is played, camera software of the handheld terminal sets a rotation angle in an output recorded video file, a player reads the rotation angle to perform corresponding picture rendering rotation, the rotated picture can be consistent with the actual shot scene picture, and the aim of correctly displaying the full screen on the vertical screen is fulfilled. As shown in fig. 1, the recording preview effect seen by the user is the picture on the left side in the figure, and the picture on the right side in the figure, which is a "lying down" picture, is output by the camera.
Fig. 2 is a schematic diagram showing a video recording and displaying process in a scene where a handheld terminal records a video in a conventional video call-only scheme. When the handheld terminal records in the vertical screen, the adopted output mode is a portrait mode (width < height, namely 9: 16). As shown in fig. 2, in order to make the opposite end see an upright picture (that is, the upright picture is consistent with the picture actually presented by the object), the handheld terminal rotates the picture captured by the camera by 90 degrees, changes the inverted picture in the Landscape mode into an upright picture in the portal mode (see fig. 3 on the left side of fig. 2), and then outputs the upright picture to the opposite end.
According to the terminal type of a calling party and a called party in the video single call, the application scenes of the video single call can be divided into two categories, namely the video single call between a handheld terminal and a handheld terminal, and the video single call between the handheld terminal and a large-screen terminal.
Fig. 3 and fig. 4 respectively show schematic diagrams of the two types of video single call application scenarios, in which, in order to show the video display effect of 2 terminals participating in a call, the two scenarios are shown in left and right 2 diagrams, a → B indicates that the screen recorded by the terminal a is displayed on the terminal B, and a ← B indicates that the screen recorded by the terminal B is displayed on the terminal a):
as shown in fig. 3, for the handheld terminal and the handheld terminal, only when the handheld directions of the two terminals are consistent (fig. 1, 3 lines in fig. 3), the pictures seen by both sides are normal, and if the handheld directions are not consistent (fig. 2 line in the figure), the pictures seen by the other side are rotated upside down.
Since the user can easily rotate the handheld terminal, the video call between the handheld terminal and the handheld terminal can be easily adjusted to the optimal state by the user.
As shown in fig. 4, for the handheld terminal and the large screen terminal, there are two problems:
the first problem is that: as shown in the 1 st line of fig. 4, because the output picture proportions of the two parties are different, the ratio of the handheld terminal to the large-screen terminal is 9:16, the ratio of the large-screen terminal to the handheld terminal is 16:9, the large-screen terminal cannot display the picture of the handheld terminal in a full screen mode, black edges exist on the left and right of the screen of the large-screen device, and the picture of the large-screen terminal cannot be displayed in the full screen mode even when the handheld terminal is vertically held by hands. In practical application, a user can adjust the handheld mode of the handheld terminal to be transversely handheld to see the full-screen display effect, and the large-screen terminal is fixedly installed, so that the picture of the handheld terminal cannot be displayed in the full screen mode when the handheld terminal is vertically handheld.
The second problem is that: as shown in the 2 nd line of fig. 4, when the handheld terminal is held in a horizontal direction, the screen output by the large-screen terminal can be displayed on the handheld terminal in a full screen mode, but the large-screen terminal cannot rotate, so that the screens in the portal mode output by the handheld terminal are all the screens with the real scene rotated by 90 degrees (see the 2 nd left line of fig. 4).
Therefore, in the video single-call scheme between the conventional handheld terminal and the large-screen terminal, when the handheld terminal is held by a vertical screen, both terminals cannot present the best full-screen display effect, and when the handheld terminal is held by a horizontal screen, the large-screen terminal cannot present the full-screen display effect, and a picture of a real scene which is rotated by 90 degrees is presented.
Disclosure of Invention
The application provides a video acquisition processing method and a video acquisition processing system in video single call, so that when the video single call is carried out between a handheld terminal and a large-screen terminal, the terminals of both sides can obtain a full-screen display effect as far as possible, and the picture is upright.
The application provides a video acquisition processing method in video single call, which comprises the following steps:
before video acquisition, equipment at two ends of a video single call negotiates an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation strategy comprises: when at least one of the two end devices is a large-screen terminal, a landscape mode is preferentially adopted;
when the negotiation is successful, the two-end equipment generates video data output to the opposite end according to the negotiated image output mode and sends the video data to the opposite end; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode.
Preferably, the negotiating about the image output mode adopted by the video single call includes:
the calling terminal of the video single call determines the currently supported image output mode according to the image output mode negotiation strategy and the terminal type of the calling terminal, and sends a session establishment request carrying the image output mode to the called terminal;
and the called end of the video single call selects an image output mode supported by both ends as an image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is notified to the calling end of the video single call through the session establishment response, otherwise, the calling end of the video single call is notified that the negotiation is failed through the session establishment response.
Preferably, the image output mode negotiation strategy includes:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
Preferably, the generating, by the handheld terminal according to the current handheld state and the image output mode, the video data output to the opposite terminal includes:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the rotated image is used as video data output to the opposite terminal;
when the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; and if the image of the landscape mode output by the local camera is an inverted image, rotating the image output by the local camera by 180 degrees to obtain a corresponding upright image, and taking the rotated image as video data output to the opposite terminal.
The invention provides a video acquisition processing system in video single call, comprising: a calling terminal device and a called terminal device;
before the calling terminal equipment and the called terminal equipment carry out video acquisition of a video single call, negotiating an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the calling terminal equipment and the called terminal equipment is a large-screen terminal, a landscape mode is preferentially adopted;
when the negotiation is successful, the calling terminal equipment and the called terminal equipment respectively generate video data output to an opposite terminal according to the negotiated image output mode and send the video data to the opposite terminal; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode.
Preferably, the negotiating, by the calling end device and the called end device, an image output mode adopted by the video single call according to the image output mode negotiating policy includes:
the calling terminal equipment determines the currently supported image output mode according to the image output mode negotiation strategy and the terminal type of the calling terminal equipment, and sends a session establishment request carrying the image output mode to the called terminal equipment;
and the called terminal equipment selects an image output mode supported by both ends as an image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is notified to the calling terminal of the video single call through session establishment response, otherwise, the calling terminal of the video single call is notified that the negotiation is failed through the session establishment response.
Preferably, the image output mode negotiation policy includes:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
Preferably, the generating, by the handheld terminal, video data output to the opposite terminal according to the current handheld state and the image output mode includes:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the rotated image is used as video data output to the opposite terminal;
when the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an upright picture, the image output by the local camera is directly used as video data output to the opposite terminal; and if the image of the landscape mode output by the local camera is an inverted image, rotating the image output by the local camera by 180 degrees to obtain a corresponding upright image, and taking the rotated image as video data output to the opposite terminal.
According to the technical scheme, the method and the system for acquiring and processing the video in the video single call introduce an input mode negotiation mechanism in consideration of the limitation that a large-screen mode cannot flexibly rotate a screen, so that when the large-screen terminal participates in the video single call, a landscape mode capable of enabling the large-screen terminal to display in a full screen mode can be preferentially selected as an output mode for outputting video data at two ends, and when the video single call is performed between a handheld terminal and the large-screen terminal, the terminals of the two parties can obtain a full-screen display effect as far as possible, and the picture is upright.
Drawings
FIG. 1 is a schematic diagram of an output picture of a camera on a handheld terminal and a corresponding picture effect displayed on a terminal screen;
fig. 2 is a schematic diagram illustrating a video recording and displaying process at a handheld terminal side in a conventional video call-only scheme;
FIG. 3 is a schematic diagram of the display effect of the two terminals when a video call is made between the handheld terminal and the handheld terminal;
FIG. 4 is a schematic view showing the display effect of the terminals of the handheld terminal and the large-screen terminal when a single video call is made between the two terminals;
FIG. 5 is a schematic flow chart of a method according to an embodiment of the present invention;
FIG. 6 is a schematic diagram illustrating a video capture processing process performed by the handheld terminal when the handheld terminal is held by a vertical screen based on the implementation of FIG. 5;
fig. 7 is a schematic view of a video capture processing process performed by the handheld terminal when the handheld terminal is held by a landscape screen based on the implementation of fig. 5.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is further described in detail below by referring to the accompanying drawings and examples.
The embodiment of the invention provides a video acquisition processing method in a video single call, as shown in fig. 5, the method comprises the following steps:
step 501, before video acquisition, devices at two ends of a video single call negotiate an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: and when at least one of the two end devices is a large-screen terminal, the landscape mode is preferentially adopted.
Before video acquisition of the video single call, the two-end equipment of the video single call negotiates an image output mode adopted by the video single call, and then video data output to the opposite end is generated in the subsequent step according to the negotiated output mode, so that the opposite end can present a full-screen display effect as much as possible.
In this step, it is necessary to define in the image output mode negotiation policy: and when at least one of the two end devices is a large-screen terminal, the landscape mode is preferentially adopted. Thus, both ends can be enabled to present full-screen display effect as much as possible.
Preferably, the two end devices may negotiate an image output mode used by the video call by using the following method:
step a1, the calling end of the video single call determines the current supported image output mode according to the image output mode negotiation strategy and the terminal type thereof, and sends a session establishment request carrying the image output mode to the called end.
Step a2, the called end of the video single call selects the image output mode supported by both ends as the image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is informed to the calling end of the video single call through the session establishment response, otherwise, the calling end of the video single call is informed that the negotiation is failed through the session establishment response.
Preferably, in order to enable the large-screen terminal to present a large-screen effect as much as possible when the large-screen terminal is used as a calling party or a called party of a video single call, and meanwhile, to avoid a situation of negotiation failure, the image output mode negotiation policy may specifically include the following contents:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
In the negotiation strategy, when the handheld terminal is used as a calling party, the request carries mode as a portrait/landscope, and the portrait mode is a preferred mode; when the large-screen terminal serves as a calling party, the request carries a mode (landscope) or a mode (landscope/portrait), wherein the landscope mode is arranged in front of the terminal and indicates an opposite-end landscope mode as a preferred selection mode, and meanwhile, negotiation failure can be avoided when the portrait mode is supported, and compatibility is improved; when the handheld terminal is used as a called party, the handheld terminal can be conveniently erected and transversely supported, so that the mode which is ranked in the front and supported by the handheld terminal is selected with the preference of the opposite terminal. When the large-screen terminal is used as a called party, the large-screen terminal can only be used for fixing the horizontal screen, so that the landscope mode is preferentially selected according to the intention of the terminal, and if the opposite terminal does not support the landscope mode, the portrait mode is selected again, and if the modes of the two parties do not have intersection, the negotiation fails.
By utilizing the image output mode negotiation strategy, the full-screen display effect can be obtained as far as possible by both the terminals no matter in the application scene of video single call between the handheld terminal and the handheld terminal or in the application scene of video single call between the handheld terminal and the large-screen terminal.
Step 502, when the negotiation is successful, the two-end equipment generates video data output to the opposite end according to the negotiated image output mode and sends the video data to the opposite end; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode.
Preferably, when the video call is performed between the handheld terminal and the large-screen terminal, the generating, by the handheld terminal, the video data output to the opposite terminal according to the current handheld state and the image output mode specifically includes:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the specific process of using the rotated image as video data output to the opposite end is shown in fig. 6.
When the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; if the image in the landscape mode output by the home terminal camera is an inverted picture, the image output by the home terminal camera is rotated by 180 degrees to obtain a corresponding upright picture, and the rotated image is used as video data output to the opposite terminal, and the specific process is shown in fig. 7.
It should be noted that, as in the existing solution, the landscape mode in the present invention corresponds to a ratio of the screen width larger than the height, specifically, the ratio may be the same as the ratio of the width to the height when the large screen terminal is displayed in a full screen in actual application, and the portrait mode corresponds to a ratio of the screen width smaller than the height, specifically, the ratio may be the same as the ratio of the width to the height when the handheld terminal is vertically handheld in actual application and displayed in a full screen.
The embodiment of the invention also provides a video acquisition processing system in the video single call, which comprises: calling end equipment and called end equipment;
before the calling terminal equipment and the called terminal equipment carry out video acquisition of a video single call, negotiating an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the calling terminal equipment and the called terminal equipment is a large-screen terminal, a landscape mode is preferentially adopted;
when the negotiation is successful, the calling terminal equipment and the called terminal equipment respectively generate video data output to an opposite terminal according to the negotiated image output mode and send the video data to the opposite terminal; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode.
Preferably, the negotiating, by the calling device and the called device, an image output mode adopted by the video single call according to the image output mode negotiation policy includes:
the calling terminal equipment determines the currently supported image output mode according to the image output mode negotiation strategy and the terminal type of the calling terminal equipment, and sends a session establishment request carrying the image output mode to the called terminal equipment;
and the called terminal equipment selects an image output mode supported by both ends as an image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is notified to the calling terminal of the video single call through session establishment response, otherwise, the calling terminal of the video single call is notified that the negotiation is failed through the session establishment response.
Preferably, the image output mode negotiation policy includes:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
Preferably, the generating, by the handheld terminal, video data output to the opposite terminal according to the current handheld state and the image output mode includes:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the rotated image is used as video data output to the opposite terminal;
when the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; and if the image of the landscape mode output by the local camera is an inverted image, rotating the image output by the local camera by 180 degrees to obtain a corresponding upright image, and taking the rotated image as video data output to the opposite terminal.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims (4)

1. A video acquisition processing method in video single call is characterized by comprising the following steps:
before video acquisition, equipment at two ends of a video single call negotiates an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the two end devices is a large-screen terminal, a landscape mode is preferentially adopted;
when the negotiation is successful, the two-end equipment generates video data output to the opposite end according to the negotiated image output mode and sends the video data to the opposite end; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode;
the negotiating the image output mode adopted by the video single call includes:
the calling terminal of the video single call determines the currently supported image output mode according to the image output mode negotiation strategy and the terminal type of the calling terminal, and sends a session establishment request carrying the image output mode to the called terminal;
the called end of the video single call selects an image output mode supported by both ends as an image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is notified to the calling end of the video single call through the session establishment response, otherwise, the calling end of the video single call is notified that the negotiation is failed through the session establishment response;
the image output mode negotiation policy includes:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
2. The method of claim 1, wherein the generating, by the handheld terminal, the video data to be output to the opposite terminal according to the current handheld state and the image output mode comprises:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the rotated image is used as video data output to the opposite terminal;
when the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; and if the image in the landscape mode output by the local camera is an inverted picture, rotating the image output by the local camera by 180 degrees to obtain a corresponding upright picture, and taking the rotated image as video data output to the opposite terminal.
3. A video capture processing system in a video call, comprising: a calling terminal device and a called terminal device;
before the calling terminal equipment and the called terminal equipment carry out video acquisition of a video single call, negotiating an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the calling terminal equipment and the called terminal equipment is a large-screen terminal, a landscape mode is preferentially adopted;
when the negotiation is successful, the calling terminal equipment and the called terminal equipment respectively generate video data output to an opposite terminal according to the negotiated image output mode and send the video data to the opposite terminal; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode;
the negotiating about the image output mode adopted by the video single call by the calling terminal equipment and the called terminal equipment according to the negotiation strategy of the image output mode comprises:
the calling terminal equipment determines the currently supported image output mode according to the image output mode negotiation strategy and the terminal type of the calling terminal equipment, and sends a session establishment request carrying the image output mode to the called terminal equipment;
the called terminal equipment selects an image output mode supported by both ends as an image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is notified to the calling terminal of the video single call through the session establishment response, otherwise, the calling terminal of the video single call is notified that the negotiation is failed through the session establishment response;
the image output mode negotiation policy includes:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
4. The system of claim 3, wherein the handheld terminal generates video data for output to the opposite terminal according to the current handheld state and the image output mode, and comprises:
when the handheld terminal is held by a vertical screen, cutting an image in a landscape mode output by a local camera according to the portrait mode, and rotating the cut image by 90 degrees to obtain a corresponding upright picture; the rotated image is used as video data output to the opposite terminal;
when the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; and if the image of the landscape mode output by the local camera is an inverted image, rotating the image output by the local camera by 180 degrees to obtain a corresponding upright image, and taking the rotated image as video data output to the opposite terminal.
CN201910411478.6A 2019-05-17 2019-05-17 Video acquisition processing method and system in video single call Active CN111953918B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910411478.6A CN111953918B (en) 2019-05-17 2019-05-17 Video acquisition processing method and system in video single call

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910411478.6A CN111953918B (en) 2019-05-17 2019-05-17 Video acquisition processing method and system in video single call

Publications (2)

Publication Number Publication Date
CN111953918A CN111953918A (en) 2020-11-17
CN111953918B true CN111953918B (en) 2022-06-24

Family

ID=73336037

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910411478.6A Active CN111953918B (en) 2019-05-17 2019-05-17 Video acquisition processing method and system in video single call

Country Status (1)

Country Link
CN (1) CN111953918B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112437243A (en) * 2020-11-20 2021-03-02 联想(北京)有限公司 Output control method and device and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103763505A (en) * 2013-12-31 2014-04-30 华为技术有限公司 Method and device suitable for screen direction switching in video call
CN106454407A (en) * 2016-10-25 2017-02-22 广州华多网络科技有限公司 Video live broadcast method and device
CN107155114A (en) * 2017-06-22 2017-09-12 上海鋆创信息技术有限公司 A kind of video pictures method of adjustment and system
WO2019090772A1 (en) * 2017-11-13 2019-05-16 华为技术有限公司 Image processing method and apparatus for terminal

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9357272B2 (en) * 2012-08-03 2016-05-31 Intel Corporation Device orientation capability exchange signaling and server adaptation of multimedia content in response to device orientation
US9264668B2 (en) * 2013-09-27 2016-02-16 Clearone Communications Hong Kong Ltd. Methodology for negotiating video camera and display capabilities in a multi-camera/multi-display video conferencing environment
US20150109408A1 (en) * 2013-10-21 2015-04-23 Stmicroelectronics International N.V. System and method for capturing and rendering a landscape image or video
US9723212B2 (en) * 2014-03-28 2017-08-01 Intel Corporation Image capture
US10528315B2 (en) * 2015-09-25 2020-01-07 Intel Corporation Implementing wireless displays that handle rotation and/or portrait-first sinks

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103763505A (en) * 2013-12-31 2014-04-30 华为技术有限公司 Method and device suitable for screen direction switching in video call
CN106454407A (en) * 2016-10-25 2017-02-22 广州华多网络科技有限公司 Video live broadcast method and device
CN107155114A (en) * 2017-06-22 2017-09-12 上海鋆创信息技术有限公司 A kind of video pictures method of adjustment and system
WO2019090772A1 (en) * 2017-11-13 2019-05-16 华为技术有限公司 Image processing method and apparatus for terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
4K大屏渲染系统在大型体育转播中的应用;秦宁;《现代电视技术》;20121031;全文 *

Also Published As

Publication number Publication date
CN111953918A (en) 2020-11-17

Similar Documents

Publication Publication Date Title
US11218649B2 (en) Photographing method, apparatus, and device
EP2811739B1 (en) Terminal, image communication control server, and system and method for image communication using same
US9124765B2 (en) Method and apparatus for performing a video conference
US8139100B2 (en) Virtual multiway scaler compensation
CN108933920B (en) Video picture output and viewing method and device
US20080316295A1 (en) Virtual decoders
EP2525574A1 (en) Method, apparatus and system for video communication
EP1887755A1 (en) Apparatus for image display and control method thereof
WO2010074582A1 (en) Method, device and a computer program for processing images in a conference between a plurality of video conferencing terminals
TWI629902B (en) Projection apparatus with video conference function and method of performing video conference using projection apparatus
JP6172610B2 (en) Video conferencing system
EP2335415A1 (en) Method, device and computer program for processing images during video conferencing
US20140078244A1 (en) Video conference system and method for performing the same
US20100066806A1 (en) Internet video image producing method
WO2015119216A1 (en) Information terminal, system, control method, and recording medium
JP3585625B2 (en) Image input device and image transmission device using the same
US8810725B2 (en) Process for digitizing video over analog component video cables
CN111953918B (en) Video acquisition processing method and system in video single call
US20180048866A1 (en) Videoconference communication device
JP2006235159A (en) Image display device and program for operating the same
CN204652551U (en) Cloud video signal all-in-one
JP2008098828A (en) Portable terminal equipment
WO2013060295A1 (en) Method and system for video processing
CN110913161B (en) Method and device for recording banner video through vertical screen
JP6680323B2 (en) Information processing device, information processing method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant