CN111953918A - Video acquisition processing method and system in video single call - Google Patents

Video acquisition processing method and system in video single call Download PDF

Info

Publication number
CN111953918A
CN111953918A CN201910411478.6A CN201910411478A CN111953918A CN 111953918 A CN111953918 A CN 111953918A CN 201910411478 A CN201910411478 A CN 201910411478A CN 111953918 A CN111953918 A CN 111953918A
Authority
CN
China
Prior art keywords
terminal
mode
image output
output mode
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910411478.6A
Other languages
Chinese (zh)
Other versions
CN111953918B (en
Inventor
汪远
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu TD Tech Ltd
Original Assignee
Chengdu TD Tech Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu TD Tech Ltd filed Critical Chengdu TD Tech Ltd
Priority to CN201910411478.6A priority Critical patent/CN111953918B/en
Publication of CN111953918A publication Critical patent/CN111953918A/en
Application granted granted Critical
Publication of CN111953918B publication Critical patent/CN111953918B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

The application discloses a video acquisition processing method and a system in video single call, wherein the method comprises the following steps: before video acquisition, equipment at two ends of a video single call negotiates an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the two end devices is a large-screen terminal, a landscape mode is preferentially adopted; when the negotiation is successful, the two-end equipment generates video data output to the opposite end according to the negotiated image output mode and sends the video data to the opposite end; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode. By adopting the invention, when video single call is carried out between the handheld terminal and the large-screen terminal, the terminals of the two parties can obtain full-screen display effect as much as possible, and the picture is upright.

Description

Video acquisition processing method and system in video single call
Technical Field
The present application relates to the field of communications technologies, and in particular, to a method and a system for video capture processing in a video call.
Background
Currently, the Btrunc standard defines the signaling flow of a video call (video call is made one-to-one), but the media processing of the video call is not described.
The inventor discovers that in the process of implementing the invention: in the video single call, under certain scenes, the terminals of the two parties cannot achieve the best full-screen display effect, and the picture displayed on the large-screen terminal is inconsistent with the picture actually presented by the shot object under certain scenes. The specific analysis is as follows:
the types of terminals participating in the call in the video single call scene are divided into two types, namely a handheld terminal and a large-screen terminal. The handheld terminal is usually a mobile phone and is a vertical screen device (the aspect ratio of the screen is generally 9:16), the terminal is small and exquisite, and a user can rotate the terminal freely; the large-screen terminal comprises a dispatching Desk (DC) and a video conference terminal, which are horizontal-screen devices (the aspect ratio of the screen is generally 16:9), and the terminal screen is large and is fixed and cannot rotate.
Due to the difference of the screens, the two types of terminals have the following different requirements on the screen when the video calls in a single call mode:
for handheld terminals, it is desirable that the picture be vertical (aspect ratio is typically 9:16) to enable full screen display, limited to the screen size, and the video resolution need not be too high, D1.
For large screen terminals, it is desirable that the picture is horizontal (aspect ratio is typically 16:9) to enable full screen display, since the screen is large and requires high definition video resolution, such as 1080P.
At present, when a camera is installed on a handheld terminal, considering that output pictures of the camera are wide-screen pictures in Landscape mode (i.e. width > height, i.e. 16:9), which are inconsistent with requirements of a vertical full-screen display picture of the handheld terminal, in order to enable pictures collected by the camera to be matched with a screen of the handheld terminal and meet the requirements of the vertical full-screen display picture (i.e. pictures collected by the camera can be displayed on the vertical screen of the handheld terminal in full-screen mode), installation angles of the camera are 90 degrees, so that pictures recorded and output by the camera are 'lying down' pictures (i.e. pictures displayed after an actually shot object rotates 90 degrees on a vertical plane, in order to be displayed correctly when a video is played, camera software of the handheld terminal sets a rotation angle in an output recorded video file, a player reads the rotation angle to perform corresponding picture rendering rotation, the rotated picture can be consistent with the picture of the actual shot scene, and the aim of correctly displaying the full screen on the vertical screen is fulfilled. As shown in fig. 1, the recording preview effect seen by the user is the left picture in the figure, and the picture recorded and output by the camera is the right picture in the figure, which is a "lying down" picture.
Fig. 2 is a schematic diagram showing a video recording and displaying process in a scene where a handheld terminal records a video in a conventional video call-only scheme. When the handheld terminal records in the vertical screen, the adopted output mode is a portrait mode (width < height, namely 9: 16). As shown in fig. 2, in order to make the opposite end see an upright picture (i.e. the picture is consistent with the picture actually presented by the subject), the handheld terminal rotates the picture taken by the camera by 90 degrees, changes the inverted picture in the Landscape mode into an upright picture in the portal mode (see fig. 3 on the left side of fig. 2), and outputs the upright picture to the opposite end.
According to the types of the calling and called terminals in the video single call, the application scenes of the video single call can be divided into two categories, one is the video single call between the handheld terminal and the handheld terminal, and the other is the video single call between the handheld terminal and the large-screen terminal.
Fig. 3 and fig. 4 respectively show schematic diagrams of the two types of video single call application scenarios, in which, in order to show the video display effect of 2 terminals participating in a call, the two scenarios are shown in left and right 2 diagrams, a → B indicates that the screen recorded by the terminal a is displayed on the terminal B, and a ← B indicates that the screen recorded by the terminal B is displayed on the terminal a):
as shown in fig. 3, for the handheld terminal and the handheld terminal, only when the handheld directions of the two terminals are consistent (fig. 1, 3 lines in fig. 3), the pictures seen by both sides are normal, and if the handheld directions are not consistent (fig. 2 line in the figure), the pictures seen by the other side are rotated upside down.
Since the user can easily rotate the handheld terminal, the video call between the handheld terminal and the handheld terminal can be easily adjusted to the optimal state by the user.
As shown in fig. 4, for the handheld terminal and the large screen terminal, there are two problems:
the first problem is that: as shown in the 1 st line of fig. 4, because the output picture proportions of the two parties are different, the ratio of the handheld terminal to the large-screen terminal is 9:16, the ratio of the large-screen terminal to the handheld terminal is 16:9, the large-screen terminal cannot display the picture of the handheld terminal in a full screen mode, black edges exist on the left and right of the screen of the large-screen device, and the picture of the large-screen terminal cannot be displayed in the full screen mode even when the handheld terminal is vertically held by hands. In practical application, a user can adjust the handheld mode of the handheld terminal to be transversely handheld to see the full-screen display effect, and the large-screen terminal is fixedly installed, so that the picture of the handheld terminal cannot be displayed in the full screen mode when the handheld terminal is vertically handheld.
The second problem is that: as shown in the 2 nd line of fig. 4, when the handheld terminal is held in a horizontal direction, the screen output by the large-screen terminal can be displayed on the handheld terminal in a full screen mode, but the large-screen terminal cannot rotate, so that the screens in the portal mode output by the handheld terminal are all the screens with the real scene rotated by 90 degrees (see the 2 nd left line of fig. 4).
Therefore, in the video single-call scheme between the conventional handheld terminal and the large-screen terminal, when the handheld terminal is held by a vertical screen, both terminals cannot present the best full-screen display effect, and when the handheld terminal is held by a horizontal screen, the large-screen terminal cannot present the full-screen display effect, and a picture of a real scene rotated by 90 degrees is presented.
Disclosure of Invention
The application provides a video acquisition processing method and a video acquisition processing system in video single call, so that when the video single call is carried out between a handheld terminal and a large-screen terminal, the terminals of both sides can obtain a full-screen display effect as far as possible, and the picture is upright.
The application provides a video acquisition processing method in video single call, which comprises the following steps:
before video acquisition, equipment at two ends of a video single call negotiates an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the two end devices is a large-screen terminal, a landscape mode is preferentially adopted;
when the negotiation is successful, the two-end equipment generates video data output to the opposite end according to the negotiated image output mode and sends the video data to the opposite end; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode.
Preferably, the negotiating about the image output mode adopted by the video single call includes:
the calling terminal of the video single call determines the currently supported image output mode according to the image output mode negotiation strategy and the terminal type of the calling terminal, and sends a session establishment request carrying the image output mode to the called terminal;
and the called end of the video single call selects an image output mode supported by both ends as an image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is notified to the calling end of the video single call through the session establishment response, otherwise, the calling end of the video single call is notified that the negotiation is failed through the session establishment response.
Preferably, the image output mode negotiation policy includes:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
Preferably, the generating, by the handheld terminal according to the current handheld state and the image output mode, the video data output to the opposite terminal includes:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the rotated image is used as video data output to the opposite terminal;
when the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; and if the image of the landscape mode output by the local camera is an inverted image, rotating the image output by the local camera by 180 degrees to obtain a corresponding upright image, and taking the rotated image as video data output to the opposite terminal.
The invention provides a video acquisition processing system in video single call, comprising: a calling terminal device and a called terminal device;
before the calling terminal equipment and the called terminal equipment carry out video acquisition of a video single call, negotiating an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the calling terminal equipment and the called terminal equipment is a large-screen terminal, a landscape mode is preferentially adopted;
when the negotiation is successful, the calling terminal equipment and the called terminal equipment respectively generate video data output to an opposite terminal according to the negotiated image output mode and send the video data to the opposite terminal; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode.
Preferably, the negotiating, by the calling device and the called device, an image output mode adopted by the video single call according to the image output mode negotiation policy includes:
the calling terminal equipment determines the currently supported image output mode according to the image output mode negotiation strategy and the terminal type of the calling terminal equipment, and sends a session establishment request carrying the image output mode to the called terminal equipment;
and the called terminal equipment selects an image output mode supported by both ends as an image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is notified to the calling terminal of the video single call through session establishment response, otherwise, the calling terminal of the video single call is notified that the negotiation is failed through the session establishment response.
Preferably, the image output mode negotiation policy includes:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
Preferably, the generating, by the handheld terminal, video data output to the opposite terminal according to the current handheld state and the image output mode includes:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the rotated image is used as video data output to the opposite terminal;
when the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; and if the image of the landscape mode output by the local camera is an inverted image, rotating the image output by the local camera by 180 degrees to obtain a corresponding upright image, and taking the rotated image as video data output to the opposite terminal.
According to the technical scheme, the method and the system for acquiring and processing the video in the video single call introduce an input mode negotiation mechanism in consideration of the limitation that a large-screen mode cannot flexibly rotate a screen, so that when the large-screen terminal participates in the video single call, a landscape mode capable of enabling the large-screen terminal to display in a full screen mode can be preferentially selected as an output mode for outputting video data at two ends, and when the video single call is performed between a handheld terminal and the large-screen terminal, the terminals of the two parties can obtain a full-screen display effect as far as possible, and the picture is upright.
Drawings
FIG. 1 is a schematic diagram of an output picture of a camera on a handheld terminal and a corresponding picture effect displayed on a terminal screen;
fig. 2 is a schematic diagram illustrating a video recording and displaying process at a handheld terminal side in a conventional video call-only scheme;
FIG. 3 is a schematic diagram of the display effect of the two terminals when a video call is made between the handheld terminal and the handheld terminal;
FIG. 4 is a schematic diagram of the display effect of the two terminals when a video single call is made between the handheld terminal and the large-screen terminal;
FIG. 5 is a schematic flow chart of a method according to an embodiment of the present invention;
FIG. 6 is a schematic diagram illustrating a video capture processing process performed by the handheld terminal when the handheld terminal is held by a vertical screen based on the implementation of FIG. 5;
fig. 7 is a schematic view of a video capture processing process performed by the handheld terminal when the handheld terminal is held by a landscape screen based on the implementation of fig. 5.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is further described in detail below by referring to the accompanying drawings and examples.
The embodiment of the invention provides a video acquisition processing method in a video single call, as shown in fig. 5, the method comprises the following steps:
step 501, before video acquisition, devices at two ends of a video single call negotiate an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: and when at least one of the two end devices is a large-screen terminal, the landscape mode is preferentially adopted.
Before video acquisition of the video single call, the two-end equipment of the video single call negotiates an image output mode adopted by the video single call, and then video data output to the opposite end is generated in the subsequent step according to the negotiated output mode, so that the opposite end can present a full-screen display effect as much as possible.
In this step, it is necessary to define in the image output mode negotiation policy: and when at least one of the two end devices is a large-screen terminal, the landscape mode is preferentially adopted. Thus, both ends can be enabled to present full-screen display effect as much as possible.
Preferably, the two-end device may negotiate an image output mode used by the video call by using the following method:
step a1, the calling end of the video single call determines the current supported image output mode according to the image output mode negotiation strategy and the terminal type thereof, and sends a session establishment request carrying the image output mode to the called end.
Step a2, the called end of the video single call selects the image output mode supported by both ends as the image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is informed to the calling end of the video single call through the session establishment response, otherwise, the calling end of the video single call is informed that the negotiation is failed through the session establishment response.
Preferably, in order to enable the large-screen terminal to present a large-screen effect as much as possible when the large-screen terminal is used as a calling party or a called party of a video single call, and meanwhile, to avoid a situation of negotiation failure, the image output mode negotiation policy may specifically include the following contents:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
In the negotiation strategy, when the handheld terminal is used as a calling party, the request carries mode as a portrait/landscope, and the portrait mode is a preferred mode; when the large-screen terminal serves as a calling party, the request carries a mode (landscope) or a mode (landscope/portrait), wherein the landscope mode is arranged in front of the terminal and indicates an opposite-end landscope mode as a preferred selection mode, and meanwhile, negotiation failure can be avoided when the portrait mode is supported, and compatibility is improved; when the handheld terminal is used as a called party, because the handheld terminal can be conveniently erected and horizontally supported, the mode which is ranked in the front and supported by the handheld terminal is selected with preference of the opposite terminal. When the large-screen terminal is used as a called party, the large-screen terminal can only be used for fixing the horizontal screen, so that the landscope mode is preferentially selected according to the intention of the terminal, and if the opposite terminal does not support the landscope mode, the portrait mode is selected again, and if the modes of the two parties do not have intersection, the negotiation fails.
By utilizing the image output mode negotiation strategy, the full-screen display effect can be obtained as far as possible by both the terminals no matter in the application scene of video single call between the handheld terminal and the handheld terminal or in the application scene of video single call between the handheld terminal and the large-screen terminal.
Step 502, when the negotiation is successful, the two-end equipment generates video data output to the opposite end according to the negotiated image output mode and sends the video data to the opposite end; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode.
Preferably, when the video call is performed between the handheld terminal and the large-screen terminal, the generating, by the handheld terminal, the video data output to the opposite terminal according to the current handheld state and the image output mode specifically includes:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the specific process of using the rotated image as video data output to the opposite end is shown in fig. 6.
When the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; if the image in the landscape mode output by the home terminal camera is an inverted image, the image output by the home terminal camera is rotated by 180 degrees to obtain a corresponding upright image, and the rotated image is used as video data output to the opposite terminal, and the specific process is shown in fig. 7.
It should be noted that, as in the existing solution, the landscape mode in the present invention corresponds to a ratio of a screen width larger than a height, and specifically may be the same ratio as a width-height ratio when the large-screen terminal is displayed in a full screen in practical application, and the portrait mode corresponds to a ratio of a screen width smaller than a height, and specifically may be the same ratio as a width-height ratio when the handheld terminal is vertically handheld in practical application and displayed in a full screen.
The embodiment of the invention also provides a video acquisition processing system in the video single call, which comprises: a calling terminal device and a called terminal device;
before the calling terminal equipment and the called terminal equipment carry out video acquisition of a video single call, negotiating an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the calling terminal equipment and the called terminal equipment is a large-screen terminal, a landscape mode is preferentially adopted;
when the negotiation is successful, the calling terminal equipment and the called terminal equipment respectively generate video data output to an opposite terminal according to the negotiated image output mode and send the video data to the opposite terminal; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode.
Preferably, the negotiating, by the calling device and the called device, an image output mode adopted by the video single call according to the image output mode negotiation policy includes:
the calling terminal equipment determines the currently supported image output mode according to the image output mode negotiation strategy and the terminal type of the calling terminal equipment, and sends a session establishment request carrying the image output mode to the called terminal equipment;
and the called terminal equipment selects an image output mode supported by both ends as an image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is notified to the calling terminal of the video single call through session establishment response, otherwise, the calling terminal of the video single call is notified that the negotiation is failed through the session establishment response.
Preferably, the image output mode negotiation policy includes:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
Preferably, the generating, by the handheld terminal, video data output to the opposite terminal according to the current handheld state and the image output mode includes:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the rotated image is used as video data output to the opposite terminal;
when the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; and if the image of the landscape mode output by the local camera is an inverted image, rotating the image output by the local camera by 180 degrees to obtain a corresponding upright image, and taking the rotated image as video data output to the opposite terminal.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims (8)

1. A video acquisition processing method in video single call is characterized by comprising the following steps:
before video acquisition, equipment at two ends of a video single call negotiates an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the two end devices is a large-screen terminal, a landscape mode is preferentially adopted;
when the negotiation is successful, the two-end equipment generates video data output to the opposite end according to the negotiated image output mode and sends the video data to the opposite end; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode.
2. The method of claim 1, wherein negotiating the image output mode for the video single call comprises:
the calling terminal of the video single call determines the currently supported image output mode according to the image output mode negotiation strategy and the terminal type of the calling terminal, and sends a session establishment request carrying the image output mode to the called terminal;
and the called end of the video single call selects an image output mode supported by both ends as an image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is notified to the calling end of the video single call through the session establishment response, otherwise, the calling end of the video single call is notified that the negotiation is failed through the session establishment response.
3. The method of claim 2, wherein the image output mode negotiation policy comprises:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
4. The method of claim 1, wherein the generating, by the handheld terminal, the video data to be output to the opposite terminal according to the current handheld state and the image output mode comprises:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the rotated image is used as video data output to the opposite terminal;
when the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; and if the image of the landscape mode output by the local camera is an inverted image, rotating the image output by the local camera by 180 degrees to obtain a corresponding upright image, and taking the rotated image as video data output to the opposite terminal.
5. A video capture processing system in a video call, comprising: a calling terminal device and a called terminal device;
before the calling terminal equipment and the called terminal equipment carry out video acquisition of a video single call, negotiating an image output mode adopted by the video single call according to a preset image output mode negotiation strategy; wherein the image output mode negotiation policy comprises: when at least one of the calling terminal equipment and the called terminal equipment is a large-screen terminal, a landscape mode is preferentially adopted;
when the negotiation is successful, the calling terminal equipment and the called terminal equipment respectively generate video data output to an opposite terminal according to the negotiated image output mode and send the video data to the opposite terminal; when the video single call is carried out between the handheld terminal and the large-screen terminal, the handheld terminal generates video data output to the opposite terminal according to the current handheld state and the image output mode.
6. The system of claim 5, wherein negotiating the image output mode adopted by the current video single call according to the image output mode negotiation policy by the calling device and the called device comprises:
the calling terminal equipment determines the currently supported image output mode according to the image output mode negotiation strategy and the terminal type of the calling terminal equipment, and sends a session establishment request carrying the image output mode to the called terminal equipment;
and the called terminal equipment selects an image output mode supported by both ends as an image output mode adopted by the video single call according to the image output mode negotiation strategy and the image output mode information in the session establishment request, if the selection is successful, the selected image output mode is notified to the calling terminal of the video single call through session establishment response, otherwise, the calling terminal of the video single call is notified that the negotiation is failed through the session establishment response.
7. The system of claim 6, wherein the image output mode negotiation policy comprises:
when the handheld terminal is used as a calling terminal, the image output modes supported by the local terminal and sent to the opposite terminal comprise a portrait mode and a landscape mode, wherein the priority of the portrait mode is higher than that of the landscape mode;
when the handheld terminal is used as a called terminal, if the image output mode with the highest priority supported by the calling terminal is a portrait mode, selecting the portrait mode as the image output mode adopted by the video single call, otherwise, selecting the landscape mode as the image output mode adopted by the video single call;
when the large-screen terminal is used as a calling terminal, the image output mode supported by the home terminal and sent to the opposite terminal is only a landscape mode or comprises a landscape mode and a portrait mode, wherein the priority of the landscape mode is higher than that of the portrait mode;
when the large-screen terminal is used as a called terminal, if the output mode supported by the calling terminal and the called terminal together comprises a landscape mode, the landscape mode is preferentially selected as the image output mode adopted by the video single call, if the output mode supported by the calling terminal and the called terminal together is only a portrait mode, the portrait mode is selected as the image output mode adopted by the video single call, and if the output mode supported by the calling terminal and the called terminal together is not the output mode supported by the calling terminal and the called terminal together, the negotiation is failed.
8. The system of claim 5, wherein the handheld terminal generates video data for output to the opposite terminal according to the current handheld state and the image output mode, and comprises:
when the handheld terminal is held by a vertical screen, the image in the landscape mode output by the local camera is cut according to the portrait mode, and the cut image is rotated by 90 degrees to obtain a corresponding upright picture; the rotated image is used as video data output to the opposite terminal;
when the handheld terminal is held by a transverse screen, if the image in the landscape mode output by the local camera is an erect picture, the image output by the local camera is directly used as video data output to the opposite terminal; and if the image of the landscape mode output by the local camera is an inverted image, rotating the image output by the local camera by 180 degrees to obtain a corresponding upright image, and taking the rotated image as video data output to the opposite terminal.
CN201910411478.6A 2019-05-17 2019-05-17 Video acquisition processing method and system in video single call Active CN111953918B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910411478.6A CN111953918B (en) 2019-05-17 2019-05-17 Video acquisition processing method and system in video single call

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910411478.6A CN111953918B (en) 2019-05-17 2019-05-17 Video acquisition processing method and system in video single call

Publications (2)

Publication Number Publication Date
CN111953918A true CN111953918A (en) 2020-11-17
CN111953918B CN111953918B (en) 2022-06-24

Family

ID=73336037

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910411478.6A Active CN111953918B (en) 2019-05-17 2019-05-17 Video acquisition processing method and system in video single call

Country Status (1)

Country Link
CN (1) CN111953918B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112437243A (en) * 2020-11-20 2021-03-02 联想(北京)有限公司 Output control method and device and electronic equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140040959A1 (en) * 2012-08-03 2014-02-06 Ozgur Oyman Device orientation capability exchange signaling and server adaptation of multimedia content in response to device orientation
CN103763505A (en) * 2013-12-31 2014-04-30 华为技术有限公司 Method and device suitable for screen direction switching in video call
US20150109408A1 (en) * 2013-10-21 2015-04-23 Stmicroelectronics International N.V. System and method for capturing and rendering a landscape image or video
US20150281583A1 (en) * 2014-03-28 2015-10-01 Intel Corporation Image sensor
US20160269680A1 (en) * 2013-09-27 2016-09-15 Clearone Communications Hong Kong Ltd. Method and Apparatus for Negotiating Video Camera and Display Capabilities in a Video Conferencing Environment
CN106454407A (en) * 2016-10-25 2017-02-22 广州华多网络科技有限公司 Video live broadcast method and device
US20170090847A1 (en) * 2015-09-25 2017-03-30 Srikanth Kambhatla Implementing Wireless Displays That Handle Rotation and/or Portrait-First Sinks
CN107155114A (en) * 2017-06-22 2017-09-12 上海鋆创信息技术有限公司 A kind of video pictures method of adjustment and system
WO2019090772A1 (en) * 2017-11-13 2019-05-16 华为技术有限公司 Image processing method and apparatus for terminal

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140040959A1 (en) * 2012-08-03 2014-02-06 Ozgur Oyman Device orientation capability exchange signaling and server adaptation of multimedia content in response to device orientation
US20160269680A1 (en) * 2013-09-27 2016-09-15 Clearone Communications Hong Kong Ltd. Method and Apparatus for Negotiating Video Camera and Display Capabilities in a Video Conferencing Environment
US20150109408A1 (en) * 2013-10-21 2015-04-23 Stmicroelectronics International N.V. System and method for capturing and rendering a landscape image or video
CN103763505A (en) * 2013-12-31 2014-04-30 华为技术有限公司 Method and device suitable for screen direction switching in video call
US20150281583A1 (en) * 2014-03-28 2015-10-01 Intel Corporation Image sensor
US20170090847A1 (en) * 2015-09-25 2017-03-30 Srikanth Kambhatla Implementing Wireless Displays That Handle Rotation and/or Portrait-First Sinks
CN106454407A (en) * 2016-10-25 2017-02-22 广州华多网络科技有限公司 Video live broadcast method and device
CN107155114A (en) * 2017-06-22 2017-09-12 上海鋆创信息技术有限公司 A kind of video pictures method of adjustment and system
WO2019090772A1 (en) * 2017-11-13 2019-05-16 华为技术有限公司 Image processing method and apparatus for terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
秦宁: "4K大屏渲染系统在大型体育转播中的应用", 《现代电视技术》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112437243A (en) * 2020-11-20 2021-03-02 联想(北京)有限公司 Output control method and device and electronic equipment

Also Published As

Publication number Publication date
CN111953918B (en) 2022-06-24

Similar Documents

Publication Publication Date Title
US20210227151A1 (en) Photographing Method, Apparatus, And Device
EP2811739B1 (en) Terminal, image communication control server, and system and method for image communication using same
CN108933920B (en) Video picture output and viewing method and device
EP1887755A1 (en) Apparatus for image display and control method thereof
EP2525574A1 (en) Method, apparatus and system for video communication
US20140028843A1 (en) Video Streaming Method and System
EP2382779A1 (en) Method, device and a computer program for processing images in a conference between a plurality of video conferencing terminals
US20090015661A1 (en) Virtual Multiway Scaler Compensation
US9185345B2 (en) Video conference system and method for performing the same
US20100188476A1 (en) Image Quality of Video Conferences
EP2335415A1 (en) Method, device and computer program for processing images during video conferencing
JP2016174282A (en) Communication device for television conference
US20040223061A1 (en) Computer camera system and method for reducing parallax
US20100066806A1 (en) Internet video image producing method
JP3585625B2 (en) Image input device and image transmission device using the same
US8810725B2 (en) Process for digitizing video over analog component video cables
CN111953918B (en) Video acquisition processing method and system in video single call
CN204652551U (en) Cloud video signal all-in-one
JP2008098828A (en) Portable terminal equipment
WO2013060295A1 (en) Method and system for video processing
CN110913161B (en) Method and device for recording banner video through vertical screen
CN111953919B (en) Video recording method and device of handheld terminal in video single call
JP6680323B2 (en) Information processing device, information processing method, and program
JP2005080043A (en) Digital camera
JP4623609B2 (en) Imaging / display device for video conference

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant