WO2016202286A1

WO2016202286A1 - Real-time video transmission method and electronic apparatus

Info

Publication number: WO2016202286A1
Application number: PCT/CN2016/086140
Authority: WO
Inventors: 武俊敏
Original assignee: 美国掌赢信息科技有限公司; 武俊敏
Priority date: 2015-06-19
Filing date: 2016-06-17
Publication date: 2016-12-22

Abstract

The invention relates to the field of video technology. Disclosed are a real-time video transmission method and electronic apparatus comprising: receiving a selection instruction triggered by a user; determining a region indicated by a preset shape in a current real-time video frame; performing, according to a preset condition met by a network bandwidth and a transmission strategy supported by an electronic apparatus, any of the following operations: if the network bandwidth meets a first preset condition, transmitting, according to a first transmission strategy, the current real-time video frame; if the network bandwidth meets a second preset condition, transmitting, according to a second transmission strategy, the current real-time video frame; if the network bandwidth meets a third preset condition, transmitting, according to a third transmission strategy, the current real-time video frame; and if the network bandwidth meets a fourth preset condition, transmitting, according to a fourth transmission strategy, the current real-time video frame. According to different network bandwidths, different transmission strategies are adopted for the current real-time video frame, thereby satisfying a variety of needs of the user in a real-time video process and improving user experience.

Description

Instant video transmission method and electronic device

Technical field

The present invention relates to the field of video, and in particular, to a method and a device for transmitting instant video.

Background technique

With the popularization of mobile devices and instant video communication technologies, more and more users choose to use mobile devices to realize real-time video interaction. In the scene of instant video interaction, users may pay attention to a certain area in real-time video. The degree is greater than other areas; or, the user's requirement for the clarity and detail retention of a certain area is greater than other areas; or, other users who want the instant video interaction may migrate the attention to the area specified by the user. The problem is that it is necessary to provide a method for transmitting instant video, which satisfies the user's attention to an area in the instant video is greater than other areas, the user's definition of a certain area and the amount of detail retention is greater than other areas and users. It is hoped that other participants of the instant video interaction will migrate the attention to the diverse needs of the area specified by the user.

Since the prior art does not provide the method for transmitting the instant video, the user cannot meet the diverse needs of the user in the instant video process, and the user experience is reduced.

Summary of the invention

In order to meet the diversified needs of users in the instant video process and improve the user experience, embodiments of the present invention provide a method and an electronic device for transmitting an instant video. The technical solution is as follows:

In a first aspect, a method for transmitting an instant video is provided, the method comprising:

Receiving a user-triggered selection instruction, the selection instruction is used to indicate a preset shape selected by the user;

Determining an area indicated by the preset shape in a current instant video frame;

Perform any of the following operations based on the preset conditions that the network bandwidth meets and the transmission policies supported by the electronic device:

If the network bandwidth meets the first preset condition, transmitting the current instant video frame including the area indicated by the preset shape according to the first transmission policy; or

If the network bandwidth meets the second preset condition, transmitting, according to the second transmission policy, the current instant video frame including the area indicated by the preset shape; or

If the network bandwidth meets the third preset condition, transmitting, according to the third transmission policy, the current instant video frame that includes the area indicated by the preset shape; or

If the network bandwidth meets the fourth preset condition, transmitting the current instant video frame including the area indicated by the preset shape according to the fourth transmission policy.

With reference to the first aspect, in a first possible implementation, the selection instruction includes a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and the preset Setting at least one of the shape effect parameters, determining an area indicated by the preset shape in the current instant video frame by any one of the following operations:

The position parameter of the preset shape includes a coordinate parameter, and determining, according to the coordinate parameter, an area indicated by the preset shape in a current instant video frame; or

The position parameter of the preset shape includes a description parameter, and the details indicated by the description parameter are identified in the current instant video frame;

According to the details, an area indicated by the preset shape is determined in the current instant video frame.

With reference to the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation, the transmitting, according to the first transmission policy, the current region including the area indicated by the preset shape Instant video frames include:

And processing the current instant video according to an importance matrix corresponding to the current instant video frame, and acquiring the processed instant video frame;

Transmitting the processed instant video frame.

In combination with the second possible implementation of the first aspect, in a third possible implementation manner, Processing the current instant video according to the importance matrix corresponding to the current instant video frame, and acquiring the processed instant video frame includes:

Obtaining an importance matrix of the area indicated by the preset shape;

Performing low-pass filtering on the current instant video frame to obtain the filtered current instant video frame;

And merging the current instant video frame with the filtered current instant video frame according to the importance matrix to generate the processed current instant video frame.

With reference to the first aspect to any one of the third possible implementation manners of the first aspect, in a fourth possible implementation, the transmitting, by the second transmission policy, the location including the area indicated by the preset shape The current instant video frame strategy includes:

Dividing an instant video frame including at least the area indicated by the preset shape into at least one macroblock, and setting a quantization parameter corresponding to the at least one macroblock;

Encoding the at least one macroblock according to the quantization parameter to generate an encoded instant video frame;

Transmitting the encoded instant video frame.

In conjunction with the fourth possible implementation of the first aspect, in a fifth possible implementation manner,

The setting the quantization parameter corresponding to the at least one macro block includes:

Setting a quantization parameter of a macroblock including all or part of the area indicated by the preset shape as a first value;

Setting a quantization parameter of a macroblock that does not include all or part of the area indicated by the preset shape as a second value;

And encoding, according to the quantization parameter, the at least one macroblock, and generating the encoded instant video frame includes:

And encoding the at least one macroblock according to the first value and the second value to generate an encoded current instant video frame.

With reference to the first aspect to any one of the fifth possible implementation manners of the first aspect, in a sixth possible implementation, the transmitting, according to the third transmission policy, transmitting the area indicated by the preset shape The current instant video frame includes:

Acquiring residual data between the current instant video frame and the reference frame including the area indicated by the preset shape;

Transmitting the residual data.

With reference to the sixth possible implementation manner of the first aspect, in a seventh possible implementation, the acquiring, by using the residual data between the current instant video frame and the reference frame of the area indicated by the preset shape include:

Obtaining a position parameter and a posture parameter of the area indicated by the preset shape;

Normalizing the position parameter and the posture parameter to generate a standard position parameter and a standard posture parameter;

Obtaining residual data between the current instant video frame and the reference frame including the region indicated by the preset shape according to the standard position parameter and the standard posture parameter.

With reference to the first aspect, in an eighth possible implementation, the transmitting, according to the fourth transmission policy, the current instant video frame that includes the area indicated by the preset shape includes:

Obtaining a feature parameter for describing an area indicated by the preset shape;

Transmitting the feature parameters.

With reference to the eighth possible implementation manner of the first aspect, in the ninth possible implementation manner, the acquiring, by using the feature parameter that is used to describe the area indicated by the preset shape, includes:

Triangulating the area indicated by the preset shape to obtain at least one triangular area;

Acquiring the attitude parameter and the position parameter corresponding to the at least one triangular area;

And generating the feature parameter according to the posture parameter and the position parameter corresponding to the at least one triangular region.

With reference to the first aspect to any one of the possible implementations of the ninth aspect, in a tenth possible implementation, the method further includes:

The selection instruction is sent to other electronic devices.

In a second aspect, a method for displaying an instant video is provided, the method comprising:

Obtaining a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy;

Obtaining a user-triggered selection instruction, the selection instruction is used to indicate a preset shape selected by the user;

The current instant video frame is displayed according to the selection instruction and a transmission policy supported by the electronic device.

In a third aspect, an electronic device is provided, the electronic device comprising:

a receiving module, configured to receive a user-triggered selection instruction, where the selection instruction is used to indicate a preset shape selected by the user;

a first processing module, configured to determine an area indicated by the preset shape in a current instant video frame;

a determining module, configured to determine whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition;

The first processing module is further configured to trigger any one of the following modules according to a preset condition that the network bandwidth meets and a transmission policy supported by the electronic device:

a second processing module, configured to: when the network bandwidth meets the first preset condition, transmit the current instant video frame that includes the area indicated by the preset shape according to the first transmission policy; or

a third processing module, configured to: when the network bandwidth meets the second preset condition, transmit the current instant video frame that includes the area indicated by the preset shape according to the second transmission policy; or

a fourth processing module, configured to: when the network bandwidth meets the third preset condition, transmit the current instant video frame that includes the area indicated by the preset shape according to the third transmission policy; or

And a fifth processing module, configured to: when the network bandwidth meets the fourth preset condition, transmit the current instant video frame including the area indicated by the preset shape according to the fourth transmission policy.

With reference to the third aspect, in a first possible implementation manner, the selection instruction includes a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and the preset At least one of a shape effect parameter is provided, the first processing module being configured to perform any one of the following operations:

With reference to the third aspect or the first possible implementation manner of the third aspect, in a second possible implementation manner, the second processing module is specifically configured to:

Transmitting the processed instant video frame.

In conjunction with the second possible implementation of the third aspect, in a third possible implementation, the second processing module is specifically configured to:

Obtaining an importance matrix of the area indicated by the preset shape;

With reference to the third aspect to any of the third possible implementation manners of the third aspect, in a fourth possible implementation, the third processing module is specifically configured to:

Transmitting the encoded instant video frame.

In conjunction with the fourth possible implementation of the third aspect, in a fifth possible implementation, the third processing module is specifically configured to:

Setting a quantization parameter of a macroblock including all or part of the area indicated by the preset shape is a value

The third processing module is specifically configured to:

With reference to any one of the third aspect to the fifth aspect of the third aspect, in a sixth possible implementation, the fourth processing module is specifically configured to:

Transmitting the residual data.

In conjunction with the sixth possible implementation of the third aspect, in a seventh possible implementation, the fourth processing module is specifically configured to:

With reference to the third aspect, in an eighth possible implementation, the fourth processing module is specifically configured to:

Transmitting the feature parameters.

In conjunction with the eighth possible implementation of the third aspect, in a ninth possible implementation, the fourth processing module is specifically configured to:

Generating the feature parameter according to the attitude parameter and the position parameter corresponding to the at least one triangular region number.

With reference to any of the third aspect to the ninth possible implementation manner of the third aspect, in the tenth possible implementation, the electronic device further includes: a sending module, configured to:

The selection instruction is sent to other electronic devices.

In a fourth aspect, an electronic device is provided, the electronic device comprising a transmitting module, a memory, and a processor connected to the sending module and the memory, wherein the memory is configured to store a set of program codes, The processor calls the program code stored by the memory to perform the following operations:

With reference to the fourth aspect, in a first possible implementation manner, the selection instruction includes a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and the preset At least one of the shape effect parameters, the processor invoking the program code stored in the memory to perform any of the following operations:

With reference to the fourth aspect, or the first possible implementation manner of the fourth aspect, in a second possible implementation, the processor invokes the program code stored by the memory, to perform the following operations:

Transmitting the processed instant video frame.

In conjunction with the second possible implementation of the fourth aspect, in a third possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

Obtaining an importance matrix of the area indicated by the preset shape;

With reference to any of the third aspect to the third possible implementation of the fourth aspect, in a fourth possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

Transmitting the encoded instant video frame.

In conjunction with the fourth possible implementation of the fourth aspect, in a fifth possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

Setting a quantization parameter of a macroblock that does not include all or part of the area indicated by the preset shape The number is the second value;

The processor calls the program code stored by the memory to perform the following operations:

With reference to any of the fifth aspect to the fifth possible implementation manner of the fourth aspect, in a sixth possible implementation, the processor invokes the program code stored by the memory to perform the following operations:

Transmitting the residual data.

In conjunction with the sixth possible implementation of the fourth aspect, in a seventh possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

In conjunction with the fourth aspect, in an eighth possible implementation, the processor invokes program code stored in the memory to perform the following operations:

Transmitting the feature parameters.

In conjunction with the eighth possible implementation of the fourth aspect, in a ninth possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

In conjunction with the fourth aspect, the ninth possible implementation of the ninth aspect, in a tenth possible implementation, the processor, by using the program code stored by the processor, is configured to perform the following operations:

The selection instruction is sent to other electronic devices.

In a fifth aspect, an electronic device is provided, the electronic device comprising:

a first acquiring module, configured to acquire a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy;

a second acquiring module, configured to acquire a user-triggered selection instruction, where the selection instruction is used to indicate a preset shape selected by the user;

And a display module, configured to display the current instant video frame according to the selection instruction and a transmission policy supported by the electronic device.

In a sixth aspect, an electronic device is provided, the electronic device including a display screen, a memory, and a processor coupled to the display screen and the memory, wherein the memory is configured to store a set of program codes, The processor calls the program code stored by the memory to perform the following operations:

The present invention discloses a method and a device for transmitting an instant video, comprising: receiving a selection instruction triggered by a user, the selection instruction is used to indicate a preset shape selected by the user; and determining a preset shape in the current instant video frame And determining whether the network bandwidth meets any one of the first preset condition, the second preset condition, the third preset condition, and the fourth preset condition; if the network bandwidth meets the first preset condition, according to the first transmission Transmitting, by the policy, the current instant video frame including the area indicated by the preset shape; if the network bandwidth meets the second preset condition, transmitting the current instant video frame including the area indicated by the preset shape according to the second transmission policy; The network bandwidth meets the third preset condition, according to the a third transmission policy, transmitting a current instant video frame including an area indicated by the preset shape; and if the network bandwidth satisfies the fourth preset condition, transmitting the current instant video frame including the area indicated by the preset shape according to the fourth transmission policy . By determining whether the network bandwidth meets any one of the first preset condition, the second preset condition, the third preset condition, and the fourth preset condition, the area indicated by the preset shape may be selected according to different network bandwidths. The current instant video frames adopt different transmission strategies, and the traditional instant video transmission method not only satisfies the user's attention to an area in the instant video is greater than other areas, the user's definition of a certain area, and The requirement for detail retention is greater than that of other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, which improves the user experience, improves the utilization of network bandwidth, and saves network resources. Therefore, the transmission efficiency of the instant video is improved, and the user experience is improved. In addition, the method of the embodiment of the present invention processes the current instant video frame after acquiring the area indicated by the preset shape from the current instant video frame. Compared with the traditional instant video coding method, the bandwidth resources are unchanged. More broadband resources are used for the transmission of the area indicated by the preset shape, thereby ensuring the transmission of the area indicated by the preset shape, further satisfying the user's attention to an area in the instant video is greater than other areas, The user's requirement for the clarity and detail retention of an area is greater than that of other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, improving the user experience.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in light of the inventive work.

FIG. 1 is a flowchart of a method for transmitting instant video according to an embodiment of the present invention;

2 is a flowchart of an instant video display method according to an embodiment of the present invention;

3 is a flowchart of a method for transmitting instant video according to an embodiment of the present invention;

4 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of an interface according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 8 is a flowchart of a method for displaying an instant video according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 10 is a flowchart of a method for transmitting instant video according to an embodiment of the present invention;

FIG. 11 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 12 is a flowchart of a method for displaying an instant video according to an embodiment of the present invention;

FIG. 13 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

15 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

16 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

FIG. 17 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. Some embodiments of the invention, rather than all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

An embodiment of the present invention provides a method for transmitting an instant video, where the method is used in an interactive system including at least two electronic devices, wherein in the interactive system, the at least two electronic devices are stored by running the same The application implements real-time video interaction, and the electronic device includes at least a transmitting/receiving module, a video input module, and a display module having a touch function, the video input module includes a camera, the display module may include a display screen, and the electronic device passes the transmitting/receiving module Realize instant video transmission Sending and receiving, real-time video input through the video input module, real-time video display and receiving user-triggered instructions through the display module with touch function.

It is worth noting that, depending on the electronic device, the transmission strategy supported by the electronic device is also different. The electronic device supports the transmission policy, and the electronic device pre-configures a code corresponding to the transmission policy, where the transmission strategy includes instant video transmission and instant transmission. The receiving of the video, the supported transmission strategy of the electronic device includes: the electronic device simultaneously supports the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy; and the electronic device supports the first transmission policy and the second transmission policy And any one of a third transmission policy and a fourth transmission policy; the electronic device supports any two of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy; and the electronic device supports the first transmission policy Any three of the second transmission policy, the third transmission policy, and the fourth transmission policy.

The above-mentioned interactive system is merely exemplary, and is a description of the method provided by the embodiment of the present invention. The specific embodiment of the present invention does not limit the specific interactive system.

Embodiment 1 is a method for transmitting an instant video according to an embodiment of the present invention. Referring to FIG. 1 , the method specifically includes:

101. Receive a user-triggered selection instruction, and the selection instruction is used to indicate a preset shape selected by the user.

Specifically, the selection instruction includes at least one of a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and a special effect parameter of the preset shape.

102. Determine an area indicated by the preset shape in the current instant video frame.

Specifically, the area indicated by the preset shape is determined in the current instant video frame by any one of the following operations:

The position parameter of the preset shape includes a coordinate parameter, and the area indicated by the preset shape is determined in the current instant video frame according to the coordinate parameter; or

According to the details, the area indicated by the preset shape is determined in the current instant video frame.

103. Determine whether the network bandwidth meets the first preset condition, the second preset condition, and the third preset condition. And any one of the fourth preset conditions.

104. If the network bandwidth meets the first preset condition, and the electronic device supports the first transmission policy, according to the first transmission policy, the current instant video frame including the area indicated by the preset shape is transmitted, and ends.

Specifically, the current live video is processed according to an importance matrix corresponding to the current instant video frame, and the processed instant video frame is obtained;

Transmit processed instant video frames.

If the network bandwidth meets the first preset condition, and the electronic device does not support the first transmission policy, the process ends, and after the end, the instant video frame is transmitted by using a conventional transmission mode.

105. If the network bandwidth meets the second preset condition, and the electronic device supports the second transmission policy, according to the second transmission policy, the current instant video frame including the area indicated by the preset shape is transmitted, and ends.

Specifically, the instant video frame including at least the area indicated by the preset shape is divided into at least one macro block, and the quantization parameter corresponding to the at least one macro block is set;

Encoding at least one macroblock according to the quantization parameter to generate an encoded instant video frame;

Transmit the encoded instant video frame.

If the network bandwidth meets the second preset condition, and the electronic device supports the second transmission policy, the process ends, and after the end, the instant video frame is transmitted by using a conventional transmission mode.

106. If the network bandwidth meets the third preset condition, and the electronic device supports the third transmission policy, according to the third transmission policy, the current instant video frame including the area indicated by the preset shape is transmitted, and ends.

Specifically, acquiring residual data between the current instant video frame and the reference frame including the area indicated by the preset shape;

Transmit residual data.

If the network bandwidth satisfies the third preset condition, and the electronic device does not support the third transmission policy, the process ends, and after the end, the instant video frame is transmitted by the conventional transmission mode.

107. If the network bandwidth meets the fourth preset condition, and the electronic device supports the fourth transmission policy, according to the fourth transmission policy, the current instant video frame including the area indicated by the preset shape is transmitted, and ends.

Specifically, acquiring a feature parameter for describing an area indicated by the preset shape;

Transfer feature parameters.

If the network bandwidth satisfies the fourth preset condition, and the electronic device does not support the fourth transmission policy, the process ends, and after the end, the instant video frame is transmitted through the conventional transmission mode.

Optionally, in addition to the foregoing steps, the method provided by the embodiment of the present invention may further include:

Send selection instructions to other electronic devices.

An embodiment of the present invention provides a method for transmitting an instant video, by determining whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition, thereby According to different network bandwidths, different transmission strategies are adopted for the current instant video frames including the area indicated by the preset shape. Compared with the traditional instant video transmission method, the user not only satisfies the user's attention to a certain area in the instant video. The degree is greater than other areas, the user's requirements for the definition of a certain area and the amount of detail retention are greater than other areas and other users who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, improve the user The experience also improves the utilization of the network bandwidth and saves the network resources, thereby improving the transmission efficiency of the instant video and improving the user experience. In addition, the method of the embodiment of the present invention acquires the preset shape from the current instant video frame. After the indicated area, the current instant video frame is processed so that compared to the traditional The instant video coding method uses more broadband resources for the transmission of the area indicated by the preset shape when the bandwidth resource is unchanged, thereby ensuring the transmission of the area indicated by the preset shape, further satisfying the user's The interest in one area of the instant video is greater than that of other areas, the user's definition of the clarity of the area and the amount of detail retention is greater than that of other areas, and other participants who want the instant video interaction to migrate the attention to the user-specified The diverse needs of the region have improved the user experience.

Embodiment 2 is a method for displaying an instant video according to an embodiment of the present invention. Referring to FIG. 2, the method includes:

201. Acquire a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy.

202. Acquire a user-triggered selection instruction, where the selection instruction is used to indicate a preset shape selected by the user;

203. Display a current instant video frame according to the selection instruction and a transmission policy supported by the user.

Specifically, the shape indicated by the selection instruction is displayed.

An embodiment of the present invention provides a method for displaying an instant video, which is obtained by acquiring and displaying a current instant video frame transmitted according to any one of a first transmission policy, a second transmission policy, a third transmission policy, and a fourth transmission policy. In the process of instant video, the user desires to have more clarity and detail retention of the selected area than other areas, further improving the user experience. In addition, by acquiring and displaying the user-triggered selection instruction, the manner in which the user selects the area is increased, and the interaction mode of the user in the instant video interaction process is increased, thereby further satisfying the diversified needs of the user and improving the user experience.

Embodiment 3 is a method for transmitting an instant video according to an embodiment of the present invention. Referring to FIG. 3, in the embodiment of the present invention, a position parameter of a preset shape includes a coordinate parameter, and the method specifically includes:

301. Receive a user-triggered selection instruction, and the selection instruction is used to indicate a preset shape selected by the user.

Specifically, the selection instruction includes at least one of a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and a special effect parameter of the preset shape; the position parameter includes a coordinate parameter, and the coordinate parameter may be The coordinates of at least one point including the geometric center of the preset shape.

The process of receiving a user-triggered selection instruction may be:

When the user triggers a first selection interface including at least one preset shape on the instant video interface, select one of the at least one preset shape on the first selection interface, and display the preset shape on the instant video interface to obtain the preset shape;

After the user stretches the preset shape in the instant video interface, obtaining a size parameter of the preset shape when the user stops stretching;

After the user drags the preset shape in the instant video interface, the position parameter of the preset shape in the instant video interface when the user stops dragging is obtained;

When the user triggers a second selection interface including at least one border on the instant video interface, after selecting one of the at least one border in the second selection interface, acquiring a border parameter of the border; wherein the border parameter includes an element included in the border And the color of the border, etc.;

When the user triggers a third selection interface including at least one special effect on the instant video interface, in the third The selection interface selects one of the at least one special effects, and obtains the special effect parameter of the special effect, the special effect includes an animation effect corresponding to the plurality of special effect elements, the special effect parameter includes a plurality of special effect elements included in the special effect, and corresponding to all the special effect elements. The effect animation and the display time of the animation;

In a practical application, in the process of triggering the selection instruction by the user, the step is: when the user triggers the first selection interface including the at least one preset shape on the instant video interface, after selecting one of the at least one preset shape in the first selection interface The execution order of each step after the preset shape is obtained is merely exemplary. The user can stretch the preset shape in the instant video interface after selecting one of the at least one preset shape, and then dragging on the instant video interface. The preset shape, and then triggering a second selection interface including at least one border on the instant video interface and triggering a third selection interface including at least one special effect on the instant video interface, and may also be in other sequences, in accordance with an embodiment of the present invention The specific order is not limited.

In order to make the method of the embodiment of the present invention more familiar to those skilled in the art, the method of the embodiment of the present invention will be further described below with reference to the accompanying drawings. It is assumed that the instant video interface is as shown in a of FIG. The interface of the video interface triggering the first selection interface including at least one preset shape may be referred to b in FIG. 4; after the user selects the preset shape, the interface for stretching the preset shape in the instant video interface may refer to The c is shown in FIG. 4; after the user selects the preset shape, the interface for dragging the preset shape on the instant video interface can be referred to d in FIG. 4; after the user selects the preset shape, the instant is The interface of the video interface triggering the second selection interface including at least one border may be referred to e in FIG. 4; after the user selects the preset shape, after the instant video interface triggers the third selection interface including at least one special effect, The interface can be referred to as f in FIG. Assume that the operation sequence of the user is: triggering the first selection interface, stretching the preset shape, dragging the preset shape, triggering the second selection interface, and triggering the third selection interface, correspondingly, the display order of the interface is: a, b, For example, the operation sequence of the user is only exemplary. In an actual application, the sequence of operations of the user may be other sequences, such as triggering the first selection interface. Dragging the preset shape, extending the preset shape, triggering the second selection interface, triggering the third selection interface, etc., may also include other operation sequences, and the specific operation sequence is not limited in the embodiment of the present invention.

In the scenario of instant video interaction, when the user pays more attention to an area in the instant video than other areas; or when the user has greater requirements for the definition of the area and the amount of detail retention than other areas; or, when the user When other participants of the instant video interaction want to migrate the attention degree to the area specified by the user, by obtaining the user-triggered selection instruction, determining the preset shape selected by the user according to the selection instruction determines the area selected by the user, which not only satisfies In the process of real-time video, the user wants to have more clarity and detail retention of the selected area than other areas, further increasing the way the user selects the area, and increasing the interaction mode of the user in the process of instant video interaction, further Meet the diverse needs of users and improve the user experience. In addition, since the selection instruction includes at least one of a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and a special effect parameter of the preset shape, the display form of the instant video is increased, and the content is further satisfied. The diverse needs of users have improved the user experience.

302. Determine an area indicated by the preset shape in the current instant video frame.

Specifically, according to the coordinate parameter, the area indicated by the preset shape is determined in the current instant video frame.

The process can be:

Determining at least one point indicated by the coordinate parameter in a current instant video frame;

The at least one point is set to be at least one point describing a preset shape, and the at least one point describing the preset shape includes a center of the preset shape. .

303. Determine whether the network bandwidth is greater than or equal to the first preset value. If yes, and the electronic device supports the first transmission policy, perform step 304; if not, determine whether the network bandwidth is less than the first preset value, and greater than or equal to a second preset value; if yes, and the electronic device supports the second transmission policy, performing step 306; if not, determining that the network bandwidth is less than the second preset value and greater than or equal to the third preset value; if yes, and If the device supports the third transmission policy, step 309 is performed; if not, and the electronic device supports the fourth transmission policy, step 311 is performed.

Specifically, determining a numerical relationship between the network bandwidth and the first preset value, the second preset value, and the third preset value, the specific manner of determining the specific manner in the embodiment of the present invention is not limited.

If the network bandwidth is greater than or equal to the first preset value, determining that the network bandwidth meets the first preset condition;

If the network bandwidth is less than the first preset value and greater than or equal to the second preset value, determining that the network bandwidth meets the second preset condition;

If the network bandwidth is less than the second preset value and greater than or equal to the third preset value, determining that the network bandwidth meets the third preset condition;

If the network bandwidth is less than the third preset condition, determining that the network bandwidth meets the fourth preset condition.

The process of determining the numerical relationship between the network bandwidth and the first preset value, the second preset value, and the third preset value may be:

Determining whether the network bandwidth is greater than or equal to the first preset value, and if yes, determining that the network bandwidth meets the first preset condition, and performing step 304; if not, determining whether the network bandwidth is greater than or equal to the second preset value, and if so, Then, it is determined that the network bandwidth meets the second preset condition, and step 306 is performed; if not, it is determined whether the network bandwidth is greater than or equal to the third preset value, and if yes, it is determined that the network bandwidth meets the third preset condition, and step 309 is performed. If not, it is determined that the network bandwidth meets the fourth preset condition, and step 311 is performed.

The actual preset value may be 100 kb/s, the second preset value may be 50 kb/s, and the third preset value may be 10 kb/s.

Optionally, because the network bandwidth is unstable during network transmission, it may be determined whether the average value of the network bandwidth in the preset time period before the current time meets the first preset condition, the second preset condition, and the third pre-predetermined Set any of the conditions and the fourth preset condition.

Among them, in practical applications, the preset time period may be 0.2 seconds.

By determining whether the average value of the network bandwidth in the preset time period meets the preset condition, the network bandwidth instability during network transmission is eliminated, the reliability of the instant video coding is ensured, and the user experience is improved.

It should be noted that if the network bandwidth is greater than or equal to the first preset value, and the electronic device does not support the first transmission policy, the instant video frame is transmitted through the conventional transmission mode.

If the network bandwidth is less than the first preset value, greater than or equal to the second preset value, and the electronic device does not support the second transmission policy, the instant video frame is transmitted by using a conventional transmission manner.

If the network bandwidth is less than the second preset value, greater than or equal to the third preset value, and the electronic device does not support the third transmission policy, the instant video frame is transmitted through the conventional transmission mode.

If the network bandwidth is less than the third preset value, and the electronic device does not support the fourth transmission policy, the instant video frame is transmitted through the conventional transmission mode.

By judging whether the network bandwidth meets the preset condition, when the network bandwidth is determined to be low, processing the instant video can not only improve the utilization of the network bandwidth, save network resources, improve the transmission efficiency of the instant video, but also can be used in the network bandwidth. When low, the user's attention to a certain area in the instant video is greater than other areas, the user's definition of a certain area and the amount of detail retention is greater than other areas and other participants who want the instant video interaction will pay attention. The diversified needs of migrating to the area specified by the user further enhances the user experience.

304. Process the current instant video according to an importance matrix corresponding to the current instant video frame, and obtain the processed instant video frame.

Specifically, an importance matrix of the area indicated by the preset shape is obtained. The obtaining process may be: setting an importance metric value of all pixels in the current instant video frame; setting an importance metric value of all pixels in the area indicated by the preset shape to a first value; setting a current instant video in a non-pre The importance measure value of all the pixels in the area indicated by the shape is a second value; wherein the first value is set to be greater than the second value, and the value of the importance measure is between 0 and 1.

The current filtering mode is low-pass filtered, and the specific filtering manner is not limited in the embodiment of the present invention.

The processed instant video frame is obtained according to the filtered current instant video frame, the current instant video frame, and the importance matrix.

The current instant video frame and the filtered current instant video frame may be merged on the basis of the importance matrix by using a preset generation algorithm to obtain the processed instant video frame. The algorithm may be:

Where out is the processed instant video frame, src is the current instant video frame, and low is the filtered current instant video frame.

For the importance matrix.

By performing low-pass filtering on the current instant video, the high-frequency signal in the current instant video is eliminated, and the bandwidth resource occupied by the current instant video is reduced, thereby improving the transmission efficiency of the instant video, and further satisfying the user's One area's attention is greater than other areas, users' requirements for a certain area's clarity and detail retention are greater than other areas and other users who want instant video interactions to divert attention to the diverse needs of the user's designated area. , the user experience is improved; in addition, since the importance matrix indicates the area indicated by the preset shape in the instant video frame and the area indicated by the non-preset shape, the importance matrix indicates the importance matrix The area indicated by the preset shape is reserved, and the area indicated by the non-preset shape in the instant video frame is replaced by the area indicated by the non-preset shape in the low-pass filtered instant video frame, so that the processed output is processed. The image of the area indicated by the preset shape in the instant video frame is an undistorted original image The image of the area indicated by the non-preset shape is an image that does not include a high-frequency signal, so that when the processed instant video frame is transmitted, the bandwidth resource required for transmission is reduced, and the transmission efficiency of the instant video is improved. Further satisfying the user's attention to an area in the instant video is greater than other areas, the user's requirement for the clarity and detail retention of a certain area is greater than that of other areas, and other participants who want the instant video interaction to migrate attention. The diverse needs of the area specified by the user enhance the user experience.

305. Transmit the processed instant video frame and end.

Specifically, the processed instant video frame is input to the encoder, and the processed instant video frame is encoded by the encoder to generate code stream data;

The specific transmission mode is not limited in the embodiment of the present invention.

It should be noted that, in step 304 to step 305, a process of transmitting a current instant video frame including an area indicated by a preset shape according to the first transmission policy may be implemented, and other manners may be used in addition to the manner described in the foregoing steps. The specific manner of the embodiment of the present invention is not limited.

The embodiment of the present invention processes the current instant video frame according to the importance matrix, and the importance matrix indicates the importance metric value of each pixel in the current instant video, thereby processing each pixel point, thereby improving the processing. The quality of the live video, further satisfying the user's instant The interest in one area of the video is greater than that of other areas, the user's definition of the clarity of the area and the amount of detail retention is greater than other areas and other participants who want the instant video interaction to migrate the attention to the area specified by the user. The diverse needs have improved the user experience.

306. Divide an instant video frame including at least an area indicated by the preset shape into at least one macro block, and set a quantization parameter corresponding to the at least one macro block.

Specifically, the processed current instant video frame may be divided into at least one macroblock according to a preset division rule, and the specific division rule is not limited in the embodiment of the present invention.

The quantization parameter of the macroblock including the area indicated by all or part of the preset shape is set to be the first value; since the value of the quantization parameter ranges from 0 to 51 in practical applications, the first value may be 0. Any value defined by any one of the user or system between 25.

The quantization parameter of the macroblock that does not include the area indicated by all or part of the preset shape is a second value; the second value may be any value defined by any one of the user or the system between 25 and 51.

In the scenario of real-time video interaction, both the interaction parties and the picture quality requirements for the area indicated by the preset shape such as the area where the face is located in the live video are larger than other areas, so that all or part of the The quantization parameter of the macroblock of the area indicated by the shape is a first value. During the encoding process, more details of the area indicated by the preset shape are retained, so that the preset shape can be guaranteed during the instant video process. The picture quality of the area satisfies the user's requirements for the picture details of the area indicated by the preset shape, further satisfies the user's attention to an area in the instant video is greater than other areas, the user's definition of a certain area, and The requirement for detail retention is greater than other regions and other participants who want instant video interactions to migrate attention to the diverse needs of the user-specified region, improving the user experience. In addition, in the scenario of real-time video interaction, the interaction party and the picture quality requirement for the area indicated by the preset shape such as the area where the face is located in the instant video are larger than other areas, so it may be set not to include all or part of The quantization parameter of the macroblock of the area indicated by the preset shape is a second value. During the encoding process, the details of the macroblock not including the area indicated by all or part of the preset shape are not reserved, and the reduction does not include all Or the bandwidth occupied by the macroblock of the area indicated by the partial preset shape during transmission, so that the method requires less bandwidth resources than the traditional instant video transmission method, thereby saving bandwidth resources and improving real-time video. The efficiency of transmission further satisfies the user's attention to a certain area in the instant video is greater than other areas, the user's requirements for the definition of a certain area and the amount of detail retention are greater than other areas and other participants who want the instant video interaction. The user experience is enhanced by migrating attention to the diverse needs of the area specified by the user. In addition, by setting a quantization parameter of a macroblock including an area indicated by all or part of the preset shape as a first value, setting a quantization parameter of a macroblock not including an area indicated by all or part of the preset shape to a second value, In the encoding process, the details of the area indicated by the preset shape are retained, and the details of the area indicated by the non-preset shape are not preserved, so that the undistorted transmission is performed on the area indicated by the preset shape. Further reducing the bandwidth occupied by the area indicated by the non-preset shape during transmission, so that the method can not only ensure the picture quality of the area indicated by the preset shape but also requires the traditional instant video transmission method. The bandwidth resources are less, which can further save bandwidth resources and improve the efficiency of instant video transmission, further satisfying the user's attention to an area in the instant video is greater than other areas, the user's definition of a certain area and details retention The amount of requirements is greater than other areas and other participants who want instant video interaction will pay attention Migrate to the diverse needs of the region specified by the user, improve the user experience.

307. Encode at least one macroblock according to the quantization parameter to generate an encoded instant video frame.

Specifically, the at least one macroblock is encoded according to the first value and the second value, to generate an encoded current instant video frame.

The processed instant video frame is encoded according to the first value and the second value.

The specific coding manner is not limited in the embodiment of the present invention.

308. Transmit the encoded instant video frame and end.

Specifically, the specific transmission mode is not limited in the embodiment of the present invention.

It should be noted that, in step 306 to step 308, a process of transmitting a current instant video frame including an area indicated by a preset shape according to the second transmission policy is implemented, and other methods may be used in addition to the manner described in the foregoing steps. The specific manner of the embodiment of the present invention is not limited.

Since at least one macroblock is encoded according to a quantization parameter for indicating the degree of fineness of the macroblock in the encoding process, in the encoding process, the details of the area indicated by the preset shape are retained, as indicated by the non-preset shape The details of the area are not preserved, not only the use of more broadband resources for the transmission of the area indicated by the preset shape, but also the picture quality of the area indicated by the preset shape in the instant video, thereby ensuring the preset shape. The transmission of the indicated area improves the transmission efficiency of the instant video, further satisfies the user's attention to an area in the instant video is greater than other areas, the user's definition of a certain area and the amount of detail retention is greater than other The region and the other participants who want the instant video interaction to move the attention to the diverse needs of the user-specified area improve the user experience.

Optionally, in the actual application, before performing step 306, step 304 may also be performed.

309. Acquire residual data between the current instant video frame and the reference frame including the area indicated by the preset shape.

Specifically, the location parameter and the posture parameter of the area indicated by the preset shape are obtained from the current instant video frame.

The position parameter and the attitude parameter are normalized to generate a standard position parameter and a standard posture parameter.

Obtaining residual data between the current instant video frame and the reference frame including the area indicated by the preset shape according to the standard position parameter and the standard posture parameter. The posture parameter of the area indicated by the preset shape in the reference frame is a standard posture parameter.

The posture parameter of the region indicated by the preset shape in the current instant video frame and the posture parameter of the region indicated by the preset shape in the reference frame are standard posture parameters, so that the preset shape is obtained according to the standard position parameter and the standard posture parameter. The residual data between the current instant video frame and the reference frame of the indicated area, compared to the position parameter position parameter of the area indicated by the preset shape in the current instant video frame, and the position parameter and posture in the reference frame The parameters generate residual data, which reduces the amount of data transmission and processing during the instant video transmission, improves the transmission efficiency of the instant video, and further satisfies the user's attention to a certain area in the instant video is greater than other areas and users. Clearness of a certain area The degree of detail and detail retention requirements are greater than other areas and other participants who want instant video interactions to migrate attention to the diverse needs of the user-specified area, improving the user experience. In addition, real-time video transmission is realized by acquiring residual data between the area indicated by the preset shape in the current instant video frame and the area indicated by the preset shape in the reference frame, compared to the conventional instant video transmission. The method further reduces the data transmission amount and the processing amount in the instant video transmission process, thereby improving the transmission efficiency of the instant video, further satisfying the user's attention to an area in the instant video is greater than other areas, and the user is The resolution of a region and the requirement for detail retention are greater than those of other regions and other participants who want the instant video interaction to move the attention to the diverse needs of the user-specified region, improving the user experience.

310. Transmit residual data and end.

It should be noted that, in step 309 to step 310, a process of transmitting a current instant video frame including an area indicated by a preset shape according to the third transmission policy is implemented, and in addition to the manner described in the foregoing steps, other manners may be adopted. The specific manner of the embodiment of the present invention is not limited.

Since the residual data between the current instant video frame and the reference frame including the area indicated by the preset shape is acquired and transmitted, the method saves network bandwidth resources and ensures instantness compared to conventional transmission of all real-time video frames. The picture quality of the area indicated by the preset shape in the video ensures the transmission of the area indicated by the preset shape, thereby improving the transmission efficiency of the instant video, and further satisfying the user's attention to an area in the instant video is greater than Other areas, users' requirements for the definition of a certain area and the amount of detail retention are greater than other areas and other users who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, improving the user experience.

Optionally, in an actual application, at least one of step 304 and step 306 may also be performed before step 309 is performed.

311. Acquire a feature parameter used to describe an area indicated by the preset shape.

Specifically, the area indicated by the preset shape is triangulated to obtain at least one triangular area.

Obtain positional parameters and attitude parameters for describing three feature points of any one of the triangular regions.

According to the position parameter and the attitude parameter of the three feature points, the attitude parameter and the position parameter corresponding to any one of the triangular regions are generated.

The feature parameter is generated according to the attitude parameter and the position parameter corresponding to the at least one triangular region.

The specific generation manner of the embodiment of the present invention is not limited.

Since the attitude parameter and the position parameter of the triangular area indicate the current position and posture of the triangular area, the driving of the triangular area can be realized by adjusting the characteristic parameter, and at least the area indicated by the preset shape is formed in the current instant video. The attitude parameter and the position parameter of a triangular area, adjusting the attitude parameter and the position parameter of the same triangular area in the transmitted instant video frame, can realize the migration of the area indicated by the preset shape in the current instant video frame to the already transmitted instant. Compared with the transmission of the current instant video frame, the video frame saves the network bandwidth and improves the transmission efficiency of the instant video, further satisfies the user's attention to an area in the instant video is greater than that of other areas, and the user belongs to a certain area. The clarity and detail retention requirements are greater than other areas and other participants who wish to have instant video interactions migrate the attention to the diverse needs of the user-specified area, improving the user experience.

312. Transfer the feature parameters and end.

It should be noted that, in step 311 to step 312, a process of transmitting a current instant video frame including an area indicated by a preset shape according to the fourth transmission policy is implemented, and other methods may be used in addition to the manner described in the foregoing steps. The specific manner of the embodiment of the present invention is not limited.

By transmitting only the feature parameters for describing the area indicated by the preset shape, bandwidth resources are saved compared to transmitting all the real-time video frame data, thereby further improving the transmission efficiency of the instant video, and further satisfying the user in the instant video. The interest of a certain area is greater than that of other areas, the user's requirement for the clarity of a certain area and the amount of detail retention is greater than that of other areas and other participants who want the instant video interaction to move the attention to the area specified by the user. Demand has increased the user experience.

Send selection instructions to other electronic devices.

By sending the selection instruction to other electronic devices, the other electronic devices can display the preset shape indicated by the selection instruction, increase the interactive form of the instant video, and satisfy the diversified needs of the user in the instant video process, and further improve The user experience. In addition, by transmitting the selection instruction to other electronic devices, the data of the preset shape is transmitted to other electronic devices, thereby reducing the amount of data during transmission, saving network resources, and improving the transmission efficiency of the instant video. Further improve the user experience.

In order to further illustrate the effect achieved by the method provided by the embodiment of the present invention, the method provided by the embodiment of the present invention will be further described below with reference to the accompanying drawings, assuming that the preset shape selected by the user is the shape shown in FIG. After performing the method of the embodiment of the present invention on the a in FIG. 7, the generated interface may be referred to b in FIG. 7. In FIG. 7, the resolution and the detail retention indicated by the second display effect are greater than or equal to the first The sharpness indicated by the display effect and the amount of detail retention, the sharpness indicated by the third display effect and the amount of detail retention are smaller than the sharpness indicated by the first display effect and the amount of detail retention.

In the scenario of the instant video interaction, the method provided by the embodiment of the present invention satisfies the requirement that the user pays more attention to an area in the instant video than other areas, and the user's requirement for the clarity and detail retention of the area is greater than other The region and other participants who want the instant video interaction migrate the attention to the diverse needs of the user-specified area, increasing the interactivity and fun of the instant video, further enhancing the user experience.

An embodiment of the present invention provides a method for transmitting an instant video, by determining whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition, thereby According to different network bandwidths, different transmission strategies are adopted for the current instant video frames including the area indicated by the preset shape. Compared with the traditional instant video transmission method, the user not only satisfies the user's attention to a certain area in the instant video. The degree is greater than other areas, the user's requirements for the definition of a certain area and the amount of detail retention are greater than other areas and other users who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, improve the user Experience, also improve the utilization of network bandwidth, save network resources, thereby improving the efficiency of real-time video transmission, and improve users In addition, the method of the embodiment of the present invention processes the current instant video frame after obtaining the area indicated by the preset shape from the current instant video frame, so that the bandwidth is compared to the traditional instant video encoding method. When the resources are unchanged, more broadband resources are used for the transmission of the area indicated by the preset shape, thereby ensuring the transmission of the area indicated by the preset shape, and further satisfying the user to an area in the instant video. The attention is greater than other areas, the user's requirements for the clarity and detail retention of a certain area are greater than other areas and other participants who want the instant video interaction to move the attention to the diverse needs of the user-specified area, improve The user experience.

Embodiment 4 is a method for displaying an instant video according to an embodiment of the present invention. Referring to FIG. 8 , in the embodiment of the present invention, a position parameter of a preset shape includes a coordinate parameter, and the method specifically includes:

801. Acquire a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy.

Specifically, the electronic device may receive the processed current instant video frame sent by the other electronic device, or may receive a selection instruction triggered by the user to indicate the preset shape selected by the user, and the network bandwidth meets the preset. After the condition, the current instant video frame including at least the area is processed according to the importance matrix of the area indicated by the preset shape, and the processed current instant video frame is obtained.

802. Acquire a user-triggered selection instruction, and the selection instruction is used to indicate a preset shape selected by the user.

Specifically, the selection instruction includes a position parameter of a preset shape, and the position parameter includes a coordinate parameter.

The electronic device may receive a selection instruction sent by another electronic device, or may receive a selection instruction triggered by the user to indicate a preset shape selected by the user, and the network bandwidth meets the preset condition, according to the preset shape. The importance matrix of the indicated area, processing the current instant video frame including at least the area, and acquiring the processed current instant video frame, and acquiring the selection instruction.

803. Display a current instant video frame according to the selection instruction and a transmission policy supported by the electronic device.

Specifically, the area indicated by the selection instruction is displayed;

The processed current instant video frame is displayed according to the coordinate parameter.

The specific display manner is not limited in the embodiment of the present invention.

Wherein, if the electronic device does not support the transmission strategy corresponding to the acquired current instant video frame, Sending a prompt message to the electronic device or the server that sends the instant video frame to prompt the electronic device does not support the obtained transmission policy corresponding to the current instant video frame, so that the server or the electronic device that sends the instant video frame receives the After prompting the information, a code corresponding to the transmission policy is sent to the electronic device, so that the electronic device configures the code.

Since the picture quality of the area indicated by the preset shape in the current instant video frame is superior to other areas, the user attention of the electronic device is migrated to the area indicated by the preset shape in the instant video, thereby satisfying the user pair. The interest in one area of the instant video is greater than that of other areas, the user's definition of the clarity of the area and the amount of detail retention is greater than that of other areas, and other participants who want the instant video interaction to migrate the attention to the user-specified The diverse needs of the region have improved the user experience. In addition, by displaying the preset shape, the user attention of the electronic device can be further migrated to the area indicated by the preset shape in the instant video, thereby satisfying the user's attention to a certain area in the instant video is greater than other areas. The user's requirement for the clarity and detail retention of a certain area is greater than that of other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, thereby improving the user experience. In addition, since the selection instruction includes at least one of a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and a special effect parameter of the preset shape, the display form of the instant video is increased, and the content is further satisfied. The diverse needs of users have improved the user experience.

In order to further illustrate the effect achieved by the method provided by the embodiment of the present invention, the method provided by the embodiment of the present invention will be further described below with reference to the accompanying drawings, assuming that the preset shape selected by the user is the shape shown in FIG. The interface for obtaining the current current video frame display after processing may be referred to b in FIG. 9. A in FIG. 9 is an interface displayed after acquiring the current instant video frame, and in FIG. 9, the second display effect indicates clearness. The degree and the detail retention amount are greater than or equal to the sharpness indicated by the first display effect and the detail retention amount, and the sharpness and the detail retention amount indicated by the third display effect are smaller than the sharpness indicated by the first display effect and the detail retention amount.

An embodiment of the present invention provides a method for displaying an instant video by acquiring and displaying any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy. The current instant video frame satisfies the demand of the user in the process of real-time video, and the content retention of the selected area is larger than that of other areas, thereby further improving the user experience. In addition, by acquiring and displaying the user-triggered selection instruction, the manner in which the user selects the area is increased, and the interaction mode of the user in the instant video interaction process is increased, thereby further satisfying the diversified needs of the user and improving the user experience.

Embodiment 5 is a method for transmitting an instant video according to an embodiment of the present invention. Referring to FIG. 10, in the embodiment of the present invention, a position parameter of a preset shape includes a description parameter, and the description parameter is used to describe The details in the area indicated by the preset shape selected by the user in the instant video frame. Illustratively, if the area indicated by the preset shape selected by the user includes at least a human face, the detail may be the eyes of the user. The nose, the mouth and the eyebrows, etc., the method specifically includes:

1001: Receive a user-triggered selection instruction, and the selection instruction is used to indicate a preset shape selected by the user.

Specifically, the step is the same as step 301, and details are not described herein again.

1002. Identify details indicated by the description parameters in the current instant video frame.

Specifically, obtaining description parameters of all feature points in the current instant video frame;

Obtaining all description points whose similarity between the description parameter and the description parameter included in the selection instruction is greater than or equal to a preset threshold;

The details of all the description points are determined to be the details indicated by the description parameters.

The user's attention to an area in the instant video is greater than that of other areas, the user's requirement for the clarity and detail retention of a certain area is greater than that of other areas, and other participants who want the instant video interaction to migrate the attention to the user. The diversified needs of the designated area are that the attention to details in the area is greater than that of other areas, the clarity of details of the area and the amount of detail retention are greater than other areas and other participants who wish to have instant video interaction will pay attention The degree of migration to the details of the area specified by the user, by identifying the details indicated by the description parameters in the current instant video frame, satisfies the user's attention to the details in the area is greater than other areas, the clarity of the details of the area And the requirement for detail retention is greater than the diversified needs of other areas and other participants who wish to have instant video interactions to move attention to the details of the area specified by the user.

1003. Determine, according to the details, an area indicated by the preset shape in the current instant video frame.

Specifically, the coordinates of the description points constituting the detail are set as the coordinates of the points in the area indicated by the preset shape.

In addition, the area indicated by the preset shape is determined in the current instant video frame according to the details, and the specific manner is not limited in the embodiment of the present invention.

Since the position of the detail in the area indicated by the preset shape changes, determining the area indicated by the preset shape in the current instant video frame according to the detail further satisfies the user's attention to a certain area in the instant video. The degree is greater than other areas, the user's requirements for the clarity and detail retention of a certain area are greater than other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, increasing the instant The interactivity and fun of the video further enhances the user experience.

It should be noted that the steps 1002 to 1003 are processes for determining an area indicated by the preset shape in the current instant video frame, and the process may be implemented by other means in addition to the manner described in the foregoing steps. The embodiment does not limit the specific manner.

By identifying the detail indicated by the description parameter in the current instant video frame, and determining the area indicated by the preset shape in the current instant video frame according to the detail, the detail position in the area indicated by the preset shape in the instant video frame In the case of a change, the user's attention to the details in the area indicated by the preset shape is satisfied is greater than that of the other areas, the definition of the detail indicated by the preset shape, and the detail retention amount is greater than other areas and It is hoped that other participants of the instant video interaction will shift the attention to the details of the area indicated by the preset shape, thereby further satisfying the user's attention to an area in the instant video is greater than that of other areas, and the user is clear about an area. The requirement for degree and detail retention is greater than that of other regions and other participants who want real-time video interaction to migrate attention to the diverse needs of the user-specified region, which increases the interactivity and interest of instant video, further enhancing the user. Experience.

1004: Determine whether the network bandwidth is greater than or equal to the first preset value. If yes, and the electronic device supports the first transmission policy, perform step 1005; if not, determine whether the network bandwidth is less than the first preset value, and greater than or equal to a second preset value; if yes, and the electronic device supports the second transmission policy, step 1007 is performed; if not, determining that the network bandwidth is less than the second preset value and greater than or equal to the third preset value; if yes, and If the device supports the third transmission policy, step 1010 is performed; if not, and the electronic device supports the fourth transmission policy, step 1012 is performed.

Specifically, the step is the same as step 303, and details are not described herein again.

1005. Process the current instant video according to an importance matrix corresponding to the current instant video frame, and obtain the processed instant video frame.

Specifically, the step is the same as step 304, and details are not described herein again.

By performing low-pass filtering on the current instant video, the high-frequency signal in the current instant video is eliminated, and the bandwidth resource occupied by the current instant video is reduced, thereby improving the transmission efficiency of the instant video, and further satisfying the user's One area's attention is greater than other areas, users' requirements for a certain area's clarity and detail retention are greater than other areas and other users who want instant video interactions to divert attention to the diverse needs of the user's designated area. , the user experience is improved; in addition, since the importance matrix indicates the area indicated by the preset shape in the instant video frame and the area indicated by the non-preset shape, the importance matrix indicates the importance matrix The area indicated by the preset shape is reserved, and the area indicated by the non-preset shape in the instant video frame is replaced by the area indicated by the non-preset shape in the low-pass filtered instant video frame, so that the processed output is processed. The image of the area indicated by the preset shape in the instant video frame is an undistorted original image Non-indicated preset shape image region is an image that does not include a high frequency signal, so that after the transfer process In the case of instant video frames, the bandwidth resources required for transmission are reduced, and the transmission efficiency of the instant video is improved, which further satisfies the user's attention to an area in the instant video is greater than that of other areas, and the user's definition of an area. The user experience is enhanced by the requirement that the amount of detail retention is greater than that of other areas and other participants who want the instant video interaction to move the attention to the area specified by the user.

1006. The instant video frame after the transmission process ends.

Specifically, the step is the same as step 305, and details are not described herein again.

It should be noted that, in step 1005 to step 1006, a process of transmitting a current instant video frame including an area indicated by a preset shape according to the first transmission policy, in addition to the manner described in the foregoing steps, may be performed in other manners. The specific manner of the embodiment of the present invention is not limited.

The embodiment of the present invention processes the current instant video frame according to the importance matrix, and the importance matrix indicates the importance metric value of each pixel in the current instant video, thereby processing each pixel point, thereby improving the processing. The picture quality of the instant video further satisfies the user's attention to a certain area in the instant video is greater than other areas, the user's requirement for the clarity and detail retention of a certain area is greater than other areas and the user wants instant video interaction. Other participants have increased the user experience by migrating their attention to the diverse needs of the area specified by the user.

1007. Divide an instant video frame including at least an area indicated by the preset shape into at least one macro block, and set a quantization parameter corresponding to the at least one macro block.

Specifically, the step is the same as step 306, and details are not described herein again.

In the scenario of real-time video interaction, both the interaction parties and the picture quality requirements for the area indicated by the preset shape such as the area where the face is located in the live video are larger than other areas, so that all or part of the The quantization parameter of the macroblock of the area indicated by the shape is a first value. During the encoding process, more details of the area indicated by the preset shape are retained, so that the preset shape can be guaranteed during the instant video process. The picture quality of the area satisfies the user's requirements for the picture details of the area indicated by the preset shape, and further satisfies the user's certain area in the instant video. The domain's attention is greater than other regions, the user's requirements for the clarity of a certain region and the amount of detail retention are greater than other regions and other users who want the instant video interaction to migrate the attention to the diverse needs of the user-specified region. Improve the user experience. In addition, in the scenario of real-time video interaction, the interaction party and the picture quality requirement for the area indicated by the preset shape such as the area where the face is located in the instant video are larger than other areas, so it may be set not to include all or part of The quantization parameter of the macroblock of the area indicated by the preset shape is a second value. During the encoding process, the details of the macroblock not including the area indicated by all or part of the preset shape are not reserved, and the reduction does not include all Or the bandwidth occupied by the macroblock of the area indicated by the partial preset shape during transmission, so that the method requires less bandwidth resources than the traditional instant video transmission method, thereby saving bandwidth resources and improving real-time video. The efficiency of transmission further satisfies the user's attention to a certain area in the instant video is greater than other areas, the user's requirements for the definition of a certain area and the amount of detail retention are greater than other areas and other participants who want the instant video interaction. Increased focus on the diversified needs of the user-specified area Experience. In addition, by setting a quantization parameter of a macroblock including an area indicated by all or part of the preset shape as a first value, setting a quantization parameter of a macroblock not including an area indicated by all or part of the preset shape to a second value, In the encoding process, the details of the area indicated by the preset shape are retained, and the details of the area indicated by the non-preset shape are not preserved, so that the undistorted transmission is performed on the area indicated by the preset shape. Further reducing the bandwidth occupied by the area indicated by the non-preset shape during transmission, so that the method can not only ensure the picture quality of the area indicated by the preset shape but also requires the traditional instant video transmission method. The bandwidth resources are less, which can further save bandwidth resources and improve the efficiency of instant video transmission, further satisfying the user's attention to an area in the instant video is greater than other areas, the user's definition of a certain area and details retention The amount of requirements is greater than other areas and other participants who want instant video interaction will pay attention Migrate to the diverse needs of the region specified by the user, improve the user experience.

1008. Encode at least one macroblock according to the quantization parameter to generate an encoded instant video frame.

Specifically, the step is the same as step 307, and details are not described herein again.

1009. Transmit the encoded instant video frame and end.

Specifically, the step is the same as step 308, and details are not described herein again.

It is to be noted that the steps 1007 to 1009 are a process for transmitting a current instant video frame including an area indicated by a preset shape according to the second transmission policy, and may be performed by other means in addition to the manner described in the foregoing steps. The specific manner of the embodiment of the present invention is not limited.

Optionally, in the actual application, before performing step 1007, step 1005 may also be performed.

1010. Acquire residual data between a current instant video frame and a reference frame including an area indicated by the preset shape.

Specifically, the step is the same as step 309, and details are not described herein again.

1011. Transmit residual data and end.

Specifically, the step is the same as step 310, and details are not described herein again.

It should be noted that, in step 1010 to step 1011, a process of transmitting a current instant video frame including an area indicated by a preset shape according to a third transmission policy is implemented, and other methods than the foregoing steps may be used. The specific manner of the embodiment of the present invention is not limited.

Optionally, in an actual application, at least one of step 1005 and step 1009 may also be performed before step 1010 is performed.

1012. Obtain a feature parameter used to describe an area indicated by the preset shape.

Specifically, the step is the same as step 311, and details are not described herein again.

1013. Transmission characteristic parameters.

Specifically, the step 312 is the same and will not be further described herein.

It should be noted that, in step 1012 to step 1013, a process of transmitting a current instant video frame including an area indicated by a preset shape according to the fourth transmission policy is implemented, and other manners may be used in addition to the manner described in the foregoing steps. The specific manner of the embodiment of the present invention is not limited.

Send selection instructions to other electronic devices.

By sending the selection instruction to other electronic devices, the other electronic devices can display the preset shape indicated by the selection instruction, increase the interactive form of the instant video, and satisfy the diversified needs of the user in the instant video process, and further improve The user experience. In addition, by sending the selection command The data is sent to other electronic devices, and the data of the preset shape is transmitted to other electronic devices, thereby reducing the amount of data during transmission, saving network resources, improving the transmission efficiency of the instant video, and further improving the user experience.

In order to further illustrate the effect achieved by the method provided by the embodiment of the present invention, the method provided by the embodiment of the present invention will be further described below with reference to the accompanying drawings, assuming that the preset shape selected by the user is the shape shown in FIG. After the method of the embodiment of the present invention is performed on the a in FIG. 11 , the generated interface may be referred to b in FIG. 11 . If the position of the user in the screen changes in the instant video interface, the interface may refer to FIG. 11 . As shown in c, in FIG. 11, the sharpness and detail retention indicated by the second display effect are greater than or equal to the sharpness indicated by the first display effect and the amount of detail retention, and the sharpness indicated by the third display effect and The amount of detail retention is less than the sharpness indicated by the first display effect and the amount of detail retention.

In the scenario of the instant video interaction, the method provided by the embodiment of the present invention satisfies the requirement that the user pays more attention to an area in the instant video than other areas, and the user's requirement for the clarity and detail retention of the area is greater than other The region and other participants who want the instant video interaction migrate the attention to the diverse needs of the user-specified area, increasing the interactivity and fun of the instant video, further enhancing the user experience. In addition, since the position of the detail in the area indicated by the preset shape changes, the area indicated by the preset shape is determined in the current instant video frame according to the detail, so that the area indicated by the shape is preset in the instant video frame. In the case where the position of the detail changes, the picture quality of the area in which the detail is located can still be ensured, thereby further satisfying the user's attention to an area in the instant video is greater than that of other areas, and the user is clear about an area. The requirement for degree and detail retention is greater than that of other regions and other participants who want real-time video interaction to migrate attention to the diverse needs of the user-specified region, which increases the interactivity and interest of instant video, further enhancing the user. Experience. For example, the area indicated by the preset shape includes a human face. By performing the method of the embodiment of the present invention, when the position of the face changes, the position of the area indicated by the preset shape also changes with the face. Ensure the picture quality of the area where the face is located.

The embodiment of the invention provides a method for transmitting instant video by determining whether the network bandwidth is full. Any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition, so that the current instant video frame including the area indicated by the preset shape may be according to different network bandwidths Adopting different transmission strategies, compared with the traditional instant video transmission method, not only satisfies the user's attention to an area in the instant video is greater than other areas, the user's definition of a certain area and the amount of detail retention. Greater than other areas and other participants who want instant video interactions to divert attention to the diverse needs of the user-specified area, improve user experience, improve network bandwidth utilization, save network resources, and improve instant The transmission efficiency of the video improves the user experience. In addition, the method of the embodiment of the present invention processes the current instant video frame after acquiring the area indicated by the preset shape from the current instant video frame, so that the current video frame is compared with the traditional Instant video coding method, using more broadband resources for the same bandwidth resources The transmission of the area indicated by the shape is ensured, thereby ensuring the transmission of the area indicated by the preset shape, further satisfying the user's attention to an area in the instant video is greater than other areas, the user's definition of an area, and The requirement for detail retention is greater than other regions and other participants who want instant video interactions to migrate attention to the diverse needs of the user-specified region, improving the user experience. In addition, by determining the area indicated by the preset shape in the current instant video frame according to the details, so that the detail position in the area indicated by the preset shape in the instant video frame changes, the area of the detail can still be guaranteed. The picture quality further satisfies the user's attention to a certain area in the instant video is greater than other areas, the user's requirements for the clarity and detail retention of a certain area are greater than other areas and the user wants instant video interaction. Other participants have moved their attention to the diverse needs of the user-specified area, increasing the interactivity and fun of instant video, further enhancing the user experience.

Embodiment 6 is a method for displaying an instant video according to an embodiment of the present invention. Referring to FIG. 12, in the embodiment of the present invention, a position parameter of a preset shape includes a description parameter, and the description parameter is used to describe an instant video frame. The details in the area indicated by the preset shape selected by the user. Illustratively, if the area indicated by the preset shape selected by the user includes at least a face, the detail may be the eyes, nose, and mouth of the user. Department and eyebrows, etc., the method specifically includes:

1201. Acquire a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy.

Specifically, the step is the same as step 801, and details are not described herein again.

1202: Acquire a user-triggered selection instruction, and the selection instruction is used to indicate a preset shape selected by the user.

Specifically, the step is the same as step 802, and details are not described herein again.

1203. Identify details indicated by the description parameters in the current instant video frame.

Specifically, the step is the same as step 1002, and details are not described herein again.

1204. Display an area indicated by the preset shape in the current instant video frame according to details and a transmission strategy supported by the electronic device.

Based on the coordinates, the area indicated by the preset shape is displayed.

In addition, the area indicated by the preset shape is displayed in the current instant video frame according to the details, and the specific manner is not limited in the embodiment of the present invention.

Since the position of the detail in the area indicated by the preset shape changes, the area indicated by the preset shape is determined in the current instant video frame according to the detail, further satisfying the user's instant view A certain area of the frequency is more concerned than other areas, the user's requirements for the definition of a certain area and the amount of detail retention are greater than other areas and other participants who want the instant video interaction to migrate the attention to the area specified by the user. The diverse needs increase the interactivity and fun of instant video, further enhancing the user experience.

It is to be noted that, in the step 1203 to the step 1204, the process of displaying the current instant video frame according to the selection instruction is implemented. In addition to the manner described in the foregoing steps, the process may be implemented in other manners. The method is not limited.

Since the picture quality of the area indicated by the preset shape in the current instant video frame is superior to other areas, the user attention of the electronic device is migrated to the area indicated by the preset shape in the instant video, thereby satisfying the user pair. The interest in one area of the instant video is greater than that of other areas, the user's definition of the clarity of the area and the amount of detail retention is greater than that of other areas, and other participants who want the instant video interaction to migrate the attention to the user-specified The diverse needs of the region have improved the user experience. In addition, by displaying the preset shape, the user attention of the electronic device can be further migrated to the area indicated by the preset shape in the instant video, thereby satisfying the user's attention to a certain area in the instant video is greater than other areas. The user's requirement for the clarity and detail retention of a certain area is greater than that of other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, thereby improving the user experience. In addition, since the selection instruction includes at least one of a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and a special effect parameter of the preset shape, the display form of the instant video is increased, and the content is further satisfied. The diverse needs of users have improved the user experience. In addition, by displaying the processed current instant video frame according to the details, in a case where the detail position in the area indicated by the preset shape changes in the instant video frame, the user is satisfied in the area indicated by the preset shape. The attention of detail is greater than that of other areas, the clarity of the details of the area indicated by the preset shape, and the amount of detail retention is greater than that of other areas and other participants who wish to have instant video interactions shift the attention to the preset shape. The details of the area further satisfy the user's attention to a certain area in the instant video is greater than other areas, the user's requirements for the definition of a certain area and the amount of detail retention are greater than other areas and users It is hoped that other participants of the instant video interaction will shift the attention to the diverse needs of the user-specified area, increasing the interactivity and interest of the instant video, further enhancing the user experience. In addition, since the position of the detail in the area indicated by the preset shape changes, the area indicated by the preset shape is determined in the current instant video frame according to the detail, so that the area indicated by the shape is preset in the instant video frame. In the case where the position of the detail changes, the picture quality of the area in which the detail is located can still be ensured, thereby further satisfying the user's attention to an area in the instant video is greater than that of other areas, and the user is clear about an area. The requirement for degree and detail retention is greater than that of other regions and other participants who want real-time video interaction to migrate attention to the diverse needs of the user-specified region, which increases the interactivity and interest of instant video, further enhancing the user. Experience. For example, the area indicated by the preset shape includes a human face. By performing the method of the embodiment of the present invention, when the position of the face changes, the position of the area indicated by the preset shape also changes with the face. Ensure the picture quality of the area where the face is located.

If the electronic device does not support the transmission policy corresponding to the current current video frame, the electronic device or the server that sends the instant video frame sends a prompt message to prompt the electronic device not to support the acquired current instant video frame. Corresponding transmission policy, so that the server or the electronic device that sends the instant video frame, after receiving the prompt information, sends a code corresponding to the transmission policy to the electronic device, so that the electronic device configures the code.

In order to further illustrate the effect achieved by the method provided by the embodiment of the present invention, the method provided by the embodiment of the present invention will be further described below with reference to the accompanying drawings, assuming that the preset shape selected by the user is the shape shown in FIG. The interface for obtaining the current instant video frame display after processing may be referred to b in FIG. 13, where a in FIG. 13 is an interface displayed after acquiring the current instant video frame, if the user in the instant video interface occurs in the position in the screen. For the change, the interface may be referred to as c in FIG. 13. In FIG. 13, the sharpness and the detail retention indicated by the second display effect are greater than or equal to the sharpness and detail retention indicated by the first display effect, The sharpness indicated by the three display effects and the amount of detail retention are smaller than the sharpness indicated by the first display effect and the amount of detail retention.

An embodiment of the present invention provides a method for displaying an instant video by acquiring and displaying according to the first The current instant video frame transmitted by any one of the transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy satisfies the fact that the user desires to have greater clarity and detail retention for the selected region than other The needs of the region further enhance the user experience. In addition, by acquiring and displaying the user-triggered selection instruction, the manner in which the user selects the area is increased, and the interaction mode of the user in the instant video interaction process is increased, thereby further satisfying the diversified needs of the user and improving the user experience. In addition, by determining and displaying the area indicated by the preset shape in the current instant video frame according to the details, such that the detail position in the area indicated by the preset shape changes in the instant video frame, the detail can still be guaranteed. The picture quality of the area, which further satisfies the user's attention to an area in the instant video is greater than other areas, the user's requirements for the clarity and detail retention of a certain area are greater than other areas and the user wants instant video. Other participants in the interaction migrated the attention to the diverse needs of the user-specified area, increasing the interactivity and fun of the instant video, further enhancing the user experience.

Embodiment 7 is an electronic device 14 according to an embodiment of the present invention. Referring to FIG. 14, the electronic device 14 includes:

The receiving module 1401 is configured to receive a user-triggered selection instruction, where the selection instruction is used to indicate a preset shape selected by the user;

The first processing module 1403 is configured to determine, in the current instant video frame, an area indicated by the preset shape;

The determining module 1402 is configured to determine whether the network bandwidth meets any one of the first preset condition, the second preset condition, the third preset condition, and the fourth preset condition;

The first processing module 1403 is further configured to trigger any one of the following modules according to a preset condition that the network bandwidth meets and a transmission policy supported by the electronic device:

The second processing module 1404 is configured to: when the network bandwidth meets the first preset condition, transmit, according to the first transmission policy, a current instant video frame that includes an area indicated by the preset shape; or

The third processing module 1405 is configured to: when the network bandwidth meets the second preset condition, transmit the current instant video frame including the area indicated by the preset shape according to the second transmission policy; or

The fourth processing module 1406 is configured to perform, according to the third transmission, when the network bandwidth meets the third preset condition a policy of transmitting a current instant video frame including an area indicated by a preset shape; or

The fifth processing module 1407 is configured to: when the network bandwidth meets the fourth preset condition, transmit the current instant video frame including the area indicated by the preset shape according to the fourth transmission policy.

Optionally, the selection instruction includes at least one of a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and a special effect parameter of the preset shape, where the first processing module is configured to perform the following operations. anyone:

Optionally, the second processing module 1404 is specifically configured to:

The current instant video is processed according to an importance matrix corresponding to the current instant video frame, and the processed instant video frame is obtained;

Transmit processed instant video frames.

Optionally, the second processing module 1404 is specifically configured to:

Obtaining an importance matrix of the area indicated by the preset shape;

According to the importance matrix, the current instant video frame is merged with the filtered current instant video frame to generate a processed current instant video frame.

Optionally, the third processing module 1405 is specifically configured to:

Dividing an instant video frame including at least an area indicated by the preset shape into at least one macro block, and setting a quantization parameter corresponding to the at least one macro block;

Transmit the encoded instant video frame.

Optionally, the third processing module 1405 is specifically configured to:

Setting a quantization parameter of a macroblock including an area indicated by all or part of the preset shape as a first value;

Setting a quantization parameter of a macroblock that does not include an area indicated by all or part of the preset shape as a second value;

The third processing module 1405 is specifically configured to:

And encoding at least one macroblock according to the first value and the second value to generate the encoded current instant video frame.

Optionally, the fourth processing module 146 is specifically configured to:

Obtaining residual data between the current instant video frame and the reference frame including the area indicated by the preset shape;

Transmit residual data.

Optionally, the fourth processing module 146 is specifically configured to:

Normalizing the position parameter and the attitude parameter to generate a standard position parameter and a standard posture parameter;

Obtaining residual data between the current instant video frame and the reference frame including the area indicated by the preset shape according to the standard position parameter and the standard posture parameter.

Optionally, the fourth processing module 146 is specifically configured to:

Transfer feature parameters.

Optionally, the fourth processing module 146 is specifically configured to:

Obtaining at least one posture parameter and a position parameter corresponding to the triangular area;

Optionally, the electronic device further includes a sending module, configured to:

Send selection instructions to other electronic devices.

An embodiment of the present invention provides an electronic device, where the electronic device determines whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition, thereby According to different network bandwidths, different transmission strategies are adopted for the current instant video frames including the area indicated by the preset shape. Compared with the traditional instant video transmission method, the user not only satisfies the user's attention to a certain area in the instant video. The degree is greater than other areas, the user's requirements for the definition of a certain area and the amount of detail retention are greater than other areas and other users who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, improve the user The experience also improves the utilization of the network bandwidth and saves the network resources, thereby improving the transmission efficiency of the instant video and improving the user experience. In addition, the method of the embodiment of the present invention acquires the preset shape from the current instant video frame. After the indicated area, the current instant video frame is processed so that compared to the traditional The instant video coding method uses more broadband resources for the transmission of the area indicated by the preset shape when the bandwidth resource is unchanged, thereby ensuring the transmission of the area indicated by the preset shape, further satisfying the user's The interest in one area of the instant video is greater than that of other areas, the user's definition of the clarity of the area and the amount of detail retention is greater than that of other areas, and other participants who want the instant video interaction to migrate the attention to the user-specified The diverse needs of the region have improved the user experience.

Embodiment 8 is an electronic device 15 according to an embodiment of the present invention. Referring to FIG. 15 , the electronic device 15 includes a sending module 1501 , a memory 1502 , and a processor 1503 connected to the sending module 1501 and the memory 1502 . The memory 1502 . For storing a set of program code, the processor 1503 calls the program code stored in the memory 1502 for performing the following operations:

Determining an area indicated by the preset shape in the current live video frame;

If the network bandwidth meets the first preset condition, transmitting, according to the first transmission policy, a current instant video frame including an area indicated by the preset shape; or

If the network bandwidth meets the second preset condition, the transmission includes the preset shape according to the second transmission policy The current instant video frame of the indicated area; or,

If the network bandwidth meets the third preset condition, transmitting, according to the third transmission policy, a current instant video frame including an area indicated by the preset shape; or

If the network bandwidth meets the fourth preset condition, the current instant video frame including the area indicated by the preset shape is transmitted according to the fourth transmission policy.

Optionally, the selection instruction includes at least one of a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and a special effect parameter of the preset shape, and the processor 1503 calls the program code stored by the memory 1502. Used to do the following:

Optionally, the processor 1503 calls the program code stored in the memory 1502 to perform the following operations:

Transmit processed instant video frames.

Obtaining an importance matrix of the area indicated by the preset shape;

Transmit the encoded instant video frame.

The processor 1503 calls the program code stored in the memory 1502 for performing the following operations:

Transmit residual data.

Optionally, the processor 1503 calls the program code stored in the memory 1502 to perform the following operations. Make:

Transfer feature parameters.

Send selection instructions to other electronic devices.

Embodiment 9 is an electronic device 16 according to an embodiment of the present invention. Referring to FIG. 16, the electronic device 16 includes:

The first obtaining module 1601 is configured to acquire, according to the first transmission policy, the second transmission policy, a current instant video frame transmitted by any one of the third transmission policy and the fourth transmission policy;

a second obtaining module 1602, configured to acquire a user-triggered selection instruction, where the selection instruction is used to indicate a preset shape selected by the user;

The display module 1603 is configured to display the current instant video frame according to the selection instruction and a transmission policy supported by the electronic device.

An embodiment of the present invention provides an electronic device that satisfies and displays a current instant video frame transmitted according to any one of a first transmission policy, a second transmission policy, a third transmission policy, and a fourth transmission policy. In the process of instant video, the user desires to have more clarity and detail retention of the selected area than other areas, further improving the user experience. In addition, by acquiring and displaying the user-triggered selection instruction, the manner in which the user selects the area is increased, and the interaction mode of the user in the instant video interaction process is increased, thereby further satisfying the diversified needs of the user and improving the user experience.

Embodiment 10 is an electronic device 17 according to an embodiment of the present invention. Referring to FIG. 17, the electronic device 17 includes a display 1701, a memory 1702, and a processor 1703 connected to the display 1701 and the memory 1702. The memory 1702 For storing a set of program code, the processor 1703 calls the program code stored in the memory 1702 for performing the following operations:

Obtaining a user-triggered selection instruction, and the selection instruction is used to indicate a preset shape selected by the user;

The current instant video frame is displayed according to the selection instruction and the transmission policy supported by the electronic device.

An embodiment of the present invention provides an electronic device that satisfies and displays a current instant video frame transmitted according to any one of a first transmission policy, a second transmission policy, a third transmission policy, and a fourth transmission policy. In the process of instant video, the user desires to have more clarity and detail retention of the selected area than other areas, further improving the user experience. In addition, by obtaining and displaying the user-triggered selection instruction, the manner in which the user selects the area is increased, the interaction mode of the user in the instant video interaction process is increased, and the diversified needs of the user are further satisfied, and the use is improved. User experience.

It is to be noted that the interface in the embodiment of the present invention is merely exemplary, and is a further description of the method provided by the embodiment of the present invention. The specific embodiment of the present invention does not limit the specific interface. .

All of the above optional technical solutions may be used in any combination to form an optional embodiment of the present invention, and will not be further described herein.

It should be noted that, when the electronic device provided by the foregoing embodiment performs the encoding of the instant video, only the division of the above functional modules is illustrated. In actual applications, the function distribution may be completed by different functional modules as needed. The internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the method for transmitting the instant video provided by the foregoing embodiment is the same as the embodiment of the electronic device, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.

A person skilled in the art can understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be executed by a program to instruct related hardware, and the program may be stored in a computer readable storage medium. The storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalents, improvements, etc., which are within the spirit and scope of the present invention, should be included in the scope of the present invention. Inside.

Claims

A method for transmitting an instant video, characterized in that the method comprises:

Receiving a user-triggered selection instruction, the selection instruction is used to indicate a preset shape selected by the user;

Determining an area indicated by the preset shape in a current instant video frame;

Perform any of the following operations based on the preset conditions that the network bandwidth meets and the transmission policies supported by the electronic device:

If the network bandwidth meets the first preset condition, transmitting the current instant video frame including the area indicated by the preset shape according to the first transmission policy; or

If the network bandwidth meets the second preset condition, transmitting, according to the second transmission policy, the current instant video frame including the area indicated by the preset shape; or

If the network bandwidth meets the third preset condition, transmitting, according to the third transmission policy, the current instant video frame that includes the area indicated by the preset shape; or

If the network bandwidth meets the fourth preset condition, transmitting the current instant video frame including the area indicated by the preset shape according to the fourth transmission policy.
The method according to claim 1, wherein the selection instruction comprises a size parameter of the preset shape, a position parameter of the preset shape, a frame parameter of the preset shape, and the preset shape At least one of the effect parameters determines an area indicated by the preset shape in the current instant video frame by any one of the following operations:

The position parameter of the preset shape includes a coordinate parameter, and determining, according to the coordinate parameter, an area indicated by the preset shape in a current instant video frame; or

The position parameter of the preset shape includes a description parameter, and the details indicated by the description parameter are identified in the current instant video frame;

According to the details, an area indicated by the preset shape is determined in the current instant video frame.
The method according to claim 1 or 2, wherein the transmitting the current instant video frame including the area indicated by the preset shape according to the first transmission policy comprises:

And processing the current instant video according to an importance matrix corresponding to the current instant video frame, and acquiring the processed instant video frame;

Transmitting the processed instant video frame.
The method according to claim 3, wherein the processing the current instant video according to the importance matrix corresponding to the current instant video frame, and acquiring the processed instant video frame comprises:

Obtaining an importance matrix of the area indicated by the preset shape;

Performing low-pass filtering on the current instant video frame to obtain the filtered current instant video frame;

And merging the current instant video frame with the filtered current instant video frame according to the importance matrix to generate the processed current instant video frame.
The method according to any one of claims 1 to 4, wherein the transmitting the current instant video frame policy including the area indicated by the preset shape according to the second transmission policy comprises:

Dividing an instant video frame including at least an area indicated by the preset shape into at least one macro block, and setting a quantization parameter corresponding to the at least one macro block;

Encoding the at least one macroblock according to the quantization parameter to generate an encoded instant video frame;

Transmitting the encoded instant video frame.
The method of claim 5 wherein:

The setting the quantization parameter corresponding to the at least one macro block includes:

Setting a quantization parameter of a macroblock including all or part of the area indicated by the preset shape as a first value;

Setting a quantization parameter of a macroblock that does not include all or part of the area indicated by the preset shape as a second value;

Encoding the at least one macroblock according to the quantization parameter, and generating the encoded The video frame includes:

And encoding the at least one macroblock according to the first value and the second value to generate an encoded current instant video frame.
The method according to any one of claims 1 to 6, wherein the transmitting the current instant video frame including the area indicated by the preset shape according to the third transmission policy comprises:

Acquiring residual data between the current instant video frame and the reference frame including the area indicated by the preset shape;

Transmitting the residual data.
The method according to claim 7, wherein the obtaining the residual data between the current instant video frame and the reference frame including the region indicated by the preset shape comprises:

Obtaining a position parameter and a posture parameter of the area indicated by the preset shape;

Normalizing the position parameter and the posture parameter to generate a standard position parameter and a standard posture parameter;

Obtaining residual data between the current instant video frame and the reference frame including the region indicated by the preset shape according to the standard position parameter and the standard posture parameter.
The method according to claim 1, wherein the transmitting the current instant video frame including the area indicated by the preset shape according to the fourth transmission policy comprises:

Obtaining a feature parameter for describing an area indicated by the preset shape;

Transmitting the feature parameters.
The method according to claim 9, wherein the acquiring the feature parameters for describing the area indicated by the preset shape comprises:

Triangulating the area indicated by the preset shape to obtain at least one triangular area;

Acquiring the attitude parameter and the position parameter corresponding to the at least one triangular area;

And generating the feature parameter according to the posture parameter and the position parameter corresponding to the at least one triangular region.
The method according to any one of claims 1 to 10, wherein the method further comprises:

The selection instruction is sent to other electronic devices.
A method for displaying an instant video, the method comprising:

Obtaining a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy;

Obtaining a user-triggered selection instruction, the selection instruction is used to indicate a preset shape selected by the user;

The current instant video frame is displayed according to the selection instruction and a transmission policy supported by the electronic device.
An electronic device, comprising:

a receiving module, configured to receive the user-triggered selection instruction, where the selection instruction is used to indicate a preset shape selected by the user;

a first processing module, configured to determine an area indicated by the preset shape in a current instant video frame;

a determining module, configured to determine whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition;

The first processing module is further configured to trigger any one of the following modules according to a preset condition that the network bandwidth meets and a transmission policy supported by the electronic device:

a second processing module, configured to: when the network bandwidth meets the first preset condition, transmit the current instant video frame that includes the area indicated by the preset shape according to the first transmission policy; or

a third processing module, configured to: when the network bandwidth meets the second preset condition, transmit the current instant video frame that includes the area indicated by the preset shape according to the second transmission policy; or

a fourth processing module, configured to: when the network bandwidth meets the third preset condition, transmit the current instant video frame that includes the area indicated by the preset shape according to the third transmission policy; or

And a fifth processing module, configured to: when the network bandwidth meets the fourth preset condition, transmit the current instant video frame including the area indicated by the preset shape according to the fourth transmission policy.
An electronic device, comprising:

a first acquiring module, configured to acquire, according to the first transmission policy, the second transmission policy, a current transmission video frame transmitted by any of the three transmission policies and the fourth transmission policy;

a second acquiring module, configured to acquire a user-triggered selection instruction, where the selection instruction is used to indicate a preset shape selected by the user;

And a display module, configured to display the current instant video frame according to the selection instruction and a transmission policy supported by the electronic device.