CN105163125A

CN105163125A - Real-time video coding method and electronic equipment

Info

Publication number: CN105163125A
Application number: CN201510346189.4A
Authority: CN
Inventors: 武俊敏
Original assignee: Zhang Ying Information Technology Co Ltd Of Us
Current assignee: Zhang Ying Information Technology Co Ltd Of Us
Priority date: 2015-06-19
Filing date: 2015-06-19
Publication date: 2015-12-16

Abstract

The invention discloses a real-time video coding method and electronic equipment, and belongs to the field of video. The real-time video coding method comprises the steps of acquiring the shape of user input; determining an area indicated by the shape in a current real-time video frame; processing the current real-time video frame which at least comprises the area according to an importance matrix of the area indicated by the shape if the network bandwidth meets a preset condition, and acquiring a processed current real-time video frame; and sending the processed current real-time video frame. According to the invention, processing is carried out on the current real-time video frame which at least comprises the area indicated by the shape of the user input according to the importance matrix of the area, the processed current real-time video frame is acquired, diversified requirements of users in the real-time video process are met, and the user experience is improved.

Description

A kind of coding method of instant video and electronic equipment

Technical field

The present invention relates to video field, particularly a kind of coding method of instant video and electronic equipment.

Background technology

Universal along with mobile device and instant video mechanics of communication, increasing user's Selection utilization mobile device realizes the mutual of instant video, under the scene of instant video interactive, may occur that the attention rate of user to a certain region in instant video is greater than other regions; Or, there will be the requirement of user to the definition in a certain region and details reserved and be greater than other regions; Or, there will be user and wish that attention rate is migrated to the problems such as the region specified by user by mutual other participants of instant video, make the coding method needing to provide a kind of instant video, meet that the attention rate of user to a certain region in instant video is greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video.

Because prior art does not provide the coding method of this instant video, thus make user in instant video process, the diversified demand that user is above-mentioned cannot be met, reduce Consumer's Experience.

Summary of the invention

In order to meet the diversified demand of user in instant video process, improving Consumer's Experience, the invention discloses a kind of coding method and electronic equipment of instant video.Described technical scheme is as follows:

First aspect, provides a kind of coding method of instant video, and described method comprises:

Obtain the shape of user's input;

The region indicated by described shape is determined in current instant video frame;

If the network bandwidth meets pre-conditioned, then the importance matrix in the region indicated by described shape, processes the described current instant video frame in the region comprised indicated by described shape, obtains the current instant video frame after process;

Send the current instant video frame after described process.

In conjunction with first aspect, in the implementation that the first is possible, the shape of described acquisition user input comprises:

Obtain the curve of described user input, the partial trace that described Curves comprises is closed curve, and determines that the shape indicated by described closed curve is the shape that described user inputs;

Obtain the location parameter of described user input, described location parameter comprises any one in coordinate parameters and characteristic parameter.

In conjunction with the first possible implementation of first aspect, in the implementation that the second is possible, by any one in following operation, in current instant video frame, determine the region indicated by described shape:

Described location parameter comprises coordinate parameters, according to described coordinate parameters, determines the region indicated by described shape in current instant video frame; Or,

Described location parameter comprises characteristic parameter, identifies the details indicated by described characteristic parameter in described current instant video frame;

According to described details, in current instant video frame, determine the region indicated by described shape.

In conjunction with the implementation that the second of first aspect is possible, in the implementation that the third is possible, the importance matrix in described region indicated by described shape, process the described current instant video frame in the region comprised indicated by described shape, the current instant video frame obtained after process comprises:

Obtain the importance matrix in the region indicated by described shape;

Low-pass filtering is carried out to described current instant video frame, obtains filtered current instant video frame;

According to described importance matrix, described current instant video frame and described filtered current instant video frame are merged, generates the current instant video frame after described process.

In conjunction with the third possible implementation of first aspect or first aspect, in the 4th kind of possible implementation, described method also comprises:

Send the shape of described user input.

Second aspect, provide a kind of display packing of instant video, the method comprises:

Obtain the current instant video frame after process;

Show the current instant video frame after described process;

Wherein, current instant video frame after described process is in the shape obtaining user's input, and the network bandwidth meet pre-conditioned after, the importance matrix in the region indicated by described shape, to the described current instant video frame in the region comprised indicated by described shape carry out process obtain.

In conjunction with second aspect, in the implementation that the first is possible, described method also comprises:

Obtain the shape of described user input;

Show the shape of described user input.

In conjunction with the first possible implementation of second aspect, in the implementation that the second is possible,

Obtain the location parameter of described user input, described location parameter comprises any one in coordinate parameters and characteristic parameter;

By any one in following operation, show the current instant video frame after described process:

Described location parameter comprises described coordinate parameters, according to described coordinate parameters, shows the current instant video frame after described process; Or,

Described location parameter comprises described characteristic parameter, identifies the details indicated by described characteristic parameter in current instant video frame after the treatment;

According to described details, show the current instant video frame after described process.

The third aspect, provides a kind of electronic equipment, and described electronic equipment comprises:

Acquisition module, for obtaining the shape of user's input;

First processing module, for determining the region indicated by described shape in current instant video frame;

Second processing module, for when the network bandwidth meets pre-conditioned, the importance matrix in the region indicated by described shape, processes the described current instant video frame in the region comprised indicated by described shape, obtains the current instant video frame after process;

Sending module, for sending the current instant video frame after described process.

In conjunction with the third aspect, in the implementation that the first is possible, described acquisition module specifically for:

In conjunction with the first possible implementation of the third aspect, in the implementation that the second is possible, described first processing module is specifically for performing any one in following operation:

According to described details, in described current instant video frame, determine the region indicated by described shape.

In conjunction with the implementation that the second of the third aspect is possible, in the implementation that the third is possible, described second processing module specifically for:

Obtain the importance matrix in the region indicated by described shape;

In conjunction with the third possible implementation of the third aspect or the third aspect, in the 4th kind of possible implementation, described sending module also for:

Send the shape of described user input.

Fourth aspect, provide a kind of electronic equipment, the processor that this electronic equipment comprises display screen, sending module, memory and is connected with described display screen, described sending module, described memory, described memory is for storing batch processing code, and described processor calls program code that described memory stores for performing following operation:

Obtain the shape that user inputs on described display screen;

If the network bandwidth meets pre-conditioned, then the importance matrix in the region indicated by described shape, processes the described current instant video frame in the region comprised indicated by described shape, obtain the current instant video frame after process;

Control sending module sends the current instant video frame after described process.

In conjunction with fourth aspect, in the implementation that the first is possible, described processor calls program code that described memory stores for performing following operation:

Obtain the curve that described user inputs on described display screen, the partial trace that described Curves comprises is closed curve, and determines that the shape indicated by described closed curve is the shape that described user inputs;

Obtain the location parameter that described user inputs on described display screen, described location parameter comprises any one in coordinate parameters and characteristic parameter.

In conjunction with the first possible implementation of fourth aspect, in the implementation that the second is possible, described processor calls program code that described memory stores for performing any one in following operation:

In conjunction with the implementation that the second of fourth aspect is possible, in the implementation that the third is possible, described processor calls program code that described memory stores for performing following operation:

Obtain the importance matrix in the region indicated by described shape;

In conjunction with the third possible implementation of fourth aspect or fourth aspect, in the 4th kind of possible implementation, described processor calls program code that described memory stores for performing following operation:

Control described sending module and send the shape that described user inputs on described display screen.

5th aspect, provides a kind of electronic equipment, and this electronic equipment comprises:

Acquisition module, for obtaining the current instant video frame after process;

Display module, for showing the current instant video frame after described process;

In conjunction with the 5th aspect, in the implementation that the first is possible,

Described acquisition module is also for shape that described user inputs;

Described display module is also for showing the shape of described user input.

In conjunction with the first possible implementation of the 5th aspect, in the implementation that the second is possible,

6th aspect, provide a kind of electronic equipment, the processor that this electronic equipment comprises display screen, memory and is connected with described display screen and described memory, described memory is for storing batch processing code, and described processor calls program code that described memory stores for performing following operation:

Obtain the current instant video frame after process;

Control described display screen show described process after current instant video frame;

In conjunction with the 6th aspect, in the implementation that the first is possible, described processor calls program code that described memory stores also for performing following operation:

Obtain the shape of described user input;

Control the shape that described display screen shows described user input.

By any one in following operation, control described display screen show described process after current instant video frame:

Described location parameter comprises described coordinate parameters, controls described display screen according to described coordinate parameters, shows the current instant video frame after described process; Or,

Control described display screen according to described details, show the current instant video frame after described process.

The invention discloses a kind of coding method and electronic equipment of instant video, comprising: the shape obtaining user's input; The region indicated by this shape is determined in current instant video frame; If the network bandwidth meets pre-conditioned, then the importance matrix in the region indicated by this shape, processes the current instant video frame at least comprising this region, obtains the current instant video frame after process; Current instant video frame after transmission processing.By the importance matrix in the region indicated by the shape that inputs according to user, the current instant video frame in region indicated by the shape at least comprising user's input is processed, obtain the current instant video frame after process, meet the demand that user in instant video process wishes to be greater than the definition in selected region and details reserved other regions, further increase Consumer's Experience.In addition, by obtaining the shape of user's input, and determine the region indicated by this shape, add the form of user input area, improve the mutual interest of instant video and interactivity, add the interaction mode of user in instant video interactive process, meet the diversified demand of user further, improve Consumer's Experience.In addition, due to pre-conditioned by judging whether the network bandwidth meets, so when decision network bandwidth is low, instant video is processed, not only can improve the utilance of the network bandwidth, save Internet resources, improve the efficiency of transmission of instant video, can also when the network bandwidth be low, meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, further increase Consumer's Experience.

Accompanying drawing explanation

In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, below the accompanying drawing used required in describing embodiment is briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.

Fig. 1 is the coding method flow chart of a kind of instant video that the embodiment of the present invention provides;

Fig. 2 is a kind of instant video display packing flow chart that the embodiment of the present invention provides;

Fig. 3 is the coding method flow chart of a kind of instant video that the embodiment of the present invention provides;

Fig. 4 is a kind of interface schematic diagram that the embodiment of the present invention provides;

Fig. 5 is a kind of interface schematic diagram that the embodiment of the present invention provides;

Fig. 6 is a kind of interface schematic diagram that the embodiment of the present invention provides;

Fig. 7 is a kind of interface schematic diagram that the embodiment of the present invention provides;

Fig. 8 is a kind of instant video display packing flow chart that the embodiment of the present invention provides;

Fig. 9 is a kind of interface schematic diagram that the embodiment of the present invention provides;

Figure 10 is the coding method flow chart of a kind of instant video that the embodiment of the present invention provides;

Figure 11 is a kind of interface schematic diagram that the embodiment of the present invention provides;

Figure 12 is a kind of instant video display packing flow chart that the embodiment of the present invention provides;

Figure 13 is a kind of interface schematic diagram that the embodiment of the present invention provides;

Figure 14 is a kind of electronic devices structure schematic diagram that the embodiment of the present invention provides;

Figure 15 is a kind of electronic devices structure schematic diagram that the embodiment of the present invention provides;

Figure 16 is a kind of electronic devices structure schematic diagram that the embodiment of the present invention provides;

Figure 17 is a kind of electronic devices structure schematic diagram that the embodiment of the present invention provides.

Embodiment

For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.

Embodiments provide a kind of coding method of instant video, the method is used for a kind of interactive system at least comprising two electronic equipments, wherein, in this interactive system, these at least two electronic equipments realize the mutual of instant video by running the application program self stored, electronic equipment at least comprises transmission/reception module, video input module and there is the display module of touch controllable function, this video input module comprises camera, display module can comprise display screen, electronic equipment realizes transmission and the reception of instant video by transmission/reception module, the input of instant video is realized by video input module, realize the display of instant video by the display module with touch controllable function and obtain the instruction of user's triggering.

It should be noted that above-mentioned interactive system is only exemplary, being the method provided to further illustrate the embodiment of the present invention, not refering in particular to, the embodiment of the present invention is not limited concrete interactive system.

The coding method of a kind of instant video that embodiment one provides for the embodiment of the present invention, shown in figure 1, the method specifically comprises:

101, the shape of user's input is obtained.

Concrete, obtain the curve of user's input, the partial trace that Curves comprises is closed curve;

Determine that the shape indicated by closed curve is the shape that user inputs;

Obtain the location parameter of user's input, location parameter comprises any one in coordinate parameters and characteristic parameter.

102, in current instant video frame, determine the region indicated by this shape.

Concrete, by any one in following operation, in current instant video frame, determine the region indicated by this shape:

Location parameter comprises coordinate parameters, according to coordinate parameters, determines the region indicated by the shape that user inputs in current instant video frame; Or,

Location parameter comprises characteristic parameter, the details in current instant video frame indicated by recognition feature parameter;

According to details, in current instant video frame, determine the region indicated by shape.

If 103 network bandwidths meet pre-conditioned, then the importance matrix in the region indicated by this shape, processes the current instant video frame at least comprising this region, obtains the current instant video frame after process.

Concrete, obtain the importance matrix in the region indicated by shape;

Low-pass filtering is carried out to current instant video frame, obtains filtered current instant video frame;

According to importance matrix, current instant video frame and filtered current instant video frame are merged, the current instant video frame after generating process.

104, the current instant video frame after transmission processing.

Can also comprise:

Send the shape of user's input.

Embodiments provide a kind of coding method of instant video, by the importance matrix in the region indicated by the shape that inputs according to user, the current instant video frame in region indicated by the shape at least comprising user's input is processed, obtain the current instant video frame after process, meet the demand that user in instant video process wishes to be greater than the definition in selected region and details reserved other regions, further increase Consumer's Experience.In addition, by obtaining the shape of user's input, and determine the region indicated by this shape, add the form of user input area, improve the mutual interest of instant video and interactivity, add the interaction mode of user in instant video interactive process, meet the diversified demand of user further, improve Consumer's Experience.In addition, due to pre-conditioned by judging whether the network bandwidth meets, so when decision network bandwidth is low, instant video is processed, not only can improve the utilance of the network bandwidth, save Internet resources, improve the efficiency of transmission of instant video, can also when the network bandwidth be low, meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, further increase Consumer's Experience.

The display packing of a kind of instant video that embodiment two provides for the embodiment of the present invention, with reference to shown in Fig. 2, the method comprises:

201, the current instant video frame after process is obtained.

202, obtain the location parameter of user's input, location parameter comprises any one in coordinate parameters and characteristic parameter.

203, the current instant video frame after Graphics Processing.

Concrete, by any one in following operation, the current instant video frame after Graphics Processing:

Location parameter comprises coordinate parameters, according to coordinate parameters, and the current instant video frame after Graphics Processing; Or,

Location parameter comprises characteristic parameter, the details in current instant video frame after treatment indicated by recognition feature parameter;

According to details, the current instant video frame after Graphics Processing.

Optionally, can also comprise:

Obtain the shape of user's input;

The shape of display user input.

Wherein, current instant video frame after process is in the shape obtaining user's input, and the network bandwidth meet pre-conditioned after, the importance matrix in the region indicated by this shape, to the current instant video frame in the region comprised indicated by this shape carry out process obtain.

Embodiments provide a kind of display packing of instant video, by obtaining and showing the importance matrix in region indicated by the shape of user's input, the current instant video frame in the region at least comprised indicated by this shape is processed, current instant video frame after the process obtained, meet the demand that user in instant video process wishes to be greater than the definition in selected region and details reserved other regions, further increase Consumer's Experience.In addition, by obtain and show user input shape, add the interaction mode of user in instant video interactive process, meet the diversified demand of user further, improve Consumer's Experience.

The coding method of a kind of instant video that embodiment three provides for the embodiment of the present invention, in embodiments of the present invention, location parameter comprises coordinate parameters, and with reference to shown in Fig. 3, the method comprises:

301, obtain the curve of user's input, the partial trace that this Curves comprises is closed curve.

Concrete, obtain the curve that user inputs at least one frame instant video frame, wherein, the process obtaining the partial trace corresponding with this any frame instant video frame of any frame instant video frame input of user in this at least one frame instant video frame can be:

The location parameter of multiple partial trace that all frame instant video frames of acquisition user before this any frame instant video frame input and the plurality of partial trace, this location parameter comprises at least one in coordinate parameters and characteristic parameter;

According to the location parameter of multiple partial trace, the plurality of partial trace is copied to this any frame instant video frame;

Obtain the partial trace corresponding with this any frame instant video frame of any frame instant video frame input of user in this at least one frame instant video frame;

Obtain the location parameter of this partial trace of user's input.

By obtaining the shape of user's input, the shape making it possible to input according to user determines the region indicated by user, compared to the region determined by other means indicated by user, this process simplify operating procedure, improve the efficiency of transmission of instant video, meet the attention rate of user to a certain region in instant video further and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, improve Consumer's Experience, in addition, by obtaining the shape of user's input, and determine the region indicated by this shape, add the form of user input area, meet that the attention rate of user to a certain region in instant video is greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions further and user wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, improve Consumer's Experience.

Method described in the embodiment of the present invention is further understood in order to make those skilled in the art, below in conjunction with accompanying drawing, the method described in the embodiment of the present invention is further described, suppose that instant video interface is with reference to shown in a in Fig. 4, the curve that user inputs at this interface is with reference to shown in the b in Fig. 4.

Optionally, the curve obtaining user's input if detect does not comprise closed curve, be then used to indicate to user's display the information that user at least inputs closed curve.

Wherein, can a little whether to comprise an identical point according to the Curves of composition user input and judge whether the curve obtaining user's input comprises closed curve.

This information can be Word message, exemplary, and this Word message can be for: " curve that you input does not comprise closed curve, please again inputs ".

302, determine that the shape indicated by closed curve is the shape that user inputs.

Concrete, the embodiment of the present invention is not limited concrete deterministic process.

By determining that the shape indicated by closed curve is the shape that user inputs, add the form of user input area, meet that the attention rate of user to a certain region in instant video is greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions further and user wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, improve Consumer's Experience.

Suppose that curve that user inputs is with reference to shown in the b in Fig. 4, then determine shape indicated by closed curve for the shape that user inputs then can with reference to shown in Fig. 5.

303, obtain the location parameter of user's input, location parameter comprises coordinate parameters.

Concrete, this coordinate parameters is the coordinate parameters of the geometric center of the shape that user inputs.

The embodiment of the present invention is not limited concrete determination mode.

It should be noted that step 301 to step 303 is the processes realizing the shape obtaining user's input, except the mode described in above-mentioned steps, can also realize this process by other means, the embodiment of the present invention is not limited concrete mode.

By obtaining the shape of user's input, add the form of user input area, improve the mutual interest of instant video and interactivity, meet that the attention rate of user to a certain region in instant video is greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions further and user wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, improve Consumer's Experience.

304, in current instant video frame, determine the region indicated by the shape that user inputs.

Concrete, according to coordinate parameters, in current instant video frame, determine the region indicated by the shape that user inputs;

This process can be:

At least one point indicated by this coordinate parameters is determined in current instant video frame;

At least one point that shape that this at least one point is this input comprises centroid is set.

305, judge whether the network bandwidth meets pre-conditioned, if so, then perform step 306, if not, then terminate.

Concrete, judge the size between the network bandwidth and preset value, the embodiment of the present invention is not limited concrete judgment mode.

If the network bandwidth is greater than or equal to preset value, then perform step 306;

If the network bandwidth is less than preset value, then terminate.

Wherein, in actual applications, preset value can be 100kb/s.

Optionally, due to the unsteadiness of network bandwidth during Internet Transmission, so whether the mean value of the network bandwidth meets pre-conditioned in the preset time period before can judging current time, if so, then perform step 306; If not, then terminate.

Wherein, in actual applications, preset time period can be 0.2 second.

By judging whether the mean value of the network bandwidth in the preset time period between current time meets pre-conditioned, eliminates the unsteadiness of network bandwidth during Internet Transmission, ensure that and the reliability that instant video is encoded improve Consumer's Experience.

Due to pre-conditioned by judging whether the network bandwidth meets, so when decision network bandwidth is low, instant video is processed, not only can improve the utilance of the network bandwidth, save Internet resources, improve the efficiency of transmission of instant video, can also when the network bandwidth be low, meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, further increase Consumer's Experience.

306, the importance matrix in the region indicated by this shape is obtained.

Concrete, the importance measures value of all pixels in current instant video frame is set; The importance measures value arranging all pixels in the region indicated by this shape is the first numerical value; The importance measures value arranging all pixels in the region in current instant video indicated by non-shape is second value; Wherein, the first numerical value is set and is greater than second value, and the value of this importance measures value between zero and one.

Low-pass filtering treatment is carried out to the region indicated by this shape, the current instant video frame after generating process.

According to the importance measures value of all pixels in the current instant video frame after process, generate the importance matrix corresponding with current instant video frame.

Because the embodiment of the present invention processes current instant video frame according to importance matrix, and importance matrix indicates the importance measures value of each pixel in current instant video, thus each pixel is processed, improve the image quality of the instant video after process, meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, further increase Consumer's Experience.

307, low-pass filtering is carried out to current instant video frame, obtain filtered current instant video frame.

Concrete, low-pass filtering carried out to current instant video frame identical in the process of the region indicated by shape being carried out to low-pass filtering, or else repeated herein.

By carrying out low-pass filtering to current instant video, eliminate the high-frequency signal in this current instant video, reduce the bandwidth resources shared by current instant video, not only can improve the efficiency of transmission of instant video, also meet that the attention rate of user to a certain region in instant video is greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, further increase Consumer's Experience.

308, according to importance matrix, current instant video frame and filtered current instant video frame are merged, the current instant video frame after generating process.

Concrete, according to filtered current instant video frame, current instant video frame and importance matrix, obtain the instant video frame after process.

By the generating algorithm preset, on the basis of importance matrix, can merge current instant video frame and filtered current instant video frame, obtain the instant video frame after process, this algorithm can be:

O u t = \partial * s r c + (1 - \partial) * l o w

Wherein, out is the instant video frame after process, and src is current instant video frame, and low is filtered current instant video frame, for importance matrix.

Because importance matrix indicates the region in instant video frame indicated by this shape and the region indicated by this shape non-, so, by importance matrix, region indicated by shape indicated by importance matrix is retained, utilize the region indicated by non-shape in the replacement of the region indicated by the non-shape instant video frame in the instant video frame after low-pass filtering, the image making the region in the instant video frame after the process exported indicated by shape is distortionless original image, the image in the region indicated by this shape non-is the image not comprising high-frequency signal, thus when making the instant video frame after transmitting this process, bandwidth resources required when not only reducing transmission, improve the efficiency of transmission of instant video, meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, further increase Consumer's Experience.

It should be noted that, step 306 to step 308 is the importance matrixes in the region realized indicated by this shape, the current instant video frame at least comprising this region is processed, obtain the process of the current instant video frame after process, except the mode described in above-mentioned steps, can also realize this process by other means, the embodiment of the present invention is not limited concrete mode.

By inputting the importance matrix in the region indicated by shape according to user, the current instant video frame at least comprising region is processed, obtain the current instant video frame after process, the image quality in the instant video after processing in this region is made to be better than other regions, thus meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, further increase Consumer's Experience.

309, the current instant video frame after transmission processing.

Concrete, the embodiment of the present invention is not limited concrete send mode.

Can also comprise:

310, the shape of user's input is sent.

By sending the shape of user's input, making other electronic equipments can show the shape of this user input, adding the interactive form of instant video, meet the diversified demand of user in instant video process, further increase Consumer's Experience.

The effect that the method provided to further illustrate the embodiment of the present invention reaches, below in conjunction with sending out figure, the method that the embodiment of the present invention provides is further illustrated, suppose that the shape that user inputs is the shape shown in Fig. 6, after method described in the embodiment of the present invention is performed to a in Fig. 7, the interface generated can with reference to shown in the b in Fig. 7, in the figure 7, definition indicated by second display effect and details reserved are greater than or equal to definition indicated by the first display effect and details reserved, definition indicated by 3rd display effect and details reserved are less than definition indicated by the first display effect and details reserved.

Under the scene of instant video interactive, the method that the embodiment of the present invention provides meets that the attention rate of user to a certain region in instant video is greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, add interactivity and the interest of instant video, further increase Consumer's Experience.

The display packing of a kind of instant video that embodiment four provides for the embodiment of the present invention, in embodiments of the present invention, location parameter comprises coordinate parameters, and with reference to shown in Fig. 8, the method comprises:

801, the current instant video frame after process is obtained.

Concrete, electronic equipment can receive the current instant video frame after the process of other electronic equipments transmission, also the shape of user's input can be obtained at this electronic equipment, and the network bandwidth meet pre-conditioned after, the importance matrix in the region indicated by the shape of user's input, the current instant video frame at least comprising region is processed, after obtaining the current instant video frame after process, obtains the instant video frame after this process.

802, obtain the location parameter of user's input, location parameter comprises coordinate parameters.

Concrete, electronic equipment can receive the location parameter that other electronic equipments send, and also can obtain the location parameter of user's input at this electronic equipment.

803, the current instant video frame after Graphics Processing.

Concrete, according to coordinate parameters, the current instant video frame after Graphics Processing;

Because the image quality in the region in the current instant video frame after process indicated by the shape that inputs is better than other regions, thus meet the region indicated by shape user's attention rate of this electronic equipment being migrated to and input in instant video, thus meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, improve Consumer's Experience.

Optionally, can also comprise:

804, the shape of user's input is obtained.

Concrete, electronic equipment can receive the shape of user's input that other electronic equipments send, and also can obtain the shape of user's input at this electronic equipment.

805, the shape of user's input is shown.

Concrete, the embodiment of the present invention is not limited concrete display mode.

By the shape of display user input, user's attention rate of this electronic equipment can be realized to migrate to the region indicated by shape of user's input in instant video further, thus meet that the attention rate of user to a certain region in instant video is greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, improve Consumer's Experience.

In the embodiment of the present invention, current instant video frame after process is in the shape obtaining user's input, and the network bandwidth meet pre-conditioned after, the importance matrix in the region indicated by this shape, to the current instant video frame in the region comprised indicated by this shape carry out process obtain, wherein, the process obtaining the current instant video frame after process can realize on other electronic equipments, also can realize on this electronic equipment.

The effect that the method provided to further illustrate the embodiment of the present invention reaches, below in conjunction with sending out figure, the method that the embodiment of the present invention provides is further illustrated, suppose that the shape that user-selected fixed user inputs is the shape shown in Fig. 6, the interface obtaining the current instant video frame display after process can with reference to shown in the b in Fig. 9, a in Fig. 9 is the interface shown after obtaining current instant video frame, in fig .9, definition indicated by second display effect and details reserved are greater than or equal to definition indicated by the first display effect and details reserved, definition indicated by 3rd display effect and details reserved are less than definition indicated by the first display effect and details reserved.

The coding method of a kind of instant video that embodiment five provides for the embodiment of the present invention, in embodiments of the present invention, the location parameter of the shape of user's input comprises characteristic parameter, this characteristic parameter for user-selected fixed user input in instant video frame described shape indicated by details in region, exemplary, if at least comprise face in region indicated by the shape of user-selected fixed user input, then this details can be the eyes of user, nose, mouth and eyebrow etc., with reference to shown in Figure 10, the method comprises:

1001, obtain the curve of user's input, the partial trace that Curves comprises is closed curve.

Concrete, this step is identical with step 301, is or else repeated herein.

1002, determine that the shape indicated by closed curve is the shape that user inputs.

Concrete, this step is identical with step 302, is or else repeated herein.

1003, obtain the location parameter of user's input, location parameter comprises characteristic parameter.

Concrete, this step is identical with step 303, is or else repeated herein.

It should be noted that step 1001 to step 1003 is the processes realizing the shape obtaining user's input, except the mode described in above-mentioned steps, can also realize this process by other means, the embodiment of the present invention is not limited concrete process.

By obtaining the shape of user's input, add the form that user inputs indicated region, improve the mutual interest of instant video and interactivity, meet that the attention rate of user to a certain region in instant video is greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions further and user wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, improve Consumer's Experience.

1004, the details in current instant video frame indicated by recognition feature parameter.

Concrete, obtain the characteristic parameter of all characteristic points in current instant video frame;

The similarity obtained between characteristic parameter included in characteristic parameter and selection instruction is greater than or equal to all characteristic points of predetermined threshold value;

Determine the details of details indicated by characteristic parameter that this all characteristic point forms.

The attention rate of user to a certain region in instant video is greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, that other regions are greater than to the attention rate of the details in this region, other regions are greater than to the definition of the details in this region and the requirement of details reserved and wish that attention rate is migrated to the details in the region specified by user by mutual other participants of instant video, by the details in current instant video frame indicated by recognition feature parameter, meet the attention rate of user to the details in this region and be greater than other regions, other regions are greater than to the definition of the details in this region and the requirement of details reserved and wish that attention rate is migrated to the diversified demand of the details in the region specified by user by mutual other participants of instant video.

1005, according to details, in current instant video frame, the region indicated by shape is determined.

Concrete, the coordinate of the characteristic point of this this details of composition is set to the coordinate of the point in the region that user inputs indicated by shape.

In addition, can also by other means, realize according to details, in current instant video frame, determine that user inputs the region indicated by shape, the embodiment of the present invention be limited concrete mode.

The position of the details in the region indicated by the shape that user inputs can change, so determine the region indicated by the shape that user inputs according to details in current instant video frame, further meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, add interactivity and the interest of instant video, further increase Consumer's Experience.

It should be noted that, step 1004 to step 1005 is the processes realizing determining the region indicated by the shape that user inputs in current instant video frame, except the mode described in above-mentioned steps, can also realize this process by other means, the embodiment of the present invention is not limited concrete mode.

By the details in current instant video frame indicated by recognition feature parameter, and according to details, the region indicated by the shape that user inputs is determined in current instant video frame, details position in the region indicated by shape of user's input in instant frame of video changes, meet the attention rate of user to the details in the region indicated by the shape of input and be greater than other regions, other regions are greater than to the definition of details in region indicated by the shape of input and the requirement of details reserved and wish that attention rate is migrated to the details in the region indicated by shape of input by mutual other participants of instant video, thus meet the attention rate of user to a certain region in instant video further and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, add interactivity and the interest of instant video, further increase Consumer's Experience.

1006, judge whether the network bandwidth meets pre-conditioned, if so, then perform step 1007, if not, then terminate.

Concrete, this step is identical with step 305, is or else repeated herein.

Optionally, due to the unsteadiness of network bandwidth during Internet Transmission, so whether the mean value of the network bandwidth meets pre-conditioned in the preset time period before can judging current time, if so, then perform step 1007; If not, then terminate.

Wherein, in actual applications, preset time period can be 0.2 second.

1007, the importance matrix in the region indicated by this shape is obtained.

Concrete, this step is identical with step 306, is or else repeated herein.

1008, low-pass filtering is carried out to current instant video frame, obtain filtered current instant video frame.

Concrete, this step is identical with step 307, is or else repeated herein.

1009, according to importance matrix, current instant video frame and filtered current instant video frame are merged, the current instant video frame after generating process.

Concrete, this step is identical with step 308, is or else repeated herein.

It should be noted that, step 1007 to step 1008 is the importance matrixes in the region realized indicated by this shape, the current instant video frame at least comprising region is processed, obtain the process of the current instant video frame after process, except the mode described in above-mentioned steps, can also realize this process by other means, the embodiment of the present invention is not limited concrete mode.

1010, the current instant video frame after transmission processing.

Concrete, this step is identical with step 309, is or else repeated herein.

Can also comprise:

1011, the shape of user's input is sent.

Concrete, this step is identical with step 310, is or else repeated herein.

Other electronic equipments are sent to by the shape this user inputted, make other electronic equipments can show the shape of this user input, add the interactive form of instant video, meet the diversified demand of user in instant video process, further increase Consumer's Experience.

The effect that the method provided to further illustrate the embodiment of the present invention reaches, below in conjunction with sending out figure, the method that the embodiment of the present invention provides is further illustrated, suppose that the shape that user inputs is the shape shown in Fig. 6, after method described in the embodiment of the present invention is performed to a in Figure 11, the interface generated can with reference to shown in the b in Figure 11, if the position of the user in instant video interface in picture changes, then interface can with reference to shown in the c in Figure 11, in fig. 11, definition indicated by second display effect and details reserved are greater than or equal to definition indicated by the first display effect and details reserved, definition indicated by 3rd display effect and details reserved are less than definition indicated by the first display effect and details reserved.

Embodiments provide a kind of coding method of instant video, by the importance matrix in the region indicated by the shape that inputs according to user, the current instant video frame in region indicated by the shape at least comprising user's input is processed, obtain the current instant video frame after process, meet the demand that user in instant video process wishes to be greater than the definition in selected region and details reserved other regions, further increase Consumer's Experience.In addition, by obtaining the shape of user's input, and determine the region indicated by this shape, add the form of user input area, improve the mutual interest of instant video and interactivity, add the interaction mode of user in instant video interactive process, meet the diversified demand of user further, improve Consumer's Experience.In addition, due to pre-conditioned by judging whether the network bandwidth meets, so when decision network bandwidth is low, instant video is processed, not only can improve the utilance of the network bandwidth, save Internet resources, improve the efficiency of transmission of instant video, can also when the network bandwidth be low, meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, further increase Consumer's Experience.In addition, by the details in current instant video frame indicated by recognition feature parameter, and according to details, the region indicated by shape inputted is determined in current instant video frame, details position in region indicated by the shape inputted in instant frame of video changes, meet the attention rate of user to the details in the region indicated by the shape of input and be greater than other regions, other regions are greater than to the definition of details in region indicated by the shape of input and the requirement of details reserved and wish that attention rate is migrated to the details in the region indicated by shape of input by mutual other participants of instant video, thus meet the attention rate of user to a certain region in instant video further and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, add interactivity and the interest of instant video, further increase Consumer's Experience.

The display packing of a kind of instant video that embodiment six provides for the embodiment of the present invention, in embodiments of the present invention, the location parameter of the shape of user's input comprises characteristic parameter, this characteristic parameter for user-selected fixed user input in instant video frame described shape indicated by details in region, exemplary, if at least comprise face in region indicated by the shape of user-selected fixed user input, then this details can be the eyes of user, nose, mouth and eyebrow etc., with reference to shown in Figure 12, the method comprises:

1201, the current instant video frame after process is obtained.

Concrete, this step is identical with step 801, is or else repeated herein.

1202, obtain the location parameter of user's input, location parameter comprises characteristic parameter.

Concrete, this step is identical with step 802, is or else repeated herein.

1203, the details in current instant video frame after treatment indicated by recognition feature parameter.

Concrete, this step is identical with step 1004, is or else repeated herein.

1204, according to details, the current instant video frame after Graphics Processing.

Concrete, the coordinate of the characteristic point of this this details of composition is set to the coordinate of the point in the region indicated by shape inputted.

According to this coordinate, the current instant video frame after Graphics Processing.

In addition, can also by other means, realize according to details, determine in current instant video frame and show user input the region indicated by shape, the embodiment of the present invention is not limited concrete mode.

It should be noted that, step 1203 to step 1204 is processes of the current instant video frame after realizing Graphics Processing, except the mode described in above-mentioned steps, can also realize this process by other means, the embodiment of the present invention is not limited concrete mode.

The image quality in the region indicated by the shape that user in the current instant video frame after process inputs is better than other regions, thus meet the region indicated by shape user's attention rate of this electronic equipment being migrated to and input in instant video, thus meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, improve Consumer's Experience.

Optionally, can also comprise:

1205, the shape of user's input is obtained.

Concrete, this step is identical with step 804, is or else repeated herein.

1206, the shape of user's input is shown.

Concrete, this step is identical with step 805, is or else repeated herein.

The effect that the method provided to further illustrate the embodiment of the present invention reaches, below in conjunction with sending out figure, the method that the embodiment of the present invention provides is further illustrated, suppose that the shape that user-selected fixed user inputs is the shape shown in Fig. 6, the interface obtaining the current instant video frame display after process can with reference to shown in the b in Figure 13, a in Figure 13 is the interface shown after obtaining current instant video frame, if the position of the user in instant video interface in picture changes, then interface can with reference to shown in the c in Figure 13, in fig. 13, definition indicated by second display effect and details reserved are greater than or equal to definition indicated by the first display effect and details reserved, definition indicated by 3rd display effect and details reserved are less than definition indicated by the first display effect and details reserved.

Embodiments provide a kind of display packing of instant video, by obtaining and showing the importance matrix in region indicated by the shape of user's input, the current instant video frame in the region at least comprised indicated by this shape is processed, current instant video frame after the process obtained, meet the demand that user in instant video process wishes to be greater than the definition in selected region and details reserved other regions, further increase Consumer's Experience.In addition, by obtain and show user input shape, add the interaction mode of user in instant video interactive process, meet the diversified demand of user further, improve Consumer's Experience.In addition, by the details in current instant video frame indicated by recognition feature parameter, and according to details, the region indicated by shape inputted is determined in current instant video frame, details position in region indicated by the shape inputted in instant frame of video changes, meet the attention rate of user to the details in the region indicated by the shape of input and be greater than other regions, other regions are greater than to the definition of details in region indicated by the shape of input and the requirement of details reserved and wish that attention rate is migrated to the details in the region indicated by shape of input by mutual other participants of instant video, thus meet the attention rate of user to a certain region in instant video further and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, add interactivity and the interest of instant video, further increase Consumer's Experience.

A kind of electronic equipment 14 that embodiment seven provides for the embodiment of the present invention, with reference to shown in Figure 14, this electronic equipment 14 comprises:

Acquisition module 1401, for obtaining the shape of user's input;

First processing module 1402, for determining the region indicated by shape in current instant video frame;

Second processing module 1403, for when the network bandwidth meets pre-conditioned, the importance matrix in the region indicated by shape, processes the current instant video frame in the region comprised indicated by shape, obtains the current instant video frame after process;

Sending module 1404, for the current instant video frame after transmission processing.

Optionally, acquisition module 1401 specifically for:

Obtain the curve of user's input, the partial trace that Curves comprises is closed curve, and determines that the shape indicated by closed curve is the shape that user inputs;

Optionally, the first processing module 1402 is specifically for performing any one in following operation:

Location parameter comprises coordinate parameters, according to coordinate parameters, determines the region indicated by shape in current instant video frame; Or,

Optionally, the second processing module 1403 specifically for:

Obtain the importance matrix in the region indicated by shape;

Optionally, sending module 1404 also for:

Send the shape of user's input.

Embodiments provide a kind of electronic equipment, this electronic equipment is by the importance matrix in the region indicated by the shape of user's input, the current instant video frame in region indicated by the shape at least comprising user's input is processed, obtain the current instant video frame after process, meet the demand that user in instant video process wishes to be greater than the definition in selected region and details reserved other regions, further increase Consumer's Experience.In addition, by obtaining the shape of user's input, and determine the region indicated by this shape, add the form of user input area, improve the mutual interest of instant video and interactivity, add the interaction mode of user in instant video interactive process, meet the diversified demand of user further, improve Consumer's Experience.In addition, due to pre-conditioned by judging whether the network bandwidth meets, so when decision network bandwidth is low, instant video is processed, not only can improve the utilance of the network bandwidth, save Internet resources, improve the efficiency of transmission of instant video, can also when the network bandwidth be low, meet the attention rate of user to a certain region in instant video and be greater than other regions, the requirement of user to the definition in a certain region and details reserved is greater than other regions and user and wishes that attention rate is migrated to the diversified demand in the region specified by user by mutual other participants of instant video, further increase Consumer's Experience.

A kind of electronic equipment 15 that embodiment eight provides for the embodiment of the present invention, with reference to shown in Figure 15, electronic equipment 15 comprise display screen 1501, sending module 1502, memory 1503 and with display screen 1501, send mould 1502 pieces, processor 1504 that memory 1503 is connected, memory 1503 is for storing batch processing code, and processor 1504 calls program code that memory 1503 stores for performing following operation:

Obtain the shape that user inputs on described display screen;

The region indicated by shape is determined in current instant video frame;

If the network bandwidth meets pre-conditioned, then the importance matrix in the region indicated by shape, processes the current instant video frame in the region comprised indicated by shape, obtain the current instant video frame after process;

Control the current instant video frame after sending module transmission processing.

Optionally, processor 1504 calls program code that memory 1503 stores for performing following operation:

Obtain the curve that user inputs on described display screen, the partial trace that Curves comprises is closed curve, and determines that the shape indicated by closed curve is the shape that user inputs;

Obtain the location parameter that user inputs on described display screen, location parameter comprises any one in coordinate parameters and characteristic parameter.

Optionally, processor 1504 calls program code that memory 1503 stores for performing any one in following operation:

Obtain the importance matrix in the region indicated by shape;

A kind of electronic equipment 16 that embodiment nine provides for the embodiment of the present invention, with reference to shown in Figure 16, electronic equipment 16 comprises:

Acquisition module 1601, for obtaining the current instant video frame after process;

Display module 1602, for the current instant video frame after Graphics Processing;

Wherein, current instant video frame after process is in the shape obtaining user's input, and the network bandwidth meet pre-conditioned after, the importance matrix in the region indicated by shape, to the described current instant video frame in the region comprised indicated by shape carry out process obtain.

Optionally,

Acquisition module 1601 is also for the shape of user's input;

Display module 1602 is also for showing the shape of user's input.

Optionally,

Obtain the location parameter of user's input, location parameter comprises any one in coordinate parameters and characteristic parameter;

By any one in following operation, the current instant video frame after Graphics Processing:

Embodiments provide a kind of electronic equipment, this electronic equipment is by obtaining and showing the importance matrix in region indicated by the shape of user's input, the current instant video frame in the region at least comprised indicated by this shape is processed, current instant video frame after the process obtained, meet the demand that user in instant video process wishes to be greater than the definition in selected region and details reserved other regions, further increase Consumer's Experience.In addition, by obtain and show user input shape, add the interaction mode of user in instant video interactive process, meet the diversified demand of user further, improve Consumer's Experience.

A kind of electronic equipment 17 that embodiment ten provides for the embodiment of the present invention, with reference to shown in Figure 17, the processor 1703 that this electronic equipment 17 comprises display screen 1701, memory 1702 and is connected with display screen 1701 and memory 1702, memory 1702 is for storing batch processing code, and processor 1703 calls program code that memory 1702 stores for performing following operation:

Obtain the current instant video frame after process;

Control the current instant video frame after described display screen Graphics Processing;

Optionally, processor 1703 calls program code that memory 1702 stores also for performing following operation:

Obtain the shape of user's input;

Control the shape of described display screen display user input.

Optionally,

By any one in following operation, control the current instant video frame after described display screen Graphics Processing:

Location parameter comprises coordinate parameters, controls described display screen according to coordinate parameters, the current instant video frame after Graphics Processing; Or,

Control described display screen according to details, the current instant video frame after Graphics Processing.

It should be noted that the interface described in the embodiment of the present invention is only exemplary, be that the method in order to provide the embodiment of the present invention is further described, not refer in particular to herein, the embodiment of the present invention is not limited concrete interface.

Above-mentioned all alternatives, can adopt and combine arbitrarily formation optional embodiment of the present invention, this is no longer going to repeat them.

It should be noted that: the electronic equipment that above-described embodiment provides is when carrying out the coding of instant video, only be illustrated with the division of above-mentioned each functional module, in practical application, can distribute as required and by above-mentioned functions and be completed by different functional modules, internal structure by equipment is divided into different functional modules, to complete all or part of function described above.In addition, the coding/decoding method embodiment of the electronic equipment that above-described embodiment provides and instant video belongs to same design, and its specific implementation process refers to embodiment of the method, repeats no more here.

One of ordinary skill in the art will appreciate that all or part of step realizing above-described embodiment can have been come by hardware, the hardware that also can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium mentioned can be read-only memory, disk or CD etc.The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims

1. a coding method for instant video, is characterized in that, described method comprises:

Obtain the shape of user's input;

Send the current instant video frame after described process.

2. method according to claim 1, is characterized in that, the shape of described acquisition user input comprises:

3. method according to claim 2, is characterized in that, by any one in following operation, determines the region indicated by described shape in current instant video frame:

4. method according to claim 3, it is characterized in that, the importance matrix in described region indicated by described shape, processes the described current instant video frame in the region comprised indicated by described shape, and the current instant video frame obtained after process comprises:

Obtain the importance matrix in the region indicated by described shape;

5., according to the arbitrary described method of Claims 1-4, it is characterized in that, described method also comprises:

Send the shape of described user input.

6. an instant video display packing, is characterized in that, described method comprises:

Obtain the current instant video frame after process;

Show the current instant video frame after described process;

7. method according to claim 6, is characterized in that, described method also comprises:

Obtain the shape of described user input;

Show the shape of described user input.

8. method according to claim 7, is characterized in that,

9. an electronic equipment, is characterized in that, described electronic equipment comprises:

Acquisition module, for obtaining the shape of user's input;

10. an electronic equipment, is characterized in that, described electronic equipment comprises: