CN110381353A

CN110381353A - Video scaling method, apparatus, server-side, client and storage medium

Info

Publication number: CN110381353A
Application number: CN201910696677.6A
Authority: CN
Inventors: 尹小玉; 杨德兴
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2019-07-30
Filing date: 2019-07-30
Publication date: 2019-10-25
Anticipated expiration: 2039-07-30
Also published as: CN110381353B

Abstract

The disclosure is about a kind of video scaling method, apparatus, server-side, client and storage medium.Scheme includes: that server-side obtains video to be processed, and the video frame of video to be processed includes caption information；Calculate subtitle ratio value of the caption information of video to be processed on multiple preset directions；Multiple subtitle ratio values are sent to client.Client zooms in and out processing to the video frame of video to be processed, determines target video frame when multiple subtitle ratio values are all larger than equal to preset ratio threshold value.Using the technical solution that the embodiment of the present disclosure provides, solve when video frame to be full of to the screen of equipment, video frame includes that caption information is completely or partially cut, and leads to the problem of video-see effect difference.

Description

Video scaling method, apparatus, server-side, client and storage medium

Technical field

This disclosure relates to technical field of video processing more particularly to a kind of video scaling method, apparatus, server-side, client End and storage medium.

Background technique

Currently, when playing video, for the feeling of immersion for improving video playing, equipment uniform zoom video frame, so that scaling Video frame afterwards is full of the screen of equipment.

However, the screen of distinct device, the ratio of width to height of screen is different.The ratio of width to height of video frame and the ratio of width to height of screen It is not necessarily equal.If the ratio of width to height of video frame and the ratio of width to height of screen are unequal, then uniform zoom video frame, after making scaling When video frame is full of the screen of equipment, it is necessarily required to cut video frame, the video frame area of cutting accounts for the total face of video frame Long-pending ratio is up to 17%.Based on this, if video frame includes caption information, caption information is likely to all or part of cropped Fall, causes video-see effect poor.

Summary of the invention

The disclosure provides a kind of video scaling method, apparatus, server-side, client and storage medium, at least to solve When video frame is full of the screen of equipment, video frame includes that caption information is completely or partially cut, and video-see is caused to be imitated The problem of fruit difference.The technical solution of the disclosure is as follows:

According to the first aspect of the embodiments of the present disclosure, a kind of video scaling method is provided, server-side is applied to, comprising:

Video to be processed is obtained, the video frame of the video to be processed includes caption information；

Calculate subtitle ratio value of the caption information of the video to be processed on multiple preset directions；

Multiple subtitle ratio values are sent to client, so that the client is equal in multiple subtitle ratio values When more than or equal to preset ratio threshold value, processing is zoomed in and out to the video frame of the video to be processed, determines target video frame, institute State target video frame on multiple preset directions length and the client screen on multiple preset directions Length it is identical.

Optionally, subtitle ratio value of the caption information for calculating the video to be processed on multiple preset directions, Including；

For each video frame of the video to be processed, determine caption information that the video frame includes respectively with it is multiple pre- The distance between frame on set direction obtains multiple subtitle distances；

The smallest subtitle distance is selected from the corresponding multiple subtitle distances of the frame on each preset direction, it is pre- as this The corresponding frame distance of frame on set direction；

Calculate each frame distance length with the video frame of the video to be processed on corresponding preset direction respectively Ratio, obtain the subtitle ratio value on each preset direction.

Optionally, each video frame of the video to be processed includes multiple caption informations, the determination video frame packet The caption information included respectively with the distance between the frame on multiple preset directions, obtain multiple subtitles apart from the step of, comprising:

For each caption information of the video frame, according to text box where the caption information on multiple preset directions Position coordinates and length determine that the caption information with the distance between the frame on multiple preset directions, obtains multiple words respectively Curtain distance.

Optionally, the origin of the video frame of the video to be processed is the picture in the video frame upper left corner of the video to be processed Vegetarian refreshments, position coordinates of the text box on preset direction include text box upper left where the caption information where each caption information Coordinates of targets of the pixel at angle on preset direction, length of the text box on preset direction includes where each caption information Target length of the text box on preset direction where the caption information；

The position coordinates and length according to text box where the caption information on multiple preset directions, determine the word Curtain information respectively with the distance between each frame on multiple preset directions, obtain multiple subtitles apart from the step of, comprising:

Coordinates of targets of the text box where the caption information on each preset direction is determined as the caption information and be somebody's turn to do Subtitle distance between frame on preset direction；Or

The difference of length and target and value of the video frame of the video to be processed on each preset direction is determined as Subtitle distance between frame on the caption information and the preset direction, the target and value are text where the caption information Coordinates of targets and target length of the frame on the preset direction and value.

According to the second aspect of an embodiment of the present disclosure, a kind of video scaling method is provided, client is applied to, comprising:

Receive subtitle ratio value of the caption information for the video to be processed that server-side is sent on multiple preset directions；

Judge whether multiple subtitle ratio values are all larger than equal to preset ratio threshold value；

If so, zoom in and out processing to the video frame of the video to be processed, first object video frame is determined, described Screen length phase on multiple preset directions of the one target video frame in length and the client on multiple preset directions Together.

Optionally, the subtitle ratio value is length of the video frame of frame distance and video to be processed on preset direction Ratio, frame distance be frame on caption information and preset direction that the video frame of the video to be processed includes it Between distance in minimum value.

Optionally, the video frame to the video to be processed zooms in and out processing, determines the step of first object video Suddenly, comprising:

Judge whether the depth-width ratio of the video frame of the video to be processed is greater than the depth-width ratio of the screen；

If so, the video frame of video to be processed described in uniform zoom, obtains the first scaling video frame, first scaling The width of video frame is of same size with the screen；Described first is cut out in the short transverse of the first scaling video frame Scaling video frame obtains the first sub-goal video frame, the height and the height phase of the screen of the first sub-goal video frame Together；

If it is not, the then video frame of video to be processed described in uniform zoom, obtains the second scaling video frame, second scaling The height of video frame is identical as the height of the screen；Described second is cut out in the width direction of the second scaling video frame Scaling video frame obtains the second sub-goal video frame, the width phase of the width and the screen of the second sub-goal video frame Together.

Optionally, the method also includes:

The preset direction includes the width direction of the video frame of the video to be processed, if the multiple subtitle ratio value Middle to there is the subtitle ratio value for being less than the preset ratio threshold value, then the video frame of video to be processed described in uniform zoom, determines Second target video frame, the width of the second target video frame are of same size with the screen；

The preset direction includes the short transverse of the video frame of the video to be processed, if the multiple subtitle ratio value Middle to there is the subtitle ratio value for being less than the preset ratio threshold value, then the video frame of video to be processed described in uniform zoom, determines The height of third target video frame, the third target video frame is identical as the height of the screen.

Optionally, the video frame of video to be processed described in the uniform zoom, the step of determining the second target video frame, packet It includes:

The video frame of video to be processed described in uniform zoom, obtains third scaling video frame, the third scaling video frame Width and the screen it is of same size；It is the third scaling video in the short transverse of the third scaling video frame Frame splices the first comment box, obtains the second target video frame, the height of the second target video frame and the height of the screen It is identical；

The video frame of video to be processed described in the uniform zoom, the step of determining third target video frame, comprising:

The video frame of video to be processed described in uniform zoom, obtains the 4th scaling video frame, the 4th scaling video frame Height it is identical as the height of the screen；It is the 4th scaling video in the width direction of the 4th scaling video frame Frame splices the second comment box, obtains third target video frame, the width of the third target video frame and the width of the screen It is identical.

According to the third aspect of an embodiment of the present disclosure, a kind of video scaling device is provided, server-side is applied to, comprising:

Module is obtained, is configured as executing acquisition video to be processed, the video frame of the video to be processed includes subtitle letter Breath；

Computing module is configured as executing word of the caption information for calculating the video to be processed on multiple preset directions Curtain ratio value；

Sending module is configured as execution for the multiple subtitle ratio value and is sent to client, so that the client When the multiple subtitle ratio value is all larger than equal to preset ratio threshold value, the video frame of the video to be processed is zoomed in and out Processing determines that target video frame, length of the target video frame on the preset direction and the screen of the client exist Length on the preset direction is identical.

Optionally, the computing module is configured as specifically executing:

Optionally, each video frame of the video to be processed includes multiple caption informations, and the computing module is configured Specifically to execute:

The computing module is configured as specifically executing:

According to a fourth aspect of embodiments of the present disclosure, a kind of video scaling device is provided, client is applied to, comprising:

Receiving module is configured as executing the caption information for receiving the video to be processed that server-side is sent in multiple default sides Upward subtitle ratio value；

Judgment module is configured as execution and judges whether multiple subtitle ratio values are all larger than equal to preset ratio threshold Value；

Zoom module is configured as executing in the case where the judging result of the judgment module, which is, is, to described wait locate The video frame of reason video zooms in and out processing, determines first object video frame, the first object video frame is in multiple default sides Upward length is identical as length of the screen of the client on multiple preset directions.

Optionally, the Zoom module is configured as specifically executing:

If it is not, the then video frame of video to be processed described in uniform zoom, obtains the second scaling video frame, second scaling The height of video frame is identical as the height of the screen；Described first is cut out in the width direction of the second scaling video frame Scaling video frame obtains the second sub-goal video frame, the width phase of the width and the screen of the second sub-goal video frame Together.

Optionally, the Zoom module is configured as also executing:

Optionally, the Zoom module is configured as specifically executing:

The preset direction includes the width direction of the video frame of the video to be processed, view to be processed described in uniform zoom The video frame of frequency, obtains third scaling video frame, and the width of the third scaling video frame is of same size with the screen；? It is that the third scaling video frame splices the first comment box in the short transverse of the third scaling video frame, obtains the second target The height of video frame, the second target video frame is identical as the height of the screen；

The preset direction includes the short transverse of the video frame of the video to be processed, view to be processed described in uniform zoom The video frame of frequency, obtains the 4th scaling video frame, and the height of the 4th scaling video frame is identical as the height of the screen；? It is that the 4th scaling video frame splices the second comment box in the width direction of the 4th scaling video frame, obtains third target Video frame, the width of the third target video frame are of same size with the screen.

According to a fifth aspect of the embodiments of the present disclosure, a kind of server-side is provided, comprising:

Processor；

For storing the memory of the processor-executable instruction；

Wherein, described in any of the above embodiments applied to service to realize the processor is configured to executing described instruction The video scaling method at end.

According to a sixth aspect of an embodiment of the present disclosure, a kind of client is provided, comprising:

Processor；

For storing the memory of the processor-executable instruction；

Wherein, described in any of the above embodiments applied to client to realize the processor is configured to executing described instruction The video scaling method at end.

According to the 7th of embodiment of the present disclosure aspect, provide a kind of storage medium, when the instruction in the storage medium by When the processor of electronic equipment executes, so that electronic equipment executes the video scaling described in any of the above embodiments applied to server-side Method.

According to the eighth aspect of the embodiment of the present disclosure, provide a kind of storage medium, when the instruction in the storage medium by When the processor of electronic equipment executes, so that electronic equipment executes the video scaling described in any of the above embodiments applied to client Method.

According to the 9th of the embodiment of the present disclosure the aspect, a kind of computer program product is provided, computer program product is by electricity When the processor of sub- equipment executes, so that the electronic equipment realizes that the video described in any of the above embodiments applied to server-side contracts Put method.

According to the tenth of the embodiment of the present disclosure the aspect, a kind of computer program product is provided, computer program product is by electricity When the processor of sub- equipment executes, so that the electronic equipment realizes that the video described in any of the above embodiments applied to client contracts Put method.

The embodiment of the present disclosure provide technical solution at least bring it is following the utility model has the advantages that

In the embodiment of the present disclosure, server-side is provided with preset direction, and preset direction is the screen that video frame is full of to client When curtain, the direction of caption information may be cropped.Server-side calculates the caption information of video to be processed in multiple preset directions On subtitle ratio value, and be sent to client.After client gets multiple subtitle ratio values, however, it is determined that multiple subtitle ratios Value is all larger than equal to preset ratio threshold value, then can determine that edge of the caption information apart from video frame is farther out on preset direction, will Video frame is full of the screen of client, when cutting to video frame, will not crop what video frame included on preset direction Caption information zooms in and out processing to the video frame of video to be processed, determines target video frame.Wherein, target video frame is pre- Length on set direction is identical as length of the screen of client on preset direction.This avoids crop on preset direction Caption information is solved when video frame to be full of to the screen of equipment, and video frame includes that caption information is completely or partially cropped Fall, leads to the problem of video-see effect difference.

It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not The disclosure can be limited.

Detailed description of the invention

The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure Example, and together with specification for explaining the principles of this disclosure, do not constitute the improper restriction to the disclosure.

Fig. 1 a-c is a kind of schematic diagram of video frame shown according to an exemplary embodiment.

Fig. 2 is a kind of schematic diagram that video frame shown in Fig. 1 a is full of screen.

Fig. 3 is a kind of block diagram of video scaling system shown according to an exemplary embodiment.

Fig. 4 is a kind of flow chart of video scaling method shown according to an exemplary embodiment.

Fig. 5 is the flow chart of another video scaling method shown according to an exemplary embodiment.

Fig. 6 is the flow chart of another video scaling method shown according to an exemplary embodiment.

Fig. 7 is the schematic diagram of another video frame shown according to an exemplary embodiment.

Fig. 8 is the flow chart of another video scaling method shown according to an exemplary embodiment.

Fig. 9 is the flow chart of another video scaling method shown according to an exemplary embodiment.

Figure 10 a-e is a kind of schematic diagram that video frame shown according to an exemplary embodiment is full of screen.

Figure 11 is the flow chart of another video scaling method shown according to an exemplary embodiment.

Figure 12 a-d is a kind of schematic diagram that video frame shown according to an exemplary embodiment is full of screen.

Figure 13 is a kind of signaling diagram of video scaling shown according to an exemplary embodiment.

Figure 14 is a kind of video scaling device block diagram shown according to an exemplary embodiment.

Figure 15 is another video scaling device block diagram shown according to an exemplary embodiment.

Figure 16 is a kind of block diagram of server-side shown according to an exemplary embodiment.

Figure 17 is a kind of block diagram of client shown according to an exemplary embodiment.

Specific embodiment

In order to make ordinary people in the field more fully understand the technical solution of the disclosure, below in conjunction with attached drawing, to this public affairs The technical solution opened in embodiment is clearly and completely described.

It should be noted that the specification and claims of the disclosure and term " first " in above-mentioned attached drawing, " Two " etc. be to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that using in this way Data be interchangeable under appropriate circumstances, so as to embodiment of the disclosure described herein can in addition to illustrating herein or Sequence other than those of description is implemented.Embodiment described in following exemplary embodiment does not represent and disclosure phase Consistent all embodiments.On the contrary, they are only and as detailed in the attached claim, the disclosure some aspects The example of consistent device and method.

Currently, to improve the viewing effect of user, uniform zoom video frame, the video frame after making scaling is full of the screen of equipment Curtain.When video frame to be full of to the screen of equipment, need to cut video frame, it is total that the video frame area of cutting accounts for video frame The ratio of area is up to 17%.Based on this, if video frame includes caption information, caption information is likely to all or part of cropped Fall, causes video-see effect poor.

It include caption information a in the video frame for example, video frame as shown in Figure 1a "A012345678901234567890123B".Video frame as shown in Figure 1 b includes caption information b in the video frame " A0123456789B " and caption information c " C012D ".Video frame as illustrated in figure 1 c includes caption information d in the video frame " EabcdefghiF " and caption information e " S0T ".It is illustrated for scheming video frame shown in Fig. 1 a.Equipment uniform zoom view Frequency frame makes the video frame be full of the screen of equipment, as shown in Figure 2.Video frame needs to cut out the view after the screen full of equipment The partial region of frequency frame, cut out areas as shown in Figure 2, at this point, having punctured the part of character A and character B in caption information a Part, cause video-see effect poor.

To solve when video frame to be full of to the screen of equipment, video frame includes that caption information is completely or partially cropped Fall, lead to the problem of video-see effect difference, the embodiment of the present disclosure provides a kind of video scaling system.As shown in figure 3, the view Frequency panntographic system includes server-side 301 and client 302.Wherein, client 302 is the electronic equipment with screen, for example, objective Family end 302 can be the mobile devices such as mobile phone, tablet computer, or PC (Personal computer, PC) etc. Equipment.

Based on above-mentioned video scaling system, the embodiment of the present disclosure provides a kind of video scaling method.As shown in figure 4, Fig. 4 It is a kind of flow chart of video scaling method shown according to an exemplary embodiment.The video scaling method is applied to such as Fig. 3 Shown in server-side 301, include the following steps.

In step S401, video to be processed is obtained, the video frame of video to be processed includes caption information.

When a certain video of client terminal playing, the video request for being directed to the video is sent to server-side.Server-side is receiving After video request, the video is obtained as video to be processed.Video to be processed includes multiple video frames.

In the embodiment of the present disclosure, at least one video frame of video to be processed includes caption information, and video frame can be with Including one or more caption informations.Video frame as shown in Figure 1a includes a caption information, as shown in fig. 1b and fig. lc Video frame includes multiple caption informations.Each caption information includes one or more characters.

In step S402, subtitle ratio value of the caption information of video to be processed on multiple preset directions is calculated.

Wherein, preset direction is that when video frame is full of the screen of client, may crop the direction of caption information. Preset direction can be set according to actual needs.Multiple preset directions may include the video frame of video to be processed a left side, It is right, above and/or under direction.The left and right both direction of the video frame of video to be processed belongs to the width of the video frame of video to be processed Spend direction.The upper and lower both direction of the video frame of video to be processed belongs to the short transverse of the video frame of video to be processed.

In one example, if video frame includes a caption information, it can be arranged based on the orientation of caption information Preset direction, the orientation of caption information are the orientation that caption information includes character.For example, as shown in Figure 1a, word The orientation of curtain information a is horizontal direction, the i.e. width direction of video frame, then can determine and be in the width direction of video frame The direction of caption information may be cropped when video frame is full of the screen of client, preset direction can be set to video frame Left and right both direction.For another example video frame includes a caption information, the orientation of caption information is vertical direction, i.e., The short transverse of video frame, then can determine may when the short transverse of video frame is that video frame is full of the screen of client The direction of caption information can be cropped, preset direction can be set to the upper and lower both direction of video frame.

In another example, if video frame includes a plurality of caption information, if a plurality of caption information includes orientation It is the caption information of width direction for the caption information of short transverse and orientation, then can determines in the height side of video frame To the direction that may crop caption information when with width direction being the screen by video frame full of client, preset direction Can be set to include video frame left and right, upper and lower four direction.For example, as illustrated in figure 1 c, the arrangement side of caption information d To the width direction for video frame, the orientation of caption information e is the short transverse of video frame, and preset direction can be set to Left and right, upper and lower four direction including video frame.

If the orientation of a plurality of caption information is width direction, it can determine that in the width direction of video frame be to incite somebody to action Video frame may crop the direction of caption information when being full of the screen of client, preset direction can be set to include video The left and right both direction of frame.For example, as shown in Figure 1 b, the width of the equal video frame of the orientation of caption information b and caption information c Spend direction, then preset direction can be set to include video frame width direction.

If the orientation of a plurality of caption information is short transverse, it can determine that in the short transverse of video frame be to incite somebody to action Video frame may crop the direction of caption information when being full of the screen of client, preset direction can be set to include video The upper and lower both direction of frame.

Subtitle ratio value of the caption information on preset direction can be default at this with video to be processed according to subtitle distance The ratio of length on direction determines.Subtitle distance can be caption information and frame of the video to be processed on the preset direction The distance between.

In the embodiment of the present disclosure, after getting video to be processed, the caption information for calculating video to be processed exists server-side Subtitle ratio value on multiple preset directions.

In step S403, multiple subtitle ratio values are sent to client, so that client is in multiple subtitle ratio values When being all larger than equal to preset ratio threshold value, processing is zoomed in and out to the video frame of video to be processed, determines target video frame, target Video frame is identical as length of the screen of client on multiple preset directions in the length on multiple preset directions.

Wherein, preset ratio threshold value is set according to actual needs.If subtitle ratio value is more than or equal to preset ratio threshold Value, then can determine on the preset direction of the corresponding subtitle distance of the subtitle ratio value, side of the caption information apart from video frame Edge farther out, will not crop caption information when video frame is full of the screen of client.If subtitle ratio value is less than preset ratio Threshold value can then determine that on the preset direction of the corresponding subtitle distance of the subtitle ratio value, caption information is apart from video frame Edge is closer, can crop caption information when video frame is full of the screen of client.Optionally, preset ratio threshold value can be set It is set to 6%, 7% etc..

Server-side is after being calculated multiple subtitle ratio values, according to the form made an appointment with client, by multiple words Curtain ratio value is sent to client.Client receives this multiple subtitle ratio value, is equal to if this multiple subtitle ratio value is all larger than Preset ratio threshold value, it is determined that caption information will not be cropped when video frame is full of the screen of client on preset direction, Processing is zoomed in and out to the video frame of video to be processed, determines that target video frame, target video frame are filled with the screen of client, Length of the target video frame on preset direction is identical as length of the screen of client on preset direction.This avoids pre- Caption information is cropped on set direction, is solved when video frame to be full of to the screen of equipment, video frame includes that caption information is complete Portion or part are cut, and lead to the problem of video-see effect difference.

In the case where each video frame of video to be processed includes multiple caption informations, video based on shown in Fig. 4 contracts Embodiment of the method is put, the embodiment of the present disclosure additionally provides a kind of video scaling method.It is according to an exemplary reality with reference to Fig. 5, Fig. 5 Apply the flow chart of another video scaling method exemplified.This method is applied to server-side, may include steps of.

In step S501, video to be processed is obtained, the video frame of video to be processed includes caption information.Step S501 with Step S401 is identical.

In step S502, for each video frame of video to be processed, the caption information point that the video frame includes is determined Not with the distance between the frame on multiple preset directions, multiple subtitle distances are obtained.

For example, video to be processed includes video frame F₁、F₂And F₃.Preset direction includes the left and right both direction of video frame.

For video frame F₁, server-side determines video frame F₁Including caption information and left direction on frame (the i.e. left side The distance between frame), obtain subtitle distance d₀₁₁, server-side determines video frame F₁Including caption information and right direction on side The distance between frame (i.e. left frame) obtains subtitle distance d₀₁₂。

For video frame F₂, server-side determines video frame F₂Including caption information and the distance between left frame, obtain word Curtain distance d₀₂₁, server-side determines video frame F₂Including caption information and the distance between left frame, obtain subtitle distance d₀₂₂。

For video frame F₃, server-side determines video frame F₃Including caption information and the distance between left frame, obtain word Curtain distance d₀₃₁, server-side determines video frame F₃Including caption information and the distance between left frame, obtain subtitle distance d₀₃₂。

At this point, server-side obtains multiple subtitle distances, it is respectively as follows: the corresponding subtitle distance d of left frame₀₁₁、d₀₂₁、d₀₃₁, right The corresponding subtitle distance d of frame₀₁₂、d₀₂₂、d₀₃₂。

In step S503, the smallest subtitle is selected from the corresponding multiple subtitle distances of the frame on each preset direction Distance, as the corresponding frame distance of frame on the preset direction.

For the frame on each preset direction, server-side obtain the corresponding multiple subtitles of the frame on the preset direction away from From rear, the smallest subtitle distance is selected from the corresponding multiple subtitles distances of the frame on the preset direction, as the frame pair The frame distance answered.

Still it is illustrated by taking the example in step S502 as an example.If d₀₁₁<d₀₂₁<d₀₃₁, d₀₁₂>d₀₃₂>d₀₂₂, then server-side from d₀₁₁、d₀₂₁、d₀₃₁In, select d₀₁₁As the corresponding frame distance of left frame, from d₀₁₂、d₀₂₂、d₀₃₂In, select d₀₂₂As the right The corresponding frame distance of frame.

In step S504, each frame distance is calculated respectively with the video frame of video to be processed in corresponding preset direction On length ratio, obtain the subtitle ratio value on each preset direction.

Wherein, if preset direction is the left and right both direction of the video frame of video to be processed, the video of video to be processed Length of the frame on preset direction is the width of the video frame of video to be processed.If preset direction is the video of video to be processed The upper and lower both direction of frame, length of the video frame of video to be processed on preset direction are the video frame of video to be processed Height.For determining each frame distance, server-side calculates the frame distance with the video frame of video to be processed corresponding Preset direction on length ratio, obtain the subtitle ratio value on each preset direction.

Still it is illustrated by taking the example in step 503 as an example.Server-side obtains the corresponding frame distance d of left frame₀₁₁The right side and The corresponding frame distance d of frame₀₂₂.Assuming that the width of the video frame of video to be processed is D₀, then frame can be calculated in server-side Distance d₀₁₁Corresponding subtitle ratio value, i.e., the subtitle ratio value δ in left direction₁=d₀₁₁/D₀, frame distance d₀₂₂Corresponding subtitle Ratio value, i.e., the subtitle ratio value δ in right direction₂=d₀₂₂/D₀。

In step S505, multiple subtitle ratio values are sent to client, so that client is in multiple subtitle ratio values When being all larger than equal to preset ratio threshold value, processing is zoomed in and out to the video frame of video to be processed, determines target video frame, target Video frame is identical as length of the screen of client on multiple preset directions in the length on multiple preset directions.Step S505 It is identical as step S403.

In the embodiment of the present disclosure, for each preset direction, server-side is corresponding multiple from the frame on the preset direction The smallest subtitle distance is selected in subtitle distance, as the corresponding frame distance of frame on the preset direction, i.e., one default side A frame distance is determined upwards.A word on the preset direction is calculated based on the frame distance on a preset direction Curtain ratio value, and it is sent to client.Client is according to a subtitle ratio value of each preset direction, to video to be processed Video frame carries out unified scaling processing, further improves the viewing effect of video.

In the case where each video frame of video to be processed includes multiple caption informations, contracted based on video shown in fig. 5 Embodiment of the method is put, the embodiment of the present disclosure additionally provides a kind of video scaling method.It is according to an exemplary reality with reference to Fig. 6, Fig. 6 Apply the flow chart of another video scaling method exemplified.This method is applied to server-side, may include steps of.

In step s 601, video to be processed is obtained, the video frame of video to be processed includes caption information.Step S601 with Step S501 is identical.

In step S602, each caption information that each video frame for video to be processed includes, according to the subtitle Position coordinates and length of the text box where information on multiple preset directions, determine the caption information respectively with multiple default sides The distance between upward frame obtains multiple subtitle distances.

Each video frame includes multiple caption informations.For each caption information, server-side is according to where the caption information Position coordinates and length of the text box on multiple preset directions, determine the caption information respectively with the side on multiple preset directions The distance between frame obtains multiple subtitle distances.

Subtitle distance in the embodiment of the present disclosure, between the frame on caption information and preset direction are as follows: in preset direction On, the minimum value of each pixel and the distance between the frame that text box where the caption information includes.

In an optional embodiment, the origin of the video frame of video to be processed is the video frame upper left corner of video to be processed Pixel.Position coordinates of the text box on preset direction include text box where the caption information where each caption information Coordinates of targets of the pixel in the upper left corner on preset direction.Length of the text box on preset direction where each caption information Target length including text box where the caption information on preset direction.The pixel in the text box upper left corner where caption information Coordinates of targets of the point on preset direction be are as follows: on preset direction the pixel in the text box upper left corner where caption information with to Handle the distance between the pixel in the video frame upper left corner of video.

It include each caption information for each video frame, server-side is by text box where the caption information each default Coordinates of targets on direction is determined as the subtitle distance between the frame on the caption information and the preset direction.Alternatively, being directed to Each video frame includes each caption information, server-side by length of the video frame of video to be processed on each preset direction with The difference of target and value is determined as the subtitle distance between the frame on the caption information and the preset direction, target and value to be somebody's turn to do Coordinates of targets and target length of the text box where caption information on the preset direction and value.

It is illustrated by taking video frame shown in Fig. 7 as an example.Video frame shown in Fig. 7 includes caption information 1,2 and of caption information Caption information 3.1 place text box of caption information is text box 1, and 2 place text box of caption information is text box 2, caption information 3 Place text box is text box 3.Preset direction includes the left and right both direction of video frame.

Black dot p in Fig. 7₁Coordinate x in left and right both direction₁For position of the text box 1 in left and right both direction Set coordinate, black dot p₂Coordinate x in left and right both direction₂The position for being text box 2 in left and right both direction is sat Mark, black dot p₃Coordinate x in left and right both direction₃For position coordinates of the text box 3 in left and right both direction.Text Length of this frame 1 in left and right both direction is w₁, length of the text box 2 in left and right both direction is w₂, text box 3 exists Length in left and right both direction is w₃.The width of video frame is D_w, the height of video frame is D_h。

Server-side is by the coordinate x of 1 place text box 1 of caption information₁The word being determined as between caption information 1 and left frame 11 Curtain distance 11, by the coordinate x of 2 place text box 2 of caption information₂Be determined as subtitle between caption information 2 and left frame 11 away from From 12, by the coordinate x of 3 place text box 3 of caption information₃The subtitle distance 13 being determined as between caption information 3 and left frame 11. At this point, server-side obtains the corresponding multiple subtitle distances of frame 11.

In addition, server-side calculates the coordinate x of 1 place text box 1 of caption information₁With text box 1 in left and right both direction Length w₁And value (x₁+w₁), calculate the coordinate x of 2 place text box 2 of caption information₂With text box 2 in left and right both direction On length w₂And value (x₂+w₂), calculate the coordinate x of 3 place text box 3 of caption information₃With text box 3 in left and right two sides Upward length w₃And value (x₃+w₃).Server-side determines that the subtitle distance 21 between caption information 1 and left frame 12 is D_w-(x₁ +w₁), determine that the subtitle distance 22 between caption information 2 and left frame 12 is D_w-(x₂+w₂), determine caption information 3 and left frame Subtitle distance 23 between 12 is D_w-(x₃+w₃).At this point, server-side obtains the corresponding multiple subtitle distances of frame 12.

For another example preset direction includes left and right, the upper and lower four direction of video frame.Black dot p in Fig. 7₁It is left, Coordinate x in right both direction₁And the coordinate y in upper and lower both direction₁For the position coordinates of text box 1, black dot p₂Coordinate x in left and right both direction₂And the coordinate y in upper and lower both direction₂It is black for the position coordinates of text box 2 Color dot p₃Coordinate x in left and right both direction₃And the coordinate y in upper and lower both direction₃For the position of text box 3 Coordinate.Length of the text box 1 in left and right both direction is w₁, length of the text box 2 in left and right both direction is w₂, text Length of this frame 3 in left and right both direction is w₃.Length of the text box 1 in upper and lower both direction is h₁, text box 2 exists Length in upper and lower both direction is h₂, length of the text box 3 in upper and lower both direction is h₃。

Server-side obtains the corresponding multiple subtitle distances (with reference to above description) of frame 11, can also be by caption information 1 The coordinate y of place text box 1₁Be determined as subtitle between the upward frame 13 (i.e. upper side frame 13) of caption information 1 and top away from From 31, by the coordinate y of 2 place text box 2 of caption information₂The subtitle distance 32 being determined as between caption information 2 and upper side frame 13, By the coordinate y of 3 place text box 3 of caption information₃The subtitle distance 33 being determined as between caption information 3 and upper side frame 13.At this point, Server-side obtains the corresponding multiple subtitle distances of frame 13.

In addition, server-side calculates the coordinate y of 1 place text box 1 of caption information₁With text box 1 in upper and lower both direction Length h₁And value (y₁+h₁), the coordinate y of 2 place text box 2 of calculating character caption information₂With text box 2 at upper and lower two Length h on direction₂And value (y₂+h₂), calculate the coordinate y of 3 place text box 3 of caption information₃With text box 3 upper and lower two Length h on a direction₃And value (y₃+h₃).Server-side determines 14 (the i.e. lower frame of frame in caption information 1 and short transverse 14) the character distance 41 between is D_h-(y₁+h₁), determine that the character distance 42 between caption information 2 and lower frame 14 is D_h-(y₂ +h₂), determine that the character distance 43 between caption information 3 and lower frame 14 is D_h-(y₃+h₃).At this point, server-side obtains frame 14 Corresponding multiple subtitle distances.

In the embodiment of the present disclosure, the origin of the video frame of video to be processed can also be the video frame upper right of video to be processed The pixel of the pixel at angle, the pixel in the lower left corner or the lower right corner, is not specifically limited in this embodiment, if guarantee caption information with Subtitle distance between frame on preset direction are as follows: on preset direction, text box where the caption information includes each The minimum value of the distance between pixel and the frame.In the embodiment of the present disclosure, server-side can be known using default recognizer Other caption information, and then determine position coordinates and length of each caption information place text box on multiple preset directions.In advance If recognizer can include but is not limited to OCR (Optical Character Recognition, optical character identification) calculation Method, convolutional neural networks model etc..

In step S603, the smallest subtitle is selected from the corresponding multiple subtitle distances of the frame on each preset direction Distance, as the corresponding frame distance of frame on the preset direction.Step S603 is identical as step S503.

Still it is illustrated with the example in step S602.Server-side obtains the corresponding multiple subtitle distances of left frame 11: {x₁, x₂, x₃, the corresponding multiple subtitle distances of left frame 12: { D_w-(x₁+w₁), D_w-(x₂+w₂), D_w-(x₃+w₃), upper side frame 13 Corresponding multiple subtitle distances: { y₁, y₂, y₃, the corresponding multiple subtitle distances of lower frame 14: { D_h-(y₁+h₁), D_h-(y₂+h₂), D_h-(y₃+h₃)}。

Wherein, x₁<x₂<x₃, server-side is from { x₁, x₂, x₃In select x₁As the corresponding frame distance of left frame 11.D_w- (x₃+w₃)<D_w-(x₁+w₁)<D_w-(x₂+w₂), server-side is from { D_w-(x₁+w₁), D_w-(x₂+w₂), D_w-(x₃+w₃) in select D_w- (x₃+w₃) it is used as the corresponding frame distance of left frame 12.y₃<y₂<y₁, server-side is from { y₁, y₂, y₃In select y₃As upper side frame 13 corresponding frame distances.D_h-(y₁+h₁)<D_h-(y₂+h₂)<D_h-(y₃+h₃), server-side is from { D_h-(y₁+h₁), D_h-(y₂+h₂), D_h-(y₃+h₃) in select D_h-(y₁+h₁) it is used as the corresponding frame distance of lower frame 14.

In step s 604, each frame distance is calculated respectively with the video frame of video to be processed in corresponding preset direction On length ratio, obtain the subtitle ratio value on each preset direction.Step S604 is identical as step S504.

In step s 605, multiple subtitle ratio values are sent to client, so that client is in multiple subtitle ratio values When being all larger than equal to preset ratio threshold value, processing is zoomed in and out to the video frame of video to be processed, determines target video frame, target Video frame is identical as length of the screen of client on multiple preset directions in the length on multiple preset directions.Step S605 It is identical as step S505.

Using embodiment illustrated in fig. 6, using position coordinates of the text box where each caption information on preset direction and Length has accurately determined on preset direction caption information at a distance from the frame of video frame, and then has promoted client accurate The video frame by video to be processed be full of screen.

Based on video scaling embodiment of the method shown in Fig. 4-6, the embodiment of the present disclosure additionally provides a kind of video scaling side Method.It is the flow chart of another video scaling method shown according to an exemplary embodiment with reference to Fig. 8, Fig. 8.This method application In client, include the following steps.

In step S801, the caption information for receiving the video to be processed that server-side is sent is more on multiple preset directions A subtitle ratio value.

In one example, subtitle ratio value can for frame distance and video to be processed video frame on preset direction The ratio of length, frame distance are between the frame on caption information and preset direction that the video frame of video to be processed includes Minimum value in distance.

In the embodiment of the present disclosure, preset direction is that when video frame is full of the screen of client, may crop subtitle The direction of information.Preset direction can be set according to actual needs.Preset direction may include the video of video to be processed Frame it is left and right, above and/or under four direction.The process that multiple subtitle ratio values are calculated in server-side can refer to Fig. 4 and Fig. 6 Partial description, details are not described herein again.

In step S802, judge whether multiple subtitle ratio values are all larger than equal to preset ratio threshold value, if so, executing Step S803.

Wherein, preset ratio threshold value is set according to actual needs.If subtitle ratio value is more than or equal to preset ratio threshold Value can then determine that on the preset direction for calculating the corresponding subtitle distance of the subtitle ratio value, caption information is apart from video frame Edge farther out, by video frame be full of client screen when will not crop caption information.If subtitle ratio value is less than default Proportion threshold value can then determine on the preset direction for calculating the corresponding subtitle distance of the subtitle ratio value, caption information distance The edge of video frame is closer, can crop caption information when video frame is full of the screen of client.

Client is after receiving multiple subtitle ratio values, caption information when judging video frame being full of the screen of client Whether can be subtracted on preset direction, that is, judge whether multiple subtitle ratio values are all larger than equal to preset ratio threshold value.

In step S803, processing is zoomed in and out to the video frame of video to be processed, determines first object video frame, first Target video frame is identical as length of the screen of client on multiple preset directions in the length on multiple preset directions.

If this multiple subtitle ratio value is all larger than equal to preset ratio threshold value, it is determined that fill video frame on preset direction Caption information will not be cropped when the screen of full client, processing is zoomed in and out to the video frame of video to be processed, determines target Video frame, target video frame are filled with the screen of client, the screen of length and client of the target video frame on preset direction Length of the curtain on preset direction is identical.This avoids caption information is cropped on preset direction, solve by video frame When screen full of equipment, video frame includes that caption information is completely or partially cut, and leads to asking for video-see effect difference Topic.

Here, client zooms in and out processing to each video frame of video to be processed, and it is corresponding to obtain each video frame First object video frame.Target video is constituted by these first object video frames.

Based on video scaling embodiment of the method shown in Fig. 8, the embodiment of the present disclosure additionally provides a kind of video scaling method. It is the flow chart of another video scaling method shown according to an exemplary embodiment with reference to Fig. 9, Fig. 9.This method is applied to Client may include steps of.

In step S901, the caption information for receiving the video to be processed that server-side is sent is more on multiple preset directions A subtitle ratio value.In one example, subtitle ratio value can be length of the frame distance with video to be processed on preset direction The ratio of degree, frame distance be video to be processed video frame include caption information and preset direction on frame between away from Minimum value from.Step S901 is identical as step S801.

In step S902, judge whether multiple subtitle ratio values are all larger than equal to preset ratio threshold value, if so, executing Step S903.Step S902 is identical as step S802.

In step S903, judge whether the depth-width ratio of the video frame of video to be processed is greater than the depth-width ratio of screen.If so, Then follow the steps S904.If it is not, thening follow the steps S905.

Wherein, depth-width ratio is the ratio of height and the width.

When multiple subtitle ratio values are all larger than equal to preset ratio threshold value, client can determine will view on preset direction Frequency frame will not crop caption information when being full of the screen of client, for the screen by video frame full of client, and compared with Few area for cropping video frame, client judge whether the depth-width ratio of the video frame of video to be processed is greater than the height width of screen Than.

In step S904, the video frame of uniform zoom video to be processed obtains the first scaling video frame, the first scaling view The width of frequency frame and screen it is of same size；The first scaling video frame is cut out in the short transverse of the first scaling video frame, is obtained Height to the first sub-goal video frame, the first sub-goal video frame is identical as the height of screen.

When determining that the depth-width ratio of video frame of video to be processed is greater than the depth-width ratio of screen, client uniform zoom waits locating The video frame for managing video, obtains the first scaling video frame, the width of the first scaling video frame and screen it is of same size.At this point, The height of first scaling video frame is greater than the height of screen.Client cuts out the upper and lower direction of the first scaling video frame beyond screen The part of curtain, i.e., cut out the first scaling video frame in the short transverse of the first scaling video frame, obtain the first sub-goal video The height of frame, the first sub-goal video frame is identical as the height of screen, and the width of the first sub-goal video frame and screen It is of same size.

For example, the screen M1 of client shown in video frame a and Figure 10 b as shown in Figure 10 a, the depth-width ratio of video frame a Greater than the depth-width ratio of screen M1.When multiple subtitle ratio values are all larger than equal to preset ratio threshold value, client uniform zoom view Frequency frame a obtains scaling video frame a0 (i.e. the first scaling video frame), the width phase of the width and screen M1 of scaling video frame a0 Together.At this point, the height of scaling video frame a0 is greater than the height of screen M1.The short transverse that client cuts out scaling video frame a0 is super The part (cut out areas of dash area in such as Figure 10 c) of screen M1 out obtains sub-goal video frame a1 (i.e. the first sub-goal view Frequency frame), the height of sub-goal video frame a1 is identical as the height of screen M1.

In step S905, the video frame of uniform zoom video to be processed obtains the second scaling video frame, the second scaling view The height of frequency frame and the height of screen are identical；The second scaling video frame is cut out in the width direction of the second scaling video frame, is obtained To the second sub-goal video frame, the width of the second sub-goal video frame and screen it is of same size.

When determining that the depth-width ratio of video frame of video to be processed is less than or equal to the depth-width ratio of screen, client uniform zoom The video frame of video to be processed, obtains the second scaling video frame, and the height of the second scaling video frame is identical as the height of screen.This When, the width of the second scaling video frame is greater than the width of screen.The left and right direction that client cuts out the second scaling video frame exceeds The second scaling video frame is cut out in the part of screen in the width direction of the second scaling video frame, obtain the second sub-goal view Of same size, and the height and screen of the second sub-goal video frame of frequency frame, the width of the second sub-goal video frame and screen Height it is identical.

For example, the screen M2 of client shown in video frame a and Figure 10 d as shown in Figure 10 a, the depth-width ratio of video frame a Less than or equal to the depth-width ratio of screen M2.When multiple subtitle ratio values are all larger than equal to preset ratio threshold value, client etc. is than contracting Video frame a is put, is obtained scaling video frame a2 (i.e. the second scaling video frame), the height of scaling video frame a2 and the height of screen M2 It is identical.At this point, the width of scaling video frame a2 is more than or equal to the width of screen M2.Client cuts out the width of scaling video frame a2 Direction exceeds the part (cut out areas of dash area in such as Figure 10 e) of screen M2, obtains sub-goal video frame a3 (the i.e. second son Target video frame), the width of sub-goal video frame a3 is of same size with screen M2's.

Using embodiment illustrated in fig. 9, video frame can be full of the screen of client by client, and less crop view The area of frequency frame.

Based on video scaling embodiment of the method shown in Fig. 8, the embodiment of the present disclosure additionally provides a kind of video scaling method. It is the flow chart of another video scaling method shown according to an exemplary embodiment with reference to Figure 11, Figure 11.This method application In client, may include steps of.

In step S1101, the caption information for the video to be processed that server-side is sent is received on multiple preset directions Multiple subtitle ratio values.In one example, subtitle ratio value can for frame distance with video to be processed on preset direction The ratio of length, frame distance are between the frame on caption information and preset direction that the video frame of video to be processed includes Minimum value in distance.Step S1101 is identical as step S801.

In step S1102, judge whether multiple subtitle ratio values are all larger than equal to preset ratio threshold value.If so, holding Row step S1103.If it is not, thening follow the steps S1104.Step S1102 is identical as step S802.

In step S1103, processing is zoomed in and out to the video frame of video to be processed, determines first object video frame, the One target video frame is identical as length of the screen of client on multiple preset directions in the length on multiple preset directions.Step Rapid S1103 is identical as step S803.

In step S1104, the video frame of uniform zoom video to be processed determines that target video frame, target video frame exist Length on multiple preset directions is identical as length of the screen on multiple preset directions.

In the embodiment of the present disclosure, if preset direction includes the width direction of the video frame of video to be processed, i.e. preset direction Including left and right direction, then the length on preset direction is width.If preset direction includes the height of the video frame of video to be processed Direction is spent, i.e. preset direction includes upper and lower direction, then the length on preset direction is height.

In the case where preset direction includes the width direction of the video frame of video to be processed, if multiple subtitle ratio values are not It is all larger than and is equal to preset ratio threshold value, i.e., there is the subtitle ratio value less than preset ratio threshold value in multiple subtitle ratio values, then Client can determine can crop subtitle when the video frame of video to be processed is full of the screen of client in the direction of the width Information, the video frame of uniform zoom video to be processed determine the second target video frame, the width and screen of the second target video frame It is of same size, i.e., the video frame of the video to be processed after uniform zoom is full of the screen of equipment in the direction of the width.

It include video to be processed in preset direction to improve the viewing effect of video in an optional embodiment In the case where the width direction of video frame, if multiple subtitle ratio value unevenness are more than or equal to preset ratio threshold value, client etc. Than the video frame for scaling video to be processed, third scaling video frame, the width of third scaling video frame and the width of screen are obtained It is identical.At this point, third scaling video frame is full of screen in the direction of the width.If third scaling video frame does not fill in the height direction Flooding, client are spliced the first comment box in the short transverse of third scaling video frame for third scaling video frame, are obtained The height of second target video frame, the second target video frame is identical as the height of screen.In the height direction, the first comment box can To splice in the top of third scaling video frame, can also splice in the lower section of third scaling video frame.The width of first comment box It spends of same size with screen.User can input comment information in the first comment box.

For example, the screen M3 of client shown in video frame a and Figure 12 a as shown in Figure 10 a.Preset direction include to In the case where the width direction for handling the video frame of video, when multiple subtitle ratio value unevenness are more than or equal to preset ratio threshold value When, client uniform zoom video frame a obtains scaling video frame c0 (i.e. third scaling video frame), the width of scaling video frame c0 It spends of same size with screen M3.At this point, if the height of scaling video frame c0 is less than the height of screen M3.In the height direction, Client is that scaling video frame c0 splices comment box 1 (i.e. the first comment box), obtains target video frame c1 (i.e. the second target video Frame), as shown in Figure 12b.At this point, target video frame c1 is full of entire screen M3.

If the height of third scaling video frame is greater than the height of screen, client can be carried out third scaling video frame Processing is cut out, the height of obtained video frame is equal to the height of screen.

In the case where preset direction includes the short transverse of the video frame of video to be processed, if multiple subtitle ratio values are not It is all larger than and is equal to preset ratio threshold value, i.e., there is the subtitle ratio value less than preset ratio threshold value in multiple subtitle ratio values, then Client can determine can crop subtitle when the video frame of video to be processed is full of the screen of client in the height direction Information, the video frame of uniform zoom video to be processed determine third target video frame, the height and screen of third target video frame Height it is identical, i.e., the video frame of the video to be processed after uniform zoom is full of the screen of equipment in the height direction.

It include video to be processed in preset direction to improve the viewing effect of video in another optional embodiment Video frame short transverse in the case where, if multiple subtitle ratio value unevenness be more than or equal to preset ratio threshold value, client The video frame of uniform zoom video to be processed obtains the 4th scaling video frame, the height of the 4th scaling video frame and the height of screen It spends identical.At this point, the 4th scaling video frame is full of screen in the height direction.If the 4th scaling video frame is in the direction of the width not Full of screen, client splices the second comment box in the width direction of the 4th scaling video frame for the 4th scaling video frame, obtains To third target video frame, the width of third target video frame and screen it is of same size.In the direction of the width, the second comment box It can splice in the left of the 4th scaling video frame, can also splice in the right of the 4th scaling video frame.Second comment box Height is identical as the height of screen.User can input comment information in the second comment box.

For example, the screen M4 of client shown in video frame a and Figure 12 c as shown in Figure 10 a.Preset direction include to In the case where the short transverse for handling the video frame frame of video, when multiple subtitle ratio value unevenness are more than or equal to preset ratio threshold value When, client uniform zoom video frame a obtains scaling video frame d0 (i.e. the 4th scaling video frame), the height of scaling video frame d0 It spends identical as the height of screen M4.At this point, if the width of scaling video frame d0 is less than the width of screen M4.In the direction of the width, Client is that scaling video frame d0 splices comment box 2 (i.e. the second comment box), obtains target video frame d1 (i.e. third target video Frame), as shown in figure 12d.At this point, target video frame d1 is full of entire screen M4.

If the width of the 4th scaling video frame is greater than the width of screen, client can be carried out the 4th scaling video frame Processing is cut out, the width of obtained video frame is equal to the width of screen.

Below with reference to signaling diagram shown in video scaling system shown in Fig. 3 and Figure 13, the embodiment of the present disclosure is provided Video scaling method be described in detail.

Step S1, server-side 301 obtain video to be processed, and the video frame of video to be processed includes caption information.

Step S2, for each video frame of video to be processed, server-side 301 determines the caption information that the video frame includes Respectively with the distance between the frame on multiple preset directions, multiple subtitle distances are obtained；Frame from each preset direction The smallest subtitle distance is selected in corresponding multiple subtitle distances, as the corresponding frame distance of frame on the preset direction； Ratio of each frame apart from the length with the video frame of video to be processed on corresponding preset direction respectively is calculated, is obtained multiple Subtitle ratio value.

Multiple subtitle ratio values are sent to client 302 by step S3, server-side 301.

Step S4, client 302 judge whether multiple subtitle ratio values are all larger than equal to preset ratio threshold value.If so, Execute step S5.If it is not, step S8 is executed in the case where preset direction includes the width direction of the video frame of video to be processed, In the case where preset direction includes the short transverse of the video frame of video to be processed, step S10 is executed.

Step S5, client 302 judge whether the depth-width ratio of the video frame of video to be processed is greater than the depth-width ratio of screen.If It is to then follow the steps S6.If it is not, thening follow the steps S7.

Step S6, the video frame of 302 uniform zoom of client video to be processed obtain the first scaling video frame, the first contracting Put video frame width and screen it is of same size；The first scaling video is cut out in the short transverse of the first scaling video frame Frame, obtains the first sub-goal video frame, and the height of the first sub-goal video frame is identical as the height of screen.

Step S7, the video frame of 302 uniform zoom of client video to be processed obtain the second scaling video frame, the second contracting The height for putting video frame is identical as the height of screen；The second scaling video is cut out in the width direction of the second scaling video frame Frame, obtains the second sub-goal video frame, the width of the second sub-goal video frame and screen it is of same size.

Step S8, the video frame of 302 uniform zoom of client video to be processed obtain third scaling video frame, third contracting Put video frame width and screen it is of same size.

Step S9, client 302 are third scaling video frame splicing first in the short transverse of third scaling video frame Comment box obtains the second target video frame, and the height of the second target video frame is identical as the height of screen, the second target video frame Width and screen it is of same size.

Step S10, the video frame of 302 uniform zoom of client video to be processed obtain the 4th scaling video frame, the 4th contracting The height for putting video frame is identical as the height of screen.

Step S11, client 302 are the 4th scaling video frame splicing second in the width direction of third scaling video frame Comment box obtains third target video frame, the width of third target video frame and of same size, the third target video frame of screen Height it is identical as the height of screen.

The description of above-mentioned steps S1-S11 is relatively easy, specifically refers to the description of the part Fig. 3-Figure 11.

Based on video scaling embodiment of the method shown in Fig. 4-13, the embodiment of the present disclosure provides a kind of video scaling dress It sets.It is a kind of video scaling device block diagram shown according to an exemplary embodiment with reference to Figure 14, Figure 14, is applied to server-side, The device includes: to obtain module 1401, computing module 1402 and sending module 1403.

Module 1401 is obtained, is configured as executing acquisition video to be processed, the video frame of video to be processed includes subtitle letter Breath.

Computing module 1402 is configured as executing word of the caption information for calculating video to be processed on multiple preset directions Curtain ratio value.

Sending module 1403 is configured as execution for multiple subtitle ratio values and is sent to client, so that client is more When a subtitle ratio value is all larger than equal to preset ratio threshold value, processing is zoomed in and out to the video frame of video to be processed, determines mesh Mark video frame, screen length on multiple preset directions of the target video frame in length and client on multiple preset directions It is identical.

In an optional embodiment, computing module 1402 is configured as specifically executing:

In an optional embodiment, each video frame of video to be processed includes multiple caption informations, computing module 1402, it is configured as specifically executing:

For each caption information of each video frame of video to be processed, according to text box where the caption information more Position coordinates and length on a preset direction, determine the caption information respectively between the frame on multiple preset directions away from From obtaining multiple subtitle distances.

In an optional embodiment, the origin of the video frame of video to be processed is the video frame upper left corner of video to be processed Pixel, position coordinates of the text box on preset direction include text box where the caption information where each caption information Coordinates of targets of the pixel in the upper left corner on preset direction, length of the text box on preset direction where each caption information Target length including text box where the caption information on preset direction.

Computing module 1402 is configured as specifically executing:

The difference of length of the video frame of video to be processed on each preset direction and target and value is determined as the word The subtitle distance between frame in curtain information and the preset direction, target and value are that text box where the caption information is pre- at this Coordinates of targets and target length on set direction and value.

Based on video scaling embodiment of the method shown in Fig. 4-Figure 13, the embodiment of the present disclosure additionally provides a kind of video scaling Device.It is another video scaling device block diagram shown according to an exemplary embodiment with reference to Figure 15, Figure 15, is applied to client End, which includes: receiving module 1501, detection module 1502 and Zoom module 1503.

Receiving module 1501 is configured as executing the caption information for receiving the video to be processed that server-side is sent multiple pre- Multiple subtitle ratio values on set direction, subtitle ratio value are length of the frame distance with video to be processed on preset direction Ratio, frame distance are in the distance between frame on caption information and preset direction that the video frame of video to be processed includes Minimum value.

Judgment module 1502 is configured as execution and judges whether multiple subtitle ratio values are all larger than equal to preset ratio threshold Value.

Zoom module 1503 is configured as executing in the case where the judging result of judgment module 1502, which is, is, treats place The video frame of reason video zooms in and out processing, determines first object video frame, first object video frame is on multiple preset directions Length it is identical as length of the screen of client on multiple preset directions.

In an optional embodiment, subtitle ratio value is the video frame of frame distance and video to be processed in preset direction On length ratio, frame distance be video to be processed video frame include caption information and preset direction on frame it Between distance in minimum value.

In an optional embodiment, Zoom module 1503 is configured as specifically executing:

Judge whether the depth-width ratio of the video frame of video to be processed is greater than the depth-width ratio of screen；

If so, the video frame of uniform zoom video to be processed, obtains the first scaling video frame, the first scaling video frame Width and screen it is of same size；The first scaling video frame is cut out in the short transverse of the first scaling video frame, obtains first The height of sub-goal video frame, the first sub-goal video frame is identical as the height of screen；

If it is not, the then video frame of uniform zoom video to be processed, obtains the second scaling video frame, the second scaling video frame Height is identical as the height of screen；The first scaling video frame is cut out in the width direction of the second scaling video frame, obtains second Sub-goal video frame, the width of the second sub-goal video frame and screen it is of same size.

In an optional embodiment, Zoom module 1503 is configured as can also be performed:

Preset direction includes the width direction of the video frame of video to be processed, is less than in advance if existing in multiple subtitle ratio values If the subtitle ratio value of proportion threshold value, then the video frame of uniform zoom video to be processed, determines the second target video frame, the second mesh Mark video frame width and screen it is of same size；

Preset direction includes the short transverse of the video frame of video to be processed, is less than in advance if existing in multiple subtitle ratio values If the subtitle ratio value of proportion threshold value, then the video frame of uniform zoom video to be processed, determines third target video frame, third mesh The height for marking video frame is identical as the height of screen.

Preset direction includes the width direction of the video frame of video to be processed, the video frame of uniform zoom video to be processed, Obtain third scaling video frame, the width of third scaling video frame and screen it is of same size；In the height of third scaling video frame It spends on direction and splices the first comment box for third scaling video frame, obtain the second target video frame, the height of the second target video frame It spends identical as the height of screen；

Preset direction includes the short transverse of the video frame of video to be processed, the video frame of uniform zoom video to be processed, The 4th scaling video frame is obtained, the height of the 4th scaling video frame is identical as the height of screen；In the width of the 4th scaling video frame It spends on direction and splices the second comment box for the 4th scaling video frame, obtain third target video frame, the width of third target video frame It spends of same size with screen.

About the device in above-described embodiment, wherein modules execute the concrete mode of operation in related this method Embodiment in be described in detail, no detailed explanation will be given here.

Based on Fig. 4-video scaling embodiment of the method shown in Fig. 7, the embodiment of the present disclosure additionally provides a kind of server-side.Figure 16 be a kind of block diagram of server-side shown according to an exemplary embodiment.The server-side includes: processor 1601 and for depositing Store up the memory 1602 of processor-executable instruction.Wherein, processor 1601 is configured as executing instruction, to realize above-mentioned Fig. 4- View video scaling method shown in Fig. 7.

Based on video scaling embodiment of the method shown in Fig. 8-Figure 12, the embodiment of the present disclosure additionally provides a kind of client. Figure 17 is a kind of block diagram of client shown according to an exemplary embodiment.The client includes: processor 1701 and is used for The memory 1702 of storage processor executable instruction.Wherein, processor 1701 is configured as executing instruction, to realize above-mentioned figure Video scaling method is regarded shown in 8- Figure 12.

Based on Fig. 4-video scaling embodiment of the method shown in Fig. 7, in the exemplary embodiment, the embodiment of the present disclosure is also mentioned A kind of storage medium including instruction is supplied, the memory 1602 for example including instruction, above-metioned instruction can be by the processing of server-side Device 1601 is executed to complete above-mentioned Fig. 4-view video scaling method shown in Fig. 7,

Based on video scaling embodiment of the method shown in Fig. 8-Figure 12, in the exemplary embodiment, the embodiment of the present disclosure is also A kind of storage medium including instruction is provided, the memory 1702 for example including instruction, above-metioned instruction can be by client Reason device 1701 is executed to complete to regard video scaling method shown in above-mentioned Fig. 8-Figure 12.

Based on Fig. 4-video scaling embodiment of the method shown in Fig. 7, in the exemplary embodiment, the embodiment of the present disclosure is also mentioned A kind of computer program product, such as the instruction that memory 1602 includes are supplied.Computer program product by server-side processing When device executes, so that electronic equipment realizes above-mentioned Fig. 4-view video scaling method shown in Fig. 7.

Based on video scaling embodiment of the method shown in Fig. 8-Figure 12, in the exemplary embodiment, the embodiment of the present disclosure is also Provide a kind of computer program product, such as the instruction that memory 1702 includes.Computer program product is by client When managing device execution, so that electronic equipment realizes view video scaling method shown in above-mentioned Fig. 8-Figure 12.

Optionally, storage medium can be non-transitorycomputer readable storage medium, for example, the non-transitory calculates Machine readable storage medium storing program for executing can be ROM (Read Only Memory, read-only memory), RAM (Random Access Memory, random access memory), CD-ROM (Compact Disc ROM, CD ROM), tape, floppy disk and optical data storage Equipment etc..

Optionally, processor can be general processor, including CPU (Central Processing Unit, centre Manage device), NP (Network Processor, network processing unit) etc.；It can also be DSP (Digital Signal Processing, digital signal processor), ASIC (Application Specific Integrated Circuit, it is dedicated Integrated circuit), FPGA (Field-Programmable Gate Array, field programmable gate array) or other programmable patrol Collect device, discrete gate or transistor logic, discrete hardware components.

Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the disclosure Its embodiment.The disclosure is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following Claim is pointed out.

It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the accompanying claims.

Claims

1. a kind of video scaling method, which is characterized in that be applied to server-side, comprising:

Multiple subtitle ratio values are sent to client, so that the client is all larger than in multiple subtitle ratio values When equal to preset ratio threshold value, processing is zoomed in and out to the video frame of the video to be processed, determines target video frame, the mesh Video frame is marked in length of the screen on multiple preset directions of length and the client on multiple preset directions It spends identical.

2. the method according to claim 1, wherein the caption information for calculating the video to be processed is more Subtitle ratio value on a preset direction, including；

For each video frame of the video to be processed, determine caption information that the video frame includes respectively with multiple default sides The distance between upward frame obtains multiple subtitle distances；

The smallest subtitle distance is selected from the corresponding multiple subtitle distances of the frame on each preset direction, as the default side The corresponding frame distance of upward frame；

Calculate ratio of each frame apart from the length with the video frame of the video to be processed on corresponding preset direction respectively Value, obtains the subtitle ratio value on each preset direction.

3. according to the method described in claim 2, it is characterized in that, each video frame of the video to be processed includes multiple words Curtain information, the caption information that the determination video frame includes with the distance between the frame on multiple preset directions, obtain respectively To multiple subtitles apart from the step of, comprising:

For each caption information of the video frame, according to position of the text box where the caption information on multiple preset directions Coordinate and length, determine the caption information respectively with the distance between the frame on multiple preset directions, obtain multiple subtitles away from From.

4. according to the method described in claim 3, it is characterized in that, the origin of the video frame of the video to be processed be it is described to The pixel in the video frame upper left corner of video is handled, position coordinates packet of the text box on preset direction where each caption information Coordinates of targets of the pixel in the text box upper left corner on preset direction where including the caption information, text where each caption information Length of this frame on preset direction includes target length of the text box on preset direction where the caption information；

The position coordinates and length according to text box where the caption information on multiple preset directions determine that the subtitle is believed Breath respectively with the distance between each frame on multiple preset directions, obtain multiple subtitles apart from the step of, comprising:

Coordinates of targets of the text box where the caption information on each preset direction is determined as the caption information to preset with this Subtitle distance between frame on direction；Or

The difference of length of the video frame of the video to be processed on each preset direction and target and value is determined as the word Text box where the subtitle distance between frame in curtain information and the preset direction, the target and value are the caption information exists Coordinates of targets and target length on the preset direction and value.

5. a kind of video scaling method, which is characterized in that be applied to client, comprising:

If so, zooming in and out processing to the video frame of the video to be processed, first object video frame, first mesh are determined It is identical as length of the screen of the client on multiple preset directions in the length on multiple preset directions to mark video frame.

6. according to the method described in claim 5, it is characterized in that, the video frame to the video to be processed zooms in and out The step of handling, determining first object video, comprising:

If so, the video frame of video to be processed described in uniform zoom, obtains the first scaling video frame, first scaling video The width of frame is of same size with the screen；First scaling is cut out in the short transverse of the first scaling video frame Video frame, obtains the first sub-goal video frame, and the height of the first sub-goal video frame is identical as the height of the screen；

If it is not, the then video frame of video to be processed described in uniform zoom, obtains the second scaling video frame, second scaling video The height of frame is identical as the height of the screen；Second scaling is cut out in the width direction of the second scaling video frame Video frame, obtains the second sub-goal video frame, and the width of the second sub-goal video frame is of same size with the screen.

7. according to the method described in claim 5, it is characterized in that, the method also includes:

The preset direction includes the width direction of the video frame of the video to be processed, if depositing in the multiple subtitle ratio value In the subtitle ratio value for being less than the preset ratio threshold value, then the video frame of video to be processed described in uniform zoom, determines second Target video frame, the width of the second target video frame are of same size with the screen；

The preset direction includes the short transverse of the video frame of the video to be processed, if depositing in the multiple subtitle ratio value In the subtitle ratio value for being less than the preset ratio threshold value, then the video frame of video to be processed described in uniform zoom, determines third The height of target video frame, the third target video frame is identical as the height of the screen.

8. the method according to the description of claim 7 is characterized in that the video frame of video to be processed described in the uniform zoom, The step of determining the second target video frame, comprising:

The video frame of video to be processed described in uniform zoom, obtains third scaling video frame, the width of the third scaling video frame It spends of same size with the screen；It is that the third scaling video frame is spelled in the short transverse of the third scaling video frame The first comment box is connect, the second target video frame is obtained, the height of the second target video frame is identical as the height of the screen；

The video frame of video to be processed described in uniform zoom, obtains the 4th scaling video frame, the height of the 4th scaling video frame It spends identical as the height of the screen；It is that the 4th scaling video frame is spelled in the width direction of the 4th scaling video frame The second comment box is connect, obtains third target video frame, the width of the third target video frame is of same size with the screen.

9. a kind of video scaling device, which is characterized in that be applied to server-side, comprising:

Module is obtained, is configured as executing acquisition video to be processed, the video frame of the video to be processed includes caption information；

Computing module is configured as executing subtitle ratio of the caption information for calculating the video to be processed on multiple preset directions Example value；

Sending module is configured as execution for the multiple subtitle ratio value and is sent to client, so that the client is in institute When stating multiple subtitle ratio values and being all larger than equal to preset ratio threshold value, place is zoomed in and out to the video frame of the video to be processed Reason, determines target video frame, and the screen of length of the target video frame on the preset direction and the client is in institute The length stated on preset direction is identical.

10. a kind of video scaling device, which is characterized in that be applied to client, comprising:

Receiving module is configured as executing the caption information for receiving the video to be processed that server-side is sent on multiple preset directions Subtitle ratio value；

Zoom module is configured as executing in the case where the judging result of the judgment module, which is, is, to the view to be processed The video frame of frequency zooms in and out processing, determines first object video frame, the first object video frame is on multiple preset directions Length it is identical as length of the screen of the client on multiple preset directions.