CN113259767B - Method and device for zooming audio and video data and electronic equipment - Google Patents
Method and device for zooming audio and video data and electronic equipment Download PDFInfo
- Publication number
- CN113259767B CN113259767B CN202110659847.0A CN202110659847A CN113259767B CN 113259767 B CN113259767 B CN 113259767B CN 202110659847 A CN202110659847 A CN 202110659847A CN 113259767 B CN113259767 B CN 113259767B
- Authority
- CN
- China
- Prior art keywords
- time
- length
- audio
- point
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Abstract
The invention provides a method, a device and electronic equipment for zooming audio and video data, wherein the method comprises the following steps: determining an adjusting area and audio and video data to be displayed, wherein the adjusting area comprises an adjuster; acquiring an adjusting instruction for adjusting the position of a target controller, wherein the target controller is a left controller at the left end of the regulator or a right controller at the right end of the regulator; determining the current position and the current length of the regulator according to the adjustment instruction, determining the in-point time and the out-point time of the display area according to the current position and the current length of the regulator, and displaying data between the in-point time and the out-point time in the audio and video data in the display area. By the method, the device and the electronic equipment for zooming the audio and video data, the displayed audio and video data can be zoomed conveniently, so that a user can preview the audio and video data globally and can perform fine operation on the audio and video data conveniently.
Description
Technical Field
The invention relates to the technical field of audio and video editing, in particular to a method and a device for zooming audio and video data, electronic equipment and a computer readable storage medium.
Background
The audio and video editing software can provide the function of editing the audio and video for the user. Because the audio and video duration is generally longer and the window length of the editing software is limited, the editing software generally only displays a part of the audio and video, so that a user can edit the audio and video conveniently.
If the time span corresponding to the window length is too large, too much information can be displayed in the limited window, which is inconvenient for the user to operate; and if the time span corresponding to the window length is too small, although the user can conveniently perform fine operation, the user can not conveniently perform global preview. Especially, texts such as lyrics and subtitles also exist in the audio and video, and the inappropriate window length is inconvenient for operating or displaying the texts.
Disclosure of Invention
In order to solve the existing technical problem, embodiments of the present invention provide a method and an apparatus for scaling audio and video data, an electronic device, and a computer-readable storage medium.
In a first aspect, an embodiment of the present invention provides a method for scaling audio and video data, including:
determining an adjusting area and audio and video data to be displayed, wherein the adjusting area comprises an adjuster;
acquiring an adjusting instruction for adjusting the position of a target controller, wherein the target controller is a left controller at the left end of the adjuster or a right controller at the right end of the adjuster;
determining the current position and the current length of the regulator according to the adjustment instruction, determining the in-point time and the out-point time of a display area according to the current position and the current length of the regulator, and displaying data positioned between the in-point time and the out-point time in the audio and video data in the display area; wherein, the time length between the point-in time and the point-out time and the current length of the regulator are in positive correlation.
In a second aspect, an embodiment of the present invention further provides a device for scaling audio and video data, including:
the device comprises a determining module, a display module and a display module, wherein the determining module is used for determining an adjusting area and audio and video data to be displayed, and the adjusting area comprises an adjuster;
the instruction acquisition module is used for acquiring an adjustment instruction for adjusting the position of a target controller, wherein the target controller is a left controller at the left end of the adjuster or a right controller at the right end of the adjuster;
the processing module is used for determining the current position and the current length of the regulator according to the adjusting instruction, determining the in-point time and the out-point time of a display area according to the current position and the current length of the regulator, and displaying data positioned between the in-point time and the out-point time in the audio and video data in the display area; wherein, the time length between the point-in time and the point-out time and the current length of the regulator are in positive correlation.
In a third aspect, an embodiment of the present invention provides an electronic device, including a bus, a transceiver, a memory, a processor, and a computer program stored on the memory and executable on the processor, where the transceiver, the memory, and the processor are connected via the bus, and when the computer program is executed by the processor, the steps in any of the above methods for scaling audio and video data are implemented.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the method for scaling audio and video data according to any one of the above items.
In the method, the device, the electronic device and the computer-readable storage medium for zooming the audio and video data provided by the embodiment of the invention, the controllable left controller and the controllable right controller are arranged at two ends of the regulator and are used for adjusting the position and the length of the regulator by adjusting the position of the left controller and/or the right controller, so that the sizes of the point-in time and the point-out time of the display area and the time duration between the point-in time and the point-out time can be changed, and the displayed audio and video data can be zoomed. The method can conveniently realize the zooming of the displayed audio and video data, so that a user can not only preview the audio and video data globally, but also conveniently perform fine operation on the audio and video data.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments or the background art of the present invention, the drawings required to be used in the embodiments or the background art of the present invention will be described below.
Fig. 1 is a flowchart illustrating a method for scaling audio-video data according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a display window in the method for scaling audio and video data according to the embodiment of the present invention;
fig. 3 is another schematic diagram of a display window in the method for scaling audio and video data according to the embodiment of the present invention;
fig. 4 is a schematic structural diagram illustrating an apparatus for scaling audio-video data according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device for performing a method of scaling audio-video data according to an embodiment of the present invention.
Detailed Description
The embodiments of the present invention will be described below with reference to the drawings.
Fig. 1 shows a flowchart of a method for scaling audio and video data according to an embodiment of the present invention. As shown in fig. 1, the method includes:
step 101: and determining a regulation area and audio-video data to be displayed, wherein the regulation area contains a regulator.
In the embodiment of the invention, audio and video data to be processed and displayed are predetermined, and each audio and video data has a specific duration; therefore, after the audio/video data is determined, the duration of the audio/video data is a fixed value.
In addition, the embodiment of the invention is provided with the adjusting area containing the adjuster, so that a user can conveniently execute the zooming operation by operating the adjuster. Fig. 2 shows a schematic view of a display window for displaying audiovisual data. In fig. 2, a regulation area is below the display window, and a regulator is disposed in the regulation area, and the regulator can move or zoom in the regulation area. In the embodiment of the invention, two ends of the regulator are controllable ends, namely two ends of the regulator are respectively a controller; in the present embodiment, the controller on the left side of the regulator is referred to as a left controller, and the controller on the right side of the regulator is referred to as a right controller.
Step 102: and acquiring an adjusting instruction for adjusting the position of a target controller, wherein the target controller is a left controller at the left end of the regulator or a right controller at the right end of the regulator.
In the embodiment of the invention, the display window can display part or all of audio and video data, and part of data is displayed in a general condition; the embodiment of the invention describes the displayed data by the point-in time and the point-out time. As shown in fig. 2, the complete track of the audio-video data is shown by a dashed box, and at this time, the display window only displays part of the data, that is, the data with the in-point time of about 00:06 and the out-point time of about 00: 12. As shown in fig. 2, the display window may include a display area for displaying a portion of the soundtrack of the audiovisual data and a time axis for representing a corresponding time scale.
In the embodiment of the invention, if the currently displayed content or proportion of the display window is not appropriate, a user can adjust the position of the target controller by inputting an adjusting instruction for adjusting the position of the target controller, so as to adjust the position and/or the length of the regulator, wherein the length of the regulator and the displayed time length (namely the time length between the point-in time and the point-out time) are in positive correlation, namely the longer the regulator is, the longer the displayed time length is. And the positions of the left controller and the right controller of the regulator have a corresponding relation with the in-point time and the out-point time, so that the adjustment of the in-point time and/or the out-point time can be realized by adjusting the regulator, and the displayed effect is to zoom the audio and video data.
Specifically, the adjustment instruction may be a drag instruction for dragging the target controller, for example, a drag instruction for dragging the left controller, or a drag instruction for dragging the right controller; that is, the adjustment command at this time adjusts the position of only one target controller. Or, the adjustment instruction may also adjust the left controller and the right controller at the same time, i.e., adjust the two target controllers; for example, the adjustment instruction for simultaneously adjusting the left controller and the right controller is input through a mouse wheel operation or a keyboard.
Step 103: determining the current position and the current length of the regulator according to the adjustment instruction, determining the in-point time and the out-point time of the display area according to the current position and the current length of the regulator, and displaying data between the in-point time and the out-point time in the audio and video data in the display area.
In the embodiment of the invention, the position of the adjusted target controller can be determined based on the adjusting instruction, namely the positions of two ends of the adjuster can be determined, and further the position and the length of the adjuster, namely the current position and the current length, can be determined. The current position and the current length of the regulator may be determined in real time during the adjustment process, or may be determined after the adjustment instruction is input, which is not limited in this embodiment. The current position refers in particular to the position of the actuator currently within the adjustment region.
In addition, as mentioned above, the time length between the in-point time and the out-point time is in positive correlation with the current length of the regulator; after the current position and the current length of the regulator are determined, the in-point time and the out-point time of the display area can be determined based on the current position and the current length, so that the in-point time and the out-point time are updated, the duration of data between the in-point time and the out-point time in the audio and video data can be adjusted, and the zooming effect is achieved. For example, if the left controller of the adjuster is dragged to the left side, the in-point time is reduced, and the out-point time can be kept unchanged, so that the duration between the in-point time and the out-point time is increased, and the length of the display window is unchanged, which is equivalent to reducing the displayed audio/video data, thereby achieving the effect of reduction.
Optionally, after "determining the in-point time and the out-point time of the display area", the method further includes: and carrying out corresponding zooming processing on a text block in the audio and video data, wherein the text block comprises a text in a period of time in the audio and video data.
In the embodiment of the invention, the audio and video data can contain texts such as lyrics, subtitles and the like, or a user can add texts when editing the audio and video data, wherein the texts are represented in the form of text blocks. The text block contains the text in a time period, namely the text block has the start time and the end time of the text block; after the point-in time and the point-out time of the display area are determined, the positions of the time axes corresponding to the starting time and the ending time of the text block respectively can be determined, so that the size of the text block can be adjusted, and the text block can be zoomed.
In the method for zooming audio and video data provided by the embodiment of the invention, the two ends of the regulator are provided with the controllable left controller and the controllable right controller, and the position and the length of the regulator can be adjusted by adjusting the position of the left controller and/or the right controller, so that the sizes of the point-in time and the point-out time of the display area and the time length between the point-in time and the point-out time can be changed, and the displayed audio and video data can be zoomed. The method can conveniently realize the zooming of the displayed audio and video data, so that a user can not only preview the audio and video data globally, but also conveniently perform fine operation on the audio and video data.
On the basis of the embodiment, different audio and video data generally have different time lengths, and the different audio and video data are difficult to be scaled uniformly, so the embodiment of the invention introduces the concept of 'pixel time length ratio'. Specifically, the step 103 "determining the in-point time and the out-point time of the display area according to the current position and the current length of the adjustor" includes:
step A1: and determining the current pixel time length ratio according to the current length of the regulator, wherein the pixel time length ratio refers to the ratio of the length of one pixel to the time length corresponding to the pixel, and the pixel time length ratio is equal to the ratio of the audio track length of the audio and video data to the time length of the audio and video data.
In the embodiment of the present invention, a pixel time duration ratio (ptr) refers to a ratio of a length of a pixel in a display window to a duration corresponding to the pixel, and is a variable value (generally, the length of the pixel is a fixed value, that is, the duration corresponding to the pixel is variable), and specifically, a ratio between a track length of audio/video data and a duration of the audio/video data may be used as a pixel time duration ratio. As shown in fig. 3, if the length of the complete track of the audio/video data is tw (track width) and the duration of the audio/video data is duration, the pixel duration ratio ptr of the audio/video data is:
in the embodiment of the invention, the duration of the audio and video data refers to the complete duration of the audio and video data, and the length of the audio track of the audio and video data refers to the length of the audio track corresponding to the complete audio and video data. For example, if the length of one pixel is 0.01cm and the track of the current audio-video data corresponds to 2000 pixels, the track length Tw of the audio-video data =20 cm; if the av data is 40s video, the duration of the av data is =40s, and the pixel duration ratio ptr =20/40=0.5 at this time is in cm/s.
In the embodiment of the present invention, since the audio/video data to be displayed needs to be scaled, the track length Tw of the audio/video data is changed, and at this time, the current pixel duration ratio may be determined based on the current length sw (scaler width) of the adjustor, and further, the current track length Tw may also be determined. Optionally, the present embodiment introduces the concept of logarithm when determining the pixel duration ratio to achieve fast scaling. Specifically, as shown in fig. 3, the current length sw of the adjuster is in a negative correlation with the track length Tw of the audio/video data, so the current length sw of the adjuster is also in a negative correlation with the pixel duration ratio ptr.
In the embodiment of the invention, the maximum value ptr of the pixel time length ratio is presetmaxDifferent audio and video data can be set to be the same ptrmax. As shown in FIG. 3, the minimum value Tw of TwminTo adjust the length cw of the region, the minimum value ptr of the pixel duration ratio is usedminIs composed of
. Also, the present embodiment presets the minimum length sw of the regulatorminThe minimum length swminThe value can be fixed, and the determination can also be based on the size of the display window. As shown in fig. 3, the maximum length sw of the actuatormaxAlso related to the length cw of the regulatory region, e.g. swmax= cw; alternatively, if the controllers (left and right) are circular, as shown in FIG. 3, the diameter dp, i.e., sw, of the controller may be eliminatedmax= cw-dp. Therefore, the pixel duration ratio is in the range of [ ptrmin,ptrmax]The value range of the current length sw of the regulator is [ sw ]min,swmax](ii) a After the audio-video data has been determined, i.e. after the duration has been determined, the four limits ptr mentioned above are usedmin、ptrmax、swmin、swmaxAll are constant values. In the embodiment, logarithm operation is introduced to determine the relationship between the current length sw and the pixel duration ratio ptr:
and can determine
。
Since the current length sw of the regulator is known and ptrmin、ptrmax、swmin、swmaxAll are constant values, so the current pixel duration ratio ptr can be determined based on the above expression. The base of the log function log may be 10, or may also be e or other values, which is not limited in this embodiment.
In the embodiment of the invention, a logarithmic function is introduced for the pixel duration ratio, so that when sw is increased, the trend of ptr reduction is smaller and smaller, namely the reduction amplitude is smaller and smaller; when sw is reduced, ptr is increased more and more, namely the increase amplitude is increased more and more, so that the scaling rate can be realized under different conditions, and a user can conveniently and more quickly and accurately position the position to be processed. Moreover, the zooming mode does not have the situations of jumping, sudden change and the like, and the user experience can be improved. Compared with the mode of equal scaling, the scaling effect is better.
Step A2: and determining the in-point time and the out-point time of the display area according to the current pixel time length ratio and the current position of the regulator.
In the embodiment of the invention, the pixel time length ratio ptr is essentially the ratio of the length to the time length, and the current positions of the regulators can represent the positions of the controllers at the two ends, that is, the position of each controller in the regulation area can be determined, so that the in-point time corresponding to the left controller and the out-point time corresponding to the right controller can be determined.
Optionally, the step a2 of "determining the in-point time and the out-point time of the display area according to the current pixel duration ratio and the current position of the adjustor" specifically includes:
step A21: determining a target distance s between a target controller and a target edge of an adjusting area according to the current position of the adjuster; the target edge of the adjustment region is the edge of the adjustment region on the same side as the target controller.
Step A22: determining a hidden distance T between a target end of the audio track and a target edge of the adjusting area according to the target distance s and the current pixel duration ratio; wherein, if sw<swmax，
(ii) a If sw = swmax，T=0。
Step A23: and determining the target time of the display area according to the hiding distance T and the current pixel duration ratio.
In an embodiment of the present invention, the target time is the above-mentioned in-point time or out-point time, and is specifically determined based on whether the target controller is a left controller or a right controller. For convenience of description, the present embodiment explains the above steps a21-a23 by taking the target controller as a left controller of the left end of the regulator as an example.
In the case where the target control is the left control at the left end of the regulator, as shown in fig. 3, the regulator is in the regulation zone, and the distance between the left control of the regulator and the left edge of the regulation zone is measurable, i.e. the target edge of the regulation zone is the left edge, and the target distance s isLIs known. The current length sw of the tuner is also known, and as shown in step a1, the current pixel duration ratio ptr can be determined, and the current track length Tw can be determined, i.e., Tw = ptr × duration.
In the embodiment of the present invention, since the logarithmic function is introduced to determine the pixel duration ratio ptr, it is not scaled equally, that is, the ratio between the length sw of the modulator and the length cw of the modulation region is not equal to the ratio between cw and Tw. Therefore, in the embodiment of the invention, the part (namely sw) of the regulating region except the regulatormaxSw) and the portion of the track length Tw not including the display area (i.e., Tw-cw)Are set as proportional relation; let T be the concealment distance between the left end of the track (i.e. the target end of the track) and the left edge of the adjustment region, as shown in fig. 3LAnd then:
therefore, the temperature of the molten metal is controlled,
。
wherein, if sw = swmaxThe limit of the above formula is found, TLAnd =0. Thus:
after determining the hidden distance TLThen, based on the pixel duration ratio ptr, the time point corresponding to the left edge of the adjustment area at this time, i.e. the point-in time t, can be determinedinAnd is and
。
accordingly, if the target controller is the right controller at the right end of the actuator, the target distance s in the above-mentioned steps A21-A23 is the distance s between the right controller and the right edge of the adjustment areaRThe hidden distance T is the distance T between the right end of the track and the right edge of the adjustment areaRSee fig. 3 for details. And the number of the first and second electrodes,
. Therefore, T can also be determined based on the above processing mannerRAnd the time of the point-out at this time toutComprises the following steps:
in the embodiment of the invention, under the condition of introducing the logarithmic function, the point-in time and the point-out time can be determined based on the mode, and the display effect is consistent with the zooming effect.
Optionally, when the adjustment instruction is a drag instruction for dragging the target controller, if the target time is an in-point time, the out-point time is fixed; and if the target time is the time of the out point, the time of the in point is fixed and unchanged.
In the embodiment of the invention, if the adjusting instruction is a dragging instruction, if the dragging instruction is used for dragging a left controller of the regulator, only the point-in time is changed at the moment, and the point-out time is not changed, namely the point-out time does not need to be calculated; on the contrary, if the drag command is used for dragging the right controller of the adjuster, only the out-point time is changed, and the in-point time is not changed.
In addition, when the controller at one end is dragged, since the time (in-point time or out-point time) at the other end is fixed, if the controller at the other end is kept still, the effect that the time at the other end is fixed and unchanged cannot be achieved; that is, when the left/right controller is dragged, the position of the right/left controller on the other side is also changed to ensure that the time on the other side is fixed. For example, when dragging the left controller, the out-point time toutShould remain unchanged, the position of the right control needs to be adapted. Therefore, when the adjustment instruction is a drag instruction, the current length sw of the regulator is not measured but calculated by processing.
Specifically, in the case where the target controller is the left controller at the left end of the regulator, the out-point time toutIs fixed, and based on the definition of the pixel duration ratio ptr:
in addition, the air conditioner is provided with a fan,
therefore:
and the number of the first and second electrodes,
。
due to sLIs measurable, so only ptr and sw are unknown quantities in both equations, so ptr and sw can be determined based on both equations.
Although the general expression of ptr and sw cannot be obtained based on the above two equations, the approximate values of ptr and sw may be calculated based on the above two equations by other methods, for example, by an approximate approximation algorithm or by a series solution.
In the case that the target controller is the right controller at the right end of the regulator, the point-in time tinIs stationary, at this point:
In addition, if the adjustment command is to simultaneously adjust the left controller and the right controller, for example, simultaneously adjust the left controller and the right controller through mouse wheel operation, the target distance s can be directly determined according to the adjustment commandLAnd sRAnd sw can be measured or calculated to determine ptr and corresponding time t of point-ininAnd a time t of departureout。
Optionally, after "determining the in-point time and the out-point time of the display area", the method further includes: and carrying out corresponding zooming processing on a text block in the audio and video data, wherein the text block comprises a text in a period of time in the audio and video data.
In the embodiment of the invention, the audio and video data can contain texts such as lyrics, subtitles and the like, or a user can add texts when editing the audio and video data, wherein the texts are represented in the form of text blocks. The text block contains the text in a time period, namely the text block has the start time and the end time of the text block; after the point-in time and the point-out time of the display area are determined, the positions of the time axes corresponding to the starting time and the ending time of the text block respectively can be determined, so that the size of the text block can be adjusted, and the text block can be zoomed.
Those skilled in the art will understand that the size of the display window can be adjusted, and after the size of the display window is determined, the length cw of the adjustment region can be determined; in the present embodiment, the length cw of the adjustment region and the length of the display window (or the length of the display region, the length of the time axis, and the length of the text track) are in a proportional relationship, and may be in an equal relationship in general.
Further optionally, the method may further comprise:
step B1: a movement instruction for moving the actuator is obtained.
Step B2: keeping the current length of the adjustor unchanged, determining the current position of the adjustor according to the moving instruction, and determining the in-point time and the out-point time of the display area according to the current position and the current length of the adjustor.
In the embodiment of the invention, besides zooming the display scale, the user can change the positions of the controllers at two ends of the adjustor in a mode of moving the adjustor, thereby adjusting the in-point time and the out-point time. In the process of moving the regulator, the time difference between the in-point time and the out-point time is kept unchanged because the length of the regulator is not changed. By setting the function of moving the regulator, the user can conveniently and properly operate the regulator according to the requirement of the user.
The method for scaling audio and video data according to the embodiment of the present invention is described above in detail, and the method may also be implemented by a corresponding apparatus.
Fig. 4 shows a schematic structural diagram of an apparatus for scaling audio-video data according to an embodiment of the present invention. As shown in fig. 4, the apparatus for scaling audio-video data includes:
the determining module 41 is configured to determine an adjustment area and audio/video data to be displayed, where the adjustment area includes an adjuster;
an instruction obtaining module 42, configured to obtain an adjustment instruction for adjusting a position of a target controller, where the target controller is a left controller at a left end of the adjuster or a right controller at a right end of the adjuster;
a processing module 43, configured to determine a current position and a current length of the adjustor according to the adjustment instruction, determine an in-point time and an out-point time of a display area according to the current position and the current length of the adjustor, and display data located between the in-point time and the out-point time in the audio and video data in the display area; wherein, the time length between the point-in time and the point-out time and the current length of the regulator are in positive correlation.
On the basis of the above embodiment, the determining, by the processing module 43, the in-point time and the out-point time of the display area according to the current position and the current length of the adjustor includes:
determining a current pixel time length ratio according to the current length of the regulator, wherein the pixel time length ratio refers to the ratio of the length of one pixel to the time length corresponding to the pixel, and the pixel time length ratio is equal to the ratio of the audio track length of the audio and video data to the time length of the audio and video data;
and determining the on-point time and the off-point time of the display area according to the current pixel time length ratio and the current position of the regulator.
On the basis of the above embodiment, the current pixel duration ratio ptr satisfies:
wherein sw is the current length of the regulator, swmaxAnd swminRespectively, a predetermined maximum length of the adjusterAnd minimum length, ptrmaxFor a preset maximum value, ptr, of said pixel duration ratiominIs the minimum value of the pixel duration ratio, and
(ii) a Wherein cw is the length of the adjustment region, and duration is the duration of the audio/video data.
On the basis of the above embodiment, the processing module 43 determines the in-point time and the out-point time of the display area according to the current pixel duration ratio and the current position of the adjustor, including:
determining a target distance s between the target controller and a target edge of the adjusting area according to the current position of the adjuster; the target edge of the adjusting area is the edge of the adjusting area, which is positioned on the same side as the target controller;
determining a hidden distance T between a target end of an audio track and a target edge of the adjusting area according to the target distance s and the current pixel duration ratio; wherein, if sw<swmax，
(ii) a If sw = swmax，T=0；
Determining the target time of the display area according to the hiding distance T and the current pixel duration ratio;
wherein, under the condition that the target controller is the left controller of regulator left end, the target edge of regulation region is the left edge of regulation region, the target tip of audio track is the left end of audio track, the target time is the in-point time, just the in-point time
；
In a case where the target controller is a right controller at a right end of the regulator, a target edge of the regulation area is a right edge of the regulation area, a target end of the track is a right end of the track, and the target time is a target timeIs the time of the point-out, and the time of the point-out
。
On the basis of the above embodiment, in the case that the adjustment instruction is a drag instruction for dragging the target controller, if the target time is the in-point time, the out-point time is fixed; and if the target time is the out-point time, the in-point time is fixed.
On the basis of the foregoing embodiment, after determining the in-point time and the out-point time of the display area, the processing module 43 is further configured to:
and correspondingly zooming text blocks in the audio and video data, wherein the text blocks contain texts in the audio and video data within a period of time.
On the basis of the above-described embodiments,
the instruction fetch module 42 is further configured to: acquiring a movement instruction for moving the adjuster;
the processing module 43 is further configured to: keeping the current length of the adjustor unchanged, determining the current position of the adjustor according to the moving instruction, and determining the on-point time and the off-point time of the display area according to the current position and the current length of the adjustor.
In addition, an embodiment of the present invention further provides an electronic device, which includes a bus, a transceiver, a memory, a processor, and a computer program stored in the memory and executable on the processor, where the transceiver, the memory, and the processor are connected via the bus, and when the computer program is executed by the processor, the processes of the method for scaling audio and video data according to the embodiment of the present invention are implemented, and the same technical effect can be achieved, and details are not repeated here to avoid repetition.
Specifically, referring to fig. 5, an embodiment of the present invention further provides an electronic device, which includes a bus 1110, a processor 1120, a transceiver 1130, a bus interface 1140, a memory 1150, and a user interface 1160.
In an embodiment of the present invention, the electronic device further includes: a computer program stored on the memory 1150 and executable on the processor 1120, the computer program, when executed by the processor 1120, implementing the various processes of the method embodiments of scaling audio-video data described above.
A transceiver 1130 for receiving and transmitting data under the control of the processor 1120.
In embodiments of the invention in which a bus architecture (represented by bus 1110) is used, bus 1110 may include any number of interconnected buses and bridges, with bus 1110 connecting various circuits including one or more processors, represented by processor 1120, and memory, represented by memory 1150.
The bus 1110 may also connect various other circuits such as peripherals, voltage regulators, or power management circuits to provide an interface between the bus 1110 and the transceiver 1130, as is well known in the art. Therefore, the embodiments of the present invention will not be further described.
The transceiver 1130 may be one element or may be multiple elements, such as multiple receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. For example: the transceiver 1130 receives external data from other devices, and the transceiver 1130 transmits data processed by the processor 1120 to other devices. Depending on the nature of the computer system, a user interface 1160 may also be provided, such as: touch screen, physical keyboard, display, mouse, speaker, microphone, trackball, joystick, stylus.
It is to be appreciated that in embodiments of the invention, the memory 1150 may further include memory located remotely with respect to the processor 1120, which may be coupled to a server via a network. One or more portions of the above-described networks may be an ad hoc network (ad hoc network), an intranet (intranet), an extranet (extranet), a Virtual Private Network (VPN), a Local Area Network (LAN), a Wireless Local Area Network (WLAN), a Wide Area Network (WAN), a Wireless Wide Area Network (WWAN), a Metropolitan Area Network (MAN), the Internet (Internet), a Public Switched Telephone Network (PSTN), a plain old telephone service network (POTS), a cellular telephone network, a wireless fidelity (Wi-Fi) network, and combinations of two or more of the above. For example, the cellular telephone network and the wireless network may be a global system for Mobile Communications (GSM) system, a Code Division Multiple Access (CDMA) system, a Worldwide Interoperability for Microwave Access (WiMAX) system, a General Packet Radio Service (GPRS) system, a Wideband Code Division Multiple Access (WCDMA) system, a Long Term Evolution (LTE) system, an LTE Frequency Division Duplex (FDD) system, an LTE Time Division Duplex (TDD) system, a long term evolution-advanced (LTE-a) system, a Universal Mobile Telecommunications (UMTS) system, an enhanced Mobile Broadband (eMBB) system, a mass Machine Type Communication (mtc) system, an Ultra Reliable Low Latency Communication (urrllc) system, or the like.
It is to be understood that the memory 1150 in embodiments of the present invention can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. Wherein the nonvolatile memory includes: Read-Only Memory (ROM), Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), or Flash Memory.
The volatile memory includes: random Access Memory (RAM), which acts as an external cache. By way of example, and not limitation, many forms of RAM are available, such as: static random access memory (Static RAM, SRAM), Dynamic random access memory (Dynamic RAM, DRAM), Synchronous Dynamic random access memory (Synchronous DRAM, SDRAM), Double Data Rate Synchronous Dynamic random access memory (Double Data Rate SDRAM, DDRSDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct memory bus RAM (DRRAM). The memory 1150 of the electronic device described in the embodiments of the invention includes, but is not limited to, the above and any other suitable types of memory.
In an embodiment of the present invention, memory 1150 stores the following elements of operating system 1151 and application programs 1152: an executable module, a data structure, or a subset thereof, or an expanded set thereof.
Specifically, the operating system 1151 includes various system programs such as: a framework layer, a core library layer, a driver layer, etc. for implementing various basic services and processing hardware-based tasks. Applications 1152 include various applications such as: media Player (Media Player), Browser (Browser), for implementing various application services. A program implementing a method of an embodiment of the invention may be included in application program 1152. The application programs 1152 include: applets, objects, components, logic, data structures, and other computer system executable instructions that perform particular tasks or implement particular abstract data types.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when being executed by a processor, the computer program implements each process of the above method for scaling audio/video data, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The computer-readable storage medium includes: permanent and non-permanent, removable and non-removable media may be tangible devices that retain and store instructions for use by an instruction execution apparatus. The computer-readable storage medium includes: electronic memory devices, magnetic memory devices, optical memory devices, electromagnetic memory devices, semiconductor memory devices, and any suitable combination of the foregoing. The computer-readable storage medium includes: phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), non-volatile random access memory (NVRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic tape cartridge storage, magnetic tape disk storage or other magnetic storage devices, memory sticks, mechanically encoded devices (e.g., punched cards or raised structures in a groove having instructions recorded thereon), or any other non-transmission medium useful for storing information that may be accessed by a computing device. As defined in embodiments of the present invention, the computer-readable storage medium does not include transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses traveling through a fiber optic cable), or electrical signals transmitted through a wire.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus, electronic device and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may also be an electrical, mechanical or other form of connection.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to solve the problem to be solved by the embodiment of the invention.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present invention may be substantially or partially contributed by the prior art, or all or part of the technical solutions may be embodied in a software product stored in a storage medium and including instructions for causing a computer device (including a personal computer, a server, a data center, or other network devices) to execute all or part of the steps of the methods of the embodiments of the present invention. And the storage medium includes various media that can store the program code as listed in the foregoing.
In the description of the embodiments of the present invention, it should be apparent to those skilled in the art that the embodiments of the present invention can be embodied as methods, apparatuses, electronic devices, and computer-readable storage media. Thus, embodiments of the invention may be embodied in the form of: entirely hardware, entirely software (including firmware, resident software, micro-code, etc.), a combination of hardware and software. Furthermore, in some embodiments, embodiments of the invention may also be embodied in the form of a computer program product in one or more computer-readable storage media having computer program code embodied in the medium.
The computer-readable storage media described above may take any combination of one or more computer-readable storage media. The computer-readable storage medium includes: an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium include: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only Memory (ROM), an erasable programmable read-only Memory (EPROM), a Flash Memory, an optical fiber, a compact disc read-only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any combination thereof. In embodiments of the invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, device, or apparatus.
The computer program code embodied on the computer readable storage medium may be transmitted using any appropriate medium, including: wireless, wire, fiber optic cable, Radio Frequency (RF), or any suitable combination thereof.
Computer program code for carrying out operations for embodiments of the present invention may be written in assembly instructions, Instruction Set Architecture (ISA) instructions, machine related instructions, microcode, firmware instructions, state setting data, integrated circuit configuration data, or in one or more programming languages, including an object oriented programming language, such as: java, Smalltalk, C + +, and also include conventional procedural programming languages, such as: c or a similar programming language. The computer program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be over any of a variety of networks, including: a Local Area Network (LAN) or a Wide Area Network (WAN), which may be connected to the user's computer, may be connected to an external computer.
The method, the device and the electronic equipment are described through the flow chart and/or the block diagram.
It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions. These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing apparatus to function in a particular manner. Thus, the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The above description is only a specific implementation of the embodiments of the present invention, but the scope of the embodiments of the present invention is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the embodiments of the present invention, and all such changes or substitutions should be covered by the scope of the embodiments of the present invention. Therefore, the protection scope of the embodiments of the present invention shall be subject to the protection scope of the claims.
Claims (9)
1. A method of scaling audio-visual data, comprising:
determining an adjusting area and audio and video data to be displayed, wherein the adjusting area comprises an adjuster;
acquiring an adjusting instruction for adjusting the position of a target controller, wherein the target controller is a left controller at the left end of the adjuster or a right controller at the right end of the adjuster;
determining the current position and the current length of the regulator according to the adjustment instruction, determining the in-point time and the out-point time of a display area according to the current position and the current length of the regulator, and displaying data positioned between the in-point time and the out-point time in the audio and video data in the display area; wherein, the time length between the point-in time and the point-out time and the current length of the regulator are in positive correlation;
wherein, the determining the in-point time and the out-point time of the display area according to the current position and the current length of the regulator comprises:
determining a current pixel time length ratio according to the current length of the regulator, wherein the pixel time length ratio refers to the ratio of the length of one pixel to the time length corresponding to the pixel, and the pixel time length ratio is equal to the ratio of the audio track length of the audio and video data to the time length of the audio and video data;
and determining the on-point time and the off-point time of the display area according to the current pixel time length ratio and the current position of the regulator.
2. The method of claim 1, wherein the current pixel duration ratio ptr satisfies:
wherein sw is the current length of the regulator, swmaxAnd swminRespectively a predetermined maximum length and a predetermined minimum length, ptr, of said actuatormaxFor a preset maximum value, ptr, of said pixel duration ratiominIs the minimum value of the pixel duration ratio, and
(ii) a Wherein cw is the length of the adjustment region, and duration is the length of the adjustment regionThe duration of the audio-video data.
3. The method of claim 2, wherein determining an in-point time and an out-point time of a display area based on the current pixel duration ratio and the current position of the actuator comprises:
determining a target distance s between the target controller and a target edge of the adjusting area according to the current position of the adjuster; the target edge of the adjusting area is the edge of the adjusting area, which is positioned on the same side as the target controller;
determining a hidden distance T between a target end of an audio track and a target edge of the adjusting area according to the target distance s and the current pixel duration ratio; wherein, if sw<swmax，
(ii) a If sw = swmax，T=0；
Determining the target time of the display area according to the hiding distance T and the current pixel duration ratio;
wherein, under the condition that the target controller is the left controller of regulator left end, the target edge of regulation region is the left edge of regulation region, the target tip of audio track is the left end of audio track, the target time is the in-point time, just the in-point time
；
In a case where the target controller is a right controller at a right end of the regulator, a target edge of the regulation area is a right edge of the regulation area, a target end of the audio track is a right end of the audio track, the target time is the out-point time, and the out-point time is the right edge of the regulation area
。
4. The method of claim 3,
if the target time is the in-point time, the out-point time is fixed under the condition that the adjusting instruction is a dragging instruction for dragging the target controller; and if the target time is the out-point time, the in-point time is fixed.
5. The method of any one of claims 1-4, wherein after determining the in-point time and the out-point time of the display area, further comprising:
and correspondingly zooming text blocks in the audio and video data, wherein the text blocks contain texts in the audio and video data within a period of time.
6. The method of any one of claims 1-4, further comprising:
acquiring a movement instruction for moving the adjuster;
keeping the current length of the adjustor unchanged, determining the current position of the adjustor according to the moving instruction, and determining the on-point time and the off-point time of the display area according to the current position and the current length of the adjustor.
7. An apparatus for scaling audio-visual data, comprising:
the device comprises a determining module, a display module and a display module, wherein the determining module is used for determining an adjusting area and audio and video data to be displayed, and the adjusting area comprises an adjuster;
the instruction acquisition module is used for acquiring an adjustment instruction for adjusting the position of a target controller, wherein the target controller is a left controller at the left end of the adjuster or a right controller at the right end of the adjuster;
the processing module is used for determining the current position and the current length of the regulator according to the adjusting instruction, determining the in-point time and the out-point time of a display area according to the current position and the current length of the regulator, and displaying data positioned between the in-point time and the out-point time in the audio and video data in the display area; wherein, the time length between the point-in time and the point-out time and the current length of the regulator are in positive correlation;
wherein, the processing module determines the point-in time and the point-out time of the display area according to the current position and the current length of the regulator, and comprises:
determining a current pixel time length ratio according to the current length of the regulator, wherein the pixel time length ratio refers to the ratio of the length of one pixel to the time length corresponding to the pixel, and the pixel time length ratio is equal to the ratio of the audio track length of the audio and video data to the time length of the audio and video data;
and determining the on-point time and the off-point time of the display area according to the current pixel time length ratio and the current position of the regulator.
8. An electronic device comprising a bus, a transceiver, a memory, a processor and a computer program stored on the memory and executable on the processor, the transceiver, the memory and the processor being connected via the bus, characterized in that the computer program, when executed by the processor, implements the steps in the method of scaling audio-visual data according to any of claims 1 to 6.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of scaling audio-visual data according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110659847.0A CN113259767B (en) | 2021-06-15 | 2021-06-15 | Method and device for zooming audio and video data and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110659847.0A CN113259767B (en) | 2021-06-15 | 2021-06-15 | Method and device for zooming audio and video data and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113259767A CN113259767A (en) | 2021-08-13 |
| CN113259767B true CN113259767B (en) | 2021-09-17 |
Family
ID=77188007
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110659847.0A Active CN113259767B (en) | 2021-06-15 | 2021-06-15 | Method and device for zooming audio and video data and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113259767B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2093313A1 (en) * | 1992-04-03 | 1993-10-04 | Randy Ubillos | Method and apparatus for video editing |
| CN1437137A (en) * | 2002-02-06 | 2003-08-20 | 北京新奥特集团 | Non-linear editing computer |
| CN102348071A (en) * | 2011-06-02 | 2012-02-08 | 上海东方传媒集团有限公司 | Program caption production method and system |
| CN102572302A (en) * | 2010-12-31 | 2012-07-11 | 新奥特（北京）视频技术有限公司 | Multi treatment methods for key frame curve after modifying exit and entry points of materials |
| CN102881308A (en) * | 2011-06-27 | 2013-01-16 | 索尼公司 | Editing device, editing method, and program |
| CN104822088A (en) * | 2015-04-16 | 2015-08-05 | 腾讯科技（北京）有限公司 | Video image zooming method and device |
| US10515665B1 (en) * | 2016-08-31 | 2019-12-24 | Dataclay, LLC | System and method for automating the configuration and sequencing of temporal elements within a digital video composition |
| CN111666527A (en) * | 2020-08-10 | 2020-09-15 | 北京美摄网络科技有限公司 | Multimedia editing method and device based on web page |
| CN112381907A (en) * | 2020-11-12 | 2021-02-19 | 上海哔哩哔哩科技有限公司 | Multimedia track drawing method and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040230910A1 (en) * | 2003-05-16 | 2004-11-18 | Brian Lin | Assistant editing display method for media clips |
-
2021
- 2021-06-15 CN CN202110659847.0A patent/CN113259767B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2093313A1 (en) * | 1992-04-03 | 1993-10-04 | Randy Ubillos | Method and apparatus for video editing |
| CN1437137A (en) * | 2002-02-06 | 2003-08-20 | 北京新奥特集团 | Non-linear editing computer |
| CN102572302A (en) * | 2010-12-31 | 2012-07-11 | 新奥特（北京）视频技术有限公司 | Multi treatment methods for key frame curve after modifying exit and entry points of materials |
| CN102348071A (en) * | 2011-06-02 | 2012-02-08 | 上海东方传媒集团有限公司 | Program caption production method and system |
| CN102881308A (en) * | 2011-06-27 | 2013-01-16 | 索尼公司 | Editing device, editing method, and program |
| CN104822088A (en) * | 2015-04-16 | 2015-08-05 | 腾讯科技（北京）有限公司 | Video image zooming method and device |
| US10515665B1 (en) * | 2016-08-31 | 2019-12-24 | Dataclay, LLC | System and method for automating the configuration and sequencing of temporal elements within a digital video composition |
| CN111666527A (en) * | 2020-08-10 | 2020-09-15 | 北京美摄网络科技有限公司 | Multimedia editing method and device based on web page |
| CN112381907A (en) * | 2020-11-12 | 2021-02-19 | 上海哔哩哔哩科技有限公司 | Multimedia track drawing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113259767A (en) | 2021-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9984725B2 (en) | Apparatus and method for editing | |
| EP2827614B1 (en) | Audio playing method and device | |
| KR101674340B1 (en) | Method and apparatus for automatically rendering dolly zoom effect | |
| CN110324717B (en) | Video playing method and device and computer readable storage medium | |
| US20210225406A1 (en) | Video acquisition method and device, terminal and medium | |
| US20230353844A1 (en) | Video generation method and apparatus, electronic device, and storage medium | |
| US20200411053A1 (en) | Video processing method and apparatus, terminal and medium | |
| KR102371770B1 (en) | Apparatus and method for recognizing speech | |
| WO2020024165A1 (en) | Video clipping method, apparatus, device and storage medium | |
| US9990772B2 (en) | Augmented reality skin evaluation | |
| CN112422591B (en) | Method and device for transmitting video stream data and electronic equipment | |
| CN110289024B (en) | Audio editing method and device, electronic equipment and storage medium | |
| CN112565834B (en) | Method and device for controlling output data and electronic equipment | |
| US20210021953A1 (en) | Electronic apparatus and controlling method thereof | |
| US20200225907A1 (en) | Automatic audio ducking with real time feedback based on fast integration of signal levels | |
| KR20210110852A (en) | Image deformation control method, device and hardware device | |
| WO2022100162A1 (en) | Method and apparatus for producing dynamic shots in short video | |
| WO2011158435A1 (en) | Audio control device, audio control program, and audio control method | |
| CN112034984A (en) | Virtual model processing method and device, electronic equipment and storage medium | |
| CN112849061A (en) | In-vehicle mode switching method and related equipment | |
| CN113259767B (en) | Method and device for zooming audio and video data and electronic equipment | |
| US10572138B1 (en) | Utilizing dynamic granularity for application controls | |
| EP4304187A1 (en) | Application video processing method, and electronic device | |
| KR102286300B1 (en) | Interactively stylizing camera motion | |
| US10051403B2 (en) | Controlling audio rendering |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |