CN112770099B - Multimedia playing method, device, terminal and storage medium - Google Patents

Multimedia playing method, device, terminal and storage medium Download PDF

Info

Publication number
CN112770099B
CN112770099B CN201911067408.XA CN201911067408A CN112770099B CN 112770099 B CN112770099 B CN 112770099B CN 201911067408 A CN201911067408 A CN 201911067408A CN 112770099 B CN112770099 B CN 112770099B
Authority
CN
China
Prior art keywords
multimedia
image
playing
layer image
displaying
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911067408.XA
Other languages
Chinese (zh)
Other versions
CN112770099A (en
Inventor
杨浩
吴雷
张龙
朱浩杭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201911067408.XA priority Critical patent/CN112770099B/en
Publication of CN112770099A publication Critical patent/CN112770099A/en
Application granted granted Critical
Publication of CN112770099B publication Critical patent/CN112770099B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/156Mixing image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/302Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention discloses a multimedia playing method, a multimedia playing device, a multimedia playing terminal and a multimedia playing storage medium; the embodiment of the invention can acquire multimedia data, wherein the multimedia data comprises a bottom layer image, a plurality of top layer images and at least one reference area of multimedia; when the playing operation of a user for the multimedia is detected, determining the displacement information of the multimedia according to the playing operation; determining a target top-level image in the plurality of top-level images according to the displacement information; performing parameter adjustment on the target top image based on the displacement information to obtain an adjusted target top image; and in the process of playing the multimedia, displaying a bottom layer image and a reference area in the multimedia, and displaying an adjusted target top layer image on the bottom layer image. According to the invention, a user can switch the target top-level image, and the reference area overlapped with the target top-level image can be displayed when multimedia is played, so that a three-dimensional visual effect is realized. The scheme can improve the interaction effect of the multimedia playing method.

Description

Multimedia playing method, device, terminal and storage medium
Technical Field
The present application relates to the field of image processing, and in particular, to a multimedia playing method, apparatus, terminal, and storage medium.
Background
Multimedia (Multimedia) refers to the integration of various media, and generally, Multimedia may include various media forms such as text, audio, and image. For example, a multimedia data may also include information such as pictures, videos, and texts.
Although multimedia data can be loaded with abundant information, the current multimedia playing method has low interactivity due to a single multimedia processing method.
Disclosure of Invention
The embodiment of the invention provides a multimedia playing method, a multimedia playing device, a terminal and a storage medium, which can improve the interaction effect of the multimedia playing method.
The embodiment of the invention provides a multimedia playing method, which comprises the following steps:
acquiring multimedia data, wherein the multimedia data comprises a bottom layer image, a plurality of top layer images and at least one reference area of multimedia;
when the playing operation of a user for the multimedia is detected, determining the displacement information of the multimedia according to the playing operation;
determining a target top-level image in the plurality of top-level images according to the displacement information;
performing parameter adjustment on the target top image based on the displacement information to obtain an adjusted target top image;
and in the process of playing the multimedia, displaying the bottom layer image and the reference area in the multimedia, and displaying the adjusted target top layer image on the bottom layer image.
An embodiment of the present invention further provides a multimedia playing apparatus, including:
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring multimedia data, and the multimedia data comprises a bottom layer image, a plurality of top layer images and at least one reference area of multimedia;
the detection unit is used for determining the displacement information of the multimedia according to the playing operation when the playing operation of the user for the multimedia is detected;
the target unit is used for determining a target top-level image in the plurality of top-level images according to the displacement information;
the adjusting unit is used for carrying out parameter adjustment on the target top layer image based on the displacement information to obtain an adjusted target top layer image;
and the display unit is used for displaying the bottom layer image and the reference area in the multimedia in the process of playing the multimedia, and displaying the adjusted target top layer image on the bottom layer image.
The embodiment of the invention also provides a terminal, which comprises a memory, a first memory and a second memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of any multimedia playing method provided by the embodiment of the invention.
The embodiment of the present invention further provides a computer-readable storage medium, where multiple instructions are stored in the computer-readable storage medium, and the instructions are suitable for being loaded by a processor to perform any of the steps in the multimedia playing method provided in the embodiment of the present invention.
The embodiment of the invention can acquire multimedia data, wherein the multimedia data comprises a bottom layer image, a plurality of top layer images and at least one reference area of multimedia; when the playing operation of a user for the multimedia is detected, determining the displacement information of the multimedia according to the playing operation; determining a target top-level image in the plurality of top-level images according to the displacement information; performing parameter adjustment on the target top image based on the displacement information to obtain an adjusted target top image; and in the process of playing the multimedia, displaying the bottom layer image and the reference area in the multimedia, and displaying the adjusted target top layer image on the bottom layer image.
In the embodiment of the invention, the playing operation of the user can be switched to the target top layer image in the plurality of top layer images, the reference area is displayed while the top layer image is displayed on the bottom layer image, and the reference area can be overlapped with the top layer image, so that the contrast effect can be generated, and the three-dimensional visual effect can be realized.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1a is a schematic view of a scene of a multimedia playing method according to an embodiment of the present invention;
fig. 1b is a schematic flowchart of a multimedia playing method according to an embodiment of the present invention;
fig. 1c is a schematic diagram illustrating an effect of a multimedia playing method according to an embodiment of the present invention;
FIG. 1d is a schematic diagram illustrating a structure of an image hierarchy in a multimedia playing method according to an embodiment of the present invention;
FIG. 1e is a schematic diagram illustrating the effect of image levels in the multimedia playing method according to an embodiment of the present invention;
fig. 2a is a schematic flowchart of a multimedia playing method applied in an advertisement scene according to an embodiment of the present invention;
FIG. 2b is a schematic diagram of a plurality of top-level images in the multimedia playing method according to the embodiment of the present invention;
fig. 2c is a schematic diagram of a bottom layer image in the multimedia playing method according to the embodiment of the present invention;
fig. 2d is a schematic view of a playing scene of an advertisement to which the multimedia playing method according to the embodiment of the present invention is applied;
fig. 3 is a schematic structural diagram of a multimedia playing apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides a multimedia playing method, a multimedia playing device, a terminal and a storage medium.
The multimedia playing apparatus may be specifically integrated in a terminal, and the terminal may be a mobile phone, a tablet Computer, an intelligent bluetooth device, a notebook Computer, or a Personal Computer (PC).
Referring to fig. 1a, the terminal may acquire multimedia data including a bottom layer image, a plurality of top layer images, and at least one reference area of multimedia; when the playing operation of a user for the multimedia is detected, determining the displacement information of the multimedia according to the playing operation; determining a target top-level image in the plurality of top-level images according to the displacement information; performing parameter adjustment on the target top image based on the displacement information to obtain an adjusted target top image; and in the process of playing the multimedia, displaying the bottom layer image and the reference area in the multimedia, and displaying the adjusted target top layer image on the bottom layer image.
The following are detailed below. The numbers in the following examples are not intended to limit the order of preference of the examples.
In this embodiment, a multimedia playing method is provided, as shown in fig. 1b, a specific flow of the multimedia playing method may be as follows:
101. the method comprises the steps of obtaining multimedia data, wherein the multimedia data comprise a bottom layer image, a plurality of top layer images and at least one reference area of multimedia.
The multimedia data refers to a collection of multiple media data, for example, the multimedia data may include data in multiple media forms such as text, audio, and image. For example, in some embodiments, the multimedia data may include text data, image data.
Referring to fig. 1a, the multimedia data may include a plurality of image data, which are a reference region, a bottom layer image, and a plurality of top layer images.
The reference area can be image data in various forms, and is used for comparing with the top layer image to generate a three-dimensional visual effect. The terminal can generate a region of a specific size, color, shape, i.e., a reference region, using the image data.
When the images are stacked and laminated, the reference area may be located above the top layer image or between the top layer image and the bottom layer image, that is, when the terminal draws the images, the pixels in the reference area may cover the pixels of other images in the multimedia data, or only the pixels of the bottom layer image in the multimedia data, and may be covered by the pixels of the top layer image.
The reference region may be stored in the multimedia data in the form of an image or a code, and when the reference region is stored in the multimedia data in the form of a code, the terminal may draw an image according to the code while playing the multimedia.
In some embodiments, the reference region may include a plurality of sub-regions, for example, the reference region may be divided into a first reference region and a second reference region.
It should be noted that the first reference region and the second reference region may have the same parameters such as image size, shape, color, etc., i.e., the first reference region and the second reference region may represent the same image.
The multimedia data may be obtained in various manners, for example, the multimedia data may be obtained from a server through a network, the multimedia data may also be obtained locally, and the like.
102. And when the playing operation of the user for the multimedia is detected, determining the displacement information of the multimedia according to the playing operation.
When the playing operation of the user for the multimedia is detected, the multimedia can be played.
The playing operation can include a touch operation of a user for a terminal touch screen, and operations such as clicking, pressing, rotating and touching for other controls on the terminal.
For example, the play operation may refer to a sliding operation of the user with respect to the terminal touch screen; for another example, the play operation may refer to a pressing operation of a volume key on the terminal by the user, and the like.
The displacement information refers to distance information and direction information of the multimedia data moving on the screen by the user through playing operation.
For example, when the user performs a sliding operation on the terminal touch screen, assuming that the screen coordinates of the user's finger touching the screen are measured as (1, 1), the finger continuously slides on the screen to the coordinates (3, 3), and the displacement information of this play operation is determined as (2, 2).
For another example, when the user presses the + key of the terminal volume key once, the displacement information of the playing operation is determined to be (0, 1).
The specific mapping relationship between the playing operation and the displacement information may be preset by a person skilled in the art, or may be set by a terminal manufacturer, which is not described herein again.
In some embodiments, the multimedia data may also include audio information, which may also be played after step 102.
In some embodiments, the audio information may include a plurality of audio sub-information, i.e. audio frames, and at this time, the specific steps of playing the audio information are as follows:
determining target audio sub-information in the plurality of audio sub-information according to the displacement information;
and performing audio playing according to the target audio sub-information.
For example, in the process that the user presses the + key of the terminal volume key for the first time, the 1 st audio sub-information is determined as the target audio sub-information in 10 audio information; and determining the 5 th audio sub-information as the target audio sub-information in the 10 audio information in the process of pressing the + key of the terminal volume key for the fifth time by the user, and the like.
Therefore, the audio can be controlled to be played in the forward order and the reverse order according to the direction information in the displacement information.
For example, it is assumed that the audio information includes 3 pieces of audio sub information, which are denoted as [1, 2, 3], when a user performs a downward sliding operation on the touch screen, the audio sub information may be played in a positive sequence, that is, the audio sub information [1], [2], [3] is played in sequence; when the user performs the upward sliding operation on the touch screen, the audio self-information can be played in reverse order, that is, the audio sub-information [3], [2], [1] is played in sequence.
103. And determining a target top-level image in the plurality of top-level images according to the displacement information.
Similar to the forward playing and the reverse playing of the audio information in step 102, the top-level image may also determine a target top-level image in the top-level image according to the displacement information, and display the target top-level image, thereby achieving the effects of the forward playing and the reverse playing, and controlling the playing speed.
For example, in the process that the user presses the + key of the terminal volume key once, the 1 st top-level image is determined as the target top-level image in 10 top-level images; determining the 2 nd top-level image as the target audio sub-information in the 10 top-level images in the process that the user presses the + key of the terminal volume key; and in the process that the user presses a key of the terminal volume key, determining the 1 st top-level image as the target audio sub-information in the 10 top-level images.
It should be noted that each top-level image may have different image contents or the same image contents, and each top-level image may have different image parameters or the same image parameters, which is not required herein.
104. And adjusting parameters of the target top image based on the displacement information to obtain the adjusted target top image.
The parameter adjustment refers to operations such as modification, assignment, and resetting of image parameters of an image.
The parameters may include an image size parameter, an image color parameter, an image shape parameter, an image rendering priority parameter, and the like.
Specifically, referring to fig. 1c, in some embodiments, when the image parameter is a size parameter, step 104 may include the following steps:
determining the original image size of a target top image;
determining a zoom factor of the target top-level image based on the displacement information;
determining a size adjustment parameter of the target top-level image based on the original size of the image and the zoom factor;
and adjusting the target top image according to the size adjustment parameter to obtain the adjusted target top image.
The terminal can obtain the original image size of the target top-level image locally, or obtain the original image size from a server through a network, and the like.
The specific value of the zoom factor can be set by those skilled in the art, and can also be set by the user, etc.
In some embodiments, the zoom factor includes a preset first factor and a preset second factor, and the step of "determining the zoom factor of the target top-level image based on the displacement information" may include the following steps in order to optimize the visual effect and prevent the top-level image from being too large or too small:
acquiring a preset first multiple, a preset second multiple and a displacement range;
when the displacement information belongs to the displacement range, determining a preset first multiple as a scaling multiple of the target top-layer image;
and when the displacement information does not belong to the displacement range, determining the preset second multiple as the zoom multiple of the target top-layer image.
The preset first multiple and the preset second multiple may be determined by those skilled in the art, and may also be set by a user, and so on.
When the distance in the displacement information is too large or too small, namely the displacement information does not belong to the displacement range, the second multiple can be used as the zoom multiple of the target top-layer image, and the situations of infinite amplification and infinite reduction caused by image zooming are prevented.
In some embodiments, in order to improve compatibility of the device and facilitate switching of the landscape screen and the portrait screen by the user in consideration of the situations of the portrait screen playing and the landscape screen playing, the step "obtaining the preset first multiple, the preset second multiple, and the displacement range" may include the following steps:
acquiring screen display information, wherein the screen display information comprises a display state of a screen, a first boundary length and a second boundary length;
when the display state is a landscape state, determining a displacement range based on the first boundary length;
and when the display state is the vertical screen state, determining the displacement range based on the second boundary length.
The first boundary length may refer to a short side width of the terminal screen, and the second boundary length may refer to a long side length of the terminal screen.
In some embodiments, the top-level image may be enlarged or reduced according to the direction information in the displacement information, in which case the zoom factor may include an enlargement factor and a reduction factor, and the step of "determining the zoom factor of the target top-level image based on the displacement information" may include the steps of:
judging the displacement type of the multimedia according to the displacement information;
when the displacement type is a first direction type, determining the magnification of the target top-layer image based on the displacement information;
and when the displacement type is the second direction type, determining the reduction multiple of the target top-layer image based on the displacement information.
For example, the first direction type may refer to a type in a screen downward direction, and the second direction type may refer to a type in a screen upward direction.
105. And in the process of playing the multimedia, displaying the bottom layer image and the reference area in the multimedia, and displaying the adjusted target top layer image on the bottom layer image.
In this embodiment, the adjusted target top-level image may be superimposed on the bottom-level image.
The reference area may be located between the base layer image and the adjusted target top layer image, may be superimposed on the adjusted target top layer image, and so on.
For example, in some embodiments, referring to fig. 1d (a), the reference area may be located between the bottom layer image and the adjusted target top layer image, so step 105 may include the following steps:
superposing a reference area (3) on the bottom layer image (1), and superposing the adjusted target top layer image (2) on the reference area (3) to obtain a superposed image;
the superimposed image is displayed.
For example, in some embodiments, referring to fig. 1d (b), the reference area may be superimposed on the adjusted target top-level image, so step 105 may include the following steps:
superposing the adjusted target top image (2) on the bottom image (1), and superposing the reference area (3) on the adjusted target top image (2) to obtain a superposed image;
the superimposed image is displayed.
In some embodiments, the reference region may be a plurality of sub-regions, for example, the reference region may include two sub-regions; for example, the reference region may include four sub-regions, and so on.
For example, the reference region may include two sub-regions, which are a first reference region and a second reference region, respectively, where the first reference region may be located between the bottom layer image and the adjusted target top layer image, or may be superimposed on the adjusted target top layer image, and so on; likewise, the second reference area may be located between the bottom layer image and the adjusted target top layer image, may be superimposed on the adjusted target top layer image, and so on.
It should be noted that when the reference region includes a plurality of sub-regions, the image hierarchy relationship between the reference region, the bottom-layer image, and the adjusted target top-layer image will have a variety.
For example, when the reference area is divided into a first reference area and a second reference area, referring to fig. 1d (c), the image hierarchy relationship may be, from bottom to top: the image processing device comprises a bottom layer image (1), a first reference area (3), a second reference area (4) and an adjusted target top layer image (2).
For example, referring to fig. 1d (d), the image hierarchy may be, from bottom to top: the image processing device comprises a bottom layer image (1), a second reference area (4), a first reference area (3) and an adjusted target top layer image (2).
For example, referring to fig. 1d (e), the image hierarchy may be, from bottom to top: the image processing device comprises a bottom layer image (1), a second reference area (4), an adjusted target top layer image (2) and a first reference area (3).
For example, referring to fig. 1d (f), the image hierarchy may be, from bottom to top: the system comprises a bottom layer image (1), an adjusted target top layer image (2), a first reference area (3) and a second reference area (4). For example, referring to fig. 1d (e), the image hierarchy respectively is: the image processing device comprises a bottom layer image (1), a second reference area (4), an adjusted target top layer image (2) and a first reference area (3).
When the images are superimposed, the terminal may store the pixels of the first reference area at a first priority, store the adjusted target top-level image at a second priority, store the second reference area at a third priority, and store the bottom-level image at a fourth priority, thereby obtaining a superimposed image.
In some embodiments, like the top layer image, the bottom layer image may also be switched according to the displacement information, the number of the bottom layer images in the multimedia data is at least 2, and after step 102, the method may further include the following steps:
determining a target bottom layer image according to the displacement information bottom layer image;
the step of sequentially overlaying the first reference area, the adjusted target top-level image and the second reference area on the bottom-level image to obtain an overlaid image may include the steps of:
and sequentially superposing the first reference area, the adjusted target top layer image and the second reference area on the target bottom layer image to obtain a superposed image.
The detailed steps refer to step 103, which are not described herein.
Referring to fig. 1e, the first reference region, the adjusted target top-level image, the second reference region, and the bottom-level image, which are respectively superimposed from top to bottom according to the image hierarchy relationship, are two-dimensional planar images, but can achieve a three-dimensional visual effect.
In some embodiments, when the user performs the playing operation, the top-level image in the superimposed image may not only be switched and changed in size, but also the entire superimposed image may be shifted in the screen, so the step "displaying the superimposed image" may include the following specific steps:
determining the image display position of the superposed image according to the displacement information;
and displaying the superposed image based on the image display position to play the multimedia.
The calculation mode of the image display position can refer to the following formula:
(X,Y)=(ax,by)
where (X, Y) is coordinates of an image display position, (X, Y) is displacement information, and a and b may be preset weights, which may be set by those skilled in the art.
In some embodiments, the multimedia data may further include text content, and step 106 may include the steps of:
displaying text content around the superimposed image;
and when the triggering operation of the user for the superposed image or the text content is detected, displaying a detail page corresponding to the multimedia.
The periphery of the superimposed image may refer to a text area around the superimposed image, such as a text area on the superimposed image, a text area under the superimposed image, and the like.
For example, text content may be displayed 1cm above the superimposed image, and so on.
The triggering operation refers to operations such as clicking, touching and double-clicking of the user for the superposed image or the text content for selection, when the triggering operation of the user for the superposed image or the text content is detected, a detail page corresponding to the multimedia is displayed, and the detail page is used for displaying the detail information of the multimedia.
In some embodiments, the step of "displaying a detail page corresponding to multimedia" may comprise the steps of:
acquiring equipment information;
determining the type of equipment according to the equipment information;
when the equipment type is first equipment, triggering an application market program of the equipment to display;
and when the equipment type is second equipment, displaying a detail page corresponding to the multimedia according to the multimedia data.
The device information includes device category information, system version information, hardware information, and the like.
The first type of device may refer to a device of an IOS system, a device of an android system, a device of a windows system, a device of a Linux system, and so on.
Similarly, the second type of device may also refer to a device of an IOS system, a device of an android system, a device of a windows system, a device of a Linux system, and so on.
Wherein the first type of device type and the second type of device type are not the same.
When the device type is a first type device, an application market program of the device can be triggered, so that the application market program of the device executes the application downloading operation related to the multimedia.
When the device type is a second type device, a detail page corresponding to the multimedia can be displayed according to the multimedia data.
For example, when the device type is the IOS type, the application market program of the device may be triggered, so that the application market program of the device downloads the application corresponding to the multimedia.
In some embodiments, the multimedia data may further include a media type of the multimedia, and the step of "displaying a detail page corresponding to the multimedia according to the multimedia data" may include the steps of:
when the media type is a first media type, acquiring detailed data and playing the detailed data;
and when the media type is a second media type, displaying a detail page corresponding to the multimedia, and downloading according to a downloading link in the detail page.
Wherein the second media type is a media type representing a downloaded application and the first media type is a media type representing a non-downloaded application.
It should be noted that a series of static images may constitute a continuous screen, and the display of the series of static images is a playing mode of multimedia including moving images, such as video, animation, video, etc.
Each still image in the series of still images may be referred to as a frame image.
After step 105 is completed, the playing of one frame of image in the multimedia is completed.
When the step 102 is returned and the step 102 is executed again, the displacement information of the multimedia can be updated; determining a target top image in the plurality of top images according to the updated displacement information; re-adjusting parameters of the target top-level image based on the updated displacement information to obtain a re-adjusted target top-level image; and displaying the bottom layer image and the reference area in the multimedia, and redisplaying the adjusted target top layer image on the bottom layer image, wherein the playing of the next frame image in the multimedia is completed.
The above steps are repeatedly executed to complete the playing of the multimedia.
As can be seen from the above, the embodiment of the present invention can acquire multimedia data, where the multimedia data includes a bottom layer image, a plurality of top layer images, and at least one reference area of a multimedia; when the playing operation of a user for the multimedia is detected, determining the displacement information of the multimedia according to the playing operation; determining a target top-level image in the plurality of top-level images according to the displacement information; performing parameter adjustment on the target top image based on the displacement information to obtain an adjusted target top image; and in the process of playing the multimedia, displaying the bottom layer image and the reference area in the multimedia, and displaying the adjusted target top layer image on the bottom layer image.
In some embodiments, the multimedia data includes a plurality of bottom layer images, i.e., the number of bottom layer images in the multimedia data is at least two; after the step of determining the displacement information according to the playing operation, the method further comprises the following steps:
determining a target bottom layer image from the bottom layer images according to the displacement information;
the displaying the bottom layer image and the reference area, and displaying the adjusted target top layer image on the bottom layer image, includes:
displaying the target bottom layer image and the reference area, and displaying the adjusted target top layer image on the target bottom layer image.
Not only the moving image composed of the plurality of top layer images but also the moving image composed of the plurality of bottom layer images can be played at this time.
In the embodiment of the invention, the playing operation of the user can switch the top layer image, and the reference area is adopted to compare with the top layer image while the bottom layer image and the top layer image are displayed, so that the three-dimensional visual effect is realized. A new multimedia playing method is provided, and the scheme can improve the interactive effect of the multimedia playing method.
The method described in the above embodiments is further described in detail below.
In this embodiment, the method of the embodiment of the present invention will be described in detail by taking an application advertisement scene in a smart phone as an example.
As shown in fig. 2a, a specific flow of a multimedia playing method is as follows:
201. advertisement data is obtained, and the advertisement data comprises advertisement text content, a first reference area, a second reference area, a bottom layer image and a plurality of top layer images.
Referring to fig. 2b, 4 top images are included in the advertisement data.
Referring to fig. 2c, the advertisement data includes 1 underlying image.
The first reference region and the second reference region are both pure white rectangular images with a width of 0.2cm and a height of 3 cm.
202. When the screen sliding operation of the user aiming at the advertisement is detected, the displacement information of the advertisement is determined according to the screen sliding operation.
When the user is detected to slide the screen of the advertisement downwards or upwards, the displacement information of the advertisement can be determined according to the sliding distance and direction of the finger of the user on the screen.
203. And determining a target top image in the plurality of top images according to the displacement information, and performing parameter adjustment on the target top image based on the displacement information to obtain an adjusted target top image.
For the specific steps, reference may be made to step 103, which is not described herein again.
204. And sequentially superposing the first reference area, the adjusted target top layer image and the second reference area on the bottom layer image to obtain a superposed image.
For the specific steps, reference may be made to step 104, which is not described herein again.
205. Displaying the superposed image, and displaying the advertisement text content around the superposed image so as to play the advertisement.
Referring to fig. 2d, when the user slides up, the effect of opening slowly the envelope (top-level image) can be completed by switching the top-level image, and the effect of increasing slowly the envelope can be completed by step 203.
In some embodiments, the envelope may close when the user slides down as shown in FIG. 2 d.
In some embodiments, advertising music may be played during the opening of the envelope.
In some embodiments, the advertisement music can be played in reverse order when the user slides down, i.e. the envelope is closed.
206. And when the clicking operation of the user for the superposed image and the advertisement text content displayed around the superposed image is detected, skipping to display the advertisement detail page.
Referring to fig. 2d, when a user click operation for the superimposed image and the text content of the advertisement displayed under the superimposed image is detected, the advertisement detail page is skipped to display.
When the android system is adopted by the smart phone, the smart phone enters a download page corresponding to the advertisement to download the application, or skips to display an advertisement detail page.
When the IOS system is adopted by the smart phone, an application downloading program carried in the smart phone is triggered, and an application page corresponding to the advertisement is displayed in the application downloading program.
As can be seen from the above, the embodiment of the present invention may obtain advertisement data, where the advertisement data includes advertisement text content, a first reference area, a second reference area, a bottom layer image, and a plurality of top layer images; when detecting screen sliding operation of a user aiming at the advertisement, determining displacement information of the advertisement according to the screen sliding operation; determining a target top image in the plurality of top images according to the displacement information, and performing parameter adjustment on the target top image based on the displacement information to obtain an adjusted target top image; sequentially superposing the first reference area, the adjusted target top-layer image and the second reference area on the bottom-layer image to obtain a superposed image; displaying the superposed image, and displaying advertisement text content around the superposed image so as to play the advertisement; and when the clicking operation of the user for the superposed image and the advertisement text content displayed around the superposed image is detected, skipping to display the advertisement detail page.
In the scene of playing the advertisement, the target top image can be switched in the top image according to the sliding operation of the user, and the size of the target top image is adjusted, so that the interactive effect is enhanced; in addition, the stacking relation among the target top-level image, the first reference area and the second reference area can provide a three-dimensional visual effect for the target top-level image, and user experience is improved. Therefore, a new multimedia playing method is provided, and the scheme can improve the interactive effect of the multimedia playing method.
In order to better implement the above method, an embodiment of the present invention further provides a multimedia playing apparatus, where the multimedia playing apparatus may be specifically integrated in an electronic device, and the electronic device may be a terminal. The terminal can be a mobile phone, a tablet computer, an intelligent Bluetooth device, a notebook computer, a personal computer and other devices.
For example, in the present embodiment, the method of the embodiment of the present invention will be described in detail by taking an example that the multimedia playing apparatus is specifically integrated in a smart phone.
For example, as shown in fig. 3, the multimedia playing apparatus may include an obtaining unit 301, a detecting unit 302, a target unit 303, an adjusting unit 304, a superimposing unit 305, and a display unit 306, as follows:
acquisition unit 301
The acquiring unit 301 may be configured to acquire multimedia data, where the multimedia data includes a bottom layer image, multiple top layer images, and at least one reference area.
(II) a detection unit 302.
The detecting unit 302 may be configured to determine, when a playing operation of the multimedia by the user is detected, displacement information of the multimedia according to the playing operation.
In some embodiments, the multimedia data may further include audio information, and the detection unit 302 may further be configured to play the audio information after determining the displacement information according to the playing operation.
(iii) target unit 303.
The target unit 303 may be configured to determine a target top-level image among the plurality of top-level images according to the displacement information.
(iv) an adjusting unit 304.
The adjusting unit 304 may be configured to perform parameter adjustment on the target top-level image based on the displacement information, so as to obtain an adjusted target top-level image.
In some embodiments, the adjustment unit 304 may include a size subunit, a multiple subunit, a parameter subunit, and an adjustment subunit, as follows:
(1) a size subunit.
And the size subunit is used for determining the original image size of the target top image.
(2) A multiple subunit.
And the multiple subunit is used for determining the scaling multiple of the target top-layer image based on the displacement information.
(3) A parameter subunit.
And the parameter subunit is used for determining the size adjustment parameter of the target top-level image based on the original size of the image and the zoom factor.
(4) And adjusting the subunit.
And the adjusting subunit is used for adjusting the target top layer image according to the size adjusting parameter to obtain the adjusted target top layer image.
In some embodiments, the multiple subunit may be specifically configured to:
acquiring a preset first multiple, a preset second multiple and a displacement range;
when the displacement information belongs to the displacement range, determining a preset first multiple as a scaling multiple of the target top-layer image;
and when the displacement information does not belong to the displacement range, determining the preset second multiple as the zoom multiple of the target top-layer image.
In some embodiments, the step of "obtaining a preset first multiple, a preset second multiple, and a displacement range" may specifically include:
acquiring screen display information, wherein the screen display information comprises a display state of a screen, a first boundary length and a second boundary length;
when the display state is a landscape state, determining a displacement range based on the first boundary length;
and when the display state is the vertical screen state, determining the displacement range based on the second boundary length.
In some embodiments, the zoom factor includes a magnification factor and a reduction factor, and the factor subunit may be specifically configured to:
judging the displacement type of the multimedia according to the displacement information;
when the displacement type is a first direction type, determining the magnification of the target top-layer image based on the displacement information;
and when the displacement type is the second direction type, determining the reduction multiple of the target top-layer image based on the displacement information.
(V) a display unit 305.
The display unit 305 may be configured to display the bottom layer image and the reference area in the multimedia and display the adjusted target top layer image on the bottom layer image during the process of playing the multimedia.
In a specific implementation, the above units may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and the specific implementation of the above units may refer to the foregoing method embodiments, which are not described herein again.
As can be seen from the above, the multimedia playing apparatus of the present embodiment includes an obtaining unit, configured to obtain multimedia data, where the multimedia data includes a bottom layer image, a plurality of top layer images, and at least one reference area; when the detection unit detects the playing operation of the user for the multimedia, determining the displacement information of the multimedia according to the playing operation; determining a target top-level image in the plurality of top-level images by the target unit according to the displacement information; the adjustment unit adjusts parameters of the target top image based on the displacement information to obtain an adjusted target top image; and displaying the bottom layer image and the reference area in the multimedia by the display unit in the process of playing the multimedia, and displaying the adjusted target top layer image on the bottom layer image. Therefore, the embodiment of the scheme can improve the interactive effect of the multimedia playing method.
The embodiment of the invention also provides the terminal. The terminal can be a mobile phone, a tablet computer, an intelligent Bluetooth device, a notebook computer, a personal computer, and the like.
In this embodiment, a detailed description will be given by taking the electronic device of this embodiment as an example of a terminal, for example, as shown in fig. 4, which shows a schematic structural diagram of a terminal according to an embodiment of the present invention, specifically:
the terminal may include components such as a processor 401 of one or more processing cores, memory 402 of one or more computer-readable storage media, a power supply 403, an input module 404, and a communication module 405. Those skilled in the art will appreciate that the terminal configuration shown in fig. 4 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:
the processor 401 is a control center of the terminal, links various parts of the entire terminal using various interfaces and lines, and performs various functions of the terminal and processes data by operating or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby integrally monitoring the terminal. In some embodiments, processor 401 may include one or more processing cores; in some embodiments, processor 401 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 401.
The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by operating the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 access to the memory 402.
The terminal also includes a power supply 403 for powering the various components, and in some embodiments, the power supply 403 may be logically coupled to the processor 401 via a power management system, such that the power management system may perform functions of managing charging, discharging, and power consumption. The power supply 403 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
The terminal may also include an input module 404, the input module 404 being operable to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
The terminal may also include a communication module 405, and in some embodiments the communication module 405 may include a wireless module, through which the terminal may wirelessly transmit over short distances, thereby providing wireless broadband internet access to the user. For example, the communication module 405 may be used to assist a user in sending and receiving e-mails, browsing web pages, accessing streaming media, and the like.
Although not shown, the terminal may further include a display unit and the like, which will not be described in detail herein. Specifically, in this embodiment, the processor 401 in the terminal loads the executable file corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 401 runs the application programs stored in the memory 402, thereby implementing various functions as follows:
acquiring multimedia data, wherein the multimedia data comprises a bottom layer image, a plurality of top layer images and at least one reference area of multimedia;
when the playing operation of a user for the multimedia is detected, determining the displacement information of the multimedia according to the playing operation;
determining a target top-level image in the plurality of top-level images according to the displacement information;
performing parameter adjustment on the target top image based on the displacement information to obtain an adjusted target top image;
and in the process of playing the multimedia, displaying the bottom layer image and the reference area in the multimedia, and displaying the adjusted target top layer image on the bottom layer image.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
Therefore, the embodiment of the invention can improve the interaction effect of the multimedia playing method.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.
To this end, the embodiment of the present invention provides a computer-readable storage medium, in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute the steps in any one of the multimedia playing methods provided by the embodiment of the present invention. For example, the instructions may perform the steps of:
acquiring multimedia data, wherein the multimedia data comprises a bottom layer image, a plurality of top layer images and at least one reference area of multimedia;
when the playing operation of a user for the multimedia is detected, determining the displacement information of the multimedia according to the playing operation;
determining a target top-level image in the plurality of top-level images according to the displacement information;
performing parameter adjustment on the target top image based on the displacement information to obtain an adjusted target top image;
and in the process of playing the multimedia, displaying the bottom layer image and the reference area in the multimedia, and displaying the adjusted target top layer image on the bottom layer image.
Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the storage medium can execute the steps in any multimedia playing method provided in the embodiments of the present invention, the beneficial effects that can be achieved by any multimedia playing method provided in the embodiments of the present invention can be achieved, which are detailed in the foregoing embodiments and will not be described herein again.
The multimedia playing method, the multimedia playing device, the multimedia playing terminal and the computer-readable storage medium according to the embodiments of the present invention are described in detail, and a specific example is applied to illustrate the principle and the implementation manner of the present invention, and the description of the embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (15)

1. A multimedia playing method, comprising:
acquiring multimedia data, wherein the multimedia data comprises a bottom layer image, a plurality of top layer images and at least one reference area of multimedia;
when the playing operation of a user for the multimedia is detected, determining the displacement information of the multimedia according to the playing operation;
determining a target top layer image in the plurality of top layer images according to the displacement information;
performing parameter adjustment on the target top image based on the displacement information to obtain an adjusted target top image;
and in the process of playing the multimedia, displaying the bottom layer image and the reference area in the multimedia, and displaying the adjusted target top layer image on the bottom layer image.
2. The multimedia playing method of claim 1, wherein performing parameter adjustment on the target top-level image based on the displacement information to obtain an adjusted target top-level image comprises:
determining an original image size of the target top image;
determining a zoom factor of the target top-layer image based on the displacement information;
determining a size adjustment parameter of the target top-layer image based on the original size of the image and the zoom factor;
and adjusting the target top image according to the size adjustment parameter to obtain the adjusted target top image.
3. The method for playing multimedia as claimed in claim 2, wherein determining the zoom factor of the target top-level image based on the displacement information comprises:
acquiring a preset first multiple, a preset second multiple and a displacement range;
when the displacement information belongs to the displacement range, determining the preset first multiple as a scaling multiple of the target top-layer image;
and when the displacement information does not belong to the displacement range, determining the preset second multiple as the scaling multiple of the target top-layer image.
4. The multimedia playback method as claimed in claim 3, further comprising:
acquiring screen display information, wherein the screen display information comprises a display state of a screen, a first boundary length and a second boundary length;
when the display state is a landscape state, determining a displacement range based on the first boundary length;
and when the display state is a vertical screen state, determining a displacement range based on the second boundary length.
5. The method of claim 1, wherein displaying the bottom layer image and the reference area in the multimedia and displaying the adjusted target top layer image on the bottom layer image during the playing of the multimedia comprises:
superposing a reference area on the bottom layer image, and superposing the adjusted target top layer image on the reference area to obtain a superposed image;
and displaying the superposed image in the multimedia in the process of playing the multimedia.
6. The multimedia playing method of claim 5, wherein the reference area comprises a first reference area and a second reference area, and wherein the step of superimposing the reference area on the bottom layer image and superimposing the adjusted target top layer image on the reference area to obtain a superimposed image comprises:
and superposing the second reference area, the adjusted target top-layer image and the first reference area on the bottom-layer image in sequence to obtain a superposed image.
7. The method as claimed in claim 5, wherein displaying the overlay image in the multimedia during playing the multimedia comprises:
determining the image display position of the superposed image according to the displacement information;
and in the process of playing the multimedia, displaying the superposed image in the multimedia based on the image display position.
8. The multimedia playback method of claim 5, wherein the multimedia data further comprises text content;
in the process of playing the multimedia, after the superimposed image is displayed in the multimedia, the method further comprises:
displaying the text content around the superimposed image;
and when the triggering operation of the user for the superposed image or the text content is detected, displaying a detail page corresponding to the multimedia.
9. The method for playing multimedia as claimed in claim 8, wherein displaying the detail page corresponding to the multimedia comprises:
acquiring equipment information;
determining the type of equipment according to the equipment information;
when the device type is a first type device, triggering an application market program of the device to display;
and when the equipment type is second equipment, displaying a detail page corresponding to the multimedia according to the multimedia data.
10. The method for playing multimedia as claimed in claim 9, wherein the multimedia data further includes a media type of the multimedia, and the displaying a detail page corresponding to the multimedia according to the multimedia data includes:
when the media type is a first media type, acquiring detailed data and processing the detailed data;
and when the media type is a second media type, displaying a detail page corresponding to the multimedia, and downloading according to a downloading link in the detail page.
11. The multimedia playing method of claim 1, wherein the multimedia data further comprises a plurality of audio sub-information;
the multimedia playing method further comprises the following steps: determining target audio sub-information in the plurality of audio sub-information according to the displacement information;
and playing audio according to the target audio sub-information.
12. The multimedia playback method of claim 1, wherein the number of base layer images in the multimedia data is at least two;
after determining the displacement information according to the playing operation, the method further comprises the following steps:
determining a target bottom layer image from the bottom layer images according to the displacement information;
the displaying the bottom layer image and the reference area, and displaying the adjusted target top layer image on the bottom layer image, includes:
displaying the target bottom layer image and the reference area, and displaying the adjusted target top layer image on the target bottom layer image.
13. A multimedia processing apparatus, comprising:
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring multimedia data, and the multimedia data comprises a bottom layer image, a plurality of top layer images and at least one reference area of multimedia;
the detection unit is used for determining the displacement information of the multimedia according to the playing operation when the playing operation of the user for the multimedia is detected;
the target unit is used for determining a target top layer image in the top layer images according to the displacement information;
the adjusting unit is used for carrying out parameter adjustment on the target top layer image based on the displacement information to obtain an adjusted target top layer image;
and the display unit is used for displaying the bottom layer image and the reference area in the multimedia in the process of playing the multimedia, and displaying the adjusted target top layer image on the bottom layer image.
14. A terminal comprising a processor and a memory, said memory storing a plurality of instructions; the processor loads instructions from the memory to perform the steps of the multimedia playing method according to any one of claims 1 to 12.
15. A computer-readable storage medium storing instructions adapted to be loaded by a processor to perform the steps of the multimedia playing method according to any of claims 1 to 12.
CN201911067408.XA 2019-11-04 2019-11-04 Multimedia playing method, device, terminal and storage medium Active CN112770099B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911067408.XA CN112770099B (en) 2019-11-04 2019-11-04 Multimedia playing method, device, terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911067408.XA CN112770099B (en) 2019-11-04 2019-11-04 Multimedia playing method, device, terminal and storage medium

Publications (2)

Publication Number Publication Date
CN112770099A CN112770099A (en) 2021-05-07
CN112770099B true CN112770099B (en) 2022-06-14

Family

ID=75692584

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911067408.XA Active CN112770099B (en) 2019-11-04 2019-11-04 Multimedia playing method, device, terminal and storage medium

Country Status (1)

Country Link
CN (1) CN112770099B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104574256A (en) * 2013-10-23 2015-04-29 腾讯科技(深圳)有限公司 Method and device for locally selecting and processing image
CN107580228A (en) * 2017-09-15 2018-01-12 赵立峰 A kind of monitor video processing method, device and equipment
CN109348299A (en) * 2018-11-08 2019-02-15 北京微播视界科技有限公司 Comment on answering method, device, equipment and storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9888274B2 (en) * 2015-04-21 2018-02-06 Edge2020, Llc Price driven multimedia content reception

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104574256A (en) * 2013-10-23 2015-04-29 腾讯科技(深圳)有限公司 Method and device for locally selecting and processing image
CN107580228A (en) * 2017-09-15 2018-01-12 赵立峰 A kind of monitor video processing method, device and equipment
CN109348299A (en) * 2018-11-08 2019-02-15 北京微播视界科技有限公司 Comment on answering method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN112770099A (en) 2021-05-07

Similar Documents

Publication Publication Date Title
CN107341018B (en) Method and device for continuously displaying view after page switching
US20180349025A1 (en) Display device including button configured according to displayed windows and control method therefor
US10228835B2 (en) Method for displaying information, and terminal equipment
US20150248722A1 (en) Web based interactive multimedia system
CN112860163B (en) Image editing method and device
CN111612873A (en) GIF picture generation method and device and electronic equipment
CN106250421A (en) A kind of method shooting process and terminal
WO2017032078A1 (en) Interface control method and mobile terminal
CN110716906A (en) File viewing method, electronic equipment and file viewing device
CN106095229A (en) The display packing of a kind of mobile terminal and device
CN114564263A (en) Page layout adjusting method and device
CN107861711B (en) Page adaptation method and device
CN111835972B (en) Shooting method and device and electronic equipment
CN112770099B (en) Multimedia playing method, device, terminal and storage medium
CN114880606A (en) Page display method, device, equipment, medium and program product
KR101825598B1 (en) Apparatus and method for providing contents, and computer program recorded on computer readable recording medium for executing the method
CN114385062A (en) Display scheme switching method and device, readable storage medium and electronic equipment
KR20190064633A (en) Method and apparatus for displaying pages, graphical user interface, and mobile terminal
KR101895865B1 (en) System and method for adaptive playing of landscape video content
CN114390205B (en) Shooting method and device and electronic equipment
CN114915850B (en) Video playing control method and device, electronic equipment and storage medium
KR101532766B1 (en) Contents reproducing system based on a dynamic layer
RU2743956C1 (en) Method for creating vertically oriented video
Ross et al. Media richness, interactivity and retargeting to mobile devices: a survey
CN117255219A (en) Comment processing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40044650

Country of ref document: HK

SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant