CN107295393B - method and device for displaying additional media in media playing, computing equipment and computer-readable storage medium - Google Patents
method and device for displaying additional media in media playing, computing equipment and computer-readable storage medium Download PDFInfo
- Publication number
- CN107295393B CN107295393B CN201610221533.1A CN201610221533A CN107295393B CN 107295393 B CN107295393 B CN 107295393B CN 201610221533 A CN201610221533 A CN 201610221533A CN 107295393 B CN107295393 B CN 107295393B
- Authority
- CN
- China
- Prior art keywords
- media
- panoramic
- picture
- user
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Abstract
The application discloses an additional media display method in media playing, which is applied to a media playing client and comprises the following steps: acquiring additional media data corresponding to the media file; the additional media data comprises a panoramic media material, the panoramic media material comprises a picture divided into a plurality of parts, a plurality of pictures or a three-dimensional video, wherein each part of the picture or each of the plurality of pictures corresponds to a different view angle, and the three-dimensional video can be displayed at different view angles; monitoring the operation of a user; responding to the monitored operation, and determining a visual angle corresponding to the operation; and displaying a part of the picture or one of the pictures corresponding to the view angle in the panoramic media material, or displaying the three-dimensional video by the view angle. The application also discloses a corresponding device. By adopting the method and the device, the media display effect can be improved.
Description
Technical Field
The present application relates to the field of Information Technology (IT), and in particular, to a method and an apparatus for displaying additional media during media playing.
Background
with the development of the internet, various online media playing technologies emerge, and a user can request and watch various media files such as videos online through a media playing client (e.g., an online video client) on a PC or various mobile terminals.
Currently, when a media file is played, various additional media can be pushed, such as: inserting a patch advertisement, and pushing promotion information (such as news, public service propaganda information and the like). However, the display mode of the additional media is fixed and single, and the display effect needs to be improved.
Disclosure of Invention
In view of this, the present application provides a method and an apparatus for displaying additional media during media playing to improve a media displaying effect.
The technical scheme of the embodiment of the invention is realized as follows:
The application provides an additional media display method in media playing, which is applied to a media playing client and comprises the following steps: acquiring additional media data corresponding to the media file; the additional media data comprises a panoramic media material, the panoramic media material comprises a picture divided into a plurality of parts, a plurality of pictures or a three-dimensional video, wherein each part of the picture or each of the plurality of pictures corresponds to a different view angle, and the three-dimensional video can be displayed at different view angles; monitoring the operation of a user; responding to the monitored operation, and determining a visual angle corresponding to the operation; and displaying a part of the picture or one of the pictures corresponding to the view angle in the panoramic media material, or displaying the three-dimensional video by the view angle.
the present application further provides an additional media display device in media playing, which is disposed in a media playing client, and the device includes: the acquisition module acquires additional media data corresponding to the media file; the additional media data comprises a panoramic media material, the panoramic media material comprises a picture divided into a plurality of parts, a plurality of pictures or a three-dimensional video, wherein each part of the picture or each of the plurality of pictures corresponds to a different view angle, and the three-dimensional video can be displayed at different view angles; the monitoring module monitors the operation of the user; and the display module responds to the monitored operation, determines a visual angle corresponding to the operation, displays a part of the picture or one of the pictures corresponding to the visual angle in the panoramic media material, or displays the three-dimensional video by the visual angle.
The method and the device provided by the application can realize the additional media display of the panoramic effect and obviously improve the display effect of the media playing client.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts. Wherein the content of the first and second substances,
FIG. 1 is a schematic illustration of an implementation environment to which the present application is directed;
FIG. 2 is a schematic flow chart of a method according to an example of the present application;
FIG. 3 is an exemplary diagram of a panoramic media material of a 360 degree picture;
FIG. 4 is an exemplary diagram of a panoramic media material of a 360 degree picture;
FIG. 5 is a chartlet example of 3D video material for a 360 degree video;
FIG. 6 is an exemplary diagram of 3D video material for a 360 degree video;
FIG. 7 is an exemplary diagram of additional media presentation;
FIG. 8 is an exemplary diagram of additional media presentation; and
Fig. 9 is a schematic diagram of the structure of the apparatus and the device according to an example of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic diagram of an implementation environment to which the present application is directed. As shown in fig. 1, a media playing client 102 is built in a user terminal 101, and the media playing client 102 can interact with a media playing server 103 through the internet 105 to obtain a media file from the media playing server 103, so as to be able to request the media file such as a video on line. The additional media server 104 is used to provide additional media data, such as: the advertiser can provide advertisement material, advertisement data (an additional media data) containing the advertisement material is stored by an advertisement server (an additional media server) and provided to the media playback server 103 through the internet, and is provided to the media playback client 102 in the user terminal 101 by the media playback server 103. The media playing client 102 can obtain additional media data (e.g., advertisement data) from the additional media server 104 through the internet 105, and can show corresponding additional media (e.g., advertisement) during the showing of a certain media file on demand.
the present application provides an additional media display method in media playing, which is applied to the media playing client 102 in fig. 1. In one example, as shown in FIG. 2, the method includes the steps of:
Step 201: and acquiring additional media data corresponding to the media file. The additional media data includes a panoramic media material, the panoramic media material includes a picture divided into a plurality of portions, a plurality of pictures, or a three-dimensional video, each portion of the picture or each of the plurality of pictures corresponds to a different viewing angle, and the three-dimensional video can be displayed at different viewing angles.
In one example, additional media data corresponding to a media file may be acquired during presentation of the media file. Here, the presentation of the media file may refer to one of the following cases: the media playing client is ready to play the media file (the additional media shown at this time may be referred to as a front tile), playing the media file, pausing the playing of the media file, and finishing the playing of the media file (the additional media shown at this time may be referred to as a rear tile). In a specific application scenario, the media file is a video of a certain television episode that can be on-demand online, and the additional media data is advertisement data, so that corresponding advertisement data (also referred to as front tile advertisement) can be obtained when the video of the episode is ready to be played, or the corresponding advertisement data can be obtained during the video playing of the episode, or the corresponding advertisement data (also referred to as rear tile advertisement) can be obtained when the video of the episode is paused to be played, or the video of the episode is finished to be played.
Here, each part of the picture or each of the multiple pictures corresponds to a different view angle, or the different view angles based on which the three-dimensional video is displayed may be multiple view angles in the same two-dimensional plane, or multiple view angles in the same three-dimensional space. Here, the correspondence between each part of the picture or each of the plurality of pictures or the map part of the three-dimensional video and the different viewing angles may be established based on a preset certain panoramic picture/video model. The provider of the additional data may provide multiple pictures or multiple videos taken by the panoramic camera as needed, such that the pictures or videos may be used to stitch together a panoramic picture or panoramic three-dimensional video material (i.e., panoramic media material), wherein the panoramic picture is divided into multiple portions or includes multiple pictures, each portion or picture corresponding to a different viewing angle, the panoramic three-dimensional video is in fact a three-dimensional stereo map, and each mapped portion corresponds to a different viewing angle. Here, a perspective may represent a visual direction, referring to a direction from a viewpoint (also referred to as a camera) to a visual object, and different visual directions may be characterized by different perspectives.
Step 202: and monitoring the operation of the user.
When the media playing client is located in a Personal Computer (PC), the operations performed by the user through the input device of the PC can be monitored in this step. Such as: the monitoring user performs various operations (such as moving from a certain position to another position or clicking a certain position, etc.) in the presentation interface of the media client by dragging/clicking a mouse or operating a keyboard, a handle, etc.
When the media playing client is located at the mobile terminal, the operation of the monitoring user includes: and monitoring gesture operation on a touch screen of the mobile terminal and/or monitoring gesture change of the mobile terminal through a gyroscope of the mobile terminal. For example: the monitoring user monitors the posture change of the mobile terminal through sliding operation on the touch screen or by utilizing the gravity acceleration sensing capability of the gyroscope, and further can monitor the operation that the user holds the mobile terminal by hand and rotates. Here, the mobile terminal refers to various portable electronic devices having a display function, such as: mobile phones, tablet computers, palm computers, ultrabooks, wearable devices, and the like.
Step 203: and in response to the monitored operation, determining a visual angle corresponding to the operation. Here, the correspondence between various operations and the respective views may be established in advance according to implementation needs.
Step 204: and displaying a part of the one picture or one of the plurality of pictures corresponding to the view angle determined in the step 203 in the panoramic media material, or displaying the three-dimensional video at the view angle determined in the step 203.
by adopting the above example, when the user requests the media file by using the media playing client, the media playing client can display the panoramic additional media, such as the panoramic picture of the advertisement or the promotion information or the panoramic three-dimensional video. Based on user operation (such as mouse click/drag operation, finger sliding touch screen, rotation of a mobile terminal where a media client is held in a handheld manner, and the like), different pictures (parts) or different three-dimensional video mapping parts corresponding to different visual angles in the panoramic picture or the panoramic three-dimensional video can be displayed, so that the user can feel more personally on the scene, the seen pictures or videos can change along with the change of the visual direction (or visual angle), and the display effect of the additional media can be obviously improved.
the panoramic picture and the panoramic three-dimensional video described above may be referred to as a 360-degree picture and a 360-degree video. Specific implementations of 360 degree pictures and 360 degree videos are described below.
firstly, a 360-degree picture has two implementation modes: one is that the viewpoint (or viewing angle) is outside the picture, i.e. objects in the picture are viewed from the outside, and one is that the viewpoint is inside the picture, i.e. objects in the picture are viewed from the inside. The two ways of implementing the logic are slightly different and will be explained separately below.
1. views outside the picture
the viewpoint is outside the picture, so that the user can imagine that the user stands in front of an object, the object continuously rotates, and the user observes the process of 360-degree complete view of the object.
For example, if the bicycle shown in fig. 3 is rotated every 10 degrees on a horizontal plane, 36 pictures are obtained.
The additional media display effect realized in this way is as follows:
When the additional media (such as picture advertisement patches) of pictures are displayed, the media playing client monitors the operation of the user, for example, the user holds the mobile terminal to rotate, the media playing client can play a plurality of object pictures at different angles in sequence according to the monitored posture change of the mobile terminal, and the user can generate a rotating display effect by utilizing the persistence of vision generated by human eyes.
In the specific implementation, the panoramic media material is prepared in advance. Photographs of an object at various angles can be taken and the photographs can be spliced into a panoramic picture (which may be called a sprite) as a panoramic media material, so that the panoramic picture comprises a plurality of parts or a plurality of pictures, and each part or each picture is a photograph of an angle of the object and also corresponds to a visual direction (i.e. a visual angle). When the media playing client acquires such additional media data, the Canvas tag of the HTML5 page can be used to load such a panoramic picture in the additional media data. And then, monitoring the operation of the user by utilizing the related class library, determining a visual angle corresponding to the monitored operation, and further quickly switching different pictures or different picture parts in the panoramic picture based on the operation of the user to form the display effect of the animation.
2. the view point is in the picture
The viewpoint is inside the picture, such as a panoramic picture that can be taken with a cell phone, as shown in fig. 4, and the photographer takes a surrounding scene in a 360 degree turn in situ, so that a 360 degree overview of the surrounding scene can be observed.
For example, the scene shown in fig. 4, if the photographer rotates every 10 degrees on a horizontal plane, 36 pictures are obtained, and the pictures are spliced together to form a panoramic picture.
The additional media display effect realized in this way is as follows:
When additional media (such as picture advertisement patches) of pictures are displayed, the media playing client monitors the operation of a user, for example, the user holds the mobile terminal to rotate, the media playing client can play a plurality of scenery pictures at different angles in sequence according to the monitored posture change of the mobile terminal, and the user can generate the display effect that scenery rotates around the scenery pictures by utilizing the persistence of vision generated by human eyes.
In the specific implementation, the panoramic media material is prepared in advance. The panoramic picture comprises a plurality of parts or a plurality of pictures, and each part or each picture is a scene picture shot when the camera rotates to a certain angle and also corresponds to a visual direction (namely a visual angle). When the media playing client acquires such additional media data, the Canvas tag of the HTML5 page can be used to load such a panoramic picture in the additional media data. And then, monitoring the operation of the user by utilizing the related class library, determining a visual angle corresponding to the monitored operation, and further quickly switching different pictures or different picture parts in the panoramic picture based on the operation of the user to form the display effect of the animation.
the implementation principle of the second and 360-degree videos is as follows:
first, a panoramic media material of a 360-degree video, which may also be referred to as a 3D video material, is to be made. The 3D video material can be thought of as a globe resembling the earth, and the globe can have different texture maps, such as green forest, blue ocean, if viewing it standing on the globe's periphery, the outline of the entire globe can be seen, as well as the texture maps thereon. For a 360-degree video, it can be understood that a video picture itself is also a map, and after the video picture is shot by a special 360-degree camera, the video picture is pasted on a sphere as a planar material, and due to the particularity of the material, the whole spherical picture can be seen to be in seamless connection after the map is pasted, as shown in fig. 5.
the 360-degree video effect is that a viewer is used as a part of the center of a sphere, a viewpoint or a camera is placed inside the sphere to observe, and then different mapping parts of a video can be seen through the rotation of the sphere. As shown in fig. 6.
The additional media display effect realized in this way is as follows:
when the video additional media (such as video advertisement patches) are displayed, the media playing client monitors the operation of the user, for example, the user holds the mobile terminal to rotate, and the media playing client can play the 3D videos at different visual angles in sequence according to the monitored posture change of the mobile terminal, so that the user can generate the feeling that the 3D scenes rotate around the user, and the display effect of being personally on the scene is achieved.
In the specific implementation, the panoramic media material is prepared in advance. For 360 degree Video, panoramic media material includes 3D Video material, such as FLV (Flash Video) or MP43 Video material, captured and encoded by professional 3D cameras. When the media playing client acquires the additional media data, the rich media container can be used to load the 3D video material, where the rich media container may be a Flash-based rich media plug-in (also called rich media shell) for the media playing client on the PC side, and may be a web view (webview) container of HTML5 page for the media playing client on the mobile terminal. Then, the operation of the user can be monitored by using a related class library (e.g., away3D of the PC end, thread. js of the mobile end), the visual direction corresponding to the monitored operation is determined, and then different visual angles can be quickly switched based on the operation of the user and the 3D video can be played at different visual angles, so that the display effect of the 3D animation is formed.
In an example, the obtaining additional media data corresponding to the media file (e.g., obtaining 360 degrees of video advertisement material corresponding to the current main video) may include: and acquiring additional media data corresponding to the media file from the outside by executing the association logic of the additional media (such as the order logic of the advertisement) through an association logic plug-in (such as the order logic plug-in of the advertisement) in the media playing client (such as the order logic plug-in of the video playing client can acquire the advertisement data corresponding to the video file through executing the order logic of the advertisement). And then loading the panoramic media material in the additional media data acquired by the associated logic plug-in by the rich media plug-in the media playing client. The displaying a part of one or more pictures corresponding to the view angle in the panoramic media material, or displaying the three-dimensional video at the determined view angle may include: and displaying a part of one or one of a plurality of pictures corresponding to the visual angle in the panoramic media material by the rich media plug-in, or displaying the three-dimensional video by the rich media plug-in according to the visual angle. When the media playing client is located in the PC, the associated logic plug-in can be a Flash plug-in, and the rich media plug-in can be a rich media shell on the Flash plug-in; when the media playing client is located in the mobile terminal, the associated logic plug-in may be a Software Development Kit (SDK) plug-in, and the rich media plug-in may be a web view (webview) plug-in.
The following takes an example in which the additional media is a 360-degree video advertisement, and further describes the technical scheme provided by the present application.
Firstly, a media playing client is positioned at a mobile terminal
The 360-degree video advertisement is realized by front-end technologies such as HTML5+ JS + CSS 3. The bottom layer is a media playing client, such as a video Application (APP), and the SDK plug-in above the APP executes order logic to obtain advertisement material (including 360-degree video advertisement material), and the media playing client implements playing logic of a main video (i.e., the aforementioned media file). The rich media plug-in is a webview page, is built by an APP and then is stacked on a playing layer of a main video, and then functions of loading 360-degree video advertisement materials, realizing 3D effects and the like are achieved in the webview page.
Secondly, the media playing client is positioned on the PC
The 360-degree video advertisement is realized by a Flash technology, a flight video main player is arranged at the bottom layer, then an advertisement plug-in (a Flash plug-in on which a rich media plug-in is operated is carried out, the Flash technology is adopted) is loaded by the main player, order logic is realized, finally, the 360-degree video material and the rich media shell are obtained by parameter content returned by an order, and finally, the realization of 360-degree video effect is completed by the rich media shell.
In one example, before displaying the picture or the three-dimensional video in the panoramic media material, the user may be prompted whether to display the panoramic effect of the additional media, and when the user determines to display the panoramic effect, the user enters the panoramic effect display mode to start monitoring the user's operation. In this case, the default additional media data may be displayed first, for example, a part of one or one of a plurality of pictures in a picture corresponding to the preset view angle in the panoramic media material, or a three-dimensional video in the panoramic media material is displayed at the preset view angle, or a picture or a segment of video other than the panoramic media material carried in the additional media data, and the user is prompted whether to display the panoramic effect. For example, the additional media is a tile advertisement, as shown in fig. 7, a default tile 701 may be displayed first, the default tile does not have a panoramic display effect, and meanwhile, whether the panoramic display effect needs to be displayed is prompted by an icon 702, and a user may enter a panoramic display mode of the advertisement by clicking the icon 702 so as to start an operation for monitoring (e.g., dragging a mouse, rotating a terminal device, performing a gesture operation on a touch screen, etc.).
in an example, after the operation of monitoring the user is started (i.e., after the panoramic display mode of the additional media is entered), the media playing client may enter a prompt to prompt the user whether to stop displaying the panoramic effect (e.g., a prompt icon 801 is displayed in the user interface as shown in fig. 8), and when a response that the user confirms to stop displaying the panoramic effect is received (e.g., the user clicks the icon 801 prompting whether to stop displaying the panoramic effect), the media playing client exits the panoramic display mode to stop monitoring the operation of the user.
in one example, when the default additional media data is displayed, such as a part of one or more pictures in a picture corresponding to a preset view angle in the panoramic media material, or a three-dimensional video in the panoramic media material is displayed at the preset view angle, or a picture or a video other than the panoramic media material carried in the additional media data, the countdown may be started according to a preset time length (as shown in 703 in fig. 7), and may be paused when a response that the user confirms that the panoramic effect is to be displayed is received, and may be resumed when a response that the user confirms that the panoramic effect is stopped being displayed is received after the panoramic display mode is entered.
Based on the above method, the present application further provides an additional media presentation device, which can be placed in a media playing client, as shown in fig. 9, and includes the following modules: an acquisition module 901, a monitoring module 902 and a display module 903.
An obtaining module 901, which obtains additional media data corresponding to the media file; the additional media data includes a panoramic media material, the panoramic media material includes a picture divided into a plurality of portions, a plurality of pictures or a three-dimensional video, wherein each portion of the picture or each of the plurality of pictures corresponds to a different viewing angle, and the three-dimensional video can be displayed at different viewing angles. Here, the obtaining module 901 may obtain the additional media data corresponding to the media file during the presentation of the media file by the media playing client.
And the monitoring module 902 monitors the operation of the user.
The displaying module 903, in response to the operation monitored by the monitoring module 902, determines a viewing angle corresponding to the operation, displays a part of the one or one of the multiple pictures corresponding to the viewing angle in the panoramic media material, or displays the three-dimensional video at the viewing angle.
In one example, the apparatus may further comprise: a prompt module 904. After the obtaining module 901 obtains the additional media data, the displaying module 903 further displays a part of the one picture or one of the multiple pictures corresponding to a preset view angle in the panoramic media material, or displays the three-dimensional video at a preset view angle, or displays a picture or a section of video other than the panoramic media material in the additional media data, and triggers the prompting module 904. The prompting module 904 prompts the user whether to display the panoramic effect after being triggered by the displaying module 903, and when a response that the user confirms that the panoramic effect is to be displayed is received, the triggering monitoring module 902 starts monitoring the operation of the user. The prompting module 904 further prompts the user whether to stop displaying the panoramic effect, and when a response that the user confirms to stop displaying the panoramic effect is received, the monitoring module 902 is triggered to stop monitoring the operation of the user.
In one example, the apparatus may further comprise: a timing module 905. The display module 903 further triggers the timing module 905 to count down according to a preset duration when a part of the one picture or one of the multiple pictures at a preset view angle is displayed, or the three-dimensional video is displayed at the preset view angle, or a picture or a section of video other than the panoramic media material is displayed. A prompt module 904, which further triggers the timing module 905 to pause the countdown when receiving a response that the user confirms that the panoramic effect is to be displayed; the timer module 905 is further triggered to continue counting down when a response is received from the user confirming that the panoramic effect is stopped being shown.
the specific implementation of the functions of the modules has been described above, and is not described herein.
in addition, each module in each example of the present application may be integrated into one processing unit, or each module may exist alone physically, or two or more devices or modules may be integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
In one embodiment, the additional media presentation apparatus may be run in any computing device capable of media presentation (such as a computing device including a display interface) and loaded in a memory of the computing device, where the memory may include: random Access Memory (RAM), nonvolatile Memory, and/or the like. As shown in FIG. 9, the computing device may further include, in addition to the modules 901-905 of the additional media presentation apparatus: memory 920, processor 910, bus 940, port 930. The processor 910 and the memory 920 are interconnected by a bus 940. Processor 910 may receive and transmit data through port 930 to enable network communications and/or local communications. The modules 901 to 905 may be machine-executable instruction modules stored in the memory 920. The processor 910 can further implement the functions of the modules 901 to 905 by executing machine-executable instructions included in the modules 901 to 904 in the memory 920.
in the above computing device, the specific method for each module 901 to 905 to implement its function is described in the foregoing method example, and is not described here again.
When the computing device where the additional media presentation apparatus is located is a PC, the computing device may include a peripheral input device capable of receiving a user operation, such as: keyboard, mouse, touch screen, handle, etc., so that the monitoring module 902 can monitor the user's operation, so that the display module can perform a panoramic display of the additional media based on the user's operation. When the computing device where the additional media presentation apparatus is located is a mobile terminal, the computing device may include a component capable of receiving a user operation, such as: the display module may include a display module, a touch screen, a line control module, and the like, and may further include a gyroscope, a gravity acceleration sensor, and the like, which are capable of sensing a change in the posture of the computing device, so that the monitoring module 902 may monitor the operation of the user, and the display module may perform a panoramic display of the additional media based on the operation of the user.
in addition, each example of the present application can be realized by a data processing program executed by a data processing apparatus such as a computer. It is clear that the data processing program constitutes the invention. Further, the data processing program, which is generally stored in one storage medium, is executed by directly reading the program out of the storage medium or by installing or copying the program into a storage device (such as a hard disk and/or a memory) of the data processing device. Such a storage medium therefore also constitutes the present invention. The storage medium may use any type of recording means, such as a paper storage medium (e.g., paper tape, etc.), a magnetic storage medium (e.g., a flexible disk, a hard disk, a flash memory, etc.), an optical storage medium (e.g., a CD-ROM, etc.), a magneto-optical storage medium (e.g., an MO, etc.), and the like.
The present application thus also provides a storage medium having stored therein a data processing program for executing any one of the examples of the method of the present application.
The above description is only exemplary of the present invention and should not be taken as limiting the invention, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (14)
1. An additional media display method in media playing is characterized in that the method is applied to a media playing client, and the method comprises the following steps:
During the process of displaying the media file, acquiring additional media data corresponding to the media file from the outside by an associated logic plug-in the media playing client through executing the associated logic of the additional media; the additional media data comprise panoramic media materials and default additional media data, the panoramic media materials comprise a picture which is divided into a plurality of parts, a plurality of pictures or a three-dimensional video, wherein each part of the picture or each of the plurality of pictures corresponds to a different visual angle, and the three-dimensional video can be displayed at different visual angles;
Displaying the default additional media data and prompting a user whether to display a panoramic effect, wherein the default additional media data is a picture or a video without the panoramic display effect;
When a response that a user confirms that the panoramic effect is to be displayed is received, loading the panoramic media material by a rich media plug-in the media playing client, and monitoring the operation of the user;
responding to the monitored operation, and determining a visual angle corresponding to the operation;
and displaying a part of the picture or one of the pictures corresponding to the visual angle in the panoramic media material by the rich media plug-in, or displaying the three-dimensional video by the visual angle.
2. The method of claim 1, the presenting the default additional media data comprising:
displaying a part of the one picture or one of the plurality of pictures corresponding to a preset view angle in the panoramic media material, or
displaying the three-dimensional video at a preset viewing angle, or
and displaying a picture or a video except the panoramic media material in the additional media data.
3. The method of claim 2, further comprising:
after the operation of monitoring the user is started, prompting the user whether to stop displaying the panoramic effect;
and when a response that the user confirms to stop displaying the panoramic effect is received, stopping the operation of the monitoring user.
4. The method of claim 3, further comprising:
Starting countdown according to a preset duration when a part of the picture or one of the pictures at the preset visual angle is displayed, or the three-dimensional video is displayed at the preset visual angle, or a picture or a section of video except the panoramic media material is displayed;
pausing the countdown when a response is received that a user confirms that a panoramic effect is to be presented;
continuing the countdown when a response is received that the user confirms to stop presenting the panoramic effect.
5. The method of claim 1, wherein when the media playing client is located in a personal computer PC, the operation of the listening user comprises: monitoring the operation of a user through the input equipment of the PC;
When the media playing client is located at the mobile terminal, the operation of the monitoring user includes: and monitoring gesture operation on a touch screen of the mobile terminal and/or monitoring gesture change of the mobile terminal through a gyroscope of the mobile terminal.
6. The method of claim 1, wherein said presenting a media file comprises:
When the media playing client is ready to play the media file, playing the media file, pausing playing the media file, and finishing playing the media file.
7. the method of claim 1, wherein when the media playing client is located on a PC, the associated logic plug-in is a Flash plug-in, and the rich media plug-in is a rich media shell on top of the Flash plug-in;
When the media playing client is located at the mobile terminal, the associated logic plug-in is a Software Development Kit (SDK) plug-in, and the rich media plug-in is a network view webview plug-in.
8. the method of claim 1, wherein the different perspectives comprise: multiple views in the same two-dimensional plane or multiple views in the same three-dimensional space.
9. an additional media presentation device in media playing, which is disposed in a media playing client, the device comprising:
The acquisition module is used for acquiring additional media data corresponding to the media file from the outside by an associated logic plug-in the media playing client through executing associated logic of the additional media during the period of displaying the media file; the additional media data comprise panoramic media materials and default additional media data, the panoramic media materials comprise a picture which is divided into a plurality of parts, a plurality of pictures or a three-dimensional video, wherein each part of the picture or each of the plurality of pictures corresponds to a different visual angle, and the three-dimensional video can be displayed at different visual angles;
The display module is used for displaying the default additional media data and triggering the prompt module, wherein the default additional media data is a picture or a video without a panoramic display effect;
The prompting module is used for prompting a user whether to display the panoramic effect; when a response that a user confirms that the panoramic effect is to be displayed is received, loading the panoramic media material by a rich media plug-in the media playing client, and triggering a monitoring module to start monitoring the operation of the user;
The monitoring module is used for monitoring the operation of a user;
The display module is further configured to, in response to the monitored operation, determine a view angle corresponding to the operation, and display, by the rich media plugin, a part of the one or one of the plurality of pictures corresponding to the view angle in the panoramic media material, or display the three-dimensional video at the view angle.
10. the apparatus of claim 9, wherein the presentation module is configured to present a portion of the one or more pictures of the panoramic media material corresponding to a preset viewing angle, or present the three-dimensional video at a preset viewing angle, or present a picture or a segment of video of the additional media data other than the panoramic media material.
11. The apparatus of claim 10, wherein,
The prompting module is further used for prompting the user whether to stop displaying the panoramic effect, and when a response that the user confirms to stop displaying the panoramic effect is received, the monitoring module is triggered to stop monitoring the operation of the user.
12. The apparatus of claim 9, further comprising: a timing module;
The display module is further configured to trigger the timing module to start countdown according to a preset duration when a part of the one picture or one of the plurality of pictures at the preset view angle is displayed, or the three-dimensional video is displayed at the preset view angle, or a picture or a section of video other than the panoramic media material is displayed;
The prompting module is further used for further triggering the timing module to pause the countdown when a response that the user confirms that the panoramic effect is to be displayed is received; and further triggering the timing module to continue the countdown when a response that the user confirms to stop displaying the panoramic effect is received.
13. A computing device comprising a processor and a memory, the memory having stored therein computer-readable instructions operable to cause the processor to perform the method of any of claims 1 to 8.
14. A computer-readable storage medium having stored thereon computer-readable instructions for causing at least one processor to perform the method of any one of claims 1 to 8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610221533.1A CN107295393B (en) | 2016-04-11 | 2016-04-11 | method and device for displaying additional media in media playing, computing equipment and computer-readable storage medium |
| PCT/CN2017/079267 WO2017177842A1 (en) | 2016-04-11 | 2017-04-01 | Additional media presentation method and device for use during media playing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610221533.1A CN107295393B (en) | 2016-04-11 | 2016-04-11 | method and device for displaying additional media in media playing, computing equipment and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107295393A CN107295393A (en) | 2017-10-24 |
| CN107295393B true CN107295393B (en) | 2019-12-13 |
Family
ID=60042323
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610221533.1A Active CN107295393B (en) | 2016-04-11 | 2016-04-11 | method and device for displaying additional media in media playing, computing equipment and computer-readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107295393B (en) |
| WO (1) | WO2017177842A1 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107911737B (en) * | 2017-11-28 | 2020-06-19 | 腾讯科技（深圳）有限公司 | Media content display method and device, computing equipment and storage medium |
| CN109960546B (en) * | 2017-12-14 | 2021-09-10 | 腾讯科技（深圳）有限公司 | Virtual resource interaction method and device, storage medium and electronic device |
| CN113012290B (en) * | 2021-03-17 | 2023-02-28 | 展讯通信(天津)有限公司 | Terminal posture-based picture display and acquisition method and device, storage medium and terminal |
| CN113923435B (en) * | 2021-08-26 | 2022-08-05 | 北京城市网邻信息技术有限公司 | Information display method, equipment and storage medium |
| CN114051090B (en) * | 2021-10-12 | 2023-07-18 | 聚好看科技股份有限公司 | Method for releasing resources in panoramic video and display equipment |
| CN113992679B (en) * | 2021-10-26 | 2023-10-31 | 广域铭岛数字科技有限公司 | Automobile image display method, system and equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001063916A1 (en) * | 2000-02-25 | 2001-08-30 | Interval Research Corporation | Method and system for selecting advertisements |
| CN102819388A (en) * | 2012-07-05 | 2012-12-12 | 东莞市尚睿电子商务有限公司 | Picture panorama display processing system applied to mobile terminal operating system and installation and use method of processing system |
| CN104748746A (en) * | 2013-12-29 | 2015-07-01 | 刘进 | Attitude determination and virtual reality roaming method of intelligent machine |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101448138B (en) * | 2008-12-29 | 2014-04-23 | 深圳市龙视传媒有限公司 | Method, system and server for inserting video advertisement |
| CN102789348A (en) * | 2011-05-18 | 2012-11-21 | 北京东方艾迪普科技发展有限公司 | Interactive three dimensional graphic video visualization system |
-
2016
- 2016-04-11 CN CN201610221533.1A patent/CN107295393B/en active Active
-
2017
- 2017-04-01 WO PCT/CN2017/079267 patent/WO2017177842A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001063916A1 (en) * | 2000-02-25 | 2001-08-30 | Interval Research Corporation | Method and system for selecting advertisements |
| CN102819388A (en) * | 2012-07-05 | 2012-12-12 | 东莞市尚睿电子商务有限公司 | Picture panorama display processing system applied to mobile terminal operating system and installation and use method of processing system |
| CN104748746A (en) * | 2013-12-29 | 2015-07-01 | 刘进 | Attitude determination and virtual reality roaming method of intelligent machine |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017177842A1 (en) | 2017-10-19 |
| CN107295393A (en) | 2017-10-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107295393B (en) | method and device for displaying additional media in media playing, computing equipment and computer-readable storage medium | |
| CN106210861B (en) | Method and system for displaying bullet screen | |
| CN107590771B (en) | 2D video with options for projection viewing in modeled 3D space | |
| CN106803966B (en) | Multi-user network live broadcast method and device and electronic equipment thereof | |
| EP3606082A1 (en) | Panoramic video playback method and client terminal | |
| EP2359915B1 (en) | Media viewing | |
| CN109743892B (en) | Virtual reality content display method and device | |
| CN111970532B (en) | Video playing method, device and equipment | |
| US11880999B2 (en) | Personalized scene image processing method, apparatus and storage medium | |
| US20190311548A1 (en) | Apparatus for sharing objects of interest and associated methods | |
| CN114116053B (en) | Resource display method, device, computer equipment and medium | |
| US10043552B1 (en) | Systems and methods for providing thumbnails for video content | |
| CN111198610A (en) | Method, device and equipment for controlling field of view of panoramic video and storage medium | |
| CN114363687B (en) | Three-dimensional scene interactive video creation method and creation device | |
| CN114598823A (en) | Special effect video generation method and device, electronic equipment and storage medium | |
| CN107197339B (en) | Display control method and device of film bullet screen and head-mounted display equipment | |
| JP7125983B2 (en) | Systems and methods for creating and displaying interactive 3D representations of real objects | |
| CN111667313A (en) | Advertisement display method and device, client device and storage medium | |
| CN111213374A (en) | Video playing method and device | |
| JP6031016B2 (en) | Video display device and video display program | |
| CN113194329A (en) | Live broadcast interaction method, device, terminal and storage medium | |
| CN112954437A (en) | Video resource processing method and device, computer equipment and storage medium | |
| US9129415B2 (en) | Appearance of an object | |
| CN112188268A (en) | Virtual scene display method, virtual scene introduction video generation method and device | |
| WO2023169089A1 (en) | Video playing method and apparatus, electronic device, medium, and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |