CN109922374A - Method of adjustment, device, equipment and the storage medium of multimedia - Google Patents

Method of adjustment, device, equipment and the storage medium of multimedia Download PDF

Info

Publication number
CN109922374A
CN109922374A CN201910156738.XA CN201910156738A CN109922374A CN 109922374 A CN109922374 A CN 109922374A CN 201910156738 A CN201910156738 A CN 201910156738A CN 109922374 A CN109922374 A CN 109922374A
Authority
CN
China
Prior art keywords
multimedia
window
visibility
setting value
multimedia file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910156738.XA
Other languages
Chinese (zh)
Inventor
姚涛
秦林婵
黄通兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing 7Invensun Technology Co Ltd
Beijing Qixin Yiwei Information Technology Co Ltd
Original Assignee
Beijing Qixin Yiwei Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qixin Yiwei Information Technology Co Ltd filed Critical Beijing Qixin Yiwei Information Technology Co Ltd
Priority to CN201910156738.XA priority Critical patent/CN109922374A/en
Publication of CN109922374A publication Critical patent/CN109922374A/en
Pending legal-status Critical Current

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention discloses a kind of method of adjustment of multimedia, device, equipment and storage mediums.This method comprises: being detected in multimedia file playing process to the visibility of multimedia window;The multimedia file plays the broadcasting including video flowing and/or audio stream;The visibility indicates whether multimedia window is effectively viewed;When the variation of the visibility of the multimedia window, the variation pattern of visibility is obtained;The play mode of the multimedia file is adjusted according to the variation pattern, and plays the multimedia file according to play mode adjusted.The method of adjustment of multimedia provided in an embodiment of the present invention adjusts the play mode of multimedia file according to the variation pattern of multimedia window visibility, the adjustment to multimedia may be implemented, and avoids the wasting of resources, saves power consumption.

Description

Method of adjustment, device, equipment and the storage medium of multimedia
Technical field
The present embodiments relate to multimedia control technology field more particularly to a kind of adjustment sides of multimedia Method, device, equipment and storage medium.
Background technique
With the fast development of Internet technology, terminal device such as mobile phone, plate and computer, which has become, thinks that people are raw The indispensable tool of work living, watches multimedia by terminal device and has become one of everybody main entertainment way.With Family is being watched multimedia while will do it other operations, such as browsing information or reply chat message using terminal device.
In the prior art, when the page where multimedia window blocks or switch to backstage or minimum by other pages After change, user can only hear multimedia file sound intermediate frequency, can not see multimedia picture, and terminal device is continued to more matchmakers Video flowing in body file is decoded broadcasting, to cause the waste of resource, increases power consumption.
Summary of the invention
The embodiment of the present invention provides method of adjustment, device, equipment and the storage medium of a kind of multimedia, with realization pair The adjustment of multimedia avoids the wasting of resources, saves power consumption.
In a first aspect, the embodiment of the invention provides a kind of methods of adjustment of multimedia, this method comprises:
In multimedia file playing process, the visibility of multimedia window is detected;The multimedia file Play the broadcasting including video flowing and/or audio stream;The visibility indicates whether multimedia window is effectively viewed;
When the variation of the visibility of the multimedia window, the variation pattern of visibility is obtained;
The play mode of the multimedia file is adjusted according to the variation pattern, and is broadcast according to play mode adjusted Put the multimedia file.
Further, the visibility of the multimedia window includes the first setting value and the second setting value;As more matchmakers When body broadcast window is effectively viewed, it is seen that spend for the first setting value, when multimedia window is deactivated viewing, it is seen that spend and be Second setting value.
Further, the visibility for detecting multimedia window is the first setting value, comprising:
The event information of multimedia window the last time triggering is obtained, if more according to event information determination Media window shows that then obtain user watches information attentively in current picture;
Watch whether the time that information is fallen in multimedia window is more than setting time described in judgement attentively, if being more than, The visibility of the multimedia window is the first setting value.
Further, the visibility for detecting multimedia window is the second setting value, including any one in such as under type:
The event information for obtaining multimedia window the last time triggering, according to event information determination The page where multimedia window is blocked by other pages, the page where the multimedia window minimizes, the multimedia Page switching where window is to from the background;Alternatively,
If determining that the multimedia window is shown in current picture according to the event information, obtain user watches letter attentively Breath;
It is described that watch time that information is fallen in outside multimedia window attentively be more than setting time.
Further, the variation pattern of the visibility include: visibility by the first setting value be converted into the second setting value, First setting value is converted by the second setting value.
Further, when the variation pattern of visibility is to be converted into the second setting value by the first setting value, according to described Variation pattern adjusts the play mode of the multimedia file, and plays the multimedia text according to play mode adjusted Part, comprising:
Obtain the corresponding timestamp of the currently playing node of multimedia file;
Pause decodes the video flowing after the timestamp, and continues to decode the audio stream after the timestamp;
Audio after broadcast decoder.
Further, when the variation pattern of visibility is by the second set point change to the first setting value, according to described Variation pattern adjusts the play mode of the multimedia file, and plays the multimedia text according to play mode adjusted Part, comprising:
Obtain the corresponding timestamp of the currently playing node of audio stream in multimedia file;
Restore the synchronous decoding to video flowing and audio stream after the timestamp;
Multimedia and audio after broadcast decoder.
Second aspect, the embodiment of the invention also provides a kind of adjustment device of multimedia, which includes:
Visibility detection module, for being detected to the visibility of multimedia window in multimedia file playing process; The multimedia file plays the broadcasting including video flowing and/or audio stream;The visibility indicates that multimedia window is It is no to be effectively viewed;
Visibility variation pattern obtains module, for when the variation of the visibility of the multimedia window, acquisition can The variation pattern of degree of opinion;
Play mode adjusts module, for adjusting the play mode of the multimedia file according to the variation pattern, and The multimedia file is played according to play mode adjusted.
The third aspect the embodiment of the invention also provides a kind of computer equipment, including memory, processor and is stored in On memory and the computer program that can run on a processor, the processor are realized when executing described program as the present invention is real Apply the method for adjustment of multimedia described in example.
Fourth aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer Program, the program realize the method for adjustment of multimedia as described in the embodiments of the present invention when being executed by processor.
The embodiment of the present invention in multimedia file playing process, detects the visibility of multimedia window;Multimedia File plays the broadcasting including video flowing and/or audio stream;When the variation of the visibility of multimedia window, the change of visibility is obtained Change mode;The play mode of multimedia file is adjusted according to variation pattern, and plays multimedia according to play mode adjusted File.The method of adjustment of multimedia provided in an embodiment of the present invention, according to the variation pattern tune of multimedia window visibility The adjustment to multimedia may be implemented in the play mode of whole multimedia file, avoids the wasting of resources, saves power consumption.
Detailed description of the invention
Fig. 1 is the flow chart of the method for adjustment of one of the embodiment of the present invention one multimedia;
Fig. 2 a is that the visibility of one of the embodiment of the present invention one multimedia window is transformed to second by the first setting value The schematic diagram of setting value;
Fig. 2 b is that the visibility of one of the embodiment of the present invention one multimedia window is transformed to first by the second setting value The schematic diagram of setting value;
Fig. 2 c is that the visibility of one of the embodiment of the present invention one multimedia window is transformed to second by the first setting value The schematic diagram of setting value;
Fig. 2 d is that the visibility of one of the embodiment of the present invention one multimedia window is transformed to first by the second setting value The schematic diagram of setting value;
Fig. 3 is the structural schematic diagram of the adjustment device of one of the embodiment of the present invention two multimedia;
Fig. 4 is the structural schematic diagram of one of the embodiment of the present invention three computer equipment.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.
Embodiment one
Fig. 1 is a kind of flow chart of the method for adjustment for multimedia that the embodiment of the present invention one provides, and the present embodiment can The case where suitable for being adjusted to multimedia, this method can be executed by the adjustment device of multimedia, the dress Setting can be made of hardware and/or software, and can generally be integrated in the equipment of the adjustment function with multimedia, the equipment It can be the electronic equipments such as server, mobile terminal or server cluster.As shown in Figure 1, this method specifically comprises the following steps:
Step 110, in multimedia file playing process, the visibility of multimedia window is detected.
Wherein, multimedia file plays the broadcasting including video flowing and/or audio stream.Visibility indicates multimedia window Whether mouth is effectively viewed.It include video flowing and audio stream in multimedia file in the present embodiment, multimedia file is normally being broadcast When putting, decompression is carried out to multimedia file first and obtains video flowing and audio stream, then video flowing and audio stream are synchronized Decompression finally plays multimedia and audio after decompression according to timestamp.
The visibility of multimedia window includes the first setting value and the second setting value;When multimedia window is effectively seen When seeing, it is seen that spend for the first setting value, when multimedia window is deactivated viewing, it is seen that spend for the second setting value.Optionally, The visibility for detecting multimedia window is the second setting value, including any one in such as under type: obtaining multimedia window The event information of the last triggering of mouth, the page is blocked by other pages, is more where determining multimedia window according to event information The page where media window minimizes, page switching where multimedia window is to from the background;Alternatively, if more according to event information determination Media window shows that obtain user watches information attentively in current picture;Watching the time that information is fallen in outside multimedia window attentively is more than Setting time.The visibility of detection multimedia window is that the mode of the first setting value may is that acquisition multimedia window The event information of the last triggering of mouth obtains user if determining that multimedia window is shown in current picture according to event information Watch information attentively;Judgement watches whether the time that information is fallen in multimedia window is more than setting time attentively, if being more than, multimedia The visibility of window is the first setting value.
Wherein, the mode for obtaining the event information of multimedia window the last time triggering can be, the window in terminal Port system is monitored the window of each application program, when application window trigger event, such as minimizes, is blocked and moves It moves, the event information that window system will test is sent to corresponding application program.Then, application program is according to event information Determine the state of its window.
Wherein, watching information attentively may include blinkpunkt information (or direction of visual lines).The present embodiment can be chased after using eyeball Track technology acquisition user's watches information attentively.Being tracked to eyeball can be realized using optical recording.The original of optical recording Reason is, using camera or the eye motion situation of camera record testee, that is, obtains and is able to reflect eye motion Eyes image extracts eye feature for establishing sight/blinkpunkt estimation model from the eyes image got.Wherein, Eye feature may include: pupil position, pupil shape, iris position, iris shape, eyelid position, canthus position, hot spot position Set (or Purkinje image) etc..Optical recording includes pupil-corneal reflection method.Pupil-corneal reflection method principle is light source Eyes are pointed into, eye is shot by image capture device, while taking reflection point of the light source on cornea i.e. hot spot, by This gets the eyes image with hot spot.With the rotation of eyeball, the relative positional relationship of pupil center and hot spot becomes Change.Change in location relationship can be reflected by collecting multiple eyes images with hot spot, be regarded according to change in location relationship The estimation of line/blinkpunkt.Specifically, the process that acquisition user watches information attentively can be, light source is pointed into eyes, is set by Image Acquisition It is standby that eye is shot, while reflection point of the light source on cornea i.e. hot spot is taken, thus get the eye with hot spot Portion's image.With the rotation of eyeball, the relative positional relationship of pupil center and hot spot changes.Multiple are collected with hot spot Eyes image can reflect change in location relationship, according to change in location relationship carry out the estimation of sight/blinkpunkt.
Specifically, obtain user watch information attentively after, then obtain the region where multimedia window, information is watched in determination attentively Whether fall in multimedia window.When detecting multimedia window in current picture display, if watching information attentively falls in multimedia Time in window is more than setting time, then the visibility of multimedia window is the first setting value, i.e. multimedia window is effective Viewing;If watching the time that information is fallen in outside multimedia window attentively is more than setting time, the visibility of multimedia window is second Setting value, i.e. multimedia window are deactivated viewing.
Step 120, when the variation of the visibility of multimedia window, the variation pattern of visibility is obtained.
Wherein, multimedia window may include that visibility is converted by the first setting value by the variation pattern of viewing visibility Second setting value and the first setting value is converted by the second setting value.Illustratively, user is in the full frame multimedia process of viewing Middle discovery has new information, and the minimum button for clicking multimedia window minimizes multimedia window, at this time by multimedia window The visibility of mouth is converted into the second setting value by the first setting value, i.e. multimedia window is transformed to be deactivated sight by being effectively viewed It sees;Alternatively, user in the screen of terminal, generally shows multimedia window, half shows document, will after document finishes watching document Sight is gone on multimedia window and residence time is more than setting time, and the visibility of multimedia window is by the second setting at this time Value is transformed to the first setting value, i.e., multimedia window is switched to by being deactivated viewing and is effectively viewed.In the present embodiment, multimedia Window is effectively viewed to be deactivated to watch with multimedia window meets different qualifications respectively, in detection multimedia window When visibility, the variation of multimedia window visibility just can be detected by the variation of detection qualifications.
Step 130, the play mode of multimedia file is adjusted according to variation pattern, and is broadcast according to play mode adjusted Put multimedia file.
Wherein, play mode includes Fast Play mode and normal play mode.Fast Play mode is achieved in that The video flowing for suspending decoded multimedia file, continues the audio stream of decoded multimedia file, and the audio after broadcast decoder, that is, works as Preceding multimedia window only has sound without picture;The implementation of normal play mode can be, in multimedia file Video flowing and audio stream synchronous decoding, and existing picture is also sound in multimedia and audio and multimedia window after broadcast decoder Sound.
Optionally, when the variation pattern of visibility is to be converted into the second setting value by the first setting value, according to variation side Formula adjusts the play mode of multimedia file, and plays multimedia file according to play mode adjusted, can pass through following sides Formula is implemented: obtaining the corresponding timestamp of the currently playing node of multimedia file;Video flowing after pause decoded time stamp, and after Audio stream after continuous decoded time stamp;Audio after broadcast decoder.
In the present embodiment, the timestamp of video flowing and audio stream in multimedia file be it is mutual corresponding, work as multimedia The visibility of window is transformed to the second setting value by the first setting value, that is, the validity watched effectively is seen by multimedia window When seeing that switching to multimedia window is deactivated viewing, the timestamp of broadcast nodes first in acquisition present multimedia file, then Pause decodes the video flowing after the timestamp, and continues to decode the audio stream after the timestamp, and the sound after broadcast decoder Frequently.It is deactivated viewing when the validity that multimedia window is watched becomes multimedia window, user is not seeing multimedia at this time Picture, decoded audio stream, and only play audio, decoded video streams can be avoided to and caused by the wasting of resources, thus Save power consumption.
Optionally, when the variation pattern of visibility is by the second set point change to the first setting value, according to variation side Formula adjusts the play mode of multimedia file, and plays multimedia file according to play mode adjusted, can pass through following sides Formula is implemented: obtaining the corresponding timestamp of the currently playing node of audio stream in multimedia file;Restore to the view after timestamp The synchronous decoding of frequency stream and audio stream;Multimedia and audio after broadcast decoder.
Specifically, that is watched has when the visibility of multimedia window is by the second set point change to the first setting value When effect property is deactivated viewing by multimedia window and switches to multimedia window and be effectively viewed, it is currently playing to obtain current audio stream The timestamp of node restores the synchronous decoding to video flowing and audio stream after the timestamp, and more matchmakers after broadcast decoder Body and audio.The advantage of doing so is that not influencing user normally watches multimedia.
As an example, Fig. 2 a is the visibility of one of embodiment of the present invention multimedia window by the first setting value It is transformed to the schematic diagram of the second setting value.As shown in Figure 2 a, multimedia file is in playing process, other labels of user's opening Page, user can not see multimedia content at this time, it is seen that be other Shipping Options Pages content, it is also possible to hear in multimedia Sound, at this point, pause video flowing decoding, continue the decoding and broadcasting of audio.
As an example, Fig. 2 b is the visibility of one of embodiment of the present invention multimedia window by the second setting value It is transformed to the schematic diagram of the first setting value.As shown in Figure 2 b, page where interface returns to multimedia window by other Shipping Options Pages, this When, restore the synchronous decoding of video flowing and audio stream, and multimedia and audio after broadcast decoder.
As an example, Fig. 2 c is the visibility of one of embodiment of the present invention multimedia window by the first setting value It is transformed to the schematic diagram of the second setting value.As described in Fig. 2 c, the sight of user shifts to non-multimedia window by multimedia window region Mouth region domain, at this point, the decoding of pause video flowing, continues the decoding and broadcasting of audio.
Fig. 2 d is that the visibility of one of embodiment of the present invention multimedia window is transformed to first by the second setting value and sets The schematic diagram of definite value.As shown in Figure 2 d, the sight of user is moved back to multimedia window region by non-multimedia window area, at this point, Restore the synchronous decoding of video flowing and audio stream, and multimedia and audio after broadcast decoder.
The technical solution of the present embodiment in multimedia file playing process, detects the visibility of multimedia window; Multimedia file plays the broadcasting including video flowing and/or audio stream;When the variation of the visibility of multimedia window, obtain effective The variation pattern of property;The play mode of multimedia file is adjusted according to variation pattern, and is played according to play mode adjusted Multimedia file.The method of adjustment of multimedia provided in an embodiment of the present invention, according to the variation of multimedia window visibility Mode adjusts the play mode of multimedia file, and the adjustment to multimedia may be implemented, and avoids the wasting of resources, saves function Consumption.
Embodiment two
Fig. 3 is a kind of structural schematic diagram of the adjustment device of multimedia provided by Embodiment 2 of the present invention.Such as Fig. 3 institute Show, which includes: visibility detection module 210, it is seen that degree variation pattern obtains module 220 and play mode adjusts module 230。
Visibility detection module 210, for being examined to the visibility of multimedia window in multimedia file playing process It surveys;Multimedia file plays the broadcasting including video flowing and/or audio stream;Visibility indicates whether multimedia window is had Effect viewing;
Visibility variation pattern obtains module 220, for obtaining visible when the variation of the visibility of multimedia window The variation pattern of degree;
Play mode adjusts module 230, for adjusting the play mode of multimedia file according to variation pattern, and according to tune Play mode after whole plays multimedia file.
Optionally, the visibility of multimedia window includes the first setting value and the second setting value;Work as multimedia When window is effectively viewed, it is seen that spend for the first setting value, when multimedia window is deactivated viewing, it is seen that spend and set for second Definite value.
Optionally, the visibility for detecting multimedia window is the first setting value, comprising:
The event information for obtaining the triggering of multimedia window the last time, if determining multimedia window according to event information It is shown in current picture, then obtain user watches information attentively;
Judgement watches whether the time that information is fallen in multimedia window is more than setting time attentively, if being more than, more matchmakers The visibility of body window is the first setting value.
Optionally, the visibility for detecting multimedia window is the second setting value, including any one in such as under type:
The event information for obtaining the triggering of multimedia window the last time, determines multimedia window according to event information The page where mouthful is blocked by other pages, the page where multimedia window minimizes, page switching where multimedia window is to rear Platform;Alternatively,
If determining that multimedia window is shown in current picture according to event information, obtain user watches information attentively;
Watching the time that information is fallen in outside multimedia window attentively is more than setting time.
Optionally, it is seen that the variation pattern of degree includes: that visibility by the first setting value is converted into the second setting value, by second Setting value is converted into the first setting value.
Optionally, when the variation pattern of visibility is by the first setting value to be converted into the second setting value constantly, play mode Module 230 is adjusted, is also used to:
Obtain the corresponding timestamp of the currently playing node of multimedia file;
Suspend the video flowing after decoded time stamp, and continues the audio stream after decoded time stamp;
Audio after broadcast decoder.
Optionally, when the variation pattern of visibility is by the second set point change to the first setting value, play mode tune Mould preparation block 230, is also used to:
Obtain the corresponding timestamp of the currently playing node of audio stream in multimedia file;
Restore the synchronous decoding to video flowing and audio stream after timestamp;
Multimedia and audio after broadcast decoder.
Method provided by the executable aforementioned all embodiments of the present invention of above-mentioned apparatus, it is corresponding to have the execution above method Functional module and beneficial effect.The not technical detail of detailed description in the present embodiment, reference can be made to the aforementioned all implementations of the present invention Method provided by example.
Embodiment three
Fig. 4 is a kind of structural schematic diagram for computer equipment that the embodiment of the present invention three provides.Fig. 4, which is shown, to be suitable for being used to Realize the block diagram of the computer equipment 312 of embodiment of the present invention.The computer equipment 312 that Fig. 4 is shown is only an example, Should not function to the embodiment of the present invention and use scope bring any restrictions.Equipment 312 typically undertakes multimedia Adjustment function calculating equipment.
As shown in figure 4, computer equipment 312 is showed in the form of universal computing device.The component of computer equipment 312 can To include but is not limited to: one or more processor 316, storage device 328 connect different system components (including storage dress Set 328 and processor 316) bus 318.
Bus 318 indicates one of a few class bus structures or a variety of, including memory bus or Memory Controller, Peripheral bus, graphics acceleration port, processor or the local bus using any bus structures in a variety of bus structures.It lifts For example, these architectures include but is not limited to industry standard architecture (Industry Standard Architecture, ISA) bus, microchannel architecture (Micro Channel Architecture, MCA) bus, enhancing Type isa bus, electronic multimedia Standard Association (Video Electronics Standards Association, VESA) office Domain bus and peripheral component interconnection (Peripheral Component Interconnect, PCI) bus.
Computer equipment 312 typically comprises a variety of computer system readable media.These media can be it is any can The usable medium accessed by computer equipment 312, including volatile and non-volatile media, moveable and immovable Jie Matter.
Storage device 328 may include the computer system readable media of form of volatile memory, such as arbitrary access Memory (Random Access Memory, RAM) 330 and/or cache memory 332.Computer equipment 312 can be into One step includes other removable/nonremovable, volatile/non-volatile computer system storage mediums.Only as an example, it deposits Storage system 334 can be used for reading and writing immovable, non-volatile magnetic media, and (Fig. 4 do not show, commonly referred to as " hard drive Device ").Although not shown in fig 4, the disk for reading and writing removable non-volatile magnetic disk (such as " floppy disk ") can be provided to drive Dynamic device, and to removable anonvolatile optical disk (such as CD-ROM (Compact Disc-Read Only Memory, CD- ROM), digital video disk (Digital Video Disc-Read Only Memory, DVD-ROM) or other optical mediums) read-write CD drive.In these cases, each driver can pass through one or more data media interfaces and bus 318 It is connected.Storage device 328 may include at least one program product, which has one group of (for example, at least one) program Module, these program modules are configured to perform the function of various embodiments of the present invention.
Program 336 with one group of (at least one) program module 326, can store in such as storage device 328, this The program module 326 of sample includes but is not limited to operating system, one or more application program, other program modules and program It may include the realization of network environment in data, each of these examples or certain combination.Program module 326 usually executes Function and/or method in embodiment described in the invention.
Computer equipment 312 can also with one or more external equipments 314 (such as keyboard, sensing equipment, camera, Display 324 etc.) communication, the equipment interacted with the computer equipment 312 communication can be also enabled a user to one or more, And/or with any equipment (such as net that the computer equipment 312 is communicated with one or more of the other calculating equipment Card, modem etc.) communication.This communication can be carried out by input/output (I/O) interface 322.Also, computer Equipment 312 can also pass through network adapter 320 and one or more network (such as local area network (Local Area Network, LAN), wide area network Wide Area Network, WAN) and/or public network, such as internet) communication.As schemed Show, network adapter 320 is communicated by bus 318 with other modules of computer equipment 312.Although should be understood that in figure not It shows, other hardware and/or software module can be used in conjunction with computer equipment 312, including but not limited to: microcode, equipment Driver, redundant processing unit, external disk drive array, disk array (Redundant Arrays of Independent Disks, RAID) system, tape drive and data backup storage system etc..
The program that processor 316 is stored in storage device 328 by operation, thereby executing various function application and number According to processing, such as realize the method for adjustment of multimedia provided by the above embodiment of the present invention.
Example IV
The embodiment of the present invention four additionally provides a kind of computer readable storage medium, is stored thereon with computer program, should The method of adjustment of the multimedia as provided by the embodiment of the present invention is realized when program is executed by processor.
Certainly, a kind of computer readable storage medium provided by the embodiment of the present invention, the computer program stored thereon The method operation being not limited to the described above, can also be performed the adjustment side of multimedia provided by any embodiment of the invention Relevant operation in method.
The computer storage medium of the embodiment of the present invention, can be using any of one or more computer-readable media Combination.Computer-readable medium can be computer-readable signal media or computer readable storage medium.It is computer-readable Storage medium for example may be-but not limited to-the system of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, device or Device, or any above combination.The more specific example (non exhaustive list) of computer readable storage medium includes: tool There are electrical connection, the portable computer diskette, hard disk, random access memory (RAM), read-only memory of one or more conducting wires (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD- ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.In this document, computer-readable storage Medium can be any tangible medium for including or store program, which can be commanded execution system, device or device Using or it is in connection.
Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal, Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for By the use of instruction execution system, device or device or program in connection.
The program code for including on computer-readable medium can transmit with any suitable medium, including --- but it is unlimited In wireless, electric wire, optical cable, RF etc. or above-mentioned any appropriate combination.
The computer for executing operation of the present invention can be write with one or more programming languages or combinations thereof Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++, It further include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with It fully executes, partly execute on the user computer on the user computer, being executed as an independent software package, portion Divide and partially executes or executed on a remote computer or server completely on the remote computer on the user computer.? Be related in the situation of remote computer, remote computer can pass through the network of any kind --- including local area network (LAN) or Wide area network (WAN)-be connected to subscriber computer, or, it may be connected to outer computer (such as mentioned using Internet service It is connected for quotient by internet).
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation, It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.

Claims (10)

1. the method for adjustment that a kind of multimedia file plays characterized by comprising
In multimedia file playing process, the visibility of multimedia window is detected;The multimedia file plays Broadcasting including video flowing and/or audio stream;The visibility indicates whether multimedia window is effectively viewed;
When the variation of the visibility of the multimedia window, the variation pattern of visibility is obtained;
The play mode of the multimedia file is adjusted according to the variation pattern, and plays institute according to play mode adjusted State multimedia file.
2. the method according to claim 1, wherein the visibility of the multimedia window is set including first Definite value and the second setting value;When multimedia window is effectively viewed, it is seen that spend for the first setting value, work as multimedia Window is deactivated viewing, it is seen that spends for the second setting value.
3. according to the method described in claim 2, it is characterized in that, the visibility of detection multimedia window is the first setting Value, comprising:
The event information for obtaining multimedia window the last time triggering, if determining multimedia according to the event information Window shows that then obtain user watches information attentively in current picture;
Watch whether the time that information is fallen in multimedia window is more than setting time described in judgement attentively, it is described if being more than The visibility of multimedia window is the first setting value.
4. according to the method described in claim 2, it is characterized in that, detection multimedia window visibility be the second setting value, Including any one in such as under type:
The event information for obtaining multimedia window the last time triggering, determines more matchmakers according to the event information The page where body broadcast window is blocked by other pages, the page where the multimedia window minimizes, the multimedia window Place page switching is to from the background;Alternatively,
If determining that the multimedia window is shown in current picture according to the event information, obtain user watches information attentively;
It is described that watch time that information is fallen in outside multimedia window attentively be more than setting time.
5. according to any method of claim 2-4, which is characterized in that the variation pattern of the visibility includes: visible Degree is converted into the second setting value by the first setting value, is converted into the first setting value by the second setting value.
6. according to the method described in claim 5, it is characterized in that, when the variation pattern of visibility is to be converted by the first setting value When to the second setting value, the play mode of the multimedia file is adjusted according to the variation pattern, and broadcast according to adjusted Mode playback plays the multimedia file, comprising:
Obtain the corresponding timestamp of the currently playing node of multimedia file;
Pause decodes the video flowing after the timestamp, and continues to decode the audio stream after the timestamp;
Audio after broadcast decoder.
7. according to the method described in claim 6, it is characterized in that, when the variation pattern of visibility is by the second set point change When to the first setting value, the play mode of the multimedia file is adjusted according to the variation pattern, and broadcast according to adjusted Mode playback plays the multimedia file, comprising:
Obtain the corresponding timestamp of the currently playing node of audio stream in multimedia file;
Restore the synchronous decoding to video flowing and audio stream after the timestamp;
Multimedia and audio after broadcast decoder.
8. a kind of adjustment device of multimedia characterized by comprising
Visibility detection module, for being detected to the visibility of multimedia window in multimedia file playing process;It is described Multimedia file plays the broadcasting including video flowing and/or audio stream;The visibility indicate multimedia window whether by Effectively viewing;
Visibility variation pattern obtains module, for obtaining visibility when the variation of the visibility of the multimedia window Variation pattern;
Play mode adjusts module, for adjusting the play mode of the multimedia file according to the variation pattern, and according to Play mode adjusted plays the multimedia file.
9. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor Calculation machine program, which is characterized in that the processor realizes more matchmakers as described in any in claim 1-7 when executing described program The method of adjustment that body plays.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor The method of adjustment of the multimedia as described in any in claim 1-7 is realized when execution.
CN201910156738.XA 2019-03-01 2019-03-01 Method of adjustment, device, equipment and the storage medium of multimedia Pending CN109922374A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910156738.XA CN109922374A (en) 2019-03-01 2019-03-01 Method of adjustment, device, equipment and the storage medium of multimedia

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910156738.XA CN109922374A (en) 2019-03-01 2019-03-01 Method of adjustment, device, equipment and the storage medium of multimedia

Publications (1)

Publication Number Publication Date
CN109922374A true CN109922374A (en) 2019-06-21

Family

ID=66963030

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910156738.XA Pending CN109922374A (en) 2019-03-01 2019-03-01 Method of adjustment, device, equipment and the storage medium of multimedia

Country Status (1)

Country Link
CN (1) CN109922374A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111610914A (en) * 2020-05-12 2020-09-01 百度在线网络技术(北京)有限公司 Multimedia playing method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103024490A (en) * 2012-12-26 2013-04-03 北京奇艺世纪科技有限公司 Method and device supporting independent playing of audio and video
CN106354363A (en) * 2016-08-26 2017-01-25 珠海市魅族科技有限公司 A method and apparatus for handling a message
CN106792075A (en) * 2017-01-04 2017-05-31 合网络技术(北京)有限公司 Video broadcasting method and device
CN107197362A (en) * 2016-03-15 2017-09-22 广州市动景计算机科技有限公司 A kind of method and device for playing multimedia messages
US20180246625A1 (en) * 2015-11-20 2018-08-30 Le Holdings (Beijing) Co., Ltd. Method and apparatus for implementation of video playback

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103024490A (en) * 2012-12-26 2013-04-03 北京奇艺世纪科技有限公司 Method and device supporting independent playing of audio and video
US20180246625A1 (en) * 2015-11-20 2018-08-30 Le Holdings (Beijing) Co., Ltd. Method and apparatus for implementation of video playback
CN107197362A (en) * 2016-03-15 2017-09-22 广州市动景计算机科技有限公司 A kind of method and device for playing multimedia messages
CN106354363A (en) * 2016-08-26 2017-01-25 珠海市魅族科技有限公司 A method and apparatus for handling a message
CN106792075A (en) * 2017-01-04 2017-05-31 合网络技术(北京)有限公司 Video broadcasting method and device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111610914A (en) * 2020-05-12 2020-09-01 百度在线网络技术(北京)有限公司 Multimedia playing method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN112400325B (en) Data driven audio enhancement
JP6165846B2 (en) Selective enhancement of parts of the display based on eye tracking
CN106791485B (en) Video switching method and device
US11150965B2 (en) Facilitation of real time conversations based on topic determination
US10042420B2 (en) Gaze-aware control of multi-screen experience
WO2017076171A1 (en) Method and apparatus for displaying information on video image
CN111866525A (en) Multi-view video playing control method and device, electronic equipment and storage medium
US20140192136A1 (en) Video chatting method and system
KR101991188B1 (en) Promotion information processing method, device, and apparatus, and non-volatile computer storage medium
US20190130193A1 (en) Virtual Reality Causal Summary Content
US10547663B2 (en) System and method for web conferencing presentation pre-staging
WO2020155915A1 (en) Method and apparatus for playing back audio
CN112528052A (en) Multimedia content output method, device, electronic equipment and storage medium
CN109922374A (en) Method of adjustment, device, equipment and the storage medium of multimedia
US20240073273A1 (en) Method and processing unit for creating and rendering synchronized content for content rendering environment
JP4934158B2 (en) Video / audio processing apparatus, video / audio processing method, video / audio processing program
CN116996702A (en) Concert live broadcast processing method and device, storage medium and electronic equipment
EP3633587B1 (en) An apparatus and associated methods for presentation of comments
KR20200052693A (en) Virtual reality player and integrated management system for monitoring thereof
CN112714331B (en) Information prompting method and device, storage medium and electronic equipment
CN105913698B (en) Method and device for playing course multimedia information
CN114845160A (en) Voice-driven video processing method, related device and storage medium
CN113192519A (en) Audio encoding method and apparatus, and audio decoding method and apparatus
JP2004120460A (en) Video conference system, video conference terminal device and program
JP2004259198A (en) Information management apparatus, information management system and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190621

RJ01 Rejection of invention patent application after publication