WO2024251274A1 - 多媒体数据预加载方法、装置、电子设备及存储介质 - Google Patents

多媒体数据预加载方法、装置、电子设备及存储介质 Download PDF

Info

Publication number
WO2024251274A1
WO2024251274A1 PCT/CN2024/098221 CN2024098221W WO2024251274A1 WO 2024251274 A1 WO2024251274 A1 WO 2024251274A1 CN 2024098221 W CN2024098221 W CN 2024098221W WO 2024251274 A1 WO2024251274 A1 WO 2024251274A1
Authority
WO
WIPO (PCT)
Prior art keywords
multimedia
target
data
played
target operation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2024/098221
Other languages
English (en)
French (fr)
Inventor
龙韵翔
熊一鸣
洪成
张宇翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Priority to EP24818800.5A priority Critical patent/EP4727105A1/en
Publication of WO2024251274A1 publication Critical patent/WO2024251274A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72442User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for playing music files
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/41Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/435Filtering based on additional data, e.g. user or group profiles
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/438Presentation of query results
    • G06F16/4387Presentation of query results by the use of playlists
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation
    • G06F16/9574Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • the present disclosure relates to the field of computer technology, and in particular to a multimedia data preloading method, device, electronic device and storage medium.
  • the present disclosure provides a multimedia data preloading method, device, electronic device and storage medium.
  • a multimedia data preloading method comprising:
  • the multimedia to be played is preloaded at least based on the target operation data and the target characteristic data.
  • the target operation data includes a plurality of target operation behaviors
  • the preloading of the multimedia to be played includes:
  • the multimedia to be played is preloaded based on the target weight and the target characteristic data to obtain preload data.
  • the preloading the multimedia to be played based on the target weight and the target feature data includes:
  • Preload data corresponding to the target feature data is preloaded based on the priority.
  • the played multimedia includes a first multimedia and a second multimedia having adjacent play periods, and the first multimedia and the to-be-played multimedia have adjacent play periods;
  • the determining target weights corresponding to the multiple target operation behaviors respectively includes:
  • the initial weight is adjusted according to the feature data of the first multimedia to obtain target weights corresponding to the multiple target operation behaviors respectively.
  • the method further comprises:
  • the target number of the preloaded multimedia to be played is determined based on the network status information.
  • the preloading of the multimedia to be played includes:
  • the target operation data and the target characteristic data Based on the network status information, the target operation data and the target characteristic data, the target number of preloaded data of the multimedia to be played is obtained.
  • a multimedia data preloading device comprising:
  • a target operation data acquisition module is configured to acquire target operation data for the played multimedia
  • a target feature data acquisition module is configured to acquire target feature data of the multimedia to be played
  • the preloading module is configured to preload the multimedia to be played based on at least the target operation data and the target characteristic data.
  • the target operation data includes multiple target operation behaviors; the preloading module is specifically configured to:
  • the multimedia to be played is preloaded based on the target weight and the target characteristic data to obtain preload data.
  • the preloading module may be further configured as follows:
  • Preload data corresponding to the target feature data is preloaded based on the priority.
  • the played multimedia includes a first multimedia and a second multimedia having adjacent play periods, and the first multimedia and the to-be-played multimedia have adjacent play periods;
  • the preloading module is specifically configured as follows:
  • the initial weight is adjusted by the feature data of the first multimedia to obtain the multiple target operation behaviors.
  • the corresponding target weight is adjusted by the feature data of the first multimedia to obtain the multiple target operation behaviors.
  • the apparatus further comprises:
  • An information acquisition module configured to acquire network status information
  • the quantity determination module is configured to determine the target quantity of the preloaded multimedia to be played based on the network status information.
  • the preloading module may be further configured as follows:
  • the target operation data and the target characteristic data Based on the network status information, the target operation data and the target characteristic data, the target number of preloaded data of the multimedia to be played is obtained.
  • an electronic device comprising: a memory and a processor, wherein the memory stores computer programs and/or instructions, and the processor implements the method described above when executing the programs and/or instructions.
  • a computer-readable storage medium on which a computer program and/or instructions are stored, and when the program and/or instructions are executed by a processor, the above method of the present disclosure is implemented.
  • a computer program product comprising instructions, which, when executed by a processor, enable the processor to implement the above method of the present disclosure.
  • a computer program comprising a program code, which, when executed by a processor, causes the above method of the present disclosure to be implemented.
  • FIG1 is a flow chart of a multimedia data preloading method provided by an exemplary embodiment of the present disclosure
  • FIG2 is a schematic diagram of a scenario of a user's operation behavior during music playing in an exemplary embodiment of the present disclosure
  • FIG3 is a schematic block diagram of functional modules of a multimedia data preloading device provided by an exemplary embodiment of the present disclosure
  • FIG4 is a structural block diagram of an electronic device provided by an exemplary embodiment of the present disclosure.
  • FIG5 is a structural block diagram of a computer system provided by an exemplary embodiment of the present disclosure.
  • a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information.
  • the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.
  • the method of sending a prompt message to the user may be, for example, a pop-up window, in which the prompt message may be presented in text.
  • the pop-up window may also carry a selection control for the user to choose "agree” or "disagree” to provide personal information to the electronic device.
  • the user type When a certain user type plays multimedia through a mobile phone or other terminal, the user type often operates on the multimedia playback interface, such as dragging the progress bar or fast forwarding, to watch or listen to the part he likes, or repeatedly watch or listen to the part he likes. This often requires preloading of multimedia.
  • the embodiments provided by the present disclosure will obtain the preloaded data of the multimedia to be played according to the relevant operation data of the multimedia by a certain user type and the characteristic data of the multimedia to be played, so as to realize the preloading of the multimedia to be played.
  • the preloaded data obtained in this way can meet the playing habits and preferences of a certain user type, and can greatly improve the efficiency of multimedia preloading.
  • the multimedia in the embodiment can be data such as music or video.
  • the embodiment is described by taking the multimedia as music as an example, and the embodiment is not limited to this.
  • historical operational behavior data of a certain user type on music can be obtained, such as the song switching behavior of a certain user type during the previous music playing process, and can also include operations such as dragging a progress bar, fast forward operations, or slow forward operations. For example, a certain user type has listened to m% of song switching, dragging a progress bar, fast forwarding songs, or slow forwarding songs, etc. At least one of these historical operational behavior data can be input into a behavior adjuster to adjust the weight of each operational behavior of a certain user type.
  • one day can be a playback cycle. If a certain user type plays music through a music player for 5 days, the operation behavior data during the first day of playing music can be input into the behavior adjuster to obtain the initial weight of the behavior operation of the certain user type. The subsequent 4 days can be input into the behavior adjuster in sequence according to the number of days, and the weight of the behavior operation of the certain user type can be continuously adjusted to obtain the final adjusted target weight.
  • the proportion of historical operation behavior data of a certain user type can be inversely correlated with the time from the current time. That is, the longer the operation behavior is from the current time, the lower the proportion it occupies in the entire historical operation behavior data, and vice versa.
  • the first four days of a certain user type's music playing can be used as a music playing cycle, and the operation behavior of the certain user type in these four days can be input into the behavior adjuster to obtain the initial weight of the certain user type's behavior operation, and the operation behavior data of the fifth day can be input into the behavior adjuster to adjust the weight of the certain user type's behavior operation to optimize the initial weight and obtain the adjusted target weight. Subsequently, the latest operation behavior data of a certain user type on music within one day can be continuously input into the adjuster to continuously adjust the weight of the behavior operation, so that the adjusted weight can be more in line with the operation habits and music playing preferences of the certain user type.
  • the target weight obtained by the behavior adjuster can be prepared for preloading of the next playback cycle.
  • the behavior adjuster can be a preset model, such as a neural network model, which is continuously trained by the historical operation behavior data of a certain user type, and the target weight can be obtained by the trained preset model.
  • the multimedia to be played can be the music that a certain user type directly selects to play, for example, a certain user type generates a music list to be played by selecting his favorite music, and the music list includes multiple music. It is a music playlist automatically generated by the system for a certain user type. For example, a music playlist can be recommended for a certain user type based on the music played by the certain user type in the past. Of course, the music in the music playlist can also be randomly generated, or the music played more frequently by a certain other user type, etc. The embodiment is not limited to this.
  • the multimedia to be played may include a music playlist, which may include one or more music, and the multimedia to be played may also carry target feature data of the music in the music playlist.
  • the target feature data may be at least one of a chorus, a verse, a drum beat, and a song type, etc.
  • the target feature data may also include the range of each part of the chorus, the verse, and the drum beat, and the song type may include DJ, pop, or folk songs, etc.
  • the multimedia to be played can be preloaded, for example, determining the data to be loaded first and the range of the loaded data.
  • the current network status information such as network quality and network type, etc.
  • the number of multimedia to be played and the preloaded data of these multimedia can be determined by combining the network status information, target weight and target feature data. That is, it can be determined how many songs need to be loaded, the range of preloaded data in each song, etc.
  • the music playlist includes 10 songs, and it is determined that 5 of them need to be preloaded, and the corresponding loading ratio of the chorus part or drum part of each song needs to be loaded, etc.
  • the embodiment is not limited to this.
  • a multimedia data preloading method is further provided. As shown in FIG1 , the method may include the following steps:
  • step S110 target operation data for the played multimedia is obtained.
  • a certain user type when obtaining relevant data of a certain user type, a certain user type may be consulted through a pop-up window or the like, and the data will be obtained only after obtaining the consent of the certain user type.
  • the multimedia in the embodiments may be music or video data, and the target operation data may include behavior data such as song switching, fast forward, rewind, or playing a specific part of a song of a certain user type, for example, song switching, dragging a progress bar, or fast or slow forward of a certain user type.
  • step S120 target feature data of the multimedia to be played is obtained.
  • the target feature data may include at least one of a chorus, a verse, drum beats, and a song type, and the target feature data may also include the range of each part of the chorus, the verse, and the drum beats.
  • the song type may include DJ, pop, or folk songs, etc.
  • the multimedia to be played is music
  • features such as the chorus part and the drum part in the music can be recognized.
  • step S130 the multimedia to be played is preloaded based at least on the target operation data and the target characteristic data.
  • the multimedia to be played can be preloaded based on the target operation data and the target feature data.
  • the weight corresponding to each operation behavior in the target operation data can be obtained based on the target operation data, and the parts of the target multimedia corresponding to each operation behavior can be preloaded in turn according to the weight.
  • the weight corresponding to the operation behavior of playing the chorus of a certain user type is the highest, and the chorus part can be loaded first, and after the chorus part is preloaded, the other parts can be preloaded.
  • the preload amount can be set, such as the preloaded part accounts for 10% of the weight data of the part, etc.
  • the preload amount and the number of preloaded multimedia can also be determined according to the network quality or network type. For example, in the case of good network quality or WIFI, the preload amount or the number of preloaded multimedia can be increased, and in the case of weak network or 4G, the preload amount or the number of preloaded multimedia can be reduced, etc.
  • the multimedia data preloading method obtaineds the target operation data of a certain user type for the multimedia that has been played, and obtains the target feature data of the multimedia to be played, and obtains the preloading data of the multimedia to be played based on at least the target operation data and the target feature data. Since the preloading data of the preloaded target multimedia is related to the operation data of a certain user type and the target feature data of the multimedia to be played, the multimedia to be played can be accurately preloaded, greatly improving the preloading efficiency.
  • the target operation data includes multiple target operation behaviors
  • the above step S130 may further specifically include the following steps:
  • the target operation data may include multiple target operation behaviors
  • the target operation data performed by a certain user type when playing multimedia in the historical stage can be input into the behavior adjuster to obtain the weights corresponding to the multiple target operation behaviors.
  • the behavior adjuster can determine or adjust the weights corresponding to the multiple target operation behaviors according to the operation frequency, number of times or duration corresponding to the multiple target operation behaviors.
  • the target feature data corresponding to the target operation behavior with a high weight may be loaded first.
  • the weight corresponding to the multiple target operation behaviors including the operation behavior of playing the chorus is the highest, and the chorus part can be loaded first, and then the other parts are loaded.
  • the priorities corresponding to the multiple target operation behaviors may be determined based on the target weights, and the preloaded data corresponding to the target feature data may be preloaded based on the priorities.
  • FIG. 2 is an operation behavior of a certain user type in the process of playing music in an exemplary embodiment of the present disclosure
  • 11 in FIG. 2 represents a song progress control
  • 12 represents a chorus part
  • 13 represents a drum part.
  • the data range of the chorus part in the multimedia to be played is between 10s and 16s
  • the data range of the drum part in the multimedia to be played can be between 1min20s and 1min25s.
  • the chorus part between 10s and 16s in the multimedia to be played can be loaded first, and the drum part between 20s and 25s in the multimedia to be played can be preloaded after the preloading is completed, and finally the other data of the multimedia to be played can be preloaded.
  • the corresponding parts such as chorus or drums can be fully preloaded 100% according to needs or network factors, or a part of them, such as 20%, can be preloaded, etc., and the embodiment is not limited to this.
  • the played multimedia includes a first multimedia and a second multimedia having adjacent playback cycles, and the first multimedia and the multimedia to be played have adjacent playback cycles; the above step S131 may further specifically include the following steps:
  • Step S11 determining initial weights corresponding to a plurality of target operation behaviors respectively based on the feature data of the second multimedia.
  • Step S12 adjusting the initial weights according to the characteristic data of the first multimedia to obtain target weights corresponding to the multiple target operation behaviors.
  • multimedia playback of a certain user type within a day can be regarded as a playback cycle according to the multimedia playback cycle, such as a day.
  • target operation data for a certain user type for multiple multimedia playback cycles can be obtained, and the initial weights corresponding to multiple target operation behaviors can be determined based on the multimedia played in the earlier playback cycle in time order according to the time sequence of the playback cycle, and the initial weights corresponding to multiple target operation behaviors can be optimized based on the multimedia played in the later playback cycle to obtain the target weight.
  • the feature data of the first multimedia and the feature data of the second multimedia in the embodiment can respectively include feature data such as drum beats, chorus or main song.
  • the second multimedia can be multimedia that has been played in an earlier playback cycle
  • the first multimedia can be multimedia that has been played in a later playback cycle.
  • the initial weights corresponding to the multiple target operation behaviors can be determined through the corresponding multiple target operation behaviors in the feature data of the second multimedia, and then the initial weights can be adjusted through the corresponding multiple target operation behaviors in the feature data of the first multimedia to obtain the target weights.
  • the weights corresponding to the multiple target operation behaviors previously obtained can be adjusted and optimized through the multiple target operation behaviors in the latest playback cycle, so as to obtain more accurate preloaded data.
  • the above method may further include the following steps:
  • Step S140 obtaining network status information.
  • Step S150 determining a target number of the preloaded multimedia to be played based on the network status information.
  • the current network status information may be obtained, and the network status information may include the transmission bit rate of the current network, and the quality of the current network may be determined by the transmission bit rate, such as good, medium or poor.
  • the network status information may also include the network type, such as WIFI, 4G or 5G.
  • the target number of multimedia to be played that needs to be preloaded can be determined within the threshold range of the current network transmission bit rate, and the target number can be positively correlated with the transmission bit rate.
  • the network type can also be combined, for example, in the case of WIFI, the target data can be greater than the preset number, otherwise in the case of 4G or 5G, the target number is not greater than the preset number.
  • the preload data of the target number of multimedia to be played can be obtained based on the network status information, the target operation data and the target characteristic data.
  • the target number of multimedia to be played can be preloaded to obtain the preload data of the target number of multimedia to be played. For example, since some music may not completely contain the target characteristic data, or the proportion of target characteristic data in different multimedia to be played is different, each multimedia to be played can be preloaded according to the target operation data and the target characteristic data, and it is determined how much corresponding preload data needs to be preloaded for each multimedia to be played, such as how much the chorus part needs to be preloaded, how much the drum part needs to be preloaded, and so on.
  • the multimedia data preloading device can execute the multimedia data preloading method provided by any embodiment of the present disclosure.
  • the embodiment of the present disclosure can divide the device into functional units according to the above method example. For example, each functional module/unit can be divided corresponding to each function, or two or more functions can be integrated into one processing module. It is worth noting that the various modules/units included in the above device are only divided according to functional logic, but are not limited to the division described in the text.
  • each module/unit can be implemented in various appropriate ways, such as hardware, firmware, or any appropriate combination.
  • FIG3 is a schematic block diagram of the functional modules of a multimedia data preloading device provided by an exemplary embodiment of the present disclosure. As shown in FIG3, the multimedia data preloading device includes:
  • the target operation data acquisition module 10 is configured to acquire target operation data for the played multimedia
  • the target feature data acquisition module 20 is configured to acquire target feature data of the multimedia to be played
  • the preloading module 30 is configured to preload the multimedia to be played based at least on the target operation data and the target characteristic data.
  • the target operation data includes multiple target operation behaviors; the preloading module is specifically configured to:
  • the multimedia to be played is preloaded based on the target weight and the target characteristic data to obtain preload data.
  • the preloading module may be further configured as follows:
  • Preload data corresponding to the target feature data is preloaded based on the priority.
  • the played multimedia includes a first multimedia and a second multimedia having adjacent play periods, and the first multimedia and the to-be-played multimedia have adjacent play periods;
  • the preloading module may be further configured as follows:
  • the initial weight is adjusted according to the feature data of the first multimedia to obtain target weights corresponding to the multiple target operation behaviors respectively.
  • the apparatus further comprises:
  • An information acquisition module configured to acquire network status information
  • the quantity determination module is configured to determine the target quantity of the preloaded multimedia to be played based on the network status information.
  • the preloading module may be further configured as follows:
  • the target operation data and the target characteristic data Based on the network status information, the target operation data and the target characteristic data, the target number of preloaded data of the multimedia to be played is obtained.
  • the electronic device includes a hardware structure and/or software module corresponding to the execution of each function.
  • the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present disclosure.
  • the present disclosure also provides an electronic device, comprising: at least one processor; a memory for storing instructions executable by the at least one processor; wherein the at least one processor is configured to execute the instructions to implement The above method disclosed in the embodiment of the present disclosure.
  • Fig. 4 is a schematic diagram of the structure of an electronic device provided by an exemplary embodiment of the present disclosure.
  • the electronic device 1800 includes at least one processor 1801 and a memory 1802 coupled to the processor 1801, and the processor 1801 can execute the corresponding steps in the above method disclosed in the embodiment of the present disclosure.
  • the processor 1801 may also be referred to as a central processing unit (CPU), which may be an integrated circuit chip having signal processing capabilities. Each step in the method disclosed in the embodiment of the present disclosure may be completed by an integrated logic circuit of hardware in the processor 1801 or by instructions in the form of software.
  • the processor 1801 may be a general-purpose processor, a digital signal processor (DSP), an ASIC, a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • DSP digital signal processor
  • FPGA field-programmable gate array
  • a general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
  • the steps of the method disclosed in the embodiment of the present disclosure may be directly embodied as being executed by a hardware decoding processor, or may be executed by a combination of hardware and software modules in a decoding processor.
  • the software module may be located in a memory 1802, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, or other mature storage media in the art.
  • the processor 1801 reads the information in the memory 1802 and completes the steps of the method in combination with its hardware.
  • FIG. 5 is a block diagram of a computer system provided by an exemplary embodiment of the present disclosure.
  • Computer system 1900 is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers.
  • Electronic devices can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices.
  • the components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and/or claimed herein.
  • the computer system 1900 includes a computing unit 1901, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1902 or a computer program loaded from a storage unit 1908 into a random access memory (RAM) 1903.
  • ROM read-only memory
  • RAM random access memory
  • various programs and data required for the operation of the computer system 1900 can also be stored.
  • the computing unit 1901, ROM 1902, and RAM 1903 are connected to each other via a bus 1904.
  • An input/output (I/O) interface 1905 is also connected to the bus 1904.
  • a plurality of components in the computer system 1900 are connected to the I/O interface 1905, including an input unit 1906, an output unit 1907, a storage unit 1908, and a communication unit 1909.
  • the input unit 1906 may be a computer system 1900.
  • the computer system 1900 may be any type of device for inputting information, and the input unit 1906 may receive input digital or character information, and generate key signal input related to user settings and/or function control of the electronic device.
  • the output unit 1907 may be any type of device capable of presenting information, and may include but is not limited to a display, a speaker, a video/audio output terminal, a vibrator and/or a printer.
  • the storage unit 1908 may include but is not limited to a disk, an optical disk.
  • the communication unit 1909 allows the computer system 1900 to exchange information/data with other devices over a network such as the Internet, and may include but is not limited to a modem, a network card, an infrared communication device, a wireless communication transceiver and/or a chipset, such as a BluetoothTM device, a WiFi device, a WiMax device, a cellular communication device and/or the like.
  • the computing unit 1901 may be a variety of general and/or special processing components with processing and computing capabilities. Some examples of the computing unit 1901 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc.
  • the computing unit 1901 performs the various methods and processes described above. For example, in some embodiments, the above methods disclosed in the embodiments of the present disclosure may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 1908.
  • part or all of the computer program may be loaded and/or installed on the electronic device 1900 via the ROM 1902 and/or the communication unit 1909.
  • the computing unit 1901 may be configured to perform the above methods disclosed in the embodiments of the present disclosure in any other appropriate manner (e.g., by means of firmware).
  • the embodiment of the present disclosure further provides a computer-readable storage medium, wherein when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the above method disclosed in the embodiment of the present disclosure.
  • the computer-readable storage medium in the disclosed embodiments may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment.
  • the computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing.
  • the computer-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read-only memory
  • EPROM or flash memory erasable programmable read-only memory
  • CD-ROM portable compact disk read-only memory
  • CD-ROM compact disk read-only memory
  • magnetic storage device or any suitable combination of the foregoing.
  • the computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
  • the embodiments of the present disclosure further provide a computer program product, including a computer program, wherein when the computer program is executed by a processor, the above method disclosed in the embodiments of the present disclosure is implemented.
  • computer program codes for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages.
  • the program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server.
  • the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer.
  • LAN local area network
  • WAN wide area network
  • each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function.
  • the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved.
  • each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
  • modules, components or units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the names of the modules, components or units do not, in some cases, limit the modules, components or units themselves.
  • exemplary hardware logic components include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
  • FPGAs field programmable gate arrays
  • ASICs application specific integrated circuits
  • ASSPs application specific standard products
  • SOCs systems on chip
  • CPLDs complex programmable logic devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本公开涉及多媒体数据预加载方法、装置、电子设备及存储介质,上述方法包括:获取针对已播放多媒体的目标操作数据;获取待播放多媒体的目标特征数据;至少基于所述目标操作数据和所述目标特征数据,对所述待播放多媒体进行预加载。

Description

多媒体数据预加载方法、装置、电子设备及存储介质
相关申请的交叉引用
本申请是以申请号为202310679148.1、申请日为2023年6月8日的中国申请为基础,并主张其优先权,该中国申请的公开内容在此作为整体引入本申请中。
技术领域
本公开涉及计算机技术领域,尤其涉及多媒体数据预加载方法、装置、电子设备及存储介质。
背景技术
随着以手机为代表的终端产品得到普及,用户可以很方便的在终端上播放自己喜欢的音乐。如果用户所处的网络环境不是很好,很多情况下会影响终端上播放的音乐,比如会出现数据加载较慢,导致播放卡顿。因此,需要对音乐进行预加载,尽量避免因网络质量影响播放的卡顿等现象。
发明内容
本公开提供了一种多媒体数据预加载方法、装置、电子设备及存储介质。
根据本公开的一方面,提供了一种多媒体数据预加载方法,所述方法包括:
获取针对已播放多媒体的目标操作数据;
获取待播放多媒体的目标特征数据;
至少基于所述目标操作数据和所述目标特征数据,对所述待播放多媒体进行预加载。
在一些实施例中,所述目标操作数据包括多个目标操作行为;
所述对所述待播放多媒体进行预加载,包括:
确定所述多个目标操作行为分别对应的目标权重;
基于所述目标权重和所述目标特征数据对所述待播放多媒体进行预加载,获得预加载数据。
在一些实施例中,所述基于所述目标权重和所述目标特征数据对所述待播放多媒体进行预加载,包括:
基于所述目标权重,确定所述多个目标操作行为分别对应的优先级;
基于所述优先级预加载所述目标特征数据对应的预加载数据。
在一些实施例中,所述已播放多媒体包括具有相邻播放周期的第一多媒体和第二多媒体,所述第一多媒体与所述待播放多媒体具有相邻的播放周期;
所述确定所述多个目标操作行为分别对应的目标权重,包括:
基于所述第二多媒体的特征数据确定所述多个目标操作行为分别对应的初始权重;
通过所述第一多媒体的特征数据调整所述初始权重,得到所述多个目标操作行为分别对应的目标权重。
在一些实施例中,所述方法还包括:
获取网络状态信息;
基于所述网络状态信息确定所述预加载的待播放多媒体的目标数量。
在一些实施例中,所述对所述待播放多媒体进行预加载,包括:
基于所述网络状态信息、所述目标操作数据和所述目标特征数据,获取所述目标数量的待播放多媒体的预加载数据。
根据本公开的第二方面,提供了一种多媒体数据预加载装置,所述装置包括:
目标操作数据获取模块,被配置为获取针对已播放多媒体的目标操作数据;
目标特征数据获取模块,被配置为获取待播放多媒体的目标特征数据;
预加载模块,被配置为至少基于所述目标操作数据和所述目标特征数据,对所述待播放多媒体进行预加载。
在一些实施例中,所述目标操作数据包括多个目标操作行为;所述预加载模块,具体被配置为:
确定所述多个目标操作行为分别对应的目标权重;
基于所述目标权重和所述目标特征数据对所述待播放多媒体进行预加载,获得预加载数据。
在一些实施例中,所述预加载模块,具体还可被配置为:
基于所述目标权重,确定所述多个目标操作行为分别对应的优先级;
基于所述优先级预加载所述目标特征数据对应的预加载数据。
在一些实施例中,所述已播放多媒体包括具有相邻播放周期的第一多媒体和第二多媒体,所述第一多媒体与所述待播放多媒体具有相邻的播放周期;所述预加载模块,具体被配置为:
基于所述第二多媒体的特征数据确定所述多个目标操作行为分别对应的初始权重;
通过所述第一多媒体的特征数据调整所述初始权重,得到所述多个目标操作行为分别 对应的目标权重。
在一些实施例中,所述装置还包括:
信息获取模块,被配置为获取网络状态信息;
数量确定模块,被配置为基于所述网络状态信息确定所述预加载的待播放多媒体的目标数量。
在一些实施例中,所述预加载模块,具体还可被配置为:
基于所述网络状态信息、所述目标操作数据和所述目标特征数据,获取所述目标数量的待播放多媒体的预加载数据。
根据本公开的第三方面,提供了一种电子设备,该电子设备包括:存储器和处理器,所述存储器上存储有计算机程序和/或指令,所述处理器执行所述程序和/或指令时实现如以上所述的方法。
根据本公开的第四方面,提供了一种计算机可读存储介质,其上存储有计算机程序和/或指令,所述程序和/或指令被处理器执行时实现本公开的上述方法。
根据本公开的第五方面,提供一种计算机程序产品,包含指令,该指令在由处理器执行时使得处理器实现本公开的上述方法。
根据本公开的第六方面,提供一种计算机程序,包括程序代码,该程序代码在由处理器执行时导致实现本公开的上述方法。
附图说明
在下面结合附图对于示例性实施例的描述中,本公开的更多细节、特征和优点被公开,在附图中:
图1为本公开一示例性实施例提供的多媒体数据预加载方法的流程图;
图2为本公开一示例性的实施例中用户在播放音乐过程中的操作行为的场景示意图;
图3为本公开一示例性实施例提供的多媒体数据预加载装置的功能模块示意性框图;
图4为本公开一示例性实施例提供的电子设备的结构框图;
图5为本公开一示例性实施例提供的计算机系统的结构框图。
具体实施方式
下面将参照附图更详细地描述本公开的实施例。虽然附图中显示了本公开的某些实施例,然而应当理解的是,本公开可以通过各种形式来实现,而且不应该被解释为限于这里阐述的实施例,相反提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是, 本公开的附图及实施例仅用于示例性作用,并非用于限制本公开的保护范围。
应当理解,本公开的方法实施方式中记载的各个步骤可以按照不同的顺序执行,和/或并行执行。此外,方法实施方式可以包括附加的步骤和/或省略执行示出的步骤。本公开的范围在此方面不受限制。
本文使用的术语“包括”及其变形是开放性包括,即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”;术语“另一实施例”表示“至少一个另外的实施例”;术语“一些实施例”表示“至少一些实施例”。其他术语的相关定义将在下文描述中给出。需要注意,本公开中提及的“第一”、“第二”等概念仅用于对不同的装置、模块或单元进行区分,并非用于限定这些装置、模块或单元所执行的功能的顺序或者相互依存关系。
需要注意,本公开中提及的“一个”、“多个”的修饰是示意性而非限制性的,本领域技术人员应当理解,除非在上下文另有明确指出,否则应该理解为“一个或多个”。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的,而并不是用于对这些消息或信息的范围进行限制。
可以理解的是,在使用本公开各实施例公开的技术方案之前,均应当依据相关法律法规通过恰当的方式对本公开所涉及个人信息的类型、使用范围、使用场景等告知用户并获得用户的授权。
例如,在响应于接收到用户的主动请求时,向用户发送提示信息,以明确地提示用户,其请求执行的操作将需要获取和使用到用户的个人信息。从而,使得用户可以根据提示信息来自主地选择是否向执行本公开技术方案的操作的电子设备、应用程序、服务器或存储介质等软件或硬件提供个人信息。
作为一种可选的但非限定性的实现方式,响应于接收到用户的主动请求,向用户发送提示信息的方式例如可以是弹窗的方式,弹窗中可以以文字的方式呈现提示信息。此外,弹窗中还可以承载供用户选择“同意”或者“不同意”向电子设备提供个人信息的选择控件。可以理解的是,上述通知和获取用户授权过程仅是示意性的,不对本公开的实现方式构成限定,其它满足相关法律法规的方式也可应用于本公开的实现方式中。
某用户类型在通过手机等终端播放多媒体时,很多时候某用户类型会在多媒体播放的界面进行操作,例如拖动进度条或者快进等操作,观看或者收听自己喜爱的部分,或者反复观看或者收听自己喜爱的那部分多媒体。这样往往涉及需要对多媒体进行预加载。
相关技术中,在对多媒体进行预加载时,很多情况会对多媒体进行大范围的预加载。这样虽然能够保障多媒体的提前加载,但这些加载的数据未必是用户想要播放的数据,可 能会造成用户流量的浪费,导致预加载效率较低。
因此,为了提高多媒体预加载的效率,使得提前进行预加载获得的预加载数据尽可能的是某用户类型喜欢或者想要播放的数据,本公开提供的实施例会根据某用户类型对多媒体的相关操作数据和待播放多媒体的特征数据,获取待播放多媒体预加载数据,实现对待播放多媒体的预加载。这样获得的预加载数据能够符合某用户类型的播放习惯和喜好,可以在很大程度上提高多媒体预加载的效率。其中,实施例中的多媒体可以是音乐或者视频等数据,实施例中以多媒体为音乐为例进行说明,实施例并不限于此。
在一些实施例中,可以获取某用户类型对音乐的历史操作行为数据,例如某用户类型在之前播放音乐过程中对音乐的切歌行为,还可以包括拖动进度条的操作行为、快进操作或者慢进操作等行为,例如某用户类型听了m%切歌、拖动进度条、快进播放歌曲或者慢进播放歌曲等,可以将这些历史操作行为数据中的至少一种输入到行为调整器当中,调整某用户类型各个操作行为的权重。
例如,可以一天为一个播放周期,假如某用户类型通过音乐播放器在5天中播放了音乐,可以将第一天在播放音乐的过程中的操作行为数据输入到行为调整器中,获得该某用户类型行为操作的初始权重,将后续4天按照天数依次输入到该行为调整器中,不断调整该某用户类型的行为操作的权重,得到最终调整后的目标权重。在一些实施例中,某用户类型的历史操作行为数据的比重,可以与距离当前的时长反相关。即距离当前时间越长的操作行为,在整个历史操作行为数据中占的比重越低,反之越高。
在一些实施例中,还可以在某用户类型5天的音乐播放当中,前4天作为音乐的一个播放周期,可以将这4天某用户类型的操作行为输入到行为调整器中,获得该某用户类型行为操作的初始权重,将第5天的操作行为数据输入到该行为调整器中,调整该某用户类型的行为操作的权重,实现对初始权重的优化,得到调整后的目标权重。后续可以不断的将最新的1天内某用户类型对音乐的操作行为数据输入到调整器中,实现对行为操作的权重不断调整,使得调整后的权重可以更加符合某用户类型的操作习惯和对音乐的播放喜好。
通过行为调整器获得的目标权重,可以为下个播放周期的预加载做准备。在一些实施例中,该行为调整器可以为预设模型,如神经网络模型,通过某用户类型的历史操作行为数据不断对预设模型进行训练,进而可以通过训练后的预设模型获得该目标权重。
在本公开提供的实施例中,仍旧以多媒体为音乐为例,通过获取待播放多媒体,该待播放多媒体可以是某用户类型直接选择想要播放的音乐,例如某用户类型通过选择自己喜欢的音乐生成一个待播放音乐列表,该音乐列表中包括多首音乐。该待播放多媒体还可以 是系统自动为某用户类型生成的音乐播放列表,例如可以根据某用户类型过往播放的音乐为某用户类型进行推荐得到的音乐播放列表,当然该音乐播放列表中的音乐还可以是随机生成的,或者其他某用户类型播放比较多的音乐等等,实施例不限于此。
在一些实施例中,该待播放多媒体可以包括音乐播放列表,该音乐播放列表可以包括一个或者多个音乐,该待播放多媒体还可以携带音乐播放列表中音乐的目标特征数据。该目标特征数据可以是副歌、主歌、鼓点和歌曲类型等中的至少一种,目标特征数据还可以包括副歌、主歌和鼓点中各个部分的范围,歌曲类型可以包括DJ、流行或者民歌等等。
在本公开提供的实施例中,通过上述确定某用户类型的多个目标操作行为分别对应的目标权重,并结合待播放多媒体的目标特征数据,就可以对待播放多媒体进行预加载,例如确定优先加载的数据和加载数据的范围等。
在一些实施例中,还可以获取当前的网络状态信息,比如网络质量和网络类型等,结合网络状态信息、目标权重和目标特征数据,确定需要加载的待播放多媒体的数量和这些数量的多媒体的预加载数据等。即可以确定需要加载几首音乐,每首音乐中预加载数据的范围等,例如,音乐播放列表中包括10首音乐,确定出需要预加载其中的5首音乐,每首音乐中需要加载对应的副歌部分或者鼓点部分对应多少加载比例等等,实施例不限于此。
基于上述实施例,在本公开提供的又一实施例中,还提供了一种多媒体数据预加载方法,如图1所示,该方法可以包括以下步骤:
在步骤S110中,获取针对已播放多媒体的目标操作数据。
在一些实施例中,在获取某用户类型的相关数据时,可以通过弹窗等方式征询某用户类型,在得到某用户类型的同意后才会获取。实施例中的多媒体可以是音乐或者视频等数据,该目标操作数据可以包括某用户类型的切歌行为、快进、倒退或者对歌曲的特定部分的播放等行为数据,例如,某用户类型的切歌、拖动进度条或者快慢进等。
在步骤S120中,获取待播放多媒体的目标特征数据。
在一些实施例中,以待播放多媒体为音乐为例进行说明,该目标特征数据可以包括副歌、主歌、鼓点和歌曲类型等中的至少一种,目标特征数据还可以包括副歌、主歌和鼓点中各个部分的范围,歌曲类型可以包括DJ、流行或者民歌等等。
可以通过对待播放多媒体进行特征提取和特征识别,例如在待播放多媒体为音乐时,识别音乐中的副歌部分、鼓点部分等特征。
在步骤S130中,至少基于目标操作数据和目标特征数据,对待播放多媒体进行预加载。
在一些实施例中,可以基于目标操作数据和目标特征数据,对待播放多媒体进行预加载。例如,可以基于目标操作数据,获得目标操作数据中各个操作行为对应的权重,可以依据权重的高低依次为各操作行为对应的目标多媒体中的部分进行预加载。例如,某用户类型播放副歌的操作行为对应的权重最高,可以优先加载副歌部分,在预加载完副歌部分之后,再预加载其他部分。在一些实施例中,预加载副歌部分时,可以设定预加载量,比如预加载部分占该部分重量数据的10%等,例如对于一首音乐中,副歌部分预加载副歌总量的10%时,确定副歌部分预加载完成。在一些实施例中,还可以根据网络质量或者网络类型来确定预加载量,及预加载多媒体的数量,例如在网络质量好或者WIFI情况下,预加载量或预加载多媒体的数量可以增加,在弱网或者4G情况下,可以预加载量或者预加载多媒体的数量可以减少等等。
本公开实施例提供的多媒体数据预加载方法,通过获取某用户类型的针对已播放多媒体的目标操作数据,及获取待播放多媒体的目标特征数据,至少基于目标操作数据和目标特征数据,获取待播放多媒体的预加载数据。由于预加载目标多媒体的预加载数据与某用户类型的操作数据和待播放多媒体的目标特征数据有关,使得能够对待播放多媒体进行准确预加载,大大提高预加载效率。
基于上述实施例,在本公开提供的又一实施例中,目标操作数据包括多个目标操作行为,上述步骤S130具体还可以包括以下步骤:
S131,确定多个目标操作行为分别对应的目标权重。
在一些实施例中,目标操作数据可以包括多个目标操作行为,可以通过将某用户类型在历史阶段播放的多媒体时进行的目标操作数据输入到行为调整器中,获取该多个目标操作行为分别对应的权重,在获得下个播放周期的目标操作数据后,可以将其输入到行为调整器中,调整多个目标操作行为分别对应的权重,获得目标权重。其中,行为调整器可以根据多个目标操作行为分别对应的操作频率、次数或者时长等,确定或者调整多个目标操作行为分别对应的权重。
S132,基于目标权重和目标特征数据对待播放多媒体进行预加载,获得预加载数据。
在一些实施例中,在根据目标权重和目标特征数据对待播放多媒体进行预加载的过程中,可以将权重高的目标操作行为对应的目标特征数据进行优先加载。
例如,多个目标操作行为包括播放副歌的操作行为对应的权重最高,可以优先加载副歌部分,再加载其他部分。
因此,在一些实施例中,可以基于目标权重,确定多个目标操作行为分别对应的优先级,并基于优先级预加载目标特征数据对应的预加载数据。
示例性的,如图2所示,图2为本公开一示例性的实施例中某用户类型在播放音乐过程中的操作行为,图2中的11表示歌曲进度控件,12表示副歌部分,13表示鼓点部分。其中,实施例中副歌部分在待播放多媒体中的数据范围为第10s至16s之间,鼓点部分在待播放多媒体中的数据范围为可以第1min20s至1min25s之间。那么在根据目标权重和目标特征数据对待播放多媒体进行预加载时,由于播放副歌的操作行为的权重最高,因此可以优先加载待播放多媒体中第10s至16s之间副歌部分,在预加载完成后再预加载待播放多媒体中第20s至25s之间鼓点部分,最后再预加载待播放多媒体的其他数据。在一些实施例中,可以根据需要或者网络等因素,对相应部分比如副歌或者鼓点等,可以100%的完全预加载,或者预加载其中一部分,例如20%等,实施例不限于此。
基于上述实施例,为了对多个目标操作行为分别对应的权重不断进行优化和调整,在本公开提供的又一实施例中,已播放多媒体包括具有相邻播放周期的第一多媒体和第二多媒体,第一多媒体与待播放多媒体具有相邻的播放周期;上述步骤S131具体还可以包括以下步骤:
步骤S11,基于第二多媒体的特征数据确定多个目标操作行为分别对应的初始权重。
步骤S12,通过第一多媒体的特征数据调整初始权重,得到多个目标操作行为分别对应的目标权重。
在一些实施例中,可以根据多媒体播放周期,例如一天时间,将某用户类型一天内的多媒体播放作为一个播放周期。这样可以获得某用户类型针对多媒体的多个播放周期的目标操作数据,可以按照播放周期的时间先后顺序,基于时间上较早的播放周期中已播放的多媒体确定多个目标操作行为分别对应的初始权重,基于时间上较晚的播放周期中已播放的多媒体优化多个目标操作行为分别对应的初始权重,得到目标权重。实施例中第一多媒体的特征数据和第二多媒体的特征数据,可以分别包括鼓点、副歌或者主歌等特征数据。
因此,实施例中的第二多媒体可以是时间上较早的播放周期中已播放多媒体,第一多媒体可以是时间上较晚的播放周期中已播放多媒体,可以通过第二多媒体的特征数据中对应的多个目标操作行为,确定该多个目标操作行为分别对应的初始权重,再通过第一多媒体的特征数据中对应的多个目标操作行为对该初始权重进行调整,得到目标权重。这样在获得最新播放周期中的多个目标操作行为时,可以通过该最新播放周期中的多个目标操作行为对之前获得的多个目标操作行为分别对应的权重进行调整和优化,以便获得更加准确的预加载数据。
基于上述实施例,在本公开提供的又一实施例中,上述方法还可以包括以下步骤:
步骤S140,获取网络状态信息。
步骤S150,基于所述网络状态信息确定所述预加载的待播放多媒体的目标数量。
在一些实施例中,可以获取当前的网络状态信息,该网络状态信息可以包括当前网络的传输码率,通过该传输码率确定当前网络的质量情况,例如良好、中或者差等。该网络状态信息还可以包括网络类型,例如WIFI、4G或者5G等。
例如,可以在当前网络的传输码率对于的阈值范围,确定需要预加载的待播放多媒体的目标数量,该目标数量可以与传输码率正相关。另外,还可以结合网络类型,例如在WIFI情况下,该目标数据可以大于预设数量,否则在4G或者5G情况下,该目标数量不大于预设数量。
因此,在本公开的实施例中,可以通过基于网络状态信息、目标操作数据和目标特征数据,获取目标数量的待播放多媒体的预加载数据。在确定预加载待播放多媒体的目标数量后,就可以对该目标数量的待播放多媒体进行预加载,获得该目标数量的待播放多媒体的预加载数据。例如,由于有些音乐可能不完全包含目标特征数据,或者不同的待播放多媒体中目标特征数据的占比不同,这样可以根据目标操作数据和目标特征数据对各个待播放多媒体进行预加载,确定每个待播放多媒体需要预加载多少对应的预加载数据,例如副歌部分需要预加载多少,鼓点部分需要预加载多少等等。
以下将描述根据本公开的实施例的多媒体数据预加载装置。本公开实施例所提供的多媒体数据预加载装置可执行本公开任意实施例所提供的多媒体数据预加载方法,本公开实施例可以根据上述方法示例对装置进行功能单元的划分,例如,可以对应各个功能划分各个功能模块/单元,也可以将两个或两个以上的功能集成在一个处理模块中。值得注意的是,上述装置所包括的各个模块/单元只是按照功能逻辑进行划分的,但并不局限于文中所述的划分,实际实现时可以有另外的划分方式,只要能够实现相应的功能即可;另外,各模块/单元的具体名称也只是为了便于相互区分,并不用于限制本公开实施例的保护范围。此外,各模块/单元可采用各种适当方式来实现,例如硬件、固件、或任何适当组合来实现的。
在采用对应各个功能划分各个功能模块的情况下,本公开实施例提供了一种多媒体数据预加载装置,该多媒体数据预加载装置可以为服务器或应用于服务器的芯片。图3为本公开一示例性实施例提供的多媒体数据预加载装置的功能模块示意性框图。如图3所示,该多媒体数据预加载装置包括:
目标操作数据获取模块10,被配置为获取针对已播放多媒体的目标操作数据;
目标特征数据获取模块20,被配置为获取待播放多媒体的目标特征数据;
预加载模块30,被配置为至少基于所述目标操作数据和所述目标特征数据,对所述待播放多媒体进行预加载。
在一些实施例中,所述目标操作数据包括多个目标操作行为;所述预加载模块,具体被配置为:
确定所述多个目标操作行为分别对应的目标权重;
基于所述目标权重和所述目标特征数据对所述待播放多媒体进行预加载,获得预加载数据。
在一些实施例中,所述预加载模块,具体还可被配置为:
基于所述目标权重,确定所述多个目标操作行为分别对应的优先级;
基于所述优先级预加载所述目标特征数据对应的预加载数据。
在一些实施例中,所述已播放多媒体包括具有相邻播放周期的第一多媒体和第二多媒体,所述第一多媒体与所述待播放多媒体具有相邻的播放周期;所述预加载模块,具体还可被配置为:
基于所述第二多媒体的特征数据确定所述多个目标操作行为分别对应的初始权重;
通过所述第一多媒体的特征数据调整所述初始权重,得到所述多个目标操作行为分别对应的目标权重。
在一些实施例中,所述装置还包括:
信息获取模块,被配置为获取网络状态信息;
数量确定模块,被配置为基于所述网络状态信息确定所述预加载的待播放多媒体的目标数量。
在一些实施例中,所述预加载模块,具体还可被配置为:
基于所述网络状态信息、所述目标操作数据和所述目标特征数据,获取所述目标数量的待播放多媒体的预加载数据。
有关装置部分,与上述方法相对应,具体可以参见上述方法实施例的描述,这里不再赘述。
上述主要对本公开实施例提供的方案进行了介绍。可以理解的是,为了实现上述功能,电子设备包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,本公开能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本公开的范围。
本公开实施例还提供一种电子设备,包括:至少一个处理器;用于存储所述至少一个处理器可执行指令的存储器;其中,所述至少一个处理器被配置为执行所述指令,以实现 本公开实施例公开的上述方法。
图4为本公开一示例性实施例提供的电子设备的结构示意图。如图4所示,该电子设备1800包括至少一个处理器1801以及耦接至处理器1801的存储器1802,该处理器1801可以执行本公开实施例公开的上述方法中的相应步骤。
上述处理器1801还可以称为中央处理单元(central processing unit,CPU),其可以是一种集成电路芯片,具有信号的处理能力。本公开实施例公开的上述方法中的各步骤可以通过处理器1801中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器1801可以是通用处理器、数字信号处理器(digital signal processing,DSP)、ASIC、现成可编程门阵列(field-programmable gate array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本公开实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于存储器1802中,例如随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质。处理器1801读取存储器1802中的信息,结合其硬件完成上述方法的步骤。
另外,根据本公开的各种操作/处理在通过软件和/或固件实现的情况下,可从存储介质或网络向具有专用硬件结构的计算机系统,例如图5所示的计算机系统1900安装构成该软件的程序,该计算机系统在安装有各种程序时,能够执行各种功能,包括诸如前文所述的功能等等。图5为本公开一示例性实施例提供的计算机系统的结构框图。
计算机系统1900旨在表示各种形式的数字电子的计算机设备,诸如,膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置,诸如,个人数字处理、蜂窝电话、智能电话、可穿戴设备和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例,并且不意在限制本文中描述的和/或者要求的本公开的实现。
如图5所示,计算机系统1900包括计算单元1901,该计算单元1901可以根据存储在只读存储器(ROM)1902中的计算机程序或者从存储单元1908加载到随机存取存储器(RAM)1903中的计算机程序,来执行各种适当的动作和处理。在RAM 1903中,还可存储计算机系统1900操作所需的各种程序和数据。计算单元1901、ROM 1902以及RAM 1903通过总线1904彼此相连。输入/输出(I/O)接口1905也连接至总线1904。
计算机系统1900中的多个部件连接至I/O接口1905,包括:输入单元1906、输出单元1907、存储单元1908以及通信单元1909。输入单元1906可以是能向计算机系统1900 输入信息的任何类型的设备,输入单元1906可以接收输入的数字或字符信息,以及产生与电子设备的用户设置和/或功能控制有关的键信号输入。输出单元1907可以是能呈现信息的任何类型的设备,并且可以包括但不限于显示器、扬声器、视频/音频输出终端、振动器和/或打印机。存储单元1908可以包括但不限于磁盘、光盘。通信单元1909允许计算机系统1900通过网络诸如因特网的与其他设备交换信息/数据,并且可以包括但不限于调制解调器、网卡、红外通信设备、无线通信收发机和/或芯片组,例如蓝牙TM设备、WiFi设备、WiMax设备、蜂窝通信设备和/或类似物。
计算单元1901可以是各种具有处理和计算能力的通用和/或专用处理组件。计算单元1901的一些示例包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的计算单元、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。计算单元1901执行上文所描述的各个方法和处理。例如,在一些实施例中,本公开实施例公开的上述方法可被实现为计算机软件程序,其被有形地包含于机器可读介质,例如存储单元1908。在一些实施例中,计算机程序的部分或者全部可以经由ROM 1902和/或通信单元1909而被载入和/或安装到电子设备1900上。在一些实施例中,计算单元1901可以通过其他任何适当的方式(例如,借助于固件)而被配置为执行本公开实施例公开的上述方法。
本公开实施例还提供一种计算机可读存储介质,其中,当所述计算机可读存储介质中的指令由电子设备的处理器执行时,使得所述电子设备能够执行本公开实施例公开的上述方法。
本公开实施例中的计算机可读存储介质可以是有形的介质,其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。上述计算机可读存储介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何合适组合。更具体的,上述计算机可读存储介质可以包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
上述计算机可读介质可以是上述电子设备中所包含的;也可以是单独存在,而未装配入该电子设备中。
本公开实施例还提供一种计算机程序产品,包括计算机程序,其中,所述计算机程序被处理器执行时实现本公开实施例公开的上述方法。
在本公开的实施例中,可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码,上述程序设计语言包括但不限于面向对象的程序设计语言,诸如Java、Smalltalk、C++,还包括常规的过程式程序设计语言,诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络(包括局域网(LAN)或广域网(WAN))连接到用户计算机,或者,可以连接到外部计算机。
附图中的流程图和框图,图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的模块、部件或单元可以通过软件的方式实现,也可以通过硬件的方式来实现。其中,模块、部件或单元的名称在某种情况下并不构成对该模块、部件或单元本身的限定。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如,非限制性地,可以使用的示例性的硬件逻辑部件包括:现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。
以上描述仅为本公开的一些实施例以及对所运用技术原理的说明。本领域技术人员应当理解,本公开中所涉及的公开范围,并不限于上述技术特征的特定组合而成的技术方案,同时也应涵盖在不脱离上述公开构思的情况下,由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
虽然已经通过示例对本公开的一些特定实施例进行了详细说明,但是本领域的技术人员应该理解,以上示例仅是为了进行说明,而不是为了限制本公开的范围。本领域的技术人员应该理解,可在不脱离本公开的范围和精神的情况下,对以上实施例进行修改。本公开的范围由所附权利要求来限定。

Claims (16)

  1. 一种多媒体数据预加载方法,所述方法包括:
    获取针对已播放多媒体的目标操作数据;
    获取待播放多媒体的目标特征数据;
    至少基于所述目标操作数据和所述目标特征数据,对所述待播放多媒体进行预加载。
  2. 根据权利要求1所述的方法,其中,所述目标操作数据包括多个目标操作行为;
    所述对所述待播放多媒体进行预加载,包括:
    确定所述多个目标操作行为分别对应的目标权重;
    基于所述目标权重和所述目标特征数据对所述待播放多媒体进行预加载,获得预加载数据。
  3. 根据权利要求2所述的方法,其中,所述基于所述目标权重和所述目标特征数据对所述待播放多媒体进行预加载,包括:
    基于所述目标权重,确定所述多个目标操作行为分别对应的优先级;
    基于所述优先级预加载所述目标特征数据对应的预加载数据。
  4. 根据权利要求2所述的方法,其中,所述已播放多媒体包括具有相邻播放周期的第一多媒体和第二多媒体,所述第一多媒体与所述待播放多媒体具有相邻的播放周期;
    所述确定所述多个目标操作行为分别对应的目标权重,包括:
    基于所述第二多媒体的特征数据确定所述多个目标操作行为分别对应的初始权重;
    通过所述第一多媒体的特征数据调整所述初始权重,得到所述多个目标操作行为分别对应的目标权重。
  5. 根据权利要求2-4中任一所述的方法,其中,所述方法还包括:
    获取网络状态信息;
    基于所述网络状态信息确定所述预加载的待播放多媒体的目标数量。
  6. 根据权利要求5所述的方法,其中,所述对所述待播放多媒体进行预加载,包括:
    基于所述网络状态信息、所述目标操作数据和所述目标特征数据,获取所述目标数量的待播放多媒体的预加载数据。
  7. 一种多媒体数据预加载装置,其中,所述装置包括:
    目标操作数据获取模块,被配置为获取针对已播放多媒体的目标操作数据;
    目标特征数据获取模块,被配置为获取待播放多媒体的目标特征数据;
    预加载模块,被配置为至少基于所述目标操作数据和所述目标特征数据,对所述待播 放多媒体进行预加载。
  8. 根据权利要求7所述的装置,其中,所述目标操作数据包括多个目标操作行为;所述预加载模块进一步被配置为:
    确定所述多个目标操作行为分别对应的目标权重;
    基于所述目标权重和所述目标特征数据对所述待播放多媒体进行预加载,获得预加载数据。
  9. 根据权利要求7所述的装置,其中,所述预加载模块具体还被配置为:
    基于所述目标权重,确定所述多个目标操作行为分别对应的优先级;
    基于所述优先级预加载所述目标特征数据对应的预加载数据。
  10. 根据权利要求7所述的装置,其中,所述已播放多媒体包括具有相邻播放周期的第一多媒体和第二多媒体,所述第一多媒体与所述待播放多媒体具有相邻的播放周期;
    其中,所述预加载模块具体还配置为:
    基于所述第二多媒体的特征数据确定所述多个目标操作行为分别对应的初始权重;
    通过所述第一多媒体的特征数据调整所述初始权重,得到所述多个目标操作行为分别对应的目标权重。
  11. 根据权利要求7所述的装置,其中,所述装置还包括:
    信息获取模块,被配置为获取网络状态信息;
    数量确定模块,被配置为基于所述网络状态信息确定所述预加载的待播放多媒体的目标数量。
  12. 根据权利要求7所述的装置,其中,所述预加载模块具体还被配置为:
    基于所述网络状态信息、所述目标操作数据和所述目标特征数据,获取所述目标数量的待播放多媒体的预加载数据。
  13. 一种电子设备,包括:
    至少一个处理器;
    用于存储可执行指令的存储器;
    其中,所述至少一个处理器被配置为执行所述可执行指令,以实现根据权利要求1-6中任一项所述的方法。
  14. 一种计算机可读存储介质,存储指令,所述指令在由处理器执行时,使得所述处理器能够执行根据权利要求1-6中任一项所述的方法。
  15. 一种计算机程序产品,包含指令,该指令在由处理器执行时使得处理器实现根据权利要求1到6中任一项所述的方法。
  16. 一种计算机程序,包括程序代码,该程序代码在由处理器执行时导致实现根据权利要求1到6中任一项所述的方法。
PCT/CN2024/098221 2023-06-08 2024-06-07 多媒体数据预加载方法、装置、电子设备及存储介质 Ceased WO2024251274A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP24818800.5A EP4727105A1 (en) 2023-06-08 2024-06-07 Multimedia data pre-loading method and apparatus, electronic device, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202310679148.1A CN116708651B (zh) 2023-06-08 2023-06-08 多媒体数据预加载方法、装置、电子设备及存储介质
CN202310679148.1 2023-06-08

Publications (1)

Publication Number Publication Date
WO2024251274A1 true WO2024251274A1 (zh) 2024-12-12

Family

ID=87833491

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/098221 Ceased WO2024251274A1 (zh) 2023-06-08 2024-06-07 多媒体数据预加载方法、装置、电子设备及存储介质

Country Status (3)

Country Link
EP (1) EP4727105A1 (zh)
CN (1) CN116708651B (zh)
WO (1) WO2024251274A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116708651B (zh) * 2023-06-08 2025-04-15 北京字跳网络技术有限公司 多媒体数据预加载方法、装置、电子设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160070702A1 (en) * 2014-09-09 2016-03-10 Aivvy Inc. Method and system to enable user related content preferences intelligently on a headphone
CN106937163A (zh) * 2017-03-21 2017-07-07 微鲸科技有限公司 多媒体预加载方法和装置
CN107888981A (zh) * 2017-11-16 2018-04-06 北京小米移动软件有限公司 音视频预加载方法、装置、设备及存储介质
CN116708651A (zh) * 2023-06-08 2023-09-05 北京字跳网络技术有限公司 多媒体数据预加载方法、装置、电子设备及存储介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104683857B (zh) * 2015-01-23 2018-05-29 华为技术有限公司 用于数据预加载的可视化呈现的方法和设备
CN114491096A (zh) * 2020-11-13 2022-05-13 北京新氧科技有限公司 一种多媒体预加载方法、装置、设备及存储介质
CN113938551B (zh) * 2021-10-15 2023-04-11 维沃移动通信有限公司 缓存方法、装置、电子设备和存储介质
CN115344724B (zh) * 2022-08-11 2025-09-16 杭州网易云音乐科技有限公司 信息提示方法及装置、存储介质及电子设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160070702A1 (en) * 2014-09-09 2016-03-10 Aivvy Inc. Method and system to enable user related content preferences intelligently on a headphone
CN106937163A (zh) * 2017-03-21 2017-07-07 微鲸科技有限公司 多媒体预加载方法和装置
CN107888981A (zh) * 2017-11-16 2018-04-06 北京小米移动软件有限公司 音视频预加载方法、装置、设备及存储介质
CN116708651A (zh) * 2023-06-08 2023-09-05 北京字跳网络技术有限公司 多媒体数据预加载方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN116708651A (zh) 2023-09-05
EP4727105A1 (en) 2026-04-15
CN116708651B (zh) 2025-04-15

Similar Documents

Publication Publication Date Title
CN109558444B (zh) 数据检索方法及装置
US20220334951A1 (en) Page simulation system
US11511200B2 (en) Game playing method and system based on a multimedia file
WO2022262470A1 (zh) 视频处理方法、装置、存储介质及电子设备
WO2024227417A1 (zh) 信息处理方法、装置、电子设备及存储介质
WO2024251274A1 (zh) 多媒体数据预加载方法、装置、电子设备及存储介质
WO2025087029A1 (zh) 一种多媒体内容的播放方法、装置、电子设备及存储介质
US20240103802A1 (en) Method, apparatus, device and medium for multimedia processing
CN115223545A (zh) 语音交互测试的方法、装置、系统、设备以及存储介质
US20260086927A1 (en) Automatically varying system clocks to simulate test environments for application triggers generated using machine learning
US9361289B1 (en) Retrieval and management of spoken language understanding personalization data
CN119299438A (zh) 音频数据处理方法、设备、存储介质及计算机程序产品
CN117055993B (zh) 用于生成与展示投放信息的方法及相关设备
CN111949527A (zh) 游戏视频的测试方法、装置、设备及存储介质
CN118734064A (zh) 召回模型训练方法、搜索结果召回方法和装置
JP2025534429A (ja) ビデオ・テンプレート用のプッシュ方法、装置、媒体及びデバイス
CN110970059A (zh) 一种多媒体信息播放方法、装置及可读存储介质
CN116033009A (zh) 一种应用的推送方法、装置、设备及存储介质
CN111814484B (zh) 语义识别方法、装置、电子设备及可读存储介质
US20200409993A1 (en) Method and apparatus for determining output information
CN111930667A (zh) 一种在阅读应用中进行书籍推荐的方法与设备
CN116467597B (zh) 一种模型训练方法及装置
WO2025092696A1 (zh) 多媒体素材显示方法、装置、电子设备以及存储介质
CN108062353A (zh) 播放多媒体文件的方法和电子设备
WO2025035983A1 (zh) 处理请求的方法、装置、设备和存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24818800

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024818800

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2024818800

Country of ref document: EP

Effective date: 20260108

ENP Entry into the national phase

Ref document number: 2024818800

Country of ref document: EP

Effective date: 20260108

ENP Entry into the national phase

Ref document number: 2024818800

Country of ref document: EP

Effective date: 20260108

ENP Entry into the national phase

Ref document number: 2024818800

Country of ref document: EP

Effective date: 20260108

ENP Entry into the national phase

Ref document number: 2024818800

Country of ref document: EP

Effective date: 20260108