CN112818166A - Video information query method and device, electronic equipment and storage medium - Google Patents
Video information query method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112818166A CN112818166A CN202110144158.6A CN202110144158A CN112818166A CN 112818166 A CN112818166 A CN 112818166A CN 202110144158 A CN202110144158 A CN 202110144158A CN 112818166 A CN112818166 A CN 112818166A
- Authority
- CN
- China
- Prior art keywords
- video
- data
- query
- external service
- service system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/73—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/547—Messaging middleware
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Library & Information Science (AREA)
- Information Transfer Between Computers (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The embodiment of the invention provides a video information query method, a video information query device, a storage system and a storage medium, and relates to the technical field of advertisement putting. The method comprises the following steps: when a target video query request is received, querying a target video in pre-stored hotspot video data; the hotspot video data are acquired in advance according to historical data inquired by video information in the advertisement putting process; when the target video cannot be inquired in the hotspot video data, inquiring the target video in the prestored video updating data; the video updating data is obtained from an external service system when the external service system accessed by the advertisement putting system has the video updating data; and when the target video is not inquired in the video updating data, inquiring the target video from the external business system. The scheme of the invention avoids query delay, reduces the request quantity of query from an external service system, saves server resources and improves reliability and stability.
Description
Technical Field
The invention relates to the technical field of advertisement putting, in particular to a video information query method, a video information query device, electronic equipment and a storage medium.
Background
The acquisition of the video information plays a crucial role in the delivery process of the advertisement system, for example, whether a user enjoys the content attribute of the video information free of wide interests, the video delivery time of the patch advertisements, the tags and album ids, the political sensitive information shielding feature tags of the video and the like are needed, so how to improve the reliability and stability of the video information query service is necessary for the video advertisement delivery system.
Because the video data capacity is very large, the external query interface is generally relied on to perform video query of advertisement delivery in real time. However, the external Query interface timeout rate is about one thousandth, the peak timeout period is serious, and there is a strict QPS (Query Per Second) limit on external invocation. Therefore, due to the serious peak time and QPS limitation, the query delay is caused by simply relying on an external query interface to perform video query for advertisement delivery in real time, and the problem needs to be solved urgently.
Disclosure of Invention
The invention provides a video information query method, a video information query device, electronic equipment and a storage medium, and solves the problem that query delay is caused by the fact that the prior art only depends on an external query interface to perform video query of advertisement delivery in real time.
In a first aspect of the present invention, a video information query method is provided, which is applied to an advertisement delivery system, and the method includes:
when a target video query request is received, querying the target video in pre-stored hotspot video data; the hotspot video data are acquired in advance according to historical data inquired by video information in the advertisement putting process and are stored locally in the advertisement putting system;
when the target video cannot be inquired in the hotspot video data, inquiring the target video in prestored video updating data; the video updating data is obtained from an external service system accessed by the advertisement delivery system when the video is updated, and the video updating data is stored in a database;
and when the target video is not inquired in the video updating data, inquiring the target video from the external business system.
Preferably, before receiving the target video query request, the method further includes:
acquiring hotspot video data with query frequency meeting preset conditions according to historical data queried by video information in the advertisement delivery process, and storing the hotspot video data locally in the advertisement delivery system;
the preset condition is that the query frequency of the videos is greater than or equal to a preset threshold, or the preset condition is that the videos are arranged from high to low according to the query frequency, the query frequency of the videos is arranged at the first N bits, and N is an integer greater than or equal to 1.
Preferably, after storing the hotspot video data locally in the advertisement delivery system, the method further includes:
updating historical data inquired by video information in the advertisement putting process according to a preset period, and re-acquiring hotspot video data with the inquiry frequency meeting preset conditions according to the updated historical data;
and updating the hot video data locally stored in the advertisement delivery system according to the newly acquired hot video data.
Preferably, the method further comprises:
when the external service system accessed by the advertisement delivery system has video updating data, the video updating data is obtained from the external service system and is stored in the database.
Preferably, the method further comprises:
setting the validity period information of each video stored in the database while storing the video updating data in the database;
and when the time of any video stored in the database reaches the corresponding validity period, deleting the video from the database.
Preferably, when the target video is not queried in the video update data, after querying the target video from the external service system, the method further includes:
and storing the inquired target video in the database.
Preferably, after storing the hotspot video data locally in the advertisement delivery system, the method further includes:
when the external service system accessed by the advertisement delivery system has video updating data and the video in the video updating data comprises the video in the hot video data, the hot video data locally stored in the advertisement delivery system is updated according to the video updating data.
Preferably, when the target video is not queried in the video update data, the step of querying the target video from the external service system includes:
writing the task for inquiring the target video into a message queue; wherein the task of querying the target video written into the message queue comprises version information, ID information and/or validity period information stored in the database of the target video;
and acquiring video data corresponding to the tasks in the message queue from the external service system.
Preferably, before writing the task of querying the target video into the message queue, the method further includes:
and filtering the request for repeatedly inquiring the same target video received within a preset time length.
Preferably, when the external service system accessed by the advertisement delivery system has video update data, the step of acquiring the video update data from the external service system includes:
subscribing the task of video updating data written in the message queue by an external service system;
and acquiring video data corresponding to the tasks in the message queue from the external service system.
Preferably, the step of acquiring the video data corresponding to the task in the message queue from the external service system includes:
sending the task requests in the message queue to the external service system in batch, and performing query rate per second (QPS) flow limitation on the quantity of the task requests sent to the external service system;
and receiving video data corresponding to the tasks in the message queue returned by the external service system.
In a third aspect of the present invention, there is provided a video information query apparatus, applied to an advertisement delivery system, the apparatus including:
the first query module is used for querying the target video in the pre-stored hotspot video data when receiving a target video query request; the hotspot video data are acquired in advance according to historical data inquired by video information in the advertisement putting process and are stored locally in the advertisement putting system;
the second query module is used for querying the target video in the prestored video updating data when the target video cannot be queried in the hotspot video data; the video updating data is obtained from an external service system accessed by the advertisement delivery system when the video is updated, and the video updating data is stored in a database;
and the third query module is used for querying the target video from the external business system when the target video cannot be queried in the video updating data.
In a third aspect of the present invention, there is also provided an electronic device, including: a processor, a communication interface, a memory, and a communication bus; the processor, the communication interface and the memory complete mutual communication through a communication bus;
a memory for storing a computer program;
and the processor is used for realizing the steps in the video information inquiry method when the program stored in the memory is executed.
In a fourth aspect implemented by the present invention, there is also provided a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the video information query method as described in any one of the above.
Aiming at the prior art, the invention has the following advantages:
in the embodiment of the invention, when a target video query request is received, a target video is queried in pre-stored hotspot video data; the method comprises the steps that hot video data are obtained in advance according to historical data inquired by video information in an advertisement putting process, and the hot video data are stored in the local of an advertisement putting system; when the target video cannot be inquired in the hotspot video data, inquiring the target video in the prestored video updating data; the video updating data is obtained from an external service system when the external service system accessed by the advertisement putting system has video updating, and the video updating data is stored in the database; and when the target video is not inquired in the video updating data, inquiring the target video from the external business system. Therefore, the cached hotspot video data and the video update data can respond to the video query request in real time, the query delay is reduced, the query requirement can be basically met through the cached hotspot video data and the video update data, the query request amount from an external service system is reduced, the server resources are saved, the reliability and the stability are improved, a certain video query error is allowed in the embodiment of the invention, and if the target video cannot be queried from the hotspot video data and the video update data, the target video is queried from the external service system.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments will be briefly described below.
Fig. 1 is a schematic flowchart of a video information query method according to an embodiment of the present invention;
fig. 2 is a schematic flowchart illustrating a sub-step of a video information query method according to an embodiment of the present invention;
fig. 3 is a schematic flow chart illustrating another sub-step of a video information query method according to an embodiment of the present invention;
fig. 4 is a schematic flowchart illustrating a further sub-step of a video information query method according to an embodiment of the present invention;
FIG. 5 is a schematic block diagram of an advertisement delivery system provided by an embodiment of the present invention;
fig. 6 is a schematic block diagram of a video information query device according to an embodiment of the present invention;
fig. 7 is a schematic block diagram of an electronic device provided in an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
Fig. 1 is a schematic flow chart of a video information query method provided in an embodiment of the present invention, where the video information query method is applied to an advertisement delivery system, and as shown in fig. 1, the method includes:
step 101: when a target video query request is received, querying the target video in pre-stored hotspot video data; the hotspot video data are acquired in advance according to historical data inquired by video information in the advertisement putting process, and are stored in the local advertisement putting system.
Here, a batch of hot video data is acquired and stored locally in the advertisement delivery system by analyzing historical data of video information inquiry in the advertisement delivery process in advance, and when a target video inquiry request is received, inquiry is firstly carried out in the hot video data cached locally. The local cached hotspot video data can respond to the video query request in real time, compared with a mode of sending the query request to an external service system and waiting for response, the method has the advantages of high query speed and query delay reduction, and the hotspot video belongs to a video with higher query heat, so that most query requests can be met, and the request quantity of query from the external service system is reduced.
In the advertisement putting process, how to put the advertisement in the video is closely related to the video information, for example, whether a user enjoys the advertisement free interest needs to be judged by combining with the content attribute of the video, and how long the advertisement is put in the video and what type of advertisement is put in the video need to be comprehensively determined by combining with information such as the video duration, the label and the content, so that the video information needs to be inquired in the advertisement putting process. The target video refers to a video which is requested to be inquired in the advertising process, and can be any video.
The target video cannot be inquired in the hotspot video data, wherein one condition is that the target video does not exist in the hotspot video data, and the other condition is that the version of the target video stored in the hotspot video data is not the latest version, and both conditions can cause that the target video cannot be inquired and further inquiry in the video updating data is needed.
The version of the video refers to a storage version set in each time of storage updating, since the originally stored video information may be updated and changed in each time of storage updating, for example, 3 pieces of original attribute information are added to 5 pieces of attribute information, and in order to distinguish the videos stored in each time, the storage version information of the videos, such as version 1.1, version 1.2 and the like, may be set at the same time.
The data volume of the stored hotspot video can be set according to the requirement. For example, when the advertisement delivery system locally stores the hotspot video data, the data volume of the hotspot video can be adjusted according to the scale of the advertisement delivery system, so as to avoid occupying too much memory to influence other functions of the advertisement delivery system.
Step 102: when the target video cannot be inquired in the hotspot video data, inquiring the target video in prestored video updating data; the video updating data is obtained from an external service system accessed by the advertisement delivery system when the video is updated, and the video updating data is stored in a database.
Here, since the advertisement delivery is often directed to some new videos or cold videos, which are characterized by being new and having low access frequency and therefore not being in the derived hot video data, in the embodiment of the present invention, the new videos also have a cache function, that is, when an external service system accessed by the advertisement delivery system has video update data, the video update data is obtained from the external service system and stored. When the target video cannot be inquired in the hot video data, the target video is inquired in the video updating data, so that the hot video data is supplemented through the cached video updating data, the inquiry hit rate is improved, the inquiry request amount from an external service system is further reduced, the delay rate of the video inquiry request can be reduced through the cached video updating data, and the inquiry delay is avoided.
The condition that the target video is not inquired in the video updating data also comprises two conditions, namely the condition that the target video does not exist in the video updating data, and the condition that the version of the target video stored in the video updating data is not the latest version, wherein the two conditions can cause that the target video is not inquired and further inquiry is needed from an external business system.
The external service system accessed by the advertisement delivery system refers to an external service system providing a video source for the advertisement delivery system, the structure and the number of the external service systems are not limited in the embodiment of the invention, and the advertisement delivery system can be accessed to any structure and any number of external service systems according to requirements.
Step 103: and when the target video is not inquired in the video updating data, inquiring the target video from the external business system.
Here, the embodiment of the present invention allows a certain video query error, and if the target video cannot be queried from the hotspot video data and the video update data, the target video is queried from an external service system, thereby ensuring effective acquisition of the target video.
According to the video information query method, the video query request can be responded in real time through the cached hot video data and the cached video update data, query delay is avoided, the query requirements can be basically met through the cached hot video data and the cached video update data, the query amount from an external service system is reduced, server resources are saved, reliability and stability are improved, certain video query errors are allowed, and if a target video cannot be queried from the hot video data and the video update data, the video is queried from the external service system.
Preferably, as shown in fig. 2, before the step 101, the method further includes:
step 1001: acquiring hotspot video data with query frequency meeting preset conditions according to historical data queried by video information in the advertisement delivery process, and storing the hotspot video data locally in the advertisement delivery system;
the preset condition is that the query frequency of the videos is greater than or equal to a preset threshold, or the preset condition is that the videos are arranged from high to low according to the query frequency, the query frequency of the videos is arranged at the first N bits, and N is an integer greater than or equal to 1.
At the moment, the hot video data are acquired and stored locally by analyzing the historical data of video information inquiry in the advertisement putting process, and when a video inquiry request is received, the local hot video data are inquired at first, so that real-time response can be realized, inquiry delay is avoided, and the inquiry request amount of calling an external interface is reduced. The selected query frequency is greater than or equal to a preset threshold value, or the query frequency is arranged in front of N bits of videos, the hot videos selected in the mode can meet the query requirements of most videos launched by advertisements, the hit rate of local query is guaranteed, real-time response of query is guaranteed, and system performance is improved.
The preset threshold value can be set according to requirements and can be set to any value. For example, assuming that the preset threshold is set to 2 million times, when the preset condition is that the query frequency of the video is greater than or equal to the preset threshold, the video with the query frequency of more than 2 million times is acquired according to the historical data queried by the video information and is stored locally as the hot video.
The value of N may be set as needed, or may be set to any value. For example, assuming that N is set to 100, when the preset condition is that the videos are arranged in the order of the query frequency from high to low, and the query frequency of the videos is arranged at the top N bits, the videos with the query frequency arranged at the top 100 bits are obtained according to the historical data queried by the video information and are stored locally as the hot videos.
Of course, the embodiment of the present invention may also adopt other manners to select the hot video data, for example, determine whether the video belongs to the hot video according to the video tag, which is not described herein.
In the embodiment of the present invention, the historical data queried by the video information in the advertisement delivery process may only store the basic information such as the ID of each video, so as to save storage resources, and at this time, step 1001 may first obtain the set of the basic information such as the ID of the hotspot video according to the historical data, and then obtain the service data of the hotspot video from the external service system in batch according to the set of the basic information such as the ID of the hotspot video, and store the service data locally.
Specifically, the external service system may store the service data of the video in a service database, for example, a Mysql (My Structured Query Language) database), and the advertisement delivery system may derive a data file (for example, a mm-format file of a source code file) of the service data of the hotspot video from the service database through the video derivation service, and synchronize the data file to a local machine of the video information Query service of the advertisement delivery system.
Preferably, after the step 1001 stores the hotspot video data locally in the advertisement delivery system, the method further includes:
updating historical data inquired by video information in the advertisement putting process according to a preset period, and re-acquiring hotspot video data with the inquiry frequency meeting preset conditions according to the updated historical data;
and updating the hot video data locally stored in the advertisement delivery system according to the newly acquired hot video data.
At the moment, the locally stored hotspot video data are regularly updated according to the preset period, and the locally stored hotspot video data can be ensured to be the latest hotspot video all the time, so that the hit rate of local video query is improved, and the system performance is improved.
The preset period can be set according to requirements and can be any value. For example, assuming that the preset period is one day, the hotspot video data is obtained again according to the historical data of video information inquiry in the daily updated advertisement putting process and is synchronized to the local memory, so that the accuracy of the local hotspot video data is ensured.
Preferably, the method further comprises:
step 1002: when the external service system accessed by the advertisement delivery system has video updating data, the video updating data is obtained from the external service system and is stored in the database.
At the moment, the advertisement delivery system captures external video updating data in real time, namely the video updating data is obtained from the external service system in real time and recorded in the database, so that the hot video data is supplemented, when the target video cannot be queried in the hot video data, the video updating data is queried, the query hit rate is improved, the query request amount from the external service system is further reduced, the delay rate of the video query request can be reduced through the cached video updating data, and the query delay is avoided. And the video updating data is stored in the database, so that the local storage resources are saved.
When the external service system has video update, a notification message is issued to the advertisement delivery system, and the advertisement delivery system can acquire video update data from the external service system after receiving the notification message.
The database for storing the video update data according to the embodiment of the present invention may adopt a kv (Key-Value, Key-Value pair) storage system, such as a Remote Dictionary service (Redis), but is not limited thereto.
Particularly, in order to reduce the risk of dependence on an external system as much as possible, the embodiment of the present invention has an emergency downgrading function for the kv storage system, and the read of the kv storage system can be directly switched to a local cache memory through a configuration center, that is, when the step 1002 stores video update data in a database, or when the step 102 queries a target video in the database, or any step involving database reading, the read can be switched to the local cache memory to be executed, so as to ensure the functional integrity of the entire service.
When the kv storage system is in a downtime risk, the kv storage system is closed through the configuration center, and related reading operations are switched to the local cache memory, that is, functions of storing video update data, inquiring a target video and the like are performed through the local cache memory. The emergency standby function is realized through the cache of the local cache, and the functional integrity and the safety of the whole service are ensured.
Preferably, after the step 1001 stores the hotspot video data locally in the advertisement delivery system, the method further includes:
when the external service system accessed by the advertisement delivery system has video updating data and the video in the video updating data comprises the video in the hot video data, the hot video data locally stored in the advertisement delivery system is updated according to the video updating data.
At this time, when the external service system updates the locally stored hot video data, the updated data is synchronized into the locally stored hot video data, so as to ensure that the locally stored hot video data is the latest and most accurate video data, and further improve the hit rate of local query, thereby ensuring the real-time response of the query and improving the system performance.
When the external service system has video update, a notification message is issued to the advertisement delivery system, and after receiving the notification message, the advertisement delivery system can acquire video update data from the external service system and detect whether the acquired video update data includes hotspot video data.
Preferably, the method further comprises:
step 1003: setting the validity period information of each video stored in the database while storing the video updating data in the database;
step 1004: and when the time of any video stored in the database reaches the corresponding validity period, deleting the video from the database.
Here, since some newly updated new videos or cold videos are stored in the database, the access frequency of these videos is relatively low, in order to save the database resources, the validity period information of these videos is simultaneously stored in the database, and when a certain video reaches the corresponding validity period, the video is deleted from the database to release the database storage resources.
By the method, the latest updated video can be continuously stored in the database, the expired video is deleted, resources are released, hot video supplement is realized, the hit rate of video query is ensured, and the optimal performance of the database is ensured.
For example, for a national celebration video, a long validity period, such as one month, can be set due to a low update frequency, and for a small video uploaded by a user, a short validity period, such as one week, can be set due to a high update frequency. The setting mode of the validity period is not limited in the embodiment of the invention.
Preferably, after the step 103, the method further comprises:
and storing the inquired target video in the database.
At the moment, if the target video cannot be inquired from the hot video data and the video updating data, namely when the video inquiry is wrong, the data updating in the database is triggered through a video inquiry wrong event, namely, some cold videos with lower access frequency are continuously supplemented into the database, and when the same video is inquired again, the cold videos are obtained from the database, so that instant response can be realized without locally storing all the videos, the expenditure of video storage resources is reduced, and the contradiction between the requirement of real-time inquiry on low delay and the high delay existing in the video information updating of the existing scheme is decoupled.
When the target video cannot be inquired in the hotspot video data and the video updating data, the data in the database can be updated in an asynchronous processing mode, and the target video is supplemented into the database, so that the response speed is increased, and the processing efficiency is improved.
In the embodiment of the present invention, when a video needs to be queried from an external service system, the video can be implemented by using a message queue, which is specifically described as follows.
Preferably, as shown in fig. 3, the step 103 includes:
step 1031: writing the task for inquiring the target video into a message queue; wherein the task of querying the target video written into the message queue comprises version information, ID information and/or validity period information stored in the database of the target video;
step 1032: and acquiring video data corresponding to the tasks in the message queue from the external service system.
At the moment, when the target video cannot be inquired from the hotspot video data and the video updating data, the inquiry task is written into the message queue, the inquiry request is submitted to an external service system through the message queue, the ordered processing of the inquiry request can be ensured by utilizing the buffer action of the message queue, and the inquiry pressure on a service party is reduced.
The message queue used in step 1031 may be, for example, a distributed publish-subscribe message system kafka message queue, but is not limited thereto.
Wherein the message queue can comprise a first message queue for video basic information update and a second message queue for video feature library information update.
The first message queue typically issues update messages for basic information such as ID, version, URL, etc. of the video. The second message queue generally issues update messages of feature information such as tags of the video, which may include, for example, custom type tags, NLP (Natural Language Processing) tags obtained through machine learning, and the like.
Because the basic information such as the ID of the video is different from the message source of the characteristic information such as the label of the video, two message queues are adopted to release the updating message.
Wherein, the writing, in the step 1031, the task of querying the target video into the message queue may include: and writing the task for inquiring the target video into a first message queue of video basic information update.
In this case, when the target video task query task is written, a query message of basic information such as an ID and a version of the video may be written in the first message queue to query the video.
Preferably, before the step 1031 writes the task of querying the target video into the message queue, the method further includes:
and filtering the request for repeatedly inquiring the same target video received within a preset time length.
At this time, for a burst hot new video, pulse flow can be generated in a short time, and in order to prevent too many repeated query tasks from being submitted to a message queue, the embodiment of the invention supports filtering processing on the repeated tasks in the short time, namely, the same task is submitted once and then is not submitted any more, and subsequent repeated tasks are filtered.
The preset time length can be set according to requirements and can be any time length.
In the embodiment of the present invention, when the external service system needs to update the video to the database, the video update can be implemented by using a message queue, which is described in detail as follows.
Preferably, as shown in fig. 4, in step 1002, when the external service system accessed by the advertisement delivery system has video update data, the step of acquiring the video update data from the external service system includes:
step 10021: subscribing the task of video updating data written in the message queue by an external service system;
step 10022: and acquiring video data corresponding to the tasks in the message queue from the external service system.
At the moment, when the external service system has video updating data, the external service system writes the task of the video updating data into the message queue, the video information updating service of the advertisement delivery system subscribes the task in the message queue, the video updating data of the external service system is inquired through the message queue, the inquiry request can be ensured to be processed orderly by utilizing the caching function of the message queue, and the inquiry pressure to a service party is reduced.
The message queue used in step 10021 may be, for example, a distributed message middleware rocktmq message queue, but is not limited thereto.
Wherein the message queue can comprise a first message queue for video basic information update and a second message queue for video feature library information update. Writing the task of the video update data to the message queue by the external service system may include: and the external service system writes the task of the video updating data into a first message queue for updating the video basic information and/or a second message queue for updating the video feature library information. Accordingly, step 10021 subscribing to the task may comprise: and subscribing the video updating data written in the first message queue of the video basic information updating and/or the second message queue of the video feature library information updating. At this time, the first message queue can acquire messages for updating basic information such as the duration and the URL of the video, and the second message queue can acquire messages for updating feature information such as tags of the video, where the tag information may include a custom type tag and an NLP tag acquired through machine learning.
For step 1032 and step 10022, the step of acquiring the video data corresponding to the task in the message queue from the external service system may include:
sending the task requests in the message queue to the external service system in batch, and performing query rate per second (QPS) flow limitation on the quantity of the task requests sent to the external service system;
and receiving video data corresponding to the tasks in the message queue returned by the external service system.
At this time, the tasks in the kafka or rocktmq message queue can be combined and then asynchronously executed in batch, and consumption of the QPS is limited in the execution process, so that the processing efficiency is improved, the timeliness of the system is improved, and the query pressure on the business side is reduced.
The above-mentioned functions of processing the tasks in the message queue in bulk and executing the QPS flow limitation may be executed by a Task execution Manager, that is, the consumed tasks of the kafka or rickettmq message queue are first submitted to the Task execution Manager, which performs a layer of encapsulation on the execution queue, and provides the functions of serial synchronous execution, parallel asynchronous execution, batch serial synchronous execution, batch parallel asynchronous execution, QPS flow limitation in the execution process, and the like. For the tasks of the kafka or rocktmq message queue, the Task execution Manager limits the QPS consumed, merges the tasks and constructs a batch request to the service system for execution.
The following description will exemplify the implementation flow of the video information query method of the present invention with reference to the application scenario.
As shown in fig. 5, it is assumed that the advertisement delivery system according to the embodiment of the present invention includes a video information query service, a video hotspot service exporter, a video information update service, video info update, a video update data cache database hikv, a message middleware kafka, and a rocktmq, and the accessed external service system includes a video service data source.
The advertisement delivery system can be provided with a plurality of video information query services so as to bear more video query service requirements based on the plurality of query services and realize higher response speed. The advertisement delivery system can also be provided with a plurality of video information updating services, so that the processing efficiency of video updating is improved.
The video information query method applying the embodiment of the invention has the following specific execution flow:
s21: firstly, the video information inquiry service exports a data file of the hot video service data from a service database (which can adopt a Mysql database) through a hot video export service, and synchronizes the data file to a local machine of the video information inquiry service.
S22: when there is a query request of the target video sent by the adapter, the video information query service first queries local hot video service data, and if the query is received, the target video is directly returned, otherwise, the process goes to S23.
S23: the video information query service queries the video update data cache database, and if the target video is queried, the video update data cache database returns directly, otherwise, the process goes to S24.
Here, the case where the target video is not queried in S22 and S23 includes both the case where the target video does not exist or the case where the version is not the latest.
S24: the video information query service writes a task of querying a target video into a video basic information updated message queue of kafka, wherein the kafka comprises a video basic information updated message queue entry and a video feature library information updated message queue feature, and the write task comprises version information and id information of the video and validity period information stored in a video update data cache database.
S25: the video information update service subscribes to the task of kafka, and when acquiring the task message, the flow goes to S27.
S26: the video information update service subscribes to the task of rocktmq, and when acquiring the task message, jumps to S27.
When video update data exists in the video service data source, the video service data source update notification service writes an update task in the rocktmq.
S27: the video information updating service inquires a reading read/feature interface of a video service data source, and then updates the inquired video data into a video updating data cache database.
When the S27 is executed, the video information update service may submit the consumed tasks of kafka or rocktmq to the task execution manager, where the task execution manager may limit the consumed QPS, merge the tasks, and construct a batch request to the video service data source for execution.
The kafka and the rocktmq both support multi-process parallel consumption under the same group id, and the balance of consumption partitions can be automatically triggered by adding and quitting of a video information updating service.
According to the video information query method, when a query request of a target video is received, hot video data cached locally is queried firstly, when the query is not successful, video update data cached in a database is queried, when the query is not successful, the data can be queried from the outside, and the database update data is triggered, so that the real-time response can be realized on the video query request, the query delay is avoided, the query quantity from an external service system is reduced, the server resources are saved, the reliability and the stability are improved, a certain video query error is allowed, the video update is triggered through a video query error event, the overhead of video storage resources is effectively reduced, and the contradiction between the requirement of real-time query on low delay and the existing scheme that the video information update has high delay is decoupled.
Referring to fig. 6, an embodiment of the present invention further provides a video information query apparatus 600, which is applied to an advertisement delivery system, and the apparatus includes:
the first query module 601 is configured to query a target video from pre-stored hotspot video data when receiving a target video query request; the hotspot video data are acquired in advance according to historical data inquired by video information in the advertisement putting process and are stored locally in the advertisement putting system;
a second query module 602, configured to query the target video in pre-stored video update data when the target video is not queried in the hotspot video data; the video updating data is obtained from an external service system accessed by the advertisement delivery system when the video is updated, and the video updating data is stored in a database;
a third query module 603, configured to query the target video from the external service system when the target video is not queried in the video update data.
According to the video information inquiry device, the video inquiry request can be responded in real time through the cached hot spot video data and the cached video updating data, inquiry delay is avoided, the inquiry requirements can be basically met through the cached hot spot video data and the cached video updating data, the inquiry request amount from an external service system is reduced, server resources are saved, reliability and stability are improved, a certain video inquiry error is allowed, and if a target video cannot be inquired from the hot spot video data and the video updating data, the video is inquired from the external service system.
Preferably, the apparatus further comprises:
the first storage module is used for acquiring hotspot video data with query frequency meeting preset conditions according to historical data queried by video information in the advertisement delivery process and storing the hotspot video data locally in the advertisement delivery system;
the preset condition is that the query frequency of the videos is greater than or equal to a preset threshold, or the preset condition is that the videos are arranged from high to low according to the query frequency, the query frequency of the videos is arranged at the first N bits, and N is an integer greater than or equal to 1.
Preferably, the apparatus further comprises:
the first acquisition module is used for updating historical data inquired by video information in the advertisement putting process according to a preset period and acquiring hot video data with inquiry frequency meeting preset conditions again according to the updated historical data;
and the first updating module is used for updating the hot video data locally stored in the advertisement delivery system according to the newly acquired hot video data.
Preferably, the apparatus further comprises:
and the second storage module is used for acquiring the video updating data from the external service system when the external service system accessed by the advertisement delivery system has the video updating data, and storing the video updating data in the database.
Preferably, the apparatus further comprises:
the first setting module is used for storing the video updating data in a database and setting the validity period information of each video stored in the database;
and the deleting module is used for deleting any video from the database when the time stored in the database reaches the corresponding validity period.
Preferably, the apparatus further comprises:
and the third storage module is used for storing the inquired target video in the database.
Preferably, the apparatus further comprises:
and the second updating module is used for updating the hot video data locally stored in the advertisement delivery system according to the video updating data when the external service system accessed by the advertisement delivery system has the video updating data and the video in the video updating data comprises the video in the hot video data.
Preferably, the third query module 603 is specifically configured to:
writing the task for inquiring the target video into a message queue; wherein the task of querying the target video written into the message queue comprises version information, ID information and/or validity period information stored in the database of the target video;
and acquiring video data corresponding to the tasks in the message queue from the external service system.
Preferably, the apparatus further comprises:
and the filtering module is used for filtering the request for repeatedly inquiring the same target video, which is received within a preset time length.
Preferably, the second storage module is specifically configured to:
subscribing the task of video updating data written in the message queue by an external service system;
and acquiring video data corresponding to the tasks in the message queue from the external service system.
Preferably, the step of acquiring, by the third query module 603 or the second storage module, video data corresponding to the task in the message queue from the external service system includes:
sending the task requests in the message queue to the external service system in batch, and performing query rate per second (QPS) flow limitation on the quantity of the task requests sent to the external service system;
and receiving video data corresponding to the tasks in the message queue returned by the external service system.
According to the video information inquiry device provided by the embodiment of the invention, when an inquiry request of a target video is received, hot video data cached locally is inquired firstly, when the inquiry is not successful, video updating data cached in the database is inquired, when the inquiry is not successful in both local and database, the data is inquired from the outside, and the database updating data is triggered, so that the real-time response can be realized on the video inquiry request, the inquiry delay is avoided, the inquiry request quantity from an external service system is reduced, the server resource is saved, the reliability and stability are improved, a certain video inquiry mistake is allowed, the video updating is triggered through a video inquiry mistake event, the expense of video storage resources is effectively reduced, and the contradiction between the requirement of real-time inquiry low delay and the high delay existing in the video information updating of the existing scheme is decoupled.
For the above device embodiments, since they are basically similar to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points.
The embodiment of the invention also provides the electronic equipment which can be a server. As shown in fig. 7, the system comprises a processor 701, a communication interface 702, a memory 703 and a communication bus 704, wherein the processor 701, the communication interface 702 and the memory 703 are communicated with each other through the communication bus 704.
A memory 703 for storing a computer program.
When the processor 701 is configured to execute the program stored in the memory 703, the following steps are implemented:
when a target video query request is received, querying the target video in pre-stored hotspot video data; the hotspot video data are acquired in advance according to historical data inquired by video information in the advertisement putting process and are stored locally in the advertisement putting system;
when the target video cannot be inquired in the hotspot video data, inquiring the target video in prestored video updating data; the video updating data is obtained from an external service system accessed by the advertisement delivery system when the video is updated, and the video updating data is stored in a database;
and when the target video is not inquired in the video updating data, inquiring the target video from the external business system.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
In another embodiment of the present invention, a computer-readable storage medium is further provided, which stores instructions that, when executed on a computer, cause the computer to execute the video information query method described in the above embodiment.
In yet another embodiment of the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to execute the video information query method described in the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present invention are included in the protection scope of the present invention.
Claims (14)
1. A video information query method is applied to an advertisement delivery system, and is characterized by comprising the following steps:
when a target video query request is received, querying the target video in pre-stored hotspot video data; the hotspot video data are acquired in advance according to historical data inquired by video information in the advertisement putting process and are stored locally in the advertisement putting system;
when the target video cannot be inquired in the hotspot video data, inquiring the target video in prestored video updating data; the video updating data is obtained from an external service system accessed by the advertisement delivery system when the video is updated, and the video updating data is stored in a database;
and when the target video is not inquired in the video updating data, inquiring the target video from the external business system.
2. The method for querying video information according to claim 1, wherein before receiving the target video query request, the method further comprises:
acquiring hotspot video data with query frequency meeting preset conditions according to historical data queried by video information in the advertisement delivery process, and storing the hotspot video data locally in the advertisement delivery system;
the preset condition is that the query frequency of the videos is greater than or equal to a preset threshold, or the preset condition is that the videos are arranged from high to low according to the query frequency, the query frequency of the videos is arranged at the first N bits, and N is an integer greater than or equal to 1.
3. The method for querying video information according to claim 2, wherein after storing the hotspot video data locally in the advertisement delivery system, the method further comprises:
updating historical data inquired by video information in the advertisement putting process according to a preset period, and re-acquiring hotspot video data with the inquiry frequency meeting preset conditions according to the updated historical data;
and updating the hot video data locally stored in the advertisement delivery system according to the newly acquired hot video data.
4. The method for querying video information according to claim 1, further comprising:
when the external service system accessed by the advertisement delivery system has video updating data, the video updating data is obtained from the external service system and is stored in the database.
5. The method for querying video information according to claim 4, further comprising:
setting the validity period information of each video stored in the database while storing the video updating data in the database;
and when the time of any video stored in the database reaches the corresponding validity period, deleting the video from the database.
6. The video query method according to claim 1, wherein after querying the target video from the external service system when the target video is not queried in the video update data, the method further comprises:
and storing the inquired target video in the database.
7. The method for querying video information according to claim 2, wherein after storing the hotspot video data locally in the advertisement delivery system, the method further comprises:
when the external service system accessed by the advertisement delivery system has video updating data and the video in the video updating data comprises the video in the hot video data, the hot video data locally stored in the advertisement delivery system is updated according to the video updating data.
8. The video query method according to claim 1, wherein the step of querying the target video from the external service system when the target video is not queried in the video update data comprises:
writing the task for inquiring the target video into a message queue; wherein the task of querying the target video written into the message queue comprises version information, ID information and/or validity period information stored in the database of the target video;
and acquiring video data corresponding to the tasks in the message queue from the external service system.
9. The video query method of claim 8, wherein before writing the task of querying the target video into a message queue, the method further comprises:
and filtering the request for repeatedly inquiring the same target video received within a preset time length.
10. The video query method according to claim 4, wherein when the external service system accessed by the advertisement delivery system has video update data, the step of obtaining the video update data from the external service system comprises:
subscribing the task of video updating data written in the message queue by an external service system;
and acquiring video data corresponding to the tasks in the message queue from the external service system.
11. The method according to claim 8 or 10, wherein the step of obtaining the video data corresponding to the task in the message queue from the external service system comprises:
sending the task requests in the message queue to the external service system in batch, and performing query rate per second (QPS) flow limitation on the quantity of the task requests sent to the external service system;
and receiving video data corresponding to the tasks in the message queue returned by the external service system.
12. A video information inquiry device is applied to an advertisement delivery system, and is characterized in that the device comprises:
the first query module is used for querying the target video in the pre-stored hotspot video data when receiving a target video query request; the hotspot video data are acquired in advance according to historical data inquired by video information in the advertisement putting process and are stored locally in the advertisement putting system;
the second query module is used for querying the target video in the prestored video updating data when the target video cannot be queried in the hotspot video data; the video updating data is obtained from an external service system accessed by the advertisement delivery system when the video is updated, and the video updating data is stored in a database;
and the third query module is used for querying the target video from the external business system when the target video cannot be queried in the video updating data.
13. An electronic device, comprising: a processor, a communication interface, a memory, and a communication bus; the processor, the communication interface and the memory complete mutual communication through a communication bus;
a memory for storing a computer program;
a processor for implementing the steps of the video information query method according to any one of claims 1 to 11 when executing the program stored in the memory.
14. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a video information query method according to any one of claims 1 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110144158.6A CN112818166B (en) | 2021-02-02 | 2021-02-02 | Video information query method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110144158.6A CN112818166B (en) | 2021-02-02 | 2021-02-02 | Video information query method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112818166A true CN112818166A (en) | 2021-05-18 |
| CN112818166B CN112818166B (en) | 2023-07-25 |
Family
ID=75860647
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110144158.6A Active CN112818166B (en) | 2021-02-02 | 2021-02-02 | Video information query method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112818166B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115174982A (en) * | 2022-06-30 | 2022-10-11 | 咪咕文化科技有限公司 | Real-time video association display method and device, computing equipment and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090113475A1 (en) * | 2007-08-21 | 2009-04-30 | Yi Li | Systems and methods for integrating search capability in interactive video |
| CN104216957A (en) * | 2014-08-20 | 2014-12-17 | 北京奇艺世纪科技有限公司 | Query system and query method for video metadata |
| WO2016123894A1 (en) * | 2015-02-06 | 2016-08-11 | 百度在线网络技术（北京）有限公司 | Advertisement delivery method and system |
| CN105933538A (en) * | 2016-06-15 | 2016-09-07 | 维沃移动通信有限公司 | Video finding method for mobile terminal and mobile terminal |
| CN106326462A (en) * | 2016-08-30 | 2017-01-11 | 北京奇艺世纪科技有限公司 | Video index grading method and device |
| WO2017096836A1 (en) * | 2015-12-07 | 2017-06-15 | 乐视控股（北京）有限公司 | Method and system for caching video file |
| CN108132958A (en) * | 2016-12-01 | 2018-06-08 | 阿里巴巴集团控股有限公司 | A kind of multi-level buffer data storage, inquiry, scheduling and processing method and processing device |
| US20190068996A1 (en) * | 2017-08-30 | 2019-02-28 | Microsoft Technology Licensing, Llc. | Processing live video streams over hierarchical clusters |
| CN109992695A (en) * | 2019-04-10 | 2019-07-09 | 北京奇艺世纪科技有限公司 | A kind of video information querying method and device |
| US20190297131A1 (en) * | 2018-03-23 | 2019-09-26 | Satori Worldwide, Llc | System and Method for Querying and Updating a Live Video Stream Using a Structured Query Language |
-
2021
- 2021-02-02 CN CN202110144158.6A patent/CN112818166B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090113475A1 (en) * | 2007-08-21 | 2009-04-30 | Yi Li | Systems and methods for integrating search capability in interactive video |
| CN104216957A (en) * | 2014-08-20 | 2014-12-17 | 北京奇艺世纪科技有限公司 | Query system and query method for video metadata |
| WO2016123894A1 (en) * | 2015-02-06 | 2016-08-11 | 百度在线网络技术（北京）有限公司 | Advertisement delivery method and system |
| WO2017096836A1 (en) * | 2015-12-07 | 2017-06-15 | 乐视控股（北京）有限公司 | Method and system for caching video file |
| CN105933538A (en) * | 2016-06-15 | 2016-09-07 | 维沃移动通信有限公司 | Video finding method for mobile terminal and mobile terminal |
| CN106326462A (en) * | 2016-08-30 | 2017-01-11 | 北京奇艺世纪科技有限公司 | Video index grading method and device |
| CN108132958A (en) * | 2016-12-01 | 2018-06-08 | 阿里巴巴集团控股有限公司 | A kind of multi-level buffer data storage, inquiry, scheduling and processing method and processing device |
| US20190068996A1 (en) * | 2017-08-30 | 2019-02-28 | Microsoft Technology Licensing, Llc. | Processing live video streams over hierarchical clusters |
| US20190297131A1 (en) * | 2018-03-23 | 2019-09-26 | Satori Worldwide, Llc | System and Method for Querying and Updating a Live Video Stream Using a Structured Query Language |
| CN109992695A (en) * | 2019-04-10 | 2019-07-09 | 北京奇艺世纪科技有限公司 | A kind of video information querying method and device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115174982A (en) * | 2022-06-30 | 2022-10-11 | 咪咕文化科技有限公司 | Real-time video association display method and device, computing equipment and storage medium |
| CN115174982B (en) * | 2022-06-30 | 2024-04-09 | 咪咕文化科技有限公司 | Real-time video association display method, device, computing equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112818166B (en) | 2023-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6013514B2 (en) | System and method for improving access to search results | |
| CN109947668B (en) | Method and device for storing data | |
| US10606806B2 (en) | Method and apparatus for storing time series data | |
| CN111327696B (en) | Data processing method and system | |
| CN103338243A (en) | Method and system for updating cache data of Web node | |
| CN107092628B (en) | Time series data processing method and device | |
| CN110008041B (en) | Message processing method and device | |
| CN109783258A (en) | A kind of message treatment method, device and server | |
| CN112818166B (en) | Video information query method and device, electronic equipment and storage medium | |
| CN108280215B (en) | Hybrid updating method of E-commerce index file based on Solr | |
| CN112865927B (en) | Message delivery verification method, device, computer equipment and storage medium | |
| WO2021137768A1 (en) | Method, apparatus and device for consuming messages based on message queue | |
| CN112653736A (en) | Parallel source returning method and device and electronic equipment | |
| CN116881277A (en) | Data aggregation method, apparatus and computer readable medium | |
| CN113037420B (en) | Reading time stamp obtaining method and device, electronic equipment and storage medium | |
| CN113535477B (en) | Method and equipment for data disaster recovery | |
| CN111291127B (en) | Data synchronization method, device, server and storage medium | |
| CN109408496A (en) | A kind of method and device reducing data redundancy | |
| CN110781238B (en) | Client view caching method and device based on combination of Redis and Hbase | |
| CN112949326B (en) | Information query method, device, equipment and computer readable medium | |
| CN113742376A (en) | Data synchronization method, first server and data synchronization system | |
| CN113626457A (en) | Method and system for realizing database and cache consistency by cache deletion retry mechanism | |
| CN107025266B (en) | Service data processing method and device | |
| CN112688982A (en) | User request processing method and device | |
| CN112860746B (en) | Cache reduction-based method, equipment and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |