CN111954038B - Configurable search method and system based on ES efficient automatic synchronization - Google Patents
Configurable search method and system based on ES efficient automatic synchronization Download PDFInfo
- Publication number
- CN111954038B CN111954038B CN202010854323.2A CN202010854323A CN111954038B CN 111954038 B CN111954038 B CN 111954038B CN 202010854323 A CN202010854323 A CN 202010854323A CN 111954038 B CN111954038 B CN 111954038B
- Authority
- CN
- China
- Prior art keywords
- request
- video data
- media asset
- module
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000012544 monitoring process Methods 0.000 claims abstract description 42
- 238000007405 data analysis Methods 0.000 claims description 3
- 238000004519 manufacturing process Methods 0.000 abstract description 6
- 238000012545 processing Methods 0.000 description 7
- 238000012217 deletion Methods 0.000 description 6
- 230000037430 deletion Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000008447 perception Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a configurable search method and a configurable search system based on ES efficient automatic synchronization, wherein the method comprises the following steps: acquiring a request of a user for inquiring media resource video data; based on the request, judging whether the ES is configured, if not, then: querying a database; judging whether the request time is continuously preset for more than preset time, if so, then: updating query data to ES in full, and setting a redis distributed lock; releasing the redis distributed lock upon completion of the update; setting the configured ES for the media asset video data; monitoring the changes of a database video table and an association table to obtain a video id; and acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data into the ES. The invention can improve the user experience and the production efficiency.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a configurable search method and a configurable search system based on ES (distributed, high-expansion and high-real-time search and data analysis engine) with high efficiency and automatic synchronization.
Background
With the increasing of the system data volume, the direct query of the required data in the database is slower and slower, and at this time, a search engine needs to be introduced, and at present, data is synchronized into an ES (electronic storage system) in a manual mode, a large number of codes need to be modified, and automatic synchronization and configurability cannot be achieved.
Therefore, how to achieve seamless switching, the front end has no perception, the background automatically switches to the search engine according to needs, the existing codes do not need to be modified in a large amount, the user can be helped to retrieve the data expected to be inquired quickly, the waiting time of the user is reduced, the user experience is improved, and the production efficiency is improved.
Disclosure of Invention
In view of the above, the invention provides an ES-based efficient, automatic, synchronous and configurable search method, which can realize seamless switching, no perception at the front end, automatic switching to a search engine as required at the background, and no modification of a large number of existing codes, and can quickly help a user to retrieve data desired to be queried, reduce user waiting time, improve user experience, and improve production efficiency.
The invention provides an ES-based efficient automatic synchronization configurable search method, which comprises the following steps:
acquiring a request of a user for inquiring media resource video data;
based on the request, judging whether the ES is configured to be used, if not, then:
querying a database;
judging whether the request time is continuously preset for more than preset time, if so, then:
updating query data to ES in full, and setting a redis distributed lock;
releasing the redis distributed lock upon completion of the update;
setting the configured ES for the media asset video data;
monitoring the changes of a database video table and an association table to obtain a video id;
and acquiring the redis distributed lock, inquiring media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES.
Preferably, the method further comprises:
when it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
Preferably, the determining whether the request time is greater than the preset time continuously for a preset number of times includes:
and judging whether the request time is more than 5 seconds continuously for 5 times.
An ES-based efficient automatic synchronization configurable search system comprising:
the first acquisition module is used for acquiring a request of a user for inquiring the media asset video data;
a first judging module, configured to judge whether an ES is configured for use based on the request;
a first query module, configured to query a database when it is determined that the ES is not configured for use based on the request;
the second judgment module is used for judging whether the request time is greater than the preset time continuously for a preset time;
the updating module is used for updating the query data to the ES in full and setting a redis distributed lock when the continuous preset times of the request time is greater than the preset time;
the releasing module is used for releasing the redis distributed lock when the updating is completed;
the setting module is used for setting the configured ES used by the media asset video data;
the monitoring module is used for monitoring the changes of the database video table and the association table to obtain a video id;
and the synchronization module is used for acquiring the redis distributed lock, inquiring the media asset video data by monitoring the video id and synchronizing the inquired media asset video data to the ES.
Preferably, the system further comprises:
and the second query module is used for querying the ES based on the request when judging that the ES is configured and used based on the request.
Preferably, the second determination module is specifically configured to:
and judging whether the request time is more than 5 seconds continuously for 5 times.
In summary, the invention discloses a configurable search method based on ES efficient automatic synchronization, which includes the steps of firstly obtaining a request of a user for inquiring media asset video data, then judging whether an ES is configured for use or not based on the request, if not, inquiring a database, then judging whether the request time is continuously preset for times greater than the preset time, if so,: updating query data to ES in full, and setting a redis distributed lock; releasing a redis distributed lock when the update is complete; setting a configured and used ES of media asset video data, and monitoring the changes of a database video table and an association table to obtain a video id; and acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data into the ES. The method and the device can realize seamless switching, the front end is not aware, the background is automatically switched to the search engine according to the needs, the existing codes are not required to be modified in a large amount, the user can be rapidly helped to retrieve the data expected to be inquired, the waiting time of the user is reduced, the user experience is improved, and the production efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of an embodiment 1 of an ES-based efficient automatic synchronization configurable search method disclosed in the present invention;
FIG. 2 is a flowchart of an embodiment 2 of the configurable search method based on ES efficient automatic synchronization disclosed in the present invention;
FIG. 3 is a flowchart of an embodiment 3 of the configurable search method based on ES efficient automatic synchronization disclosed in the present invention;
FIG. 4 is a schematic structural diagram of an embodiment 1 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention;
FIG. 5 is a schematic structural diagram of an embodiment 2 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention;
FIG. 6 is a schematic structural diagram of embodiment 3 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, which is a flowchart of embodiment 1 of the configurable search method based on ES efficient automatic synchronization disclosed in the present invention, the method may include the following steps:
s101, acquiring a request of a user for inquiring media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
S102, based on the request, judging whether the use ES is configured, if not, the S103 is carried out:
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
S103, querying a database;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
S104, judging whether the request time is continuously preset for times more than the preset time, if so, entering S105:
then, whether the request time is continuously preset for more than preset time is judged.
S105, updating query data to ES in a full amount, and setting a redis distributed lock;
and when the continuous preset times of the request time is greater than the preset time, updating the table database in full, updating the query data to the ES in full, and setting a redis distributed lock.
S106, when the updating is completed, releasing the redis distributed lock;
when the update is complete, the redis distributed lock is released.
S107, setting a configured and used ES of the media asset video data;
then, the asset video data is set to the configuration use ES.
S108, monitoring changes of a database video table and an association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
S109, acquiring a redis distributed lock, inquiring media asset video data through monitoring a video id, and synchronizing the inquired media asset video data to an ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
To sum up, in the above embodiment, first, a request for a user to query media asset video data is obtained, then, based on the request, whether an ES is configured for use is determined, if not, the database is queried, then, whether the request time is continuously preset for a number of times greater than a preset time is determined, if yes, the method: updating query data to ES in full, and setting a redis distributed lock; releasing a redis distributed lock when the update is complete; setting a configured and used ES of media asset video data, and monitoring the changes of a database video table and an association table to obtain a video id; and acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data into the ES. The seamless switching can be achieved, the front end has no perception, the background is automatically switched to the search engine according to needs, existing codes do not need to be modified in a large amount, a user can be helped to retrieve data expected to be inquired quickly, the waiting time of the user is shortened, the user experience is improved, and the production efficiency is improved.
As shown in fig. 2, which is a flowchart of embodiment 2 of the configurable search method based on ES efficient automatic synchronization disclosed in the present invention, the method may include the following steps:
s201, acquiring a request of a user for inquiring media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
S202, based on the request, judging whether the use ES is configured, if not, the process goes to S203, and if so, the process goes to S210:
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
S203, querying a database;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
S204, judging whether the request time is continuously preset for times more than the preset time, if so, entering S205:
then, whether the request time is continuously preset for more than preset time is judged.
S205, updating query data to ES in a full amount, and setting a redis distributed lock;
and when the continuous preset times of the request time is greater than the preset time, updating the table database in full, updating the query data to the ES in full, and setting a redis distributed lock.
S206, when the updating is completed, releasing the redis distributed lock;
when the update is complete, the redis distributed lock is released.
S207, setting a configured and used ES of the media asset video data;
then, the asset video data is set to the configuration use ES.
S208, monitoring changes of the database video table and the association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
S209, acquiring a redis distributed lock, inquiring the media asset video data through monitoring the video id, and synchronizing the inquired media asset video data to the ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
S210, inquiring the ES based on the request.
When it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
As shown in fig. 3, which is a flowchart of embodiment 3 of the configurable search method based on ES efficient automatic synchronization disclosed in the present invention, the method may include the following steps:
s301, acquiring a request of a user for inquiring media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
S302, based on the request, judging whether the use ES is configured, if not, entering S303, and if so, entering S310:
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
S303, querying a database;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
S304, judging whether the request time is continuously 5 times and is more than 5 seconds, if so, entering S305:
then, whether the request time is continuously preset for more than preset time is judged. Specifically, it may be determined whether the request time is greater than 5 seconds in 5 consecutive times.
S305, updating query data to ES in a full amount, and setting a redis distributed lock;
and when the request time is continuously 5 times and is more than 5 seconds, the table database is updated in a full amount, the query data is updated to the ES in a full amount, and the redis distributed lock is set.
S306, releasing the redis distributed lock when the updating is finished;
when the update is complete, the redis distributed lock is released.
S307, setting a configured ES for the media asset video data;
then, the asset video data is set to the configuration use ES.
S308, monitoring the changes of the database video table and the association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
S309, acquiring a redis distributed lock, inquiring media asset video data through monitoring a video id, and synchronizing the inquired media asset video data to the ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
S310, inquiring the ES based on the request.
When it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
As shown in fig. 4, which is a schematic structural diagram of embodiment 1 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention, the system may include:
a first obtaining module 401, configured to obtain a request for a user to query media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
A first determining module 402, configured to determine whether an ES is configured for use based on the request;
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
A first query module 403, configured to query a database when it is determined that the ES is not configured for use based on the request;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
A second judging module 404, configured to judge whether the request time is greater than a preset time continuously for a preset number of times;
then, whether the request time is continuously preset for more than preset time is judged.
An updating module 405, configured to update query data to the ES in full and set a redis distributed lock when the request time is greater than the preset time for the preset number of consecutive times;
and when the continuous preset times of the request time is greater than the preset time, updating the table database in full, updating the query data to the ES in full, and setting a redis distributed lock.
A releasing module 406, configured to release the redis distributed lock when the update is completed;
when the update is complete, the redis distributed lock is released.
A setting module 407, configured to set the configured ES for the media asset video data;
then, the asset video data is set to the configuration use ES.
The monitoring module 408 is configured to monitor changes of the database video table and the association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
And the synchronization module 409 is configured to acquire a redis distributed lock, query the media asset video data by monitoring the video id, and synchronize the queried media asset video data to the ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
To sum up, in the above embodiment, first, a request for a user to query media asset video data is obtained, then, based on the request, whether an ES is configured for use is determined, if not, the database is queried, then, whether the request time is continuously preset for a number of times greater than a preset time is determined, if yes, the method: updating query data to ES in full, and setting a redis distributed lock; releasing a redis distributed lock when the update is complete; setting a configured and used ES of media asset video data, and monitoring the changes of a database video table and an association table to obtain a video id; and acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data into the ES. The seamless switching can be achieved, the front end has no perception, the background is automatically switched to the search engine according to needs, existing codes do not need to be modified in a large amount, a user can be helped to retrieve data expected to be inquired quickly, the waiting time of the user is shortened, the user experience is improved, and the production efficiency is improved.
As shown in fig. 5, which is a schematic structural diagram of embodiment 2 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention, the system may include:
a first obtaining module 501, configured to obtain a request for a user to query media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
A first determining module 502, configured to determine whether an ES is configured for use based on the request;
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
A first query module 503, configured to query the database when it is determined that the ES is not configured for use based on the request;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
A second judging module 504, configured to judge whether the request time is greater than a preset time continuously;
then, whether the request time is continuously preset for more than preset time is judged.
An updating module 505, configured to update query data to the ES in full and set a redis distributed lock when the request time is greater than the preset time for the preset number of consecutive times;
and when the continuous preset times of the request time is greater than the preset time, updating the table database in full, updating the query data to the ES in full, and setting a redis distributed lock.
A releasing module 506, configured to release the redis distributed lock when the update is completed;
when the update is complete, the redis distributed lock is released.
A setting module 507, configured to set an ES configured for use by the media asset video data;
then, the asset video data is set to the configuration use ES.
A monitoring module 508, configured to monitor changes in the database video table and the association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
And a synchronization module 509, configured to acquire a redis distributed lock, query the media asset video data by monitoring the video id, and synchronize the queried media asset video data to the ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
A second query module 510, configured to query the ES based on the request when it is determined that the ES is configured for use based on the request.
When it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
As shown in fig. 6, which is a schematic structural diagram of embodiment 3 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention, the system may include:
a first obtaining module 601, configured to obtain a request for a user to query media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
A first determining module 602, configured to determine whether an ES is configured to be used based on the request;
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
A first query module 603 configured to query the database when it is determined that the ES is not configured for use based on the request;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
A second judging module 604, configured to judge whether the request time is greater than 5 seconds continuously for 5 times;
then, whether the request time is continuously preset for more than preset time is judged. Specifically, it may be determined whether the request time is greater than 5 seconds in 5 consecutive times.
An updating module 605, configured to update query data to the ES in full and set a redis distributed lock when the request time is greater than the preset time for the preset number of consecutive times;
and when the continuous preset times of the request time is greater than the preset time, updating the table database in full, updating the query data to the ES in full, and setting a redis distributed lock.
A releasing module 606, configured to release the redis distributed lock when the update is completed;
when the update is complete, the redis distributed lock is released.
A setting module 607, configured to set the ES used by the media asset video data;
then, the asset video data is set to the configuration use ES.
The monitoring module 608 is configured to monitor changes of the database video table and the association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
And the synchronization module 609 is configured to acquire a redis distributed lock, query the media asset video data by monitoring the video id, and synchronize the queried media asset video data to the ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
A second query module 610, configured to query the ES based on the request when it is determined that the ES has been configured for use based on the request.
When it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (6)
1. An ES-based efficient automatic synchronization configurable search method is characterized by comprising the following steps:
acquiring a request of a user for inquiring media resource video data;
based on the request, judging whether the ES is configured to be used, if not, then:
querying a database;
judging whether the request time is continuously preset for more than preset time, if so, then:
updating query data to ES in full, and setting a redis distributed lock;
releasing the redis distributed lock upon completion of the update;
setting the configured ES for the media asset video data;
monitoring the changes of a database video table and an association table to obtain a video id;
acquiring the redis distributed lock, inquiring media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to an ES (extended service provider); wherein the ES is an Elasticissearch search and data analysis engine.
2. The method of claim 1, further comprising:
when it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
3. The method of claim 1, wherein the determining whether the requested time is greater than the predetermined time for a predetermined number of consecutive times comprises:
and judging whether the request time is more than 5 seconds continuously for 5 times.
4. An ES-based efficient automatic synchronization configurable search system, comprising:
the first acquisition module is used for acquiring a request of a user for inquiring the media asset video data;
a first judging module, configured to judge whether an ES is configured for use based on the request;
a first query module, configured to query a database when it is determined that the ES is not configured for use based on the request;
the second judgment module is used for judging whether the request time is greater than the preset time continuously for a preset time;
the updating module is used for updating the query data to the ES in full and setting a redis distributed lock when the continuous preset times of the request time is greater than the preset time;
the releasing module is used for releasing the redis distributed lock when the updating is completed;
the setting module is used for setting the configured ES used by the media asset video data;
the monitoring module is used for monitoring the changes of the database video table and the association table to obtain a video id;
the synchronization module is used for acquiring the redis distributed lock, inquiring media asset video data by monitoring the video id and synchronizing the inquired media asset video data to the ES; wherein the ES is an Elasticissearch search and data analysis engine.
5. The system of claim 4, further comprising:
and the second query module is used for querying the ES based on the request when judging that the ES is configured to be used based on the request.
6. The system of claim 4, wherein the second determination module is specifically configured to:
and judging whether the request time is more than 5 seconds continuously for 5 times.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010854323.2A CN111954038B (en) | 2020-08-21 | 2020-08-21 | Configurable search method and system based on ES efficient automatic synchronization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010854323.2A CN111954038B (en) | 2020-08-21 | 2020-08-21 | Configurable search method and system based on ES efficient automatic synchronization |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111954038A CN111954038A (en) | 2020-11-17 |
| CN111954038B true CN111954038B (en) | 2021-12-21 |
Family
ID=73359692
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010854323.2A Active CN111954038B (en) | 2020-08-21 | 2020-08-21 | Configurable search method and system based on ES efficient automatic synchronization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111954038B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115098525B (en) * | 2022-07-25 | 2024-06-14 | 湖南快乐阳光互动娱乐传媒有限公司 | Index updating method and device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109241191A (en) * | 2018-09-13 | 2019-01-18 | 华东交通大学 | A kind of distributed data source isomery synchronous platform and synchronous method |
| CN110362564A (en) * | 2018-04-08 | 2019-10-22 | 车伯乐（北京）信息科技有限公司 | A kind of processing method of data source switching, apparatus and system |
| CN110928885A (en) * | 2018-09-04 | 2020-03-27 | 北京奇虎科技有限公司 | Method and device for updating data of Mysql database to Es database |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10255324B2 (en) * | 2017-02-03 | 2019-04-09 | International Business Machines Corporation | Query modification in a database management system |
-
2020
- 2020-08-21 CN CN202010854323.2A patent/CN111954038B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110362564A (en) * | 2018-04-08 | 2019-10-22 | 车伯乐（北京）信息科技有限公司 | A kind of processing method of data source switching, apparatus and system |
| CN110928885A (en) * | 2018-09-04 | 2020-03-27 | 北京奇虎科技有限公司 | Method and device for updating data of Mysql database to Es database |
| CN109241191A (en) * | 2018-09-13 | 2019-01-18 | 华东交通大学 | A kind of distributed data source isomery synchronous platform and synchronous method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111954038A (en) | 2020-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111954038B (en) | Configurable search method and system based on ES efficient automatic synchronization | |
| CN110362632B (en) | Data synchronization method, device, equipment and computer readable storage medium | |
| US12095587B2 (en) | Home appliance control method, server, home appliance, and storage medium | |
| CN106022108B (en) | A kind of synchronization management method and terminal device | |
| CN105589881B (en) | Data processing method and device | |
| CN105407515B (en) | A kind of method for switching network and device | |
| CN102654879B (en) | Search method and device | |
| CN111061681A (en) | Method and device for partitioning directory based on case insensitivity and storage medium | |
| CN113127774A (en) | Content pre-caching method and device for mobile application | |
| US20190004969A1 (en) | Caching System for Eventually Consistent Services | |
| CN115515206A (en) | Network searching method based on cloud service, terminal and cloud server | |
| CN107562762B (en) | Data index construction method and device | |
| CN112446568A (en) | Dispatching method, system and computer readable storage medium | |
| CN115250441A (en) | Method, device, equipment and medium for determining voice fallback time delay information | |
| CN104765813A (en) | Video retrieval method, system and device | |
| CN115002507A (en) | Video data updating method, device, equipment and readable storage medium | |
| CN106021473B (en) | Folder size display method and system of mobile terminal and mobile terminal | |
| CN1972479A (en) | Setting method of alarm of mobile phone | |
| CN104853232B (en) | Television channel updating method and device | |
| CN111143311B (en) | Inter-application association determination and log association search methods, devices, media and equipment | |
| CN110688402B (en) | Method, device and equipment for querying directory and computer readable storage medium | |
| CN114328526A (en) | Data processing method and device, electronic equipment and computer readable storage medium | |
| CN114020843A (en) | Spark framework-based data table synchronization method, device and storage medium | |
| CN112416946A (en) | Method, apparatus, device and medium for managing playing content | |
| CN107623577B (en) | Service call flow control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |