CN111954038B - Configurable search method and system based on ES efficient automatic synchronization - Google Patents

Configurable search method and system based on ES efficient automatic synchronization Download PDF

Info

Publication number
CN111954038B
CN111954038B CN202010854323.2A CN202010854323A CN111954038B CN 111954038 B CN111954038 B CN 111954038B CN 202010854323 A CN202010854323 A CN 202010854323A CN 111954038 B CN111954038 B CN 111954038B
Authority
CN
China
Prior art keywords
request
video data
media asset
module
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010854323.2A
Other languages
Chinese (zh)
Other versions
CN111954038A (en
Inventor
汪纬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan Happly Sunshine Interactive Entertainment Media Co Ltd
Original Assignee
Hunan Happly Sunshine Interactive Entertainment Media Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan Happly Sunshine Interactive Entertainment Media Co Ltd filed Critical Hunan Happly Sunshine Interactive Entertainment Media Co Ltd
Priority to CN202010854323.2A priority Critical patent/CN111954038B/en
Publication of CN111954038A publication Critical patent/CN111954038A/en
Application granted granted Critical
Publication of CN111954038B publication Critical patent/CN111954038B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a configurable search method and a configurable search system based on ES efficient automatic synchronization, wherein the method comprises the following steps: acquiring a request of a user for inquiring media resource video data; based on the request, judging whether the ES is configured, if not, then: querying a database; judging whether the request time is continuously preset for more than preset time, if so, then: updating query data to ES in full, and setting a redis distributed lock; releasing the redis distributed lock upon completion of the update; setting the configured ES for the media asset video data; monitoring the changes of a database video table and an association table to obtain a video id; and acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data into the ES. The invention can improve the user experience and the production efficiency.

Description

Configurable search method and system based on ES efficient automatic synchronization
Technical Field
The invention relates to the technical field of data processing, in particular to a configurable search method and a configurable search system based on ES (distributed, high-expansion and high-real-time search and data analysis engine) with high efficiency and automatic synchronization.
Background
With the increasing of the system data volume, the direct query of the required data in the database is slower and slower, and at this time, a search engine needs to be introduced, and at present, data is synchronized into an ES (electronic storage system) in a manual mode, a large number of codes need to be modified, and automatic synchronization and configurability cannot be achieved.
Therefore, how to achieve seamless switching, the front end has no perception, the background automatically switches to the search engine according to needs, the existing codes do not need to be modified in a large amount, the user can be helped to retrieve the data expected to be inquired quickly, the waiting time of the user is reduced, the user experience is improved, and the production efficiency is improved.
Disclosure of Invention
In view of the above, the invention provides an ES-based efficient, automatic, synchronous and configurable search method, which can realize seamless switching, no perception at the front end, automatic switching to a search engine as required at the background, and no modification of a large number of existing codes, and can quickly help a user to retrieve data desired to be queried, reduce user waiting time, improve user experience, and improve production efficiency.
The invention provides an ES-based efficient automatic synchronization configurable search method, which comprises the following steps:
acquiring a request of a user for inquiring media resource video data;
based on the request, judging whether the ES is configured to be used, if not, then:
querying a database;
judging whether the request time is continuously preset for more than preset time, if so, then:
updating query data to ES in full, and setting a redis distributed lock;
releasing the redis distributed lock upon completion of the update;
setting the configured ES for the media asset video data;
monitoring the changes of a database video table and an association table to obtain a video id;
and acquiring the redis distributed lock, inquiring media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES.
Preferably, the method further comprises:
when it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
Preferably, the determining whether the request time is greater than the preset time continuously for a preset number of times includes:
and judging whether the request time is more than 5 seconds continuously for 5 times.
An ES-based efficient automatic synchronization configurable search system comprising:
the first acquisition module is used for acquiring a request of a user for inquiring the media asset video data;
a first judging module, configured to judge whether an ES is configured for use based on the request;
a first query module, configured to query a database when it is determined that the ES is not configured for use based on the request;
the second judgment module is used for judging whether the request time is greater than the preset time continuously for a preset time;
the updating module is used for updating the query data to the ES in full and setting a redis distributed lock when the continuous preset times of the request time is greater than the preset time;
the releasing module is used for releasing the redis distributed lock when the updating is completed;
the setting module is used for setting the configured ES used by the media asset video data;
the monitoring module is used for monitoring the changes of the database video table and the association table to obtain a video id;
and the synchronization module is used for acquiring the redis distributed lock, inquiring the media asset video data by monitoring the video id and synchronizing the inquired media asset video data to the ES.
Preferably, the system further comprises:
and the second query module is used for querying the ES based on the request when judging that the ES is configured and used based on the request.
Preferably, the second determination module is specifically configured to:
and judging whether the request time is more than 5 seconds continuously for 5 times.
In summary, the invention discloses a configurable search method based on ES efficient automatic synchronization, which includes the steps of firstly obtaining a request of a user for inquiring media asset video data, then judging whether an ES is configured for use or not based on the request, if not, inquiring a database, then judging whether the request time is continuously preset for times greater than the preset time, if so,: updating query data to ES in full, and setting a redis distributed lock; releasing a redis distributed lock when the update is complete; setting a configured and used ES of media asset video data, and monitoring the changes of a database video table and an association table to obtain a video id; and acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data into the ES. The method and the device can realize seamless switching, the front end is not aware, the background is automatically switched to the search engine according to the needs, the existing codes are not required to be modified in a large amount, the user can be rapidly helped to retrieve the data expected to be inquired, the waiting time of the user is reduced, the user experience is improved, and the production efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of an embodiment 1 of an ES-based efficient automatic synchronization configurable search method disclosed in the present invention;
FIG. 2 is a flowchart of an embodiment 2 of the configurable search method based on ES efficient automatic synchronization disclosed in the present invention;
FIG. 3 is a flowchart of an embodiment 3 of the configurable search method based on ES efficient automatic synchronization disclosed in the present invention;
FIG. 4 is a schematic structural diagram of an embodiment 1 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention;
FIG. 5 is a schematic structural diagram of an embodiment 2 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention;
FIG. 6 is a schematic structural diagram of embodiment 3 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, which is a flowchart of embodiment 1 of the configurable search method based on ES efficient automatic synchronization disclosed in the present invention, the method may include the following steps:
s101, acquiring a request of a user for inquiring media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
S102, based on the request, judging whether the use ES is configured, if not, the S103 is carried out:
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
S103, querying a database;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
S104, judging whether the request time is continuously preset for times more than the preset time, if so, entering S105:
then, whether the request time is continuously preset for more than preset time is judged.
S105, updating query data to ES in a full amount, and setting a redis distributed lock;
and when the continuous preset times of the request time is greater than the preset time, updating the table database in full, updating the query data to the ES in full, and setting a redis distributed lock.
S106, when the updating is completed, releasing the redis distributed lock;
when the update is complete, the redis distributed lock is released.
S107, setting a configured and used ES of the media asset video data;
then, the asset video data is set to the configuration use ES.
S108, monitoring changes of a database video table and an association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
S109, acquiring a redis distributed lock, inquiring media asset video data through monitoring a video id, and synchronizing the inquired media asset video data to an ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
To sum up, in the above embodiment, first, a request for a user to query media asset video data is obtained, then, based on the request, whether an ES is configured for use is determined, if not, the database is queried, then, whether the request time is continuously preset for a number of times greater than a preset time is determined, if yes, the method: updating query data to ES in full, and setting a redis distributed lock; releasing a redis distributed lock when the update is complete; setting a configured and used ES of media asset video data, and monitoring the changes of a database video table and an association table to obtain a video id; and acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data into the ES. The seamless switching can be achieved, the front end has no perception, the background is automatically switched to the search engine according to needs, existing codes do not need to be modified in a large amount, a user can be helped to retrieve data expected to be inquired quickly, the waiting time of the user is shortened, the user experience is improved, and the production efficiency is improved.
As shown in fig. 2, which is a flowchart of embodiment 2 of the configurable search method based on ES efficient automatic synchronization disclosed in the present invention, the method may include the following steps:
s201, acquiring a request of a user for inquiring media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
S202, based on the request, judging whether the use ES is configured, if not, the process goes to S203, and if so, the process goes to S210:
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
S203, querying a database;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
S204, judging whether the request time is continuously preset for times more than the preset time, if so, entering S205:
then, whether the request time is continuously preset for more than preset time is judged.
S205, updating query data to ES in a full amount, and setting a redis distributed lock;
and when the continuous preset times of the request time is greater than the preset time, updating the table database in full, updating the query data to the ES in full, and setting a redis distributed lock.
S206, when the updating is completed, releasing the redis distributed lock;
when the update is complete, the redis distributed lock is released.
S207, setting a configured and used ES of the media asset video data;
then, the asset video data is set to the configuration use ES.
S208, monitoring changes of the database video table and the association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
S209, acquiring a redis distributed lock, inquiring the media asset video data through monitoring the video id, and synchronizing the inquired media asset video data to the ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
S210, inquiring the ES based on the request.
When it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
As shown in fig. 3, which is a flowchart of embodiment 3 of the configurable search method based on ES efficient automatic synchronization disclosed in the present invention, the method may include the following steps:
s301, acquiring a request of a user for inquiring media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
S302, based on the request, judging whether the use ES is configured, if not, entering S303, and if so, entering S310:
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
S303, querying a database;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
S304, judging whether the request time is continuously 5 times and is more than 5 seconds, if so, entering S305:
then, whether the request time is continuously preset for more than preset time is judged. Specifically, it may be determined whether the request time is greater than 5 seconds in 5 consecutive times.
S305, updating query data to ES in a full amount, and setting a redis distributed lock;
and when the request time is continuously 5 times and is more than 5 seconds, the table database is updated in a full amount, the query data is updated to the ES in a full amount, and the redis distributed lock is set.
S306, releasing the redis distributed lock when the updating is finished;
when the update is complete, the redis distributed lock is released.
S307, setting a configured ES for the media asset video data;
then, the asset video data is set to the configuration use ES.
S308, monitoring the changes of the database video table and the association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
S309, acquiring a redis distributed lock, inquiring media asset video data through monitoring a video id, and synchronizing the inquired media asset video data to the ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
S310, inquiring the ES based on the request.
When it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
As shown in fig. 4, which is a schematic structural diagram of embodiment 1 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention, the system may include:
a first obtaining module 401, configured to obtain a request for a user to query media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
A first determining module 402, configured to determine whether an ES is configured for use based on the request;
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
A first query module 403, configured to query a database when it is determined that the ES is not configured for use based on the request;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
A second judging module 404, configured to judge whether the request time is greater than a preset time continuously for a preset number of times;
then, whether the request time is continuously preset for more than preset time is judged.
An updating module 405, configured to update query data to the ES in full and set a redis distributed lock when the request time is greater than the preset time for the preset number of consecutive times;
and when the continuous preset times of the request time is greater than the preset time, updating the table database in full, updating the query data to the ES in full, and setting a redis distributed lock.
A releasing module 406, configured to release the redis distributed lock when the update is completed;
when the update is complete, the redis distributed lock is released.
A setting module 407, configured to set the configured ES for the media asset video data;
then, the asset video data is set to the configuration use ES.
The monitoring module 408 is configured to monitor changes of the database video table and the association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
And the synchronization module 409 is configured to acquire a redis distributed lock, query the media asset video data by monitoring the video id, and synchronize the queried media asset video data to the ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
To sum up, in the above embodiment, first, a request for a user to query media asset video data is obtained, then, based on the request, whether an ES is configured for use is determined, if not, the database is queried, then, whether the request time is continuously preset for a number of times greater than a preset time is determined, if yes, the method: updating query data to ES in full, and setting a redis distributed lock; releasing a redis distributed lock when the update is complete; setting a configured and used ES of media asset video data, and monitoring the changes of a database video table and an association table to obtain a video id; and acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data into the ES. The seamless switching can be achieved, the front end has no perception, the background is automatically switched to the search engine according to needs, existing codes do not need to be modified in a large amount, a user can be helped to retrieve data expected to be inquired quickly, the waiting time of the user is shortened, the user experience is improved, and the production efficiency is improved.
As shown in fig. 5, which is a schematic structural diagram of embodiment 2 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention, the system may include:
a first obtaining module 501, configured to obtain a request for a user to query media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
A first determining module 502, configured to determine whether an ES is configured for use based on the request;
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
A first query module 503, configured to query the database when it is determined that the ES is not configured for use based on the request;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
A second judging module 504, configured to judge whether the request time is greater than a preset time continuously;
then, whether the request time is continuously preset for more than preset time is judged.
An updating module 505, configured to update query data to the ES in full and set a redis distributed lock when the request time is greater than the preset time for the preset number of consecutive times;
and when the continuous preset times of the request time is greater than the preset time, updating the table database in full, updating the query data to the ES in full, and setting a redis distributed lock.
A releasing module 506, configured to release the redis distributed lock when the update is completed;
when the update is complete, the redis distributed lock is released.
A setting module 507, configured to set an ES configured for use by the media asset video data;
then, the asset video data is set to the configuration use ES.
A monitoring module 508, configured to monitor changes in the database video table and the association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
And a synchronization module 509, configured to acquire a redis distributed lock, query the media asset video data by monitoring the video id, and synchronize the queried media asset video data to the ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
A second query module 510, configured to query the ES based on the request when it is determined that the ES is configured for use based on the request.
When it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
As shown in fig. 6, which is a schematic structural diagram of embodiment 3 of the configurable search system based on ES efficient automatic synchronization disclosed in the present invention, the system may include:
a first obtaining module 601, configured to obtain a request for a user to query media asset video data;
when a user needs to inquire the media asset video data, firstly, a request of the user for inquiring the media asset video data is obtained.
A first determining module 602, configured to determine whether an ES is configured to be used based on the request;
and after a request for inquiring the media asset video data by the user is acquired, further judging whether the ES is configured to be used according to the acquired request.
A first query module 603 configured to query the database when it is determined that the ES is not configured for use based on the request;
when it is determined that the ES is not configured for use based on the request, the database is queried. Wherein, the database can be a Mysql database.
A second judging module 604, configured to judge whether the request time is greater than 5 seconds continuously for 5 times;
then, whether the request time is continuously preset for more than preset time is judged. Specifically, it may be determined whether the request time is greater than 5 seconds in 5 consecutive times.
An updating module 605, configured to update query data to the ES in full and set a redis distributed lock when the request time is greater than the preset time for the preset number of consecutive times;
and when the continuous preset times of the request time is greater than the preset time, updating the table database in full, updating the query data to the ES in full, and setting a redis distributed lock.
A releasing module 606, configured to release the redis distributed lock when the update is completed;
when the update is complete, the redis distributed lock is released.
A setting module 607, configured to set the ES used by the media asset video data;
then, the asset video data is set to the configuration use ES.
The monitoring module 608 is configured to monitor changes of the database video table and the association table to obtain a video id;
then, monitoring the changes of the database video table and the association table, such as addition, deletion and change; and obtaining the video id.
And the synchronization module 609 is configured to acquire a redis distributed lock, query the media asset video data by monitoring the video id, and synchronize the queried media asset video data to the ES.
And then, acquiring a redis distributed lock, inquiring the media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to the ES. When the user inquires the data again, the data authority logic is automatically processed, and the ES inquiry statement is generated by assembling the inquiry condition and processing the sequence for inquiry.
A second query module 610, configured to query the ES based on the request when it is determined that the ES has been configured for use based on the request.
When it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (6)

1. An ES-based efficient automatic synchronization configurable search method is characterized by comprising the following steps:
acquiring a request of a user for inquiring media resource video data;
based on the request, judging whether the ES is configured to be used, if not, then:
querying a database;
judging whether the request time is continuously preset for more than preset time, if so, then:
updating query data to ES in full, and setting a redis distributed lock;
releasing the redis distributed lock upon completion of the update;
setting the configured ES for the media asset video data;
monitoring the changes of a database video table and an association table to obtain a video id;
acquiring the redis distributed lock, inquiring media asset video data by monitoring the video id, and synchronizing the inquired media asset video data to an ES (extended service provider); wherein the ES is an Elasticissearch search and data analysis engine.
2. The method of claim 1, further comprising:
when it is determined that the ES has been configured for use based on the request, the ES is queried based on the request.
3. The method of claim 1, wherein the determining whether the requested time is greater than the predetermined time for a predetermined number of consecutive times comprises:
and judging whether the request time is more than 5 seconds continuously for 5 times.
4. An ES-based efficient automatic synchronization configurable search system, comprising:
the first acquisition module is used for acquiring a request of a user for inquiring the media asset video data;
a first judging module, configured to judge whether an ES is configured for use based on the request;
a first query module, configured to query a database when it is determined that the ES is not configured for use based on the request;
the second judgment module is used for judging whether the request time is greater than the preset time continuously for a preset time;
the updating module is used for updating the query data to the ES in full and setting a redis distributed lock when the continuous preset times of the request time is greater than the preset time;
the releasing module is used for releasing the redis distributed lock when the updating is completed;
the setting module is used for setting the configured ES used by the media asset video data;
the monitoring module is used for monitoring the changes of the database video table and the association table to obtain a video id;
the synchronization module is used for acquiring the redis distributed lock, inquiring media asset video data by monitoring the video id and synchronizing the inquired media asset video data to the ES; wherein the ES is an Elasticissearch search and data analysis engine.
5. The system of claim 4, further comprising:
and the second query module is used for querying the ES based on the request when judging that the ES is configured to be used based on the request.
6. The system of claim 4, wherein the second determination module is specifically configured to:
and judging whether the request time is more than 5 seconds continuously for 5 times.
CN202010854323.2A 2020-08-21 2020-08-21 Configurable search method and system based on ES efficient automatic synchronization Active CN111954038B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010854323.2A CN111954038B (en) 2020-08-21 2020-08-21 Configurable search method and system based on ES efficient automatic synchronization

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010854323.2A CN111954038B (en) 2020-08-21 2020-08-21 Configurable search method and system based on ES efficient automatic synchronization

Publications (2)

Publication Number Publication Date
CN111954038A CN111954038A (en) 2020-11-17
CN111954038B true CN111954038B (en) 2021-12-21

Family

ID=73359692

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010854323.2A Active CN111954038B (en) 2020-08-21 2020-08-21 Configurable search method and system based on ES efficient automatic synchronization

Country Status (1)

Country Link
CN (1) CN111954038B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115098525B (en) * 2022-07-25 2024-06-14 湖南快乐阳光互动娱乐传媒有限公司 Index updating method and device, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109241191A (en) * 2018-09-13 2019-01-18 华东交通大学 A kind of distributed data source isomery synchronous platform and synchronous method
CN110362564A (en) * 2018-04-08 2019-10-22 车伯乐(北京)信息科技有限公司 A kind of processing method of data source switching, apparatus and system
CN110928885A (en) * 2018-09-04 2020-03-27 北京奇虎科技有限公司 Method and device for updating data of Mysql database to Es database

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10255324B2 (en) * 2017-02-03 2019-04-09 International Business Machines Corporation Query modification in a database management system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110362564A (en) * 2018-04-08 2019-10-22 车伯乐(北京)信息科技有限公司 A kind of processing method of data source switching, apparatus and system
CN110928885A (en) * 2018-09-04 2020-03-27 北京奇虎科技有限公司 Method and device for updating data of Mysql database to Es database
CN109241191A (en) * 2018-09-13 2019-01-18 华东交通大学 A kind of distributed data source isomery synchronous platform and synchronous method

Also Published As

Publication number Publication date
CN111954038A (en) 2020-11-17

Similar Documents

Publication Publication Date Title
CN111954038B (en) Configurable search method and system based on ES efficient automatic synchronization
CN103077718B (en) Method of speech processing, system and terminal
CN101743746B (en) Method for displaying internet television information of broadcasting receiver and broadcasting receiver enabling the method
US20220103390A1 (en) Home appliance control method, server, home appliance, and storage medium
CN105589881B (en) Data processing method and device
CN105407515B (en) A kind of method for switching network and device
CN111324660A (en) Data synchronization method and device, electronic equipment and machine-readable storage medium
CN111221469A (en) Method, device and system for synchronizing cache data
CN102654879B (en) Search method and device
CN111061681A (en) Method and device for partitioning directory based on case insensitivity and storage medium
CN113127774A (en) Content pre-caching method and device for mobile application
CN105530323A (en) File upgrading method, related equipment and system
CN116756190A (en) Data cache management method, device, terminal equipment and storage medium
CN106682197B (en) Search cache updating method and device
CN106021473B (en) Folder size display method and system of mobile terminal and mobile terminal
CN1972479A (en) Setting method of alarm of mobile phone
CN104853232B (en) A kind of television channel update method and device
CN110798222B (en) Data compression method and device
CN111143311B (en) Inter-application association determination and log association search methods, devices, media and equipment
CN109032626B (en) Method and system for automatically deploying network equipment monitoring software
CN111061554B (en) Intelligent task scheduling method and device, computer equipment and storage medium
CN110688402B (en) Method, device and equipment for querying directory and computer readable storage medium
CN114328526A (en) Data processing method and device, electronic equipment and computer readable storage medium
CN109408538B (en) Method and system for automatically issuing cloud components in cloud platform to realize large-scale fusion query
CN115250441A (en) Method, device, equipment and medium for determining voice fallback time delay information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant