WO2018032254A1

WO2018032254A1 - Method and system for fetching trusted video in big data

Info

Publication number: WO2018032254A1
Application number: PCT/CN2016/095304
Authority: WO
Inventors: 马岩
Original assignee: 马岩
Priority date: 2016-08-15
Filing date: 2016-08-15
Publication date: 2018-02-22

Abstract

A method for fetching a trusted video in big data. The method comprises the following steps: acquiring a keyword for searching (101); extracting a collection of videos having a security level higher than a preset level, launching, according to the keyword, a Baidu search and a Google search on the collection of videos to perform searches according to the keyword (102); and displaying the two search results respectively on left and right pages (103). The technical solution has the advantage of search effectiveness.

Description

Crawling method and system for trusted video in big data

Technical field

The present invention relates to the field of big data, and in particular, to a method and system for capturing trusted video in big data.

Background technique

Big data (big Data) refers to a collection of data that cannot be captured, managed, and processed by conventional software tools within a certain time frame. It requires a new processing model to have stronger decision-making power, insight and process optimization capabilities to adapt to massive and high growth. Rate and diversified information assets, existing big data is diverse, such as video data, how to search for the desired data from the video data is a problem worth studying, the existing technical solutions can not achieve effective video data search for.

technical problem

The application provides a method for crawling trusted video in big data. It solves the shortcomings of the prior art technical solution that the effective search of video data cannot be realized.

Technical solution

In one aspect, a method for crawling trusted video in big data is provided, the method comprising the following steps:

Get the keywords to be searched and extract the video range whose security level is above the set level;

According to the keyword, Baidu search and Google search are opened in the video range to search according to the keyword;

Display the two search results left and right.

Optionally, the method further includes:

If the search results are the same in both search results, the same search results are displayed on either page.

Optionally, the method further includes:

Block the promoted video.

In a second aspect, a crawling system for trusted video in big data is provided, the system comprising:

An obtaining unit, configured to acquire a keyword to be searched, and extract a video range whose security level is above a set level;

a search unit for opening a Baidu search and a Google search in the video range according to the keyword, respectively searching according to the keyword;

A paging unit that displays two search results left and right.

Optionally, the system further includes:

An allocation unit for having the same search result as in two search results, displaying the same search result on any one of the pages.

Optionally, the system further includes:

A shielding unit that shields the promoted video.

Beneficial effect

The technical solution provided by the invention obtains a keyword to be searched, and according to the keyword, the Baidu search and the Google search are respectively searched according to the keyword, and the two search results are displayed on the left and right pages, so that it has the advantage of effective search.

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.

1 is a flowchart of a method for capturing trusted video in big data according to a first preferred embodiment of the present invention;

FIG. 2 is a structural diagram of a crawling system for trusted video in big data according to a second preferred embodiment of the present invention.

Embodiments of the invention

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Please refer to FIG. 1. FIG. 1 is a schematic diagram of a method for capturing trusted video in big data according to a first preferred embodiment of the present invention. The method is as shown in FIG.

Step S101: Acquire a keyword to be searched, and extract a video range whose security level is above a set level;

Step S102: Open a Baidu search and a Google search in the video range according to the keyword, and perform a search according to the keyword respectively;

In step S103, the two search results are displayed on the left and right pages.

Optionally, after the step S103, the foregoing method may further include:

Block the promoted video.

Please refer to FIG. 2. FIG. 2 is a schematic diagram of a crawling system for trusted video in big data according to a second preferred embodiment of the present invention. The system includes:

The obtaining unit 201 is configured to acquire a keyword to be searched, and extract a video range whose security level is above a set level;

The searching unit 202 is configured to perform Baidu search and Google search in the video range according to the keyword, and perform search according to the keyword respectively;

The paging unit 203 is configured to display two search results to the left and right pages.

Optionally, the above system may further include:

The allocating unit 204 is configured to display the same search result on any one of the pages if the two search results have the same search result.

Optionally, the above system may further include:

The shielding unit 205 is configured to shield the promoted video.

It should be noted that, for the foregoing various method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present invention. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

In the above embodiments, the descriptions of the various embodiments are different, and the parts that are not described in detail in a certain embodiment can be referred to the related descriptions of other embodiments.

A person skilled in the art may understand that all or part of the various steps of the foregoing embodiments may be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium, and the storage medium may include: Flash drive, read-only memory (English: Read-Only Memory, referred to as: ROM), random accessor (English: Random Access Memory, referred to as: RAM), disk or CD.

The content downloading method and the related device and system provided by the embodiments of the present invention are described in detail above. The principles and implementation manners of the present invention are described in the specific examples. The description of the above embodiments is only used to help understand the present invention. The method of the invention and its core idea; at the same time, for the person of ordinary skill in the art, according to the idea of the present invention, there are some changes in the specific embodiment and the scope of application. In summary, the content of the specification should not be understood. To limit the invention.

Claims

A method for crawling trusted video in big data, characterized in that the method comprises the following steps:

Get the keywords to be searched and extract the video range whose security level is above the set level;

According to the keyword, Baidu search and Google search are opened in the video range according to the keyword search;

Display the two search results left and right.
The method of claim 1 further comprising:

If the search results are the same in both search results, the same search results are displayed on either page.
The method of claim 1 further comprising:

Block the promoted video.
A crawling system for trusted video in big data, characterized in that the system comprises:

An obtaining unit, configured to acquire a keyword to be searched, and extract a video range whose security level is above a set level;

a search unit for opening a Baidu search and a Google search in the video range according to the keyword, respectively searching according to the keyword;

A paging unit that displays two search results left and right.
The system of claim 4, wherein the system further comprises:

An allocation unit for having the same search result as in two search results, displaying the same search result on any one of the pages.
The system of claim 4, wherein the system further comprises:

A shielding unit that shields the promoted video.