WO2012128419A1

WO2012128419A1 - Search system and search method for providing integrated multimedia contents

Info

Publication number: WO2012128419A1
Application number: PCT/KR2011/003315
Authority: WO
Inventors: 지윤성; 문선홍; 이홍근
Original assignee: 주식회사 코난테크놀로지
Priority date: 2011-03-21
Filing date: 2011-05-03
Publication date: 2012-09-27
Also published as: KR20120107273A; KR101245665B1

Abstract

The present invention relates to a search system and a search method for providing a search result of multimedia content, where text, sound, and images are integrated, by generating the multimedia content from searched contents. The search system according to the present invention includes: a search server for receiving a search word of a user and performing a multimedia search, performing at least one of text conversion processing, sound conversion processing, and image search processing corresponding to each searched result, generating multimedia content of each result in synchronization with the processed results of sound, text, and image, and displaying the generated multimedia content on a divided area of a screen in order to provide the multimedia content to a user as a search result; and a user terminal for requesting a search by inputting a search word while accessing a search server and receiving a search result having a User Interface (UI) where multimedia contents are divided and disposed. According to the present invention, a user may obtain search information through multimedia content easily and quickly.

Description

Retrieval system and method for providing integrated multimedia contents

The present invention relates to a search system and a search method, and more particularly, to a search system and a search method for providing a search result of integrated multimedia data contents by generating and synchronizing multimedia data from a search result of a user's search word.

This application claims priority based on Korean Patent Application No. 10-2011-0024862, filed March 21, 2011, and all the contents disclosed in the specification and drawings of the application are incorporated in this application.

To date, Internet search results list simple text information in the form of a list. This is because most of the retrieved information exists as text-based documents of the past. Text information takes longer for users to interpret than multimedia information and is less intuitive to understand.

In the hardware specification of the Internet terminals, the processing capability of multimedia content is further enhanced. This is because the information usage pattern of the user interprets the information more quickly through the multimedia data and delivers the information as the multimedia data faster. In addition, the user wants to quickly understand the information through the multimedia information rather than text information, and to process such as transmission and reception.

For example, in the case of a smart phone, which is a kind of Internet terminal, processing capability of multimedia data is required in almost all functions such as video call, touch input, generation, storage and reception of multimedia data. Here, the smart phone is made compact for portability and mobility, but takes time when a user inputs or reads text data. Therefore, users of smart phones prefer multimedia data that can easily understand information and reduce data processing time.

As another example, in the case of an IP TV (or smart TV), since the Internet can be connected, various multimedia data processing capabilities such as online shopping and information retrieval are required. Here, the IP TV has transmitted the TV broadcast to the user as visual and audio information. As such, the user is accustomed to viewing multimedia information, but it is very inconvenient and time-consuming to read and input text information in the process of using the Internet of the newly added IP TV. In addition, simple remote control operation of a general TV may be complicated to use for text input on an IP TV. Therefore, users of IP TVs prefer multimedia data rather than text information when using the Internet.

The Internet search results in which text-based documents are listed in a list form are not suitable for Internet terminals such as smart phones or IP TVs with a limited UI. Accordingly, there is a need for converting or generating content results of various formats obtained through Internet inquiry or search into multimedia contents and providing them.

SUMMARY OF THE INVENTION The present invention has been created under the above-described prior art, and an object of the present invention is to provide a search system and a search method for analyzing a content searched on the Internet, generating new multimedia content integrating text, voice, and image and providing the same to a user. do.

Another object of the present invention is to provide a search system and a search method for providing a search result screen in which a product of multimedia content is arranged in a user interface (UI) space dynamically divided in a limited search result screen.

In order to achieve the above technical problem, a search system for providing integrated multimedia contents according to an embodiment of the present invention may receive a user's search word on a wired or wireless Internet, perform a multimedia search with the search word, and convert corresponding text to the searched individual result. At least one of processing, voice conversion processing, and image retrieval processing, synchronizing the outputs of the processed voice, text, and image to generate multimedia contents of individual results, and placing the generated multimedia contents in a divided area of the screen. A search server that provides the user with search results; And a user terminal connected to the search server to input a search word in a text, voice, or image format to request a search, and receiving and displaying a search result having a UI (User Interface) in which multimedia contents are divided and displayed on a screen. .

According to the present invention, the search server comprises: an interface module for receiving a user profile and a search word requested to be searched from a user terminal and providing a search result of multimedia content; A middleware module for classifying a text, voice, or image format with respect to a search word; A search module for performing a multimedia search for each text, voice, and image by a format separated search word; A conversion processing module which performs text conversion processing, voice conversion processing, and image retrieval processing to secure contents of another format type corresponding to the format of the retrieved individual result; And generating a single integrated multimedia content by synchronizing the output of the text, voice, and image contents obtained through the conversion process with the individual searched results, and arranging the generated multimedia contents based on the user profile information to generate a search result. And a synchronization batch module.

The search module may include: a format analysis module configured to analyze metadata about a format-specific search word received from a middleware module, and to extract the morphological analysis and syntax analysis of the text search word and the image feature of the search word; And a semantic search module that analyzes and retrieves data received from the format analysis module with a semantic search engine.

According to an aspect of the present invention, the synchronization arrangement module extracts user terminal information and screen display information from user profile information, and configures a screen UI according to the extracted information and the number of multimedia contents to be arranged.

In addition, the search server generates voice information on the searched text result by text to speech (tts) and secures the image information by image search to synchronize the text result, the voice information, and the image information. A process of generating multimedia content; A process of generating text information with respect to the searched speech result, by generating a text to speech (stt: speech to text), and securing image information through an image search process to generate multimedia contents synchronized with the speech result, text information and image information; And a process of generating text information on the retrieved image result by text search processing, and optionally generating voice information by voice conversion processing to generate multimedia content synchronized with the image result, text information and voice information.

Furthermore, the search server provides a search result of a screen UI in which a frame or layout is dynamically configured in consideration of the image size of the multimedia content.

Here, the search result is displayed on the user terminal, the other content is deactivated when playing a specific multimedia content, when the mouse is located in the deactivated content is activated and played when clicked.

Alternatively, the search server may include: a markup language module configured to change an audio volume of a content, a rank adjustment of a content, and a screen UI configuration by using an extended markup language (XML) tag according to a command of an administrator; And a result module for performing a cache function of the completed search result and mediating user provisioning.

According to a search method for providing integrated multimedia contents of the present invention, a search server receives a search word from a user terminal as a search word on a wired or wireless Internet, performs a search, and provides a search result. Classifying the format of the requested search term; (b) performing a multimedia search of text, voice, and image for each format of the search word; (c) performing at least one of a text conversion process, a voice conversion process, and an image search process on the individual results in order to secure contents of another format type corresponding to the format of the retrieved individual results; (d) synchronizing the output of the text, voice, and image contents obtained through the conversion process with the individual results retrieved to produce a single integrated multimedia content; (d) dividing at least one multimedia content on an area of a screen user interface (UI) to generate a search result; And (e) providing a search result in response to the search request of the user terminal.

According to an aspect of the present invention, a user is provided with a result of dynamically arranging multimedia content as a search result to quickly and easily acquire information by playing multimedia content.

According to another aspect of the present invention, the convenience of the user is increased by generating a search result screen excluding text display as much as possible in smart phones and IP TVs where multimedia data is frequently used.

The following drawings attached to this specification are illustrative of preferred embodiments of the present invention, and together with the detailed description of the invention to serve to further understand the technical spirit of the present invention, the present invention is a matter described in such drawings It should not be construed as limited to.

1 is a schematic structural diagram of a search system according to an embodiment of the present invention.

2 is a schematic internal structural diagram of a search server according to an embodiment of the present invention.

3 is an exemplary view of a search server composed of a plurality of servers in an embodiment of the present invention.

4 is a screen diagram of a conventional Internet search result.

5 is a screen diagram of an Internet search result according to an embodiment of the present invention.

6 is a schematic flowchart of a search method according to an embodiment of the present invention.

7 is a flowchart of a process of generating text, voice, and image content from retrieved source content according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the specification and claims should not be construed as having a conventional or dictionary meaning, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention.

Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiments of the present invention and do not represent all of the technical spirit of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

<1. 시스템 구성><1. System Configuration>

1 is a schematic structural diagram of a search system 1 according to an embodiment of the present invention.

The search system 1 according to an embodiment of the present invention includes a search server 2 that receives a search word through wired and wireless networks, generates searched individual contents as integrated multimedia contents, and provides the search results to a user as a search result. It includes a user terminal (3) for receiving a search result of the multimedia content after transmitting a search request to the search server (2).

The wired / wireless network in the present invention typically includes all communication networks capable of internet data communication using various protocols such as mobile communication networks, wired and wireless public networks or dedicated networks such as the Internet.

The search server 2 has a home page and provides a search service to the user terminal 3 accessing the home page. For example, the search server 2 provides a search page including a search box to the user terminal 3 and receives a search word from the user terminal 3 through the search page. Thereafter, the search server 2 performs a search using the search word, and provides the search result page including the search result to the user terminal 3.

Here, the search server 2 analyzes each searched content (hereinafter referred to as "raw content") to produce a single integrated multimedia content in which text, voice, and images (eg, a video and a still image) are combined. Provided to the user terminal (3). That is, the search server 2 does not arrange individual raw contents in the form of a list on the search result page as it is, but visualizes and auditifies the multimedia contents generated from the individual raw contents and dynamically places them on the search result page.

For example, assuming that the raw content is a document, the search server 2 converts the text content of the document content into voice information, and collects an image inserted into the document content or an image retrieved from the document. . The search server 2 synchronizes the output of text information, voice information, and image information to produce one integrated multimedia content. Of course, even when the original content is voice or image, corresponding text information, voice information, and image information are produced or collected. In some cases, in the case of some moving images, if it is determined that the multimedia contents are already completed, the generation of the multimedia contents may be omitted.

When the multimedia content corresponding to each content is produced, the search server 2 generates a search result (eg, a search result page and search result screen information) having a UI in which the multimedia content is dynamically arranged. Provided by (3).

The user terminal 3 corresponds to a computer terminal capable of accessing the Internet through a wired or wireless network, a mobile communication terminal (including a smart phone), a personal portable terminal, an IP TV (including a smart TV), and the like.

Here, the user terminal 3 accesses the search server 2 to input a search word and requests a search. The user terminal 3 receives the search result from the search server 2 and displays the search result on the screen. When the search result is displayed on the screen, the user selects individual multimedia contents represented by an image or an icon to check the multimedia contents to be played back.

For example, each image corresponding to the retrieved raw contents is displayed on the screen of the user terminal 3, and when a user makes a reproduction request (for example, clicking) on an image of the content in which the raw contents were a document, a voice file Is reproduced, and the text information of the document synchronized with the voice is rolled up in the reproduction process. Accordingly, the user obtains multimedia information in which images, voices, and texts are combined by playing multimedia contents. Here, it is apparent to those skilled in the art that the information of the image and the voice in the reproduction process of the multimedia content is more transferable than the text information and is preferred by the user.

2 shows a schematic internal structure of a search server 2 according to an embodiment of the present invention.

The search server 2 according to an embodiment of the present invention includes an interface module 21 for receiving a user's search word and responding with a search result, and a middleware module 22 for classifying a data format of the search word; Respective format analysis modules 231 to 233 for analyzing a search word in different formats of text, voice, and image formats, and a semantic search module 24 for performing a multimedia search for each format; A conversion processing module 25 for performing a conversion process and a retrieval process to the contents of other formats of the retrieved raw content; Synchronization batch module 26 for synchronizing text, voice and image contents to create a single integrated multimedia content, and dynamic placement to generate search results, and a result module for caching completed search results and mediating user provisioning. And a markup language module 28 for registering the attribute of the search result with the setting of the administrator.

The interface module 21 receives a search word requested to be searched from the user terminal 3. In response to the search request, the search result of the multimedia content is transmitted to the user terminal 3.

Here, the interface module 21 may receive a search word in a text, voice, or image format input by the user in the user terminal 3.

The interface module 21 also receives a user profile from a web browser of the user terminal 3. The user profile includes information of the user terminal 3 (eg, desktop, smartphone or IP TV), screen display information (eg, monitor size, screen resolution, etc.).

The middleware module 22 distinguishes a text, voice, or image format from the received search word.

The format analysis module 231 to 233 analyzes metadata for each search word according to the search word format. The text analysis module 231 stems and parses the text search word and transmits the analyzed result to the semantic search module 24. The voice analysis module 232 converts the voice search word into a text search word, and then, stems and parses the converted text and transmits the analyzed result to the semantic search module 24. The image analysis module 233 analyzes the searched image, extracts a feature, compares the stored metadata with the stored metadata, and delivers the analyzed result to the semantic search module 24.

Here, the format analysis module 231 to 233 may generate a search word of another format from the search word format. For example, a voice search word or an image search word is generated for a text search word requested by a user. Of course, it is also possible to generate a search word in another format from the voice search word or the image search word.

The semantic search module 24 applies advanced text mining techniques to each analysis result analyzed by the format analysis modules 231 to 233 of text, voice, and image to analyze unstructured information as well as structured information. Retrieve information closest to the user's intent. Accordingly, the user is to search for a variety of information that is intended by the user, which is related to the meaning and substantiveness, instead of simply searching for a search result matching a search word. Here, the semantic searched text, voice and image contents are raw contents (or child contents) for synthesizing multimedia contents.

Here, the semantic search module 24 collects raw content from a data DB built on the search server 2 and a search engine and data DB of another search site. Furthermore, other search methods may be applied in addition to the semantic search described above.

The conversion processing module 25 performs text conversion processing, voice conversion processing, and image retrieval processing as necessary to generate contents in a different format for each format of the retrieved raw content.

For example, the conversion processing module 25 generates the voice content with respect to the retrieved text content by text to speech (tts), and retrieves the image content by the image retrieval processing. The conversion processing module 25 generates the text content with respect to the retrieved speech content by text conversion processing (stt: speech to text), and retrieves the image information by the image search processing. In addition, the conversion processing module 25 generates the text content with respect to the retrieved image content by text retrieval processing, and selectively generates voice content by voice conversion processing. Here, the search can be searched from the insertion information and the meta information of the raw content, and the Internet search can be performed through the search engine.

The synchronizing arrangement module 26 synchronizes the output of the retrieved raw content and other formats of contents secured using the raw content to produce a single integrated multimedia content. Therefore, when the multimedia content is played, the output of each text, voice, and image is semantically synchronized and output. In addition, the synchronization arrangement module 26 generates a search result that the multimedia content is dynamically arranged to form the screen UI.

Here, the synchronization arrangement module 26 extracts user terminal information and screen display information from the received user profile information, and configures the screen UI according to the extracted information and the number of multimedia contents to be arranged. That is, the arrangement size and position of the content may vary according to the user terminal and the number of contents. In addition, even if the same search word is input, the UI of the search result may vary according to a user terminal of an IP TV or a smart phone.

When the number of arrangement of the contents is determined, the synchronization arrangement module 26 enlarges or reduces the size of the image in the screen UI configured with the frame or layout according to the number. Of course, one image corresponds to one search result content. In addition, it is apparent that the arrangement of the multimedia contents may be arranged according to the known sorting order of the known inquiry order and the latest order. For example, in the case of bulletin board search, multimedia content corresponding to a post is arranged based on a predetermined sorting criterion.

The search server 2 may further include a markup language module 28. The markup language module 28 changes the voice volume of the content, the ranking of the content, and the screen UI configuration by using an extended markup language (XML) tag according to an administrator's command. That is, the markup language module 28 stores the screen UI according to the type of the user terminal and the number of contents to be arranged according to the setting of the administrator, and provides a corresponding screen UI according to a condition when generating a search result. In addition, the screen UI may include a control function such as placement of the advertisement content, top exposure, etc. as the administrator setting.

FIG. 3 shows a distributed server environment of the search server 2 in which the configuration module of FIG. 2 is constructed as each server.

The interface server 210 receives the search word requested by the user and transmits the search word to the middleware server 220. The middleware server 220 divides the format of the search word and transmits it to the analysis server 230.

The analysis server 230 performs text analysis (morphological analysis and syntax analysis), voice analysis (stt transformation and text analysis) and image analysis (image feature extraction) corresponding to the format of the search, and analyzes the analyzed text, voice and The analysis result of the image is transmitted to the semantic search server 24. The semantic search server 240 searches for semantic related content by format using the semantic search engine. In this process, the semantic search server 240 transmits the raw content retrieved from the DB stored in the data DB server 241 to the voice processing server 250 as needed. Here, it is assumed that the retrieved raw content is document content.

The voice processing server 250 extracts text information from the raw content to generate the voice content through the TTS engine, and transfers the raw content and the generated voice content to the synchronization and markup language server 26. Here, the STT server (video, voice-> text) and the image server (voice, text-> image) in addition to the voice processing server 250 may be further included.

The synchronization and markup language server 260 checks basic UI information by referring to a user profile, and dynamically configures a screen UI optimized for the user terminal according to the number of contents to be retrieved (distributed). When the contents of the text, voice, and image are generated as one multimedia content through the synchronization, and the search result is generated by the screen UI arrangement, the generated search result is transmitted to the result server 270.

The result server 270 temporarily stores the search results and delivers the search results to the interface server 210, and the interface server 210 provides the search results in response to the search request of the user terminal 3.

4 is a conventional search result page and FIG. 5 is a search result page according to an embodiment of the present invention.

For convenience of comparison, the search term is entered as "Poland". In the case of FIG. 4, it can be seen that the contents searched in Poland in the conventional search result page are arranged in a UI defined as sections and columns in a box area or a list form.

On the other hand, in the case of Figure 5, the UI screen is determined according to the type of the user terminal and the number of multimedia content to be arranged. For example, the search server 2 reads a profile that is user device information (display information, resolution) to confirm user UI size information (screen display size). Next, after checking the number of contents of the search result, the search server 2 divides the screen according to the user device UI and arranges the contents. Here, screen division and content arrangement may display content of a search result over a plurality of pages through page processing. In addition, individual pages may have the same or different UI. The search result in which the multimedia content generated by the search server 2 is arranged is transmitted to the user terminal 3 and displayed on the screen.

Here, when the search result is displayed on the screen of the user terminal 3, the default content may be played. When specific multimedia content is played, the remaining contents are deactivated. In this state, when a pointer of a touch input or a mouse input is positioned at a specific inactivated content, the touch input or mouse input is activated and played upon touch or click.

<2. 방법 구성><2. How to Configure>

The search method according to an embodiment of the present invention can be preferably realized through the construction of the search system 1 described above.

The interface module 21 of the search server 2 receives search request information including a search word from the user terminal (S21).

Here, the interface module 21 further receives information of the user profile including the terminal information and the screen display information from the user terminal 3. The received user profile information is analyzed for multimedia content placement.

When the search word is received from the user terminal 3, the middleware module 22 distinguishes which format the received search word is from text, voice, or image (S22).

When the search word formats are divided, the analysis modules 231 to 233 perform analysis processing such as extraction of meta information corresponding to each search word format, semantic analysis, morpheme and syntax analysis, and image feature extraction (S23).

When a keyword by text, voice, or image is analyzed by the keyword analysis, the semantic search module 24 performs a semantic search on search result contents corresponding to the keyword by format (S24).

If the raw content is found as a result of the search, the conversion processing module 25 converts or retrieves contents of a format different from the raw content required for generating the multimedia content (S25). This process involves a TTS / STT conversion process and a search process.

When the text, voice, and image contents for constituting the multimedia contents are secured, the synchronizing arrangement module 26 generates one integrated multimedia contents by synchronizing the respective contents and disposing each contents in the screen UI (S26).

Here, the synchronization match module 26 determines the corresponding screen UI according to the user profile information and the number of content to be arranged, and generates a search result by placing individual content in an image frame of the screen UI.

When the search result is generated, the result module 27 transmits the search result to the interface module 21, and the interface module 21 transmits the search result as a response to the search request to the user terminal 3 (S27). ).

Alternatively, the administrator may be provided with a UI setting page from the markup language module 28, and may use the Extended Markup Language (XML) tag according to the user profile information and the number of the content to be deployed, The ranking of content and the screen UI configuration may be registered in advance.

When the original content is text in step S25 of FIG. 7 described above, the conversion processing module 25 converts the text information into tts to generate voice content (S251). In operation S252, image contents corresponding to text and voice information are searched for. The image content may be extracted from an image embedded in the text or searched through an external site.

If the original content is voice, the conversion processing module 25 converts the voice information to stt to generate text content (S253). The image content corresponding to the voice and text information is searched for (S252).

If the original content is an image, the conversion processing module 25 searches for text corresponding to the image (S254), and converts the searched text into tts to generate voice content (S251). If the image is a video, step S251 may be omitted.

In the above-described embodiment, the term "module" may be a plurality of modules may be integrated into one module, or one module may be divided into a plurality of modules. In addition, the module may mean a hardware module, but may also mean a module of software. Therefore, it should be understood that the present invention is not particularly limited by the term module.

Although the present invention has been described by way of limited embodiments and drawings, the present invention is not limited thereto, and the technical idea of the present invention and claims to be described below by those skilled in the art to which the present invention pertains. Of course, various modifications and variations are possible within the scope of equivalents.

Claims

Receives a user's search word on a wired or wireless Internet, performs a multimedia search with the search word, and performs at least one of a corresponding text conversion process, a voice conversion process, and an image search process on the searched individual results, and processes each voice. A search server for synchronizing the results of text and images to generate multimedia contents of individual results, and placing the generated multimedia contents on a divided area of a screen and providing the search results to a user as a search result; And

A user terminal that accesses the search server and inputs a search word in a text, voice, or image format to request a search, and receives and displays a search result having a UI (User Interface) in which multimedia contents are divided and displayed on a screen.

Search system comprising a.
The method of claim 1,

The search server,

An interface module for receiving a user profile and a search word requested to be searched from the user terminal and providing a search result of the multimedia content;

A middleware module for classifying a text, voice, or image format with respect to a search word;

A search module for performing a multimedia search for each text, voice, and image by a format separated search word;

A conversion processing module which performs text conversion processing, voice conversion processing, and image retrieval processing to secure contents of another format type corresponding to the format of the retrieved individual result; And

Synchronize the output of text, voice and image contents obtained through the individual search results and the conversion process to generate a single integrated multimedia content, and generate a search result by placing the generated multimedia content based on the user profile information Synchronization batch module

Search system comprising a.
The method of claim 2,

The search module,

A format analysis module configured to analyze metadata for a format-specific search term received from the middleware module, and to extract the morphological analysis and parsing of the text search term and the image feature of the search term; And

Semantic search module that analyzes and retrieves data received from the format analysis module with a semantic search engine

Search system comprising a.
The method of claim 2,

The synchronization batch module,

And extracting user terminal information and screen display information from the user profile information, and dynamically configuring the screen UI according to the extracted information and the number of multimedia contents to be arranged.
The method according to claim 1 or 2,

The search server,

A process of generating speech information on the retrieved text result by text-to-speech (tts), and obtaining image information by image retrieval processing to generate multimedia content in which the text result, speech information and image information are synchronized;

A process of generating text information with respect to the searched speech result, by generating a text to speech (stt: speech to text), and securing image information through an image search process to generate multimedia contents synchronized with the speech result, text information and image information; And

A process of generating text information for the retrieved image result by generating text information by text search processing, and optionally generating voice information by voice conversion processing to generate multimedia contents synchronized with the image result, text information and voice information.

Search system characterized in that for performing.
The method according to claim 1 or 2,

The search server,

And a search result of a screen UI in which a frame or a layout is dynamically configured in consideration of the image size of the multimedia content.
The method of claim 6,

The search results,

And after the screen is displayed on the user terminal, other contents are deactivated when the specific multimedia contents are played, and when the mouse is positioned on the deactivated contents, the contents are activated and played when clicked.
The method according to claim 1 or 2,

The search server,

A markup language module for changing a voice volume, a ranking of content, and a screen UI configuration of the content by using an extended markup language (XML) tag according to a command of an administrator; And

Results module that performs the caching of completed search results and mediates user contributions

Search system characterized in that it further comprises.
A search method for a search server, which receives a search word from a user terminal on a wired or wireless Internet, performs a search, and provides a search result.

(a) classifying a format of a search term requested for search from a user terminal;

(b) performing a multimedia search of text, voice, and image for each format of the search word;

(c) performing at least one of a text conversion process, a voice conversion process, and an image search process on the individual results in order to secure contents of another format type corresponding to the format of the retrieved individual results;

(d) synchronizing the output of the text, voice, and image contents obtained through the conversion process with the individual results retrieved to produce a single integrated multimedia content;

(d) dividing at least one multimedia content on an area of a screen user interface (UI) to generate a search result; And

(e) providing search results in response to a search request from the user terminal;

Search method comprising a.
The method of claim 9,

Step (a) is,

And receiving information of a user profile including terminal information and screen display information from the user terminal.
The method of claim 9,

Step (b) is,

A step of analyzing the meta data for the search word for each format, morphological analysis, parsing of the text search word, and extracting image features of the search word, and then searching the analyzed data with a semantic search engine. Way.
The method of claim 9,

Step (c) is,

A process of generating speech information with respect to the retrieved text result by text to speech (tts), and securing image information with an image search process;

A process of generating text information on the retrieved speech result by text conversion processing (stt: speech to text), and securing image information by image search processing; And

A process of generating text information by text search processing on the retrieved image result, and selectively generating voice information by performing voice conversion processing.

The search method characterized in that the step of performing.
The method of claim 9,

Step (d) is,

And extracting the user terminal information and the screen display information from the user profile information and dynamically configuring the screen UI according to the extracted information and the number of multimedia contents to be arranged.
The method according to claim 9 or 13,

Step (d) is,

And generating a screen UI having a frame or a layout dynamically considering the image size of the multimedia content.
The method of claim 9,

The user terminal,

Receiving and displaying a search result on a screen;

Playing specific multimedia content by default setting or user request;

Deactivating other contents except contents currently being played;

Activating when the mouse is located on the deactivated content; And

Playing the clicked content on clicking of the activated content

Search method comprising a.
The method of claim 9,

The search server,

And a markup language step of changing the voice volume of the content, the ranking of the content, and the screen UI configuration by using an extended markup language (XML) tag according to an administrator's command.
The method of claim 9,

The search server,

At least one independent distributed server.