CN105893431A - Media retrieval method and equipment - Google Patents
Media retrieval method and equipment Download PDFInfo
- Publication number
- CN105893431A CN105893431A CN201510902605.4A CN201510902605A CN105893431A CN 105893431 A CN105893431 A CN 105893431A CN 201510902605 A CN201510902605 A CN 201510902605A CN 105893431 A CN105893431 A CN 105893431A
- Authority
- CN
- China
- Prior art keywords
- media content
- relevant
- key element
- retrieval
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/432—Query formulation
- G06F16/433—Query formulation using audio data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/432—Query formulation
- G06F16/434—Query formulation using image data, e.g. images, photos, pictures taken by a user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Library & Information Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the field of digital information retrieval, and discloses a media retrieval method and equipment, wherein the method comprises the following steps of obtaining a media content element; sending the obtained media content element to a server so as to retrieve a media content associated with the media content element in the server; and receiving information relevant to the retrieved media content from the server, wherein the media content element includes at least one of an image, sound and a mark relevant to the media content. By using the technical scheme, the retrieval on the media content can be realized by using the image, the sound and the mark as the retrieval element, so that the media content is obtained; the retrieval element can be conveniently obtained; and the user experience is good.
Description
Technical field
The present invention relates to digital information searching field, in particular it relates to a kind of media retrieval method and apparatus.
Background technology
Traditional retrieval is text retrieval, also known as natural language searching, refers to not carry out document or content
Any index, directly passes through the computer system with the words and phrases matched and searched in natural language.Text retrieval
Carry out the object mated, can be the text of whole publication, including article, the most whole books of report, also
Can be its part, such as digest, take passages or the autograph of simply document.
The most most typical text retrieval is the book index of library, according to title, author, publishing house,
Library Books is indexed by the information such as publication time, book number, and reader only need to can quickly according to index
Find where required book leaves library in.The appearance of computer makes people by computer
The more document of management that can be convenient, hard disc of computer even can load all books in the whole world
Library Collection.In order to quickly search the document that computer is managed, occur in that first generation text retrieval technique,
I.e. according to keyword match, the document comprising keyword is picked out and presents to user as retrieval result.
Along with the increase of number of documents, first generation text retrieval technique is used to be difficult to retrieve accurately
Retrieval result, the second filial generation text retrieval technique thus according to content of text arises at the historic moment.I.e. according to system
To text and the understanding of retrieval statement, calculate text and the similarity of retrieval statement, according to similarity to inspection
Rope sort result, presents to user by retrieval result the highest for similarity.Along with the Internet appearance and
Development, text documents quantity development on the internet is more swift and violent, the order of magnitude of text and the knot of text
Structure all there occurs change: amount of text increases substantially, text on the Internet becomes semi-structured.
This proposes bigger challenge to text retrieval technique.
Along with enriching constantly of media content, user is increasing to the demand of multimedia content retrieval.Many
Media are the comprehensive of media, generally comprise text, the media form such as sound and image.At present,
User is when retrieving content of multimedia, it is to be appreciated that the partial content of multimedia Chinese version, such as,
Media name.But when user does not knows media name, the retrieval to media then becomes the most difficult.
For the problems referred to above prior art there is no good solution.
Summary of the invention
It is an object of the invention to provide a kind of method and apparatus, the method and equipment can provide according to user
Any media elements carry out retrieving obtaining corresponding media content.
To achieve these goals, the present invention provides a kind of media retrieval method, and the method includes: obtain
Media content key element；The media content key element obtained is sent to server, with in described server
The media content that retrieval is associated with described media content key element；And from described server receive and examined
The information that the media content that rope arrives is relevant；Wherein, described media content key element includes and described media content
Relevant at least one of person: image, sound and labelling.
Further, described terminal acquisition media content key element includes: by acquisition and the described media of taking pictures
The image that content is relevant；And/or obtain the sound relevant to described media content by recording；And/or penetrate
Frequency identifies electronic tag, wherein relevant to described media content is labeled as described electronic tag.
Another aspect of the present invention, it is provided that a kind of media retrieval method, the method includes: from terminal
Receive the media content key element that described terminal obtains；The media that retrieval is associated with described media content key element
Content；And transmit the information relevant to the media content retrieved to described terminal；Wherein, described
Media content key element includes at least one of person relevant to described media content: image, sound and
Labelling.
Further, described terminal obtain media content key element include: by take pictures obtain with described
The image that media content is relevant；And/or the sound relevant to described media content obtained by recording；With
/ or radio frequency recognizing electronic label, wherein relevant to described media content is labeled as described electronic tag.
Another aspect of the present invention, it is provided that a kind of terminal, including: acquisition module, it is used for obtaining matchmaker
Body content element；First sending module, sends to server for the media content key element that will be obtained,
To retrieve the media content being associated with described media content key element in described server；And first connect
Receive module, for receiving the information relevant to the media content retrieved from described server；Wherein,
Described media content key element includes at least one of person relevant to described media content: image, sound
And labelling.
Further, described acquisition module is used for: obtain the figure relevant to described media content by taking pictures
Picture；And/or obtain the sound relevant to described media content by recording；And/or frequency identification electronic mark
Sign, wherein relevant to described media content be labeled as described electronic tag.
Another aspect of the present invention, it is provided that a kind of server, including: the second receiver module, it is used for
The media content key element that this terminal obtains is received from terminal；Retrieval module, in retrieval with described media
Hold the media content that key element is associated；And second sending module, for transmitting to described terminal and being examined
The information that the media content that rope arrives is relevant；Wherein, described media content key element includes and described media content
Relevant at least one of person: image, sound and labelling.
Further, described terminal obtain media content key element include: by take pictures obtain with described
The image that media content is relevant；And/or the sound relevant to described media content obtained by recording；With
/ or radio frequency recognizing electronic label, wherein relevant to described media content is labeled as described electronic tag.
Another aspect of the present invention, it is provided that a kind of media retrieval system, this system includes: terminal,
It is configured to obtain media content key element, and described media content key element is sent to server；And
Described server, is configured to the media content that retrieval is associated with described media content key element；And to
The information that the output of described terminal is relevant to the media content retrieved；Wherein, described media content key element
At least one of person including relevant to described media content: image, sound and labelling.
Further, described terminal includes that above-mentioned terminal, described server include above-mentioned server.
Pass through technique scheme, it is possible to it is right to be realized as retrieval key element by image, sound and labelling
The retrieval of media content, thus obtain media content, retrieval key element is readily available, and Consumer's Experience is good.
Other features and advantages of the present invention will be described in detail in detailed description of the invention part subsequently.
Accompanying drawing explanation
Accompanying drawing is used to provide a further understanding of the present invention, and constitutes the part of description, with
Detailed description below is used for explaining the present invention together, but is not intended that limitation of the present invention.?
In accompanying drawing:
Fig. 1 is the media retrieval method flow diagram that embodiment of the present invention provides；
Fig. 2 is the media retrieval method flow diagram that embodiment of the present invention provides；
Fig. 3 is the terminal structure schematic diagram that embodiment of the present invention provides；
Fig. 4 is the server architecture schematic diagram that embodiment of the present invention provides；And
Fig. 5 is the media retrieval system structure schematic diagram that embodiment of the present invention provides.
Detailed description of the invention
Below in conjunction with accompanying drawing, the detailed description of the invention of the present invention is described in detail.It should be appreciated that
Detailed description of the invention described herein is merely to illustrate and explains the present invention, is not limited to this
Bright.
Fig. 1 is the media retrieval method flow diagram that embodiment of the present invention provides.As it is shown in figure 1, this
Bright embodiment provides a kind of media retrieval method, and the method includes: S101, and terminal obtains media content
Key element；S102, the media content key element obtained is sent to server, to examine in the server by terminal
The media content that rope is associated with described media content key element；And S103, terminal receives from server
The information relevant to the media content retrieved.
Fig. 2 is the media retrieval method flow diagram that another embodiment of the present invention provides.As in figure 2 it is shown,
Embodiment of the present invention provides a kind of media retrieval method, and the method includes: S201, and server is from end
End receives the media content key element that described terminal obtains；S202, server retrieval is wanted with described media content
The media content that element is associated；And S203, server transmits and the matchmaker retrieved to described terminal
The information that internal appearance is relevant.
In the method shown in Fig. 1 and Fig. 2, described media content key element can include with in described media
At least one of person that appearance is relevant: image, sound and labelling.Retrieval refers generally to character search, inspection
Rope to word include retrieval use keyword.Similar, to matchmaker with character search based on keyword
Body is retrieved, and the media content retrieved includes the media content key element that media include.Above-mentioned retrieval
Media content key element can be retrieved by process as retrieval key element.In embodiments, server can
There is broad medium content with storage, or there is the energy accessing the data base that storage has broad medium content
Power.According to retrieval key element, such as one image, this server will find all in all media contents
Comprise the media content of this key element, such as, include the film of this image, trailer etc..Its ultimate principle is
Based on image recognition, because such as the video media such as film, trailer is all by image construction.
Wherein, the information that media content that is described and that retrieved is relevant can include described media content
Link, to the introduction of described media content or comment etc., user can be readily available matchmaker by this link
Internal appearance, by obtaining the understanding to this media content to the introduction of media content or comment.
In embodiments, the media content key element of acquisition can be photo or the sound of recording of shooting,
Therefore, in method step, obtain media content key element may include that terminal is passed through to take pictures acquisition with described
The image that media content is relevant；And/or terminal obtains the sound relevant to described media content by recording.
Wherein, image and sound can have multiple source, the such as propaganda film of film, film, poster, interlude
Deng.The method provided by the present invention, when the user discover that content interested wishes to obtain media content
Time, by shooting the image relevant to this content interested or the content phase interested with this can be recorded
The sound closed retrieves media content in the server.Wherein, retrieval key element can be the color in image,
Texture, shape, scene, tone in sound, loudness, tone color etc..Media content key element can be obtained
Terminal can have photographic head, mike, it is also possible to there is speaker and the display that can play media
Screen.
For image retrieval key element, the method that the present invention provides can extract its face according to the content of image
Color, shape, texture, and the information such as object spatial relationship, set up the aspect indexing of image.Then may be used
To utilize existing image indexing system to carry out image retrieval, such as: IBM Almaden opens in research center
The searching system (Query By Image Content, QBIC) of the image content-based sent out, by MIT
The PhotoBook that develops of Media Lab, the VisualSEEK of Columbia Univ USA's exploitation
Image query systems etc..
Content-based audio retrieval to be realized, it is necessary to extract audition from sound or voice data special
Reference ceases.Audio frequency characteristics can be divided into: auditory perceptual feature and the non-Perception Features of audition, the most not people
Infrasonic sound or ultrasonic in ear perceived frequency, auditory perceptual feature includes volume, tone, loudness of a sound etc..At language
Sound identification aspect, can be for example with the Via Voice system of IBM, the VMR system of Cambridge University,
And the Informedia system etc. of Ka Neiji Hui Long university.
In other implementations, the labelling relevant to described media content can be electronic tag, example
Such as embedded within the electronic tag in film poster or Quick Response Code, in such embodiment, pass through radio frequency
Identify that described electronic tag is obtained with media content key element.
In a preferred embodiment, after the information that output is relevant to the media content retrieved,
The method can also include playing the media content retrieved.Such as, the mobile terminal used user
(such as, mobile phone) upper media content retrieved of directly playing, broadcasting can in response to the operation of user,
Or directly according to retrieval result ranking automatic media playing content, such as automatically play retrieval result ranking
The media content of first.
Fig. 3 and Fig. 4 respectively illustrates the media retrieval method for implementing embodiment of the present invention offer
Exemplary terminal and server.Fig. 5 is that the media retrieval system structure that embodiment of the present invention provides is shown
It is intended to.
As it is shown on figure 3, the terminal 30 that embodiment of the present invention provides, may include that acquisition module 31,
For obtaining media content key element；First sending module 32, for sending out the media content key element obtained
Deliver to server, with in the media that retrieval in described server is associated with described media content key element
Hold；And first receiver module 33, for receiving and the media content phase retrieved from described server
The information closed；Wherein, described media content key element include relevant to described media content following at least it
One: image, sound and labelling.
As shown in Figure 4, the server 40 that embodiment of the present invention provides, may include that the second reception mould
Block 41, for receiving, from terminal, the media content key element that this terminal obtains；Retrieval module 42, is used for examining
The media content that rope is associated with described media content key element；And second sending module 43, for institute
State terminal and transmit the information relevant to the media content retrieved；Wherein, described media content key element bag
Include at least one of person relevant to described media content: image, sound and labelling.
As it is shown in figure 5, embodiment of the present invention provides a kind of media retrieval system, this system can be wrapped
Include: terminal 30, be configured to obtain media content key element, and described media content key element is sent to
Server 40；And described server 40, it is configured to retrieval and is associated with described media content key element
Media content；And export the information relevant to the media content retrieved to described terminal 30；
Wherein, described media content key element includes at least one of person relevant to described media content: image,
Sound and labelling.
In a preferred embodiment, the information that media content that is described and that retrieved is relevant includes described
The link of media content, to the introduction of described media content or comment etc..User can utilize terminal 201
It is readily available media content by this link.
In embodiments, in order to obtain image and sound, the terminal 30 in embodiment of the present invention can
To include photographic head and mike (not shown).Terminal 30 may be configured to: by described photographic head
Take pictures and obtain the image relevant to described media content；And/or obtained with described by described microphone location
The sound that media content is relevant.Further, relevant to described media content labelling can be electronics mark
Sign, and described terminal 30 is configured to electronic tag described in RF identification.
In a preferred embodiment, terminal 30 be further configured to receive described with retrieved
After the information that media content is relevant, playing the media content retrieved, broadcasting can be in response to user
Operation, or directly according to retrieval result ranking automatic media playing content, the most automatically play retrieval
The media content that result ranks the first.Terminal 30 in embodiments can include display and raise one's voice
Device (not shown).
In embodiments of the present invention, terminal 30 can be such as smart mobile phone, panel computer, with
And the mobile terminal such as personal digital assistant.Terminal 30 can by the way of wire/wireless with server 40
Communicate.Server 40 can be the webserver, cloud database.
Pass through technique scheme, it is possible to it is right to be realized as retrieval key element by image, sound and labelling
The retrieval of media content, thus obtain media content.Retrieval key element can be easily by taking pictures, recording
The mode such as sound and RF identification obtains, and Consumer's Experience is good.
The preferred embodiment of the present invention is described in detail above in association with accompanying drawing, but, the present invention does not limit
Detail in above-mentioned embodiment, in the technology concept of the present invention, can be to the present invention
Technical scheme carry out multiple simple variant, these simple variant belong to protection scope of the present invention.
It is further to note that each the concrete technology described in above-mentioned detailed description of the invention is special
Levy, in the case of reconcilable, can be combined by any suitable means.In order to avoid need not
The repetition wanted, various possible compound modes are illustrated by the present invention the most separately.
Additionally, combination in any can also be carried out between the various different embodiment of the present invention, as long as its
Without prejudice to the thought of the present invention, it should be considered as content disclosed in this invention equally.
Claims (10)
1. a media retrieval method, it is characterised in that the method includes:
Obtain media content key element；
The media content key element obtained is sent to server, with retrieval in described server with described
The media content that media content key element is associated；And
The information relevant to the media content retrieved is received from described server；Wherein,
Described media content key element includes at least one of person relevant to described media content: image,
Sound and labelling.
Method the most according to claim 1, it is characterised in that described terminal obtains media content
Key element includes:
The image relevant to described media content is obtained by taking pictures；And/or
The sound relevant to described media content is obtained by recording；And/or
Radio frequency recognizing electronic label, wherein relevant to described media content is labeled as described electronic tag.
3. a media retrieval method, it is characterised in that the method includes:
The media content key element that described terminal obtains is received from terminal；
The media content that retrieval is associated with described media content key element；And
The information relevant to the media content retrieved is transmitted to described terminal；Wherein,
Described media content key element includes at least one of person relevant to described media content: image,
Sound and labelling.
Method the most according to claim 3, it is characterised in that in the media that described terminal obtains
Hold key element to include:
By the image relevant to described media content obtained of taking pictures；And/or
The sound relevant to described media content obtained by recording；And/or
Radio frequency recognizing electronic label, wherein relevant to described media content is labeled as described electronic tag.
5. a terminal, it is characterised in that including:
Acquisition module, is used for obtaining media content key element；
First sending module, sends to server for the media content key element that will be obtained, with described
Server is retrieved the media content being associated with described media content key element；And
First receiver module, for receiving the letter relevant to the media content retrieved from described server
Breath；Wherein,
Described media content key element includes at least one of person relevant to described media content: image,
Sound and labelling.
Terminal the most according to claim 5, it is characterised in that described acquisition module is used for:
The image relevant to described media content is obtained by taking pictures；And/or
The sound relevant to described media content is obtained by recording；And/or
Radio frequency recognizing electronic label, wherein relevant to described media content is labeled as described electronic tag.
7. a server, it is characterised in that including:
Second receiver module, for receiving, from terminal, the media content key element that this terminal obtains；
Retrieval module, the media content being associated with described media content key element for retrieval；And
Second sending module, for transmitting the letter relevant to the media content retrieved to described terminal
Breath；Wherein,
Described media content key element includes at least one of person relevant to described media content: image,
Sound and labelling.
Server the most according to claim 7, it is characterised in that the media that described terminal obtains
Content element includes:
By the image relevant to described media content obtained of taking pictures；And/or
The sound relevant to described media content obtained by recording；And/or
Radio frequency recognizing electronic label, wherein relevant to described media content is labeled as described electronic tag.
9. a media retrieval system, it is characterised in that this system includes:
Terminal, is configured to obtain media content key element, and described media content key element is sent to clothes
Business device；And
Described server, is configured to the media content that retrieval is associated with described media content key element；With
And export the information relevant to the media content retrieved to described terminal；Wherein,
Described media content key element includes at least one of person relevant to described media content: image,
Sound and labelling.
Media retrieval system the most according to claim 9, it is characterised in that described terminal includes
Terminal described in claim 5 or 6, described server includes the server described in claim 7 or 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510902605.4A CN105893431A (en) | 2015-12-09 | 2015-12-09 | Media retrieval method and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510902605.4A CN105893431A (en) | 2015-12-09 | 2015-12-09 | Media retrieval method and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105893431A true CN105893431A (en) | 2016-08-24 |
Family
ID=57002382
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510902605.4A Pending CN105893431A (en) | 2015-12-09 | 2015-12-09 | Media retrieval method and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105893431A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001016935A1 (en) * | 1999-08-26 | 2001-03-08 | Sony Corporation | Information retrieving/processing method, retrieving/processing device, storing method and storing device |
| CN1916907A (en) * | 2005-08-17 | 2007-02-21 | 株式会社东芝 | Information processing apparatus, information processing method |
| CN104346387A (en) * | 2013-07-31 | 2015-02-11 | 株式会社理光 | Cloud server and image storage and retrieval system |
-
2015
- 2015-12-09 CN CN201510902605.4A patent/CN105893431A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001016935A1 (en) * | 1999-08-26 | 2001-03-08 | Sony Corporation | Information retrieving/processing method, retrieving/processing device, storing method and storing device |
| CN1916907A (en) * | 2005-08-17 | 2007-02-21 | 株式会社东芝 | Information processing apparatus, information processing method |
| CN104346387A (en) * | 2013-07-31 | 2015-02-11 | 株式会社理光 | Cloud server and image storage and retrieval system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11055342B2 (en) | System and method for rich media annotation | |
| CN101313364B (en) | System and method for using content features and metadata of digital images to find related audio accompaniment | |
| CN101778233B (en) | Data processing apparatus, data processing method | |
| US9489403B2 (en) | Method and apparatus for providing visual search engine results | |
| CN105094760B (en) | A kind of picture indicia method and device | |
| US20120233531A1 (en) | Method, Apparatus or System for Image Processing | |
| US8438034B2 (en) | Method and apparatus for playing pictures | |
| JP2009526302A (en) | Method and system for tagging digital data | |
| US9195735B2 (en) | Information extracting server, information extracting client, information extracting method, and information extracting program | |
| US20140324858A1 (en) | Information processing apparatus, keyword registration method, and program | |
| CN111368141B (en) | Video tag expansion method, device, computer equipment and storage medium | |
| CN105205695A (en) | Internet-based advertisement interactive system and method | |
| CN109740016A (en) | Method, apparatus, server and the computer readable storage medium of music query | |
| CN105677799A (en) | Picture retrieval method and system | |
| CN114757208A (en) | Question and answer matching method and device | |
| CN110929137B (en) | Article recommendation method, device, equipment and storage medium | |
| US20150178387A1 (en) | Method and system of audio retrieval and source separation | |
| CN111159442A (en) | Picture search system, method, medium, and apparatus based on voice | |
| JP2011076336A (en) | Digital signage system and method for identifying display device viewed by user | |
| CN104090878B (en) | A kind of multimedia lookup method, terminal, server and system | |
| US20090094319A1 (en) | System and method of acquiring contents | |
| US20140078331A1 (en) | Method and system for associating sound data with an image | |
| CN111310461A (en) | Event element extraction method, device, equipment and storage medium | |
| CN103870500A (en) | Searching method and searching device | |
| CN105893431A (en) | Media retrieval method and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160824 |