CN109446356A - A kind of multimedia document retrieval method and device - Google Patents
A kind of multimedia document retrieval method and device Download PDFInfo
- Publication number
- CN109446356A CN109446356A CN201811108846.1A CN201811108846A CN109446356A CN 109446356 A CN109446356 A CN 109446356A CN 201811108846 A CN201811108846 A CN 201811108846A CN 109446356 A CN109446356 A CN 109446356A
- Authority
- CN
- China
- Prior art keywords
- information
- multimedia file
- image
- image information
- animal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present embodiments relate to intelligent security guard technical fields, disclose a kind of multimedia document retrieval method and device.The multimedia document retrieval method is applied to Network Attached Storage, comprising: receives retrieval information, the retrieval information includes image information；Image classification information is determined according to described image information；The multimedia file in the Network Attached Storage is retrieved according to the classification information, is obtained and the matched multimedia file of the classification information.The present invention realize quickly, accurately obtain destination multimedia file.
Description
Technical field
The present embodiments relate to intelligent security guard technical field more particularly to a kind of multimedia document retrieval method and dresses
It sets.
Background technique
With the popularization and application of technology of Internet of things, so that the security protection in city is from past simple security protection system to city
Synthesization system develops.Intelligent security guard technology refers to the transimission and storage technology of the informationization of service, image, with science
The development of technology has marched toward a completely new field, intelligent security protection skill with progressive and 21st century information technology rapid development
Boundary between art and computer gradually disappears.
Multimedia file is the important information source of intelligent security guard, a region of Yao Shixian or the intelligence of a system regions
Energy security protection, for example, to analyze the vehicle flow information of certain a road section, vehicle position information, communal facility security information, meteorological letter
Breath etc., it is necessary to acquire or store in real time a large amount of multimedia document informations.
It realizes in process of the present invention, at least there are the following problems in the related technology for inventor's discovery: huge due to calculating data
Greatly, and to data security requirement with higher, a large amount of multimedia document information is usually stored in network attached storage
In device.Currently, when needing to obtain corresponding multimedia file according to different needs, Network Attached Storage need to carry out by
One searches, time-consuming to obtain file failure or get wrong file compared with long and since operand is huge, may cause.
Summary of the invention
The embodiment of the present invention provides a kind of multimedia document retrieval method and device, can quickly, accurately obtain mesh
Mark multimedia file.
In order to solve the above-mentioned technical problem, the embodiment of the invention discloses following technical solutions:
In a first aspect, being applied to network attached storage the embodiment of the invention provides a kind of multimedia document retrieval method
Device, which comprises
Retrieval information is received, the retrieval information includes image information；
Image classification information is determined according to described image information；
The multimedia file in the Network Attached Storage is retrieved according to the classification information, obtain with it is described
The matched multimedia file of classification information.
Optionally, described to determine that image classification information includes: according to described image information
Described image information is parsed, the key frame in image is obtained, the key frame includes image classification information, the figure
As classification information includes: character image information, animal painting information or equipment image information；
Described image is determined according to character image information, animal painting information or the equipment image information in the key frame
The image classification information of information.
Optionally, the method also includes:
Image fractionation is carried out to the multimedia file in the Network Attached Storage, by the figure in the multimedia file
As information classification storage to character image information bank, animal painting information bank or equipment Image Database, wherein character image letter
Ceasing the multimedia image information in library, animal painting information bank or equipment Image Database includes multimedia file identification and figure
As timestamp of the information in multimedia file.
Optionally, the multimedia file in the Network Attached Storage is retrieved according to the classification information, is obtained
It takes and includes: with the matched multimedia file of the classification information
According to character image information, animal painting information or the equipment image information in the key frame to the figure map
As information bank, animal painting information bank or equipment Image Database are retrieved, obtains and scheme with the character image information, animal
As information or the multimedia file image information of equipment image information matches；
The multimedia file identification and image information for including according to the multimedia file image information are in multimedia text
Timestamp in part obtains and the multimedia of the character image information, animal painting information or equipment image information matches text
Part.
Optionally, the retrieval information also includes audio-frequency information, the method also includes:
The multimedia file in the Network Attached Storage is retrieved according to the audio-frequency information, obtain with it is described
The matched multimedia file of audio-frequency information.
Optionally, the audio-frequency information includes personage's acoustic information or animal sounds information, the method also includes:
Audio fractionation is carried out to the multimedia file in the Network Attached Storage, by the sound in the multimedia file
Frequency information classification storage is to personage's acoustic information library or animal sounds information bank, wherein personage's acoustic information library or animal sounds
Multimedia audio information in information bank includes the timestamp of multimedia file identification and acoustic information in multimedia file；
It is described that the multimedia file in the Network Attached Storage is retrieved according to the audio-frequency information, obtain with
The matched multimedia file of audio-frequency information includes:
According to personage's acoustic information or animal sounds information to personage's acoustic information library, animal sounds information bank
It is retrieved, obtains the multimedia file acoustic information with personage's acoustic information library or animal sounds information matches；
The multimedia file identification and acoustic information for including according to the multimedia file acoustic information are in multimedia text
Timestamp in part obtains the multimedia file with personage's acoustic information or animal sounds information matches.
Second aspect, the embodiment of the invention provides a kind of multimedia document retrieval devices, are applied to network attached storage
Device, described device include:
Receiving module, for receiving retrieval information, the retrieval information includes image information；
Determining module, for determining image classification information according to described image information；
First obtain module, for according to the classification information to the multimedia file in the Network Attached Storage into
Row retrieval, obtains and the matched multimedia file of the classification information.
Optionally, the determining module is specifically used for:
Described image information is parsed, the key frame in image is obtained, the key frame includes image classification information, the figure
As classification information includes: character image information, animal painting information or equipment image information；
Described image is determined according to character image information, animal painting information or the equipment image information in the key frame
The image classification information of information.
Optionally, described device further include:
First splits module, for carrying out image fractionation to the multimedia file in the Network Attached Storage, by institute
Image information classification storage in multimedia file is stated to character image information bank, animal painting information bank or equipment image information
Library, wherein the multimedia image information in character image information bank, animal painting information bank or equipment Image Database includes more
The timestamp of media file identification and image information in multimedia file.
Optionally, the first acquisition module is specifically used for:
According to character image information, animal painting information or the equipment image information in the key frame to the figure map
As information bank, animal painting information bank or equipment Image Database are retrieved, obtains and scheme with the character image information, animal
As information or the multimedia file image information of equipment image information matches；
The multimedia file identification and image information for including according to the multimedia file image information are in multimedia text
Timestamp in part obtains and the multimedia of the character image information, animal painting information or equipment image information matches text
Part.
Optionally, the retrieval information also includes audio-frequency information, described device further include:
Second obtain module, for according to the audio-frequency information to the multimedia file in the Network Attached Storage into
Row retrieval, obtains and the matched multimedia file of the audio-frequency information.
Optionally, the audio-frequency information includes personage's acoustic information or animal sounds information, described device further include:
Second splits module, for carrying out audio fractionation to the multimedia file in the Network Attached Storage, by institute
Audio-frequency information classification storage in multimedia file is stated to personage's acoustic information library or animal sounds information bank, wherein Ren Wusheng
Multimedia audio information in sound information bank or animal sounds information bank includes multimedia file identification and acoustic information more
Timestamp in media file；
The second acquisition module is specifically used for:
According to personage's acoustic information or animal sounds information to personage's acoustic information library, animal sounds information bank
It is retrieved, obtains the multimedia file acoustic information with personage's acoustic information library or animal sounds information matches；
The multimedia file identification and acoustic information for including according to the multimedia file acoustic information are in multimedia text
Timestamp in part obtains the multimedia file with personage's acoustic information or animal sounds information matches.
The third aspect, the embodiment of the invention provides a kind of Network Attached Storages, comprising:
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one
A processor executes, so that at least one described processor is able to carry out multimedia document retrieval method as described above.
Fourth aspect is described non-easy the embodiment of the invention also provides a kind of non-volatile computer readable storage medium storing program for executing
The property lost computer-readable recording medium storage has computer executable instructions, and the computer executable instructions are for making computer
Execute multimedia document retrieval method as described above.
The beneficial effect of the embodiment of the present invention is: being in contrast to the prior art, the embodiment of the invention provides one kind
Multimedia document retrieval method and device.Wherein, the multimedia document retrieval method is by receiving retrieval information, the retrieval
Information includes image information, image classification information is determined according to described image information, according to the classification information to the network
Multimedia file in annex storage is retrieved, acquisition and the matched multimedia file of the classification information, to realize
Quickly, destination multimedia file is accurately obtained.
Detailed description of the invention
One or more embodiments are illustrated by the picture in corresponding attached drawing, these exemplary theorys
The bright restriction not constituted to embodiment, the element in attached drawing with same reference numbers label are expressed as similar element, remove
Non- to have special statement, composition does not limit the figure in attached drawing.
Fig. 1 is the schematic network structure of multimedia document retrieval method provided in an embodiment of the present invention；
Fig. 2 is a kind of storage region schematic diagram of Network Attached Storage provided in an embodiment of the present invention；
Fig. 3 is a kind of flow diagram of multimedia document retrieval method provided in an embodiment of the present invention；
Fig. 4 is the flow diagram of step S13 in Fig. 3；
Fig. 5 is the flow diagram of step S15 in Fig. 3；
Fig. 6 be another embodiment of the present invention provides a kind of multimedia document retrieval method flow diagram；
Fig. 7 is a kind of flow diagram for multimedia document retrieval method that further embodiment of this invention provides；
Fig. 8 is the flow diagram of step S19 in Fig. 7；
Fig. 9 is a kind of structural schematic diagram of multimedia document retrieval device provided in an embodiment of the present invention；
Figure 10 be another embodiment of the present invention provides a kind of multimedia document retrieval device structural schematic diagram；
Figure 11 is a kind of structural schematic diagram for multimedia document retrieval device that further embodiment of this invention provides；
Figure 12 is a kind of structural schematic diagram of Network Attached Storage provided in an embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
In addition, as long as technical characteristic involved in the various embodiments of the present invention described below is each other not
Constituting conflict can be combined with each other.
Referring to Fig. 1, Fig. 1 is the schematic network structure of multimedia document retrieval method provided in an embodiment of the present invention.
As shown in Figure 1, the network structure of the multimedia document retrieval method includes at least: terminal device 10, gateway 20, network attached
Memory 30, local area network 40 and acquisition equipment 50, wherein it should be noted that connection relationship shown in figure can be it is wired
Connection, can also be wireless connection, for example, the connection between the gateway 20 and the Network Attached Storage 30 can pass through
The communications cable is attached, and can also be attached by wireless WiFi module, wireless blue tooth module etc..
The terminal device 10 is the operable equipment for having certain processing and display function of user, in the present embodiment
In, the terminal device 10 includes portable equipment 101 or computer 102, wherein the portable equipment 101 includes notebook electricity
Brain, tablet computer, smart phone etc., the computer 102 include desktop computer, intelligence control system, intelligent refrigerator, intelligence
Washing machine etc..
The portable equipment 101 or the computer 102 are attached from the network by the certification and addressing of the gateway 20
Belong to memory 30 and obtains destination multimedia file.The portable equipment 101 and the computer 102 include user interface 11,
The user interface 11 is the window of human-computer interaction, and the user interface 11 can be LED or LCD or CRT display screen.Some
In embodiment, the portable equipment 101 or the computer 102 include hardware input equipment, the portable equipment 101 or described
Computer 102 receives the instruction of the hardware input equipment, is shown in the user interface 11, and by the portable equipment
101 or the computer 102 execute.
The touch of the user interface 11 is grasped specifically, the portable equipment 101 or the computer 102 receive user
Make, corresponding movement is executed according to the touch operation.The touch operation can be touching, clicking on or sliding for user's finger
Dynamic operation, be also possible to stylus touch, click on or slide, alternatively, the touch operation can also be gesture control
System operation, for example, the user interface 11 of intelligent washing machine receives user when the computer 102 is intelligent washing machine
Gesture operation from left to right, the intelligent washing machine are opened, further for example, the user interface 11 of intelligent washing machine is default
Time in receive gesture operation X time of user preset, the intelligent washing machine is into preset operating mode.
In some embodiments, the user interface 11 include search condition frame, ACK button, return upper level button and
Into next stage button etc..Specifically, for example, working as the picture that retrieve the C time point of the fork in the road B of A road, in search condition
The keyword of frame input image information, the portable equipment 101 or the computer 102 carry out tentatively the search condition
Analysis and judgement, and the fork in the road B for obtaining A road is sent from the corresponding Network Attached Storage 30 via the gateway 20
C time point picture request, the Network Attached Storage 30 returns to acquisition request response, and the request-reply carries A
The picture at the C time point of the fork in the road B of road.
In some embodiments, when the local area network 40 is Zigbee ad hoc network, the local area network 40 by serial ports or
Single-chip microcontroller is connect with the processor of the Network Attached Storage 30, to realize that the data between Zigbee net and Ethernet pass
It passs.
Referring to Figure 2 together, the Network Attached Storage 30 is divided into multiple storage regions 31, in the present embodiment,
The storage region 31 includes character image information bank, animal painting information bank, equipment Image Database, personage's acoustic information library
With animal sounds information bank, wherein each described storage region 31 includes key frame 311, file identification 312 and timestamp
313, it include image classification information or audio classification information in the key frame 311, the file identification 312 is actually text
Part name is generally made of prefix name and suffix name, and the timestamp 313 is a character string, uniquely identifies certain a moment
Time.The image classification that image can be determined by the key frame 311 can determine the storage according to described image classification
Region 31 can further be determined by the file identification 312 and timestamp 313 and be stored in the more of different storage zone 31
Media file.
In the present embodiment, the acquisition equipment 50 includes that picture pick-up device 501 and/or sound pick-up outfit 502 and/or sensing are set
Standby 503 etc., it will be understood that the picture pick-up device 501 can be video camera, an at least video camera according to certain rules or
It is laid in realistic space according to practical situation, the video camera can maximumlly can increase in conjunction with multidimensional motor to be taken the photograph
The acquisition range of camera.In some embodiments, it can choose integrated video camera substitution multidimensional motor in conjunction with video camera
Mode, for example, hemispherical all-in-one machine, quick ball-type all-in-one machine, the integral machine in conjunction with holder or camera lens are built in holder
All-in-one machine etc., above-mentioned all-in-one machine may be implemented to focus automatically.Preferably, selection has water-proof function, small volume, resolution ratio
High, high life and the video camera with universal communication interface etc..
It is appreciated that the acquisition equipment 50 can be including picture pick-up device 501 and/or sound pick-up outfit 502 and/or sensing
The electronic equipment of equipment 503, it may for example comprise intelligent KTV, intelligent access control system, the smart phone of built-in camera and recorder
Deng alternatively, the acquisition equipment 50 can be independent picture pick-up device 501 or sound pick-up outfit 502, for example, the security protection in cell
Monitoring.In some embodiments, independent picture pick-up device 501 or sound pick-up outfit 502 are used for root also with the sensing equipment 503
According to the physical signal that the sensing equipment 503 acquires, controls the picture pick-up device 501 or sound pick-up outfit 502 enters preset work
Operation mode (for example, open and close of the picture pick-up device 501 or sound pick-up outfit 502).
Fig. 3 is referred to, Fig. 3 is a kind of flow diagram of multimedia document retrieval method provided in an embodiment of the present invention.
As shown in figure 3, the multimedia document retrieval method is applied to Network Attached Storage, comprising:
S11: receiving retrieval information, and the retrieval information includes image information.
It is appreciated that the Network Attached Storage includes data transmit-receive module, it is arranged on the Network Attached Storage
There is listening port, the listening port is connect with the gateway, receives the retrieval information from terminal device, and be stored in net
In the memory of network annex storage.
S13: image classification information is determined according to described image information.
As shown in figure 4, step S13 is specifically included:
S131: parsing described image information obtains the key frame in image, and the key frame includes image classification information,
Described image classification information includes: character image information, animal painting information or equipment image information.
Described image information is information provided by the attribute type or magnitude of pixel, in embodiments of the present invention, described
Image information is accurate to frame, i.e. the picture frame minimum unit that is described image information.Described image information successively passes through the figure
As input equipment, image processor, image storage system and computer network, it is eventually displayed in image output device, it is corresponding
In the network architecture provided in an embodiment of the present invention, described image information successively by the acquisition equipment, described network attached deposit
Reservoir, the gateway and the terminal device.
S132: institute is determined according to character image information, animal painting information or the equipment image information in the key frame
State the image classification information of image information.
It include key frame in described image information, the key frame includes image classification information, described image classification information
It include: character image information, animal painting information or equipment image information.In some embodiments, described image classification information
It can also include other classifications, be not limited to the present embodiment provided image classification.
It is appreciated that described image classification information be can by quickly distinguish multimedia file it is a kind of in a manner of, and image point
Category information is mostly to determine and not no doubt, for example, when needing to retrieve a certain character image information, directly from the net
The set of character image information goes lookup in network annex storage, reduces lookup more matchmakers corresponding with matching search condition
The time of body file improves the efficiency for obtaining multimedia file.
S15: retrieving the multimedia file in the Network Attached Storage according to the classification information, obtain with
The matched multimedia file of classification information.
As shown in figure 5, step S15 is specifically included:
S151: according to character image information, animal painting information or the equipment image information in the key frame to described
Character image information bank, animal painting information bank or equipment Image Database are retrieved, obtain with the character image information,
The multimedia file image information of animal painting information or equipment image information matches.
Specifically, different image classification information corresponds to different information banks, i.e., different multimedia file image informations
It is stored in different storage regions, for example, when the image information that search condition includes is the dog in certain cell, described image letter
Key frame in breath includes animal painting information, according to the animal painting information in the key frame to the animal painting information
Library is retrieved, and the multimedia file image information with the animal painting information matches is obtained, i.e., all in certain cell to move
The video clip (i.e. complete multimedia file) of object image information or image information composition.Further for example, search condition can be
Image information is the image for the dog that a certain video camera in certain cell takes or the video clip of image information composition, Ke Yili
Solution, the search condition can also include that (such as time, position, path become other restrictive conditions in addition to including image information
Change etc.), to limit the seeking scope of multimedia file image information.
S152: the multimedia file identification and image information for including according to the multimedia file image information are in more matchmakers
Timestamp in body file obtains more matchmakers with the character image information, animal painting information or equipment image information matches
Body file.
Further include multimedia file identification in order to further accurately match the multimedia file, in described image information with
And timestamp of the image information in multimedia file, in inventive embodiments, the multimedia file identification refers to file
Name can quickly position the character image information bank, animal painting information bank or equipment image information according to filename index
Associated multimedia file in library can be named in the timestamp according to described image information in multimedia file from repetition
Multiple multimedia files in or name and obtain destination multimedia file in similar multiple multimedia files, improve acquisition
Efficiency and acquisition precision.
The embodiment of the present invention also provides the flow diagram of another multimedia document retrieval method, as shown in fig. 6, described
Method further include:
S17: carrying out image fractionation to the multimedia file in the Network Attached Storage, will be in the multimedia file
Image information classification storage to character image information bank, animal painting information bank or equipment Image Database, wherein figure map
As the multimedia image information in information bank, animal painting information bank or equipment Image Database include multimedia file identification with
And timestamp of the image information in multimedia file.
Generally, the multimedia file includes multiple images, by the image in the multimedia file according to image information
Classification storage is to character image information bank, animal painting information bank or equipment Image Database.It include different figures in one image
As the object that information is classified, for example, including building, landscape, personage etc. in an image, so, which can deposit simultaneously
Be stored in different information banks, i.e., can find the image in each information bank, alternatively, by building in the image,
Landscape, personage split, and are stored respectively in different information banks, using multimedia file identification and image information more
Timestamp in media file synthesizes a complete image or the multimedia file comprising the image.
The embodiment of the present invention also provides the flow diagram of another multimedia document retrieval method, as shown in fig. 7, described
Retrieving information also includes audio-frequency information, the method also includes:
S19: retrieving the multimedia file in the Network Attached Storage according to the audio-frequency information, obtain with
The matched multimedia file of audio-frequency information.
As shown in figure 8, step S19 is specifically included:
S191: according to personage's acoustic information or animal sounds information to personage's acoustic information library, animal sounds
Information bank is retrieved, and is obtained and is believed with the multimedia file sound of personage's acoustic information library or animal sounds information matches
Breath.
S192: the multimedia file identification and acoustic information for including according to the multimedia file acoustic information are in more matchmakers
Timestamp in body file obtains the multimedia file with personage's acoustic information or animal sounds information matches.
S21: carrying out audio fractionation to the multimedia file in the Network Attached Storage, will be in the multimedia file
Audio-frequency information classification storage to personage's acoustic information library or animal sounds information bank, wherein personage's acoustic information library or animal
Multimedia audio information in acoustic information library include multimedia file identification and acoustic information in multimedia file when
Between stab.
Multimedia document retrieval method provided in an embodiment of the present invention retrieves information by receiving, and the retrieval information includes
Image information determines image classification information according to described image information, according to the classification information to the network attached storage
Multimedia file in device is retrieved, acquisition and the matched multimedia file of the classification information, to realize quick, smart
Destination multimedia file is obtained quasi-ly.
Referring to Fig. 9, Fig. 9 is a kind of structural schematic diagram of multimedia document retrieval device provided in an embodiment of the present invention.
As shown in figure 9, the multimedia document retrieval device 300 is applied to Network Attached Storage, described device 300 includes:
Receiving module 301, for receiving retrieval information, the retrieval information includes image information.
Determining module 302, for determining image classification information according to described image information.
In embodiments of the present invention, the determining module 302 is specifically used for: parsing described image information obtains in image
Key frame, the key frame include image classification information, described image classification information include: character image information, animal figure
As information or equipment image information；According to character image information, animal painting information or the equipment image letter in the key frame
Cease the image classification information for determining described image information.
First obtains module 303, for literary to the multimedia in the Network Attached Storage according to the classification information
Part is retrieved, and is obtained and the matched multimedia file of the classification information.
In embodiments of the present invention, described first module 303 is obtained specifically for according to the figure map in the key frame
As information, animal painting information or equipment image information are to the character image information bank, animal painting information bank or equipment drawing
As information bank is retrieved, more matchmakers with the character image information, animal painting information or equipment image information matches are obtained
Body document image information；The multimedia file identification and image information for including according to the multimedia file image information are more
Timestamp in media file is obtained more with the character image information, animal painting information or equipment image information matches
Media file.
The embodiment of the present invention also provides the structural schematic diagram of another multimedia document retrieval device, as shown in Figure 10, institute
State device 300 further include:
First splits module 304, will for carrying out image fractionation to the multimedia file in the Network Attached Storage
Image information classification storage to character image information bank, animal painting information bank or equipment image in the multimedia file is believed
Cease library, wherein the multimedia image information in character image information bank, animal painting information bank or equipment Image Database includes
The timestamp of multimedia file identification and image information in multimedia file.
The embodiment of the present invention also provides the structural schematic diagram of another multimedia document retrieval device, as shown in figure 11, institute
Stating retrieval information also includes audio-frequency information, described device 300 further include:
Second obtains module 305, for literary to the multimedia in the Network Attached Storage according to the audio-frequency information
Part is retrieved, and is obtained and the matched multimedia file of the audio-frequency information.
In embodiments of the present invention, the second acquisition module 305 is specifically used for according to personage's acoustic information or moves
Object acoustic information retrieves personage's acoustic information library, animal sounds information bank, obtains and personage's acoustic information
The multimedia file acoustic information of library or animal sounds information matches；The more matchmakers for including according to the multimedia file acoustic information
The timestamp of body file identification and acoustic information in multimedia file obtains and personage's acoustic information or animal sounds
The multimedia file of information matches.
The audio-frequency information includes personage's acoustic information or animal sounds information, described device 300 further include:
Second splits module 306, will for carrying out audio fractionation to the multimedia file in the Network Attached Storage
Audio-frequency information classification storage in the multimedia file is to personage's acoustic information library or animal sounds information bank, wherein personage
Multimedia audio information in acoustic information library or animal sounds information bank includes that multimedia file identification and acoustic information exist
Timestamp in multimedia file.
Since Installation practice and above-mentioned each embodiment are based on same design, in the not mutual conflicting premise of content
Under, the content of Installation practice can quote the content of above-mentioned each embodiment, and this will not be repeated here.
Figure 12 is a kind of structural schematic diagram of Network Attached Storage provided in an embodiment of the present invention, the network attached storage
Device 500 includes:
One or more processors 510 and memory 520, in Figure 12 by taking a processor 510 as an example.
Processor 510 can be connected with memory 520 by bus or other modes, to be connected by bus in Figure 12
For.
Memory 520 is used as a kind of non-volatile computer readable storage medium storing program for executing, can be used for storing non-volatile software journey
Sequence, non-volatile computer executable program and module, as the multimedia document retrieval method in the embodiment of the present invention is corresponding
Program instruction/module.Processor 510 by operation be stored in memory 520 non-volatile software program, instruction and
Module realizes more matchmakers of above method embodiment thereby executing the various function application and data processing of the user terminal
Body document retrieval method.
Memory 520 may include storing program area and storage data area, wherein storing program area can store operation system
Application program required for system, at least one function；Storage data area can be stored is created according to using for Network Attached Storage
The data etc. built.In addition, memory 520 may include high-speed random access memory, it can also include nonvolatile memory,
A for example, at least disk memory, flush memory device or other non-volatile solid state memory parts.In some embodiments,
Optional memory 520 includes the memory remotely located relative to processor 510, these remote memories can be connected by network
It is connected to Network Attached Storage.The example of above-mentioned network includes but is not limited to internet, intranet, local area network, moves and lead to
Letter net and combinations thereof.
One or more of modules are stored in the memory 520, when by one or more of processors
When 510 execution, the multimedia document retrieval method in above-mentioned any means embodiment is executed, for example, executing Fig. 3 described above
In method and step S11 to step S15, realize Fig. 9 in unit 301-303 function.
Method provided by the embodiment of the present invention can be performed in the said goods, has the corresponding functional module of execution method and has
Beneficial effect.The not technical detail of detailed description in the present embodiment, reference can be made to method provided by the embodiment of the present invention.
The embodiment of the invention also provides a kind of non-volatile computer readable storage medium storing program for executing, the computer-readable storage
Media storage has computer executable instructions, which is executed by one or more processors, such as Figure 12
In a processor 510, may make said one or multiple processors that more matchmakers in above-mentioned any means embodiment can be performed
Body document retrieval method, for example, executing above description executes the method and step S11 in Fig. 7 described above to step S21, it is real
The function of unit 301-306 in existing Figure 11.
Method provided by the embodiment of the present invention can be performed in the said goods, has the corresponding functional module of execution method and has
Beneficial effect.The not technical detail of detailed description in the present embodiment, reference can be made to method provided by the embodiment of the present invention.
The apparatus embodiments described above are merely exemplary, wherein described, unit can as illustrated by the separation member
It is physically separated with being or may not be, component shown as a unit may or may not be physics list
Member, it can it is in one place, or may be distributed over multiple network units.It can be selected according to the actual needs
In some or all of the modules achieve the purpose of the solution of this embodiment.
Through the above description of the embodiments, those of ordinary skill in the art can be understood that each embodiment
The mode of general hardware platform can be added to realize by software, naturally it is also possible to pass through hardware.Those of ordinary skill in the art can
With understand all or part of the process realized in above-described embodiment method be can be instructed by computer program it is relevant hard
Part is completed, and the program can be stored in a computer-readable storage medium, the program is when being executed, it may include as above
State the process of the embodiment of each method.Wherein, the storage medium can be magnetic disk, CD, read-only memory (Read-
Only Memory, ROM) or random access memory (Random Access Memory, RAM) etc..
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；At this
It under the thinking of invention, can also be combined between the technical characteristic in above embodiments or different embodiment, step can be with
It is realized with random order, and there are many other variations of different aspect present invention as described above, for simplicity, they do not have
Have and is provided in details；Although the present invention is described in detail referring to the foregoing embodiments, the ordinary skill people of this field
Member is it is understood that it is still possible to modify the technical solutions described in the foregoing embodiments, or to part of skill
Art feature is equivalently replaced；And these are modified or replaceed, each reality of the present invention that it does not separate the essence of the corresponding technical solution
Apply the range of a technical solution.
Claims (12)
1. a kind of multimedia document retrieval method is applied to Network Attached Storage, which is characterized in that the described method includes:
Retrieval information is received, the retrieval information includes image information；
Image classification information is determined according to described image information；
The multimedia file in the Network Attached Storage is retrieved according to the classification information, is obtained and the classification
The multimedia file of information matches.
2. the method according to claim 1, wherein described determine image classification information according to described image information
Include:
Described image information is parsed, the key frame in image is obtained, the key frame includes image classification information, described image point
Category information includes: character image information, animal painting information or equipment image information；
Described image information is determined according to character image information, animal painting information or the equipment image information in the key frame
Image classification information.
3. according to the method described in claim 2, it is characterized in that, the method also includes:
Image fractionation is carried out to the multimedia file in the Network Attached Storage, the image in the multimedia file is believed
Classification storage is ceased to character image information bank, animal painting information bank or equipment Image Database, wherein character image information
Multimedia image information in library, animal painting information bank or equipment Image Database includes multimedia file identification and image
Timestamp of the information in multimedia file.
4. according to the method described in claim 3, it is characterized in that, according to the classification information to the Network Attached Storage
In multimedia file retrieved, obtain and with the matched multimedia file of the classification information include:
The character image is believed according to character image information, animal painting information or the equipment image information in the key frame
Breath library, animal painting information bank or equipment Image Database are retrieved, and are obtained and are believed with the character image information, animal painting
The multimedia file image information of breath or equipment image information matches；
The multimedia file identification and image information for including according to the multimedia file image information are in multimedia file
Timestamp, obtain with the character image information, animal painting information or equipment image information matches multimedia file.
5. method according to claim 1-4, which is characterized in that the retrieval information also includes audio-frequency information,
The method also includes:
The multimedia file in the Network Attached Storage is retrieved according to the audio-frequency information, is obtained and the audio
The multimedia file of information matches.
6. according to the method described in claim 5, it is characterized in that, the audio-frequency information includes personage's acoustic information or animal sound
Message breath, the method also includes:
Audio fractionation is carried out to the multimedia file in the Network Attached Storage, the audio in the multimedia file is believed
Classification storage is ceased to personage's acoustic information library or animal sounds information bank, wherein personage's acoustic information library or animal sounds information
Multimedia audio information in library includes the timestamp of multimedia file identification and acoustic information in multimedia file；
It is described that the multimedia file in the Network Attached Storage is retrieved according to the audio-frequency information, obtain with it is described
The matched multimedia file of audio-frequency information includes:
Personage's acoustic information library, animal sounds information bank are carried out according to personage's acoustic information or animal sounds information
Retrieval obtains the multimedia file acoustic information with personage's acoustic information library or animal sounds information matches；
The multimedia file identification and acoustic information for including according to the multimedia file acoustic information are in multimedia file
Timestamp, obtain the multimedia file with personage's acoustic information or animal sounds information matches.
7. a kind of multimedia document retrieval device, it is applied to Network Attached Storage, which is characterized in that described device includes:
Receiving module, for receiving retrieval information, the retrieval information includes image information；
Determining module, for determining image classification information according to described image information；
First obtains module, for being examined according to the classification information to the multimedia file in the Network Attached Storage
Rope obtains and the matched multimedia file of the classification information.
8. device according to claim 7, which is characterized in that the determining module is specifically used for:
Described image information is parsed, the key frame in image is obtained, the key frame includes image classification information, described image point
Category information includes: character image information, animal painting information or equipment image information；
Described image information is determined according to character image information, animal painting information or the equipment image information in the key frame
Image classification information.
9. device according to claim 7, which is characterized in that described device further include:
First splits module, will be described more for carrying out image fractionation to the multimedia file in the Network Attached Storage
Image information classification storage in media file to character image information bank, animal painting information bank or equipment Image Database,
Wherein, the multimedia image information in character image information bank, animal painting information bank or equipment Image Database includes more matchmakers
The timestamp of body file identification and image information in multimedia file.
10. device according to claim 7, which is characterized in that the first acquisition module is specifically used for:
The character image is believed according to character image information, animal painting information or the equipment image information in the key frame
Breath library, animal painting information bank or equipment Image Database are retrieved, and are obtained and are believed with the character image information, animal painting
The multimedia file image information of breath or equipment image information matches；
The multimedia file identification and image information for including according to the multimedia file image information are in multimedia file
Timestamp, obtain with the character image information, animal painting information or equipment image information matches multimedia file.
11. device according to claim 7, which is characterized in that the retrieval information also includes audio-frequency information, described device
Further include:
Second obtains module, for being examined according to the audio-frequency information to the multimedia file in the Network Attached Storage
Rope obtains and the matched multimedia file of the audio-frequency information.
12. device according to claim 11, which is characterized in that the audio-frequency information includes personage's acoustic information or animal
Acoustic information, described device further include:
Second splits module, will be described more for carrying out audio fractionation to the multimedia file in the Network Attached Storage
Audio-frequency information classification storage in media file is to personage's acoustic information library or animal sounds information bank, wherein personage's sound letter
Ceasing the multimedia audio information in library or animal sounds information bank includes multimedia file identification and acoustic information in multimedia
Timestamp in file；
The second acquisition module is specifically used for:
Personage's acoustic information library, animal sounds information bank are carried out according to personage's acoustic information or animal sounds information
Retrieval obtains the multimedia file acoustic information with personage's acoustic information library or animal sounds information matches；
The multimedia file identification and acoustic information for including according to the multimedia file acoustic information are in multimedia file
Timestamp, obtain the multimedia file with personage's acoustic information or animal sounds information matches.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811108846.1A CN109446356A (en) | 2018-09-21 | 2018-09-21 | A kind of multimedia document retrieval method and device |
| PCT/CN2019/103769 WO2020057347A1 (en) | 2018-09-21 | 2019-08-30 | Multimedia file retrieval method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811108846.1A CN109446356A (en) | 2018-09-21 | 2018-09-21 | A kind of multimedia document retrieval method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109446356A true CN109446356A (en) | 2019-03-08 |
Family
ID=65530683
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811108846.1A Pending CN109446356A (en) | 2018-09-21 | 2018-09-21 | A kind of multimedia document retrieval method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109446356A (en) |
| WO (1) | WO2020057347A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020057347A1 (en) * | 2018-09-21 | 2020-03-26 | 深圳市九洲电器有限公司 | Multimedia file retrieval method and apparatus |
| CN111666262A (en) * | 2020-05-28 | 2020-09-15 | 重庆渝抗医药科技有限公司 | Working method for extracting feature points of massive medical images in network attached storage NAS state |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050132269A1 (en) * | 2003-12-10 | 2005-06-16 | Siemens Corporate Research, Inc. | Method for retrieving image documents using hierarchy and context techniques |
| KR100680209B1 (en) * | 2005-11-04 | 2007-02-08 | 엘지전자 주식회사 | Mobile communication terminal enable to manage of data for tag and its operating method |
| CN101339558A (en) * | 2008-06-19 | 2009-01-07 | 北京中星微电子有限公司 | Digital photo frame and its image display method |
| CN101751404A (en) * | 2008-12-12 | 2010-06-23 | 金宝电子工业股份有限公司 | Classification method of multimedia files |
| CN102402621A (en) * | 2011-12-27 | 2012-04-04 | 浙江大学 | Image retrieval method based on image classification |
| CN103530652A (en) * | 2013-10-23 | 2014-01-22 | 北京中视广信科技有限公司 | Face clustering based video categorization method and retrieval method as well as systems thereof |
| KR101641942B1 (en) * | 2015-12-15 | 2016-07-25 | 한경대학교 산학협력단 | Flower name search system and method |
| CN106055570A (en) * | 2016-05-19 | 2016-10-26 | 中国农业大学 | Video retrieval device based on audio data and video retrieval method for same |
| CN107766571A (en) * | 2017-11-08 | 2018-03-06 | 北京大学 | The search method and device of a kind of multimedia resource |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102207966B (en) * | 2011-06-01 | 2013-07-10 | 华南理工大学 | Video content quick retrieving method based on object tag |
| CN103035247B (en) * | 2012-12-05 | 2017-07-07 | 北京三星通信技术研究有限公司 | Based on the method and device that voiceprint is operated to audio/video file |
| US9201958B2 (en) * | 2013-10-24 | 2015-12-01 | TCL Research America Inc. | Video object retrieval system and method |
| US20170139933A1 (en) * | 2015-11-18 | 2017-05-18 | Le Holdings (Beijing) Co., Ltd. | Electronic Device, And Computer-Readable Storage Medium For Quickly Searching Video Segments |
| CN105611413B (en) * | 2015-12-24 | 2018-10-02 | 小米科技有限责任公司 | A kind of method and apparatus of addition video-frequency band category label |
| CN109446356A (en) * | 2018-09-21 | 2019-03-08 | 深圳市九洲电器有限公司 | A kind of multimedia document retrieval method and device |
-
2018
- 2018-09-21 CN CN201811108846.1A patent/CN109446356A/en active Pending
-
2019
- 2019-08-30 WO PCT/CN2019/103769 patent/WO2020057347A1/en active Application Filing
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050132269A1 (en) * | 2003-12-10 | 2005-06-16 | Siemens Corporate Research, Inc. | Method for retrieving image documents using hierarchy and context techniques |
| KR100680209B1 (en) * | 2005-11-04 | 2007-02-08 | 엘지전자 주식회사 | Mobile communication terminal enable to manage of data for tag and its operating method |
| CN101339558A (en) * | 2008-06-19 | 2009-01-07 | 北京中星微电子有限公司 | Digital photo frame and its image display method |
| CN101751404A (en) * | 2008-12-12 | 2010-06-23 | 金宝电子工业股份有限公司 | Classification method of multimedia files |
| CN102402621A (en) * | 2011-12-27 | 2012-04-04 | 浙江大学 | Image retrieval method based on image classification |
| CN103530652A (en) * | 2013-10-23 | 2014-01-22 | 北京中视广信科技有限公司 | Face clustering based video categorization method and retrieval method as well as systems thereof |
| KR101641942B1 (en) * | 2015-12-15 | 2016-07-25 | 한경대학교 산학협력단 | Flower name search system and method |
| CN106055570A (en) * | 2016-05-19 | 2016-10-26 | 中国农业大学 | Video retrieval device based on audio data and video retrieval method for same |
| CN107766571A (en) * | 2017-11-08 | 2018-03-06 | 北京大学 | The search method and device of a kind of multimedia resource |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020057347A1 (en) * | 2018-09-21 | 2020-03-26 | 深圳市九洲电器有限公司 | Multimedia file retrieval method and apparatus |
| CN111666262A (en) * | 2020-05-28 | 2020-09-15 | 重庆渝抗医药科技有限公司 | Working method for extracting feature points of massive medical images in network attached storage NAS state |
| CN111666262B (en) * | 2020-05-28 | 2021-06-22 | 重庆中联信息产业有限责任公司 | Working method for extracting feature points of massive medical images in network attached storage NAS state |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020057347A1 (en) | 2020-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6894534B2 (en) | Information processing method and terminal, computer storage medium | |
| US10970334B2 (en) | Navigating video scenes using cognitive insights | |
| US20200226133A1 (en) | Knowledge map building system and method | |
| CN105938477B (en) | For integrating and the method and system of format search result | |
| CN110458360B (en) | Method, device, equipment and storage medium for predicting hot resources | |
| CN108319723A (en) | A kind of picture sharing method and device, terminal, storage medium | |
| KR20100002756A (en) | Matrix blogging system and service support method thereof | |
| US20170212886A1 (en) | Configurable Generic Language Understanding Models | |
| CN110765301B (en) | Picture processing method, device, equipment and storage medium | |
| US9881232B2 (en) | Viewpoints of a point of interest | |
| CN107315833A (en) | Method and apparatus of the retrieval with downloading based on application program | |
| CN115114395A (en) | Content retrieval and model training method and device, electronic equipment and storage medium | |
| CN111191133B (en) | Service search processing method, device and equipment | |
| CN109446356A (en) | A kind of multimedia document retrieval method and device | |
| KR101479260B1 (en) | Method for searching closeness between people based on photos | |
| CN113779261B (en) | Quality evaluation method and device of knowledge graph, computer equipment and storage medium | |
| US20150035836A1 (en) | Data display and data display method | |
| CN116186197A (en) | Topic recommendation method, device, electronic equipment and storage medium | |
| CN114282587A (en) | Data processing method and device, computer equipment and storage medium | |
| CN106777066B (en) | Method and device for image recognition and media file matching | |
| CN111797175A (en) | Data storage method and device, storage medium and electronic equipment | |
| Bhati et al. | Interactive visualization and capture of geo-coded multimedia data on mobile devices | |
| CN110516024A (en) | Map search result shows method, apparatus, equipment and storage medium | |
| CN113869516B (en) | Knowledge graph embedded model training method and device, electronic equipment and medium | |
| CN114510591B (en) | Digital image generating and typesetting system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190308 |
|
| RJ01 | Rejection of invention patent application after publication |