CN102117304B - Image searching device, searching system and searching method - Google Patents

Image searching device, searching system and searching method Download PDF

Info

Publication number
CN102117304B
CN102117304B CN 200910312906 CN200910312906A CN102117304B CN 102117304 B CN102117304 B CN 102117304B CN 200910312906 CN200910312906 CN 200910312906 CN 200910312906 A CN200910312906 A CN 200910312906A CN 102117304 B CN102117304 B CN 102117304B
Authority
CN
China
Prior art keywords
image
time
shelves
sound
index
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 200910312906
Other languages
Chinese (zh)
Other versions
CN102117304A (en
Inventor
范朝宗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zhongcai Wyse Education Technology Co ltd
Nantong Create Industrial Co ltd
Original Assignee
Hongfujin Precision Industry Shenzhen Co Ltd
Hon Hai Precision Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hongfujin Precision Industry Shenzhen Co Ltd, Hon Hai Precision Industry Co Ltd filed Critical Hongfujin Precision Industry Shenzhen Co Ltd
Priority to CN 200910312906 priority Critical patent/CN102117304B/en
Publication of CN102117304A publication Critical patent/CN102117304A/en
Application granted granted Critical
Publication of CN102117304B publication Critical patent/CN102117304B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Television Signal Processing For Recording (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention discloses an image searching device comprising monitoring equipment and an image searching system, wherein the monitoring equipment is used for shooting the images in the monitoring range in real time, recording the sound in the monitoring range and forming a sound file and an image file corresponding to each other on time; the image searching system is used for reading the sound file and the image file sequentially from the starting point of the set time, and judging whether an acoustical signal of the sound file is larger than a decibel value set in advance or not; when the acoustical signal of the sound file is larger than the decibel value set in advance, the position is recorded to be taken as the index time for searching the image; and by taking the index time as the reference, the image in image file corresponding to a set time slot corresponding to the index time is intercepted to be taken as the range of the image needed, and the image intercepted is stored. The invention also provides an image searching system and a searching method. The image searching device, the searching system, and the searching method can enable a user to obtain the image needed conveniently and fast.

Description

Image searcher, search system and searching method
Technical field
The present invention relates to a kind of image searcher, search system and searching method.
Background technology
At present, in various supervisory systems, the captured image of the first-class watch-dog of making a video recording only carries out record with date, time, file type as index mostly, so that the user can determine which image of priority check.But when the quantity of information of image is very large, and captured image mostly is greatly the image of picture still, and the picture that has often the personage to occur that the user need search for, like this, only depend on take date, time, file type as the above-mentioned common querying method of index and just be difficult to find the person image that the user need search, sometimes even will browse complete image shelves and just can obtain, it is also extremely low so to search the time that spends efficient many, that search.
Summary of the invention
In view of above content, be necessary the image searcher, search system and the searching method that provide a kind of user of making to obtain quickly and easily required image.
A kind of image searcher comprises a watch-dog, is used for taking in real time image in the monitoring range and the sound in the lower monitoring range of record, and forms on the time one to one sound shelves and image shelves; An and image search system, be used for beginning to read in turn described sound shelves and image shelves from the setting-up time starting point, and whether the voice signal of judging the sound shelves read is greater than a predefined decibel value, at the voice signal of the sound shelves that read during greater than a predefined decibel value, record this and sentence index time as the search image; Take the index time as reference, intercept image in the corresponding image shelves of a setting-up time section corresponding with the index time as the scope of required image, and truncated picture stored.
A kind of image search system, comprise an audio and video file read module, be used for beginning to read in turn sound shelves and image shelves from the setting-up time starting point, and judge that start time is whether greater than maximum time of sound shelves, if, then finishing, described sound shelves comprise the corresponding voice signal of sound that a hummer sends and the watch-dog voice signal under recording, described image shelves comprise the image that described watch-dog is captured, and described image shelves are corresponding one by one in time with described sound shelves; Module set up in one index, and whether the voice signal that is used for judging the sound shelves, if then being judged as is the sound that described hummer sends and records this and sentence as the index time of searching for image greater than a predefined decibel value; An and image collection module, be used for take the index time as reference, intercept image in the corresponding image shelves of a setting-up time section corresponding with the index time as the scope of required image, and with the truncated picture storage, added the duration of setting-up time section continues the voice signal of sound shelves is processed as new start time the index time.
A kind of image searching method may further comprise the steps:
Begin to read sound shelves and image shelves from the setting-up time starting point; Described sound shelves comprise the corresponding voice signal of sound that a hummer sends and the watch-dog voice signal under recording, and described image shelves comprise the image that described watch-dog is captured, and described image shelves are corresponding one by one in time with described sound shelves;
Judge that start time is whether greater than maximum time of sound shelves, if then finish;
Judge that whether the voice signal of sound shelves is greater than predefined a certain decibel value, if not, then return and carry out the step that begins to read sound shelves and image shelves from the setting-up time starting point, if, then being judged as is the sound that described hummer sends, and record this sentence as the search image the index time, take the index time as reference, intercept image in the corresponding image shelves of a setting-up time section corresponding with the index time as the scope of required image, and truncated picture is stored; And
Added the duration of setting-up time section the index time as new start time, return and carry out the step that begins to read sound shelves and image shelves from the setting-up time starting point.
Image searcher of the present invention, search system and searching method can judge that whether the voice signal of the sound shelves read is greater than a certain decibel value according to time sequencing, at the voice signal of the sound shelves that read during greater than a predefined decibel value, record this and sentence index time as the search image; And take the index time as reference, intercept image in the corresponding image shelves of a setting-up time section corresponding with the index time as the scope of required image, and with the truncated picture storage, thereby can so that the user can obtain required image quickly and easily, save the user search time.
Description of drawings
Fig. 1 is the Organization Chart of the preferred embodiments of image searcher of the present invention.
Fig. 2 is the block diagram of the preferred embodiments of image search system of the present invention.
Fig. 3 is the image that records of the image search system of Fig. 2 and the synoptic diagram of sound waveform.
Fig. 4 is the process flow diagram of the preferred embodiments of image searching method of the present invention.
The main element symbol description
Watch-dog 10
Inductor 20
Hummer 30
The image search system 40
The audio and video file read module 402
Module set up in index 404
Image collection module 406
Embodiment
As shown in Figure 1 to Figure 3, image searcher of the present invention can make the user obtain quickly and easily required image, and present embodiment is used in the gate control system so that the image that the user obtains the personage front quickly and easily describes as example take the image searcher.Image searcher preferred embodiments of the present invention comprises a watch-dog 10, an inductor 20, a hummer 30 and an image search system 40.Described inductor 20, hummer 30 and image search system 40 all link to each other with described watch-dog 10, and described hummer 30 also links to each other with described inductor 20 and image search system 40.In the present embodiment, watch-dog 10 can be video camera, the first-class equipment that can filmed image of shooting.Image search system 40 is located in the monitoring host computer.In other embodiments, inductor 20 and hummer 30 also can be arranged at the inside of watch-dog 10.
Described watch-dog 10 is arranged on the doorway of a gate control system, is used for taking in real time the image of (in the scope of doorway) in the monitoring range and the sound in the lower monitoring range of record.Sound in described inductor 20 is used for enclosing in the induction monitor scope, the sound that is opened of door for example, and after door is opened a period of time, for example 2 seconds, this moment, common people were from entering outdoors in the monitoring range, then started described hummer 30 and sounded, as send " serge serge " two and note to cause into interior person, enter interior person this moment and generally can come back and check to search for the source of sound, then this moment, watch-dog 10 just can photograph very clearly people's face front image.And (such as the protruding ripple S1 of voice signal) is higher for the protruding ripple of the waveform of the sound that hummer 30 sends, the protruding ripple (such as the protruding ripple of one section voice signal S2) of the sound under watch-dog 10 was recorded after the people entered in the monitoring range is relatively low, and the waveform of the sound under watch-dog 10 is recorded during still frame in nobody enters monitoring range is relatively mild.Voice signal under the corresponding voice signal of the sound that hummer 30 sends and watch-dog 10 are recorded is sent in real time as the image shelves as sound shelves and watch-dog 10 captured images and stores in the monitoring host computer, and image shelves and sound shelves are one by one corresponding (as shown in Figure 3) in time, searches for personage's direct picture to make things convenient for image search system 40.In the present embodiment, the time span of the image shelves of each sound shelves and correspondence is 2 hours.
Image search system 40 comprises that an audio and video file read module 402, an index set up module 404 and an image collection module 406.
Described audio and video file read module 402 is used for beginning to read in turn sound shelves and the image shelves of storing in the monitoring host computer from the setting-up time starting point, also comprise the maximum time of reading sound shelves and image shelves, be the information such as time of sound shelves and image shelves end position, and judge that start time is whether greater than maximum time (being the time of sound shelves end position) of sound shelves, if then finish.
Described index is set up module 404 and is used for judging that according to time sequencing whether the voice signal of the sound shelves that read is greater than predefined a certain decibel value, for example 60 decibels, if, then being judged as is the sound that hummer 30 sends, and record herein (such as the protruding ripple S1 place of voice signal) with as the index time of searching for image.This mainly is because the sound that sends of hummer 30 is usually more loud than the monitoring environment, so the decibel value of the corresponding voice signal of sound that sends of hummer 30 is also larger, so protruding ripple corresponding to its sound signal waveform is higher.
Described image collection module 406 be used for take the index time as starting point, the intercepting index after the time image in the corresponding image shelves of a setting-up time section (such as the image of index one section corresponding image shelves of voice signal S2 of 1 minute scope after the time) as the required image scope of personage's direct picture for example, and with the truncated picture storage, the scope of dwindling retrieval when being beneficial to the subsequent user retrieval.The length user of described setting-up time section can set as required.Described image collection module 406 adds the index time that the duration of setting-up time section continues the voice signal of sound shelves is processed as new start time again.
The below lifts an example and describes the process that required personage front image is obtained in image search system search of the present invention:
When the someone starts a gate control system by swiping the card, after door was opened 2 seconds, watch-dog 10 started hummers 30 and sends " serge serge " two and notice that to cause into interior person this moment, watch-dog 10 just can photograph very clearly people's face front image.Voice signal under the corresponding voice signal of " serge serge " sound that hummer 30 sends and watch-dog 10 are recorded is sent in real time as the image shelves as sound shelves and watch-dog 10 captured images and stores in the monitoring host computer, and image shelves and sound shelves are one by one corresponding (as shown in Figure 3) in time, searches for personage's direct picture to make things convenient for image search system 40.Audio and video file read module 402 begins to read in turn sound shelves and the image shelves of storing in the monitoring host computer from the setting-up time starting point.Judge that start time is whether greater than maximum time (being the time of sound shelves end position) of the sound shelves that read, if, then finish, if not, then whether index sets up voice signal that module 404 judges the sound shelves that read greater than predefined a certain decibel value, and for example 60 decibels, if, then being judged as is the sound that hummer 30 sends, and record herein (such as the protruding ripple S1 place of voice signal) with as the index time of searching for image.Image collection module 406 be used for take the index time as starting point, the intercepting index after the time image in the corresponding image shelves of a setting-up time section (such as the image of index one section corresponding image shelves of voice signal S2 of 1 minute scope after the time) and truncated picture stored as the scope of personage's direct picture.Image collection module 406 adds the index time that the duration of setting-up time section continues the voice signal of sound shelves is processed as new start time again.
As shown in Figure 4, image searching method of the present invention can make the user obtain quickly and easily required image, and its preferred embodiments may further comprise the steps:
Step S100, described audio and video file read module 402 begins to read sound shelves and the image shelves corresponding with the sound shelves of storing in the monitoring host computer from the setting-up time starting point, also comprise the maximum time of reading sound shelves and image shelves, i.e. the information such as time of sound shelves and image shelves end position.During beginning, described audio and video file read module 402 begins to read from the start time of sound shelves.
Step S102, described audio and video file read module 402 judge start time whether greater than maximum time (being the time of sound shelves end position) of sound shelves, if, then finish, if not, execution in step S104 then.
Whether step S104, described index set up voice signal that module 404 judges the sound shelves greater than predefined a certain decibel value, and for example 60 decibels, if (such as the protruding ripple S1 place of voice signal), execution in step S106 then, if not, execution in step S100 then.
Step S106, it is the sound that hummer 30 sends that described index sets up that module 404 is judged as, and record herein (the protruding ripple S1 place of voice signal) with as the index time of searching for image, described image collection module 406 take the index time as starting point, intercept in turn index after the time image in the corresponding image shelves of a setting-up time section (such as the image of index one section corresponding image shelves of voice signal S2 of 1 minute scope after the time) as the required image scope of personage's direct picture for example, and with the truncated picture storage, the scope of dwindling retrieval when being beneficial to the subsequent user retrieval.
Step S108, described image collection module 406 adds the index time duration of setting-up time section as new start time, returns execution in step S100.
Sound shelves in the image search system of the present invention and image shelves also can synthesize an audio and video file, judge whether the voice signal of audio and video file determines the index time greater than predefined a certain decibel value.Also can not establish hummer 30 in other embodiments, the issuable sound deterministic retrieval time in the time of can occuring according to event in the monitoring range, also can intercept index before the time or comprise image in the corresponding image shelves of a setting-up time section of index time.
Image search system of the present invention and image searching method method can make the user obtain quickly and easily personage front image information, save the user search time, improve search efficiency.Image search system of the present invention also can be used for other field, such as the traffic hazard of monitoring on the highway etc.

Claims (7)

1. image searcher comprises:
One watch-dog is used for taking in real time image in the monitoring range and the sound in the lower monitoring range of record, and forms on the time one to one sound shelves and image shelves; And
One image search system, be used for beginning to read in turn described sound shelves and image shelves from the setting-up time starting point, judge that also start time is whether greater than maximum time of sound shelves, if, then finish, and whether the voice signal of judging the sound shelves read greater than a predefined decibel value, at the voice signal of the sound shelves that read during greater than a predefined decibel value, records this and sentences index time as the search image; Take the index time as reference, intercept image in the corresponding image shelves of a setting-up time section corresponding with the index time as the scope of required image, and with the truncated picture storage, also added that the duration of setting-up time section continues the voice signal of sound shelves is processed as new start time the index time.
2. image searcher as claimed in claim 1, it is characterized in that: described watch-dog is arranged on the doorway of a gate control system, described image searcher also comprises an inductor and a hummer, described inductor is used for the sound that induction door is opened, and after door is opened a period of time, starts described hummer and sound.
3. image search system comprises:
One audio and video file read module, be used for beginning to read in turn sound shelves and image shelves from the setting-up time starting point, and judge that start time is whether greater than maximum time of sound shelves, if, then finish, described sound shelves comprise the corresponding voice signal of sound that a hummer sends and the watch-dog voice signal under recording, and described image shelves comprise the image that described watch-dog is captured, and described image shelves are corresponding one by one in time with described sound shelves;
Module set up in one index, and whether the voice signal that is used for judging the sound shelves, if then being judged as is the sound that described hummer sends and records this and sentence as the index time of searching for image greater than a predefined decibel value; And
One image collection module, be used for take the index time as reference, intercept image in the corresponding image shelves of a setting-up time section corresponding with the index time as the scope of required image, and with the truncated picture storage, added the duration of setting-up time section continues the voice signal of sound shelves is processed as new start time the index time.
4. image search system as claimed in claim 3, it is characterized in that: described watch-dog is a camera or a video camera.
5. image searching method may further comprise the steps:
Begin to read sound shelves and image shelves from the setting-up time starting point; Described sound shelves comprise the corresponding voice signal of sound that a hummer sends and the watch-dog voice signal under recording, and described image shelves comprise the image that described watch-dog is captured, and described image shelves are corresponding one by one in time with described sound shelves;
Judge that start time is whether greater than maximum time of sound shelves, if then finish;
Judge that whether the voice signal of sound shelves is greater than predefined a certain decibel value, if not, then return and carry out the step that begins to read sound shelves and image shelves from the setting-up time starting point, if, then being judged as is the sound that described hummer sends, and record this sentence as the search image the index time, take the index time as reference, intercept image in the corresponding image shelves of a setting-up time section corresponding with the index time as the scope of required image, and truncated picture is stored; And
Added the duration of setting-up time section the index time as new start time, return and carry out the step that begins to read sound shelves and image shelves from the setting-up time starting point.
6. image searching method as claimed in claim 5, it is characterized in that: described watch-dog is a camera or a video camera.
7. image searching method as claimed in claim 5 is characterized in that: the scope of required image be take the index time as starting point, the intercepting index after the time image in the corresponding image shelves of setting-up time section obtain.
CN 200910312906 2009-12-31 2009-12-31 Image searching device, searching system and searching method Expired - Fee Related CN102117304B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200910312906 CN102117304B (en) 2009-12-31 2009-12-31 Image searching device, searching system and searching method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200910312906 CN102117304B (en) 2009-12-31 2009-12-31 Image searching device, searching system and searching method

Publications (2)

Publication Number Publication Date
CN102117304A CN102117304A (en) 2011-07-06
CN102117304B true CN102117304B (en) 2013-03-20

Family

ID=44216078

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200910312906 Expired - Fee Related CN102117304B (en) 2009-12-31 2009-12-31 Image searching device, searching system and searching method

Country Status (1)

Country Link
CN (1) CN102117304B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1249624A (en) * 1998-09-04 2000-04-05 松下电器产业株式会社 Network monitoring video camera system
CN2424590Y (en) * 2000-01-25 2001-03-21 张铁石 Acoustic controlled automatic visible intercom door bell
CN1413030A (en) * 2001-10-05 2003-04-23 艾迪斯株式会社 Telecontrol and management system
CN1490768A (en) * 2002-10-17 2004-04-21 龙星企业股份有限公司 Doorbell device with acoustic image pick and transmission
CN1716329A (en) * 2004-06-29 2006-01-04 乐金电子(沈阳)有限公司 Baby monitoring system and its method using baby's crying frequency
CN101009801A (en) * 2006-01-27 2007-08-01 智辉研发股份有限公司 A searching method of the motion film

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040167767A1 (en) * 2003-02-25 2004-08-26 Ziyou Xiong Method and system for extracting sports highlights from audio signals

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1249624A (en) * 1998-09-04 2000-04-05 松下电器产业株式会社 Network monitoring video camera system
CN2424590Y (en) * 2000-01-25 2001-03-21 张铁石 Acoustic controlled automatic visible intercom door bell
CN1413030A (en) * 2001-10-05 2003-04-23 艾迪斯株式会社 Telecontrol and management system
CN1490768A (en) * 2002-10-17 2004-04-21 龙星企业股份有限公司 Doorbell device with acoustic image pick and transmission
CN1716329A (en) * 2004-06-29 2006-01-04 乐金电子(沈阳)有限公司 Baby monitoring system and its method using baby's crying frequency
CN101009801A (en) * 2006-01-27 2007-08-01 智辉研发股份有限公司 A searching method of the motion film

Also Published As

Publication number Publication date
CN102117304A (en) 2011-07-06

Similar Documents

Publication Publication Date Title
US6687671B2 (en) Method and apparatus for automatic collection and summarization of meeting information
CN101692706B (en) Intelligent storage equipment for security monitoring
EP1536638A1 (en) Metadata preparing device, preparing method therefor and retrieving device
CN103248853B (en) Realize the method, apparatus and system of video retrieval
CN101621673A (en) Intelligent network security monitoring camera
US7446803B2 (en) Synchronous video and data annotations
US20080033983A1 (en) Data recording and reproducing apparatus and method of generating metadata
WO2003049430A2 (en) Adaptive environment system and method of providing an adaptive environment
CN101025981B (en) Digital recording system and method
KR100999655B1 (en) Digital video recorder system and application method thereof
CN101646070A (en) Novel intelligent security-protecting and monitoring method and special equipment thereof
CN102244758A (en) Video-recording-file-based data acquisition method and equipment
CN104284162A (en) Video retrieval method and system
CN104270605B (en) A kind of processing method and processing device of video monitoring data
CN103076879A (en) Multimedia interaction method and device based on face information, and terminal
US20090265165A1 (en) Automatic meta-data tagging pictures and video records
US20130120612A1 (en) Content Storage Management in Cameras
CN102929887A (en) Quick video retrieval method and system based on sound feature identification
CN104125340A (en) Generating managing method and system for call sound recording files
CN101257620A (en) Real time image and sound monitoring apparatus and controller and monitoring method thereof
CN110278398A (en) Date storage method, video clip searching method, device and electronic equipment
CN108989724A (en) Embedded video camera videotape storage means
Smeaton et al. Towards event detection in an audio-based sensor network
US20060082664A1 (en) Moving image processing unit, moving image processing method, and moving image processing program
CN102117304B (en) Image searching device, searching system and searching method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Free format text: FORMER OWNER: HONGFUJIN PRECISE INDUSTRY CO., LTD.

Effective date: 20141126

Owner name: BEIJING ZHONGCAI WYSE EDUCATION TECHNOLOGY CO., LT

Free format text: FORMER OWNER: HONGFUJIN PRECISE INDUSTRY (SHENZHEN) CO., LTD.

Effective date: 20141126

Owner name: NANTONG CHUANG'OU INDUSTRIAL CO., LTD.

Free format text: FORMER OWNER: BEIJING ZHONGCAI WYSE EDUCATION TECHNOLOGY CO., LTD.

Effective date: 20141126

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 518109 SHENZHEN, GUANGDONG PROVINCE TO: 100083 HAIDIAN, BEIJING

Free format text: CORRECT: ADDRESS; FROM: 100083 HAIDIAN, BEIJING TO: 226311 NANTONG, JIANGSU PROVINCE

TR01 Transfer of patent right

Effective date of registration: 20141126

Address after: 226311, Jiangsu, Nantong, Tongzhou District Zhang Zhen Town neighborhood committee two groups

Patentee after: Nantong create Industrial Co.,Ltd.

Address before: 100083 Beijing Haidian District Zhongguancun Road No. 18 smartfortune International Building B706

Patentee before: Beijing Zhongcai Wyse Education Technology Co.,Ltd.

Effective date of registration: 20141126

Address after: 100083 Beijing Haidian District Zhongguancun Road No. 18 smartfortune International Building B706

Patentee after: Beijing Zhongcai Wyse Education Technology Co.,Ltd.

Address before: 518109 Guangdong city of Shenzhen province Baoan District Longhua Town Industrial Zone tabulaeformis tenth East Ring Road No. 2 two

Patentee before: HONG FU JIN PRECISION INDUSTRY (SHENZHEN) Co.,Ltd.

Patentee before: HON HAI PRECISION INDUSTRY Co.,Ltd.

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130320

Termination date: 20181231

CF01 Termination of patent right due to non-payment of annual fee