CN101833584A - System and method for searching teaching video contents in embedded equipment - Google Patents
System and method for searching teaching video contents in embedded equipment Download PDFInfo
- Publication number
- CN101833584A CN101833584A CN 201010178784 CN201010178784A CN101833584A CN 101833584 A CN101833584 A CN 101833584A CN 201010178784 CN201010178784 CN 201010178784 CN 201010178784 A CN201010178784 A CN 201010178784A CN 101833584 A CN101833584 A CN 101833584A
- Authority
- CN
- China
- Prior art keywords
- outline
- video
- keyword
- module
- contents
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a system and a method for searching teaching video contents in embedded equipment. The system comprises a selection module for selecting a video outline, a storage module for storing video outline data, a processing module for extracting the video outline from the storage module and creating a video outline, and a display module for displaying video related files, wherein the selection module is connected with the display module; the processing module is connected with the display module; and the storage module is connected with the selection module. The invention provides the system and the method for searching the teaching video contents in the embedded equipment, which realize search of allowing a user to enter the contents of the teaching video content related outline by creating an outline document corresponding to the video search contents and re-identifying certain text data into texts according to the video contents.
Description
Technical field
The present invention relates to the query video field, relate in particular to the system and the method thereof of searching teaching video contents in embedded device.
Background technology
The query video of content (Content-Based Video Retrieval, CBVR) mainly be that some algorithms of utilization carry out a large amount of computings at present, thereby carrying out video features extracts (as the dominant hue of frame, dominant hue, color of object or the features such as shape, texture of camera lens, also comprise motion conditions of target in the camera motion of instruction manual or the video etc.) and then obtain automatic lens scene of certain precision (under the threshold values tolerance condition) etc. again according to different algorithms, thus set up index etc.Thereby make things convenient for the user to inquire about with regard to some scene characteristic or color motif etc.As the user " searching the from left to right camera lens of the automobile of motion " or " search video camera and push away near camera lens " etc. can be proposed.
In teaching class video, the video content of some religion formula is very long then, and the camera lens switching also substantially seldom, and tone may also compare dull.For the video in the study, we do not pay close attention to any scene at inquiry, and tone advances or lens features such as stretching, and more pay attention to the inquiry of learning content.And generally limited in view of embedded equipment CPU arithmetic capability, present arithmetic speed all can't support dynamic real-time feature extraction and contrast based on video content.
And along with the arriving of digital Age, people use the instructional video that gets more and more and use on the Embedded electronic product of carrying now.And a large amount of instructional video is used as the study teaching material.Video shelves form substantially all is the file layout of the video media stream of main flow also, such as rmvb, and avi, all kinds of forms such as fls.And this class video some can also support captions.But for instructional video, all have no idea to do inquiry easily for the content of video inside.The publisher of some videos may perhaps can be divided into long video the video of a plurality of weak points based on the consideration of directory by chapters and sections.But for single video, the content in the middle of it remains can not carry out content search.(content search described herein is not simple F.F., the seek inquiry that rewind down, progress slide block slide and to carry out), and be meant keyword according to user's input or appointment, in video according to the content of describing.And can get access to the result of inquiry according to the auxiliary outline content of video, and enumerate out the video segment of being correlated with then automatically, thus can be for consultant's direct viewing or with reference to relevant video.Thereby the full text content (not being title, theme) of instructional video can be inquired about.
Summary of the invention
In order to solve existing technical matters in the background technology, the present invention proposes the system and the method thereof of searching teaching video contents in a kind of embedded device, set up a kind of outline shelves of corresponding query video content, according to video content, some text datas are identified as text again, have realized that a kind of user of permission carries out the inquiry of the content of the relevant outline of teaching video contents.
Technical solution of the present invention is: the present invention is the system of searching teaching video contents in a kind of embedded device, and its special character is: described system comprise be used for the selecting video outline choose module, be used to store the video outline data memory module, be used for the processing module that extracts video outline and create video outline from memory module; The display module that is used for the display video associated documents; The described module of choosing is connected with display module; Described processing module is connected with display module; Described memory module with choose module and be connected.
The present invention also provides a kind of method of the system based on searching teaching video contents in the embedded device, and its special character is: said method comprising the steps of:
1) check instructional video, according to the content and the teaching purposes of instructional video, whether decision can Automatic Program extract video outline; If then Automatic Program extracts, and if not, then manually adds video outline;
2) set up the timeslice table of comparisons of outline keyword and this outline keyword and former video according to video outline;
3) set up outline keyword query table according to the outline keyword of setting up;
4) in the process of Bo Fanging, accept the keyword of user input query, and in outline keyword query table, inquire about, if this keyword in outline keyword query table, then carries out step 5);
5) locate automatically the position of carrying out instructional video according to outline keyword and the timeslice table of comparisons, realizes the content search of instructional video.
Above-mentioned steps 1) concrete steps of program Automatic Extraction outline are in:
1.1) program scanning and extract suitable outline;
1.2) the corresponding frame information of acquisition outline;
1.3) discern and translate into text according to frame information; Examine in the time of identification and translation, extract the outline keyword in the outline.
Above-mentioned steps 1) the artificial concrete grammar that extracts outline is in: according to teaching purpose, and according to contents different in the video, input outline content, and definite outline keyword.
Above-mentioned steps 5) concrete steps of inquiry are in: system carries out the outline content search according to the keyword matching engine of input, shows that then lookup result and the timeslice information that writes down according to inquiry file directly navigate to instructional video position correlation time if matched the video segment of outline; If do not find the video segment of coupling, then the user selects whether to revise key word and continues inquiry.
Said method also includes the step that step 6) user oneself adds the outline keyword after step 5), concrete steps are as follows: allow user oneself to replenish, on player standing time sheet selection, eject an edit box that allows the input text outline, carry out the outline keyword of newly-built or additional this timeslice correspondence.
Above-mentioned steps 2) in the timeslice table of comparisons of keyword and former video, that the corresponding relation of different outline keyword time corresponding sheets has is overlapping, comprise and many-one.
Above-mentioned steps 1.2) method that obtains frame information in is to use the OCR technology;
Above-mentioned video outline comprises the code snippet in the programming study course, and the mathematical formulae in the mathematics study course, the example sentence in the english teaching extract.
Advantage of the present invention is:
1) set up a kind of outline shelves of corresponding query video content, the outline shelves can adopt artificial input mode, according to video content, carry out incident sheet related content and carry out the outline content and carry out mark.Can see through content that video grabs (as the OCR recognition technology for some service routines, perhaps can be from frame of video, some text datas be identified as text again and transfer to again and manually carry out verification and confirm) mode that can Automatic Program grasps artificial then checking and choose again.
2) question blank of setting up a kind of outline and time slice is set up the contrast question blank, and adopt the mode of the index of full-text query to organize and store all outline content, thereby obtain a corresponding portion " instructional video (outline) question blank (outline keyword-video time sheet scope) " with this video, the keyword that player allows user's input to inquire about, polling routine can be inquired about " instructional video (outline) question blank " and carried out the inquiry and the location of video content then, thereby allows instructional video can carry out the accurate inquiry of content.
3) some outline can be obtained by auxiliary extraction of program, manually examine and choose keyword, thereby may only need artificial input still less, instructional video can also be by sending extraction by the distribution of instructional video, because they are familiar with its video content more, thus can be more consummate and get access to outline accurately; By setting up the auxilliary group polling table of outline, thereby realize accurately and video content inquiry easily and location on the embedded device again, and then allow the user of instructional video can carry out content search easily.
Description of drawings
Fig. 1 is the structured flowchart of system of the present invention;
Fig. 2 is a method flow diagram of the present invention;
Fig. 3 is the method flow diagram of query video in the inventive method;
Fig. 4 is the method flow diagram that User Defined expands outline in the inventive method;
Fig. 5 .1 is the outline content specific embodiment synoptic diagram of query video of the present invention;
Fig. 5 .2 is the keyword of query video outline content among Fig. 5 .1 and the synoptic diagram of timeslice contrast;
Fig. 5 .3 is another specific embodiment synoptic diagram of outline content of query video of the present invention;
Fig. 5 .4 is the keyword of query video outline content among Fig. 5 .3 and the synoptic diagram of timeslice contrast;
Embodiment
Referring to Fig. 1, the system of searching teaching video contents in the embedded device of the present invention comprises and chooses module 1, is used for coming the selecting video outline according to content and teaching purposes; Memory module 2 is used to store the video outline data; Processing module 3 is used for extracting video outline from memory module 2; Display module 4, the video outline and the instructional video outline that are used for choosing show with the video time sheet table of comparisons and instructional video inquiry file.Processing module 3 is also created video outline, according to the outline of setting up except extracting the screen outline, set up the timeslice table of comparisons of outline keyword and former video and set up outline full text or keyword query table;
Referring to Fig. 2, Fig. 3, the present invention is based on the method for the system of searching teaching video contents in the embedded device, may further comprise the steps:
1) checks instructional video,, whether determine program or manual creation video outline according to its content and teaching purposes.Extract if the content of courses is fit to Automatic Program, the concrete steps that Automatic Program is created are:
1.1) program scanning and extract suitable outline; Generally such as the code snippet in the programming study course, the mathematical formulae in the mathematics study course etc., the example sentence extraction in the english teaching etc.;
1.2) obtain corresponding frame information;
1.3) use the OCR technology to discern and translate into text according to frame information; Examine in the time of identification and translation, extract the keyword in the outline, referring to Fig. 5 .1 and Fig. 5 .3; Shown in Fig. 5 .1 be among the MFC (VC6.0) about socket socket teaching programming video Lesson14.rmvb duration 02:06:03 (video duration 2 hours 06 minutes 03 seconds), the timeslice 01:33:24 of Fig. 5 .1 is the vc++ example code that one section socket socket UDP message sends data.Code snippet in the above-mentioned video then also can be used as a kind of outline content and includes, and extracts the query contents of these function names as outline.All can be used as the keyword of video content inquiry as the keyword of italic mark among Fig. 5 .1.
Shown in Fig. 5 .3 be among the MFC (VC6.0) about socket socket teaching programming video Lesson16.rmvb duration 01:59:10 (video duration 1 hour 0 59 minutes 0 10 seconds), the timeslice 01:41:17 of figure two is the vc++ example code that one section socket socket UDP (user datagram protocol) sends data.Italics part keyword among Fig. 5 .3 all can be used as the keyword of video content inquiry.
Fig. 5 .2 and Fig. 5 .4 are respectively in the instructional video among above-mentioned Fig. 5 .1 and Fig. 5 .3, the corresponding timeslice table of comparisons of outline keyword and timeslice.
If program is inconvenient to grab outline content accurately, then manual mode is carried out the input and the time contrast of outline, concrete steps are: this part is for instructional video, teaching purpose that can basis is a foundation, thereby content according to timeslices different in the video, the outline content that input is relevant also can be by the auxiliary relevant outline of instructional video that extracts of publisher or making side of instructional video;
Certainly, consider the accuracy of the content of program extraction, can be by manually examining on one side, and extract keyword in the outline, otherwise query contents may too much and too mix, and is inconvenient to use.
2) create automatically or the manual outline of setting up according to said procedure, set up the timeslice table of comparisons of outline keyword and keyword and former video;
3) set up outline keyword query table according to the outline keyword of setting up;
4) in the process of Bo Fanging, accept the keyword of user input query, and in outline keyword query table, inquire about, if this keyword in outline keyword query table, then carries out step 5);
5) locate automatically the position of carrying out instructional video according to outline keyword and the timeslice table of comparisons, realizes the content search of instructional video.
In the inquiry video outline, the key word that content input that the user can inquire about as required or selection need inquiry, the system matches engine carries out the outline content search, and the video segment that system matches has arrived outline shows that then lookup result and the timeslice information that writes down according to inquiry file directly navigate to instructional video position correlation time; If do not find the video segment of coupling, then the user can select whether to revise key word and continue inquiry, referring to Fig. 3.
6) user can oneself add outline, concrete steps are as follows: allow user oneself to replenish, on player standing time sheet selection, eject an edit box that allows the input text outline, carry out the outline keyword of newly-built or additional this timeslice correspondence, thereby the interior permission of realization outline User Defined is edited and is expanded, and this step specific embodiment is referring to Fig. 4; Under the situation that does not have suitable outline timeslice, the user can be according to prompting, two kinds of selections that selective system provides: newly-increased outline content or map editorial policy content, system can upgrade the query video file according to user's input afterwards.
Step 2) in the timeslice of different outline keyword time corresponding allow overlapping, comprise, relation such as many-one.
About the inquiry of outline, then have and use the text query technology to set up the implementation that concordance list can have multiple realization maturation in the method for the present invention, as keyword ordering back binary chop, many gimmicks such as the hash table of comparisons can realize.
By method of the present invention, we have realized a kind of content search of accurately searching for instructional video, and because instructional video substantially all has the main line of giving lessons of teaching, so it is not difficult manually to crawl out outline yet.And some outline can be obtained by auxiliary extraction of program, manually into is to examine and choose keyword, thereby may only need artificial input still less.If if instructional video is sent extraction by the distribution of instructional video, because they are familiar with its video content more, thus can be more consummate and get access to outline accurately.By setting up the auxilliary group polling table of outline, thereby on embedded device, realize accurately and video content inquiry easily and location, and then allow the user of instructional video can carry out content search easily.
Claims (9)
1. the system of searching teaching video contents in the embedded device is characterized in that: described system comprise be used for the selecting video outline choose module, be used to store the video outline data memory module, be used for the processing module that extracts video outline and create video outline from memory module; The display module that is used for the display video associated documents; The described module of choosing is connected with display module; Described processing module is connected with display module; Described memory module with choose module and be connected.
2. based on the method for the system of searching teaching video contents in the embedded device, it is characterized in that: said method comprising the steps of:
1) check instructional video, according to the content and the teaching purposes of instructional video, whether decision can Automatic Program extract video outline; If then Automatic Program extracts, and if not, then manually adds video outline;
2) set up the timeslice table of comparisons of outline keyword and this outline keyword and former video according to video outline;
3) set up outline keyword query table according to the outline keyword of setting up;
4) in the process of Bo Fanging, accept the keyword of user input query, and in outline keyword query table, inquire about, if this keyword in outline keyword query table, then carries out step 5);
5) locate automatically the position of carrying out instructional video according to outline keyword and the timeslice table of comparisons, realizes the content search of instructional video.
3. the method for the system based on searching teaching video contents in the embedded device according to claim 2, it is characterized in that: the concrete steps of program Automatic Extraction outline are in the described step 1):
1.1) program scanning and extract suitable outline;
1.2) the corresponding frame information of acquisition outline;
1.3) discern and translate into text according to frame information; Examine in the time of identification and translation, extract the outline keyword in the outline.
4. the method for the system based on searching teaching video contents in the embedded device according to claim 2, it is characterized in that: the artificial concrete grammar that extracts outline is in the described step 1): according to teaching purpose, according to contents different in the video, input outline content, and definite outline keyword.
5. the method for the system based on searching teaching video contents in the embedded device according to claim 4, it is characterized in that: the concrete steps of inquiring about in the described step 5) are: system carries out the outline content search according to the keyword matching engine of input, shows that then lookup result and the timeslice information that writes down according to inquiry file directly navigate to instructional video position correlation time if matched the video segment of outline; If do not find the video segment of coupling, then the user selects whether to revise key word and continues inquiry.
6. according to the method for claim 2 or 3 or 4 or 5 described systems based on searching teaching video contents in the embedded device, it is characterized in that: described method also includes the step that step 6) user oneself adds the outline keyword after step 5), concrete steps are as follows: allow user oneself to replenish, on player standing time sheet selection, eject an edit box that allows the input text outline, carry out the outline keyword of newly-built or additional this timeslice correspondence.
7. the method for the system based on searching teaching video contents in the embedded device according to claim 3, it is characterized in that: described step 2) in the timeslice table of comparisons of keyword and former video, that the corresponding relation of different outline keyword time corresponding sheets has is overlapping, comprise and many-one.
8. the method for the system based on searching teaching video contents in the embedded device according to claim 3 is characterized in that: the method that obtains frame information described step 1.2) is to use the OCR technology;
9. the method for the system based on searching teaching video contents in the embedded device according to claim 6 is characterized in that: described video outline comprises the code snippet in the programming study course, and the mathematical formulae in the mathematics study course, the example sentence in the english teaching extract.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010178784 CN101833584A (en) | 2010-05-20 | 2010-05-20 | System and method for searching teaching video contents in embedded equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010178784 CN101833584A (en) | 2010-05-20 | 2010-05-20 | System and method for searching teaching video contents in embedded equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101833584A true CN101833584A (en) | 2010-09-15 |
Family
ID=42717653
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010178784 Pending CN101833584A (en) | 2010-05-20 | 2010-05-20 | System and method for searching teaching video contents in embedded equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101833584A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184259A (en) * | 2011-06-08 | 2011-09-14 | 无敌科技(西安)有限公司 | System for searching teaching video contents and method thereof |
| CN108920513A (en) * | 2018-05-31 | 2018-11-30 | 深圳市图灵机器人有限公司 | A kind of multimedia data processing method, device and electronic equipment |
| WO2019015132A1 (en) * | 2017-07-21 | 2019-01-24 | 深圳市鹰硕技术有限公司 | Information providing method and system |
| CN112860939A (en) * | 2021-02-19 | 2021-05-28 | 北京百度网讯科技有限公司 | Audio and video data processing method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1295690A (en) * | 1999-01-28 | 2001-05-16 | 皇家菲利浦电子有限公司 | System and method for analyzing video content using detected text in video frames |
| CN1851709A (en) * | 2006-05-25 | 2006-10-25 | 浙江大学 | Embedded multimedia content-based inquiry and search realizing method |
| CN101196919A (en) * | 2007-12-21 | 2008-06-11 | 北京天天宽广网络科技有限公司 | Index and query method based on audio and video segment |
| CN101493995A (en) * | 2009-03-05 | 2009-07-29 | 无敌科技(西安)有限公司 | Video interactive teaching system and method |
-
2010
- 2010-05-20 CN CN 201010178784 patent/CN101833584A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1295690A (en) * | 1999-01-28 | 2001-05-16 | 皇家菲利浦电子有限公司 | System and method for analyzing video content using detected text in video frames |
| CN1851709A (en) * | 2006-05-25 | 2006-10-25 | 浙江大学 | Embedded multimedia content-based inquiry and search realizing method |
| CN101196919A (en) * | 2007-12-21 | 2008-06-11 | 北京天天宽广网络科技有限公司 | Index and query method based on audio and video segment |
| CN101493995A (en) * | 2009-03-05 | 2009-07-29 | 无敌科技(西安)有限公司 | Video interactive teaching system and method |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184259A (en) * | 2011-06-08 | 2011-09-14 | 无敌科技(西安)有限公司 | System for searching teaching video contents and method thereof |
| WO2019015132A1 (en) * | 2017-07-21 | 2019-01-24 | 深圳市鹰硕技术有限公司 | Information providing method and system |
| CN108920513A (en) * | 2018-05-31 | 2018-11-30 | 深圳市图灵机器人有限公司 | A kind of multimedia data processing method, device and electronic equipment |
| CN108920513B (en) * | 2018-05-31 | 2022-03-15 | 深圳市图灵机器人有限公司 | Multimedia data processing method and device and electronic equipment |
| CN112860939A (en) * | 2021-02-19 | 2021-05-28 | 北京百度网讯科技有限公司 | Audio and video data processing method, device, equipment and storage medium |
| CN112860939B (en) * | 2021-02-19 | 2023-09-26 | 北京百度网讯科技有限公司 | Audio and video data processing method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100430938C (en) | Image retrieving apparatus and image retrieving method | |
| US7734654B2 (en) | Method and system for linking digital pictures to electronic documents | |
| US8577882B2 (en) | Method and system for searching multilingual documents | |
| US7672508B2 (en) | Image classification based on a mixture of elliptical color models | |
| CN101021855B (en) | Video searching system based on content | |
| CN111291210B (en) | Image material library generation method, image material recommendation method and related devices | |
| US20180150444A1 (en) | Constructing a Narrative Based on a Collection of Images | |
| JP2009526302A (en) | Method and system for tagging digital data | |
| US20100114856A1 (en) | Information search apparatus, information search method, and storage medium | |
| US20020076110A1 (en) | Technique to identify interesting print articles for later retrieval and use of the electronic version of the articles | |
| CN102576373B (en) | Content management device, contents management method, content supervisor and integrated circuit | |
| CN112099709B (en) | Method and device for arranging multimedia objects, electronic equipment and storage medium | |
| CN101206662A (en) | Document retrieving apparatus, document retrieving method | |
| JP2000276484A5 (en) | Image search device, image search method | |
| CN103631819A (en) | Method and system for naming picture | |
| CN112929746B (en) | Video generation method and device, storage medium and electronic equipment | |
| CN102591868A (en) | System and method for automatic generation of photograph guide | |
| CN106156111B (en) | Patent document retrieval method, device and system | |
| JP2007011637A (en) | Image management device | |
| US20110075884A1 (en) | Automatic Retrieval of Object Interaction Relationships | |
| US20190082236A1 (en) | Determining Representative Content to be Used in Representing a Video | |
| CN101833584A (en) | System and method for searching teaching video contents in embedded equipment | |
| CN107704520B (en) | Multi-file retrieval method and device based on face recognition | |
| KR101307325B1 (en) | System for dual-searching image using region of interest set | |
| CN107066474A (en) | Literature search method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20100915 |