CN104461008B - A kind of multimedia teaching control system and control method - Google Patents
A kind of multimedia teaching control system and control method Download PDFInfo
- Publication number
- CN104461008B CN104461008B CN201410808310.6A CN201410808310A CN104461008B CN 104461008 B CN104461008 B CN 104461008B CN 201410808310 A CN201410808310 A CN 201410808310A CN 104461008 B CN104461008 B CN 104461008B
- Authority
- CN
- China
- Prior art keywords
- point
- profile
- image
- convex closure
- finger
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Human Computer Interaction (AREA)
- Electrically Operated Instructional Devices (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention provides a kind of multimedia teaching control system and control method, including：Data acquisition module：Gather video flowing；Characterized in that, also include：Interactive control module：The video flowing collected is handled, the profile of personage is identified by image recognition technology and calculate profile central point and convex closure point so that it is determined that the position of hand, then according to the residence time decision instruction of hand, so as to make corresponding response action.The interactive control module of the present invention and control method cause class-teaching of teacher to employ the hardware devices such as mouse-keyboard, as long as point to the object setting time to be operated with finger, corresponding button can be triggered, accomplishes that the interaction to courseware controls, the mode of attending class will be more nimbly and freely；Whole invention improves the interest in classroom, has innovated teaching pattern, has reached more preferable teaching efficiency.
Description
Technical field
The present invention relates to multimedia teaching field, specifically, is related to a kind of multimedia teaching control system and controlling party
Method.
Background technology
Multimedia is information-based embodiment, and the trend of social development, information-based level have become measurement one
Modernization of the country is horizontal and the major criterion of overall national strength, multimedia education are an information-based parts, and make greater efforts to promote more matchmakers
Body education has turned into the trend of educational development.
Multimedia technology is used in teaching, is advantageous to improve the professional standards of teacher, is advantageous to teacher's integrated instruction resource.
Teaching Technology of Multimedia can overcome the disadvantages that the deficiency in conventional teaching, be new Scientific Teaching technology.At present, operation of teacher multimedia
Still traditional manual mode is used during equipment, the mode of class-teaching of teacher operation equipment is single, lacks interesting.This is existing skill
The weak point of art.
The content of the invention：
The technical program technical problems to be solved are to provide a kind of multimedia teaching control system and control method, improve
The interest in classroom, has innovated teaching pattern, has reached more preferable teaching efficiency.
The present invention realizes goal of the invention by following technological means：
A kind of multimedia teaching control system, including：
Data acquisition module：Gather video flowing；Characterized in that, also include：
Interactive control module：The video flowing collected is handled, the profile of personage is identified by image recognition technology
And calculate profile central point and convex closure point so that it is determined that the position of hand, then according to the residence time decision instruction of hand, so as to
Make corresponding response action.
A kind of multimedia teaching control method, including：
(1) open camera and obtain background, under nobody environment, the purer image of one amplitude ratio of extraction is as background；
(2) current frame image is obtained, extracts the gray level image of personage's prospect；
Concretely comprise the following steps：The grey scale pixel value that L (x, y) is current frame image is set, B (x, y) is the pixel of background image
Gray value, D (x, y) are that the grey scale pixel value of foreground image then has：
D (x, y)=| L (x, y)-B (x, y) |
(3) threshold calculations are carried out to gray level image, obtains bianry image；
Concretely comprise the following steps：Assuming that f (x, y) is the pixel value of certain point in gray level image, d (x, y) is certain in bianry image
The pixel value of a bit, T are threshold value, then have
(4) edge gradient calculates, and detects the profile of personage；
(5) position of hand is determined, is concretely comprised the following steps：
According to the character contour detected in step (4), the central point of profile and the convex closure point of profile are calculated, according to obtaining
Profile central point and convex closure point, on x directions and y directions convex closure point is calculated respectively to the distance of profile central point, if x side
To distance be more than y directions on distance, then the convex closure point position is taken as the position of finger；
(6) repeat step (2)-(5), the position data of real-time hand is obtained；
(7) response events are triggered and carries out event response, specifically included：
The triggering of g1 events, when the position of continuous 3 two field picture finger is all in certain a small range, then be considered as finger
Position within continuous 3 frame position do not become, just trigger click event；
G2 is changed according to the size of present image and the resolution ratio of desktop screen, and the position of finger in the picture is turned
The position of desktop mouse click is changed to, can thus realize conversion of the finger position to the click response position of mouse, position
Conversion formula is specially：
Assuming that picture size size is (PicWidth, PicHight), desktop screen resolutions for (ScreenX,
ScreenY), the position of finger in the picture is (PicX, PicY), and the click location of desktop mouse is (x, y), then has：
As the further restriction to the technical program, the step (5) comprises the following steps：
Calculate concretely comprising the following steps for profile convex closure point：
Assuming that the point set of composition profile is S, any two points p (x in set are taken1,y1) and p (x2,y2), then this 2 points group
Into straight line be：Ax+by=c (wherein, a=y2-y1, b=x2-x1, c=x1y2-y1x2), by other all points concentrated
Linear equation ax+by=c is brought into respectively, if the symbol of expression formula is identical, all>C or all<C, then it represents that above-mentioned 2 points are the wheel
Wide convex closure point, is not otherwise just convex closure point,
Every opposite vertexes of profile are detected, find all convex closure points；
Calculate concretely comprising the following steps for profile central point：
Point all on profile is traveled through, total number a little is obtained, extracts the coordinate value of each point；
N=∑sI1
The average value of all point coordinates is sought, obtains the central point of profile
Wherein, profile point total number is N, and each point coordinate value is mtx (x, y), and center point coordinate is M (x, y).
Compared with prior art, the advantages and positive effects of the present invention are：The interactive control module of the present invention and control method
So that class-teaching of teacher need not employ the hardware devices such as mouse-keyboard, as long as pointing to the object setting time to be operated with finger, just
Corresponding button is can trigger, accomplishes that the interaction to courseware controls, the mode of attending class will be more nimbly and freely；Whole invention improves
The interest in classroom, has innovated teaching pattern, has reached more preferable teaching efficiency.
Brief description of the drawings
Fig. 1 is the flow chart of the present invention.
Embodiment:
With reference to embodiment, the present invention is further illustrated.
Referring to Fig. 1, the present invention includes：
A kind of multimedia teaching control system, including：
Data acquisition module：Gather video flowing；Characterized in that, also include：
Interactive control module：The video flowing collected is handled, the profile of personage is identified by image recognition technology
And calculate profile central point and convex closure point so that it is determined that the position of hand, then according to the residence time decision instruction of hand, so as to
Make corresponding response action.
A kind of multimedia teaching control method, including：
(1) open camera and obtain background, under nobody environment, the purer image of one amplitude ratio of extraction is as background；
(2) current frame image is obtained, extracts the gray level image of personage's prospect；
Concretely comprise the following steps：The grey scale pixel value that L (x, y) is current frame image is set, B (x, y) is the pixel of background image
Gray value, D (x, y) are that the grey scale pixel value of foreground image then has：
D (x, y)=| L (x, y)-B (x, y) |
(3) threshold calculations are carried out to gray level image, obtains bianry image；
Concretely comprise the following steps：Assuming that f (x, y) is the pixel value of certain point in gray level image, d (x, y) is certain in bianry image
The pixel value of a bit, T are threshold value, then have
(4) edge gradient calculates, and detects the profile of personage；
(5) position of hand is determined, is concretely comprised the following steps：
According to the character contour detected in step (4), the central point of profile and the convex closure point of profile are calculated, according to obtaining
Profile central point and convex closure point, on x directions and y directions convex closure point is calculated respectively to the distance of profile central point, if x side
To distance be more than y directions on distance, then the convex closure point position is taken as the position of finger；
(6) repeat step (2)-(5), the position data of real-time hand is obtained；
(7) response events are triggered and carries out event response, specifically included：
The triggering of g1 events, when the position of continuous 3 two field picture finger is all in certain a small range, then be considered as finger
Position within continuous 3 frame position do not become, just trigger click event；
G2 is changed according to the size of present image and the resolution ratio of desktop screen, and the position of finger in the picture is turned
The position of desktop mouse click is changed to, can thus realize conversion of the finger position to the click response position of mouse, position
Conversion formula is specially：
Assuming that picture size size is (PicWidth, PicHight), desktop screen resolutions for (ScreenX,
ScreenY), the position of finger in the picture is (PicX, PicY), and the click location of desktop mouse is (x, y), then has：
The step (5) comprises the following steps：
Calculate concretely comprising the following steps for profile convex closure point：
Assuming that the point set of composition profile is S, any two points p (x in set are taken1,y1) and p (x2,y2), then this 2 points group
Into straight line be：Ax+by=c (wherein, a=y2-y1, b=x2-x1, c=x1y2-y1x2), by other all points concentrated
Linear equation ax+by=c is brought into respectively, if the symbol of expression formula is identical, all>C or all<C, then it represents that above-mentioned 2 points are the wheel
Wide convex closure point, is not otherwise just convex closure point,
Every opposite vertexes of profile are detected, find all convex closure points；
Calculate concretely comprising the following steps for profile central point：
Point all on profile is traveled through, total number a little is obtained, extracts the coordinate value of each point；
N=∑sI1
The average value of all point coordinates is sought, obtains the central point of profile
Wherein, profile point total number is N, and each point coordinate value is mtx (x, y), and center point coordinate is M (x, y).
Claims (1)
1. a kind of multimedia teaching control method, including：
(1) open camera and obtain background, under nobody environment, the purer image of one amplitude ratio of extraction is as background；
(2) current frame image is obtained, extracts the gray level image of personage's prospect；
Concretely comprise the following steps：The grey scale pixel value that L (x, y) is current frame image is set, B (x, y) is the pixel grey scale of background image
Value, D (x, y) are that the grey scale pixel value of foreground image then has：
D (x, y)=| L (x, y)-B (x, y) |
(3) threshold calculations are carried out to gray level image, obtains bianry image；
Concretely comprise the following steps：Assuming that f (x, y) is the pixel value of certain point in gray level image, d (x, y) is certain point in bianry image
Pixel value, T is threshold value, then has
(4) edge gradient calculates, and detects the profile of personage；
(5) position of hand is determined, is concretely comprised the following steps：
According to the character contour detected in step (4), the central point of profile and the convex closure point of profile are calculated, according to obtained wheel
Wide central point and convex closure point, on x directions and y directions convex closure point is calculated respectively to the distance of profile central point, if x directions
Distance is more than the distance on y directions, then the convex closure point position is taken as the position of finger；
(6) repeat step (2)-(5), the position data of real-time hand is obtained；
(7) response events are triggered and carries out event response, specifically included：
The triggering of g1 events, when the position of continuous 3 two field picture finger is all in certain a small range, then be considered as the position of finger
Put the position within continuous 3 frame not become, just trigger click event；
G2 is changed according to the size of present image and the resolution ratio of desktop screen, and the position of finger in the picture is converted to
The position that desktop mouse is clicked on, it can thus realize conversion of the finger position to the click response position of mouse, position conversion
Formula is specially：
Assuming that picture size size is (PicWidth, PicHight), desktop screen divides example to be (ScreenX, ScreenY),
The position of finger in the picture is (PicX, PicY), and the click location of desktop mouse is (x, y), then has：
The step (5) comprises the following steps：
Calculate concretely comprising the following steps for profile convex closure point：
Assuming that the point set of composition profile is S, any two points p (x in set are taken1,y1) and p (x2,y2), then this 2 points composition it is straight
Line is：Ax+by=c (wherein, a=y2-y1, b=x2-x1, c=x1y2-y1x2), by other an all points band respectively concentrated
Enter linear equation ax+by=c, if the symbol of expression formula is identical, all>C or all<C, then it represents that above-mentioned 2 points are the convex of the profile
Bao Dian, otherwise just it is not convex closure point,
Every opposite vertexes of profile are detected, find all convex closure points；
Calculate concretely comprising the following steps for profile central point：
Point all on profile is traveled through, total number a little is obtained, extracts the coordinate value of each point；
N=∑sI1
The average value of all point coordinates is sought, obtains the central point of profile
Wherein, profile point total number is N, and each point coordinate value is mtx (x, y), and center point coordinate is M (x, y).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410808310.6A CN104461008B (en) | 2014-12-23 | 2014-12-23 | A kind of multimedia teaching control system and control method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410808310.6A CN104461008B (en) | 2014-12-23 | 2014-12-23 | A kind of multimedia teaching control system and control method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104461008A CN104461008A (en) | 2015-03-25 |
| CN104461008B true CN104461008B (en) | 2017-12-08 |
Family
ID=52907200
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410808310.6A Active CN104461008B (en) | 2014-12-23 | 2014-12-23 | A kind of multimedia teaching control system and control method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104461008B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107092350A (en) * | 2017-03-22 | 2017-08-25 | 深圳大学 | A kind of remote computer based system and method |
| CN110505529A (en) * | 2019-08-16 | 2019-11-26 | 上海掌学教育科技有限公司 | Courseware synchronous display method, device, background server, medium and system |
| CN111507318A (en) * | 2020-07-01 | 2020-08-07 | 口碑(上海)信息技术有限公司 | Off-store detection method and device based on image recognition |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1664755A (en) * | 2005-03-11 | 2005-09-07 | 西北工业大学 | Video recognition input system |
| CN101877180A (en) * | 2009-11-18 | 2010-11-03 | 北京同方瑞博数字技术有限公司 | Multi-media electronic reciprocal teaching system |
| CN102200834A (en) * | 2011-05-26 | 2011-09-28 | 华南理工大学 | television control-oriented finger-mouse interaction method |
| CN102323859A (en) * | 2011-09-08 | 2012-01-18 | 昆山市工业技术研究院有限责任公司 | Teaching materials Play System and method based on gesture control |
| CN102981742A (en) * | 2012-11-28 | 2013-03-20 | 无锡市爱福瑞科技发展有限公司 | Gesture interaction system based on computer visions |
| CN103092334A (en) * | 2011-10-31 | 2013-05-08 | 财团法人资讯工业策进会 | Virtual mouse driving device and virtual mouse simulation method |
-
2014
- 2014-12-23 CN CN201410808310.6A patent/CN104461008B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1664755A (en) * | 2005-03-11 | 2005-09-07 | 西北工业大学 | Video recognition input system |
| CN101877180A (en) * | 2009-11-18 | 2010-11-03 | 北京同方瑞博数字技术有限公司 | Multi-media electronic reciprocal teaching system |
| CN102200834A (en) * | 2011-05-26 | 2011-09-28 | 华南理工大学 | television control-oriented finger-mouse interaction method |
| CN102323859A (en) * | 2011-09-08 | 2012-01-18 | 昆山市工业技术研究院有限责任公司 | Teaching materials Play System and method based on gesture control |
| CN103092334A (en) * | 2011-10-31 | 2013-05-08 | 财团法人资讯工业策进会 | Virtual mouse driving device and virtual mouse simulation method |
| CN102981742A (en) * | 2012-11-28 | 2013-03-20 | 无锡市爱福瑞科技发展有限公司 | Gesture interaction system based on computer visions |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104461008A (en) | 2015-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104484040B (en) | A kind of multimedia interactive teaching control system and learning control mode | |
| WO2020220968A1 (en) | Video data processing method and related device | |
| CN111325020B (en) | Event argument extraction method and device and electronic equipment | |
| WO2019029100A1 (en) | Multi-interaction implementation method for mining operation based on virtual reality and augmented reality | |
| CN105718878A (en) | Egocentric vision in-the-air hand-writing and in-the-air interaction method based on cascade convolution nerve network | |
| CN106201173B (en) | A kind of interaction control method and system of user's interactive icons based on projection | |
| CN109063694A (en) | A kind of video object detection recognition method | |
| CN104461008B (en) | A kind of multimedia teaching control system and control method | |
| CN102096471A (en) | Human-computer interaction method based on machine vision | |
| CN107624061A (en) | Machine vision with dimension data reduction | |
| CN106445386B (en) | Handwriting display method and device | |
| CN109064389A (en) | A kind of free hand line draws the deep learning method of generation presence image | |
| CN106611172A (en) | Style learning-based Chinese character synthesis method | |
| CN110008961A (en) | Text real-time identification method, device, computer equipment and storage medium | |
| US20200126274A1 (en) | Chinese character information recording method | |
| CN104407696A (en) | Virtual ball simulation and control method of mobile device | |
| Xue et al. | A Chinese sign language recognition system using leap motion | |
| CN109471533A (en) | A kind of VR/AR teaches indoor student's end system and its application method | |
| CN111768377A (en) | Image color evaluation method and device, electronic equipment and storage medium | |
| CN107608510A (en) | Method for building up, device and the electronic equipment in gesture model storehouse | |
| CN103914677A (en) | Action recognition method and device | |
| CN107885324B (en) | Human-computer interaction method based on convolutional neural network | |
| CN107241643A (en) | A kind of multimedia volume adjusting method and system | |
| CN105138122B (en) | A method of by identifying gesture remote control screen equipment | |
| Benito et al. | Engaging computer engineering students with an augmented reality software for laboratory exercises |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| DD01 | Delivery of document by public notice |
Addressee: He Qiang Document name: Notification that Application Deemed not to be Proposed |
|
| DD01 | Delivery of document by public notice | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20190930 Address after: Room 1401A, North Building, 9 Building, Shuntai Square, 2000 Shunhua Road, Jinan City, Shandong Province, 250101 Patentee after: Ji'nan Keming digital technology Limited by Share Ltd Address before: Fengming Road District of Ji'nan City, the development of the port in Shandong province 250101 Shandong Jianzhu University No. 1000 Patentee before: shandong jianzhu university |
|
| TR01 | Transfer of patent right |