CN104461008A - Multimedia teaching control system and method - Google Patents

Abstract

The invention provides a multimedia teaching control system and method. The system comprises a data collecting module which is used for collecting video streaming. The multimedia teaching control system is characterized in that an interaction control module is further included, the collected video streaming is processed, the outline of a figure is identified through an image identification technology, the central point and the convex hull points of the outline are calculated to determine the positions of hands, then an instruction is judged according to the stay time of the hands, and therefore corresponding response actions are made. According to the multimedia teaching control system and method, the interaction control module and the control method enable a teacher to do not need to use hardware equipment such as a mouse and a keyboard, corresponding buttons can be triggered by pointing to an object to be operated by fingers to set time, interactive control over courseware is achieved, and the lecturing mode is more flexible. The entire multimedia teaching control system and method improve the enjoyment of a lesson, the teaching mode is innovated, and a better teaching effect is achieved.

Description

A kind of multimedia teaching control system and control method

Technical field

The present invention relates to multimedia teaching field, specifically, relate to a kind of multimedia teaching control system and control method.

Background technology

Multimedia is informationalized embodiment, also be the trend of social development, informationalized level has become the major criterion of measurement modernization of the country level and overall national strength, and multimedia education is an informationalized part, and multimedia education of making greater efforts to promote has become the trend of educational development.

Use multimedia technology in teaching, be conducive to the professional standards improving teacher, be conducive to teacher's integrated instruction resource.Teaching Technology of Multimedia can make up the deficiency in conventional teaching, is novel Scientific Teaching technology.At present, still adopt traditional manual mode during operation of teacher multimedia equipment, the mode of class-teaching of teacher operating equipment is single, lacks interesting.This is the deficiencies in the prior art part.

Summary of the invention:

The technical matters that the technical program will solve is to provide a kind of multimedia teaching control system and control method, improves the interest in classroom, has innovated teaching pattern, reaches better teaching efficiency.

The present invention realizes goal of the invention by following technological means:

A kind of multimedia teaching control system, comprising:

Data acquisition module: gather video flowing; It is characterized in that, also comprise:

Interactive control module: the video flowing collected is processed, calculate the central point of profile and convex closure point by the profile of image recognition technology identification personage thus determine the position of hand, then according to the residence time decision instruction of hand, thus make and respond action accordingly.

A kind of multimedia teaching control method, comprising:

(1) open camera background extraction, under unmanned environment, extract the purer image of an amplitude ratio as a setting;

(2) obtain current frame image, extract the gray level image of personage's prospect;

Concrete steps are: the grey scale pixel value that setting L (x, y) is current frame image, the grey scale pixel value that B (x, y) is background image, and the grey scale pixel value that D (x, y) is foreground image then has:

D(x，y)＝|L(x,y)-B(x,y)|

(3) threshold calculations is carried out to gray level image, obtain bianry image;

Concrete steps are: suppose that f (x, y) is for certain any pixel value in gray level image, and d (x, y) is certain any pixel value in bianry image, and T is threshold value, then have $d(x,y)=\left\{\begin{array}{cc}1& f(x,y)>=T\\ 0& f(x,y)<T\end{array}\right.,$

(4) edge gradient calculates, and the profile of personage detected;

(5) determine the position of hand, concrete steps are:

According to the character contour detected in step (4), calculate the central point of profile and the convex closure point of profile, according to the profile central point obtained and convex closure point, to calculate on x direction and y direction convex closure point respectively to the distance of profile central point, if the distance in x direction is greater than the distance on y direction, so the position of finger is just thought in this convex closure point position;

(6) repeat step (2)-(5), obtain the position data of real-time hand;

(7) trigger response events and carry out event response, specifically comprise:

The triggering of g1 event, when continuous 3 two field pictures fingers position all certain among a small circle in, so just think that position within continuous 3 frames, the position of finger does not become, just trigger click event;

G2 changes according to the size of present image and the resolution of desktop screen, finger position is in the picture converted to the position that desktop mouse is clicked, so just can realize the conversion of finger position to the click response position of mouse, position conversion formula is specially:

Suppose that picture size size is for (PicWidth, PicHight), desktop screen resolutions is (ScreenX, ScreenY), finger position is in the picture (PicX, PicY), the click location of desktop mouse is (x, y), then have: $(x,y)=\frac{\mathrm{ScreenX},\mathrm{Screen\; Y}}{(\mathrm{PicWidth},\mathrm{PicHight})}*(\mathrm{PicX},\mathrm{PicY}).$

As the further restriction to the technical program, described step (5) comprises the steps:

The concrete steps calculating profile convex closure point are:

Suppose that the point set forming profile is S, get any two points p (x in set ₁, y ₁) and p (x ₂, y ₂), then the straight line of these 2 compositions is: ax+by=c (wherein, a=y ₂-y ₁, b=x ₂-x ₁, c=x ₁y ₂-y ₁x ₂), bring other all points that point is concentrated into straight-line equation ax+by=c respectively, if the symbol of expression formula is identical, >c or <c, then represent that be the convex closure point of this profile at above-mentioned 2, otherwise be not just convex closure point,

Every opposite vertexes of profile is detected, finds all convex closure points;

The concrete steps calculating profile central point are:

Points all on traversal profile, total number of acquisition point, extracts the coordinate figure of each point;

N＝∑ _I1

Ask the mean value of all point coordinate, obtain the central point of profile

Wherein, the total number of point is N, and each point coordinate figure is mtx (x, y), and center point coordinate is M (x, y).

Compared with prior art, advantage of the present invention and good effect are: the interactive control module of the present invention and control method make class-teaching of teacher without the need to employing the hardware devices such as mouse-keyboard, as long as with Fingers to the object setting-up time that will operate, just corresponding button can be triggered, accomplish to control the interaction of courseware, the mode of attending class will be more nimbly and freely; Whole invention improves the interest in classroom, has innovated teaching pattern, reaches better teaching efficiency.

Accompanying drawing explanation

Fig. 1 is process flow diagram of the present invention.

Embodiment:

Below in conjunction with embodiment, further illustrate the present invention.

See Fig. 1, the present invention includes:

A kind of multimedia teaching control system, comprising:

Data acquisition module: gather video flowing; It is characterized in that, also comprise:

Interactive control module: the video flowing collected is processed, calculate the central point of profile and convex closure point by the profile of image recognition technology identification personage thus determine the position of hand, then according to the residence time decision instruction of hand, thus make and respond action accordingly.

A kind of multimedia teaching control method, comprising:

(1) open camera background extraction, under unmanned environment, extract the purer image of an amplitude ratio as a setting;

(2) obtain current frame image, extract the gray level image of personage's prospect;

Concrete steps are: the grey scale pixel value that setting L (x, y) is current frame image, the grey scale pixel value that B (x, y) is background image, and the grey scale pixel value that D (x, y) is foreground image then has:

D(x，y)＝|L(x,y)-B(x,y)|

(3) threshold calculations is carried out to gray level image, obtain bianry image;

Concrete steps are: suppose that f (x, y) is for certain any pixel value in gray level image, and d (x, y) is certain any pixel value in bianry image, and T is threshold value, then have $d(x,y)=\left\{\begin{array}{cc}1& f(x,y)>=T\\ 0& f(x,y)<T\end{array}\right.,$

(4) edge gradient calculates, and the profile of personage detected;

(5) determine the position of hand, concrete steps are:

According to the character contour detected in step (4), calculate the central point of profile and the convex closure point of profile, according to the profile central point obtained and convex closure point, to calculate on x direction and y direction convex closure point respectively to the distance of profile central point, if the distance in x direction is greater than the distance on y direction, so the position of finger is just thought in this convex closure point position;

(6) repeat step (2)-(5), obtain the position data of real-time hand;

(7) trigger response events and carry out event response, specifically comprise:

The triggering of g1 event, when continuous 3 two field pictures fingers position all certain among a small circle in, so just think that position within continuous 3 frames, the position of finger does not become, just trigger click event;

G2 changes according to the size of present image and the resolution of desktop screen, finger position is in the picture converted to the position that desktop mouse is clicked, so just can realize the conversion of finger position to the click response position of mouse, position conversion formula is specially:

Suppose that picture size size is for (PicWidth, PicHight), desktop screen resolutions is (ScreenX, ScreenY), finger position is in the picture (PicX, PicY), the click location of desktop mouse is (x, y), then have: $(x,y)=\frac{\mathrm{ScreenX},\mathrm{Screen\; Y}}{(\mathrm{PicWidth},\mathrm{PicHight})}*(\mathrm{PicX},\mathrm{PicY}).$

Described step (5) comprises the steps:

The concrete steps calculating profile convex closure point are:

Suppose that the point set forming profile is S, get any two points p (x in set ₁, y ₁) and p (x ₂, y ₂), then the straight line of these 2 compositions is: ax+by=c (wherein, a=y ₂-y ₁, b=x ₂-x ₁, c=x ₁y ₂-y ₁x ₂), bring other all points that point is concentrated into straight-line equation ax+by=c respectively, if the symbol of expression formula is identical, >c or <c, then represent that be the convex closure point of this profile at above-mentioned 2, otherwise be not just convex closure point,

Every opposite vertexes of profile is detected, finds all convex closure points;

The concrete steps calculating profile central point are:

Points all on traversal profile, total number of acquisition point, extracts the coordinate figure of each point;

N＝∑ _I1

Ask the mean value of all point coordinate, obtain the central point of profile

Wherein, the total number of point is N, and each point coordinate figure is mtx (x, y), and center point coordinate is M (x, y).

Claims (3)

1. a multimedia teaching control system, comprising:

Data acquisition module: gather video flowing; It is characterized in that, also comprise:

Interactive control module: the video flowing collected is processed, calculate the central point of profile and convex closure point by the profile of image recognition technology identification personage thus determine the position of hand, then according to the residence time decision instruction of hand, thus make and respond action accordingly.

2. a multimedia teaching control method, comprising:

(1) open camera background extraction, under unmanned environment, extract the purer image of an amplitude ratio as a setting;

(2) obtain current frame image, extract the gray level image of personage's prospect;

Concrete steps are: the grey scale pixel value that setting L (x, y) is current frame image, the grey scale pixel value that B (x, y) is background image, and the grey scale pixel value that D (x, y) is foreground image then has:

D(x，y)＝|L(x,y)-B(x,y)|

(3) threshold calculations is carried out to gray level image, obtain bianry image;

Concrete steps are: suppose that f (x, y) is for certain any pixel value in gray level image, and d (x, y) is certain any pixel value in bianry image, and T is threshold value, then have $d(x,y)=\left\{\begin{array}{cc}1& f(x,y)>=T\\ 0& f(x,y)<T\end{array}\right.,$

(4) edge gradient calculates, and the profile of personage detected;

(5) determine the position of hand, concrete steps are:

According to the character contour detected in step (4), calculate the central point of profile and the convex closure point of profile, according to the profile central point obtained and convex closure point, to calculate on x direction and y direction convex closure point respectively to the distance of profile central point, if the distance in x direction is greater than the distance on y direction, so the position of finger is just thought in this convex closure point position;

(6) repeat step (2)-(5), obtain the position data of real-time hand;

(7) trigger response events and carry out event response, specifically comprise:

The triggering of g1 event, when continuous 3 two field pictures fingers position all certain among a small circle in, so just think that position within continuous 3 frames, the position of finger does not become, just trigger click event;

G2 changes according to the size of present image and the resolution of desktop screen, finger position is in the picture converted to the position that desktop mouse is clicked, so just can realize the conversion of finger position to the click response position of mouse, position conversion formula is specially:

Suppose that picture size size is for (PicWidth, PicHight), desktop screen resolutions is (ScreenX, ScreenY), finger position is in the picture (PicX, PicY), the click location of desktop mouse is (x, y), then have: $(x,y)=\frac{\mathrm{ScreenX},\mathrm{ScreenY}}{(\mathrm{PicWidth},\mathrm{PicHight})}*(\mathrm{PicX},\mathrm{PicY}).$

3. multimedia teaching control method according to claim 2, is characterized in that, described step (5) comprises the steps:

The concrete steps calculating profile convex closure point are:

Suppose that the point set forming profile is S, get any two points p (x in set ₁, y ₁) and p (x ₂, y ₂), then the straight line of these 2 compositions is: ax+by=c (wherein, a=y ₂-y ₁, b=x ₂-x ₁, c=x ₁y ₂-y ₁x ₂), bring other all points that point is concentrated into straight-line equation ax+by=c respectively, if the symbol of expression formula is identical, >c or <c, then represent that be the convex closure point of this profile at above-mentioned 2, otherwise be not just convex closure point,

Every opposite vertexes of profile is detected, finds all convex closure points;

The concrete steps calculating profile central point are:

Points all on traversal profile, total number of acquisition point, extracts the coordinate figure of each point;

N＝∑ _I1

Ask the mean value of all point coordinate, obtain the central point of profile

Wherein, the total number of point is N, and each point coordinate figure is mtx (x, y), and center point coordinate is M (x, y).