CN109062484B - Manual mask image acquisition method for interactive classroom teaching system - Google Patents

Manual mask image acquisition method for interactive classroom teaching system Download PDF

Info

Publication number
CN109062484B
CN109062484B CN201810852767.5A CN201810852767A CN109062484B CN 109062484 B CN109062484 B CN 109062484B CN 201810852767 A CN201810852767 A CN 201810852767A CN 109062484 B CN109062484 B CN 109062484B
Authority
CN
China
Prior art keywords
outer frame
image
coordinates
point
acquiring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810852767.5A
Other languages
Chinese (zh)
Other versions
CN109062484A (en
Inventor
汪俊锋
林传文
高祥
戴平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Anhui Huishi Jintong Technology Co ltd
Original Assignee
Anhui Huishi Jintong Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anhui Huishi Jintong Technology Co ltd filed Critical Anhui Huishi Jintong Technology Co ltd
Priority to CN201810852767.5A priority Critical patent/CN109062484B/en
Publication of CN109062484A publication Critical patent/CN109062484A/en
Application granted granted Critical
Publication of CN109062484B publication Critical patent/CN109062484B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486Drag-and-drop
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Abstract

The invention discloses a manual mask image acquisition method for an interactive classroom teaching system, and relates to the field of image processing. The invention comprises the following steps: acquiring a block diagram outside a projection area; step two, acquiring coordinates of four corner points of the external block diagram of the projection area: sequentially clicking four corner points of the outer frame diagram by a mouse to acquire a screen coordinate when the mouse clicks; step three, extending coordinates of four corner points of the outer frame of the projection area: adjusting four-point coordinates of the manually acquired outer frame image until a polygon formed by four corner points of the manually acquired outer frame image is close to the outer frame image; step four, obtaining a manual mask image: and sequentially storing the coordinates of the four corners of the external frame image in the set to form a connected domain, and drawing the new connected domain set in an image with the same resolution as that of the camera to obtain a manual mask image. The invention provides a method for manually acquiring a mask image, which can effectively remove an interference area of a projector and improve the teaching quality of an interactive classroom.

Description

Manual mask image acquisition method for interactive classroom teaching system
Technical Field
The invention belongs to the field of image processing, and particularly relates to a manual mask image acquisition method for an interactive classroom teaching system.
Background
The interactive classroom teaching system is a system which is matched with equipment such as a projector, a computer, a camera and the like and can realize the functions of random finger touch control, interactive question answering, remote communication and the like on any smooth projection surface.
The interaction in the interactive classroom teaching system is realized by capturing images through a camera and processing the images through an image algorithm. Because the camera has a large visual field coverage surface which is larger than the projection surface of the projector, interference areas except the projection surface in the image are not required to be processed during image algorithm processing, and if the interference areas are not eliminated, the interaction in the interactive classroom teaching system is greatly influenced.
Therefore, a method for eliminating the interference area is urgently needed, and the mask image can be rapidly acquired.
Disclosure of Invention
The invention aims to provide a manual mask image acquisition method of an interactive classroom teaching system, which is characterized in that a projection image of a projector is captured by a camera and displayed on a computer screen image, a mouse is utilized to click an outer frame image of the computer screen to acquire coordinates of four corners, the coordinates are adjusted until the outer frame image is close to a real outer frame image, and then a connected domain formed by the adjusted coordinates is drawn in an image with the same resolution as that of the camera to obtain the manual mask image, so that the problems that the conventional interactive teaching system is easily disturbed by an unexpected region of a projection surface and the teaching quality is influenced are solved.
In order to solve the technical problems, the invention is realized by the following technical scheme:
the invention discloses a manual mask image acquisition method of an interactive classroom teaching system, which comprises the following steps:
step one, acquiring a projection region outer frame diagram: the image captured by the camera is put on a computer screen;
step two, acquiring coordinates of four corner points of the external block diagram of the projection area: sequentially clicking four corner points of the outer frame diagram by a mouse to acquire a screen coordinate when the mouse clicks;
step three, extending coordinates of four corner points of the outer frame of the projection area: adjusting four-point coordinates of the manually acquired outer frame image until a polygon formed by four corner points of the manually acquired outer frame image is close to the outer frame image;
step four, obtaining a manual mask image: and sequentially storing the coordinates of the four corners of the external frame image in the set to form a connected domain, and drawing the new connected domain set in an image with the same resolution as that of the camera to obtain a manual mask image.
Preferably, in the first step, the specific step of acquiring the block diagram outside the projection region is as follows:
step 1: putting a rectangular frame on a computer screen in a full screen mode;
step 2: capturing a projection image of the projector at the moment in the visible light mode by using a camera;
and 3, step 3: and throwing the captured image to a computer screen.
Preferably, in the second step, the four corner points of the outer frame map include: the outer frame diagram comprises an upper left corner point, an upper right corner point, a lower right corner point and a lower left corner point.
Preferably, in the third step, the four-point coordinates of the outer frame map are adjusted by manually adding or subtracting horizontal and vertical coordinates of the four-point coordinates until a polygon formed by the manually acquired four-corner points of the outer frame map is close to the outer frame map.
The invention has the following beneficial effects:
the invention captures the projection image of the projector through the camera and displays the projection image on the image of the computer screen, clicks the outer frame diagram of the computer screen by using the mouse to obtain the coordinates of four corners, adjusts the coordinates until the outer frame diagram is similar to the real outer frame diagram, and then draws the communication domain newly formed by the adjusted coordinates in the image with the same resolution as the camera to obtain the manual mask diagram, thereby removing the interference area of the projector and improving the teaching quality.
Of course, it is not necessary for any product in which the invention is practiced to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a step diagram of a manual mask diagram acquisition method of an interactive classroom teaching system according to the present invention;
FIG. 2 is a schematic view of an improved front projection screen showing a projection surface;
FIG. 3 is a schematic diagram of a computer screen displaying a white frame on a full screen;
FIG. 4 is a schematic diagram of a camera capturing a projector projected image in the state of FIG. 3;
FIG. 5 is a schematic diagram of the camera of FIG. 4 capturing an image projected onto a computer screen;
FIG. 6 is a schematic view of the projection screen of FIG. 5 showing the projection of an image from the computer screen;
FIG. 7 is a schematic view of the computer screen after the four-point coordinate adjustment of the outer frame diagram in FIG. 5;
FIG. 8 is a schematic view of the computer screen of FIG. 7 with an image projected onto a projection screen;
FIG. 9 is a schematic diagram of a structure for obtaining a manual mask map;
in the drawings, the components represented by the respective reference numerals are listed below:
1-projection screen, 2-interference area, 3-white frame, 4-projection area, 5-computer screen, 6-camera screen.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the present invention is a manual mask diagram obtaining method for an interactive classroom teaching system, including the following steps:
step one, as shown in fig. 3-5, obtaining a block diagram outside a projection area: the image captured by the camera is put on a computer screen;
step two, as shown in fig. 6, obtaining coordinates of four corner points of the outer frame of the projection area: sequentially clicking four corner points of the outer frame diagram by a mouse to acquire a screen coordinate when the mouse clicks;
step three, as shown in fig. 7-8, coordinates of four corner points of the block diagram outside the outward expansion projection area: adjusting four-point coordinates of the manually acquired outer frame image until a polygon formed by four corner points of the manually acquired outer frame image is close to the outer frame image;
step four, as shown in fig. 9, a manual mask map is obtained: and sequentially storing the four-corner coordinates of the externally expanded outer frame graph in a set mask Contour to form a connected domain mask Contour, and drawing the new connected domain mask Contour set in a black image with the same resolution as the camera by using a white painting brush to obtain a manual mask graph.
Referring to fig. 2, in general, the "interaction" in the interactive classroom teaching system is realized by capturing images through a camera and processing the images through an image algorithm; since the area covered by the camera view field is larger than the projection area 4 of the projector, the interference area 2 outside the white frame 3 has no practical effect, and therefore, the area of the interference area 2 on the projection screen 1 needs to be reduced as much as possible;
in the first step, the specific steps of obtaining the outside block diagram of the projection area are as follows:
step 1: as shown in fig. 3, a rectangular white frame is dropped on the computer screen in a full screen;
step 2: as shown in fig. 4, the projection image of the projector at this time is captured with the camera in the visible light mode;
and step 3: as shown in fig. 5, the captured image is projected onto a computer screen.
In the second step, the four corners of the outer frame diagram include: the outer frame diagram comprises an upper left corner point, an upper right corner point, a lower right corner point and a lower left corner point.
In the third step, the four-point coordinates of the outer frame image are adjusted by manually adding or subtracting the horizontal coordinates and the vertical coordinates of the four-point coordinates until the manually acquired polygon formed by the four corner points of the outer frame image is close to the outer frame image; coordinates of four corner points of the outer frame diagram are obtained by clicking an upper left corner point, an upper right corner point, a lower right corner point and a lower left corner point of the outer frame diagram by a mouse; according to a large number of experiments, the specific scheme of adding and subtracting the horizontal coordinate and the vertical coordinate of the four-point coordinate is as follows: the left upper corner point of the outer frame, the X horizontal coordinate is subtracted by 3, and the Y vertical coordinate is subtracted by 3; adding 3 to the X-axis and subtracting 3 from the Y-axis of the right upper corner point of the outer frame; adding 6 to the X horizontal coordinate and 6 to the Y vertical coordinate of the right lower corner point of the outer frame; the left lower corner of the outer frame, the X horizontal coordinate is subtracted by 6, and the Y vertical coordinate is added by 6;
one specific application of this embodiment is:
the operation method of the manual mask is as follows:
1. double-clicking a left mouse button on 4 vertexes of the white outer frame in sequence according to the left upper angular point, the right lower angular point and the left lower angular point to generate 4 green calibration points;
2. no double click in order and at the outer box vertex will generate a calibration point;
3. the generated index point can be dragged by clicking a left mouse button to realize adjustment;
4. the adjustment range can only be around the calibration point, and the adjustment range is beyond the calibration point and is regarded as invalid;
5. clicking the right mouse button to push out the manual mask, wherein the operation of the 4 calibration points fails, and otherwise, the operation is successful.
It should be noted that, in the above system embodiment, each included unit is only divided according to functional logic, but is not limited to the above division as long as the corresponding function can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
In addition, it is understood by those skilled in the art that all or part of the steps in the method for implementing the embodiments described above may be implemented by a program instructing associated hardware, and the corresponding program may be stored in a computer-readable storage medium.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.

Claims (4)

1. A manual mask image acquisition method of an interactive classroom teaching system is characterized by comprising the following steps:
step one, acquiring a projection region outer frame diagram: the image captured by the camera is put on a computer screen;
step two, acquiring coordinates of four corner points of the external block diagram of the projection area: sequentially clicking four corner points of the outer frame diagram by a mouse to acquire a screen coordinate when the mouse clicks;
step three, extending coordinates of four corner points of the outer frame of the projection area: adjusting four-point coordinates of the manually acquired outer frame image until a polygon formed by four corner points of the manually acquired outer frame image is close to the outer frame image;
step four, obtaining a manual mask image: sequentially storing coordinates of four corners of the externally expanded outline drawing in a set to form a connected domain, and drawing a new connected domain set in an image with the same resolution as that of the camera to obtain a manual mask drawing;
in the second step, the left mouse button is double-clicked on 4 vertexes of the white frame in sequence by the mouse according to the upper left corner point, the upper right corner point, the lower right corner point and the lower left corner point to generate 4 green calibration points; if the mouse is not in order and double-clicking on the white border vertices will not be able to generate the index points.
2. The method for acquiring the manual mask map of the interactive classroom teaching system as claimed in claim 1, wherein in the step one, the specific step of acquiring the outside block map of the projection area is as follows:
step 1: putting a rectangular frame on a computer screen in a full screen mode;
step 2: capturing a projection image of the projector at the moment in the visible light mode by using a camera;
and step 3: and throwing the captured image to a computer screen.
3. The method as claimed in claim 1, wherein in the second step, the four corner points of the outline border comprises: the outer frame diagram comprises an upper left corner point, an upper right corner point, a lower right corner point and a lower left corner point.
4. The method as claimed in claim 1, wherein in the third step, the four-point coordinate adjustment of the outer frame image is performed by manually adding or subtracting horizontal and vertical coordinates of the four-point coordinates until a polygon formed by the four-point points of the manually obtained outer frame image is similar to the outer frame image.
CN201810852767.5A 2018-07-30 2018-07-30 Manual mask image acquisition method for interactive classroom teaching system Active CN109062484B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810852767.5A CN109062484B (en) 2018-07-30 2018-07-30 Manual mask image acquisition method for interactive classroom teaching system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810852767.5A CN109062484B (en) 2018-07-30 2018-07-30 Manual mask image acquisition method for interactive classroom teaching system

Publications (2)

Publication Number Publication Date
CN109062484A CN109062484A (en) 2018-12-21
CN109062484B true CN109062484B (en) 2022-08-02

Family

ID=64831808

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810852767.5A Active CN109062484B (en) 2018-07-30 2018-07-30 Manual mask image acquisition method for interactive classroom teaching system

Country Status (1)

Country Link
CN (1) CN109062484B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102004375A (en) * 2009-08-27 2011-04-06 精工爱普生株式会社 Projector masks for calibrating projector-based display systems
CN105308503A (en) * 2013-03-15 2016-02-03 斯加勒宝展示技术有限公司 System and method for calibrating a display system using a short throw camera
CN105286893A (en) * 2014-06-06 2016-02-03 西门子公司 Method for operating an image recording device with touch screen and image recording device
CN106273487A (en) * 2016-08-17 2017-01-04 苏州秉创科技有限公司 A kind of DLP printing device projector light intensity autoalign unit and calibration steps

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103942794B (en) * 2014-04-16 2016-08-31 南京大学 A kind of image based on confidence level is collaborative scratches drawing method
US9857888B2 (en) * 2015-03-17 2018-01-02 Behr Process Corporation Paint your place application for optimizing digital painting of an image
CN105894470A (en) * 2016-03-31 2016-08-24 北京奇艺世纪科技有限公司 Image processing method and device
CN106507077B (en) * 2016-11-28 2018-07-24 江苏鸿信系统集成有限公司 Preventing collision method is corrected and blocked to projecting apparatus picture based on image analysis
CN107656637B (en) * 2017-08-28 2018-06-05 哈尔滨拓博科技有限公司 A kind of automation scaling method using the projected keyboard for choosing manually at 4 points
CN108269288B (en) * 2017-12-28 2020-07-24 中国科学院自动化研究所 Intelligent special-shaped projection non-contact interaction system and method
CN108256521B (en) * 2017-12-29 2021-06-22 济南中维世纪科技有限公司 Effective area positioning method for vehicle body color identification

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102004375A (en) * 2009-08-27 2011-04-06 精工爱普生株式会社 Projector masks for calibrating projector-based display systems
CN105308503A (en) * 2013-03-15 2016-02-03 斯加勒宝展示技术有限公司 System and method for calibrating a display system using a short throw camera
CN105286893A (en) * 2014-06-06 2016-02-03 西门子公司 Method for operating an image recording device with touch screen and image recording device
CN106273487A (en) * 2016-08-17 2017-01-04 苏州秉创科技有限公司 A kind of DLP printing device projector light intensity autoalign unit and calibration steps

Also Published As

Publication number Publication date
CN109062484A (en) 2018-12-21

Similar Documents

Publication Publication Date Title
CN106507077B (en) Preventing collision method is corrected and blocked to projecting apparatus picture based on image analysis
US10600169B2 (en) Image processing system and image processing method
CN110310319B (en) Illumination-separated single-view human body clothing geometric detail reconstruction method and device
TW583600B (en) Method of seamless processing for merging 3D color images
CN106604003B (en) Method and system for realizing curved-surface curtain projection through short-focus projection
US20090262217A1 (en) Method and apparatus for an automated background lighting compensation system
CN110324534B (en) Image processing method and device and electronic equipment
US5270820A (en) Method and apparatus for tracking a pointing device in a video field
CN111369659A (en) Texture mapping method, device and equipment based on three-dimensional model
CN112351325B (en) Gesture-based display terminal control method, terminal and readable storage medium
CN106561044B (en) Processing method and system for black edge of vertical screen video on android system
CN109598736A (en) The method for registering and device of depth image and color image
CN114697623A (en) Projection surface selection and projection image correction method and device, projector and medium
CN107580203B (en) Immersion active stereo projective perspective transformation matrix solving method
CN109062484B (en) Manual mask image acquisition method for interactive classroom teaching system
CN108197596A (en) A kind of gesture identification method and device
CN104516482A (en) Shadowless projection system and method
CN109493288B (en) Light spot self-adaptive mapping method for interactive classroom teaching system
JP4554231B2 (en) Distortion parameter generation method, video generation method, distortion parameter generation apparatus, and video generation apparatus
CN109885172B (en) Object interaction display method and system based on Augmented Reality (AR)
JP6549764B1 (en) IMAGE PROJECTION SYSTEM, IMAGE PROJECTION METHOD, AND PROGRAM
CN111179299A (en) Image processing method and device
CN109917974B (en) Non-linear point coordinate mapping method for interactive projection system
CN114860184A (en) Processing device, system and method for blackboard writing display
CN111192227B (en) Fusion processing method for overlapped pictures

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 230000 Yafu Park, Juchao Economic Development Zone, Chaohu City, Hefei City, Anhui Province

Applicant after: ANHUI HUISHI JINTONG TECHNOLOGY Co.,Ltd.

Address before: 230000 Room 102, 1st Floor, C District, Science Park, Hefei National University, 602 Huangshan Road, Hefei High-tech Zone, Anhui Province

Applicant before: ANHUI HUISHI JINTONG TECHNOLOGY Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant