CN110471545A - It is a kind of based on infrared image identification PPT delineate device and PPT delineation method - Google Patents

It is a kind of based on infrared image identification PPT delineate device and PPT delineation method Download PDF

Info

Publication number
CN110471545A
CN110471545A CN201910733000.5A CN201910733000A CN110471545A CN 110471545 A CN110471545 A CN 110471545A CN 201910733000 A CN201910733000 A CN 201910733000A CN 110471545 A CN110471545 A CN 110471545A
Authority
CN
China
Prior art keywords
infrared light
light spot
ppt
infrared
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910733000.5A
Other languages
Chinese (zh)
Inventor
黄永杰
蔡洽凯
曾云辉
黄丽
胡文娟
孔锐
罗勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jinan University
University of Jinan
Original Assignee
Jinan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jinan University filed Critical Jinan University
Priority to CN201910733000.5A priority Critical patent/CN110471545A/en
Publication of CN110471545A publication Critical patent/CN110471545A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03542Light pens for emitting or receiving light
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention belongs to computer fields to remain the use habit of PPT Pen for turning page to delineate device and PPT delineation method based on the PPT that infrared image identifies, it is uncomfortable and the problem of can not detect translation to avoid gyroscope equipment bring.Apparatus of the present invention include wireless remote control pen, infrared camera and image processor;Wireless remote control pen is equipped with visible red laser emitter, Infrared laser emission device, red switch and delineates key, and wireless remote control pen will delineate signal and be sent to computer;Image processor receives the image that infrared camera takes and is handled, extract the coordinate of infrared light spot and be sent to computer;When computer, which receives, delineates signal, left mouse button is pressed in control while opening PPT paintbrush;When computer receives the infrared light spot coordinate that image processor transmits, control mouse is mobile, draws trace.

Description

It is a kind of based on infrared image identification PPT delineate device and PPT delineation method
Technical field
The present invention relates to computer field, especially a kind of PPT based on infrared image identification delineates device and PPT is delineated Method.
Background technique
Medium technique is widely used in giving lessons for teacher, and complex abstract change procedure originally is changed more by it Visual pattern, so that audient is easier to understand absorption.During being given lessons using multimedia technology, laser pen complex chart As the human-computer interaction technology of the technologies such as processing, pattern-recognition completion interactive instruction, it is advantageous that getting rid of Desktop Computing mode The limitation of distance increases interactive mobile flexibility and natural universality, becomes religion essential to almost each teacher Learn auxiliary tool.The function of page turning and laser may be implemented in traditional laser pen.But it is quick with multimedia teaching cause Development, people put forward higher requirements the function of laser pen, thus on the basis of conventional laser pen, develop scribing line There is the laser pen of scribing line identification function to teach auxiliary tool for laser pen and air mouse etc..
Scribing line laser pen key technology be to get rid of desktop, realize in the sky for PPT scribing line mark.It is existing at present Product realizes that scribing line function is the principle based on gyroscope.This auxiliary tool control of religion is difficult to be adapted to and is difficult to when translation Detect its motion profile to achieve the purpose that scribing line.And the laser pen based on infrared image processing, infrared ray and image are known It is not combined with processing, can capture infrared light spot information all on projection screen, realize the accessible scribing line of all directions, It has well solved based on gyroscope and can not achieve the problem of translation is crossed.And the laser pen shape based on infrared image processing It is small and exquisite, it is easy to operate and fast, it is easily controllable.Product is the development of multimedia education cause, is provided a great convenience.
As the mankind enter informationized society, instructional technology and platform are constantly progressive.Multimedia teaching platform is a kind of Together with the information knowledge integrated treatment of the forms such as text, figure, image, animation and sound, it is made into courseware, and pass through computer Equal soft and hardwares carry out integrated control, in classroom or speech, complete the technology platform of series of interactive operation.It will be originally Complex abstract change procedure changes to obtain more visual pattern, so that audient is easier to understand absorption.It may be implemented long-range The series of interactive operations such as real time education, speech training.
During being given lessons using multimedia technology, the technologies such as laser pen combination image procossing, pattern-recognition are complete At the human-computer interaction technology of interactive instruction, the limitation of Desktop Computing pattern distance is got rid of, increases interactive mobile flexibility And natural universality, almost become the teaching tool of each teacher's indispensability.Several frequently seen laser pen currently on the market Function and advantage and disadvantage it is as follows: laser pointer have laser indication function, improve Students' enthusiasm simultaneously also can avoid teacher Projected picture is blocked, but function is too simple, use occasion is limited;Common laser pen has the simple of page turning and laser display Function, it have many advantages, such as it is cheap, last a long time, control simplicity, but its function is less, can not cross mark on the screen Note can not amplify screen;The PPT Pen for turning page that can be marked has PPT page-turning function, can the underlining in PPT, but can only Used in PPT, and be based on gyroscope, control it is difficult adapt to, when translation, can not detect to move;Air mouse is capable of being taken away from desktop The basic function for controlling screen, realizing mouse, but it does not meet teacher's use habit, is easy to appear shake, and is based on gyro Instrument, control it is difficult adapt to, when translation, can not detect to move.As it can be seen that existing laser pen all has some limitations.
Summary of the invention
To solve technical problem present in the prior art, the present invention provides a kind of PPT hook based on infrared image identification Picture device and PPT delineation method, remain the use habit of PPT Pen for turning page, avoid gyroscope equipment bring it is uncomfortable with And the problem of translation can not be detected.
PPT according to the present invention based on infrared image identification delineates device, including wireless remote control pen, infrared camera and Image processor;Wireless remote control pen be equipped with visible red laser emitter, Infrared laser emission device, red switch and delineate by Key, it is seen that the infrared laser that the visible red and Infrared laser emission device that red laser transmitter issues issue falls within projection screen Same point, wireless remote control pen will be sent to computer to the signal of delineating of PPT;Image processor receives infrared camera and takes Image and handled, extract the coordinate of infrared light spot, infrared light spot coordinate be sent to computer;
When computer receive that wireless remote control pen transmits when delineating signal, mouse is pressed in control while opening PPT paintbrush Left button;When computer receives the infrared light spot coordinate that image processor transmits, control mouse is mobile, draws trace.
In the preferred scheme, when pinning red switch, it is seen that red laser transmitter issues visible red;Work as double-click When red switch, it is seen that red laser transmitter issues visible red, and keeps being always on, and just closes until double-clicking red switch again Close visible red;It double-clicks after opening red switch, delineates key when pressing, the sending of Infrared laser emission device is overlapped with visible red Infrared laser.
PPT delineation method of the present invention is based on above-mentioned PPT and delineates device, comprising the following steps:
S1, unlatching PPT delineate device, and PPT delineates device and enters screen correction state;
S2, operation wireless remote control pen make it be directed toward the upper left corner of projection screen;
S3, infrared camera take the infrared light spot on projection screen, and infrared light spot image is sent at image Manage device;
S4, image processor handle infrared light spot image, obtain the coordinate (x of infrared light spot0, y0);
S5, step S2 to S4 is repeated three times, the difference is that being successively directed toward the upper right of projection screen with wireless remote control pen three times Angle, the lower left corner, the lower right corner, and the coordinate for the infrared light spot that successively will acquire is denoted as (x1, y1)、(x2, y2)、(x3, y3);According to The coordinate of four infrared light spots calculates transformation matrix parameter, obtains transformation matrix;
S6, PPT delineate device and enter working condition, and wireless remote control pen will open PPT paintbrush and delineate letter with prepare to draw lines Number it is sent to computer;
S7, infrared camera take the infrared light spot on projection screen, and infrared light spot image is sent at image Manage device;
S8, image processor handle infrared light spot image, obtain infrared light spot coordinate (xC, yC);It is calculated according to S5 Obtained transformation matrix and infrared light spot coordinate (xC, yC) mouse coordinates (u, v) is calculated, and it is sent to computer;
S9, computer receive the signal of delineating that wireless remote control pen transmits, and press left mouse button while opening PPT paintbrush; Computer receives the mouse coordinates signal that image processor transmits simultaneously, and control mouse is moved to mouse coordinates (u, v), thus even A short-term section draws mark out;
Repeat the above steps S6 to S9, and trace is drawn on PPT, and the trace is drawn mark by a plurality of short-term section and formed, until It is unidentified in certain time to arrive infrared light spot.
In the preferred scheme, in step S1 PPT delineate device enter screen correction state and step S6 in PPT delineate dress Set enter working condition when, Infrared laser emission device issue it is parallel with the visible red that visible red laser emitter is issued Infrared laser, it is seen that feux rouges and infrared laser are fallen in the same point of projection screen.
According to transformation matrix and infrared light spot coordinate (x in step S8C, yC) calculate mouse coordinates (u, v) formula are as follows:
In step S5, the coordinate (x of four infrared light spots0, y0)、(x1, y1)、(x2, y2)、(x3, y3) respectively correspond (0,0), (screen_w, 0), (0, screen_h), (screen_w, screen_h) calculate the formula of transformation matrix parameter are as follows:
Wherein, (xi, yi) it is the image coordinate that camera takes, (ui, vi) be mapping after image coordinate, tiIt is to be solved Parameter, i=0,1,2,3, (screen_w, screen_h) is the resolution width and height of computer screen.
Compared with the prior art, the invention has the following advantages and beneficial effects: on the one hand, the present invention uses infrared image Know otherwise, remain the use habit of PPT Pen for turning page, it is uncomfortable and can not detect to avoid gyroscope equipment bring The problem of translation;On the other hand, using international BLE HID protocol, electricity is passed to by wireless remote control pen and image processor Brain is all BLE HID order, and computer can use the present apparatus without additionally mounted software or configuration surroundings.
Detailed description of the invention
Fig. 1 is structural schematic diagram of the invention;
Fig. 2 is the structural schematic diagram of wireless remote control pen.
Specific embodiment
Present invention will now be described in further detail with reference to the embodiments and the accompanying drawings, but embodiments of the present invention are unlimited In this.
Embodiment
As shown in Figure 1, 2, the present embodiment delineates device based on the PPT that infrared image identifies, including wireless remote control pen 1, red Outer camera 2 and image processor 3.
A visible red laser emitter 1.1 and an Infrared laser emission device 1.2 are equipped at the top of wireless remote control pen 1, Visible red laser emitter 1.1 can issue naked eyes visible red, and Infrared laser emission device 1.2 can issue feature wavelength Infrared laser;Visible red laser emitter is parallel with Infrared laser emission device to be installed.Wireless remote control pen is additionally provided with red switch 1.3 and key 1.4 is delineated, when pinning red switch 1.3, it is seen that red laser transmitter 1.1 issues visible red;Work as double-click When red switch 1.3, it is seen that red laser transmitter 1.1 issues visible red, and keeps being always on, and opens until double-clicking feux rouges again It closes 1.3 and just closes feux rouges;It double-clicks after opening red switch 1.3, delineates key 1.4 when pressing, Infrared laser emission device 1.2 issues The infrared laser being almost overlapped with visible red, it is seen that feux rouges and infrared laser are almost fallen in the same point of projection screen 4.This Outside, wireless remote control pen 1 also has bluetooth transmitters, can will be sent to the signal of delineating of PPT with the format of BLE HID protocol Computer 5.As a preferred embodiment, can also have other keys on wireless remote control pen 1, other keys can be set to PPT page turning, The keys such as mouse right and left key, screen magnifying.
Infrared camera 2 is narrowband infrared camera, and the infrared light for only Infrared laser emission device being allowed to issue passes through, and Function with anti-distortion;The image that infrared camera takes is passed directly to image processor and is handled.
Image processor 3 can receive the image that infrared camera transmits, by image segmentation, Morphological scale-space and hot spot It extracts, extracts the coordinate of infrared light spot.Image processor has bluetooth transmitters, by infrared light spot coordinate with BLE HID association The format of view is sent to computer 5.In addition, screen correction key is additionally provided on image processor 3, when by sub-screen correction key When, four corners of projection screen 4 are successively irradiated using wireless remote control pen 1, can positioning projection's curtain 4, in image processor 3 Portion will use algorithm to correct perspective distortion, and the correction algorithm of transmitted distortion can be called directly in opencv, step as detailed below S5、S86。
When computer 5 receive that wireless remote control pen 1 transmits when delineating signal, delineate signal and correspond to keyboard shortcut and mouse Left button, left mouse button is pressed in control while opening PPT paintbrush;Simultaneously computer 5 can also receive image processor 3 transmit it is red Outer hot spot coordinate, infrared light spot coordinate pair answer mouse coordinates, and control mouse is mobile, draws trace.
On the basis of the above-mentioned PPT based on infrared image identification delineates device, the present embodiment also proposes a kind of based on red The PPT delineation method of outer image recognition, the delineation method the following steps are included:
Step S1, infrared camera and image processor are placed, and makes projection screen in the coverage of infrared camera It is interior;It opens the screen on image processor and corrects key, PPT delineates device and enters screen correction state, double-clicks wireless remote control pen On red switch, it is seen that red laser transmitter issues visible red, and keeps being always on until double-click again;Feux rouges is opened to open It closes and keeps after being always on, delineate key when pressing, Infrared laser emission device issues the infrared laser parallel with visible red, it is seen that Feux rouges and infrared laser are almost fallen in the same point of projection screen.
Step S2, operation wireless remote control pen makes it be directed toward the upper left corner of projection screen.
Step S3, infrared camera takes the infrared light spot on projection screen, and infrared light spot image is sent to figure As processor.
Step S4, image processor handles infrared light spot image, obtains the coordinate of infrared light spot, specifically includes:
Step S41, infrared light spot image is switched into grayscale image, which can call directly the cvtColor of OpenCV () function.
Step S42, binary conversion treatment is carried out to infrared light spot image, treatment process may be expressed as:
Wherein, Grey (x, y) is former grayscale image, and G (x, y) is the image after binary conversion treatment, and k is binarization threshold, should Binary conversion treatment process can call directly threshold () function of OpenCV.
Step S43, corrosion treatment is carried out to infrared light spot image, eliminating noise and veiling glare, corrosion treatment process can indicate Are as follows:
Wherein, X is the infrared light spot before corrosion, BaIt is obtained after translating a by structure B, corrosion treatment process can call directly Erode () function of OpenCV.
Step S44, the infrared light spot that area is excessive and too small in infrared light spot image is deleted, Retention area is suitably infrared Hot spot, if environmental disturbances are little, this step is not required, it is however generally that, an infrared light can be only left after this step Spot.
Step S45, infrared light spot coordinate is calculated, the centroid method that discrete picture can be used is calculated:
Wherein, (xC, yC) it is infrared light spot centroid coordinate, (xi, yi) it is each pixel of infrared light spot, N is infrared light spot picture Vegetarian refreshments number.
Step S46, image processor writes down the centroid coordinate (x of current infrared light spot0, y0), and it is denoted as (x0, y0)。
Step S5, it repeats the above steps S2 to step S4 three times, is thrown the difference is that being successively directed toward three times with wireless remote control pen The upper right corner, the lower left corner, the lower right corner of shadow curtain, and the centroid coordinate for the infrared light spot that successively will acquire is denoted as (x1, y1)、 (x2, y2)、(x3, y3);Coordinate (the x of infrared light spot0, y0)、(x1, y1)、(x2, y2)、(x3, y3), respectively correspond (0,0), (screen_w, 0), (0, screen_h), (screen_w, screen_h) calculate transformation matrix parameter Cmn(m, n=0,1,2), Calculation formula are as follows:
Wherein, (xi, yi) it is the image coordinate that camera takes, (ui, vi) be mapping after image coordinate, tiIt is to be solved Parameter, i=0,1,2,3, (screen_w, screen_h) is the resolution width and height of computer screen, which can GetPerspectiveTransform () function of OpenCV is called directly, the transformation matrix being calculated will be used for subsequent control Mouse processed is mobile.
Step S6, the screen closed on image processor corrects key, and PPT delineates device and enters working condition, double-clicks nothing Red switch on line remote control pen, it is seen that red laser transmitter issues visible red, and keeps being always on until double-clicking again;It beats It opens red switch and keeps after being always on, delineate key when pressing, Infrared laser emission device issues parallel with visible red infrared Laser, it is seen that feux rouges and infrared laser are almost fallen in the same point of projection screen, while wireless remote control pen uses Bluetooth transmission Device sends a signal to computer with the format of BLE HID protocol, transmitted signal include keyboard shortcut (opening PPT paintbrush) and Left mouse button is pressed and (prepares setting-out).
Step S7, infrared camera takes the infrared light spot on projection screen, and infrared light spot image is sent to figure As processor.
Step S8, image processor handles infrared light spot image, obtains the coordinate of infrared light spot, specifically includes:
Step S81, infrared light spot image is switched into grayscale image, which can call directly the cvtColor of OpenCV () function.
Step S82, binary conversion treatment is carried out to infrared light spot image, binary conversion treatment process may be expressed as:
Wherein, Grey (x, y) is former grayscale image, and G (x, y) is the image after binary conversion treatment, and k is binarization threshold, should Binary conversion treatment process can call directly threshold () function of OpenCV.
Step S83, corrosion treatment is carried out to infrared light spot image, eliminating noise and veiling glare, corrosion treatment process can indicate Are as follows:
Wherein, X is the infrared light spot before corrosion, BaIt is obtained after translating a by structure B, corrosion treatment process can call directly Erode () function of OpenCV.
Step S84, the infrared light spot that area is excessive and too small in infrared light spot image is deleted, Retention area is suitably infrared Hot spot, if environmental disturbances are little, this step is not required, it is however generally that, an infrared light can be only left after this step Spot.
Step S85, infrared light spot coordinate is calculated, the centroid method that discrete picture can be used is calculated:
Wherein, (xC, yC) it is infrared light spot centroid coordinate, (xi, yi) it is each pixel of infrared light spot, N is infrared light spot picture Vegetarian refreshments number.
Step S86, according to the above-mentioned transformation matrix being calculated and infrared light spot coordinate (xC, yC) calculating mouse coordinates (u, V):
Using bluetooth transmitters, computer is sent a signal to the format of BLE HID protocol, transmitted signal is mouse seat Mark;
Step S9, computer receives the signal of delineating that wireless remote control pen transmits, and a mouse left side is pressed while opening PPT paintbrush Key;Computer can also receive the mouse coordinates signal that image processor transmits simultaneously, and control mouse is moved to (u, v), thus even A short-term section draws mark out.
Repeat the above steps S6 to S9, and trace can be drawn on PPT, which draws mark by a plurality of short-term section and form, until It is unidentified in certain time to arrive infrared light spot, then enter step S10:
Step S10, image processor is unidentified within a certain period of time arrives infrared light spot, using bluetooth transmitters with BLE The format of HID protocol sends a signal to computer, and transmitted signal includes keyboard shortcut (closing PPT paintbrush) and left mouse button It unclamps and (closes setting-out).
The above embodiment is a preferred embodiment of the present invention, but embodiments of the present invention are not by above-described embodiment Limitation, other any changes, modifications, substitutions, combinations, simplifications made without departing from the spirit and principles of the present invention, It should be equivalent substitute mode, be included within the scope of the present invention.

Claims (10)

1. a kind of PPT based on infrared image identification delineates device, which is characterized in that including wireless remote control pen, infrared camera And image processor;Wireless remote control pen is equipped with visible red laser emitter, Infrared laser emission device, red switch and delineates Key, it is seen that the infrared laser that the visible red and Infrared laser emission device that red laser transmitter issues issue falls within projection screen The same point of cloth, wireless remote control pen will be sent to computer to the signal of delineating of PPT;Image processor receives infrared camera shooting To image and handled, extract the coordinate of infrared light spot, infrared light spot coordinate be sent to computer;
When computer receive that wireless remote control pen transmits when delineating signal, left mouse button is pressed in control while opening PPT paintbrush; When computer receives the infrared light spot coordinate that image processor transmits, control mouse is mobile, draws trace.
2. PPT according to claim 1 delineates device, which is characterized in that when pinning red switch, it is seen that red laser Transmitter issues visible red;When double-clicking red switch, it is seen that red laser transmitter issues visible red, and keeps normal It is bright, until double-clicking red switch again just closes visible red;It double-clicks after opening red switch, delineates key when pressing, it is infrared Laser emitter issues the infrared laser being overlapped with visible red.
3. PPT according to claim 1 delineates device, which is characterized in that the infrared camera is narrowband infrared photography Head, and have the function of anti-distortion.
4. PPT according to claim 1 delineates device, which is characterized in that be additionally provided with screen on described image processor and rectify Positive key is successively irradiated four corners of projection screen using wireless remote control pen, can positioned when by sub-screen correction key Projection screen.
5. PPT according to claim 1 delineates device, which is characterized in that the visible red laser emitter and infrared Laser emitter is installed in parallel.
6. delineating the PPT delineation method of device based on PPT described in claim 1, which comprises the following steps:
S1, unlatching PPT delineate device, and PPT delineates device and enters screen correction state;
S2, operation wireless remote control pen make it be directed toward the upper left corner of projection screen;
S3, infrared camera take the infrared light spot on projection screen, and infrared light spot image is sent to image processor;
S4, image processor handle infrared light spot image, obtain the coordinate (x of infrared light spot0, y0);
S5, step S2 to S4 is repeated three times, the difference is that being successively directed toward the upper right corner, the left side of projection screen with wireless remote control pen three times Inferior horn, the lower right corner, and the coordinate for the infrared light spot that successively will acquire is denoted as (x1, y1)、(x2, y2)、(x3, y3);According to four The coordinate of infrared light spot calculates transformation matrix parameter, obtains transformation matrix;
S6, PPT delineate device and enter working condition, and wireless remote control pen sends out the signal of delineating opened PPT paintbrush and prepare to draw lines Give computer;
S7, infrared camera take the infrared light spot on projection screen, and infrared light spot image is sent to image processor;
S8, image processor handle infrared light spot image, obtain infrared light spot coordinate (xC, yC);It is calculated according to S5 Transformation matrix and infrared light spot coordinate (xC, yC) mouse coordinates (u, v) is calculated, and it is sent to computer;
S9, computer receive the signal of delineating that wireless remote control pen transmits, and press left mouse button while opening PPT paintbrush;Simultaneously Computer receives the mouse coordinates signal that image processor transmits, and control mouse is moved to mouse coordinates (u, v), to connect one Short-term section draws mark;
Repeat the above steps S6 to S9, and trace is drawn on PPT, and the trace is drawn mark by a plurality of short-term section and formed, until certain It is unidentified in time to arrive infrared light spot.
7. PPT delineation method according to claim 6, which is characterized in that in step S1 PPT delineate device enter screen rectify When PPT delineates device and enters working condition in positive status and step S6, Infrared laser emission device is issued to be sent out with visible red laser The parallel infrared laser of the visible red that emitter is issued, it is seen that feux rouges and infrared laser are fallen in the same point of projection screen.
8. PPT delineation method according to claim 6, which is characterized in that according to transformation matrix and infrared light in step S8 Spot coordinate (xC, yC) calculate mouse coordinates (u, v) formula are as follows:
In step S5, the coordinate (x of four infrared light spots0, y0)、(x1, y1)、(x2, y2)、(x3, y3) respectively correspond (0,0), (screen_w, 0), (0, screen_h), (screen_w, screen_h) calculate the formula of transformation matrix parameter are as follows:
Wherein, (xi, yi) it is the image coordinate that camera takes, (ui, vi) be mapping after image coordinate, tiFor ginseng to be solved Number, i=0,1,2,3, (screen_w, screen_h) is the resolution width and height of computer screen.
9. PPT delineation method according to claim 6, which is characterized in that step S4 includes:
S41, infrared light spot image is switched into grayscale image;
S42, binary conversion treatment is carried out to infrared light spot image;
S43, corrosion treatment is carried out to infrared light spot image, eliminates noise and veiling glare;
S44, infrared light spot coordinate is calculated using the centroid method of discrete picture:
Wherein, (xC, yC) it is infrared light spot centroid coordinate, (xi, yi) it is each pixel of infrared light spot, N is infrared light spot pixel Number;
S45, image processor write down coordinate (x of the centroid coordinate as infrared light spot of current infrared light spot0, y0)。
10. PPT delineation method according to claim 6, which is characterized in that step S8 includes:
S81, infrared light spot image is switched into grayscale image;
S82, binary conversion treatment is carried out to infrared light spot image;
S83, corrosion treatment is carried out to infrared light spot image, eliminates noise and veiling glare;
S84, infrared light spot coordinate is calculated using the centroid method of discrete picture:
Wherein, (xC, yC) it is infrared light spot coordinate, (xi, yi) it is each pixel of infrared light spot, N is infrared light spot pixel number; S86, the transformation matrix and infrared light spot coordinate (x obtained according to step S5C, yC) calculate mouse coordinates (u, v).
CN201910733000.5A 2019-08-09 2019-08-09 It is a kind of based on infrared image identification PPT delineate device and PPT delineation method Pending CN110471545A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910733000.5A CN110471545A (en) 2019-08-09 2019-08-09 It is a kind of based on infrared image identification PPT delineate device and PPT delineation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910733000.5A CN110471545A (en) 2019-08-09 2019-08-09 It is a kind of based on infrared image identification PPT delineate device and PPT delineation method

Publications (1)

Publication Number Publication Date
CN110471545A true CN110471545A (en) 2019-11-19

Family

ID=68510563

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910733000.5A Pending CN110471545A (en) 2019-08-09 2019-08-09 It is a kind of based on infrared image identification PPT delineate device and PPT delineation method

Country Status (1)

Country Link
CN (1) CN110471545A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021217882A1 (en) * 2020-04-29 2021-11-04 深圳市华星光电半导体显示技术有限公司 Light beam emitter and display device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102880360A (en) * 2012-09-29 2013-01-16 东北大学 Infrared multipoint interactive electronic whiteboard system and whiteboard projection calibration method
CN108021243A (en) * 2016-10-31 2018-05-11 中国移动通信有限公司研究院 A kind of virtual mouse method for determining position, apparatus and system
US20180307335A1 (en) * 2017-04-19 2018-10-25 Chung Yuan Christian University Laser spot detecting and locating system and method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102880360A (en) * 2012-09-29 2013-01-16 东北大学 Infrared multipoint interactive electronic whiteboard system and whiteboard projection calibration method
CN108021243A (en) * 2016-10-31 2018-05-11 中国移动通信有限公司研究院 A kind of virtual mouse method for determining position, apparatus and system
US20180307335A1 (en) * 2017-04-19 2018-10-25 Chung Yuan Christian University Laser spot detecting and locating system and method thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021217882A1 (en) * 2020-04-29 2021-11-04 深圳市华星光电半导体显示技术有限公司 Light beam emitter and display device

Similar Documents

Publication Publication Date Title
CN106055091B (en) A kind of hand gestures estimation method based on depth information and correcting mode
EP0622722B1 (en) Interactive copying system
CN105868715B (en) Gesture recognition method and device and gesture learning system
CN108509026B (en) Remote maintenance support system and method based on enhanced interaction mode
CN103019466B (en) Based on the projection interaction system of infrared acquisition
CN106502570A (en) A kind of method of gesture identification, device and onboard system
CN105536205A (en) Upper limb training system based on monocular video human body action sensing
CN103207709A (en) Multi-touch system and method
CN103092437B (en) A kind of Portable touch interactive system based on image processing techniques
CN108806371A (en) A kind of intelligent decision method and system based on Driving Test Subject training
Pramada et al. Intelligent sign language recognition using image processing
CN107291346A (en) Drafting content processing method, device and the terminal device of terminal device
US20020140682A1 (en) Optical drawing tablet
CN108153502A (en) Hand-held augmented reality display methods and device based on transparent screen
CN114445853A (en) Visual gesture recognition system recognition method
CN106503619A (en) Gesture identification method based on BP neural network
CN110471545A (en) It is a kind of based on infrared image identification PPT delineate device and PPT delineation method
CN103927014A (en) Character input method and device
CN110058688A (en) A kind of projection system and method for dynamic gesture page turning
CN104965625B (en) A kind of Visual Teaching display systems
CN203950270U (en) Body sense recognition device and by the man-machine interactive system of its mouse beacon keyboard operation
CN113807287A (en) 3D structured light face recognition method
Vidhate et al. Virtual paint application by hand gesture recognition system
CN203311660U (en) Intelligent electronic blackboard
CN106774995B (en) A kind of three-dimensional style of brushwork recognition methods based on localization by ultrasonic

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination