CN110297556A - A kind of electronic projection drawing board system and its processing method based on image recognition technology - Google Patents
A kind of electronic projection drawing board system and its processing method based on image recognition technology Download PDFInfo
- Publication number
- CN110297556A CN110297556A CN201910591343.2A CN201910591343A CN110297556A CN 110297556 A CN110297556 A CN 110297556A CN 201910591343 A CN201910591343 A CN 201910591343A CN 110297556 A CN110297556 A CN 110297556A
- Authority
- CN
- China
- Prior art keywords
- laser
- module
- drawing board
- signal
- electronic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F3/0383—Signal control means within the pointing device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F3/0386—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry for light pen
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
Abstract
A kind of electronic projection drawing board system and its processing method based on image recognition technology；Including laser pen, electronic drawing board processing unit, photographing module, projector, projection screen；Wherein electronic drawing board processing unit includes reception of wireless signals module, bluetooth receiving module, image processing module, display module；Laser pen includes nib, pressure sensor device, laser emitter, function switch switch, function button, bluetooth module；Photographing module includes to set video camera, wireless signal generation module；Laser pen has drawing board mode and mouse mode both of which；Drawing board Mode for Laser connects straight to be write on projection screen, system identification laser point, is formed drawing board track, is projected on projection screen；Mouse mode laser pen remotely issues laser, and system identification laser point forms mouse track, and cooperation function of laser pointer key completes mouse control.
Description
Technical field
The present invention relates to projection demonstration technical field more particularly to a kind of electronic projection drawing boards based on image recognition technology
System and its processing method.
Background technique
There are many function is not perfect for current optical projection system.For example, teacher is when teaching is imparted knowledge, it is also necessary to be existed with chalk
It is write on blackboard, emphasis can not be marked on lantern slide, some is this white also merely by matched whiteboard system
Plate system is made of a large amount of sensor, and the density and precision of sensor often determine the precision of drawing board, so it is more accurate
Blank it is just more expensive, and blank is needed to connect with projector in advance and be corrected.
Existing blank and projector integrated system technical disadvantages:
1. correcting cumbersome.Timing needs repeatedly to be corrected on blank with pen, could substantially guarantee handwriting trace and pen tip
Track is identical.If projector is accidentally touched, also need to re-calibrate.
2. equipment is cumbersome.Current this equipment can only be attached to use with specific blank, can not achieve throwing
Which shadow instrument, which throws into, to be write where.
3. cost is high.Current this equipment, needs mating blank, this just inevitably promotes the expense of manufacture with maintenance.
4. application direction is limited.Current this equipment when in use, need to build relevant device in advance, only apply at present
Education sector.
Summary of the invention
In view of the deficienciess of the prior art, it is an object of the invention to provide a kind of electronic projections based on image recognition technology
Drawing board system and its processing method, the system capture the motion profile of laser pen, application image processing technique using photographing module
It realizes the operation of the electronic drawing board in computer, then the results are shown on projection screen, laser pen can also be existed as mouse
Directly computer is operated on large screen, large screen both can be used and be used to substitute blackboard, realizes no chalk teaching, and can
To reduce screen to desktop, Trackpad use is served as.Greater ease of operation difficulty reduces cost, realizes convenient projection and writes
Operation.
To achieve the above object, the technical scheme adopted by the invention is as follows: build a kind of electronics based on image recognition technology
Project drawing board system；Including laser pen, electronic drawing board processing unit, photographing module, projector, projection screen；Wherein electronic drawing board
Processing unit includes reception of wireless signals module, bluetooth receiving module, image processing module, display module；Laser pen includes pen
Head, pressure sensor device, laser emitter, function switch switch, function button, bluetooth module；Photographing module includes to set camera shooting
Module occurs for machine, wireless signal, in which:
For receiving the wireless signal in photographing module the picture signal that module issues occurs for reception of wireless signals module,
And transmit a signal to image processing module；
Bluetooth receiving module for receiving the control signal of the sending of the bluetooth module in laser pen, and transmits a signal to
Image processing module；
Image processing module, laser point coordinates in received picture signal for identification, by laser point coordinates convert to
Drawing board coordinate or mouse coordinates, and coordinate and control signal are sent to display module；
Display module, for being drawing board track or mouse track by the coordinate transformation of image processing module, by track, control
Signal and project content combine, and generate new project content；
Laser pen is radiated at projection screen for writing directly on projection screen or remotely issuing laser point, and is controlled
System operation, control operation signal are transferred to the Bluetooth Receiver of electronic drawing board processing unit by bluetooth module；
Photographing module is used for real-time capture projection screen image, and module occurs by data transport Electronic by wireless signal
The signal receiver of drawing board processing unit.
A kind of electronic projection drawing board system based on image recognition technology of the present invention, the nib of laser pen are transparent
What plastics were made into can dismantle cylinder, play the role of guiding laser.
The written tail portion of a kind of electronic projection drawing board system based on image recognition technology of the present invention, laser pen connects
Pressure sensor device is connect, pressure sensor device connects laser emitter, and the Laser emission mouth of laser emitter is directed at nib；Laser
Function switch switch in pen is drawing board function, and pressure sensor device detects pressure control laser emitter hair when nib is write
Laser out.
A kind of electronic projection drawing board system based on image recognition technology of the present invention, laser pen contain spring, swash
Photoswitch and function button；Laser switch and function button are located on the shell of laser pen；Spring one end connects the outer of laser pen
Shell, the other end connect bluetooth module；The connection of the emission port opposite end of the bluetooth module other end and laser emitter；Laser emission
The emission port of device connects pressure sensor device, and the other end of pressure sensor device is connect with written tail portion, and written head is straight
It connects and is write on projection screen；Nib, pressure sensor device, laser emitter, bluetooth module, spring are placed at same level；Bullet
Spring can play a protective role when laser pen falls；Laser switch can control the opening and closing of laser pen；Laser pen function
It is mouse function that switch, which can be switched, and function button can be used as the left button of mouse, right button uses.
A kind of electronic projection drawing board system based on image recognition technology of the present invention, photographing module, which contains two, to be taken the photograph
Camera；Two video cameras are mutually perpendicular to be respectively arranged in the intersection both sides of projection screen, and the camera shooting area of two camera surveillances is big
In the area of projection screen；Hand is blocking laser point to a certain degree when shooting, can also have one to take laser point.
The electronic projection drawing board system processing method based on image recognition technology that the present invention also provides a kind of, specifically includes
Following steps:
S1, make photographing module to detection projector plane positioning by anchor point；
Whether S2, detection function of laser pointer switching switch are opened, if so, function switch switch is that drawing board mode then enters
S3；If it is not, then function switch switch is that mouse mode then enters S7 step；
Whether S3, the pen tip for detecting laser pen have pressure, if it is not, then the laser emitter in laser pen does not issue laser knot
Beam；If so, the laser emitter in laser pen issues laser, into S4 step；
S4, electronic drawing board processing unit receive the picture signal of photographing module real-time Transmission, will by image processing module
Laser signal is converted to position signal；
Position signal is converted drawing board motion track signal by S5, display module；
S6, display module combine drawing board track and project content, generate new project content；Enter step S10；
S7, electronic drawing board processing unit receive the picture signal of photographing module real-time Transmission, will by image processing module
Laser signal is converted to position signal；
Position signal is converted mouse motion track signal by S8, display module；
S9, display module combine mouse track, mouse control signal and project content, generate new project content；
In the new project content to projection screen of S10, projector.
A kind of electronic projection drawing board system processing method based on image recognition technology of the present invention；It is of the present invention
A kind of electronic projection drawing board system processing method based on image recognition technology；S1 positioning, constant linear coordinate turns coordinate really
Scaling method, specifically includes the following steps:
S11, system initialization, (x, y) are the abscissa and ordinate that video camera shoots figure, and (X, Y) is on projection screen
The abscissa and ordinate of real screen, am,an,bm,bn,dx,dyFor the constant of the even incidence formula of coordinate；Projector is thrown
Shadow picture is shown as black, in the upper of projected picture, under, left, the right side respectively takes four points of 100 pixels labeled as red, this four
Point is (x1, y1), (x2, y2), (x3.y3), (x4.y4) in the captured image coordinate of video camera；It is being thrown in projector
The coordinate of picture is (X1, Y1), (X2, Y2), (X3, Y3), (X4, Y4) on shadow screen；
S12, by four points in S11, every three points make primary combination and substitute into following formula expression:
dx=X1-amx1-any1
dy=Y1-bmx1-bny1
Available am, an, bm, bn, dx, dyNumerical value.Last calculated result is averaged as final value；?
To the positional relationship of (x, y) coordinate and (X, Y) coordinate.
A kind of electronic projection drawing board system processing method based on image recognition technology of the present invention, feature exist
In described image processing module identifies coordinate of the laser point in photographed images；It substitutes into S1 step and obtains positional relationship function,
Coordinate of the available laser point on projection screen.
A kind of electronic projection drawing board system processing method based on image recognition technology of the present invention, feature exist
In the written tail portion of the laser pen connects pressure sensor device, and pressure sensor device connects laser emitter, laser emitter
Laser emission mouth be aligned nib；Function switch switch in laser pen is drawing board function, pressure sensor device when nib is write
Detect that pressure control laser emitter issues laser.
A kind of electronic projection drawing board system processing method based on image recognition technology of the present invention swashs in the S7
Optical signal is converted to position signal and can also be obtained using perspective image transform method, the specific steps are as follows:
Four vertex of S13 projected image are set as particular color, and image processing module 22 identifies 31 shooting figure of video camera
Four apex coordinates of the projected image in piece, obtain a quadrangle；
S14 passes through the universal transformation formula of perspective transform, and quadrangle can be converted into a square；
S15 tries again perspective transform, and square can be for conversion into projection screen projected image size identical new four
Side shape；
S16 identifies the laser point coordinates in new quadrangle, which is the laser position coordinate needed.
Advantageous effects of the invention:
1. can when carrying out the teaching tasks such as any lantern slide, video and carrying out on large screen Free Writing, it is simple and convenient
It is again practical.
2. device simple, identification is accurate, and common laser pen is simply transformed, so that it may more complete human-computer interaction is completed,
Greatly reduce cost.
3. it is flexible and convenient, writing plane is not required, is suitable for after need to only initializing adjustment for different planes.
4. having drawing board function and mouse function, whole demands in projector use are met.
Detailed description of the invention
A kind of system structural framework of electronic projection drawing board system processing method based on image recognition technology of Fig. 1 is illustrated
Figure；
A kind of scheme of installation of the electronic projection drawing board system processing method based on image recognition technology of Fig. 2；
A kind of control flow schematic diagram of the electronic projection drawing board system processing method based on image recognition technology of Fig. 3；
The structural schematic diagram of Fig. 4 laser pen；
Fig. 5 video camera scheme of installation；
Fig. 6 coordinate schematic diagram；
Wherein: 1 laser pen, 2 electronic drawing board processing units, 3 photographing modules, 4 projectors, 5 projection screens, 11 laser pen pens
Head, 12 pressure sensor devices, 131 function buttons, 132 function buttons, 14 function switch switch, 15 laser emitters, 16 bluetooths
Module, 17 laser pens switch, 18 springs, 21 reception of wireless signals module, 22 image processing modules, 23 display modules, 24 bluetooths
Module occurs for receiving module, 31 video cameras, 32 wireless signals
Specific embodiment
To be easy to understand the technical means, the creative features, the aims and the efficiencies achieved by the present invention, below with reference to
Specific embodiment, the present invention is further explained.
Such as Fig. 1, Fig. 2, shown in Fig. 5, a kind of electronic projection drawing board system based on image recognition technology；Comprising laser pen 1,
Electronic drawing board processing unit 2, photographing module 3, projector 4, projection screen 5；Photographing module 3 is installed above common projection screen 5；
The image information of shooting is wirelessly sent to electronic drawing board processing unit 2 by photographing module 3；Electronic drawing board processing unit
2 laser points emitted by laser pen 1 in the identification image of in house software are simultaneously pocessed generation drawing board track or mouse track,
Simultaneously image information will be generated after drawing board track or mouse track and former project content section；The image information of generation is by projector 4
It is projected on projection screen；Drawing board function and mouse function can be realized by built-in function switch switch 14 built in laser pen 1
Two kinds of function switch；Switching to drawing board function laser pen can directly write on projection screen, and the laser that laser pen 1 issues is
System is identification, is projected out drawing board track；The laser for switching to the sending of mouse function laser pen 1 is recognized by the system, and is projected out mouse
Mouse function may be implemented in the function button of track, collocation laser pen 1.
Wherein electronic drawing board processing unit 2 is by reception of wireless signals module 21, image processing module 22, display module 23,
Bluetooth receiving module 24 is constituted；Wireless signal receiver 21 issues image information for receiving photographing module 3, and image is believed
Breath is transferred to image processing module 22；Bluetooth receiving module 24 is used to receive the control information of laser pen sending, and control is believed
Breath is transferred to image processing module 22；Image processing module 22 identifies the location information that the laser point in image information generates, and
Drawing board coordinate or mouse coordinates and control signal are generated in conjunction with the control information of Bluetooth signal receiving module 24；23 knot of display module
It closes image processing module 22 and generates drawing board track or mouse track and control signal, combine and generated newly with former computer interface
Computer interface, new computer interface are projected instrument 4 and project on projection screen 5.Wireless communication in electronic drawing board processing unit 2
Number receiving module 21, image processing module 22, display module 23, it is external that bluetooth receiving module 24 can be used as overall peripheral equipment
On computers.Can also be external on computers with reception of wireless signals module 21, bluetooth receiving module 24, image processing module
22, display module 23 constitutes drawing board software installation on computers, and drawing board software continuous works as use in the front end of computer desktop
Under drawing board mode, software itself does not make any response to mouse-keyboard completely, will not influence mouse-keyboard to drawing board software
The use of lower other software, mouse can be directed through software itself, and keyboard spy can lead to normally to the software input under interface
It crosses and special shortcut key is specified to close software；When using mouse mode, software is complete using obtained coordinate information operation mouse
At the various operations of mouse.
Wherein photographing module 3 is made of two video cameras 31 and wireless signal generation module 32, and two video cameras 32 are mutual
The both sides of projection screen 5 are vertically respectively arranged in, when can prevent from directly writing on the screen using two video cameras 31, hand is hidden
Firmly laser point, the camera shooting area that video camera 31 monitors are greater than the area of projection screen, can shoot entire projector 4 comprehensively and be projected in
Picture on projection screen 5；The graphical information that video camera 31 is shot, by wireless signal in photographing module 3 occur module 32 with
The form of wireless signal is transferred to the reception of wireless signals module 21 in electronic drawing board processing unit 2.Module occurs for wireless signal
32 can use WIFI module, and WIFI has many advantages, such as that radio wave coverage is wide, transmission speed is fast, safe and healthy；WIFI
The building of wireless sensor network is primarily referred to as the building of sensor node in wireless network, and Sensor section is mainly responsible for information
It acquires and other signals is changed into electric signal and give microcontroller, microcontroller needs to receive the signal of sensor and progress
Handle accordingly SCM Based wireless sensor maximum feature be untreated module and RF transceiver module are integrated, such as
Say CS1010 chip, it is internally integrated two pieces of ARM, and one of responsible data processing, another piece is used to be wirelessly transferred, in this item
This chip can be used for reference in mesh.
Wherein the laser pen 1 as shown in Fig. 1, Fig. 2 and Fig. 4 include nib 11, pressure sensor device 12, laser emitter 15,
Function switch switch 14, function button 131, function button 132, bluetooth module 16, laser pen switch 17；Bluetooth module 16 to
Control signal in laser pen 1 is transferred to electronic drawing board processing unit 2；Function switch switch 14 can switch drawing board mode and
Mouse mode, when drawing board mode, hand-held drawing board is write on projection screen, and written 11 stress can make pressure sensor device 12 hold
It opens, so that opening laser emitter 15 issues laser, laser forms laser point on projection screen 5, and laser point is recognized by the system life
At drawing board track；When mouse mode, laser pen 1 can control transmitting laser by laser pen switch 17 and generate laser point, swash
Luminous point, which is recognized by the system, generates drawing board track；Function button 131, function button 132 can be used as the left button of mouse, right button from
And control interface, realize that the institute of mouse is functional.Nib 11 can be transparent plastic and be made into detachable post system to guide
Laser.Laser pen 1 can also increase spring 18, and cushioning effect is played when laser pen is fallen, and help that internal components is protected to prolong
Long life；1 all parts connection relationship of laser pen；Laser switch 17 and function button 13, function switch switch 14 are located at
On the shell of laser pen 1；18 one end of spring connects the shell of laser pen 1, and the other end connects bluetooth module 24；Bluetooth module 24 is another
One end is connect with the emission port opposite end of laser emitter 15；The emission port of laser emitter 15 connects pressure sensor device
12, the other end of pressure sensor device 12 is connect with written 11 tail portions, and the head of nib 11 is directly write on projection screen 5；Pen
First 11, pressure sensor device 12, laser emitter 15, bluetooth module 24, spring 18 are placed at same level.
Such as Fig. 3, shown in Fig. 6, at the present invention also provides a kind of electronic projection drawing board system based on image recognition technology
Reason method, specifically includes the following steps:
S1, make 3 pairs of 4 projection plane of detection projector positioning of photographing module by anchor point；
Whether S2, detection 1 function switch switch 14 of laser pen are opened, if so, function switch switch 14 is drawing board mode
Then enter S3；If it is not, then function switch switch 14 is that mouse mode then enters S7 step；
S3, detect laser pen 1 pen tip whether have pressure, if it is not, then the laser emitter 15 in laser pen 1 do not issue it is sharp
Light terminates；If so, the laser emitter 15 in laser pen 1 issues laser, into S4 step；
S4, electronic drawing board processing unit 2 receive the picture signal of 3 real-time Transmission of photographing module, pass through image processing module
Laser signal is converted to position signal by 22；
Position signal is converted drawing board motion track signal by S5, display module 23；
S6, display module 23 combine drawing board track and project content, generate new project content；Enter step S10；
S7, electronic drawing board processing unit 2 receive the picture signal of 3 real-time Transmission of photographing module, pass through image processing module
Laser signal is converted to position signal by 22；
Position signal is converted mouse motion track signal by S8, display module 23；
S9, display module 23 combine mouse track, mouse control signal and project content, generate new project content；
S10, projector 4 project in new project content to projection screen 5.
A kind of electronic projection drawing board system processing method based on image recognition technology of the present invention；S1 positioning, sits
Target determines linear coordinate transfer algorithm, specifically includes the following steps:
S11, system initialization, (x, y) are the abscissa and ordinate that video camera 31 shoots figure, and (X, Y) is projection screen 5
The abscissa and ordinate of upper real screen are the coordinate in Computer display picture, am, an, bm, bn, dx, dyFor even coordinate
Incidence formula constant；4 projected picture of projector is shown as black, in the upper of projected picture, under, left, the right side respectively takes 100
Four points of pixel labeled as red, this 4 points captured image coordinates in video camera 31 be (x1, y1), (x2, y2),
(x3.y3), (x4.y4)；Projector 4 be projected in picture on projection screen 5 coordinate be (X1, Y1), (X2, Y2), (X3, Y3),
(X4, Y4).
S12, by four points in S11, every three points make primary combination and substitute into following formula expression:
dx=X1-amx1-any1
dy=Y1-bmx1-bny1
Available am, an, bm, bn, dx, dyNumerical value.Last calculated result is averaged as final value；?
To the positional relationship of (x, y) coordinate and (X, Y) coordinate.
A kind of electronic projection drawing board system processing method based on image recognition technology of the present invention, at described image
Reason module 22 identifies coordinate of the laser point in photographed images；It substitutes into S1 step and obtains positional relationship function, it is available to swash
Coordinate of the luminous point on projection screen 5.
A kind of electronic projection drawing board system processing method based on image recognition technology, laser signal is converted in the S7
Position signal can also be obtained using perspective image transform method, the specific steps are as follows:
Four vertex of S13 projected image are set as particular color, and image processing module 22 identifies 31 shooting figure of video camera
Four apex coordinates of the projected image in piece, obtain a quadrangle；
S14 passes through the universal transformation formula of perspective transform, and quadrangle can be converted into a square；
S15 tries again perspective transform, and square can be for conversion into projection screen projected image size identical new four
Side shape；
S16 identifies the laser point coordinates in new quadrangle, which is the laser position coordinate needed.
Constant linear coordinates transformation method concrete principle is as follows really for test point and coordinate in step S11, step S12.
Recognition detection point first:
Man-machine interactive system in design needs to be accurately positioned the position of laser point in projection screen, and by its location information
Computer disposal is passed to, to position cursor position and respond corresponding laser point operation.Therefore system first has to camera shooting
Module captures projection screen in real time, obtains image of video data.Because each frame of digital image is Coutinuous store in memory, and
The sequence image of photographing module capture has two kinds of formats of RGB24 and YUV.Thus system will be imaged when running for the first time by software
The picture format of module photograph is set as RGB24.The target to be identified in this system is that laser pen is emitted on projection screen
Infrared laser point, pixel rgb value of the luminous point in the digital picture of RGB24 format is (255,0,0), and it is relative to back
Clearly, we can first be filtered each frame bitmap images and use inter-frame difference and background scape color R value
The method that difference combines chooses some specific threshold value T and the position of laser point and motion profile is identified and tracked.Swash
R, one byte of each component of G, B are needed in luminous point identification process, and the sequence of the color of image table of the format is suitable by BGR
Sequence arrangement, therefore in image the distribution of the rgb value of a pixel should be first character section expression be B value, second word
Section is G value, and third byte is R value, be mainly compared pixel R value and the threshold value T of selection when inter-frame difference.
Secondly determination --- the linear coordinate transfer algorithm of coordinate
The rectangular area that the interactive system of this research requires photographing module to shoot as far as possible when system initialization
With projection screen region sides aligned parallel up and down, but artificial adjustment can not can guarantee absolute stringent parallel, photographing module
There will also certainly be the inclination of certain angle between the plane of delineation and projection screen plane.The sequence chart of photographing module capture in this way
As the reference axis between imaging coordinate system and projection screen plane coordinate system is not parallel, (it is assumed that angular deviation is a), coordinate origin is not
Same and coordinate scale is different.The wherein sequence image size 640*480 of hypothesis photographing module capture, and projection screen plane sizes
For 1024*768.Linear coordinate transfer algorithm assumes that any pattern distortion is not present in the video sequence image of capture, then I
It is considered that image of the rectangular projection screen on wide-angle USB photographing module be also rectangle, such laser point coordinates turn
Changing is exactly a linear transform process
As shown in fig. 6, rectangular area represented by xoy coordinate system is region captured by photographing module, which is view
Frequency image imaging coordinate system.Rectangular area represented by XOY coordinate system is projection screen display area, which is projection screen
The logical coordinates system of pulse train of curtain, the angular deviation between two coordinate systems are a.Photographing module image coordinate system and projection screen coordinate system
Coordinate origin in the upper left corner.
If xoy coordinate system and XOY coordinate system unit value are x ', y ', X ', Y ', existed between them according to the hypothesis of front
Certain linear relationship, is defined as follows:
X '=x ' X '=y ' Y '=x ' Y '=y '
As shown, coordinate value of the coordinate origin of XOY coordinate system in xoy coordinate system is assumed to (x0, y0), then basis
Figure can obtain following relationship:
Wherein enable
It is available to substitute into above formula:
It can be seen that the binary quadratic equation group contains 6 unknown parameters from formula, solved according to mathematical knowledge
This six unknown parameters need to know that photographing module captures the coordinate of three points on image, respectively (x1, y1), (x2,
Y2), the coordinate (X1, Y1) (X2, Y2) (X3, Y3) of (x3, y3) and these three points on corresponding projection screen.This six are sat
Punctuate substitutes into, and can establish 6 equations, as follows so as to solve six unknown parameters:
dx=X1-amx1-any1
dy=Y1-bmx1-bny1
This six parameters are found out, binary quadratic equation group formula also determines that.
Six parameters that equation is solved known to analysis need to know three known points on projection screen in camera shooting mould
Coordinate in block image, we choose in projection screen on edge here, under, left, four points of right each 100 pixels
(100,100), (924,100), (100,668), (924,100).Screen is shown as black when system initialization, this four points
For red, this coordinate of four points in image forming plane is calculated using image recognition technology.Then by this four points, often
Three points make the value that primary combination calculates, and last calculated result is averaged as final value.System is run in this way
As long as when real time scan and by image recognition algorithm calculate the laser point on photographing module image position coordinates (x, y) benefit
The laser point corresponding logical coordinates (X, Y) on the projection screen can be calculated with formula, passes through laser pen to realize
The laser point of injection carries out accurate positionin and relevant operation to software.
Furthermore the step of acquisition of laser point coordinates can also take perspective image transform method to obtain, perspective transform:
1. four fixed points of projected image are set as particular color, image processing apparatus is identified in video camera shooting picture
Four fixed point coordinates of projected image, obtain a quadrangle；
2. passing through the universal transformation formula of perspective transform, quadrangle can be converted into a square.
3. try again perspective transform, square can be for conversion into identical new four side of projection screen projected image size
Shape.
4. identifying the laser point coordinates in new quadrangle, the coordinate which as needs to project.
The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention.The technology of the industry
Personnel are it should be appreciated that the present invention is not limited to the above embodiments, and the above embodiments and description only describe this
The principle of invention, without departing from the spirit and scope of the present invention, various changes and improvements may be made to the invention, these changes
Change and improvement all fall within the protetion scope of the claimed invention.The claimed scope of the invention by appended claims and its
Equivalent thereof.
Claims (10)
1. a kind of electronic projection drawing board system based on image recognition technology；Including laser pen (1), electronic drawing board processing unit
(2), photographing module (3), projector (4), projection screen (5)；It is characterized in that, the electronic drawing board processing unit (2) includes nothing
Line signal receiving module (21), bluetooth receiving module (24), image processing module (22), display module (23)；Laser pen (1) packet
(14), laser emitter (15), bluetooth are switched containing written (11), pressure sensor device (12), function button (13), function switch
Module (16)；Photographing module (3) includes to set video camera (31), wireless signal generation module (32), in which:
For receiving the wireless signal in photographing module (3) figure that module (32) issue occurs for reception of wireless signals module (21)
As signal, and transmit a signal to image processing module (22)；
Bluetooth receiving module (24), for receiving the control signal of the sending of the bluetooth module (16) in laser pen (1), and by signal
It is transferred to image processing module (22)；
Image processing module (22), laser point coordinates in received picture signal for identification, by laser point coordinates convert to
Drawing board coordinate or mouse coordinates, and coordinate and control signal are sent to display module (23)；
Display module (23), for by the coordinate transformation of image processing module (22) be drawing board track or mouse track, by track,
It controls signal and project content combines, generate new project content；
Laser pen (1) is radiated at projection screen (5) for writing directly on projection screen (5) or remotely issuing laser point, goes forward side by side
Row control operation, control operation signal are transferred to the Bluetooth Receiver of electronic drawing board processing unit (2) by bluetooth module (16)；
Photographing module (3) is used for real-time capture projection screen (5) image, and module (32) occurs by wireless signal and pass data
The signal receiver of defeated electronic drawing board processing unit (2).
2. a kind of electronic projection drawing board system based on image recognition technology according to claim 1, which is characterized in that institute
Cylinder can be dismantled for what transparent plastic was made by stating the nib (11) of laser pen (1).
3. a kind of electronic projection drawing board system based on image recognition technology according to claim 2, which is characterized in that institute
Nib (11) tail portion connection pressure sensor device (12) of laser pen (1) is stated, pressure sensor device (12) connects laser emitter
(15), the Laser emission mouth of laser emitter (15) is directed at written (11)；Function switch switch (14) in laser pen (1) is picture
Plate function, pressure sensor device (12) detects that pressure control laser emitter (15) issues laser when written (11) write.
4. a kind of electronic projection drawing board system based on image recognition technology according to claim 3, which is characterized in that institute
Laser pen (1) is stated containing spring (18), laser switch (17) and function button (13)；Laser switch (17) and function button (13)
On the shell of laser pen (1)；Spring (18) one end connects the shell of laser pen (1), and the other end connects bluetooth module (24)；
Bluetooth module (24) other end is connect with the emission port opposite end of laser emitter (15)；The transmitting terminal of laser emitter (15)
Mouth connection pressure sensor device (12), the other end of pressure sensor device (12) are connect with written (11) tail portion, written (11)
It is directly write on projection screen (5) on head；Written (11), pressure sensor device (12), laser emitter (15), bluetooth module
(24), spring (18) is placed at same level.
5. a kind of electronic projection drawing board system based on image recognition technology according to claim 1, which is characterized in that institute
It states photographing module (3) and contains two video cameras (31)；Two video cameras (31) are mutually perpendicular to be respectively arranged in the phase of projection screen (5)
Both sides are handed over, the camera shooting area of two video cameras (31) monitoring is greater than the area of projection screen (5).
6. a kind of processing method of the electronic projection drawing board system described in claim 1 based on image recognition technology, specific to wrap
Include following steps:
S1, make photographing module (3) to detection projector (4) projection plane positioning by anchor point；
Whether S2, detection laser pen (1) function switch switch (14) are opened, if so, function switch switch (14) is drawing board mould
Formula then enters S3；If it is not, then function switch switch (14) is that mouse mode then enters S7 step；
Whether S3, the pen tip for detecting laser pen (1) have pressure, if it is not, then the laser emitter (15) in laser pen (1) does not issue
Laser terminates；If so, the laser emitter (15) in laser pen (1) issues laser, into S4 step；
S4, electronic drawing board processing unit (2) receive the picture signal of photographing module (3) real-time Transmission, pass through image processing module
(22) laser signal is converted into position signal；
Position signal is converted drawing board motion track signal by S5, display module (23)；
S6, display module (23) combine drawing board track and project content, generate new project content；Enter step S10；
S7, electronic drawing board processing unit (2) receive the picture signal of photographing module (3) real-time Transmission, pass through image processing module
(22) laser signal is converted into position signal；
Position signal is converted mouse motion track signal by S8, display module (23)；
S9, display module (23) combine mouse track, mouse control signal and project content, generate new project content；
S10, projector (4) project in new project content to projection screen (5).
7. a kind of electronic projection drawing board system processing method based on image recognition technology according to claim 6；It is special
Sign is, in the S1 positioning, coordinate constant linear coordinates transformation method really, specifically includes the following steps:
S11, system initialization, (x, y) are the abscissa and ordinate that video camera (31) shoot figure, and (X, Y) is projection screen (5)
The abscissa and ordinate of upper real screen, am, an, bm, bn, dx, dyFor the constant of the even incidence formula of coordinate；By projector
(4) projected picture is shown as black, in the upper of projected picture, under, left, the right side respectively takes four points of 100 pixels labeled as red,
This 4 points captured image coordinates in video camera (31) are (x1, y1), (x2, y2), (x3.y3), (x4.y4)；In projector
(4) coordinate for being projected in picture on projection screen (5) is (X1, Y1), (X2, Y2), (X3, Y3), (X4, Y4)；
S12, by four points in S11, every three points make primary combination and substitute into following formula expression:
dx=X1-amx1-any1
dy=Y1-bmx1-bny1
Available am, an, bm, bn, dx, dyNumerical value.Last calculated result is averaged as final value；It obtains
The positional relationship of (x, y) coordinate and (X, Y) coordinate.
8. a kind of electronic projection drawing board system processing method based on image recognition technology according to claim 7, special
Sign is that described image processing module (22) identifies coordinate of the laser point in photographed images；It substitutes into S1 step and obtains position
Relation function, coordinate of the available laser point on projection screen (5).
9. a kind of electronic projection drawing board system processing method based on image recognition technology according to claim 8, special
Sign is that nib (11) tail portion of the laser pen (1) connects pressure sensor device (12), and pressure sensor device (12) connection swashs
The Laser emission mouth of optical transmitting set (15), laser emitter (15) is directed at written (11)；Function switch switch in laser pen (1)
It (14) is drawing board function, pressure sensor device (12) detects that pressure control laser emitter (15) issues when written (11) write
Laser.
10. a kind of electronic projection drawing board system processing method based on image recognition technology according to claim 6, special
Sign is that laser signal is converted to position signal and can be obtained using perspective image transform method in the S7, and specific steps are such as
Under:
Four vertex of S13 projected image are set as particular color, and image processing module (22) identifies video camera (31) shooting figure
Four apex coordinates of the projected image in piece, obtain a quadrangle；
S14 passes through the universal transformation formula of perspective transform, and quadrangle can be converted into a square；
S15 tries again perspective transform, and square can be for conversion into the identical new quadrangle of projection screen projected image size；
S16 identifies the laser point coordinates in new quadrangle, which is the laser position coordinate needed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910591343.2A CN110297556B (en) | 2019-07-02 | 2019-07-02 | Electronic projection drawing board system based on image recognition technology and processing method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910591343.2A CN110297556B (en) | 2019-07-02 | 2019-07-02 | Electronic projection drawing board system based on image recognition technology and processing method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110297556A true CN110297556A (en) | 2019-10-01 |
| CN110297556B CN110297556B (en) | 2023-03-31 |
Family
ID=68030036
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910591343.2A Active CN110297556B (en) | 2019-07-02 | 2019-07-02 | Electronic projection drawing board system based on image recognition technology and processing method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110297556B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112015286A (en) * | 2020-07-31 | 2020-12-01 | 青岛海尔科技有限公司 | Method and device for interactive projection and projection system |
| CN112297035A (en) * | 2020-11-24 | 2021-02-02 | 武汉大学苏州研究院 | Six-dimensional control device for B-ultrasonic robot |
| CN112738490A (en) * | 2020-12-28 | 2021-04-30 | 慧投科技（深圳）有限公司 | Projection method of electronic conference whiteboard system without calibration |
| CN112785883A (en) * | 2021-01-27 | 2021-05-11 | 吕瑞 | Point reading position marking method and system based on image recognition and intelligent learning table |
| CN115016691A (en) * | 2022-05-30 | 2022-09-06 | 海宁奕斯伟集成电路设计有限公司 | Electronic blackboard function realization server, client, system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100013801A1 (en) * | 2007-03-08 | 2010-01-21 | Lunascape Co., Ltd. | Projector system |
| CN102662498A (en) * | 2012-04-16 | 2012-09-12 | 中科华核电技术研究院有限公司 | Wireless control method and system for projection demonstration |
| CN102880360A (en) * | 2012-09-29 | 2013-01-16 | 东北大学 | Infrared multipoint interactive electronic whiteboard system and whiteboard projection calibration method |
| US20140247216A1 (en) * | 2011-11-08 | 2014-09-04 | Tencent Technology (Shenzhen) Company Limited | Trigger and control method and system of human-computer interaction operation command and laser emission device |
| CN105912145A (en) * | 2016-04-15 | 2016-08-31 | 武汉邮电科学研究院 | Laser pen mouse system and image positioning method thereof |
| CN108227970A (en) * | 2018-03-08 | 2018-06-29 | 李慕浩 | A kind of remote mouse based on image identification |
-
2019
- 2019-07-02 CN CN201910591343.2A patent/CN110297556B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100013801A1 (en) * | 2007-03-08 | 2010-01-21 | Lunascape Co., Ltd. | Projector system |
| US20140247216A1 (en) * | 2011-11-08 | 2014-09-04 | Tencent Technology (Shenzhen) Company Limited | Trigger and control method and system of human-computer interaction operation command and laser emission device |
| CN102662498A (en) * | 2012-04-16 | 2012-09-12 | 中科华核电技术研究院有限公司 | Wireless control method and system for projection demonstration |
| CN102880360A (en) * | 2012-09-29 | 2013-01-16 | 东北大学 | Infrared multipoint interactive electronic whiteboard system and whiteboard projection calibration method |
| CN105912145A (en) * | 2016-04-15 | 2016-08-31 | 武汉邮电科学研究院 | Laser pen mouse system and image positioning method thereof |
| CN108227970A (en) * | 2018-03-08 | 2018-06-29 | 李慕浩 | A kind of remote mouse based on image identification |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112015286A (en) * | 2020-07-31 | 2020-12-01 | 青岛海尔科技有限公司 | Method and device for interactive projection and projection system |
| CN112015286B (en) * | 2020-07-31 | 2023-06-09 | 青岛海尔科技有限公司 | Method, device and projection system for interactive projection |
| CN112297035A (en) * | 2020-11-24 | 2021-02-02 | 武汉大学苏州研究院 | Six-dimensional control device for B-ultrasonic robot |
| CN112738490A (en) * | 2020-12-28 | 2021-04-30 | 慧投科技（深圳）有限公司 | Projection method of electronic conference whiteboard system without calibration |
| CN112785883A (en) * | 2021-01-27 | 2021-05-11 | 吕瑞 | Point reading position marking method and system based on image recognition and intelligent learning table |
| CN115016691A (en) * | 2022-05-30 | 2022-09-06 | 海宁奕斯伟集成电路设计有限公司 | Electronic blackboard function realization server, client, system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110297556B (en) | 2023-03-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110297556A (en) | A kind of electronic projection drawing board system and its processing method based on image recognition technology | |
| JP3950837B2 (en) | Projector, electronic blackboard system using projector, and indication position acquisition method | |
| CN103092432B (en) | The trigger control method of man-machine interactive operation instruction and system and laser beam emitting device | |
| CN102253737B (en) | Realizing method of screen-vision mouse system | |
| CN101730876B (en) | Pointing device using camera and outputting mark | |
| Molyneaux et al. | Interactive environment-aware handheld projectors for pervasive computing spaces | |
| CN106843602B (en) | Large-screen remote control interaction system and interaction method thereof | |
| CN101859210A (en) | Interactive projection system and implementation method thereof | |
| WO2009104550A1 (en) | Light projection device and illumination device | |
| JP2001325069A (en) | Device and method for detecting position | |
| CN105912145A (en) | Laser pen mouse system and image positioning method thereof | |
| CN101639746B (en) | Automatic calibration method of touch screen | |
| US10534448B2 (en) | Interactive projector and interactive projection system | |
| KR101691880B1 (en) | Interactive System Having Auto Calibration Function And Auto Calibration Method of Interactive System | |
| CN108874187A (en) | A kind of projector Notes System | |
| CN102722254A (en) | Method and system for location interaction | |
| KR100532525B1 (en) | 3 dimensional pointing apparatus using camera | |
| CN205068424U (en) | Motion tracking system based on stealthy code road sign | |
| CN101620485B (en) | Device and method for positioning light source | |
| Kim et al. | Vision based laser pointer interaction for flexible screens | |
| JP2001166881A (en) | Pointing device and its method | |
| US9582084B2 (en) | Interactive projector and interactive projection system | |
| CN202110500U (en) | Visual mouse system of screen | |
| CN1326023C (en) | Electronic display system positioning method and positioner thereof | |
| WO2019100547A1 (en) | Projection control method, apparatus, projection interaction system, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |