CN102662500A - Method for controlling mouse pointer position based on multimedia projection system - Google Patents
Method for controlling mouse pointer position based on multimedia projection system Download PDFInfo
- Publication number
- CN102662500A CN102662500A CN2012101457710A CN201210145771A CN102662500A CN 102662500 A CN102662500 A CN 102662500A CN 2012101457710 A CN2012101457710 A CN 2012101457710A CN 201210145771 A CN201210145771 A CN 201210145771A CN 102662500 A CN102662500 A CN 102662500A
- Authority
- CN
- China
- Prior art keywords
- computing machine
- mouse pointer
- coordinate
- video image
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention provides a method for controlling the mouse pointer position based on a multimedia projection system. The method comprises the following steps of: collecting video images including a computer display output projection image area by virtue of a camera, transmitting the images to a computer in real time, controlling the mouse pointer position according to the position of a laser cursor in the video image by virtue of the computer so that operators can control the mouse pointer position directly by operating a laser pen, thereby realizing more demonstration functions in the multimedia projection system by controlling the computer mouse pointer position and avoiding restriction of the demonstration effect of the multimedia projection system in the prior art. Through optimization and improvement, the method for controlling the mouse pointer position has the beneficial effects of improving the processing efficiency, reducing the error and enhancing the smooth performance for controlling the mouse pointer position.
Description
Technical field
The invention belongs to image recognition technology and Computer Control Technology field, relate in particular to a kind of mouse pointer position control method based on the multimedia overhead projector system.
Background technology
Multimedia technology has got into modern projection systems already, and the multimedia overhead projector system has been widely used in fields such as college teaching demonstration, enterprise's meeting demonstration.Use the multimedia overhead projector system; Can let the demonstrator from a large amount of numerous and diverse blackboards are write, free; Make the demonstrator to put into more energy on the demo content; And be compared to the blackboard writing on the blackboard, the text material through multimedia overhead projector system compiles and demonstration all has outstanding performance at aspects such as dirigibility, intuitive and demonstration effects, helps significantly to improve on-the-spot demonstration and explanation quality.
Use the multimedia overhead projector system of comparative maturity at present; Mainly constitute by equipment such as computing machine, projector and laser pens; Projector connects the demonstration output terminal of computing machine, is used for demonstration output with computing machine and projects to and form projection image on metope or the curtain and show that laser pen then is used to launch laser beam; On metope or curtain, form the laser cursor of Gao Liang, to realize deixis; Thus, in teaching application, can open text documents such as Word, PowerPoint, with the Projection Display in addition of demo content in the text document, indicate operation, realize the multimedia subsidiary function of on-the-spot demonstration through laser cursor by projector through computing machine; In addition; The laser pen that has the Wireless USB communication function in the market in addition; Usually also be provided with two function buttons and supporting on this laser pen Wireless USB connector is arranged; This Wireless USB connector is plugged on the usb communication interface of computing machine and can realizes that laser pen is connected with the radio communication of computing machine, can realize left button, the right button operating function of mouse respectively through two function buttons on the operation laser pen, possess this operating function after; Make when demonstration PowerPoint text document; Page turning before under the situation of inoperation mouse, can directly directly realizing through two function buttons on the operation laser pen, back page turn over operation, the demonstration that is more convenient for the demonstrator is operated, and can make on-the-spot demonstration quality and effect be able to further lifting.Even if but be used in combination this laser pen with Wireless USB communication function; The acquiescence shortcut that its attainable demonstration operating function must depend on the used text document software of demonstration is provided with function (but for example the left button of PowerPoint text default setting mouse, right button are the shortcut of preceding page turning, back page turn over operation function); And attainable operating function scope also very limited (page turning before for example only can straight line under the PowerPoint applied environment, back page turn over operation function); Then can't realize more demonstrating operating function for not possessing the text document software that left mouse button/right button acquiescence shortcut is provided with function (for example Word text document etc.), so its demonstration operating effect receives the software application environmental limit to a great extent; Realize more demonstration operation, still must depend on the operation mouse, the rolling mouse pointer is achieved to software function button positions, the left button/right button of clicking the mouse.
In the multimedia overhead projector system; If can just directly realize control by the operation laser pen to the computer mouse pointer position; Again in conjunction with left button, the right button operating function of the Wireless USB Communication Realization mouse of laser pen and computer; That will mean and can substitute mouse function fully by the operation laser pen; Realize to break away from the restriction of software application environment and operating function scope by the demonstration operating function of mouse action completion arbitrarily to laser pen demonstration operating effect; Even if use the common laser pen that does not possess the Wireless USB communication function; If can just directly realize control by the operation laser pen to the computer mouse pointer position; Also can be by programming; Allow computer that the back is discerned in position, the action of mouse pointer and carry out relevant position, the preset demonstration operating function of action, and then reach the purpose that promotes the demonstration effect.Yet occurring as yet at present can be through operating the mature technology that laser pen is directly controlled the computer mouse pointer position.
Summary of the invention
To the problems referred to above that exist in the prior art; In order to solve the limited problem of demonstration operating effect of multimedia overhead projector system in the prior art; The invention provides a kind of mouse pointer position control method based on the multimedia overhead projector system; Make it possible to just directly realize control, for the restriction that breaks through multimedia overhead projector system demonstration operating effect provides technical guarantee to the computer mouse pointer position through the operation laser pen.
For realizing above-mentioned purpose, the present invention has adopted following technological means:
Based on the mouse pointer position control method of multimedia overhead projector system, said multimedia overhead projector system mainly is made up of computing machine, projector, laser pen and video camera; Projector is used to connect the demonstration output terminal of computing machine, and projection is carried out in computing machine demonstration output; Laser pen is used for launching laser beam and shows that at computing machine output projection image forms laser cursor; Video camera is used to gather the video image that comprises computing machine demonstration output projection image zone, and gives computing machine with the video image real-time Transmission of gathering; Computing machine is used for according to the position of video image laser cursor the position of mouse pointer being controlled;
Wherein, computing machine is controlled the position of mouse pointer according to the position of laser cursor in the video image, specifically comprises the steps:
A) confirm in advance that in computing machine computing machine shows the pixel coordinate zone of projection image zone in video image of output, set up the coordinate corresponding conversion relation between the computing machine demonstration output projection image pixel coordinate zone in computer mouse pointer coordinate territory and the video image;
B) computing machine is handled video image; Appear at the pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the capture video images; And according to the coordinate corresponding conversion relation between the computing machine demonstration output projection image pixel coordinate zone in computer mouse pointer coordinate territory and the video image; Calculate and appear at the pairing mouse pointer coordinate of pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the video image, by the position of this mouse pointer coordinate mouse beacon pointer.
In the above-mentioned mouse pointer control method, as a kind of optimized choice scheme, said step B) be specially:
B1) computing machine extracts a up-to-date two field picture picture and this last two field picture picture in the current time video image; Calculate the brightness value increment of the corresponding pixel points in this last two field picture picture of each pixel in the said up-to-date two field picture picture respectively, and judge whether exist the brightness value increment more than or equal to the luminance difference threshold value that presets and be positioned at the pixel that computing machine shows output projection image pixel coordinate zone in the said up-to-date two field picture picture; If exist,, and continue execution in step b2) then with its pixel undetermined as a said up-to-date two field picture picture; Otherwise, carry out and wait for operation;
B2) computing machine that brightness value in the pixel undetermined of a said up-to-date two field picture picture is maximum is as target pixel points, and whether the brightness value of judging said target pixel points is more than or equal to the laser cursor luminance threshold value that presets; If; Then the pixel coordinate of said target pixel points in a said up-to-date two field picture picture is judged to be and appears at the pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the current time video image, and continue execution in step b3); Otherwise, carry out and wait for operation;
B3) computer based computer in computer mouse pointer coordinate territory and video image shows the coordinate corresponding conversion relation between the output projection image pixel coordinate zone; Calculate and appear at the pairing mouse pointer coordinate of pixel coordinate that computer shows the laser cursor in the output projection image pixel coordinate zone in the current time video image, and the position of pressing this mouse pointer coordinate mouse beacon pointer;
B4) computing machine is carried out frequency circulation execution in step b1 by the control that presets) ~ b3), until the position control operation that stops mouse pointer.
In the above-mentioned mouse pointer control method, as a kind of optimized choice scheme, the span of said luminance difference threshold value is 0.1Lmax ~ 0.2Lmax, and Lmax representes the higher limit of brightness values.
In the above-mentioned mouse pointer control method, as a kind of optimized choice scheme, the span of said laser cursor luminance threshold value is 0.6Lmax ~ 0.7Lmax, and Lmax representes the higher limit of brightness values.
In the above-mentioned mouse pointer control method, as a kind of optimized choice scheme, the span that frequency is carried out in said control is 25Hz ~ 50Hz.
Than prior art, the present invention has following beneficial effect:
1, the mouse pointer position control method based on the multimedia overhead projector system of the present invention; The video image and the real-time Transmission that comprise computing machine demonstration output projection image zone through camera acquisition are given computing machine; The position of mouse pointer is controlled according to the position of laser cursor in the video image by computing machine; Make operating personnel just directly to realize control through the operation laser pen to the computer mouse pointer position; And then can realize demonstration operating function abundant more in the multimedia overhead projector system by control to the computer mouse pointer position, break through the restriction of multimedia overhead projector system demonstration operating effect in the prior art.
2, the mouse pointer position control method based on the multimedia overhead projector system of the present invention; Can also be through optimize improving, reach and improve mouse pointer position control and treatment efficient, reduce the mouse pointer position departure, promote mouse pointer position and control many-sided beneficial effects such as smooth performance.
Description of drawings
Fig. 1 is the FB(flow block) that the present invention is based on the mouse pointer position control method of multimedia overhead projector system;
Fig. 2 the present invention is based on step B in the mouse pointer position control method of multimedia overhead projector system) FB(flow block) of improvement project.
Embodiment
Below in conjunction with accompanying drawing and embodiment technical scheme of the present invention is further described.
In the present invention program; In the multimedia overhead projector system, can realize control in order to make through the operation laser pen to the computer mouse pointer position; The multimedia overhead projector system that the present invention adopted has set up video camera on the basis of existing multimedia overhead projector system, mainly be made up of computing machine, projector, laser pen and video camera; Wherein, projector is used to connect the demonstration output terminal of computing machine, and projection is carried out in computing machine demonstration output; Laser pen is used for launching laser beam and shows that at computing machine output projection image forms laser cursor; Video camera is used to gather the video image that comprises computing machine demonstration output projection image zone, and gives computing machine with the video image real-time Transmission of gathering; Computing machine is used for according to the position of video image laser cursor the position of mouse pointer being controlled.
Specifically, the operating process that computing machine is controlled the position of mouse pointer according to the position of laser cursor in the video image is as shown in Figure 1, specifically comprises the steps:
A) confirm in advance that in computing machine computing machine shows the pixel coordinate zone of projection image zone in video image of output, set up the coordinate corresponding conversion relation between the computing machine demonstration output projection image pixel coordinate zone in computer mouse pointer coordinate territory and the video image.
The effect of this step is for subsequent operation the data basis to be provided.This step is when concrete operations; Confirm that computing machine shows that the mode in the pixel coordinate zone of projection image zone in video image of output has a lot; Can through manual work check and manually in the selecting video image computing machine show the position at the place, projection image zone of output; And it is regional by the projection image of the computing machine demonstration output in the video image of operation box taking-up manually; The pixel coordinate of zone in video image by the computer Recognition frame takes out is regional; The pixel coordinate zone of projection image zone in video image that shows output as computing machine; Also can utilize projection image zone that computing machine in the video image shows output than brighter these characteristics of surrounding enviroment brightness,, automatically identify according to the projection brightness threshold value by computing machine that computing machine shows output projection image pixel coordinate zone in the video image through preset projection brightness threshold value in computing machine; Those skilled in the art can also accomplish this processing by the alternate manner of its grasp.And show the foundation that the coordinate corresponding conversion between the output projection image pixel coordinate zone concerns about computing machine in computer mouse pointer coordinate territory and the video image; Then need confirm according to actual employing of institute in the image frame pixel coordinate range size of the coordinate range in computer mouse pointer coordinate territory size, video image, projection image zone these concrete applied environments such as pixel coordinate zone in video image that computing machine shows output and the technical parameter that relates to; Therefore under different concrete applied environments; This coordinate corresponding conversion relation is not quite similar, and set up according to actual conditions; Set up the coordinate corresponding conversion relation between the computing machine demonstration output projection image pixel coordinate zone in computer mouse pointer coordinate territory and the video image in order to be more convenient for; When practical operation; Suggestion is through regulating the range size of camera acquisition video image; Let computing machine show that the projection image zone of output takes the image frame zone of whole video image; So just make that computing machine shows that output projection image pixel coordinate zone promptly is equal to the image frame pixel coordinate zone of video image in the video image; Thereby can be directly according to the coordinate range size in computer mouse pointer coordinate territory and the ratio of the image frame pixel coordinate range size of video image; The image frame pixel coordinate bi-directional scaling of video image can be obtained corresponding computer mouse pointer coordinate, realize that computing machine shows the foundation that the coordinate corresponding conversion between the output projection image pixel coordinate zone concerns in computer mouse pointer coordinate territory and the video image.
Because the scope of mouse pointer coordinate domain is exactly the scope that computing machine shows output area in computing machine; Therefore; After setting up computing machine in computer mouse pointer coordinate territory and the video image and showing the coordinate corresponding conversion relation between the output projection image pixel coordinate zone; Just can be according to this coordinate corresponding conversion relation; Determine the computer mouse pointer coordinate of correspondence position by the pixel coordinate of a concrete appointment in the computing machine demonstration output projection image pixel coordinate zone in the video image; Thereby after letting computing machine pass through projection again by the position of this mouse pointer coordinate mouse beacon pointer, the projection of mouse pointer promptly drops on the pixel coordinate position of concrete appointment described in the computing machine demonstration output projection image pixel coordinate zone in the video image; Show the position in the output projection image if the pixel coordinate position of this concrete appointment is exactly actual laser cursor at computing machine, just realized mouse pointer projected position and the consistent effect of laser cursor position overlaid.
B) computing machine is handled video image; Appear at the pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the capture video images; And according to the coordinate corresponding conversion relation between the computing machine demonstration output projection image pixel coordinate zone in computer mouse pointer coordinate territory and the video image; Calculate and appear at the pairing mouse pointer coordinate of pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the video image, by the position of this mouse pointer coordinate mouse beacon pointer.
The effect of this step is to realize based on the position of laser cursor the position of mouse pointer being controlled.Because the scope of mouse pointer coordinate domain is exactly the scope that computing machine shows output area in computing machine; Therefore; After abovementioned steps is set up computing machine in computer mouse pointer coordinate territory and the video image and is shown the coordinate corresponding conversion relation between the output projection image pixel coordinate zone; Just can be in this step process according to this coordinate corresponding conversion relation; Determine the computer mouse pointer coordinate of correspondence position by the pixel coordinate of a concrete appointment in the computing machine demonstration output projection image pixel coordinate zone in the video image; Thereby after letting computing machine pass through projection again by the position of this mouse pointer coordinate mouse beacon pointer, the projection of mouse pointer promptly drops on the pixel coordinate position of concrete appointment described in the computing machine demonstration output projection image pixel coordinate zone in the video image; Show the position in the output projection image if the pixel coordinate position of this concrete appointment is exactly actual laser cursor at computing machine, just realized mouse pointer projected position and the consistent effect of laser cursor position overlaid.Therefore, this step shows the pixel coordinate of exporting the laser cursor in the projection image pixel coordinate zone through appearing at computing machine in the capture video images, thereby calculates corresponding mouse pointer coordinate, by the position of this mouse pointer coordinate mouse beacon pointer.This step appears at the pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the capture video images when concrete operations, the video image processing technology that can adopt has a lot; For example can adopt Boundary Recognition method commonly used in the technical field of video image processing; The image boundary characteristic that is promptly demonstrated in video image through laser cursor is set up its border mathematical model, and computing machine then goes out the pixel coordinate position that whether has occurred laser cursor in the video image picture and confirmed its appearance according to this border mathematics Model Identification; Can also adopt database matching method commonly used in the technical field of video image processing; The figure that promptly the storage laser cursor is demonstrated in video image in the database of computing machine is as the laser cursor template; Computing machine is then through matching operation; The pixel region that is complementary with the laser cursor template in the video image picture is identified as the laser cursor that occurs in the video image picture, and confirms its pixel coordinate position.But comparatively speaking, these video image processing technologies all exist the characteristics that computing is comparatively complicated, the operational data amount is big, make computing machine draw result and often need pass through long calculation process delay; And in the present invention is based on the mouse pointer position control method of multimedia overhead projector system; If appear at the pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the capture video images; Its calculation process postpones long words; According to the pixel coordinate of this laser cursor the position of mouse pointer is controlled again, then can be increased mouse pointer greatly and move the hysteresis quality that moves than laser cursor.A kind ofly can guarantee that the comparatively simple again method of accuracy, calculation process realizes the catching of pixel coordinate of laser cursor, then can improve mouse pointer and move the real time synchronization and the sensitivity of moving than laser cursor if adopt.In order further to reach this purpose, the present invention also is the step B in the mouse pointer control method of the present invention) a kind of embodiment preferred is provided, its process flow diagram is as shown in Figure 2, and concrete processing procedure is following:
B1) computing machine extracts a up-to-date two field picture picture and this last two field picture picture in the current time video image; Calculate the brightness value increment of the corresponding pixel points in this last two field picture picture of each pixel in the said up-to-date two field picture picture respectively, and judge whether exist the brightness value increment more than or equal to the luminance difference threshold value that presets and be positioned at the pixel that computing machine shows output projection image pixel coordinate zone in the said up-to-date two field picture picture; If exist,, and continue execution in step b2) then with its pixel undetermined as a said up-to-date two field picture picture; Otherwise, carry out and wait for operation;
B2) computing machine that brightness value in the pixel undetermined of a said up-to-date two field picture picture is maximum is as target pixel points, and whether the brightness value of judging said target pixel points is more than or equal to the laser cursor luminance threshold value that presets; If; Then the pixel coordinate of said target pixel points in a said up-to-date two field picture picture is judged to be and appears at the pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the current time video image, and continue execution in step b3); Otherwise, carry out and wait for operation;
B3) computer based computer in computer mouse pointer coordinate territory and video image shows the coordinate corresponding conversion relation between the output projection image pixel coordinate zone; Calculate and appear at the pairing mouse pointer coordinate of pixel coordinate that computer shows the laser cursor in the output projection image pixel coordinate zone in the current time video image, and the position of pressing this mouse pointer coordinate mouse beacon pointer;
B4) computing machine is carried out frequency circulation execution in step b1 by the control that presets) ~ b3), until the position control operation that stops mouse pointer.
This step B) preferred embodiment; Need not to carry out Boundary Recognition processing or images match handles; But utilized laser cursor to have the characteristics of high brightness, through the brightness value of pixel in the video image picture is differentiated, capture the pixel coordinate of laser cursor; Significantly reduce the operand of computing machine, helped to promote Computer Processing efficient.Projection theory according to projector can be known; Its projected light is the diverging light after the scioptics imaging; Camera acquisition to video image in projection image then be that projected light is transmitted to the reflected light after metope or curtain pass through diffuse reflection again, so its pixel brightness in video image picture can't be very high; And the laser beam of laser pen projects the laser cursor that forms on metope or the curtain; Because its light beam is concentrated; Brightness is very high; This also is its reason that can play tangible vision indicative function, therefore if laser cursor appears in the video image picture, the pixel regional luminance at laser cursor place normally in all video image picture pixels brightness the highest.Therefore; At this step B) preferred embodiment in; The image frame that computing machine is carried out frequency circulation execution video image by the control that presets extracts operation, and each the extraction operated like step b1) said, extract a up-to-date two field picture picture and this last two field picture picture in the current time video image; So that each corresponding pixel points in this two two field pictures picture is carried out the brightness value increment operation; With the undetermined pixel of the tangible pixel of brightness value increment (whether its brightness value increment is obvious, confirms through comparing with the luminance difference threshold value) as a said up-to-date two field picture picture, the reason of handling like this is; On the one hand; Using the multimedia overhead projector system to carry out in the process of projection demonstration, in the position that the time-continuing process of demonstrating same picture has only laser cursor to move through usually tangible brightness can take place just and changing the brightness variation in big zone can appear in the moment of demonstrating picture except switching; This brightness changes the increase that directly is presented as brightness value; And the brightness value increment is (because high bright characteristics that laser cursor has) obviously, and laser cursor moves or the projection image zone in do not occur not needing the mouse beacon cursor to move under the situation of laser cursor yet, therefore through the brightness value increment in addition judgment mode can significantly dwindle the follow-up data process range of catching the laser cursor pixel coordinate; On the other hand; In the video image of camera acquisition because of reasons such as camera lens quality some noises may appear in image frame; These noises can cause that the brightness variation takes place local pixel point in the image frame; But the brightness intensity of variation by noise causes is very limited, changes far away from the brightness value increment that has the laser cursor change in location to cause, therefore can reject the influence that this noise is caught laser cursor through the luminance difference threshold value.Then; At step b2) in; One that brightness value in the pixel undetermined of a said up-to-date two field picture picture is maximum as target pixel points; And if the brightness value of the said target pixel points of judgement is enough to reach the brightness of laser cursor, and (whether its brightness value is enough to reach the brightness of laser cursor; Confirm through comparing with laser cursor luminance threshold value) situation under, then the pixel coordinate of said target pixel points in a said up-to-date two field picture picture is judged to be and appears at the pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the current time video image, the reason of processing is like this; On the one hand; Some dynamic effects in the projection demonstration picture can cause that also the brightness variation takes place local pixel point in the image frame, but the brightness value of dynamic effect area pixel point is high far away from the brightness value of laser cursor, therefore can reject the influence that dynamic effect area pixel point is caught laser cursor through laser cursor luminance threshold value; On the other hand; Because laser cursor is bright and concentrated from height; Usually only take one or few in number and adjoining several pixels in the video image picture; And brightness value is maximum in video image picture usually, and is therefore that brightness value in the pixel undetermined is maximum and be judged to be the pixel coordinate of laser cursor more than or equal to the pixel coordinate at a place of laser cursor luminance threshold value in advance, is enough to reach the accuracy that the laser cursor location of pixels is caught; Just in concrete the application; When laser cursor takies in video image picture that brightness value that adjoining several pixels cause having a plurality of pixels equates and is maximum; Those skilled in the art can have more the needs of practical situations and confirm that voluntarily the pixel coordinate of one of them pixel is judged to be the pixel coordinate of laser cursor and (for example chooses wherein and lean on most last one; Perhaps by under one; Or the like), this can be to the influence that accuracy causes essence of catching of laser cursor pixel coordinate.After confirming to appear at the pixel coordinate of the laser cursor in the computing machine demonstration output projection image pixel coordinate zone in the current time video image; Then through step b3) calculate the pairing mouse pointer coordinate of pixel coordinate of laser cursor, and by the position of this mouse pointer coordinate mouse beacon pointer.Last like step b4) said, computing machine is carried out frequency circulation execution in step b1 by the control that presets) ~ b3), thus property performance period ground is that the position is controlled mouse pointer position according to laser cursor.This shows; In this improvement project; Utilize the characteristics of laser cursor in projection image's video image, the calculating through the pixel brightness value and differentiate and just realized catching of laser cursor pixel coordinate is than traditional Boundary Recognition computing and database matching computing; The calculation process of computing machine is able to simplify, and has improved the calculation process efficient of computing machine execution mouse pointer position control and treatment.This improvement project realizes that setting that catching of laser cursor pixel coordinate need depend on luminance difference threshold value, laser cursor luminance threshold value is to provide enough accuracys of catching; Through a large amount of experimental verifications; Usually the brightness gain that is caused by noise in the video image changes can not surpass 0.1Lmax, and the pixel brightness value of laser cursor in video image is about 0.6Lmax ~ 0.7Lmax, and Lmax representes the higher limit of brightness values; Therefore; In concrete application process, the preferred span of luminance difference threshold value is 0.1Lmax ~ 0.2Lmax, and the preferred span of laser cursor luminance threshold value is 0.6Lmax ~ 0.7Lmax; The size of brightness values higher limit Lmax then need be decided according to the data bits of camera collection video image; For example, if its data bits is 8, its brightness values is [0,255], then brightness values higher limit Lmax=255; If data bits is 16, its brightness values is [0,65535], brightness values higher limit Lmax=65535 then, or the like; Certainly, those skilled in the art also can set up the concrete value of luminance difference threshold value and laser cursor luminance threshold value on their own according to the needs of its practical situations.In addition; Because the periodicity to mouse cursor position in this improvement project is controlled; Its frequency is to carry out frequency with the control of setting; Consider that it is more than the 25Hz that human eye will stay frequency to the identification of smooth picture, consider the treatment effeciency that influences computing machine if the too high meeting of control execution frequency configuration increases the computer data treatment capacity simultaneously, therefore the preferred span of control execution frequency is 25Hz ~ 50Hz; Certainly, if do not have too much requirement or computing machine self to possess sufficiently high data processing performance to the fluency of mouse pointer position control, then those skilled in the art can select the lower or higher control of value to carry out frequency.
Utilization the present invention is based on the mouse pointer position control method of multimedia overhead projector system; Can just directly realize control through the operation laser pen to the computer mouse pointer position; The left button, the right button operating function that combine the Wireless USB Communication Realization mouse of laser pen and computing machine again; Just can substitute mouse function fully through the operation laser pen; Realize to break away from the restriction of software application environment and operating function scope through the demonstration operating function of mouse action completion arbitrarily to laser pen demonstration operating effect; For example; When practical PowerPoint text document carries out full frame projection demonstration operation; Four action buttons can appear in the text lower left corner; Its operating function is followed successively by left page turning, mouse pointer option, attribute catalogue and right page turning, through the laser cursor mouse beacon pen travel of operation laser pen, and left button, the right button operating function of the Wireless USB Communication Realization mouse of combination laser pen and computing machine; Then can use these four action buttons to realize nearly all PowerPoint demonstration operating function; For example projection demonstration etc. is delineated, finished to a left side/right page turning, marking pen, and its delay operation effect is just just the same as practical mouse action, has improved the simple operation performance of multimedia overhead projector system greatly.Even if use the common laser pen that does not possess the Wireless USB communication function; If can just directly realize control by the operation laser pen to the computer mouse pointer position; Also can be by programming; Allow computer that the back is discerned in position, the action of mouse pointer and carry out relevant position, the preset demonstration operating function of action, and then reach the purpose that promotes the demonstration effect; For example; Can be by the several special mouse pointer functions of programmed settings are regional in advance; Suppose that setting computer shows that the lower left corner of output area is left page-turning function; The lower right corner is right page-turning function; The upper left corner is a red symbol function; The upper right corner is for finishing the projection demo function; And keep watch on the coordinate position of real-time mouse pointer by programming;, just carries out mouse pointer the function corresponding operation when falling into above-mentioned predefined mouse pointer function zone; The demonstrator can be by the operation laser pen then; Position with any mouse beacon pointer of laser cursor; And when needs are carried out ground, predefined mouse pointer function zone corresponding function; Only needing to make mouse pointer move to corresponding mouse pointer function zone by mobile laser cursor gets final product; Operate also very conveniently, and make the demonstration effect be able to promote.This shows; The present invention is based on the mouse pointer position control method of multimedia overhead projector system; Can obtain the effect of highly significant in fields such as college teaching demonstration, enterprise's meeting demonstrations, all very helpful for the lifting of aspects such as the convenience of demonstrating operation through laser pen and demonstration operating effect; Moreover, mouse pointer position control method of the present invention can also be applied to technical fields such as the game operation control that combines the multimedia overhead projector system to realize, motion capture, has multi-field using value.
Explanation is at last; Above embodiment is only unrestricted in order to technical scheme of the present invention to be described; Although with reference to preferred embodiment the present invention is specified, those of ordinary skill in the art should be appreciated that and can make amendment or be equal to replacement technical scheme of the present invention; And not breaking away from the aim and the scope of technical scheme of the present invention, it all should be encompassed in the middle of the claim scope of the present invention.
Claims (5)
1. based on the mouse pointer position control method of multimedia overhead projector system, it is characterized in that said multimedia overhead projector system mainly is made up of computing machine, projector, laser pen and video camera; Projector is used to connect the demonstration output terminal of computing machine, and projection is carried out in computing machine demonstration output; Laser pen is used for launching laser beam and shows that at computing machine output projection image forms laser cursor; Video camera is used to gather the video image that comprises computing machine demonstration output projection image zone, and gives computing machine with the video image real-time Transmission of gathering; Computing machine is used for according to the position of video image laser cursor the position of mouse pointer being controlled;
Wherein, computing machine is controlled the position of mouse pointer according to the position of laser cursor in the video image, specifically comprises the steps:
A) confirm in advance that in computing machine computing machine shows the pixel coordinate zone of projection image zone in video image of output, set up the coordinate corresponding conversion relation between the computing machine demonstration output projection image pixel coordinate zone in computer mouse pointer coordinate territory and the video image;
B) computing machine is handled video image; Appear at the pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the capture video images; And according to the coordinate corresponding conversion relation between the computing machine demonstration output projection image pixel coordinate zone in computer mouse pointer coordinate territory and the video image; Calculate and appear at the pairing mouse pointer coordinate of pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the video image, by the position of this mouse pointer coordinate mouse beacon pointer.
2. mouse pointer control method according to claim 1 is characterized in that, said step B) be specially:
B1) computing machine extracts a up-to-date two field picture picture and this last two field picture picture in the current time video image; Calculate the brightness value increment of the corresponding pixel points in this last two field picture picture of each pixel in the said up-to-date two field picture picture respectively, and judge whether exist the brightness value increment more than or equal to the luminance difference threshold value that presets and be positioned at the pixel that computing machine shows output projection image pixel coordinate zone in the said up-to-date two field picture picture; If exist,, and continue execution in step b2) then with its pixel undetermined as a said up-to-date two field picture picture; Otherwise, carry out and wait for operation;
B2) computing machine that brightness value in the pixel undetermined of a said up-to-date two field picture picture is maximum is as target pixel points, and whether the brightness value of judging said target pixel points is more than or equal to the laser cursor luminance threshold value that presets; If; Then the pixel coordinate of said target pixel points in a said up-to-date two field picture picture is judged to be and appears at the pixel coordinate that computing machine shows the laser cursor in the output projection image pixel coordinate zone in the current time video image, and continue execution in step b3); Otherwise, carry out and wait for operation;
B3) computer based computer in computer mouse pointer coordinate territory and video image shows the coordinate corresponding conversion relation between the output projection image pixel coordinate zone; Calculate and appear at the pairing mouse pointer coordinate of pixel coordinate that computer shows the laser cursor in the output projection image pixel coordinate zone in the current time video image, and the position of pressing this mouse pointer coordinate mouse beacon pointer;
B4) computing machine is carried out frequency circulation execution in step b1 by the control that presets) ~ b3), until the position control operation that stops mouse pointer.
3. mouse pointer control method according to claim 2 is characterized in that, the span of said luminance difference threshold value is 0.1Lmax ~ 0.2Lmax, and Lmax representes the higher limit of brightness values.
4. mouse pointer control method according to claim 2 is characterized in that, the span of said laser cursor luminance threshold value is 0.6Lmax ~ 0.7Lmax, and Lmax representes the higher limit of brightness values.
5. mouse pointer control method according to claim 2 is characterized in that, the span that frequency is carried out in said control is 25Hz ~ 50Hz.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210145771.0A CN102662500B (en) | 2012-05-11 | 2012-05-11 | Method for controlling mouse pointer position based on multimedia projection system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210145771.0A CN102662500B (en) | 2012-05-11 | 2012-05-11 | Method for controlling mouse pointer position based on multimedia projection system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102662500A true CN102662500A (en) | 2012-09-12 |
| CN102662500B CN102662500B (en) | 2015-02-04 |
Family
ID=46772004
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210145771.0A Expired - Fee Related CN102662500B (en) | 2012-05-11 | 2012-05-11 | Method for controlling mouse pointer position based on multimedia projection system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102662500B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103425409A (en) * | 2013-07-30 | 2013-12-04 | 华为终端有限公司 | Control method and device for projection display |
| CN105094504A (en) * | 2014-05-07 | 2015-11-25 | 鸿合科技有限公司 | Simulation display control method, simulation display control device and remote control device |
| CN105912145A (en) * | 2016-04-15 | 2016-08-31 | 武汉邮电科学研究院 | Laser pen mouse system and image positioning method thereof |
| CN105931509A (en) * | 2016-04-21 | 2016-09-07 | 孟玲玲 | Electronic communication physical intelligent teaching system |
| WO2017024808A1 (en) * | 2015-08-12 | 2017-02-16 | 中兴通讯股份有限公司 | Cursor control method and device, input device |
| CN108279838A (en) * | 2018-01-16 | 2018-07-13 | 安徽慧视金瞳科技有限公司 | A kind of laser pen remote interaction method |
| CN109491519A (en) * | 2018-10-09 | 2019-03-19 | 深圳市奥拓电子股份有限公司 | Air mouse method for tracing, system and machine readable storage medium |
| CN109542250A (en) * | 2018-12-10 | 2019-03-29 | 威创集团股份有限公司 | Server control method for switching between, KVM video processor and joined screen system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1299987A (en) * | 2001-01-17 | 2001-06-20 | 上海交通大学 | Interactive projecting display system with laser remote controller |
| CN1517842A (en) * | 2003-01-14 | 2004-08-04 | 友�科技股份有限公司 | Pick-up method and device of coordinate input |
| CN1979329A (en) * | 2005-12-05 | 2007-06-13 | 财团法人资讯工业策进会 | Device for synchronously operating cursor and optical projection, method and computer readable medium |
| CN102184053A (en) * | 2011-04-15 | 2011-09-14 | 深圳市华测检测技术股份有限公司 | Novel projector unit |
| CN102193651A (en) * | 2010-03-11 | 2011-09-21 | 株式会社理光 | Equipment, method and system for identifying laser point |
| CN102279668A (en) * | 2010-06-08 | 2011-12-14 | 株式会社理光 | Information interaction method and system |
| CN202093496U (en) * | 2011-04-15 | 2011-12-28 | 深圳市华测检测技术股份有限公司 | Novel projector |
-
2012
- 2012-05-11 CN CN201210145771.0A patent/CN102662500B/en not_active Expired - Fee Related
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1299987A (en) * | 2001-01-17 | 2001-06-20 | 上海交通大学 | Interactive projecting display system with laser remote controller |
| CN1517842A (en) * | 2003-01-14 | 2004-08-04 | 友�科技股份有限公司 | Pick-up method and device of coordinate input |
| CN1979329A (en) * | 2005-12-05 | 2007-06-13 | 财团法人资讯工业策进会 | Device for synchronously operating cursor and optical projection, method and computer readable medium |
| CN102193651A (en) * | 2010-03-11 | 2011-09-21 | 株式会社理光 | Equipment, method and system for identifying laser point |
| CN102279668A (en) * | 2010-06-08 | 2011-12-14 | 株式会社理光 | Information interaction method and system |
| CN102184053A (en) * | 2011-04-15 | 2011-09-14 | 深圳市华测检测技术股份有限公司 | Novel projector unit |
| CN202093496U (en) * | 2011-04-15 | 2011-12-28 | 深圳市华测检测技术股份有限公司 | Novel projector |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103425409A (en) * | 2013-07-30 | 2013-12-04 | 华为终端有限公司 | Control method and device for projection display |
| CN105094504B (en) * | 2014-05-07 | 2019-08-13 | 鸿合科技股份有限公司 | Emulate display control method, device and remote control device |
| CN105094504A (en) * | 2014-05-07 | 2015-11-25 | 鸿合科技有限公司 | Simulation display control method, simulation display control device and remote control device |
| WO2017024808A1 (en) * | 2015-08-12 | 2017-02-16 | 中兴通讯股份有限公司 | Cursor control method and device, input device |
| CN106445090A (en) * | 2015-08-12 | 2017-02-22 | 中兴通讯股份有限公司 | Cursor control method and apparatus, and input device |
| CN105912145A (en) * | 2016-04-15 | 2016-08-31 | 武汉邮电科学研究院 | Laser pen mouse system and image positioning method thereof |
| CN105931509A (en) * | 2016-04-21 | 2016-09-07 | 孟玲玲 | Electronic communication physical intelligent teaching system |
| CN105931509B (en) * | 2016-04-21 | 2018-09-21 | 潍坊科技学院 | A kind of electronic communication physics intelligent tutoring system |
| CN108279838A (en) * | 2018-01-16 | 2018-07-13 | 安徽慧视金瞳科技有限公司 | A kind of laser pen remote interaction method |
| CN108279838B (en) * | 2018-01-16 | 2021-11-12 | 安徽慧视金瞳科技有限公司 | Laser pen remote interaction method |
| CN109491519A (en) * | 2018-10-09 | 2019-03-19 | 深圳市奥拓电子股份有限公司 | Air mouse method for tracing, system and machine readable storage medium |
| CN109542250A (en) * | 2018-12-10 | 2019-03-29 | 威创集团股份有限公司 | Server control method for switching between, KVM video processor and joined screen system |
| CN109542250B (en) * | 2018-12-10 | 2021-07-16 | 威创集团股份有限公司 | Inter-server switching control method, KVM video processor and spliced wall system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102662500B (en) | 2015-02-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102662500A (en) | Method for controlling mouse pointer position based on multimedia projection system | |
| CN108549489B (en) | gesture control method and system based on hand shape, posture, position and motion characteristics | |
| US20220303447A1 (en) | Information acquisition device, method, patrol robot and storage medium | |
| DE112009000596B4 (en) | Remote control and procedure therefor | |
| WO2014208168A1 (en) | Information processing device, control method, program, and storage medium | |
| DE112012004714T5 (en) | Lighting control method and lighting device using this | |
| CN103135748B (en) | The trigger control method of man-machine interactive operation instruction and system | |
| CN102945091B (en) | A kind of man-machine interaction method based on laser projection location and system | |
| CN203012636U (en) | Man-machine interactive system based on laser projection positioning | |
| CN111736489B (en) | Distributed stage lighting simulation system and method | |
| CN102662498A (en) | Wireless control method and system for projection demonstration | |
| CN104506765B (en) | A kind of mobile terminal and its focusing method based on touch gestures | |
| CN100527783C (en) | Method of direct screen writing for television system distant end | |
| CN105635776A (en) | Virtual operation interface remote control method and system | |
| CN105657304A (en) | Method and apparatus for controlling projection display | |
| CN107589628A (en) | A kind of holographic projector and its method of work based on gesture identification | |
| CN105183269A (en) | Method for automatically identifying screen where cursor is located | |
| CN107808109A (en) | A kind of image in 2 D code recognition methods and mobile terminal | |
| CN107015650B (en) | Interactive projection method, device and system | |
| CN110442316A (en) | Image display method, device and computer readable storage medium | |
| CN203933781U (en) | Virtual to the autonomous responding system of reality in a kind of virtual reality real-time, interactive | |
| CN105511649A (en) | Multilateration system and multilateration method | |
| CN115769182A (en) | Intelligent interactive panel and brightness adjusting method thereof | |
| CN113031841A (en) | Laser pen interaction control system and laser pen interaction control method | |
| CN106101671A (en) | A kind of multichannel software projection arrangement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150204 Termination date: 20160511 |