CN109388291B - Projector assembly, projector projection method, projector projection device and readable storage medium - Google Patents
Projector assembly, projector projection method, projector projection device and readable storage medium Download PDFInfo
- Publication number
- CN109388291B CN109388291B CN201710654009.8A CN201710654009A CN109388291B CN 109388291 B CN109388291 B CN 109388291B CN 201710654009 A CN201710654009 A CN 201710654009A CN 109388291 B CN109388291 B CN 109388291B
- Authority
- CN
- China
- Prior art keywords
- projector
- brush
- painting brush
- initial position
- movement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
Abstract
The invention discloses a projector assembly, a projection method and a projection device of a projector and a readable storage medium, wherein the projection method of the projector comprises the following steps: when the touch point capturing button on the painting brush is detected to be triggered, determining the initial position of the pen end of the painting brush projected by the projector; obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position; and sending the movement track to a projector for the projector to project and display the movement track. According to the scheme, when the trigger of the brush projection button is detected, the initial position of the projection of the brush end on the projector is determined, the moving data of the brush are obtained, the obtained moving data of the brush are converted into the moving track of the brush according to the initial position, and the moving track is sent to the projector so that the projector can display the moving track of the brush along with the drawing, and the use is convenient.
Description
Technical Field
The present invention relates generally to the field of projectors, and in particular, to a projector assembly, a projection method and apparatus for a projector, and a readable storage medium.
Background
With the development of science and technology, the volume of the projector is continuously reduced, the playing content is more and more extensive, the video and audio quality and the image quality are continuously improved, the application range is more and more extensive, and the projector is developed from schools and various meeting places of companies to families. However, the projector generally plays a role in playing, and even if the projector has the function of drawing on a playing interface, the projector can carry out drawing on a computer or a projector screen and then project and display, and can not display on a board or a wall along with drawing like a drawing board, so that the projector is inconvenient to use and has poor user experience.
Disclosure of Invention
The invention mainly aims to provide a projector assembly, a projection method and device of the projector and a readable storage medium, and aims to solve the problem that the existing projector cannot display along with pictures and is inconvenient to use.
In order to achieve the above object, the present invention provides a projector assembly including a projector and a brush matched with the projector;
the projector comprises an infrared emission device for emitting an infrared coordinate line;
the painting brush comprises an infrared camera and a microprocessor, wherein the infrared camera is used for collecting infrared coordinate images, and the microprocessor processes the infrared coordinate images into coordinate data and sends the coordinate data to the projector for display.
Preferably, the brush further comprises a sensor, and the sensor is used for acquiring movement track data of the brush.
In addition, to achieve the above object, the present invention also provides a projection method of a projector, including:
when the touch point capturing button on the painting brush is detected to be triggered, determining the initial position of the pen end of the painting brush projected by the projector;
obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position;
and sending the movement track to a projector for the projector to project and display the movement track.
Preferably, the step of acquiring movement data of the brush and converting the movement data into a movement track of the brush based on the initial position includes:
acquiring the motion acceleration and the angular velocity of the painting brush, and determining the displacement of the painting brush according to the acceleration and the angular velocity;
and determining the moving track of the painting brush based on the displacement and the initial position.
Preferably, the step of acquiring movement data of the brush and converting the movement data into a movement track of the brush based on the initial position includes:
acquiring a position point passing through in the moving process of the painting brush, and converting the position point into an infrared coordinate point;
And determining the moving track of the painting brush based on the infrared coordinate point and the initial position.
Preferably, the step of determining the initial position of the pen end projected by the projector when the touch point capturing button on the pen is detected to be triggered comprises:
when the touch point capturing button on the painting brush is triggered, the initial position point of the end of the painting brush is collected;
and converting the initial position point into an initial infrared coordinate point, and determining the initial infrared coordinate point as an initial position of the projection of the pen end of the painting brush on the projector.
Preferably, the step of sending the movement track to a projector for the projector to project and display the movement track further comprises:
and sending the storage information to a projector so that the projector stores the image corresponding to the movement track.
Preferably, the projection method of the projector further comprises the steps of:
and sending setting information to the projector so as to set the display parameters of the moving track of the painting brush.
In addition, in order to achieve the above object, the present invention also proposes a projection apparatus of a projector, the projection apparatus of the projector comprising: a memory, a processor, a communication bus, and a projector program of a projector stored on the memory;
The communication bus is used for realizing connection communication between the processor and the memory;
the processor is configured to execute a projection program of the projector to implement the steps of:
when the touch point capturing button on the painting brush is detected to be triggered, determining the initial position of the pen end of the painting brush projected by the projector;
obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position;
and sending the movement track to a projector for the projector to project and display the movement track.
In addition, to achieve the above object, the present invention also provides a computer-readable storage medium storing one or more programs executable by one or more processors for:
when the touch point capturing button on the painting brush is detected to be triggered, determining the initial position of the pen end of the painting brush projected by the projector;
obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position;
and sending the movement track to a projector for the projector to project and display the movement track.
According to the projection method of the projector, when the touch point capturing button on the brush is detected to be triggered, the initial position of the brush end projected by the projector is determined, the obtained brush movement data are obtained, and the obtained brush movement data are converted into the movement track of the brush according to the initial position, so that the movement track is sent to the projector, and the projector can display the movement track of the brush along with the drawing, so that the use is convenient.
Drawings
FIG. 1 is a schematic frame diagram of a projector assembly of the present invention;
FIG. 2 is a flow chart of a first embodiment of a projection method of a projector according to the present invention;
FIG. 3 is a functional block diagram of a first embodiment of a projection apparatus of a projector according to the present invention;
FIG. 4 is a schematic diagram of a refinement function module of an acquisition module of a second embodiment of a projection apparatus of a projector according to the present invention;
FIG. 5 is a schematic diagram of a refinement function module of an acquisition module of a third embodiment of a projection apparatus of a projector according to the present invention;
FIG. 6 is a schematic diagram of a detailed functional block of a determination module of a fourth embodiment of a projection apparatus of a projector according to the present invention;
FIG. 7 is a schematic diagram of a device architecture of a hardware operating environment involved in a method according to an embodiment of the present invention;
FIG. 8 is a schematic view of a projection method setup interface of a projector according to the present invention;
fig. 9 is a schematic diagram showing the acquisition of infrared coordinate points in the projection method of the projector according to the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The invention provides a projector assembly.
Referring to fig. 1, in an embodiment of the present invention, the projector assembly includes a projector and a brush matched with the projector; the projector comprises an infrared emission device for emitting an infrared coordinate line; the painting brush comprises an infrared camera and a microprocessor, wherein the infrared camera is used for collecting infrared coordinate images, and the microprocessor processes the infrared coordinate images into coordinate data and sends the coordinate data to the projector for display.
The projector component comprises a projector and a painting brush, wherein the projector is a Bluetooth projector capable of projecting infrared coordinates, the projector comprises an infrared emission device for emitting infrared coordinate lines, the projector can project the infrared coordinate lines on a projection surface for display, a telescopic pen point for triggering projection operation is arranged on the painting brush, the projector further comprises an infrared camera and a microprocessor, the painting brush projection operation is triggered and when the painting brush projection operation moves towards the projection surface of the projector, an infrared coordinate image of the painting brush on the projection surface is obtained through the infrared camera, and the infrared coordinate image comprises a position point image of the painting brush and a position image surrounded by the infrared coordinate lines; and the microprocessor performs image processing on the position point image of the painting brush according to the position image surrounded by the infrared coordinate lines on the projection surface to obtain real-time projection coordinate data of the painting brush on the projection surface. The painting brush also comprises a transmission module for realizing data transmission with the projector. The transmission module can be bluetooth low energy, and the microprocessor sends the projection coordinate data of the painting brush to the projector for projection through the bluetooth low energy after obtaining the projection coordinate data of the painting brush, so that the following display of the painting brush on a projection surface is realized.
Further, the brush of the present embodiment may further include a sensor for acquiring brush movement trajectory data, and in particular, may include an acceleration sensor and a gyroscope. When the brush moves towards the projection surface of the projector, the acceleration sensor acquires the acceleration of the movement of the brush, and the gyroscope acquires the movement direction of the brush. The sensor module connected with the acceleration sensor and the gyroscope is arranged in the painting brush so as to read the acceleration and the moving direction of the movement of the painting brush, obtain real-time movement track data of the painting brush according to the acceleration and the angular speed, and send the movement track data to the projector for display through low power consumption.
Referring to fig. 2, in a first embodiment, the projection method of the projector according to the present invention includes the following steps:
step S10, when the touch point capturing button on the painting brush is detected to be triggered, determining the initial position of the end of the painting brush projected by the projector;
the projection method of the projector is suitable for projection of drawing and writing operations of the painting brush on a projection surface of the projector. The painting brush is provided with a touch point capturing button for triggering projection operation, and when the touch point capturing button receives the triggering operation, the projection operation is started. Specifically, the contact capture button for starting projection operation can be triggered by setting the pen point of the painting brush to be telescopic, setting the pen point to be in a retracted state in a normal state, and extending the pen point to trigger when projection is required. In addition, a key button can be arranged on the pen body of the painting pen, and when projection is needed, the key button is pressed to trigger. When the touch point capturing button is triggered, determining the initial projection position according to the projection position of the projector where the pen end of the painting brush is positioned when the projection operation is triggered when the projection operation of the painting brush is started. Specifically, when it is detected that a touch point capturing button on the brush is triggered, the step of determining an initial position of the brush end projected by the projector includes:
Step S11, when the touch point capturing button on the painting brush is triggered, collecting an initial position point of the end of the painting brush;
and step S12, converting the initial position point into an initial infrared coordinate point, and determining the initial infrared coordinate point as an initial position of the pen end projected on the projector.
It is understood that the writing operation has an operation start position, when the touch point capture of the brush is detected to be triggered, the projection is required, and when the projection operation of the brush is started, the projection position of the brush end towards the projection surface is used as the start position of the writing operation, namely the projection start position. The initial position point of the painting brush is collected, the collected initial position point is converted into an initial infrared coordinate point, and the specific collection mode is shown in fig. 9, the infrared rays emitted by the projector are projected to the projection surface to exist in a crisscross mode, and a grid is formed on the projection surface. Each grid is a unit, and four sides of each unit are marked with longitudinal and transverse coordinate values. The shape that the infrared camera of painting brush gathered can be circular, and the centre of a circle is the initial position point that the painting brush was located, and circular radius is greater than or equal to the length of a grid cell to can catch the grid cell of the infrared coordinate line of a projecting apparatus transmission at least when making infrared camera gather. The distance between the center of the circle and the four sides of the grid unit where the center of the circle is located is calculated through an image processing mode, the distance can be a relative distance, as shown in fig. 9, dx1, dx2, dy1 and dy2, a first-comparison example px=dx1/(dx1+dx2) in the X direction and a first-comparison example py=dy 1/(dy1+dy2) in the Y direction are further obtained, so that the center coordinates ox=x2+px (X3-X2) and oy=y2+py (Y3-Y2) can be determined, and the coordinate values are initial infrared coordinate points of the projection of the painting brush onto the projection surface, and the initial infrared coordinate points are determined as initial positions of the projection of the painting brush end on the projector. Based on the initial position, the initial position of the drawing and writing operation is determined, and the follow-up display of the projector on the drawing pen is realized.
Step S20, obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position;
further, in order to project the drawing and writing operation of the movement of the brush, it is necessary to acquire movement data of the brush and convert the movement data into a movement track, so as to project the movement track and display the drawing and writing graph of the brush. The moving data of the painting brush can be detected in real time by arranging a sensor in the painting brush to detect the moving data such as acceleration or speed, moving direction and the like of the movement of the painting brush, and the detected real-time moving data is converted to obtain the real-time position of the painting brush, so that the real-time moving track of the painting brush is determined by combining the initial position of the painting brush. In addition, the moving data of the painting brush can also be used for carrying out infrared imaging on the position points of the moving path through the infrared camera of the painting brush, and coordinate points on the moving path can be obtained in real time. And forming a real-time moving track of the painting brush based on the coordinate point of the initial position of the painting brush.
And step S30, the movement track is sent to a projector for the projector to project and display the movement track.
Further, after determining the real-time moving track of the painting brush, the moving track is sent to the projector for the projector to perform projection display on the moving track, so that the function of displaying the painting on the fly is realized. In addition, the graph displayed by projection can be stored, a storage button is arranged on the painting brush or the projector, and the graph displayed on the projection surface can be stored on the projector or a cloud or computer connected with the projector when the storage button is clicked, so that the next opening and calling are facilitated. Meanwhile, in order to meet different requirements of users, the brushes are supported and set so as to realize the change of display parameters such as the color of the moving track of the brushes, the thickness of lines and the like. The setting function can also be used for adjusting the erasing function to erase and recover the drawing and writing operation of the painting brush. In order to save space, a setting button is provided on the projector or the brush to trigger a save operation, a setting operation, and the like. Specifically, referring to fig. 8, when the setting button receives a trigger operation, a setting interface is displayed on a projection surface of the projector, where the interface includes a brush option, a eraser option, a save option, and the like, and each option can be switched to each other, and when the user switches to the brush option and clicks into the brush option, the user can set the brush. The brush setting comprises brush color setting and brush thickness setting, and corresponding line colors and thicknesses can be displayed by selecting different brush colors and brush thicknesses. After switching to the erasing option and clicking to enter, the eraser can be called to erase the wire. And when switching to the save option, the currently displayed graphic can be saved. Therefore, different options are set through the setting interface, different requirements of users are met, and the user satisfaction is high.
The projection method of the projector of the embodiment comprises the following steps: when the touch point capturing button on the painting brush is detected to be triggered, determining the initial position of the pen end of the painting brush projected by the projector; obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position; and sending the movement track to a projector for the projector to project and display the movement track. According to the scheme, when the touch point capturing button is detected to be triggered, the initial position of the projector is determined, the moving data of the painting brush are obtained, the obtained moving data of the painting brush are converted into the moving track of the painting brush according to the initial position, and accordingly the moving track is sent to the projector, so that the projector can display the moving track of the painting brush along with the drawing, and the use is convenient.
Further, in another embodiment of the data storage method of the present invention, the step S20 of obtaining movement data of the brush and converting the movement data into a movement track of the brush based on the initial position includes:
step S21, obtaining the motion acceleration and the angular velocity of the painting brush, and determining the displacement of the painting brush according to the acceleration and the angular velocity;
step S22, determining the moving track of the painting brush based on the displacement and the initial position.
In this embodiment, the sensor is disposed in the brush to obtain the data of the brush when the brush moves. Specifically, the sensor comprises an acceleration sensor and a gyroscope, wherein the acceleration sensor is used for detecting the acceleration of the movement of the painting brush, the gyroscope is used for detecting the moving direction of the painting brush, and the painting brush also comprises a timer and a sensor module, and the timer is used for timing the movement of the painting brush. The sensor module is communicated with the sensor so that the acceleration sensor and the gyroscope can send the detected acceleration and the detected moving direction to the sensor module for processing, and the moving speed of the painting brush can be calculated and obtained according to the acceleration and the timing time of the timer; in addition, the acceleration sensor can be replaced by a speed sensor, and the moving speed of the painting brush is determined according to the moving speed of the painting brush detected by the speed sensor and the timing of the timer. And the displacement of the painting brush can be determined by further combining the moving direction of the painting brush detected by the gyroscope. And then determining the moving track of the painting brush based on the projection initial position determined in the mode shown in the figure 9. In another scheme, after the acceleration sensor detects the acceleration of the real-time movement of the brush and the gyroscope detects the real-time movement direction of the brush, the acceleration and the movement direction are sent to the projector, and the projector processes the acceleration and the movement direction to determine the displacement of the brush. When the painting brush moves further, the real-time position of the painting brush is obtained in real time in the mode, and the position of the painting brush at the last moment can be used as a reference of the current position, so that the moving track is more accurate.
Still further, in another embodiment of the data storage method of the present invention, the step S20 of obtaining movement data of the brush and converting the movement data into a movement track of the brush based on the initial position includes:
step S23, obtaining position points passing through in the moving process of the painting brush, and converting the position points into infrared coordinate points;
and step S24, determining the moving track of the painting brush based on the infrared coordinate point and the initial position.
In this embodiment, the moving data is obtained by setting an infrared camera in the brush and by the infrared camera when the brush moves. The infrared camera can emit infrared rays, the infrared rays irradiate on an object to form diffuse reflection, and the diffuse reflection is received by the monitoring camera to form a shooting image. Specifically, in the moving process of the painting brush, the infrared camera emits infrared rays towards the projection surface, corresponding position points receiving the infrared rays form diffuse reflection and reflect the diffuse reflection to the camera, and the camera shoots the position points to obtain images of the position points receiving the infrared rays. The position point is the mapping of the current position point of the painting brush, and the position point is converted into an infrared coordinate point of an infrared coordinate line. Referring to fig. 9, the shape of the image captured by the infrared camera of the brush may be a circle, the center of the circle is the position point of the brush, and the center of the circle moves along with the movement of the brush. The distances from the center of the circle to four sides of the grid unit where the center of the circle is located are calculated in an image processing manner, as shown in dx1, dx2, dy1 and dy2 in fig. 9, and further the first comparative example px=dx1/(dx1+dx2) in the X direction and the first comparative example py=dy1/(dy1+dy2) in the Y direction are obtained, so that the center coordinates ox=x2+px (X3-X2) and oy=y2+py (Y3-Y2) can be determined, and the coordinate values are the current infrared coordinate points of the brush projected on the projection surface. According to the real-time infrared coordinate point and the initial position of the movement of the painting brush, the movement track of the painting brush can be determined. And the position of the painting brush at the moment is used as a reference of the current position, so that the moving track can be more accurate. Meanwhile, the smaller the side length of the grid unit is, the denser the grid is, the smaller the shot circular radius is, namely the larger the shooting precision is, and the more accurate the moving track can be also.
In addition, the present invention also provides a projection apparatus of a projector, referring to fig. 3, in a first embodiment, the projection apparatus of a projector according to the present invention includes:
a determining module 10, configured to determine an initial position of a pen end projected by the projector when it is detected that a touch point capturing button on the brush is triggered;
the projection method of the projector is suitable for projection of drawing and writing operations of the painting brush on a projection surface of the projector. The painting brush is provided with a touch point capturing button for triggering projection operation, and when the touch point capturing button receives the triggering operation, the projection operation is started. Specifically, the contact capture button for starting projection operation can be triggered by setting the pen point of the painting brush to be telescopic, setting the pen point to be in a retracted state in a normal state, and extending the pen point to trigger when projection is required. In addition, a key button can be arranged on the pen body of the painting pen, and when projection is needed, the key button is pressed to trigger. When it is detected that the touch point capturing button is triggered, the projection operation of the brush is started, and the determining module 10 determines the initial position of projection according to the projection position of the projector where the brush is located when the projection operation is triggered. Referring specifically to fig. 6, the determining module 10 includes:
The collecting unit 11 is used for collecting an initial position point of a pen end of the painting brush when the touch point capturing button on the painting brush is triggered;
and a third determining unit 12, configured to convert the initial position point into an initial infrared coordinate point, and determine the initial infrared coordinate point as an initial position where the pen end projects on the projector.
It is understood that the writing operation has an operation start position, when the touch point capture of the brush is detected to be triggered, the projection is required, and when the projection operation of the brush is started, the projection position of the brush end towards the projection surface is used as the start position of the writing operation, namely the projection start position. The collecting unit 11 collects the initial position point where the painting brush is located, and converts the collected initial position point into an initial infrared coordinate point, referring to fig. 9, in a specific collecting mode, the infrared rays emitted by the projector are projected onto the projection surface to exist in a crisscross mode, and a grid is formed on the projection surface. Each grid is a unit, and four sides of each unit are marked with longitudinal and transverse coordinate values. The shape that the infrared camera of painting brush gathered can be circular, and the centre of a circle is the initial position point that the painting brush was located, and circular radius is greater than or equal to the length of a grid cell to can catch the grid cell of the infrared coordinate line of a projecting apparatus transmission at least when making infrared camera gather. The distances from the center of the circle to the four sides of the grid unit where the center of the circle is located are calculated by an image processing mode, the distances can be relative distances, as shown in fig. 9, dx1, dx2, dy1 and dy2, the first X-direction comparison example px=dx1/(dx1+dx2) and the first Y-direction comparison example py=dy 1/(dy1+dy2) are further obtained, so that the center coordinates ox=x2+px (X3-X2) and oy=y2+py (Y3-Y2) can be determined, the coordinate values are initial infrared coordinate points of the projection of the brush onto the projection surface, and the third determining unit 12 determines the initial infrared coordinate points as initial positions of the projection of the pen ends of the brush on the projector. Based on the initial position, the starting position of the drawing and writing operation is determined, and the follow-up display of the projector on the drawing pen is realized.
The acquisition module 20 is configured to acquire movement data of the brush, and convert the movement data into a movement track of the brush based on an initial position;
further, in order to project the drawing operation of the movement of the brush, the acquisition module 20 is required to acquire the movement data of the brush and convert the movement data into the movement track, so as to project the movement track and display the drawing and writing graph of the brush. The moving data of the painting brush can be detected in real time by arranging a sensor in the painting brush to detect the moving data such as acceleration or speed, moving direction and the like of the movement of the painting brush, and the detected real-time moving data is converted to obtain the real-time position of the painting brush, so that the real-time moving track of the painting brush is determined by combining the initial position of the painting brush. In addition, the moving data of the painting brush can also be used for carrying out infrared imaging on the position points of the moving path through the infrared camera of the painting brush, and coordinate points on the moving path can be obtained in real time. And forming a real-time moving track of the painting brush based on the coordinate point of the initial position of the painting brush.
And the sending module 30 is used for sending the movement track to a projector so that the projector can project and display the movement track.
Further, after determining the real-time moving track of the brush, the sending module 30 sends the moving track to the projector for the projector to perform projection display on the moving track, so as to realize the function of displaying along with the drawing. In addition, the graph displayed by projection can be stored, a storage button is arranged on the painting brush or the projector, and the graph displayed on the projection surface can be stored on the projector or a cloud or computer connected with the projector when the storage button is clicked, so that the next opening and calling are facilitated. Meanwhile, in order to meet different requirements of users, the brushes are supported and set so as to realize the change of display parameters such as the color of the moving track of the brushes, the thickness of lines and the like. The setting function can also be used for adjusting the erasing function to erase and recover the drawing and writing operation of the painting brush. In order to save space, a setting button is provided on the projector or the brush to trigger a save operation, a setting operation, and the like. Specifically, referring to fig. 8, when the setting button receives a trigger operation, a setting interface is displayed on a projection surface of the projector, where the interface includes a brush option, a eraser option, a save option, and the like, and each option can be switched to each other, and when the user switches to the brush option and clicks into the brush option, the user can set the brush. The brush setting comprises brush color setting and brush thickness setting, and corresponding line colors and thicknesses can be displayed by selecting different brush colors and brush thicknesses. After switching to the erasing option and clicking to enter, the eraser can be called to erase the wire. And when switching to the save option, the currently displayed graphic can be saved. Therefore, different options are set through the setting interface, different requirements of users are met, and the user satisfaction is high.
The projector apparatus of the present embodiment includes: a determining module 10, configured to determine an initial position of a pen end projected by the projector when it is detected that a touch point capturing button on the brush is triggered; the acquisition module 20 is configured to acquire movement data of the brush, and convert the movement data into a movement track of the brush based on an initial position; and the sending module 30 is used for sending the movement track to a projector so that the projector can project and display the movement track. According to the scheme, when the touch point capturing button is detected to be triggered, the initial position of the projector is determined, the moving data of the painting brush are obtained, the obtained moving data of the painting brush are converted into the moving track of the painting brush according to the initial position, and accordingly the moving track is sent to the projector, so that the projector can display the moving track of the painting brush along with the drawing, and the use is convenient.
Further, referring to fig. 4, in a first embodiment of the projection apparatus of the projector according to the present invention, in a second embodiment of the projection apparatus of the projector according to the present invention, the acquisition module 20 includes:
a first acquisition unit 21 for acquiring a moving acceleration and an angular velocity of the brush and determining a displacement of the brush based on the acceleration and the angular velocity;
A first determining unit 22 for determining a movement locus of the brush based on the displacement and the initial position.
In this embodiment, the sensor is disposed in the brush to obtain the data of the brush when the brush moves. Specifically, the sensor comprises an acceleration sensor and a gyroscope, wherein the acceleration sensor is used for detecting the acceleration of the movement of the painting brush, the gyroscope is used for detecting the moving direction of the painting brush, and the painting brush also comprises a timer and a sensor module, and the timer is used for timing the movement of the painting brush. The sensor module communicates with the sensor so that the acceleration sensor and the gyroscope send the detected acceleration and the detected movement direction to the sensor module for processing, and the first acquisition unit 21 calculates and acquires the movement speed of the painting brush according to the acceleration and the timing time of the timer; in addition, the acceleration sensor can be replaced by a speed sensor, and the moving speed of the painting brush is determined according to the moving speed of the painting brush detected by the speed sensor and the timing of the timer. And the displacement of the painting brush can be determined by further combining the moving direction of the painting brush detected by the gyroscope. And then determining the moving track of the painting brush based on the projection initial position determined in the mode shown in the figure 9. In another scheme, after the acceleration sensor detects the acceleration of the real-time movement of the brush and the gyroscope detects the real-time movement direction of the brush, the acceleration and the movement direction are sent to the projector, and the projector processes the acceleration and the movement direction to determine the displacement of the brush. When the painting brush moves further, the real-time position of the painting brush is obtained in real time in the mode, and the position of the painting brush at the last moment can be used as a reference of the current position, so that the moving track is more accurate.
Further, referring to fig. 5, in a second embodiment of the projection apparatus of the projector according to the present invention, in a third embodiment of the projection apparatus of the projector according to the present invention, the acquisition module 20 includes:
a second obtaining unit 23, configured to obtain a position point passed by the brush in the moving process, and convert the position point into an infrared coordinate point;
and a second determining unit 24 for determining a moving track of the brush based on the infrared coordinate point and the initial position.
In this embodiment, the moving data is obtained by setting an infrared camera in the brush and by the infrared camera when the brush moves. The infrared camera can emit infrared rays, the infrared rays irradiate on an object to form diffuse reflection, and the diffuse reflection is received by the monitoring camera to form a shooting image. Specifically, during the movement of the brush, the infrared camera emits infrared rays toward the projection surface, the corresponding position points receiving the infrared rays form diffuse reflection, the diffuse reflection is reflected to the camera, the camera captures images of the position points, and the second acquisition unit 23 acquires images of the position points receiving the infrared rays. The position point is the mapping of the current position point of the painting brush, and the position point is converted into an infrared coordinate point of an infrared coordinate line. Referring to fig. 9, the shape of the image captured by the infrared camera of the brush may be a circle, the center of the circle is the position point of the brush, and the center of the circle moves along with the movement of the brush. The distances from the center of the circle to four sides of the grid unit where the center of the circle is located are calculated in an image processing manner, as shown in dx1, dx2, dy1 and dy2 in fig. 9, and further the first comparative example px=dx1/(dx1+dx2) in the X direction and the first comparative example py=dy1/(dy1+dy2) in the Y direction are obtained, so that the center coordinates ox=x2+px (X3-X2) and oy=y2+py (Y3-Y2) can be determined, and the coordinate values are the current infrared coordinate points of the brush projected on the projection surface. The second obtaining unit 23 can determine the current position of the brush on the projection surface according to the infrared coordinate point, and the second determining unit 24 can determine the moving track of the brush according to the real-time infrared coordinate point and the initial position of the brush. And the position of the painting brush at the moment is used as a reference of the current position, so that the moving track can be more accurate. Meanwhile, the smaller the side length of the grid unit is, the denser the grid is, the smaller the shot circular radius is, namely the larger the shooting precision is, and the more accurate the moving track can be also.
Referring to fig. 7, fig. 7 is a schematic device structure of a hardware running environment related to a method according to an embodiment of the present invention.
The projection device of the projector may include: a processor 1001, such as a CPU, memory 1005, and a communication bus 1002. Wherein a communication bus 1002 is used to enable connected communication between the processor 1001 and a memory 1005. The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Optionally, the projection device of the digital projector may further include a user interface, a network interface, a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like. The user interface may comprise a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface may further comprise a standard wired interface, a wireless interface. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface).
It will be appreciated by those skilled in the art that the projection device configuration of the projector shown in fig. 7 is not limiting of the projection device of the projector, and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 7, an operating system, a network communication module, and a data storage program may be included in the memory 1005, which is one type of computer storage medium. An operating system is a program that manages and controls the projector's projection device hardware and software resources, supporting the projector's projection program and the execution of other software and/or programs. The network communication module is used to enable communication between components within the memory 1005 and other hardware and software in the projector's projection device.
In the projector apparatus of the projector shown in fig. 7, the processor 1001 is configured to execute a projector program of the projector stored in the memory 1005, and the following steps are implemented:
when the touch point capturing button on the painting brush is detected to be triggered, determining the initial position of the pen end of the painting brush projected by the projector;
obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position;
and sending the movement track to a projector for the projector to project and display the movement track.
Further, the step of obtaining the movement data of the brush and converting the movement data into the movement track of the brush based on the initial position includes:
Acquiring the motion acceleration and the angular velocity of the painting brush, and determining the displacement of the painting brush according to the acceleration and the angular velocity;
and determining the moving track of the painting brush based on the displacement and the initial position.
Further, the step of obtaining the movement data of the brush and converting the movement data into the movement track of the brush based on the initial position includes:
acquiring a position point passing through in the moving process of the painting brush, and converting the position point into an infrared coordinate point;
and determining the moving track of the painting brush based on the infrared coordinate point and the initial position.
Further, when the touch point capturing button on the brush is detected to be triggered, the step of determining the initial position of the pen end projected by the projector comprises the following steps:
when the touch point capturing button on the painting brush is triggered, the initial position point of the end of the painting brush is collected;
and converting the initial position point into an initial infrared coordinate point, and determining the initial infrared coordinate point as an initial position of the projection of the pen end of the painting brush on the projector.
Further, after the step of transmitting the movement track to a projector for the projector to project and display the movement track,
The processor 1001 is configured to execute a projection program of a projector stored in the memory 1005, and implement the following steps:
and sending the storage information to a projector so that the projector stores the image corresponding to the movement track.
Further, the processor 1001 is configured to execute a projection program of a projector stored in the memory 1005, and implement the following steps:
and sending setting information to the projector so as to set the display parameters of the moving track of the painting brush.
The specific implementation manner of the projection device of the projector is basically the same as that of each embodiment of the projection method of the projector, and is not repeated here.
The present invention provides a computer-readable storage medium storing one or more programs, the one or more programs further executable by one or more processors for:
when the touch point capturing button on the painting brush is detected to be triggered, determining the initial position of the pen end of the painting brush projected by the projector;
obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position;
and sending the movement track to a projector for the projector to project and display the movement track.
Further, the step of obtaining the movement data of the brush and converting the movement data into the movement track of the brush based on the initial position includes:
acquiring the motion acceleration and the angular velocity of the painting brush, and determining the displacement of the painting brush according to the acceleration and the angular velocity;
and determining the moving track of the painting brush based on the displacement and the initial position.
Further, the step of obtaining the movement data of the brush and converting the movement data into the movement track of the brush based on the initial position includes:
acquiring a position point passing through in the moving process of the painting brush, and converting the position point into an infrared coordinate point;
and determining the moving track of the painting brush based on the infrared coordinate point and the initial position.
Further, when the touch point capturing button on the brush is detected to be triggered, the step of determining the initial position of the pen end projected by the projector comprises the following steps:
when the touch point capturing button on the painting brush is triggered, the initial position point of the end of the painting brush is collected;
and converting the initial position point into an initial infrared coordinate point, and determining the initial infrared coordinate point as an initial position of the projection of the pen end of the painting brush on the projector.
Further, after the step of transmitting the movement track to a projector for the projector to project and display the movement track,
the one or more programs may also be executable by the one or more processors for:
and sending the storage information to a projector so that the projector stores the image corresponding to the movement track.
Further, the one or more programs may also be executable by the one or more processors for:
and sending setting information to the projector so as to set the display parameters of the moving track of the painting brush.
The specific embodiments of the computer readable storage medium of the present invention are substantially the same as the embodiments of the projection method of the projector described above, and will not be described herein.
It should also be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the invention, and all equivalent structural changes made by the specification and drawings of the present invention or direct/indirect application in other related technical fields are included in the scope of the present invention.
Claims (10)
1. A projector assembly, wherein the projector assembly comprises a projector and a painting brush matched with the projector for use;
the projector comprises an infrared emission device for emitting an infrared coordinate line;
the painting brush comprises an infrared camera and a microprocessor, wherein the infrared camera is used for collecting infrared coordinate images, the infrared coordinate images comprise position point images where the painting brush is located and position images formed by surrounding infrared coordinate lines, and the microprocessor is used for carrying out image processing on the position point images where the painting brush is located according to the position images formed by surrounding the infrared coordinate lines on a projection surface, obtaining coordinate data and sending the coordinate data to the projector for display.
2. The projector assembly of claim 1 wherein the brush further comprises a sensor for acquiring movement trajectory data of the brush.
3. A projection method of a projector, applied to the projector assembly according to claim 1 or 2, comprising the steps of:
when a touch point capturing button on a painting brush is triggered, determining an initial position projected by a projector at the pen end of the painting brush, wherein the initial position is determined by a position point image where the painting brush is positioned and a position image surrounded by infrared coordinate lines;
Obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position;
and sending the movement track to a projector for the projector to project and display the movement track.
4. The projection method of the projector according to claim 3, wherein the step of acquiring movement data of the brush and converting the movement data into a movement trajectory of the brush based on an initial position includes:
acquiring the motion acceleration and the angular velocity of the painting brush, and determining the displacement of the painting brush according to the acceleration and the angular velocity;
and determining the moving track of the painting brush based on the displacement and the initial position.
5. The projection method of the projector according to claim 3, wherein the step of acquiring movement data of the brush and converting the movement data into a movement trajectory of the brush based on the initial position includes:
acquiring a position point passing through in the moving process of the painting brush, and converting the position point into an infrared coordinate point;
and determining the moving track of the painting brush based on the infrared coordinate point and the initial position.
6. The method of projecting by a projector according to any one of claims 3-5, wherein the step of determining the initial position of the brush end at the projector projected by the projector when the touch point capturing button on the brush is detected to be triggered comprises:
When the touch point capturing button on the painting brush is triggered, the initial position point of the end of the painting brush is collected;
and converting the initial position point into an initial infrared coordinate point, and determining the initial infrared coordinate point as an initial position of the projection of the pen end of the painting brush on the projector.
7. The method of projecting a projector according to claim 6, wherein the step of transmitting the movement trajectory to the projector for projection display by the projector on the movement trajectory further comprises:
and sending the storage information to a projector so that the projector stores the image corresponding to the movement track.
8. The projection method of the projector according to claim 6, wherein the projection method of the projector further comprises the steps of:
and sending setting information to the projector so as to set the display parameters of the moving track of the painting brush.
9. A projection apparatus of a projector, applied to the projector assembly of claim 1 or 2, comprising: a memory, a processor, a communication bus, and a projector program of a projector stored on the memory;
the communication bus is used for realizing connection communication between the processor and the memory;
The processor is configured to execute a projection program of the projector to implement the steps of:
when a touch point capturing button on a painting brush is triggered, determining an initial position projected by a projector at the pen end of the painting brush, wherein the initial position is determined by a position point image where the painting brush is positioned and a position image surrounded by infrared coordinate lines;
obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position;
and sending the movement track to a projector for the projector to project and display the movement track.
10. A readable storage medium, applied to the projector assembly of claim 1 or 2, having stored thereon a projection program of a projector, which when executed by a processor, implements the steps of:
when a touch point capturing button on a painting brush is triggered, determining an initial position projected by a projector at the pen end of the painting brush, wherein the initial position is determined by a position point image where the painting brush is positioned and a position image surrounded by infrared coordinate lines;
obtaining movement data of a painting brush, and converting the movement data into a movement track of the painting brush based on an initial position;
And sending the movement track to a projector for the projector to project and display the movement track.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710654009.8A CN109388291B (en) | 2017-08-02 | 2017-08-02 | Projector assembly, projector projection method, projector projection device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710654009.8A CN109388291B (en) | 2017-08-02 | 2017-08-02 | Projector assembly, projector projection method, projector projection device and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109388291A CN109388291A (en) | 2019-02-26 |
| CN109388291B true CN109388291B (en) | 2023-10-13 |
Family
ID=65412830
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710654009.8A Active CN109388291B (en) | 2017-08-02 | 2017-08-02 | Projector assembly, projector projection method, projector projection device and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109388291B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110197675B (en) * | 2019-06-04 | 2022-10-21 | 京东方科技集团股份有限公司 | Mobile storage device |
| CN110837322A (en) * | 2019-09-29 | 2020-02-25 | 深圳市火乐科技发展有限公司 | Projection touch control method, projection equipment, projection curtain and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101114200A (en) * | 2006-07-26 | 2008-01-30 | 富士施乐株式会社 | Function command system, function command device, function command analysis system, presentation system, and computer readable medium |
| CN101359251A (en) * | 2007-07-30 | 2009-02-04 | 由田新技股份有限公司 | Optical remote-control system and method applying to computer projection picture |
| CN101872260A (en) * | 2010-06-03 | 2010-10-27 | 张通达 | Remote interactive pen and handwriting detection method |
| CN102361495A (en) * | 2011-10-21 | 2012-02-22 | 青岛海信信芯科技有限公司 | Projection control method and projection equipment |
| CN102819327A (en) * | 2012-07-26 | 2012-12-12 | 郑州信大捷安信息技术股份有限公司 | Interactive projection system of infrared positioning wireless control and realizing method thereof |
| CN105657304A (en) * | 2014-11-12 | 2016-06-08 | 中兴通讯股份有限公司 | Method and apparatus for controlling projection display |
-
2017
- 2017-08-02 CN CN201710654009.8A patent/CN109388291B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101114200A (en) * | 2006-07-26 | 2008-01-30 | 富士施乐株式会社 | Function command system, function command device, function command analysis system, presentation system, and computer readable medium |
| CN101359251A (en) * | 2007-07-30 | 2009-02-04 | 由田新技股份有限公司 | Optical remote-control system and method applying to computer projection picture |
| CN101872260A (en) * | 2010-06-03 | 2010-10-27 | 张通达 | Remote interactive pen and handwriting detection method |
| CN102361495A (en) * | 2011-10-21 | 2012-02-22 | 青岛海信信芯科技有限公司 | Projection control method and projection equipment |
| CN102819327A (en) * | 2012-07-26 | 2012-12-12 | 郑州信大捷安信息技术股份有限公司 | Interactive projection system of infrared positioning wireless control and realizing method thereof |
| CN105657304A (en) * | 2014-11-12 | 2016-06-08 | 中兴通讯股份有限公司 | Method and apparatus for controlling projection display |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109388291A (en) | 2019-02-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107077239B (en) | Method for adjusting photographing focal length of mobile terminal through touch pad and mobile terminal | |
| JP6075122B2 (en) | System, image projection apparatus, information processing apparatus, information processing method, and program | |
| US8188973B2 (en) | Apparatus and method for tracking a light pointer | |
| CN107562288B (en) | Response method based on infrared touch device, infrared touch device and medium | |
| CN109388291B (en) | Projector assembly, projector projection method, projector projection device and readable storage medium | |
| CN102945091B (en) | A kind of man-machine interaction method based on laser projection location and system | |
| CN102196176A (en) | Information processing apparatus, information processing method, and program | |
| EP2208112A2 (en) | Apparatus and method for tracking a light pointer | |
| CN106873789B (en) | Projection system | |
| EP3541066A1 (en) | Electronic whiteboard, image display method, and carrier means | |
| WO2019029379A1 (en) | Interaction object control method and device, terminal and computer-readable storage medium | |
| JP2018507493A (en) | Air mouse remote control optimization method, apparatus, terminal device, program, and recording medium | |
| CN110850973B (en) | Audio device control method, audio device and storage medium | |
| WO2022088999A1 (en) | Interactive display method and apparatus, electronic device, system and storage medium | |
| CN112437231B (en) | Image shooting method and device, electronic equipment and storage medium | |
| CN110213407B (en) | Electronic device, operation method thereof and computer storage medium | |
| JP6519074B2 (en) | Electronics | |
| CN114756162B (en) | Touch system and method, electronic device and computer readable storage medium | |
| JP4436164B2 (en) | Optical signal pointing method, optical signal pointing device, and program | |
| CN116828131A (en) | Shooting processing method and device based on virtual reality and electronic equipment | |
| CN108089732B (en) | Capacitance pen for demonstration and projection mobile phone | |
| JP4046664B2 (en) | Information providing system, information providing method, information providing program, and recording medium for recording information providing program for portable information terminal | |
| CN107229341B (en) | Terminal control ring, terminal control method and computer readable storage medium | |
| CN103677271A (en) | Remote pointing device and application method thereof | |
| CN104580876B (en) | A kind of image acquiring method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |