CN109144375B - Screen control method and device - Google Patents
Screen control method and device Download PDFInfo
- Publication number
- CN109144375B CN109144375B CN201811180697.XA CN201811180697A CN109144375B CN 109144375 B CN109144375 B CN 109144375B CN 201811180697 A CN201811180697 A CN 201811180697A CN 109144375 B CN109144375 B CN 109144375B
- Authority
- CN
- China
- Prior art keywords
- screen
- image
- laser
- coordinates
- invisible
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03542—Light pens for emitting or receiving light
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The application provides a screen control method and a screen control device, wherein the method comprises the following steps: determining the actual position coordinates of the track of the invisible laser in a screen corresponding to the screen image based on the received screen image comprising the track of the invisible laser; the invisible laser and the visible light form an indicating light beam, and the indicating light beam is used for prompting a user to indicate a position; generating a control instruction for controlling the screen to display according to a key instruction and the actual position coordinate which are sent together with the invisible laser; and returning the control instruction to a screen control system of the screen to realize the control of the screen. According to the embodiment of the application, the control of the screen by the user is realized through the invisible laser, and the screen control accuracy is improved.
Description
Technical Field
The application relates to the technical field of screen control, in particular to a screen control method and device.
Background
The large screen interactive system can bring visual, novel and more convenient demonstration effects. The user can control the demonstration content in a non-contact mode, the control mode is more humanized, and meanwhile the requirement of user interaction experience can be met.
In the existing large screen interactive system, red laser remote control is mostly used for interacting with a large screen. For the common forward projection display technology, the projection brightness is low, and the projection screen is diffuse reflection, so that the laser point and the normal display content of the screen can be easily distinguished. However, when the projection screen is replaced by other self-luminous screens, the screen content and the laser points are difficult to distinguish.
Disclosure of Invention
In view of this, an object of the embodiments of the present application is to provide a screen control method and apparatus, which can utilize invisible light to realize interaction with a screen with light, so as to improve the accuracy of screen control.
In a first aspect, an embodiment of the present application provides a screen control method, including:
determining the actual position coordinates of the track of the invisible laser in a screen corresponding to the screen image based on the received screen image comprising the track of the invisible laser; the invisible laser and the visible light form an indicating light beam, and the indicating light beam is used for prompting a user to indicate a position;
generating a control instruction for controlling the screen to display according to a key instruction and the actual position coordinate which are sent together with the invisible laser;
and returning the control instruction to a screen control system of the screen to realize the control of the screen.
With reference to the first aspect, this application provides a first possible implementation manner of the first aspect, where before the step of determining, based on the received screen image including the trajectory of the invisible laser light, actual position coordinates of the trajectory of the invisible laser light in a screen corresponding to the screen image, the method further includes:
acquiring a screen image formed by visible light on the screen;
and determining the corresponding relation between the image coordinates of the screen image and the actual position coordinates according to the image coordinates of the target light points in the screen image and the pre-stored standard image coordinates of the target light points in the screen image.
With reference to the first possible implementation manner of the first aspect, an embodiment of the present application provides a second possible implementation manner of the first aspect, where the determining, according to image coordinates of a target light spot in the screen image and pre-stored standard image coordinates of the target light spot, a correspondence between image coordinates and actual position coordinates of the screen image includes:
comparing the image coordinates to the standard image coordinates;
if the image coordinate is not consistent with the standard image coordinate, calibrating the image coordinate according to a pre-stored standard image coordinate;
and generating a corresponding relation between the image coordinate and the actual position coordinate of the calibrated screen image according to the proportional relation between the screen image and the screen.
With reference to the second possible implementation manner of the first aspect, this application example provides a third possible implementation manner of the first aspect, where the determining, based on the received screen image including the trajectory of the invisible laser light, the actual position coordinates of the trajectory of the invisible laser light in a screen corresponding to the screen image includes:
determining image coordinates of a track of invisible laser light on a received screen image comprising the track of invisible laser light;
and determining the actual position coordinates of the track of the invisible laser in the screen corresponding to the screen image according to the image coordinates of the track of the invisible laser on the screen image and the corresponding relationship between the image coordinates of the calibrated screen image and the actual position coordinates.
With reference to the second possible implementation manner of the first aspect, an embodiment of the present application provides a fourth possible implementation manner of the first aspect, where the determining, according to the position coordinates of the track of the invisible laser on the screen image and the correspondence between the image coordinates of the screen image and the actual position coordinates, the actual position coordinates of the track of the invisible laser in the screen corresponding to the screen image includes:
and performing equal-scale transformation on the image coordinates of the track of the invisible laser on the screen image according to the corresponding relation between the image coordinates and the actual position coordinates of the screen image to obtain the actual position coordinates of the track of the invisible laser on the screen.
In a second aspect, an embodiment of the present application further provides a screen control device, including:
the first determining module is used for determining the actual position coordinates of the track of the invisible laser in a screen corresponding to the screen image based on the received screen image comprising the track of the invisible laser;
the generating module is used for generating a control instruction for controlling the screen to display according to a key instruction and the actual position coordinate which are sent together with the invisible laser;
and the processing module is used for returning the control instruction to a screen control system of the screen so as to realize the control of the screen.
With reference to the second aspect, the present application provides a first possible implementation manner of the second aspect, where the implementation manner includes:
the acquisition module is used for acquiring a screen image formed by visible light on the screen;
and the second determining module is used for determining the corresponding relation between the image coordinate of the screen image and the actual position coordinate according to the image coordinate of the target light spot in the screen image and the pre-stored standard image coordinate of the target light spot.
With reference to the first possible implementation manner of the second aspect, this application embodiment provides a second possible implementation manner of the second aspect, where the second determining module includes:
a comparison unit for comparing the image coordinates with the standard image coordinates;
the calibration unit is used for calibrating the image coordinates according to the pre-stored standard image coordinates if the image coordinates are inconsistent with the standard image coordinates;
and the generating unit is used for generating the corresponding relation between the image coordinate of the calibrated screen image and the actual position coordinate according to the proportional relation between the screen image and the screen.
In a third aspect, an embodiment of the present application further provides an electronic device, including: a server, a memory and a bus, the memory storing machine-readable instructions executable by the server, the server and the memory communicating via the bus when the electronic device is running, the machine-readable instructions when executed by the server performing the steps of the first aspect or any one of the possible implementation manners of the first aspect.
In a fourth aspect, this application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program is executed by a server to perform the steps in the first aspect or any possible implementation manner of the first aspect.
According to the screen control method and device provided by the embodiment of the application, the actual position coordinates of the track of the invisible laser in the screen corresponding to the screen image are determined according to the received screen image comprising the track of the invisible laser. The invisible laser and the visible light form an indicating light beam, and the indicating light beam is used for prompting a user to indicate the position. And then, generating a control instruction for controlling the screen to display according to the key instruction and the actual position coordinate sent together with the invisible laser. And finally, returning the control instruction to a screen control system to realize the control of the screen. This application makes the sensor can gather the invisible laser on the screen through throwing invisible laser on luminous screen itself to realize the detection separation of invisible laser, the actual position coordinate of the invisible laser of comparatively accurate definite on the screen, simultaneously with the button instruction generation control command, control large screen realization and user's interaction.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
FIG. 1 is a basic flowchart of a screen control method provided in an embodiment of the present application;
fig. 2 is a schematic structural diagram illustrating a remote control device for screen control in a screen control method provided in an embodiment of the present application;
FIG. 3 is a flowchart of an application system of a screen control method provided by an embodiment of the present application;
FIG. 4 is a schematic structural diagram illustrating a screen control device provided in an embodiment of the present application;
fig. 5 shows a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
The embodiment in this application mainly uses and carries out interactive scene at the use large screen, including but not limited to the interactive remote control system to the large screen, perhaps in command center or the multimedia classroom, there is a set of or multiunit large-screen curtain, a remote control equipment is to many host computers, many display screens realize the operation (one person is multimachine, a tractor serves several screens), the unified management of multizone large-screen wall, the interactive remote control of liquid crystal concatenation screen curtain, the interactive remote control of Digital Light Processing (DLP) rear projection concatenation screen curtain, scenes such as the interactive remote control of booth apart from emitting diode (LED) concatenation screen curtain. The main application occasions comprise conference occasions, including a multimedia conference room, a multifunctional conference room, an intelligent conference room, a multifunctional report hall and the like; teaching occasions including multimedia classrooms, multimedia electrified education systems and the like; the command center comprises an emergency command center, a subway command center, an armed police command center, a fire emergency command center, a public security command center, a military command center and the like, and a monitoring center and the like.
Existing interactive remote control systems typically employ a red laser remote control device and a visible light sensor to implement the interactive function. Because the screen can send the visible light of various colours by itself, after the red laser that remote control equipment transmitted hits the screen, can be mixed together with the visible light of screen, the red laser that the remote control equipment transmitted can't be distinguished to the visible light sensor to the user can't realize the control to the screen through red laser. For the common forward projection display technology, because the projection brightness is relatively low and the projection screen generally reflects diffusely, when the visible light sensor is used for detection, the laser spot and the normal display content of the screen can be easily distinguished because the laser spot brightness is relatively high, thereby realizing the interactive remote control technology.
When the large screen is changed into a liquid crystal spliced screen, an LED spliced screen or a DLP rear projection spliced screen, because the screen emits light, when a visible light sensor is used for detection, because the brightness of a laser point is relatively close to the brightness of the screen, the laser point is difficult to be distinguished from the normal display content of the screen, and an interactive remote control technology cannot be realized.
The existing solutions to the above problem are generally to enhance the brightness of the emitted laser light of the remote control device, but this causes other problems, such as:
the increase of the laser brightness can cause the power of the laser to increase, and in application tests, the laser power can be obviously distinguished from the light of the screen when the laser power is increased to more than 100mw, and the power is dangerous for a user, for example, if the power irradiates human eyes, the user can be injured. In addition, the increase of the laser power leads to the increase of the power consumption of the remote control device, and the service time of the battery of the remote control device is obviously shortened.
In addition, since the sensitivity of the human eye to red light is low, when the power of the red laser light is small, the brightness of the laser light seen by the human eye is also low. In a large-screen interactive system, a general screen is very large, and a user is far away from the screen, so that the user is difficult to see a laser indication point on the screen clearly, and the significance of remote accurate remote control is lost. The green light which is sensitive to human eyes can not be used for solving the problems because the light emitted by the liquid crystal, LED and DLP rear projection screens is very bright and the optical sensors can not distinguish the light emitted by the screens from laser indicating points.
Based on the above problems, the embodiments of the present application provide a screen control method and device. To facilitate understanding of the present embodiment, a detailed description will be given of a screen control method disclosed in the embodiments of the present application.
As shown in fig. 1, a basic flowchart of a screen control method provided in an embodiment of the present application includes:
s101, determining the actual position coordinates of the track of the invisible laser in a screen corresponding to a screen image based on the received screen image comprising the track of the invisible laser; the invisible laser and the visible light form an indicating light beam, and the indicating light beam is used for prompting a user to indicate the position.
Here, the received screen image including the trajectory of the invisible laser light is collected by the invisible light sensing module installed around the screen and transmitted to the server, and the invisible light is emitted by the remote control device controlled by the user. The remote control device emits a mixed light beam composed of visible light and invisible light, as shown in fig. 2, which is a schematic structural diagram of the remote control device for screen control provided in an embodiment of the present application. The visible light is transmitted by the remote control device together with the invisible laser light.
Here, the reason why the red laser light and the green laser light are selected is that the wavelength that can be perceived by the human eye is about 550nm in a bright environment and about 500nm in a dark environment. In practical tests, the human eye perceives as much as the brightness of green laser light of about 5mw and the brightness of red laser light of about 100 mw. Therefore, the remote control device in the embodiment of the present application uses two kinds of visible light, one is green laser with a center wavelength of 532nm and the other is red laser with a center wavelength of 650nm, and according to the adjustment of the intensities of the two kinds of laser light, laser light with colors in the wavelength range can be mixed, and according to the external light, the color of the visible light can be adjusted. Thereby achieving maximum sensitivity of the human eye.
The green laser emits a green visible laser beam, and the green visible laser beam passes through a total reflection mirror and then vertically enters the X prism from the upper part; the infrared invisible laser emits invisible laser beams which are directly projected into the X prism from the back; a red laser emits a red visible laser beam, and the red visible laser beam passes through a total reflector and then vertically enters the X prism from the lower part; and after the three kinds of laser beams are combined through the X prism, laser beams with mixed wavelengths are emitted from the front of the remote control equipment. The positions of the visible light and the invisible light on the screen coincide. The mixed light beam composed of the visible light and the invisible light also constitutes a prompt light beam, and the visible light is displayed on the screen and used for indicating the actual position of the invisible light on the screen for a user.
The generating of the final control command by using the invisible light includes the following steps:
determining image coordinates of a track of invisible laser light on a received screen image comprising the track of invisible laser light;
and determining the actual position coordinate of the track of the invisible laser in the screen corresponding to the screen image according to the image coordinate of the track of the invisible laser on the screen image and the corresponding relation between the image coordinate of the calibrated screen image and the actual position coordinate.
In specific implementation, when the brightness of the screen is high, when the screen receives a mixed light beam which is sent by the remote control device and consists of visible light and invisible laser, the invisible light sensing module collects a screen image which consists of the invisible laser and sends the screen image to the server, and the server determines the image coordinates of the track of the invisible laser on the screen image.
In addition, before the screen interaction control is performed, the screen should be generally calibrated. The specific calibration method is as follows:
acquiring a screen image formed by visible light on the screen;
and determining the corresponding relation between the image coordinates of the screen image and the actual position coordinates according to the image coordinates of the target light points in the screen image and the pre-stored standard image coordinates of the target light points in the screen image.
Here, the acquisition of the screen image composed of visible light on the screen is captured by the visible light sensing modules installed around the screen. And sending the collected screen image composed of the visible light to a server, and analyzing by the server to obtain the image coordinates of the target light point in the screen image composed of the visible light. In the server, standard image coordinates of the target light point in the screen image are stored in advance.
Specifically, the image coordinates are compared with the standard image coordinates;
if the image coordinate is inconsistent with the standard image coordinate, calibrating the image coordinate according to a pre-stored standard image coordinate;
and generating a corresponding relation between the image coordinate and the actual position coordinate of the calibrated screen image according to the proportional relation between the screen image and the screen.
Here, the acquired image coordinates of the target light point are compared with the standard image coordinates to obtain a correspondence between the image coordinates of the target light point and the standard image coordinates, and the image coordinates of the target light point are corrected according to the standard image coordinates to generate image coordinates of the calibrated screen image. The screen image is displayed on the screen finally, the screen image is displayed on the screen in an equal-scale magnification or reduction relationship, and a proportional relationship is determined between the coordinates of the calibrated target light point on the screen image and the corresponding actual position coordinates on the screen.
After the screen is calibrated, according to the corresponding relation between the image coordinates and the actual position coordinates of the screen image, the server performs equal-proportion transformation on the image coordinates of the invisible laser track on the screen image to obtain the actual position coordinates of the invisible laser track on the screen.
Here, after acquiring the calibration data, the server performs an equal-scale enlargement or reduction transformation of the image coordinates of the invisible laser on the screen image to obtain the actual position coordinates when displayed on the screen, and finally displays the actual position coordinates on the screen.
And S102, generating a control instruction for controlling the screen to display according to the key instruction and the actual position coordinate sent together with the invisible laser.
Here, while the user sends the mixed light beam to the screen using the remote control device, a key instruction such as direction control, analog keyboard, analog mouse, zoom, scene switching, and the like is also sent through a wireless signal. The server receives the key instruction, obtains the actual position coordinate of the invisible laser through the steps, can determine the position of the user which wants to execute the key instruction according to the actual position coordinate of the invisible laser, and generates a control instruction for displaying the key instruction of the user on a control screen by the server.
And S103, returning the control instruction to a screen control system of the screen to realize the control of the screen.
And the server sends a control instruction containing a key instruction of the user and the actual position coordinate of the invisible laser to a screen control system of the screen so as to realize the interaction between the final screen and the user.
Specifically, as shown in fig. 3, a flowchart of an application system of a screen control method provided in the embodiment of the present application is provided. The visible light sensing module is mainly used for screen correction, the invisible light sensing module is mainly used for collecting a screen image formed by invisible lasers so as to judge the actual position coordinates of the invisible lasers, and the server generates a final control instruction according to the actual position coordinates of the invisible lasers, the calibration data and the key instruction and finally realizes control of the screen.
By adopting the invisible laser detection method, the embodiment of the application can easily realize the detection and separation of the invisible light spot in the luminous application scenes of display systems such as a liquid crystal screen, a DLP rear projection, an LED splicing screen and the like. Meanwhile, the screen is calibrated by using visible light mixed by green laser with the central wavelength of 532nm and red laser with the central wavelength of 650nm, which are sensitive to human eyes, and the user is prompted in screen interaction, so that the interaction between the user and the screen is realized, and the screen control accuracy is improved.
Based on the same inventive concept, the embodiment of the present application further provides a screen control device corresponding to a screen control method, and since the principle of solving the problem of the device in the embodiment of the present application is similar to that of the screen control method in the embodiment of the present application, the implementation of the device can refer to the implementation of the method, and repeated details are omitted.
An embodiment of the present application further provides a screen control, as shown in fig. 4, a schematic structural diagram of a screen control device provided in the embodiment of the present application, where the screen control device includes:
a first determining module 401, configured to determine, based on a received screen image including a track of invisible laser light, actual position coordinates of the track of invisible laser light in a screen corresponding to the screen image;
a generating module 402, configured to generate a control instruction for controlling the screen to display according to the key instruction and the actual position coordinate sent together with the invisible laser;
and the processing module 403 is configured to return the control instruction to a screen control system of the screen, so as to implement control of the screen.
The device further comprises:
the acquisition module is used for acquiring a screen image formed by visible light on the screen;
and the second determining module is used for determining the corresponding relation between the image coordinate of the screen image and the actual position coordinate according to the image coordinate of the target light spot in the screen image and the pre-stored standard image coordinate of the target light spot.
The second determining module comprises:
a comparison unit for comparing the image coordinates with the standard image coordinates;
the calibration unit is used for calibrating the image coordinates according to the pre-stored standard image coordinates if the image coordinates are inconsistent with the standard image coordinates;
and the generating unit is used for generating the corresponding relation between the image coordinate and the actual position coordinate of the calibrated screen image according to the proportional relation between the screen image and the screen.
In this embodiment, specific functions and interaction manners of the first determining module 401, the generating module 402, and the processing module 403 may refer to the description of the embodiment corresponding to fig. 1, and are not described herein again.
As shown in fig. 5, for a schematic diagram of an electronic device provided in an embodiment of the present application, the apparatus includes a server 51, a memory 52, and a bus 53, where the memory 52 stores an execution instruction, when the apparatus is operated, the server 51 communicates with the memory 52 through the bus 53, and the server 51 executes the execution instruction to cause the apparatus to perform the following method:
determining actual position coordinates of the track of the invisible laser in a screen corresponding to the screen image based on the received screen image comprising the track of the invisible laser; the invisible laser and the visible light form an indicating light beam, and the indicating light beam is used for prompting a user to indicate a position;
generating a control instruction for controlling the screen to display according to a key instruction and the actual position coordinate which are sent together with the invisible laser;
and returning the control instruction to a screen control system of the screen to realize the control of the screen.
Optionally, in the method executed by the server 51, before the step of determining, based on the received screen image including the trajectory of the invisible laser light, actual position coordinates of the trajectory of the invisible laser light in a screen corresponding to the screen image, the method further includes:
acquiring a screen image formed by visible light on the screen;
and determining the corresponding relation between the image coordinates of the screen image and the actual position coordinates according to the image coordinates of the target light points in the screen image and the pre-stored standard image coordinates of the target light points in the screen image.
Optionally, in the method executed by the server 51, the determining a correspondence between the image coordinates of the screen image and the actual position coordinates according to the image coordinates of the target light point in the screen image and the pre-stored standard image coordinates of the target light point includes:
comparing the image coordinates to the standard image coordinates;
if the image coordinate is not consistent with the standard image coordinate, calibrating the image coordinate according to a pre-stored standard image coordinate;
and generating a corresponding relation between the image coordinates and the actual position coordinates of the calibrated screen image according to the proportional relation between the screen image and the screen.
Optionally, in the method executed by the server 51, the determining, based on the received screen image including the track of the invisible laser light, the actual position coordinate of the track of the invisible laser light in the screen corresponding to the screen image includes:
determining image coordinates of a track of invisible laser light on a received screen image comprising the track of invisible laser light;
and determining the actual position coordinates of the track of the invisible laser in the screen corresponding to the screen image according to the image coordinates of the track of the invisible laser on the screen image and the corresponding relationship between the image coordinates of the calibrated screen image and the actual position coordinates.
Optionally, in the method executed by the server 51, the determining, according to the position coordinates of the track of the invisible laser on the screen image and the correspondence between the image coordinates of the screen image and the actual position coordinates, the actual position coordinates of the track of the invisible laser in the screen corresponding to the screen image includes:
and performing equal-scale transformation on the image coordinates of the track of the invisible laser on the screen image according to the corresponding relation between the image coordinates and the actual position coordinates of the screen image to obtain the actual position coordinates of the track of the invisible laser on the screen.
Corresponding to the screen control method in fig. 1, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a server, performs the steps of the screen control method.
Specifically, the storage medium can be a general storage medium, such as a mobile disk, a hard disk, and the like, and when a computer program on the storage medium is run, the screen control method can be executed, so that the problem of interaction between a self-luminous display screen and a user is solved, and the effects of realizing the control of the user on the screen through invisible laser and improving the accuracy of screen control are achieved.
The computer program product of the screen control method provided in the embodiment of the present application includes a computer-readable storage medium storing a program code, where instructions included in the program code may be used to execute the method described in the foregoing method embodiment, and specific implementation may refer to the method embodiment, which is not described herein again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a server. Based on such understanding, the technical solutions of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: those skilled in the art can still make modifications or changes to the embodiments described in the foregoing embodiments, or make equivalent substitutions for some features, within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the exemplary embodiments of the present application, and are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (5)
1. A screen control method, comprising:
acquiring a screen image formed by visible light on the screen, wherein the acquired screen image formed by the visible light on the screen is acquired by a visible light sensing module arranged around the screen and is sent to a server;
the screen is calibrated by using visible light mixed by green laser with the center wavelength of 532nm and red laser with the center wavelength of 650nm, which are sensitive to human eyes; determining a corresponding relation between the image coordinates of the screen image and the actual position coordinates according to the image coordinates of the target light points in the screen image and the pre-stored standard image coordinates of the target light points;
determining the actual position coordinates of the track of the invisible laser in a screen corresponding to the screen image based on the received screen image comprising the track of the invisible laser; the invisible laser and the visible light form an indicating light beam, and the indicating light beam is used for prompting a user to indicate a position; the received screen image comprising the track of the invisible laser is collected by an invisible light sensing module arranged around a screen and is sent to a server, the positions of the invisible laser and the visible light on the screen are coincident, the visible light comprises two visible lights, one is green laser with the central wavelength of 532nm and the other is red laser with the central wavelength of 650nm, the laser with the central wavelength of more than or equal to 532nm and the laser with the central wavelength of less than or equal to 650nm can be mixed according to the intensity of the two lasers, and the color of the visible light is adjusted according to external light; the green laser emits a green visible laser beam, and the green visible laser beam passes through a holophote and then vertically enters the X prism from the upper part; the infrared invisible laser emits invisible laser beams which are directly projected into the X prism from the back; a red laser emits a red visible laser beam, and the red visible laser beam passes through a total reflector and then vertically enters the X prism from the lower part; after the three lasers are combined by the X prism, laser beams with mixed wavelengths are emitted from the front of the remote control equipment;
generating a control instruction for controlling the screen to display according to a key instruction and the actual position coordinate which are sent together with the invisible laser;
returning the control instruction to a screen control system of the screen to realize the control of the screen;
the determining the corresponding relationship between the image coordinates of the screen image and the actual position coordinates according to the image coordinates of the target light points in the screen image and the pre-stored standard image coordinates of the target light points comprises:
comparing the image coordinates to the standard image coordinates;
if the image coordinate is inconsistent with the standard image coordinate, calibrating the image coordinate according to a pre-stored standard image coordinate;
generating a corresponding relation between the image coordinate and the actual position coordinate of the calibrated screen image according to the proportional relation between the screen image and the screen;
the determining the actual position coordinates of the track of the invisible laser in the screen corresponding to the screen image according to the position coordinates of the track of the invisible laser on the screen image and the corresponding relationship between the image coordinates of the screen image and the actual position coordinates comprises:
calibrating the screen to obtain calibrated image coordinates;
and performing equal-scale transformation on the image coordinates of the track of the invisible laser on the screen image according to the corresponding relation between the image coordinates and the actual position coordinates after the screen image is calibrated, so as to obtain the actual position coordinates of the track of the invisible laser on the screen.
2. The method of claim 1, wherein the determining the actual position coordinates of the track of the invisible laser light in the screen corresponding to the screen image based on the received screen image comprising the track of the invisible laser light comprises:
determining image coordinates of a track of invisible laser light on a received screen image comprising the track of invisible laser light;
and determining the actual position coordinate of the track of the invisible laser in the screen corresponding to the screen image according to the image coordinate of the track of the invisible laser on the screen image and the corresponding relation between the image coordinate of the calibrated screen image and the actual position coordinate.
3. A screen control apparatus, comprising:
the acquisition module is used for acquiring a screen image formed by visible light on the screen, and the acquired screen image formed by the visible light on the screen is acquired by the visible light sensing module arranged around the screen and is sent to the server;
the second determining module is used for calibrating the screen by using visible light mixed by green laser with the central wavelength of 532nm and red laser with the central wavelength of 650nm, which are sensitive to human eyes; determining a corresponding relation between the image coordinates of the screen image and the actual position coordinates according to the image coordinates of the target light points in the screen image and the pre-stored standard image coordinates of the target light points;
the first determining module is used for determining the actual position coordinates of the track of the invisible laser in a screen corresponding to the screen image based on the received screen image comprising the track of the invisible laser; the invisible laser and the visible light form an indicating light beam, and the indicating light beam is used for prompting a user to indicate a position; the received screen image comprising the track of the invisible laser is collected by an invisible light sensing module arranged around a screen and is sent to a server, the positions of the invisible laser and the visible light on the screen are coincident, the visible light comprises two visible lights, one is green laser with the central wavelength of 532nm and the other is red laser with the central wavelength of 650nm, the laser with the central wavelength of more than or equal to 532nm and the laser with the central wavelength of less than or equal to 650nm can be mixed according to the intensity of the two lasers, and the color of the visible light is adjusted according to external light; the green laser emits a green visible laser beam, and the green visible laser beam passes through a holophote and then vertically enters the X prism from the upper part; the infrared invisible laser emits invisible laser beams which are directly projected into the X prism from the back; a red laser emits a red visible laser beam, and the red visible laser beam passes through a total reflection mirror and then vertically enters an X prism from the lower part; after the three lasers are combined by the X prism, laser beams with mixed wavelengths are emitted from the front of the remote control equipment;
the generating module is used for generating a control instruction for controlling the screen to display according to a key instruction and the actual position coordinate which are sent together with the invisible laser;
the processing module is used for returning the control instruction to a screen control system of the screen so as to realize the control of the screen;
the second determining module includes:
a comparison unit for comparing the image coordinates with the standard image coordinates;
the calibration unit is used for calibrating the image coordinates according to the pre-stored standard image coordinates if the image coordinates are inconsistent with the standard image coordinates;
the generating unit is used for generating a corresponding relation between the image coordinate of the calibrated screen image and the actual position coordinate according to the proportional relation between the screen image and the screen;
the first determination module is further to:
calibrating the screen to obtain a calibrated image coordinate;
and performing equal-scale transformation on the image coordinates of the track of the invisible laser on the screen image according to the corresponding relation between the image coordinates and the actual position coordinates after the screen image is calibrated, so as to obtain the actual position coordinates of the track of the invisible laser on the screen.
4. An electronic device, comprising: a server, a memory and a bus, the memory storing machine-readable instructions executable by the server, the server and the memory communicating over the bus when the electronic device is running, the machine-readable instructions when executed by the server performing the steps of the method of screen control according to any of claims 1 to 2.
5. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a server, performs the steps of the method of screen control according to any one of claims 1 to 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811180697.XA CN109144375B (en) | 2018-10-09 | 2018-10-09 | Screen control method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811180697.XA CN109144375B (en) | 2018-10-09 | 2018-10-09 | Screen control method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109144375A CN109144375A (en) | 2019-01-04 |
| CN109144375B true CN109144375B (en) | 2022-08-19 |
Family
ID=64811482
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811180697.XA Active CN109144375B (en) | 2018-10-09 | 2018-10-09 | Screen control method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109144375B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112153781A (en) * | 2019-06-28 | 2020-12-29 | Oppo广东移动通信有限公司 | Light control system, method, lamp, mobile terminal and storage medium |
| CN111107406A (en) * | 2019-12-20 | 2020-05-05 | 视联动力信息技术股份有限公司 | Control method and device of display terminal and storage medium |
| CN111462248B (en) * | 2020-03-13 | 2024-05-14 | 中天智领（北京）科技有限公司 | Cursor position calibration parameter calibration method and device for screen interaction |
| CN111462247B (en) * | 2020-03-13 | 2024-04-02 | 中天智领（北京）科技有限公司 | Cursor position calibration method and device for screen interaction |
| CN111831140B (en) * | 2020-07-14 | 2024-10-15 | 北京简元科技有限公司 | Visual interaction method, device and equipment based on laser pen |
| CN114428571A (en) * | 2020-10-29 | 2022-05-03 | 深圳Tcl新技术有限公司 | Interaction method, computer equipment and computer readable storage medium |
| CN112506384B (en) * | 2020-12-18 | 2024-07-09 | 深圳Tcl新技术有限公司 | Interaction method, device and equipment based on laser signals and readable storage medium |
| CN113050113B (en) * | 2021-03-10 | 2023-08-01 | 广州南方卫星导航仪器有限公司 | Laser spot positioning method and device |
| CN113325659A (en) * | 2021-05-31 | 2021-08-31 | 深圳市极鑫科技有限公司 | Human-computer interaction system and method based on projection display |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1534544A (en) * | 2003-04-01 | 2004-10-06 | 中国科学院电子学研究所 | Large screen non contact type control mode |
| CN102073395A (en) * | 2011-02-25 | 2011-05-25 | 上海交通大学 | Wireless laser pen interaction system based on field programmable gate array (FPGA) |
| CN103702607A (en) * | 2011-07-08 | 2014-04-02 | 修复型机器人公司 | Calibration and transformation of a camera system's coordinate system |
| CN105955512A (en) * | 2016-04-18 | 2016-09-21 | 陕西铁路工程职业技术学院 | Mouse-type laser electronic chalk |
| CN106598356A (en) * | 2016-11-24 | 2017-04-26 | 北方工业大学 | Method, device and system for detecting positioning point of input signal of infrared emission source |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5786803A (en) * | 1994-05-09 | 1998-07-28 | Apple Computer, Inc. | System and method for adjusting the illumination characteristics of an output device |
| JP2004246574A (en) * | 2003-02-13 | 2004-09-02 | Fuji Photo Optical Co Ltd | Presentation device |
| CN102122499A (en) * | 2011-02-23 | 2011-07-13 | 西南交通大学 | Light environment adaptive regulating system for screen display equipment |
| CN202067394U (en) * | 2011-05-12 | 2011-12-07 | 陈默 | Infrared ray remote controller |
| CN202110500U (en) * | 2011-05-31 | 2012-01-11 | 王石 | Visual mouse system of screen |
| CN102253737B (en) * | 2011-05-31 | 2013-07-17 | 王石 | Realizing method of screen-vision mouse system |
| CN103092432B (en) * | 2011-11-08 | 2016-08-03 | 深圳市中科睿成智能科技有限公司 | The trigger control method of man-machine interactive operation instruction and system and laser beam emitting device |
| CN102591531B (en) * | 2011-12-26 | 2014-11-19 | 深圳市巨龙科教高技术股份有限公司 | Electronic whiteboard, coordinate mapping method for same, device |
| CN104020894B (en) * | 2013-02-28 | 2019-06-28 | 现代自动车株式会社 | The display device touched for identification |
| CN106257388A (en) * | 2016-07-25 | 2016-12-28 | 北京仁光科技有限公司 | A kind of localization method of optical touch screen |
| CN106293270B (en) * | 2016-08-05 | 2018-11-13 | 南京仁光电子科技有限公司 | A kind of scaling method of large screen touch-control system |
| CN206115398U (en) * | 2016-08-10 | 2017-04-19 | 淮安信息职业技术学院 | Cross facula location whiteboard |
| CN106354460A (en) * | 2016-08-29 | 2017-01-25 | 武汉仁光科技有限公司 | Physical interaction system and interaction method thereof |
| CN106353957A (en) * | 2016-09-29 | 2017-01-25 | 南京仁光电子科技有限公司 | Laser-projector-based interaction device and method |
| CN106527825B (en) * | 2016-09-30 | 2019-03-26 | 南京仁光电子科技有限公司 | A kind of large screen remote control interactive system and its exchange method |
| CN106970748A (en) * | 2016-10-13 | 2017-07-21 | 蔚来汽车有限公司 | The method and system of vehicle-mounted HUD display colors is automatically adjusted based on ambient light color |
-
2018
- 2018-10-09 CN CN201811180697.XA patent/CN109144375B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1534544A (en) * | 2003-04-01 | 2004-10-06 | 中国科学院电子学研究所 | Large screen non contact type control mode |
| CN102073395A (en) * | 2011-02-25 | 2011-05-25 | 上海交通大学 | Wireless laser pen interaction system based on field programmable gate array (FPGA) |
| CN103702607A (en) * | 2011-07-08 | 2014-04-02 | 修复型机器人公司 | Calibration and transformation of a camera system's coordinate system |
| CN105955512A (en) * | 2016-04-18 | 2016-09-21 | 陕西铁路工程职业技术学院 | Mouse-type laser electronic chalk |
| CN106598356A (en) * | 2016-11-24 | 2017-04-26 | 北方工业大学 | Method, device and system for detecting positioning point of input signal of infrared emission source |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109144375A (en) | 2019-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109144375B (en) | Screen control method and device | |
| CN104793811B (en) | The control method of position detecting system and position detecting system | |
| CN104730827B (en) | The control method of projecting apparatus, optical projection system and projecting apparatus | |
| US10907923B2 (en) | Shooting system using laser beam | |
| US20040169639A1 (en) | Visible pointer tracking with separately detectable pointer tracking signal | |
| CN103576428A (en) | Laser projection system with security protection mechanism | |
| CN108875473A (en) | Living body verification method, device and system and storage medium | |
| CN104793810A (en) | Position detecting device, position detecting system, and controlling method of position detecting device | |
| CN108446047A (en) | Display device and display control method | |
| US11132832B2 (en) | Augmented reality (AR) mat with light, touch sensing mat with infrared trackable surface | |
| US20090244497A1 (en) | Projection Display Apparatus and Control Method Thereof | |
| JP2006277552A (en) | Information display system and information display method | |
| US10616540B2 (en) | Lamp control | |
| CN108737800A (en) | The control method of display device and display device | |
| CN105938410A (en) | Display apparatus and control method for display apparatus | |
| JP6143791B2 (en) | Method for detecting and controlling an encoded light source | |
| CN108279774B (en) | Method, device, intelligent equipment, system and storage medium for region calibration | |
| CN105988638B (en) | Position detecting device and its control method and display device and its control method | |
| CN112911358B (en) | Laser television and human eye protection method based on laser television | |
| CN105677030B (en) | A kind of control method and electronic equipment | |
| CN105468135A (en) | Information processing method and electronic device | |
| CN112908228A (en) | Display brightness adjusting method and device, head-mounted display equipment and storage medium | |
| US8872763B2 (en) | Position detecting system and position detecting method | |
| JP6681610B2 (en) | Guidance display device and guidance system | |
| JP2021092521A (en) | Head-mounted type temperature distribution recognition device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |