CN116152113A

CN116152113A - Information input method, information input device, storage medium and terminal equipment

Info

Publication number: CN116152113A
Application number: CN202310258011.9A
Authority: CN
Inventors: 张麟瑞
Original assignee: Individual
Current assignee: Individual
Priority date: 2023-03-10
Filing date: 2023-03-10
Publication date: 2023-05-23

Abstract

The present disclosure relates to an information input method, an information input device, an electronic apparatus for information input, a storage medium, and a terminal apparatus. The information input method comprises the steps of emitting infrared rays to a display screen through an infrared laser; acquiring an infrared light image transmitted by a camera; infrared light spots formed by infrared light on a display screen are displayed in the infrared light image; performing image calibration on the infrared imaging based on the calibration parameters to obtain a target position of an infrared spot on a display screen; and positioning a cursor on the display screen to a target position of the infrared light spot on the display screen for information input. Through carrying out image calibration processing to infrared light formation of image for when infrared laser's removal, under the circumstances that infrared light spot moved fast on the display screen, can be with the cursor quick positioning to the target position of infrared light spot on the display screen, and then effectively improve the speed of movement of cursor on the display screen.

Description

Information input method, information input device, storage medium and terminal equipment

Technical Field

The present disclosure relates to the field of information technologies, and in particular, to an information input method, an information input device, an electronic device for information input, a storage medium, and a terminal device.

Background

When using a computer or other terminal device having a display screen, it is generally necessary to provide an instructional input device. Movement of the cursor position on the display screen is performed by the indicative input device. Information input is then performed at the cursor position. In some cases, the speed of cursor movement affects the information input efficiency, especially for larger display screens.

Disclosure of Invention

In view of this, it is desirable for embodiments of the present disclosure to provide an information input method, an information input apparatus, an electronic device for information input, a storage medium, and a terminal device.

The technical scheme of the present disclosure is realized as follows:

in a first aspect, the present disclosure provides an information input method.

The information input method provided by the embodiment of the disclosure comprises the following steps:

transmitting infrared rays to a display screen through an infrared laser;

acquiring an infrared light image transmitted by a camera, wherein the infrared light image is a display image of a display screen acquired based on infrared light reflected by the display screen, wherein the camera is positioned at a preset position in front of the display screen; the infrared light image is displayed with an infrared light spot formed by the infrared light on the display screen;

Performing image calibration on the infrared light imaging based on the calibration parameters to obtain a target position of the infrared light spot on the display screen; wherein the calibration parameters are used for imaging and mapping the infrared light to a display area of the display screen;

and positioning a cursor on the display screen to the target position of the infrared light spot on the display screen, and inputting information.

In some embodiments, before the acquiring the infrared light image transmitted by the camera, the method includes:

the method comprises the steps of obtaining a visible light image transmitted by a camera, wherein the visible light image is a display image of the display screen, which is obtained based on visible light emitted by the display screen, of the camera at the preset position;

performing image mapping calibration processing on the visible light image to obtain the calibration parameters; the calibration parameters are used for mapping the visible light image to a display area of the display screen.

In some embodiments, the calibration parameters include distortion mapping parameters, projection mapping parameters, and scale mapping parameters;

the performing image mapping calibration processing on the visible light image to obtain the calibration parameters includes:

Performing distortion mapping processing on the visible light image to obtain the distortion mapping parameters; wherein the distortion mapping parameter is used for mapping the visible light image with distortion to a quadrilateral image;

carrying out projection mapping processing on the quadrilateral image obtained through the distortion mapping processing to obtain the projection mapping parameters; the projection mapping parameters are used for mapping the quadrilateral image into a square image;

performing proportional mapping processing on the square image obtained through projection mapping to obtain the proportional mapping parameters; the proportion mapping parameter is used for mapping the square image to a display area of the display screen.

In some embodiments, the calibration parameters include coordinate mapping parameters;

and performing image calibration on the infrared light imaging based on the calibration parameters to obtain a target position of the infrared light spot on the display screen, wherein the method comprises the following steps:

acquiring position information of the infrared light spot in the infrared light imaging;

and carrying out coordinate mapping on the position information of the infrared light spot based on the coordinate mapping parameters to obtain the target position of the infrared light spot on the display screen.

In some embodiments, the acquiring the infrared light image transmitted by the camera includes:

acquiring a plurality of frames of infrared light images transmitted by the camera in the moving process of the infrared laser;

the positioning the cursor on the display screen to the target position of the infrared light spot on the display screen comprises the following steps:

the target position of the infrared light spot moving on the display screen is obtained by carrying out continuous image calibration on the multi-frame infrared light images;

and moving and positioning the cursor on the display screen along with the target position of the infrared light spot.

In some embodiments, the performing distortion mapping on the visible light image to obtain the distortion mapping parameter includes:

setting points A (Xa, ya) and B (Xb, yb) as two vertexes of one side of the visible light image, and setting point E (Xe, ye) as one point of the side; the point O (Xo, yo, zo) is a spherical spatial mapping reference point, and then it is determined that:

r ² ＝(X–Xo) ² +(Y–Yo) ² wherein r is ² Squaring the distance from the point on the sphere to the spatial mapping reference point to the vertical of the image plane;

dz＝(Zo ² –r ² ) ^(1/2) the method comprises the steps of carrying out a first treatment on the surface of the dz is the z coordinate mapped to a point on the sphere;

rt=zo/dz; rt is the mapping proportion;

Xn＝(X–Xo)*rt+Xo；

yn= (Y-Yo) rt+yo; wherein, (X, Y) is taken as input, (Xn, yn) is taken as output, and mapped points A ', B ' and E ' corresponding to A (Xa, ya), point B (Xb, yb) and point E (Xe, ye) are obtained respectively;

And (3) regulating the points O (Xo, yo, zo) to enable the sum of the distances from E ' to A ' of four sides in the mapped quadrilateral image to form a straight line with B ' to be minimum, and obtaining the determined O (Xo, yo, zo) as the distortion mapping parameter.

In a second aspect, the present disclosure provides an information input device, comprising:

the infrared light emitting module is used for emitting infrared light to the display screen through the infrared laser;

the infrared light image acquisition module is used for acquiring an infrared light image transmitted by the camera, wherein the infrared light image is a display image of the display screen acquired by the camera at a preset position in front of the display screen based on infrared light reflected by the display screen; the infrared light image is displayed with an infrared light spot formed by the infrared light on the display screen;

the image calibration module is used for carrying out image calibration on the infrared light imaging based on calibration parameters to obtain a target position of the infrared light spot on the display screen; wherein the calibration parameters are used for imaging and mapping the infrared light to a display area of the display screen;

and the information input module is used for positioning a cursor on the display screen to the target position of the infrared light spot on the display screen and inputting information.

In a third aspect, the present disclosure provides an electronic device for information input, comprising:

the display screen is used for displaying display information to be input;

the infrared laser is used for emitting infrared rays to the display screen;

the camera is used for information input, is positioned at a preset position in front of the display screen and is used for imaging infrared light of the display screen, which is acquired based on infrared light reflected by the display screen;

the processor is connected with the camera and used for carrying out image calibration on the infrared light imaging based on the calibration parameters to obtain a target position of the infrared light spot on the display screen; wherein the calibration parameters are used for imaging and mapping the infrared light to a display area of the display screen; a kind of electronic device with high-pressure air-conditioning system

In a fourth aspect, the present disclosure provides a computer-readable storage medium having stored thereon an information input program which, when executed by a processor, implements the information input method described in the first aspect.

In a fifth aspect, the present disclosure provides a terminal device, including a memory, a processor, and an information input program stored in the memory and capable of running on the processor, where the processor implements the information input method described in the first aspect when executing the information input program.

An information input method according to an embodiment of the present disclosure includes emitting infrared rays to a display screen by an infrared laser; acquiring an infrared light image transmitted by a camera, wherein the infrared light image is a display image of a display screen acquired by the camera at a preset position in front of the display screen based on infrared light reflected by the display screen; infrared light spots formed by infrared light on a display screen are displayed in the infrared light image; based on the calibration parameters, performing image calibration on the infrared imaging to obtain a target position of an infrared spot on a display screen; the calibration parameters are used for imaging and mapping infrared light to a display area of the display screen; and positioning a cursor on the display screen to a target position of the infrared light spot on the display screen, and inputting information. In this application, through carrying out image calibration processing to infrared light formation of image for when infrared laser's removal, infrared light spot under the circumstances of quick movement on the display screen, can be with the cursor quick positioning to the target position of infrared light spot on the display screen, and then effectively improve the moving speed of cursor on the display screen.

Additional aspects and advantages of the disclosure will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the disclosure.

Drawings

FIG. 1 is a flow chart of an information input method according to an exemplary embodiment;

FIG. 2 is a diagram illustrating a transformation of a distortion-mapped image in an information input method according to an exemplary embodiment;

FIG. 3 is a diagram illustrating a distortion map in an information input method according to an exemplary embodiment;

FIG. 4 is a second diagram of a distortion map in an information input method, according to an exemplary embodiment;

FIG. 5 is a flowchart illustrating a selection of a camera in an information input method according to an exemplary embodiment;

FIG. 6 is a flowchart illustrating adjustment of a camera in an information input method according to an exemplary embodiment;

FIG. 7 is a flowchart of image acquisition in an information input method according to an exemplary embodiment;

FIG. 8 is a flowchart of a system for operating in an information input method, according to an exemplary embodiment;

FIG. 9 is a flow chart illustrating system calibration in an information input method according to an exemplary embodiment;

fig. 10 is a schematic diagram showing the structure of an information input apparatus according to an exemplary embodiment.

Detailed Description

Embodiments of the present disclosure are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are exemplary and intended for the purpose of explaining the present disclosure and are not to be construed as limiting the present disclosure.

In view of the foregoing, the present disclosure provides an information input method. Fig. 1 is a flowchart illustrating an information input method according to an exemplary embodiment. As shown in fig. 1, the information input method can be applied to computer information input, including:

step 10, emitting infrared rays to a display screen through an infrared laser;

step 11, acquiring an infrared light image transmitted by a camera, wherein the infrared light image is a display image of a display screen acquired based on infrared light reflected by the display screen, wherein the camera is positioned at a preset position in front of the display screen; the infrared light image is displayed with an infrared light spot formed by the infrared light on the display screen;

step 12, performing image calibration on the infrared light imaging based on calibration parameters to obtain a target position of the infrared light spot on the display screen; wherein the calibration parameters are used for imaging and mapping the infrared light to a display area of the display screen;

And 13, positioning a cursor on the display screen to the target position of the infrared light spot on the display screen, and inputting information.

In the present exemplary embodiment, the infrared laser may be worn on the head of a human body; the camera is positioned right below the front of the display screen; the lens is a wide-angle lens or an ultra-wide-angle lens; a camera, comprising: the lens is used for acquiring light rays reflected or emitted by a display image on the display screen; the double-filter switcher is provided with a visible light transmission sheet and an infrared light transmission sheet; the double-filter switcher is fixedly connected with the lens and is used for transmitting visible light rays in light rays emitted by the display image when switching to the visible light transmission sheet or transmitting infrared light rays in the light rays reflected by the display image when switching to the infrared light transmission sheet; the imaging device is connected with the double-filter switcher and is used for receiving the visible light transmitted by the visible light transmitting sheet and carrying out visible light imaging on the display image on the display screen when the double-filter switcher is switched to the visible light transmitting sheet; or when the double-filter switcher is switched to the infrared light transmission sheet, receiving infrared light rays transmitted by the infrared light transmission sheet, and carrying out infrared light imaging on a display image on the display screen. The visible light transmitting sheet is used for transmitting visible light rays of 400 nm-600 nm; the infrared light transmitting sheet is used for transmitting infrared light of 700 nm-1100 nm. The target position refers to the target position of the infrared light spot on the display screen.

In the present exemplary embodiment, the calibration parameters include a distortion mapping parameter, a projection mapping parameter, and a scale mapping parameter;

In the present exemplary embodiment, fig. 2 is a diagram illustrating a distortion map image transformation in an information input method according to an exemplary embodiment. As shown in fig. 2, the visible light image is mapped to a square image. FIG. 3 is a diagram illustrating a distortion map in an information input method according to an exemplary embodiment; fig. 4 is a diagram illustrating a distortion map in an information input method according to an exemplary embodiment. The mapping process is as shown in fig. 3: the M point is a straight line parallel to the Z axis passing through the P point, and is a spherical surface tangent to the XY plane at the O point and the center of the sphere, and is close to the intersection point of one side of the P point.

In fig. 3, the performing distortion mapping on the visible light image to obtain the distortion mapping parameters includes:

r ² ＝(X–Xo) ² +(Y–Yo) ² wherein r is ² Squaring the distance from the point on the sphere to the spatial mapping reference point to the vertical of the image plane; wherein the image plane may be a spherical section;

rt=zo/dz; rt is the mapping proportion;

Xn＝(X–Xo)*rt+Xo；

For example, each of the four sides of the visible light image may correspond to a set of a (Xa, ya), point B (Xb, yb), point E (Xe, ye); the four sides of the mapped square image also correspond to points a ', B ' and E ', respectively, corresponding to a (Xa, ya), point B (Xb, yb), point E (Xe, ye), respectively. And (3) regulating the points O (Xo, yo, zo) to enable the sum of the distances from E ' to A ' of four sides in the mapped quadrilateral image to form a straight line with B ' to be minimum, so that the determined O (Xo, yo, zo) is the distortion mapping parameter.

After distortion mapping parameters are obtained, when infrared light image mapping is carried out, taking the coordinates of an infrared light spot on an infrared light image as (X, y) as input, and carrying in xn= (X-Xo) rt+xo; yn= (Y-Yo) rt+yo; the output (Xn, yn) is obtained as the coordinates of the infrared spot on the mapped square image.

By arranging the above formula, xn= (X-Xo) Zo/((Zo) ² –((X–Xo) ² +(Y–Yo) ² )) ^(1/2) )+Xo；

Yn＝(Y–Yo)*Zo/((Zo ² –((X–Xo) ² +(Y–Yo) ² )) ^(1/2) )+Yo；

Wherein O (Xo, yo, zo) is a spatial mapping reference point, P _(X,Y,0) P being a point in the original image _’(Xn,Yn,0) Is the mapped point of the P point in the original image.

After setting a spatial mapping reference point, an image obtained by mapping the original distorted image is obtained by the distortion correction method, as shown in fig. 4:

A. four points B, C, D are four endpoints and four points E, F, G, H are each mapped to a point in the middle of curve AB, BC, CD, DA. At this time, distances e1, e2, e3, e4 from the four points E, F, G, H to the corresponding straight lines AB, BC, CD, DA can be calculated.

Let AB straight line equation be: a x+b y+c=0, then E (x ', y') is at a distance from the line AB of:

e1＝|A*x’+B*y’+C|/((A ² +B ² ) ^(1/2) )；

the total error is:

the correction process reduces the total error E by continually attempting to adjust the position of the spatial mapping reference point O, which is the optimal reference point when E is minimized.

In the present exemplary embodiment, a quadrangular image is obtained after distortion mapping, and a square image is obtained by projection mapping. The parameter for mapping the quadrangular image into the square image is a projection mapping parameter. For example, the quadrangular image is a trapezoidal image, and the parameter for mapping the trapezoidal image to the square image is a projection mapping parameter. And mapping the size of the square image to the size of the display area of the display screen to obtain the proportional mapping parameter. For example, the size of the square image is 2×2, and the size of the display area of the display screen is 4*8, and the ratio mapping parameter is 2×4.

In the present exemplary embodiment, the calibration parameters include coordinate mapping parameters;

the image calibration is carried out on the infrared light imaging based on the calibration parameters to obtain the target position of the infrared light spot on the display screen, and the method comprises the following steps:

In the present exemplary embodiment, a cursor on a display screen moves following the movement of an infrared light spot formed on the display screen.

Typical device configurations may include a mouse, a tablet, and the like. The mouse belongs to relative position input equipment, and only can input the offset of a few pixels at a time, so long-distance sliding or repeated sliding is needed to position a cursor to a new position, and the time and the labor are wasted; the handwriting board is absolute position input equipment, and a cursor can move to a corresponding proportion position of a screen when clicking a certain position on the handwriting board each time, so that the handwriting board is more convenient, but the position of the input pen on the handwriting board needs to be repeatedly adjusted each time, and the position condition of the handwriting board needs to be concerned, so that the handwriting board is quite unintuitive and cannot be seen; the touch screen can perfectly solve a plurality of problems of the mouse and the handwriting board, but when inputting, a user needs to move the hand on the screen continuously, the action range is large, fatigue is easily caused when the touch screen is used for a long time, and meanwhile, the touch screen is large in loss and relatively expensive in price, so that the touch screen is unfavorable for popularization.

The information input method does not use input modes such as a mouse, a handwriting board and the like, but adopts infrared laser input as a remote non-contact input mode. Because the photoelectric direct indication mode is adopted for inputting the position information, the contact with a mouse, a handwriting board and a touch screen is avoided, the vulnerability of the equipment is effectively reduced, and simultaneously, both hands can be fully released;

Secondly, as a direct position input mode: the cursor position information generated by the photoelectric direct indication mode belongs to a direct position input mode, so that the mouse-type reciprocating dragging can be avoided, and the cursor positioning speed is greatly improved;

the response speed is high: because a direct position input mode is adopted, and a new cursor position coordinate can be obtained after a resolving program processes one frame of image, a cursor can be arranged at a preset position immediately as long as laser is turned to a target position;

the infrared laser mode of wear-type can liberate both hands, moves the neck simultaneously, reduces mouse hand and cervical vertebra disease etc..

According to the information input mode, low-power-consumption infrared laser is used for irradiating a computer screen to form diffuse reflection light spots, an image containing the screen is obtained through a camera additionally provided with an infrared filter, and finally bright spots in the image are converted into position information of a cursor through an algorithm program on the computer.

The advantages are that: the laser can be used in a head-mounted mode, so that other devices do not need to be manually operated to move a cursor; the cursor position is input in a non-contact mode, so that the reliability and durability of the equipment can be greatly improved; by adopting an absolute position input mode, the cursor positioning speed can be improved, so that the use comfort level is improved.

The full-transparent filter sheet on the common IR_CUT double-filter switcher is changed into an infrared filter sheet, namely only infrared light is allowed to pass through, and visible light and the like are eliminated; accordingly, when the calibration is performed, the common visible light filter can be used for acquiring the image of the screen to determine the position and deformation of the screen; during normal operation, the infrared filter is adopted to shield the visible light of the screen, so that the position of the light spot can be better obtained, and the corresponding cursor coordinate can be calculated.

1. The calibration process comprises the following steps:

1-1, selecting a camera: since a plurality of internal or external cameras may be connected to the same computer, a user needs to select the correct camera;

1-1-1, acquiring all camera information lists on a computer;

1-1-2, displaying a camera list and displaying an image of a currently selected camera; the camera which is used by the equipment can be judged by adjusting the currently selected camera and looking up the corresponding image;

1-1-3, storing information of cameras used by the equipment set by a user.

1-2, adjusting the position of a camera: in the process, the camera is required to be adjusted to a proper position, so that the screen is displayed at the middle part of the camera as far as possible, and the view field range of the camera is filled as far as possible;

1-2-1, opening a camera of the equipment and displaying real-time video;

1-2-2, requiring a user to refer to a real-time video, and adjusting the front, back, left and right positions of a camera and the pitching and rolling angle positions of the camera so that a screen seen in the video on the screen is that the upper part of the screen is positioned at the upper side, the lower part of the screen is positioned at the lower side, the left and right directions are horizontal as much as possible, and the whole camera image range is filled in the middle as much as possible; the step can be exited when the requirement is met;

1-3, calibration image acquisition: because various interferences in reality can cause that a small number of pictures are collected to be corrected, larger errors and errors can occur, the pictures need to be collected for multiple times, so that the interferences in the collection are eliminated as much as possible;

1-3-1, repeatedly setting the whole screen to be darker in white brightness and a plurality of fixed brightness levels, acquiring average images of the darker and the plurality of fixed brightness levels through multiple acquisition, and then integrating the images to acquire an image with a highlighted screen and a maximally eliminated background as a correction reference image;

1-3-2, setting the screen to be fully bright, and setting a dark area in the upper left corner; acquiring a camera image at the moment as a basis for judging the phase of a screen;

1-3-2, storing the two pictures as reference pictures in correction;

1-4, calibrating: the process needs to obtain parameters for converting the distorted image into a weak distorted image and transmission parameters for converting the weak distorted image into a unit square, and needs to acquire the condition of the screen phase;

1-4-1, binarizing the correction reference image, searching screen boundary points from the middle part of the binarized image to the periphery, and searching the boundary sequence of the whole screen along the boundary points;

1-4-2, the four vertexes on the screen boundary can be obtained through the distance from one point on the boundary sequence to the straight line formed by the N-th point before and after the boundary sequence;

1-4-3, wherein points A (Xa, ya) and B (Xb, yb) are two vertexes of one side of the visible light image, and point E (Xe, ye) is one point of the side; the point O (Xo, yo, zo) is a spherical spatial mapping reference point, and then it is determined that:

r ² ＝(X–Xo) ² +(Y–Yo) ² wherein r is ² Squaring the distance from the point on the sphere to the spatial mapping reference point to the vertical of the image plane; wherein the image plane may beTaking the spherical section;

rt=zo/dz; rt is the mapping proportion;

Xn＝(X–Xo)*rt+Xo；

For example, each of the four sides of the visible light image may correspond to a set of a (Xa, ya), point B (Xb, yb), point E (Xe, ye); the four sides of the mapped square image also correspond to points a ', B ' and E ', respectively, corresponding to a (Xa, ya), point B (Xb, yb), point E (Xe, ye), respectively. And (3) regulating the points O (Xo, yo, zo) to enable the sum of the distances from E ' to A ' of four sides in the mapped quadrilateral image to form a straight line with B ' to be minimum, so that the determined O (Xo, yo, zo) is the distortion mapping parameter. The O-points are mapped accordingly, thereby converting the original distortion boundary into a regular quadrilateral.

1-4-4, mapping the quadrangle into a unit square by a projection mapping method after distortion mapping is completed. So far the correction parameters are complete.

2. The working procedure comprises the following steps:

2-1, calling in parameters in the standard process;

2-2, setting to an infrared mode and starting a camera to acquire a real-time image;

2-3, detecting infrared laser bright spots in a screen position area, and calculating the gravity center position of the bright spots;

2-4, converting the gravity center position of the bright spot into a unit square range through distortion mapping and projection mapping;

2-5, mapping the unit square position into full-screen position information according to the screen resolution, and setting the cursor position through an operating system API (application programming interface).

In the present exemplary embodiment, the dual filter switcher includes:

a housing having a light hole; the lens is fixed on the shell of the double-filter switcher, and the light output end of the lens is aligned with the light transmission hole;

the light sheet switcher component is positioned on the inner side of the shell and can be connected with the shell in a relative rotation way; the visible light transmitting sheet and the infrared light transmitting sheet are both positioned on the light sheet switcher member; when the light sheet switcher component rotates relative to the shell, the visible light transparent sheet and the infrared light transparent sheet can be switched to the light holes.

In the present exemplary embodiment, the light sheet switching mechanism member has a visible light transmitting sheet mounting position and an infrared light transmitting sheet mounting position; the light sheet switching mechanism piece is provided with a chute between the visible light transparent sheet installation position and the infrared light transparent sheet installation position; the light sheet switcher component is provided with a rotating hole at a preset distance from the chute; the connecting axis of the rotating hole and the sliding groove is positioned between the visible light transparent sheet mounting position and the infrared light transparent sheet mounting position.

In the present exemplary embodiment, the housing has a tap lever and a drive mechanism thereon; the first end of the toggle rod is provided with a sliding block, and the sliding block is positioned in the sliding groove; the second end of the poking rod is connected with the driving mechanism;

the driving mechanism is used for controlling the toggle rod to rotate relative to the shell by taking the second end as the center and driving the sliding block at the first end to slide in the sliding groove so as to drive the light sheet switcher component to rotate around the rotating hole.

In the present exemplary embodiment, the housing has a rotation post thereon; the turning aperture of the light sheet switcher member is nested on a turning post of the housing.

In the present exemplary embodiment, the lens is a wide-angle lens or an ultra-wide-angle lens.

In the present exemplary embodiment, the visible light-transmitting sheet is for transmitting visible rays of 400nm to 600 nm; the infrared light transmitting sheet is used for transmitting infrared light of 700 nm-1100 nm.

In the present exemplary embodiment, the driving mechanism includes a control coil; the control coil is connected with the toggle rod and used for controlling the rotation of the fluctuation rod by applying forward or reverse voltage to the control coil. During switching, the forward voltage toggle rod is added to the two ends of the coil to switch to one side, and the reverse voltage toggle rod is added to switch to the other side.

In the present exemplary embodiment, a terminal device for displaying information input includes:

the display screen is used for displaying display information to be input;

the infrared laser is used for emitting infrared rays to the display screen;

the camera for displaying information input in the above embodiment;

the processor is connected with the camera, and is used for receiving the visible light imaging transmitted by the camera when the double-filter switcher is switched to the visible light transmission sheet, and performing image mapping calibration on the visible light imaging to obtain calibration parameters; the calibration parameters are used for mapping the visible light image to a display area of the display screen; a kind of electronic device with high-pressure air-conditioning system

When the double-filter switcher is switched to the infrared light transmitting sheet, the infrared light imaging transmitted by the camera is received, and the infrared light imaging is subjected to image calibration through the calibration parameters, so that the target position of an infrared light spot formed on the display screen by the infrared light emitted by the infrared laser is obtained, and

and positioning a cursor on the display screen to the target position of the infrared light spot on the display screen.

In the present exemplary embodiment, the infrared laser may be worn on the head of a human body;

The camera is positioned right below the front of the display screen;

when the infrared laser moves relative to the display screen, a cursor on the display screen moves along with the movement of the infrared light spot formed on the display screen.

In the application, the system realizes non-contact direct position input, is more convenient than the common mouse input, adopts head-mounted infrared laser indication, and can release hands to the maximum extent; the computer is convenient for the disabled to use; providing a possibility for rapid cursor movement in the game; in offices, physical rigidity, especially the neck, is avoided. Meanwhile, an IR_CUT component is not used in the application, and an infrared filter disc is directly added by using a common camera; the method needs to position and correct the screen by further enhancing the brightness of the screen or adopting other infrared light sources to irradiate the screen; switching between a visible light mode and an infrared light mode is realized by adopting other filter switching methods; and setting an infrared characteristic mark around the screen, changing a camera into a head-mounted type, and calibrating the screen and the pointing position by observing the infrared characteristic mark through the camera.

The present disclosure provides an electronic device for information input, comprising:

The display screen is used for displaying display information to be input;

the infrared laser is used for emitting infrared rays to the display screen;

In this exemplary embodiment, the camera for inputting information is located at a predetermined position in front of the display screen, and is configured to obtain a visible light image transmitted by the camera, where the visible light image is a display image of the display screen obtained based on visible light emitted by the display screen and the camera is located at the predetermined position;

the processor is connected with the camera and used for carrying out image mapping calibration processing on the visible light image to obtain the calibration parameters; the calibration parameters are used for mapping the visible light image to a display area of the display screen.

Fig. 5 is a flowchart illustrating a selection of a camera in an information input method according to an exemplary embodiment. As shown in fig. 5, selecting a camera flow includes:

step 50, selecting a camera;

step 51, obtaining a camera list;

step 52, displaying a camera list;

step 53, obtaining user selection;

step 54, save the user selection.

Fig. 6 is a flowchart illustrating adjustment of a camera in an information input method according to an exemplary embodiment. As shown in fig. 6, adjusting the camera flow includes:

step 61, turning on a camera;

step 62, displaying camera video;

step 63, waiting for user adjustment;

step 64, the user ends.

Fig. 7 is a flowchart of image acquisition in an information input method according to an exemplary embodiment. As shown in fig. 7, the image acquisition process includes:

step 70, turning on a camera;

step 71, setting full brightness of a screen;

step 72, acquiring a camera image;

step 73, setting the screen to be completely dark;

step 74, acquiring a camera image;

step 75, repeating for 10 times;

step 76, obtaining an image average difference;

step 77, displaying an angle mark graph;

step 78, obtaining an angle mark graph;

step 79, saving the image.

Fig. 8 is a flowchart illustrating a system for operating in an information input method according to an exemplary embodiment. As shown in fig. 8, the running system flow includes:

Step 80, operating the system;

step 81, adjusting calibration parameters;

step 82, turning on the camera;

step 83, obtaining a camera image;

step 84, calling a processing module;

step 85, setting the cursor position.

FIG. 9 is a flow chart illustrating system calibration in an information input method according to an exemplary embodiment. As shown in fig. 9, the system calibration procedure includes:

step 90, adjusting in an average difference;

step 91, calling a calibration module;

step 92, calling in a marked image;

and 93, storing calibration parameters.

The present disclosure provides an information input device. Fig. 10 is a schematic diagram showing the structure of an information input apparatus according to an exemplary embodiment. As shown in fig. 10, the information input device includes:

an infrared light emitting module 30 for emitting infrared light to the display screen by an infrared laser;

an infrared light image obtaining module 31, configured to obtain an infrared light image transmitted by a camera, where the infrared light image is a display image of a display screen obtained by the camera at a predetermined position in front of the display screen based on an infrared light reflected by the display screen; the infrared light image is displayed with an infrared light spot formed by the infrared light on the display screen;

An image calibration module 32, configured to perform image calibration on the infrared light imaging based on calibration parameters, so as to obtain a target position of the infrared light spot on the display screen; wherein the calibration parameters are used for imaging and mapping the infrared light to a display area of the display screen;

and the information input module 33 is used for positioning a cursor on the display screen to the target position of the infrared light spot on the display screen and inputting information.

The information input device is used for emitting infrared rays to the display screen through the infrared laser; acquiring an infrared light image transmitted by a camera, wherein the infrared light image is a display image of a display screen acquired by the camera at a preset position in front of the display screen based on infrared light reflected by the display screen; infrared light spots formed by infrared light on a display screen are displayed in the infrared light image; based on the calibration parameters, performing image calibration on the infrared imaging to obtain a target position of an infrared spot on a display screen; the calibration parameters are used for imaging and mapping infrared light to a display area of the display screen; and positioning a cursor on the display screen to a target position of the infrared light spot on the display screen, and inputting information. In this application, through carrying out image calibration processing to infrared light formation of image for when infrared laser's removal, infrared light spot under the circumstances of quick movement on the display screen, can be with the cursor quick positioning to the target position of infrared light spot on the display screen, and then effectively improve the moving speed of cursor on the display screen.

In some embodiments, before the acquiring the infrared light image transmitted by the camera, the image calibration module is configured to

the image calibration module is used for

In the present exemplary embodiment, the infrared light image acquisition module is configured to

the information input module is used for

In the present exemplary embodiment, the image calibration module is configured to

rt=zo/dz; rt is the mapping proportion;

Xn＝(X–Xo)*rt+Xo；

In this exemplary embodiment, when determining the projection mapping parameter, the projection mapping parameter may be obtained by mapping the size of the square image to the size of the display area of the display screen. For example, the size of the square image is 2×2, and the size of the display area of the display screen is 4*8, and the projection mapping parameter is 2×4; i.e. the coordinates of the infrared spot on the square image are (Xn, yn), the coordinates of the infrared spot on the display area of the display screen are mapped to (2 x Xn,4 x Yn).

The present disclosure provides a computer-readable storage medium having stored thereon an information input program which, when executed by a processor, implements the information input method described in the above embodiments.

The present disclosure provides a terminal device, including a memory, a processor, and an information input program stored in the memory and capable of running on the processor, where the processor implements the information input method described in each of the above embodiments when executing the information input program.

It should be noted that the logic and/or steps represented in the flowcharts or otherwise described herein, for example, may be considered as a ordered listing of executable instructions for implementing logical functions, and may be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium may even be paper or other suitable medium upon which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.

It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.

In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present disclosure. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

In the description of the present disclosure, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings are merely for convenience in describing the present disclosure and simplifying the description, and do not indicate or imply that the device or element being referred to must have a specific orientation, be configured and operated in a specific orientation, and therefore should not be construed as limiting the present disclosure.

Furthermore, the terms "first," "second," and the like, as used in embodiments of the present disclosure, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated in the present embodiment. Thus, a feature of an embodiment of the present disclosure that is defined by terms such as "first," "second," and the like may explicitly or implicitly indicate that at least one such feature is included in the embodiment. In the description of the present disclosure, the word "plurality" means at least two or more, for example, two, three, four, etc., unless explicitly specified otherwise in the examples.

In this disclosure, unless expressly specified or limited otherwise in the examples, the terms "mounted," "connected," and "secured" and the like as used in the examples are intended to be broadly construed, as for example, the connection may be a fixed connection, may be a removable connection, or may be integral, and as may be a mechanical connection, an electrical connection, or the like; of course, it may be directly connected, or indirectly connected through an intermediate medium, or may be in communication with each other, or in interaction with each other. The specific meaning of the terms in this disclosure will be understood by those of ordinary skill in the art depending on the specific implementation.

In this disclosure, unless expressly stated or limited otherwise, a first feature "up" or "down" a second feature may be the first and second features in direct contact, or the first and second features in indirect contact through an intervening medium. Moreover, a first feature being "above," "over" and "on" a second feature may be a first feature being directly above or obliquely above the second feature, or simply indicating that the first feature is level higher than the second feature. The first feature being "under", "below" and "beneath" the second feature may be the first feature being directly under or obliquely below the second feature, or simply indicating that the first feature is less level than the second feature.

Although embodiments of the present disclosure have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the present disclosure, and that variations, modifications, alternatives, and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the present disclosure.

Claims

1. An information input method, characterized by comprising:

transmitting infrared rays to a display screen through an infrared laser;

2. The information input method according to claim 1, wherein before the acquisition of the infrared light image transmitted by the camera, the method comprises:

3. The information input method according to claim 2, wherein the calibration parameters include distortion mapping parameters, projection mapping parameters, and scale mapping parameters;

4. The information input method according to claim 1, wherein the calibration parameters include coordinate mapping parameters;

5. The information input method according to claim 1, wherein the acquiring the infrared light image transmitted by the camera includes:

6. The information input method according to claim 3, wherein the performing distortion mapping on the visible light image to obtain the distortion mapping parameter includes:

rt=zo/dz; rt is the mapping proportion;

Xn＝(X–Xo)*rt+Xo；

7. An information input device, comprising:

8. An electronic device for information input, comprising:

the display screen is used for displaying display information to be input;

the infrared laser is used for emitting infrared rays to the display screen;

9. A computer-readable storage medium, on which an information input program is stored, which, when executed by a processor, implements the information input method of any one of claims 1-6.

10. A terminal device comprising a memory, a processor and an information input program stored on the memory and executable on the processor, the processor implementing the information input method of any one of claims 1-6 when executing the information input program.