CN109871155A - It is embedded into the radium-shine projection input scheme of mobile terminal device - Google Patents

It is embedded into the radium-shine projection input scheme of mobile terminal device Download PDF

Info

Publication number
CN109871155A
CN109871155A CN201910087255.9A CN201910087255A CN109871155A CN 109871155 A CN109871155 A CN 109871155A CN 201910087255 A CN201910087255 A CN 201910087255A CN 109871155 A CN109871155 A CN 109871155A
Authority
CN
China
Prior art keywords
mobile terminal
terminal device
laser
infrared
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910087255.9A
Other languages
Chinese (zh)
Inventor
蒋亿
钟日丽
闫伟
葛翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHENZHEN HIPAD COMMUNICATION TECHNOLOGY Co Ltd
Original Assignee
SHENZHEN HIPAD COMMUNICATION TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHENZHEN HIPAD COMMUNICATION TECHNOLOGY Co Ltd filed Critical SHENZHEN HIPAD COMMUNICATION TECHNOLOGY Co Ltd
Priority to CN201910087255.9A priority Critical patent/CN109871155A/en
Publication of CN109871155A publication Critical patent/CN109871155A/en
Pending legal-status Critical Current

Links

Landscapes

  • Input From Keyboards Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a kind of radium-shine projection input scheme for being embedded into mobile terminal device, mobile terminal device is provided with laser emitter and infrared laser, laser emitter projection virtual keyboard to desktop;The infrared-ray of infrared laser transmitting detection laser, infrared laser receive the intercepted signal of infrared-ray, can trigger the interrupt routine in infrared laser;Starting camera is captured;The image that camera is captured is handled;Finger is obtained on flat image and is parked in the key position of dummy keyboard, then obtains deviation post, and the coordinate value of finger corresponding x and y on the table is calculated according to triangle telemetry;The corresponding key position of dummy keyboard is found, and is wrapped into the general incoming event data packet of system, is sent to application layer for its use, terminate identification, by reequiping projected keyboard, and it is directly embedded into mobile terminal device, adapts to the portability demand of mobile terminal device.

Description

It is embedded into the radium-shine projection input scheme of mobile terminal device
[technical field]
The present invention relates to a kind of radium-shine projection input scheme for being embedded into mobile terminal device, espespecially a kind of text input sides The radium-shine projection input scheme for being embedded into mobile terminal device of formula.
[background technique]
As mobile terminal technology is more and more mature, the equipment of mobile terminal includes but is not limited to mobile phone, pad etc., other The mobile device of incorporeity keyboard, kind is although more and more, but the situation of homogeneity is also increasingly severe, and terminal itself Some design problems still remain.
The screen of mobile device all designs smaller in order to portable, but on the interface of screen, light is that dummy keyboard will Occupy the size more than one third or even half, and because the problem of screen size, the spacing and key of key Size all limit very much our input feel, existing projected keyboard is existing on condition that needing independent hardware on the market External equipment, but there is following disadvantage:
First, traditional projected keyboard needs to carry additional equipment and volume is big, it has not been convenient to outgoing to carry.
Second, for cost consideration, what is used inside traditional projected keyboard is all the microprocessor of low performance, when use It is easy to appear failures.
Third, although being inputted using projected keyboard, the dummy keyboard on screen still occupies that screen is most can Apparent area limits remaining function.
Therefore, it is necessary to a kind of good radium-shine projection input scheme for being embedded into mobile terminal device be designed, on overcoming State problem.
[summary of the invention]
For background technique problem encountered, the purpose of the present invention is to provide one kind by changing projected keyboard Dress, and be directly embedded into mobile terminal device, it is inputted to adapt to the radium-shine projection of portability demand of mobile terminal device Scheme.
To achieve the above object, the present invention uses following technological means:
A kind of radium-shine projection input scheme being embedded into mobile terminal device comprising following steps: step 1: one is provided Mobile terminal device, mobile terminal device are provided with a laser emitter and an infrared laser, and laser emitter is relatively infrared Laser is located above, and mobile terminal device is provided with a camera, starts laser emitter, so that laser emitter projects One dummy keyboard a to desktop;Step 2: starting infrared laser, so that infrared laser transmitting detection the infrared of laser is penetrated The infrared-ray of line, the detection laser is parallel with desktop;Step 3: user by the finger of waiting be parked in the one of dummy keyboard by When key position, infrared laser receives the intercepted signal of infrared-ray, can trigger the interrupt routine in infrared laser;Step Rapid four: starting camera is captured;Step 5: handling the image that camera is captured, and forms flat image;Step Six: obtaining finger on flat image and be parked in the key position of dummy keyboard, then obtain deviation post, and according to range of triangle Method calculates the coordinate value of finger corresponding x and y on the table;Step 7: according to the coordinate value of x and y, dummy keyboard is found Corresponding key position, and it is wrapped into the general incoming event data packet of system, application layer is sent to for its use, is corresponded to Key position be shown in equipment interface;Step 8: primary input is completed, identification is terminated.
Further, in step 2, the infrared-ray of the detection laser of infrared laser transmitting is sector.
Further, in step 1, camera is 120 degree or more of wide-angle camera, is equipped in the camera infrared Filter plate.
Further, in step 1, the position of camera and the position of laser emitter are in sustained height.
It is further that it is normal by distortion or nonplanar image flame detection that the mode that image is handled, which is, in step 5 Flat image, the gray processing for then carrying out color to normal flat image handles, and reinforces in normal plane image Spot center effect weakens the periphery brightness of hot spot.
It is further that the hot spot position that finger is parked and pressing keys are formed is found on normal flat image in step 6 It sets, then calculates camera optical center axis with facula position angle degree and offset distance, to obtain deviation post, lead to The distance for the infrared-ray that camera emits with infrared laser is crossed it is known that calculating light by the arm of angle angle formula of trigonometric function again The coordinate value of corresponding x and y on desktop locating for spot.
Further, in step 2, the infrared-ray for detecting laser uses the wavelength of 808nm-810nm.
Further, laser emitter and camera are respectively positioned on the top of mobile terminal device, and infrared laser, which is located at, to be moved The bottom of dynamic terminal device.
Further, the desktop in step 1 is smooth and smooth.
Compared with prior art, the invention has the following advantages:
The above-mentioned radium-shine projection input scheme for being embedded into mobile terminal device, mobile terminal device are provided with laser emitter And infrared laser, laser emitter are located above with respect to infrared laser, and mobile terminal device is provided with camera, starting Laser emitter, so that laser emitter projection virtual keyboard is to desktop;Start infrared laser, so that infrared laser emits The infrared-ray of laser is detected, the infrared-ray of the detection laser is parallel with desktop;The finger of waiting is parked in virtually by user When the key position of keyboard, infrared laser receives the intercepted signal of infrared-ray, can trigger in infrared laser Disconnected program;Starting camera is captured;The image that camera is captured is handled, flat image is formed;In plan view It as upper acquisition finger is parked in the key position of dummy keyboard, then obtains deviation post, and is sold according to triangle telemetry calculating Refer to the coordinate value of corresponding x and y on the table;According to the coordinate value of x and y, the corresponding key position of dummy keyboard is found, and It is wrapped into the general incoming event data packet of system, is sent to application layer for its use, corresponding key position is shown In equipment interface;Once input is completed, identification is terminated, by reequiping projected keyboard, and is directly embedded into mobile whole In end equipment, the portability demand of mobile terminal device is adapted to.
[Detailed description of the invention]
Fig. 1 is the schematic diagram for the radium-shine projection input scheme that the present invention is embedded into mobile terminal device;
Fig. 2 is the frame block diagram for the radium-shine projection input scheme that the present invention is embedded into mobile terminal device.
The drawing reference numeral of specific embodiment illustrates:
1 infrared laser of laser emitter, 2 camera 3
[specific embodiment]
Purpose, structure, feature and effect to facilitate the understanding of the present invention etc., now in conjunction with attached drawing and specific implementation The invention will be further described for mode.
Referring to Figure 1 to Fig. 2, a kind of radium-shine projection input scheme being embedded into mobile terminal device, user can be simple It is convenient to use, radium-shine projection input scheme is integrated with mobile terminal device (not shown, similarly hereinafter), user can be direct The hardware carried using mobile terminal device, had both been saved cost and has also improved performance.
Referring to Figure 1 to Fig. 2, a kind of radium-shine projection input scheme being embedded into mobile terminal device comprising following step It is rapid:
Step 1: providing a mobile terminal device, and mobile terminal device is provided with a laser emitter 1 and an infrared laser Device 2, laser emitter 1 are located above with respect to infrared laser 2, and laser emitter 1 and camera 3 are respectively positioned on mobile terminal device Top, infrared laser 2 is located at the bottom of mobile terminal device.Mobile terminal device is provided with a camera 3, camera 3 For 120 degree or more of wide-angle camera 3, infrared filter (not shown, similarly hereinafter), the position of camera 3 are installed in the camera 3 It sets and is in sustained height with the position of laser emitter 1.Start laser emitter 1, so that laser emitter 1 projects a virtual key For disk (not shown, similarly hereinafter) to a desktop (not shown, similarly hereinafter), desktop is smooth and smooth.
Step 2: starting infrared laser 2, so that the infrared-ray of the transmitting detection laser of infrared laser 2, the detection swash The infrared-ray of light is parallel with desktop, and the infrared-ray for detecting laser that infrared laser 2 emits is sector, detects laser Infrared-ray uses the wavelength of 808nm-810nm, and since the human eye of user is to the infrared-ray of laser reactions vary sample, wavelength is A faint feux rouges can be seen in the laser infrared ray of 780nm-808nm, human eye, and wavelength is the laser of 850nm to 1064nm Infrared-ray human eye is invisible, and the laser infrared ray that wavelength is 808-850nm can see by camera 3.
Step 3: when the finger of waiting is parked in a key position of dummy keyboard by user, infrared laser 2 is received The intercepted signal of infrared-ray, can trigger the interrupt routine in infrared laser 2.
Step 4: starting camera 3 is captured.
Step 5: the image captured to camera 3 is handled, and forms flat image, the mode that image is handled To be normal flat image by distortion or nonplanar image flame detection, then carrying out color to normal flat image Gray processing processing, and reinforce the spot center effect in normal plane image, weaken the periphery brightness of hot spot.
Step 6: obtaining finger on flat image and be parked in the key position of dummy keyboard, then obtain deviation post, and The coordinate value that finger corresponding x and y on the table is calculated according to triangle telemetry, finds finger on normal flat image Park and facula position that pressing keys are formed, then calculate 3 optical center axis of camera with facula position angle degree and Offset distance, to obtain deviation post, the distance of the infrared-ray emitted by camera 3 with infrared laser 2 is it is known that again The coordinate value of corresponding x and y on desktop locating for glossing up is calculated as the arm of angle angle formula of trigonometric function.
Step 7: according to the coordinate value of x and y, the corresponding key position of dummy keyboard is found, and is wrapped into system General incoming event data packet is sent to application layer for its use, and corresponding key position is shown in equipment interface;
Step 8: primary input is completed, identification is terminated.
Referring to Figure 1 to Fig. 2, camera 3 is 120 degree or more of wide-angle camera 3, and is equipped in the camera 3 red Outer filter plate needs disposably to shoot entire projection virtual keyboard because dummy keyboard is wider, and infrared filter can filter off The veiling glare of other most wavelength, only the hot spot of remaining infrared-ray, can accelerate the process of image procossing and promote image The accuracy rate of processing.
Referring to Figure 1 to Fig. 2, the above-mentioned radium-shine projection input scheme for being embedded into mobile terminal device, mobile terminal device It is provided with laser emitter 1 and infrared laser 2, laser emitter 1 is located above with respect to infrared laser 2, and mobile terminal Equipment is provided with camera 3, starts laser emitter 1, so that 1 projection virtual keyboard of laser emitter is to desktop;Start infrared Laser 2, so that the infrared-ray of the transmitting detection laser of infrared laser 2, the infrared-ray of the detection laser are parallel with desktop; When the finger of waiting is parked in the key position of dummy keyboard by user, infrared laser 2 receives what infrared-ray was intercepted Signal can trigger the interrupt routine in infrared laser 2;Starting camera 3 is captured;The image that camera 3 is captured It is handled, forms flat image;Finger is obtained on flat image and is parked in the key position of dummy keyboard, then obtains offset Position, and calculate according to triangle telemetry the coordinate value of finger corresponding x and y on the table;According to the coordinate value of x and y, look into The corresponding key position of dummy keyboard is found, and is wrapped into the general incoming event data packet of system, is sent to application layer For its use, corresponding key position is shown in equipment interface;Primary input is completed, terminates identification, by the way that key will be projected Disk is reequiped, and is directly embedded into mobile terminal device, and the portability demand of mobile terminal device is adapted to.
It is all to carry out electric connection use with mobile terminal device using additional hardware in traditional projection scheme, Because working independently, projects in hardware and need to be additionally present of the devices such as processor, camera 3, but these devices are in fact Natively have in mobile terminal device, be equivalent to device repetition, and for cost consideration, is all to use in additional hardware Low performance hardware is also easy for breaking down in this way, and service life is also short, and the present invention by radium-shine projection input scheme with movement Terminal device integrates, and the included hardware of mobile terminal device can be used directly in user, had both saved cost and has also improved Performance.
Be described in detail above be only the preferred embodiments of the invention explanation, non-therefore limitation the scope of the patents of the invention, So all equivalence techniques with carried out by this creation specification and diagramatic content change, it is both contained in the scope of the patents of the invention It is interior.

Claims (9)

1. a kind of radium-shine projection input scheme for being embedded into mobile terminal device, which comprises the following steps:
Step 1: providing a mobile terminal device, and mobile terminal device is provided with a laser emitter and an infrared laser, swashs Optical transmitting set is located above with respect to infrared laser, and mobile terminal device is provided with a camera, is started laser emitter, is made It obtains laser emitter and projects a dummy keyboard a to desktop;
Step 2: starting infrared laser so that infrared laser transmitting detection laser infrared-ray, the detection laser it is red Outer ray is parallel with desktop;
Step 3: when the finger of waiting is parked in a key position of dummy keyboard by user, infrared laser receives infrared The intercepted signal of ray, can trigger the interrupt routine in infrared laser;
Step 4: starting camera is captured;
Step 5: handling the image that camera is captured, and forms flat image;
Step 6: obtaining finger on flat image and be parked in the key position of dummy keyboard, then obtain deviation post, and according to Triangle telemetry calculates the coordinate value of finger corresponding x and y on the table;
Step 7: according to the coordinate value of x and y, the corresponding key position of dummy keyboard is found, and it is general to be wrapped into system Incoming event data packet, be sent to application layer for its use, corresponding key position is shown in equipment interface;
Step 8: primary input is completed, identification is terminated.
2. being embedded into the radium-shine projection input scheme of mobile terminal device as described in claim 1, it is characterised in that: step 2 In, the infrared-ray of the detection laser of infrared laser transmitting is sector.
3. being embedded into the radium-shine projection input scheme of mobile terminal device as described in claim 1, it is characterised in that: step 1 In, camera is 120 degree or more of wide-angle camera, is equipped with infrared filter in the camera.
4. being embedded into the radium-shine projection input scheme of mobile terminal device as described in claim 1, it is characterised in that: step 1 In, the position of camera and the position of laser emitter are in sustained height.
5. being embedded into the radium-shine projection input scheme of mobile terminal device as described in claim 1, it is characterised in that: step 5 In be further that the mode that image is handled is, be normal flat image by distortion or nonplanar image flame detection, then The gray processing processing of color is carried out to normal flat image, and reinforces the spot center effect in normal plane image, is subtracted The periphery brightness of dim light spot.
6. being embedded into the radium-shine projection input scheme of mobile terminal device as described in claim 1, it is characterised in that: step 6 In be further that the facula position that finger is parked and pressing keys are formed is found on normal flat image, then calculate and take the photograph Picture head optical center axis is with facula position angle degree and offset distance, so that deviation post is obtained, by camera with red The distance of the infrared-ray of outer laser transmitting as the arm of angle angle formula of trigonometric function it is known that calculated on desktop locating for glossing up again The coordinate value of corresponding x and y.
7. being embedded into the radium-shine projection input scheme of mobile terminal device as described in claim 1, it is characterised in that: step 2 In, the infrared-ray for detecting laser uses the wavelength of 808nm-810nm.
8. being embedded into the radium-shine projection input scheme of mobile terminal device as described in claim 1, it is characterised in that: laser hair Emitter and camera are respectively positioned on the top of mobile terminal device, and infrared laser is located at the bottom of mobile terminal device.
9. being embedded into the radium-shine projection input scheme of mobile terminal device as described in claim 1, it is characterised in that: step 1 In desktop it is smooth and smooth.
CN201910087255.9A 2019-01-29 2019-01-29 It is embedded into the radium-shine projection input scheme of mobile terminal device Pending CN109871155A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910087255.9A CN109871155A (en) 2019-01-29 2019-01-29 It is embedded into the radium-shine projection input scheme of mobile terminal device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910087255.9A CN109871155A (en) 2019-01-29 2019-01-29 It is embedded into the radium-shine projection input scheme of mobile terminal device

Publications (1)

Publication Number Publication Date
CN109871155A true CN109871155A (en) 2019-06-11

Family

ID=66918341

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910087255.9A Pending CN109871155A (en) 2019-01-29 2019-01-29 It is embedded into the radium-shine projection input scheme of mobile terminal device

Country Status (1)

Country Link
CN (1) CN109871155A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110450167A (en) * 2019-08-27 2019-11-15 南京涵曦月自动化科技有限公司 A kind of robot infrared laser positioning motion trail planning method
CN110913255A (en) * 2019-10-31 2020-03-24 广东长虹电子有限公司 Remote controller capable of laser outputting virtual keyboard and control method thereof
CN111860239A (en) * 2020-07-07 2020-10-30 佛山长光智能制造研究院有限公司 Key identification method and device, terminal equipment and computer readable storage medium
WO2023045696A1 (en) * 2021-09-22 2023-03-30 极氪汽车(宁波杭州湾新区)有限公司 Vehicle-mounted projection input system and vehicle

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140375539A1 (en) * 2013-06-19 2014-12-25 Thaddeus Gabara Method and Apparatus for a Virtual Keyboard Plane
CN105549795A (en) * 2015-12-11 2016-05-04 杭州东尚光电科技有限公司 Laser projection virtual keyboard system achieved by diffractive optical elements and operation method
CN106205576A (en) * 2016-08-31 2016-12-07 哈尔滨固泰电子有限责任公司 Electronic musical instrument
CN107562288A (en) * 2017-08-31 2018-01-09 广东美的制冷设备有限公司 Response method based on infrared contactor control device, infrared contactor control device and medium
CN109062419A (en) * 2018-08-09 2018-12-21 郑州大学 A kind of laser projection virtual keyboard of optimization

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140375539A1 (en) * 2013-06-19 2014-12-25 Thaddeus Gabara Method and Apparatus for a Virtual Keyboard Plane
CN105549795A (en) * 2015-12-11 2016-05-04 杭州东尚光电科技有限公司 Laser projection virtual keyboard system achieved by diffractive optical elements and operation method
CN106205576A (en) * 2016-08-31 2016-12-07 哈尔滨固泰电子有限责任公司 Electronic musical instrument
CN107562288A (en) * 2017-08-31 2018-01-09 广东美的制冷设备有限公司 Response method based on infrared contactor control device, infrared contactor control device and medium
CN109062419A (en) * 2018-08-09 2018-12-21 郑州大学 A kind of laser projection virtual keyboard of optimization

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110450167A (en) * 2019-08-27 2019-11-15 南京涵曦月自动化科技有限公司 A kind of robot infrared laser positioning motion trail planning method
CN110913255A (en) * 2019-10-31 2020-03-24 广东长虹电子有限公司 Remote controller capable of laser outputting virtual keyboard and control method thereof
CN111860239A (en) * 2020-07-07 2020-10-30 佛山长光智能制造研究院有限公司 Key identification method and device, terminal equipment and computer readable storage medium
WO2023045696A1 (en) * 2021-09-22 2023-03-30 极氪汽车(宁波杭州湾新区)有限公司 Vehicle-mounted projection input system and vehicle

Similar Documents

Publication Publication Date Title
CN109871155A (en) It is embedded into the radium-shine projection input scheme of mobile terminal device
CN107566721B (en) Information display method, terminal and computer readable storage medium
JP5567206B2 (en) Computing device interface
WO2015003522A1 (en) Face recognition method, apparatus, and mobile terminal
RU2455676C2 (en) Method of controlling device using gestures and 3d sensor for realising said method
WO2016029853A1 (en) Identity authentication method, terminal device and system
EP3923239B1 (en) Distance measurement method and electronic device
US9658702B2 (en) System and method of object recognition for an interactive input system
CN108319338B (en) Display screen determining method, mobile terminal and computer readable storage medium
CN109214225A (en) A kind of scan method, device, mobile terminal and the storage medium of figure bar code
CN107407959B (en) Manipulation of three-dimensional images based on gestures
CN109033911A (en) A kind of scan method, device, mobile terminal and the storage medium of figure bar code
CN109788174B (en) Light supplementing method and terminal
CN108628515B (en) Multimedia content operation method and mobile terminal
US12027138B2 (en) Screen illuminance control method for photo shooting and electronic device
US11928291B2 (en) Image projection device
CN107743156B (en) Mobile terminal, control method of mobile terminal, and computer-readable storage medium
CN110825223A (en) Control method and intelligent glasses
WO2022247762A1 (en) Electronic device, and fingerprint unlocking method and fingerprint unlocking apparatus therefor
CN109857321A (en) Operating method, mobile terminal based on screen prjection, readable storage medium storing program for executing
KR20210013127A (en) Target recognition method and mobile terminal
CN108024013B (en) Screen control method, terminal and computer readable storage medium
CN108984075B (en) Display mode switching method and device and terminal
CN109426355B (en) Input method and input device of electronic equipment and electronic equipment
CN108628487A (en) A kind of method of determining position information, projection device and computer storage media

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190611

WD01 Invention patent application deemed withdrawn after publication