CN111279305A - Method and system for realizing virtual keyboard - Google Patents
Method and system for realizing virtual keyboard Download PDFInfo
- Publication number
- CN111279305A CN111279305A CN201780095214.3A CN201780095214A CN111279305A CN 111279305 A CN111279305 A CN 111279305A CN 201780095214 A CN201780095214 A CN 201780095214A CN 111279305 A CN111279305 A CN 111279305A
- Authority
- CN
- China
- Prior art keywords
- keyboard
- input interface
- virtual keyboard
- display screen
- keyboard input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000002452 interceptive effect Effects 0.000 claims abstract description 36
- 239000013307 optical fiber Substances 0.000 claims description 29
- 230000003287 optical effect Effects 0.000 claims description 23
- 238000012545 processing Methods 0.000 claims description 7
- 230000008878 coupling Effects 0.000 claims description 6
- 238000010168 coupling process Methods 0.000 claims description 6
- 238000005859 coupling reaction Methods 0.000 claims description 6
- 239000000835 fiber Substances 0.000 claims description 6
- 230000003044 adaptive effect Effects 0.000 claims description 3
- 230000035807 sensation Effects 0.000 claims description 2
- 230000001360 synchronised effect Effects 0.000 claims description 2
- 230000008901 benefit Effects 0.000 abstract description 4
- 238000005516 engineering process Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 230000002457 bidirectional effect Effects 0.000 description 2
- 230000005057 finger movement Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Abstract
A method for implementing a virtual keyboard, comprising: s1, a keyboard input interface which is partially displayed and an interactive interface which corresponds to the current keyboard input interface are arranged on a display screen of the terminal equipment; s2, when the user starts the virtual keyboard, adjusting the keyboard input interface displayed locally on the display screen to be suitable for the keyboard input interface displayed in full screen, and simultaneously displaying the interactive interface corresponding to the keyboard input interface in a projection mode; and S3, when the virtual keyboard is closed by the user, adjusting the keyboard input interface displayed on the full screen of the display screen to the keyboard input interface state displayed locally, stopping projection, and adjusting the interactive interface corresponding to the current keyboard input interface to the display state of the display screen. The advantages are that: the screen of the terminal equipment is used as a keyboard, and meanwhile, the screen is matched with a micro projector or electronic equipment with a projection function, so that an interactive interface to be displayed by the terminal equipment is projected, and the user habit is better met.
Description
The invention relates to the technical field of input devices, in particular to a method and a system for realizing a virtual keyboard.
With the development and popularization of computer technology, keyboards have been playing irreplaceable roles as important input devices of computers. The keyboard is not separated from the keyboard whether the input of data or the transmission of control signals. Also, the role of the keyboard is indispensable for a considerable period of time that can be expected. However, the conventional keyboard is bulky and inconvenient to carry, and cannot meet the requirement of the mobile terminal on the input device. For example, when people go out to work, more people carry the tablet personal computer, and at this time, the people are troubled by not having a proper keyboard, do not work conveniently without the keyboard, and carry the keyboard specially is cumbersome.
Conventionally, a keyboard projection technology is developed, as shown in fig. 1, which includes a terminal device such as a mobile phone 1 ', a projection device 2' communicatively connected to the mobile phone 1 ', the projection device 2' can project a keyboard 3 ', the keyboard 3' can be projected on any object surface, a user directly "touches" the projected keyboard image on the projected surface to input data, and then, the user tracks the finger movement through infrared rays or other technologies to complete the acquisition of input information, for example:
VLK is known as Virtual Laser Keyboard, a Virtual Laser Keyboard, manufactured by Hutchison Harbour Ring Limited-HRR. It is a virtual keyboard similar in size to a small mobile phone (90x34x24mm) that allows a user to type articles or e-mail as easily as operating a conventional keyboard. The I-Tech virtual keyboard adopts the light projection technology, and can project a full-size computer keyboard on an almost arbitrary plane. When the virtual keyboard is used on a PDA and a smart phone, e-mail receiving and sending, word processing and electronic form making can be conveniently carried out, and a user can leave a notebook computer and a desktop computer at home. The applicability technology of the virtual keyboard researches the finger movement of a user, and decodes and records the keyboard hitting action. Since the virtual keyboard is an image formed by light projection, the virtual keyboard completely disappears when not in use.
Google filed a patent application to the united states patent and trademark office directed to a laser projection keyboard that can turn the user's body into a touch screen.
The apple also patented a virtual keyboard, describing four ways of making the virtual keyboard more sensible to the knock, including adding a layer of elements that raise the feel of the keyboard as it appears on the screen, such as under the touch panel. Meanwhile, after a user presses the keyboard, the user can feel resilience of different degrees, and the hand feeling is closer to that of a physical keyboard.
Microsoft proposed the virtual keyboard patent that it would sense the position of your palm and fingers and then align the virtual keyboard with your hand using multi-touch technology so you would not worry about pressing the wrong key because the key is fixed under your fingers.
The virtual keyboard equipment has the advantages that 1, the virtual keyboard equipment has high brightness, and can display clear keyboard images under normal indoor lighting environment; 2. the stability and the safety are high, the operation can be stably carried out for a long time, and the human body cannot be injured; 3. low cost and convenient popularization; 4. small volume, convenient carrying and operation. The four aspects have the advantage of replacing the traditional mechanical keyboard. However, the virtual keyboard has the disadvantages that the keyboard layout is compact due to the limit value of the projection technology, the virtual keyboard is inconvenient to use, the virtual keyboard can only input english due to the hardware limitation, the virtual keyboard is not disappointed to users who input chinese, although the virtual keyboard can be installed with a driver on a chinese mobile system (such as microsoft windows mobile2003second edition for pocketpcphone simplified chinese version, etc.), only english characters can be input, the virtual keyboard has defects in function, and a photographic device with high imaging quality is required for realizing the function, the cost is high, and the complex operation means that stronger CPU support is required, so the cost is also high. At present, many display device manufacturers, such as mobile terminal manufacturers, have to integrate multiple functions, such as a virtual keyboard, a touch screen, etc., into a mobile terminal to bring convenience to users. The user can input characters through a virtual keyboard displayed on a screen, and in most cases, the virtual keyboard is used on a touch screen to achieve the purpose of quick input. However, the virtual keyboard needs to occupy a larger display space, and when the virtual keyboard is displayed on a screen in the prior art, the size of the virtual keyboard is fixed, the display position is fixed, and the keys of the virtual keyboard are fixed, so that great inconvenience is brought to a user when the user operates the mobile terminal; in addition, the touch screen is expensive, which brings a certain cost to manufacturers.
In summary, the existing projection keyboard is not provided with a keyboard, which is a big trouble for business people to go on business, the keyboard is provided with a burden and is inconvenient to carry, if the existing projection keyboard is used, the layout and arrangement are compact due to the limit value of the projection technology, and the infrared ray cannot be thoroughly close to the keyboard, so that fingers must be suspended during typing, the problems of no feedback and difficult positioning exist, and the identification speed and accuracy of the equipment are not high.
Disclosure of the invention
The invention aims to provide a method and a system for realizing a virtual keyboard, wherein a screen of a terminal device is used as a keyboard to provide instant feedback for a user, real touch feeling can be simulated through vibration, and an interactive interface to be displayed by the terminal device is projected by matching with a micro projector or an electronic device with a projection function, so that the habit of the user is better met.
In order to achieve the purpose, the invention is realized by the following technical scheme:
a method for realizing a virtual keyboard is characterized in that:
s1, a keyboard input interface which is partially displayed and an interactive interface which corresponds to the current keyboard input interface are arranged on a display screen of the terminal equipment;
s2, when the user starts the virtual keyboard, adjusting the keyboard input interface displayed locally on the display screen to be suitable for the keyboard input interface displayed in full screen, and simultaneously displaying the interactive interface corresponding to the keyboard input interface in a projection mode;
and S3, when the virtual keyboard is closed by the user, adjusting the keyboard input interface displayed on the full screen of the display screen to the keyboard input interface state displayed locally, stopping projection, and adjusting the interactive interface corresponding to the current keyboard input interface to the display state of the display screen.
The implementation method of the virtual keyboard comprises the following steps:
when a keyboard input interface which is partially displayed and an interactive interface which corresponds to the current keyboard input interface are arranged on a display screen of the terminal equipment, a virtual keyboard starting or closing button is further displayed at the adaptive position on the display screen.
The implementation method of the virtual keyboard comprises the following steps:
the interactive interface corresponding to the keyboard input interface is projected on the surface of any object;
when the user clicks the keyboard input interface displayed in a full screen mode, the projected interactive interface updates the picture content in real time according to the user input information.
The implementation method of the virtual keyboard comprises the following steps:
when the user taps the keyboard input interface displayed full screen, the display screen simulates real tactile sensations by shaking to provide the user immediate feedback.
The implementation method of the virtual keyboard comprises the following steps:
the terminal equipment is a tablet personal computer.
The implementation method of the virtual keyboard comprises the following steps:
the interactive interface corresponding to the keyboard input interface is projected through an external micro projector connected with the terminal equipment, or,
and projecting the interactive interface corresponding to the keyboard input interface through a projection device of the terminal equipment.
A virtual keyboard implementation system is characterized by comprising:
a display screen;
the virtual keyboard setting module is connected with the display screen and used for receiving a virtual keyboard starting instruction and a virtual keyboard closing instruction from a user through the display screen;
the keyboard adjusting module is connected with the virtual keyboard setting module and is used for adjusting the keyboard input interface displayed on the partial display screen into a keyboard input interface suitable for full screen display or adjusting the keyboard input interface displayed on the full screen display screen back to the keyboard input interface state displayed on the partial display screen;
and the projection module is connected with the virtual keyboard setting module and used for displaying or stopping projection of the interactive interface corresponding to the keyboard input interface on the display screen in a projection mode and returning the interactive interface corresponding to the current keyboard input interface to the display state of the display screen.
The system for implementing a virtual keyboard described above, wherein:
the display screen, the virtual keyboard setting module and the keyboard adjusting module are all arranged in the terminal equipment;
the projection module is an independent device connected with the terminal equipment;
wherein, the projection module comprises:
a laser light source unit;
a control circuit;
a micro scanning device;
optical fibers and associated optics;
wherein:
the input end of the control circuit is connected with the output end of the terminal equipment and receives a video signal provided by the terminal equipment;
the input end of the laser light source unit is connected with one output end of the control circuit and receives a high-speed modulation signal sent by the control circuit;
the output end of the laser light source unit is connected with the input ends of the optical fiber and the auxiliary optical system and is used for coupling red, green and blue laser which is generated by the laser light source unit, modulated at high speed and subjected to collimation/beam combination into the optical fiber and the auxiliary optical system;
the output ends of the optical fiber and the auxiliary optical system are connected with the micro scanning device, and red, green and blue lasers which are transmitted and collimated by the optical fiber and the auxiliary optical system are projected on a reflector of the micro scanning device for high-speed scanning so as to be projected out;
the other output end of the control circuit is connected with the input end of the micro scanning device, and the electronic control signal generated by the control circuit controls the micro scanning device to complete high-speed scanning.
The system for implementing a virtual keyboard described above, wherein:
the control circuit can receive the video signal of the terminal equipment and convert the video signal into an RGB digital signal and a line/field synchronous signal so as to modulate the laser light source unit at a high speed and control an external micro scanning device to carry out high-speed two-dimensional scanning;
the control circuit comprises an analog front-end chip, a digital video processing circuit and a microcontroller;
the analog front-end chip adopts the existing commercial chip;
the digital video processing circuit is realized by adopting an FPGA;
the microcontroller is realized by adopting an independent commercial chip or an IP software core integrated in the FPGA.
The system for implementing a virtual keyboard described above, wherein:
the optical fiber and the auxiliary optical system are used for transmitting collimated/combined red, green and blue laser generated by the built-in laser light source unit to the external micro scanning device;
the optical fiber is single-mode visible light optical fiber;
the auxiliary optical system includes:
the first lens/lens group is used for coupling the collimated/combined red, green and blue laser into the visible light optical fiber;
and a second lens/lens group for collimating the red, green and blue laser beams emitted from the visible light fiber.
Compared with the prior art, the invention has the following advantages:
1. the screen of the terminal equipment is used as a keyboard, so that instant feedback can be provided, and real touch can be simulated through vibration, so that the typing process conforms to the use habit of a user;
2. the portable projector is convenient to carry, and can be realized only by one terminal device and one miniature projector or self-contained projection function device;
typing speed and accuracy are higher than those of projection keyboards.
Brief description of the drawings
FIG. 1 is a schematic diagram of a prior art virtual keyboard implementation method;
FIG. 2 is a flow chart of a method of the present invention;
FIG. 3 is a schematic diagram of an implementation of the present invention;
FIG. 4 is a block diagram of the system of the present invention;
FIG. 5 is a block diagram of a projection module in the system of the present invention;
FIG. 6 is a schematic diagram of the laser source unit and collimating/beam combining optics in the system of the present invention;
FIG. 7 is a schematic diagram of the structure of the optical fiber and the associated optical system and micro-scanning device in the system of the present invention;
fig. 8 is a schematic structural diagram of a laser light source unit in the system of the present invention.
Best mode for carrying out the invention
The present invention will now be further described by way of the following detailed description of a preferred embodiment thereof, taken in conjunction with the accompanying drawings.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
As shown in fig. 1 to 3, the present invention provides a method for implementing a virtual keyboard, which includes:
s1, a keyboard input interface which is partially displayed and an interactive interface which corresponds to the current keyboard input interface are arranged on a display screen of the terminal device 1;
s2, when the user starts the virtual keyboard, adjusting the keyboard input interface displayed locally on the display screen to be suitable for the keyboard input interface displayed in full screen, and simultaneously displaying the interactive interface 3 corresponding to the keyboard input interface in a projection mode;
and S3, when the virtual keyboard is closed by the user, adjusting the keyboard input interface displayed on the full screen of the display screen to the keyboard input interface state displayed locally, stopping projection, and adjusting the interactive interface corresponding to the current keyboard input interface to the display state of the display screen.
The method of the invention uses the screen of the terminal device as a keyboard to provide the instant feedback of the user, and simultaneously projects the interactive interface to be displayed by the terminal device through the projector in a matching way, thereby being more in line with the habit of the user.
The implementation method of the virtual keyboard comprises the following steps:
when the display screen of the terminal device 1 has a keyboard input interface which is partially displayed and an interactive interface corresponding to the current keyboard input interface, a virtual keyboard start or close button is also displayed at an adaptive position on the display screen.
Preferably, the interactive interface corresponding to the keyboard input interface is projected on the surface of any object; when the user clicks the keyboard input interface displayed in a full screen mode, the projected interactive interface updates the picture content in real time according to the user input information.
In order to provide the real typing touch feeling of the user, the implementation method of the virtual keyboard comprises the following steps:
when a user clicks a keyboard input interface displayed in a full screen mode, the display screen simulates real touch through vibration to provide instant feedback of the user, the function can be completed through a vibration unit in terminal equipment, and the electronic equipment is basically provided with the function.
The implementation method of the virtual keyboard comprises the following steps:
the terminal equipment is a tablet computer or other arbitrary electronic equipment with a keyboard input function and a display, and the larger the display screen is, the better the implementation effect of the scheme is.
The projection mode can be various, for example:
and projecting the interactive interface corresponding to the keyboard input interface through an external micro projector connected with the terminal equipment, or projecting the interactive interface corresponding to the keyboard input interface through a projection device carried by the terminal equipment.
As shown in fig. 4, the present invention also discloses a system for implementing a virtual keyboard, which comprises:
a display screen 11;
the virtual keyboard setting module 12 is connected with the display screen 11 and is used for receiving a virtual keyboard starting instruction and a virtual keyboard closing instruction from a user through the display screen 11;
the keyboard adjusting module 13 is connected with the virtual keyboard setting module 12, and is configured to adjust a keyboard input interface displayed locally on the display screen 11 to be suitable for a keyboard input interface displayed in a full screen or adjust the keyboard input interface displayed in the full screen on the display screen back to a keyboard input interface state displayed locally;
and the projection module 14 is connected with the virtual keyboard setting module 12, and is used for displaying or stopping projection of the interactive interface corresponding to the keyboard input interface on the display screen 11 in a projection manner and returning the interactive interface corresponding to the current keyboard input interface to the display state of the display screen.
The system for implementing the virtual keyboard comprises:
the display screen 11, the virtual keyboard setting module 12 and the keyboard adjusting module 13 are all arranged in the terminal equipment;
the projection module 14 is an independent device connected to the terminal device, and may also be a projection device carried by the terminal device in some embodiments;
as shown in fig. 5 to 7, in the present embodiment, the projection module 14 is a device independent from the terminal device, and may include: a laser light source unit 141, a control circuit 145, a micro scanning device 144, and an optical fiber and accessory optical system 143.
Wherein: the input end of the control circuit 145 is connected with the output end of the terminal equipment, and receives a video signal provided by the terminal equipment; the input end of the laser light source unit 141 is connected with one output end of the control circuit 145, and receives a high-speed modulation signal sent by the control circuit 145; the output end of the laser light source unit 141 is connected to the input end of the optical fiber and auxiliary optical system 143, and is used for coupling the collimating/beam combining optical system 142 formed by the red, green and blue lasers which are generated by the laser light source unit 141 and are modulated at a high speed and undergo collimating/beam combining into the optical fiber and auxiliary optical system 143; the output end of the optical fiber and auxiliary optical system 143 is connected to the micro scanning device 144, and the red, green and blue lasers transmitted and collimated by the optical fiber and auxiliary optical system 143 are projected onto the reflector of the micro scanning device 144 for high-speed scanning; another output terminal of the control circuit 145 is connected to an input terminal of the micro-scanning device 144, and the electronic control signal generated by the control circuit 145 controls the micro-scanning device 144 to perform high-speed scanning.
The projection device has the characteristics of wide display color gamut, high contrast, high saturation and low power consumption, is small in size and is convenient to carry.
The system for implementing the virtual keyboard comprises:
the control circuit 145 can receive the video signal of the terminal device and convert the video signal into an RGB digital signal and a line/field synchronizing signal to modulate the laser light source unit 141 at a high speed and control the external micro-scanning device 144 to perform high-speed two-dimensional scanning;
the control circuit 145 comprises an analog front-end chip, a digital video processing circuit and a microcontroller;
the analog front-end chip adopts the existing commercial chip;
the digital video processing circuit is realized by adopting an FPGA;
the microcontroller is realized by adopting an independent commercial chip or an IP software core integrated in the FPGA.
The system for implementing the virtual keyboard comprises:
the optical fiber and auxiliary optical system 143 is used for transmitting collimated/combined red, green and blue laser beams generated by the built-in laser light source unit 141 to the external micro scanning device 144;
the optical fiber used is a single-mode visible light optical fiber.
As shown in fig. 8, the laser light source unit 141 includes one each of red/green/blue lasers and a collimating/beam combining optical system that can be modulated at high speed (typically several tens MHz to hundreds MHz). The red laser typically has a wavelength of 635nm to 642nm and may be a red laser diode; the green laser has a wavelength of typically 515nm to 532nm, and may be a green laser or a green laser diode based on Second Harmonic Generation (SHG); the blue laser typically has a wavelength of 515nm to 532nm and may be a blue laser diode.
The optical fiber and the auxiliary optical system 143 are used for transmitting the collimated/combined red, green and blue laser beams generated by the built-in laser light source unit 141 to the external micro scanning device 144. The optical fiber used is a Single Mode visible light fiber, such as a Corning gRGB400 fiber. As shown in fig. 6 and 7, the auxiliary optical system includes: 1. a first lens/lens group 1431 for coupling the collimated/combined red, green, and blue laser into a visible light fiber in the tablet computer; 2. a second lens/lens group 1432 outside the tablet computer for collimating the red, green, and blue laser light emitted from the visible light fiber. The red, green and blue laser collimated by the second lens/lens group 1432 is projected to a reflector on the external micro-scanning device and is projected out.
In this embodiment, the micro scanning device 144 is a MEMS (micro electro mechanical Systems) micro scanning mirror for two-dimensional laser scanning, and includes a movable mirror and an Actuator (Actuator) for rotating the mirror about the X-axis and the Y-axis at high speed. Its structure is generally of two kinds: (1) a single gimbaled (Gimbal) or Gimbal-less biaxial micro-scanning mirror comprising a fast scan axis (X-axis) for line scanning and a slow scan axis (Y-axis) for field scanning, the two axes being orthogonal to each other; (2) two single-axis micro-scanning mirrors, one of which is responsible for line scanning (i.e., X-axis scanning), which is accomplished by a fast driver; another orthogonally positioned single axis micro-scanning mirror performs the slower field scan (Y-axis scan). The scanning mode of the MEMS micro scanning mirror can be bidirectional line-by-line scanning, namely scanning on odd lines from left to right and scanning on even lines from right to left; or bidirectional interlaced scanning, namely scanning from left to right on the first line, scanning from right to left on the third line, scanning from left to right on the fifth line, and so on, when the odd field scanning is finished, scanning from left to right on the second line, scanning from right to left on the fourth line, scanning from left to right on the sixth line, and so on, so as to finish the even field scanning.
While the present invention has been described in detail with reference to the preferred embodiments, it should be understood that the above description should not be taken as limiting the invention. Various modifications and alterations to this invention will become apparent to those skilled in the art upon reading the foregoing description. Accordingly, the scope of the invention should be determined from the following claims.
Claims (10)
- A method for realizing a virtual keyboard is characterized in that:s1, a keyboard input interface which is partially displayed and an interactive interface which corresponds to the current keyboard input interface are arranged on a display screen of the terminal equipment;s2, when the user starts the virtual keyboard, adjusting the keyboard input interface displayed locally on the display screen to be suitable for the keyboard input interface displayed in full screen, and simultaneously displaying the interactive interface corresponding to the keyboard input interface in a projection mode;and S3, when the virtual keyboard is closed by the user, adjusting the keyboard input interface displayed on the full screen of the display screen to the keyboard input interface state displayed locally, stopping projection, and adjusting the interactive interface corresponding to the current keyboard input interface to the display state of the display screen.
- The method for implementing a virtual keyboard according to claim 1, wherein:when a keyboard input interface which is partially displayed and an interactive interface which corresponds to the current keyboard input interface are arranged on a display screen of the terminal equipment, a virtual keyboard starting or closing button is further displayed at the adaptive position on the display screen.
- The method for implementing a virtual keyboard according to claim 1, wherein:the interactive interface corresponding to the keyboard input interface is projected on the surface of any object;when the user clicks the keyboard input interface displayed in a full screen mode, the projected interactive interface updates the picture content in real time according to the user input information.
- The method for implementing a virtual keyboard according to claim 1, wherein:when the user taps the keyboard input interface displayed full screen, the display screen simulates real tactile sensations by shaking to provide the user immediate feedback.
- The method for implementing a virtual keyboard according to claim 1, wherein:the terminal equipment is a tablet personal computer.
- The method for implementing a virtual keyboard according to claim 1, wherein:the interactive interface corresponding to the keyboard input interface is projected through an external micro projector connected with the terminal equipment, or,and projecting the interactive interface corresponding to the keyboard input interface through a projection device of the terminal equipment.
- A system for implementing a virtual keyboard, comprising:a display screen;the virtual keyboard setting module is connected with the display screen and used for receiving a virtual keyboard starting instruction and a virtual keyboard closing instruction from a user through the display screen;the keyboard adjusting module is connected with the virtual keyboard setting module and is used for adjusting the keyboard input interface displayed on the partial display screen into a keyboard input interface suitable for full screen display or adjusting the keyboard input interface displayed on the full screen display screen back to the keyboard input interface state displayed on the partial display screen;and the projection module is connected with the virtual keyboard setting module and used for displaying or stopping projection of the interactive interface corresponding to the keyboard input interface on the display screen in a projection mode and returning the interactive interface corresponding to the current keyboard input interface to the display state of the display screen.
- The system for implementing a virtual keyboard of claim 7, wherein:the display screen, the virtual keyboard setting module and the keyboard adjusting module are all arranged in the terminal equipment;the projection module is an independent device connected with the terminal equipment;wherein, the projection module comprises:a laser light source unit;a control circuit;a micro scanning device;optical fibers and associated optics;wherein:the input end of the control circuit is connected with the output end of the terminal equipment and receives a video signal provided by the terminal equipment;the input end of the laser light source unit is connected with one output end of the control circuit and receives a high-speed modulation signal sent by the control circuit;the output end of the laser light source unit is connected with the input ends of the optical fiber and the auxiliary optical system and is used for coupling red, green and blue laser which is generated by the laser light source unit, modulated at high speed and subjected to collimation/beam combination into the optical fiber and the auxiliary optical system;the output ends of the optical fiber and the auxiliary optical system are connected with the micro scanning device, and red, green and blue lasers which are transmitted and collimated by the optical fiber and the auxiliary optical system are projected on a reflector of the micro scanning device for high-speed scanning so as to be projected out;the other output end of the control circuit is connected with the input end of the micro scanning device, and the electronic control signal generated by the control circuit controls the micro scanning device to complete high-speed scanning.
- The system for implementing a virtual keyboard of claim 8, wherein:the control circuit can receive the video signal of the terminal equipment and convert the video signal into an RGB digital signal and a line/field synchronous signal so as to modulate the laser light source unit at a high speed and control an external micro scanning device to carry out high-speed two-dimensional scanning;the control circuit comprises an analog front-end chip, a digital video processing circuit and a microcontroller;the analog front-end chip adopts the existing commercial chip;the digital video processing circuit is realized by adopting an FPGA;the microcontroller is realized by adopting an independent commercial chip or an IP software core integrated in the FPGA.
- The system for implementing a virtual keyboard of claim 8, wherein:the optical fiber and the auxiliary optical system are used for transmitting collimated/combined red, green and blue laser generated by the built-in laser light source unit to the external micro scanning device;the optical fiber is single-mode visible light optical fiber;the auxiliary optical system includes:the first lens/lens group is used for coupling the collimated/combined red, green and blue laser into the visible light optical fiber;and a second lens/lens group for collimating the red, green and blue laser beams emitted from the visible light fiber.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/103137 WO2019056353A1 (en) | 2017-09-25 | 2017-09-25 | Method and system for implementing virtual keyboard |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111279305A true CN111279305A (en) | 2020-06-12 |
Family
ID=65809938
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780095214.3A Pending CN111279305A (en) | 2017-09-25 | 2017-09-25 | Method and system for realizing virtual keyboard |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111279305A (en) |
| WO (1) | WO2019056353A1 (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101714050A (en) * | 2008-10-07 | 2010-05-26 | 英业达股份有限公司 | Panel computer and full screen keyboard window display method thereof |
| CN102023796A (en) * | 2009-09-11 | 2011-04-20 | 鸿富锦精密工业（深圳）有限公司 | Display system of virtual keyboard and realization method thereof |
| CN203930785U (en) * | 2014-02-24 | 2014-11-05 | 联想(北京)有限公司 | Electronic equipment |
| TW201511516A (en) * | 2013-09-02 | 2015-03-16 | Nat Univ Chung Hsing | A mobile device having projecting function |
| WO2015152649A1 (en) * | 2014-04-02 | 2015-10-08 | 디에스글로벌 (주) | Portable device for providing multiple functions |
| CN106125923A (en) * | 2016-06-22 | 2016-11-16 | 京东方科技集团股份有限公司 | Electronic equipment, input/output unit and using method thereof |
| CN106303325A (en) * | 2015-06-08 | 2017-01-04 | 中强光电股份有限公司 | Interactive projection system and projecting method thereof |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7173605B2 (en) * | 2003-07-18 | 2007-02-06 | International Business Machines Corporation | Method and apparatus for providing projected user interface for computing device |
| TW201329733A (en) * | 2012-01-13 | 2013-07-16 | Hon Hai Prec Ind Co Ltd | Instant messaging method and system in hand-held electronic device |
| CN102750106B (en) * | 2012-07-02 | 2016-05-18 | 安徽科大讯飞信息科技股份有限公司 | Full frame handwriting recognition input method and system |
-
2017
- 2017-09-25 WO PCT/CN2017/103137 patent/WO2019056353A1/en active Application Filing
- 2017-09-25 CN CN201780095214.3A patent/CN111279305A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101714050A (en) * | 2008-10-07 | 2010-05-26 | 英业达股份有限公司 | Panel computer and full screen keyboard window display method thereof |
| CN102023796A (en) * | 2009-09-11 | 2011-04-20 | 鸿富锦精密工业（深圳）有限公司 | Display system of virtual keyboard and realization method thereof |
| TW201511516A (en) * | 2013-09-02 | 2015-03-16 | Nat Univ Chung Hsing | A mobile device having projecting function |
| CN203930785U (en) * | 2014-02-24 | 2014-11-05 | 联想(北京)有限公司 | Electronic equipment |
| WO2015152649A1 (en) * | 2014-04-02 | 2015-10-08 | 디에스글로벌 (주) | Portable device for providing multiple functions |
| CN106303325A (en) * | 2015-06-08 | 2017-01-04 | 中强光电股份有限公司 | Interactive projection system and projecting method thereof |
| CN106125923A (en) * | 2016-06-22 | 2016-11-16 | 京东方科技集团股份有限公司 | Electronic equipment, input/output unit and using method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019056353A1 (en) | 2019-03-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2919104B1 (en) | Information processing device, information processing method, and computer-readable recording medium | |
| US7173605B2 (en) | Method and apparatus for providing projected user interface for computing device | |
| Ni et al. | A survey of large high-resolution display technologies, techniques, and applications | |
| US20150193084A1 (en) | Display input device | |
| CN103631382A (en) | Laser projection virtual keyboard | |
| US20160335242A1 (en) | System and Method of Communicating between Interactive Systems | |
| JP2001021992A (en) | Portable terminal, portable terminal system and portable telephone | |
| CN103543823B (en) | There is the portable electronic devices of multiplicity of projection function | |
| CN103365620A (en) | Intelligent split screen display available mobile terminal | |
| US11620414B2 (en) | Display apparatus, display method, and image processing system | |
| JPH0778055A (en) | Data processor | |
| US20240028143A1 (en) | Virtual peripherals for mobile devices | |
| US20200218198A1 (en) | Movement control of holographic objects with crown movement of a watch device | |
| CN111279305A (en) | Method and system for realizing virtual keyboard | |
| WO2022057644A1 (en) | Device interaction method, electronic device, and interactive system | |
| WO2016006070A1 (en) | Portable information terminal device and head-mount display linked thereto | |
| JPH10124178A (en) | Electronic main terminal, method for processing the same, and its medium | |
| KR20190093243A (en) | Block recognition based infant learning device and method | |
| WO2017120056A1 (en) | Content navigation control | |
| CN105652451A (en) | Intelligent glasses | |
| JP2004046311A (en) | Method and system for gesture input in three-dimensional virtual space | |
| AlKassim et al. | Sixth sense technology: Comparisons and future predictions | |
| US20240103625A1 (en) | Interaction method and apparatus, electronic device, storage medium, and computer program product | |
| JP2022102885A (en) | Information processing apparatus, information processing system, and program | |
| CN118053457A (en) | Portable projection storage equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200612 |
|
| RJ01 | Rejection of invention patent application after publication |