CN109426355B - Input method and input device of electronic equipment and electronic equipment - Google Patents
Input method and input device of electronic equipment and electronic equipment Download PDFInfo
- Publication number
- CN109426355B CN109426355B CN201710767456.4A CN201710767456A CN109426355B CN 109426355 B CN109426355 B CN 109426355B CN 201710767456 A CN201710767456 A CN 201710767456A CN 109426355 B CN109426355 B CN 109426355B
- Authority
- CN
- China
- Prior art keywords
- input
- keyboard
- electronic device
- projection surface
- key
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
- Input From Keyboards Or The Like (AREA)
Abstract
The embodiment of the invention provides an input method of electronic equipment and related equipment, wherein the method comprises the following steps: acquiring a control instruction of the projected keyboard; projecting a keyboard to the appointed position of the projection surface; controlling the infrared emitter to emit infrared light; determining a pressing position of an input operation on the projection surface according to the reflected light of the infrared light received by the receiver; and determining an input key J according to the position of the keyboard on the projection surface and the pressing position of the input operation on the projection surface. According to the embodiment of the invention, the input operation object is the projected keyboard, and the operation area is not limited by the size of the electronic equipment, so that the convenience and the accuracy of the input operation are improved.
Description
Technical Field
The invention relates to the technical field of electronics, in particular to an input method and an input device of electronic equipment and the electronic equipment.
Background
With the development of electronic technology, electronic devices such as mobile phones and the like integrate more and more functions, and in order to use the functions in the electronic devices, data or instructions need to be input by means of an input device, and currently, the input device is usually a physical key arranged in the electronic devices or a virtual keyboard displayed in a display interface of the electronic devices.
To improve portability, electronic devices are becoming smaller and smaller in size. Limited by the size, the size of the virtual key displayed in the display interface is smaller than that of the physical key, so that the user is inconvenient to operate and is easy to cause misoperation.
Disclosure of Invention
The embodiment of the invention provides an input method and an input device of electronic equipment and the electronic equipment, aiming at improving the convenience and accuracy of input operation.
A first aspect of an embodiment of the present invention provides an input method for an electronic device, where the method includes:
acquiring a control instruction of the projected keyboard;
projecting a keyboard to the designated position of the projection surface; the designated position may be that one side of the projected keyboard is parallel to an intersection line of the electronic device and the projection surface, and the distance is a preset distance, for example, the preset distance may be 10 centimeters. The projected center point of the keyboard may be perpendicular to the line connecting the center point of the electronic device and the aforementioned intersection line.
Controlling the infrared emitter to emit infrared light;
determining a pressing position of an input operation on the projection surface according to the reflected light of the infrared light received by the receiver;
and determining an input key J according to the position of the keyboard on the projection surface and the pressing position of the input operation on the projection surface.
As can be seen from the above, in this embodiment, after the control instruction for projecting the keyboard is obtained, the keyboard is projected to the designated position on the projection surface, the pressing position of the input operation on the projection surface can be determined according to the reflected light of the infrared ray emitted by the emitter and received by the receiver, and the input key is determined by combining the position of the projected keyboard on the projection surface and the pressing position of the input operation on the projection surface. According to the embodiment, the object of the input operation is the projected keyboard, and the operation area is not limited by the size of the electronic equipment, so that the convenience and the accuracy of the input operation are improved.
In some possible embodiments, the method may further include:
judging whether an input trend exists according to the reflected light of the infrared light received by the receiver; for example, the contour posture of the hand when the user performs an input operation and the moving direction of the finger can be determined according to the reflected light received by the receiver, and when it is determined that the finger moves upward and falls, an input trend can be considered. It is understood that different judgment bases can be set for judging whether the input trend exists, for example, the input trend can also be determined when the finger is lifted, and the like.
When the input trend is judged, starting a visual sensor;
triggering the visual sensor to take a picture when the input operation is judged to press the keyboard projected on the projection surface; in some possible embodiments of the present invention, a vertical distance between a fingertip of a finger and a keyboard may be detected, and when the vertical distance is less than 3 mm, it is considered that an input operation presses the keyboard projected on the projection surface, and at this time, the visual sensor may be triggered to take a picture, although the vertical distance may also be other values. It is understood that in some possible embodiments of the present invention, after the finger is lifted to the highest point, a preset time period, for example, 1 second, is considered that the input operation presses the keyboard projected on the projection surface, and then the visual sensor is triggered to take a picture.
Recognizing an input gesture according to a photo obtained by photographing by the vision sensor; for example, a picture taken by a visual sensor may be recognized by using an image recognition technology, specifically, at least one input gesture may be set in advance for an input operation of each key, after the input gesture is recognized, the input gesture is matched with the preset input gesture to determine an input operation corresponding to the recognized input gesture, and the key corresponding to the input operation may be determined according to a preset correspondence relationship between the input gesture and the key.
Determining an input key J' according to the input posture;
judging whether the key J and the key J' are the same key or not;
if yes, determining that the key input by the input operation is J; and if not, determining that the input operation fails.
In order to improve the input accuracy, in the embodiment, the input key J ' is determined after the image is taken by using the visual sensor, and then the input key J ' is compared with the previously determined key J input by the input operation, so that whether the key J and the key J ' are the same key is judged; if the key J and the key J' are the same key, determining that the key input by the input operation is J, and in some possible embodiments of the application, further displaying the input key information on a display interface of the electronic device; if the key J and the key J' are not the same key, determining that the input operation fails; in some possible embodiments of the present application, information of input failure may be further displayed on a display interface of the electronic device, or information may not be displayed, and a user may determine to continue inputting or to change inputting or delete inputting, etc. by observing the information on the display interface.
In some possible embodiments, before projecting the keyboard to the designated position of the projection surface, the method may further include:
acquiring a real-time posture of the electronic equipment;
and adjusting the postures of a projector, a receiver, a visual sensor and an infrared transmitter in the electronic equipment according to the real-time posture.
In some possible implementations, the real-time pose of the electronic device includes: whether the electronic device is laid horizontally or vertically, and an inclination angle of the electronic device.
In some possible embodiments, adjusting the pose of a projector, a receiver, a visual sensor, and an infrared transmitter in the electronic device according to the real-time pose includes:
and adjusting the positions of the projector, the receiver, the visual sensor and the infrared emitter to enable the optical axis of the projector, the optical axis of the receiver, the optical axis of the visual sensor and the optical axis of the infrared emitter to intersect at the same point.
In some possible embodiments, the same point is a projected center point of the keyboard.
A first aspect of an embodiment of the present invention provides an input device for an electronic device, where the input device includes:
the acquisition unit is used for acquiring a control instruction of the projected keyboard;
the processing unit is used for projecting the keyboard to the specified position of the projection surface;
the transmitting unit is used for controlling the infrared transmitter to transmit infrared light;
a first determination unit configured to determine a pressing position of an input operation on the projection surface based on the reflected light of the infrared light received by the receiver;
and the second determining unit is used for determining the input key J according to the position of the keyboard on the projection surface and the pressing position of the input operation on the projection surface.
In this embodiment, after the control instruction for projecting the keyboard is acquired, the keyboard is projected to the designated position on the projection surface, the pressing position of the input operation on the projection surface can be determined according to the reflected light of the infrared ray emitted by the emitter received by the receiver, and the input key is determined by combining the position of the projected keyboard on the projection surface and the pressing position of the input operation on the projection surface. According to the embodiment, the object of the input operation is the projected keyboard, and the operation area is not limited by the size of the electronic equipment, so that the convenience and the accuracy of the input operation are improved.
In some possible embodiments, the processing unit may be further configured to determine whether there is an input trend according to the reflected light of the infrared light received by the receiver;
the starting unit is used for starting the visual sensor when the processing unit judges that the input trend exists;
the triggering unit is used for triggering the visual sensor to take a picture when the input operation is judged to press the keyboard projected on the projection surface;
the recognition unit is used for recognizing an input gesture according to a picture obtained by photographing by the vision sensor;
a third determination unit configured to determine an input key J' according to the input gesture; judging whether the key J and the key J' are the same key or not; if yes, determining that the key input by the input operation is J; and if not, determining that the input operation fails.
In some possible embodiments, the acquiring unit may be further configured to acquire a real-time pose of the electronic device before the processing unit projects the keyboard onto the designated position of the projection surface;
the processing unit is further configured to adjust the postures of the projector, the receiver, the visual sensor and the infrared emitter in the electronic device according to the real-time posture of the electronic device acquired by the acquisition unit.
In some possible implementations, the real-time pose of the electronic device may include: whether the electronic device is laid horizontally or vertically, and an inclination angle of the electronic device.
In some possible embodiments, in adjusting the postures of the projector, the receiver, the vision sensor and the infrared emitter in the electronic device according to the real-time posture, the processing unit is specifically configured to adjust the positions of the projector, the receiver, the vision sensor and the infrared emitter so that the optical axis of the projector, the optical axis of the receiver, the optical axis of the vision sensor and the optical axis of the infrared emitter intersect at the same point.
In some possible embodiments, the same point is a projected center point of the keyboard.
A third aspect of an embodiment of the present invention provides an electronic device, including: a projector, an infrared emitter, a receiver, a display, a processor, and a storage component coupled to one another; in some possible implementations, the electronic device may further include a visual sensor, wherein the processor is configured to perform some or all of the steps of the input method of the electronic device provided by the embodiment of the present invention.
Furthermore, a fourth aspect of embodiments of the present application provides a computer-readable storage medium storing program code. The program code includes instructions for performing some or all of the steps of any one of the input methods of the electronic device provided by the embodiments of the present invention.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be adopted in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
FIG. 1-a is a schematic view of an electronic device according to an embodiment of the present invention when projecting a keyboard;
FIG. 1-b is a schematic diagram of a user inputting with an electronic device according to another embodiment of the invention;
fig. 2-a is a schematic flowchart of an input method of an electronic device according to an embodiment of the present invention;
fig. 2-b is a schematic flowchart of an input method of an electronic device according to another embodiment of the present invention;
FIG. 2-c is a schematic diagram of a receiver according to an embodiment of the present invention;
fig. 3-a is a schematic flowchart of an input method of an electronic device according to an embodiment of the present invention;
fig. 3-b is a schematic flowchart of an input method of an electronic device according to another embodiment of the present invention;
fig. 4-a is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 4-b is a schematic structural diagram of an electronic device according to another embodiment of the present invention.
Detailed Description
The embodiment of the invention provides an input method and an input device of electronic equipment and the electronic equipment.
The appearances of the phrases "first," "second," and "third," or the like, in the specification, claims, and figures are not necessarily all referring to the particular order in which they are presented. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
The input method of the electronic device provided by the embodiment of the invention is described first. The main body of the input method provided by the embodiment of the invention is a processor in an electronic device, wherein the electronic device may be an apparatus having a projector, an infrared transmitter, and a receiver, such as a notebook computer, a tablet computer, a personal computer, a mobile phone, or a video server.
Referring to fig. 1-a, fig. 1-a is a schematic view of an electronic device 100 according to an embodiment of the invention when projecting a keyboard K. The gyroscope, the magnetic sensor and the accelerometer which are used for detecting the placing posture (such as the inclination angle, the horizontal placing or the vertical placing) of the electronic device 100 are arranged inside the electronic device 100, the display screen is arranged on the surface of the electronic device 100, control instructions can be received through the display screen, for example, a user can trigger an instruction of projecting a keyboard on a projection plane through operating the content displayed in the display screen, the projection plane can be a plane where the electronic device 100 is placed, and the electronic device 100 can be obliquely placed on the projection plane. The electronic device 100 is also provided with a projector 101, a receiver 102, and an infrared transmitter 103; the receiver 102 is used for receiving the reflected light of the infrared ray emitted by the infrared ray emitter 103. It can be understood that, as shown in fig. 1-b, when a user inputs an instruction by operating the keyboard K on the projection interface, infrared light irradiated on the hand of the user is reflected back, the receiver 102 receives the reflected light, the positions of the reflection points can be determined according to information such as the distance between the infrared emitter 103 and the receiver 102, the time difference between the reflected light and the emitted light, the angle of the reflected light, and the like, and the posture of the hand can be determined according to the positions of all the reflection points, such as which finger is lifted, which finger is dropped, the vertical distance between the fingertip and the projection surface, the overall position and posture of the finger, and the like. Which key of the keyboard is pressed by the finger can be determined according to the position of the projected keyboard and the position when the finger is pressed. Wherein, one side of the keyboard is parallel to one side of the electronic equipment and the distance is X O . The gyroscope can detect that the inclination angle of the electronic device 100 is theta 1 The optical axis of the infrared emitter 103 is oo', and the included angle between the optical axis and the display interface is θ 2 。
As shown in fig. 2-a, an input method of an electronic device according to an embodiment of the present invention may include:
201. and acquiring a control instruction of the projected keyboard.
In some possible embodiments of the present invention, the electronic device may interact with the user through a control interface displayed in the display screen, for example, the electronic device may receive a control command projected out of the keyboard through the display screen. It will be appreciated that the control command may be triggered by other means, such as by physical keys on the terminal.
202. And projecting the keyboard to the specified position of the projection surface.
The designated position may be that one side of the projected keyboard is parallel to an intersection line of the electronic device and the projection plane, and the distance is a preset distance, for example, the preset distance may be 10 centimeters; meanwhile, a connecting line between the projected center point of the keyboard and the center point of the electronic device may be perpendicular to the intersecting line. The keyboard may be projected to a specified position of the projection surface using a projector provided in the electronic device. After the projector projects a keyboard on the projection surface, self-maintaining of the posture is carried out, the posture maintaining is mainly judged through the gyroscope and the accelerometer, the posture of the projector is adjusted through detecting the posture of the electronic equipment according to the unchanged preset distance, and then the maintaining of the preset distance is realized.
203. Controlling the infrared emitter to emit infrared light.
204. And determining the pressing position of the input operation on the projection surface according to the reflected light of the infrared light received by the receiver.
205. And determining an input key J according to the position of the keyboard on the projection surface and the pressing position of the input operation on the projection surface.
In order to allow the light emitted from the infrared emitter to be received by the receiver and the light emitted from the infrared emitter to be irradiated to the projected keyboard, the positions of the projector, the infrared emitter, and the receiver may be set. In some possible embodiments of the present invention, the positions of the projector, the receiver, and the infrared emitter may be adjusted such that the optical axis of the projector, the optical axis of the receiver, and the optical axis of the infrared emitter intersect at the same point. In some possible embodiments of the present invention, the intersection point may be a projected center point of the keyboard.
Taking the position adjustment of the receiver as an example, as shown in fig. 2-c, it is a schematic structural diagram of the receiver. The device comprises a rotating motor 21, wherein the rotating motor 21 is fixed on the inner side of a shell of the electronic equipment through a positioning hole 25, a rotating shaft 23 of the rotating motor 21 is provided with a Complementary Metal Oxide Semiconductor (CMOS) camera 22 for collecting finger contours, the CMOS camera 22 is hinged on the rotating shaft 23, a telescopic rod 24 is arranged on the rotating shaft 23, the telescopic rod 24 can be a traction type electromagnet, and the telescopic rod 24 can be controlled to stretch and retract by adjusting the size and the direction of voltage in the telescopic rod 24. One end of the telescopic rod 24 is hinged to the rotating shaft 23, the other end of the telescopic rod 24 is hinged to the CMOS camera 22, the CMOS camera 22 can rotate under the driving of the rotating shaft 23, and the CMOS camera 22 can pitch under the driving of the telescopic rod. The optical axis of the CMOS camera 22 can be controlled to intersect the projected center point of the keyboard by the telescopic rod 24 and the rotary shaft 23. It will be appreciated that the adjustment principle of the projector and the infrared emitter is similar to that of the receiver, and will not be described herein.
As can be seen from the above, in the embodiment of the present invention, after the control instruction of the projected keyboard is obtained, the keyboard is projected to the specified position on the projection surface, the pressing position of the input operation on the projection surface can be determined according to the reflected light of the infrared ray emitted by the emitter and received by the receiver, and the input key is determined by combining the position of the projected keyboard on the projection surface and the pressing position of the input operation on the projection surface. According to the embodiment, the object of the input operation is the projected keyboard, and the operation area is not limited by the size of the electronic equipment, so that the convenience and the accuracy of the input operation are improved.
In some possible embodiments, the input method of the electronic device may be further as shown in fig. 2-b, and with respect to fig. 2-a, the input method in fig. 2-b further includes:
206. and judging whether the input trend exists according to the reflected light of the infrared light received by the receiver.
For example, the contour gesture of the hand when the user performs an input operation and the moving direction of the finger can be determined according to the reflected light received by the receiver, and when it is determined that the finger moves upward and falls, an input trend can be considered. It is understood that different judgment bases can be set for judging whether the input trend exists, for example, the input trend can also be determined when the finger is lifted, and the like.
207. And when the input trend is judged, starting the visual sensor.
208. And triggering the visual sensor to take a picture when the input operation is judged to press the keyboard projected on the projection surface.
In some possible embodiments of the present invention, a vertical distance between a finger tip and a keyboard may be detected, and when the vertical distance is less than 3 mm, it is considered that an input operation presses the keyboard projected on the projection surface, and at this time, the visual sensor may be triggered to take a picture, although the vertical distance may also be other values. It is understood that in some possible embodiments of the present invention, after the finger is lifted to the highest point, a preset time period, for example, 1 second, is considered that the input operation presses the keyboard projected on the projection surface, and then the visual sensor is triggered to take a picture.
209. And recognizing the input gesture according to the photo photographed by the visual sensor.
In some possible embodiments of the present invention, an input gesture library may be preset, where one input gesture in the input gesture library corresponds to one key input. The pressed key may be determined according to the input gesture.
The gesture library can be divided into a standard mode and a simple mode, wherein the standard mode refers to a mode for inputting characters according to a specified keyboard input gesture, and the simple mode refers to a mode for facilitating information acquisition when a user uses a single finger to operate a keyboard.
210. And determining an input key J' according to the input gesture.
211. And judging whether the key J and the key J' are the same key or not.
212. If yes, determining that the key input by the input operation is J; and if not, determining that the input operation fails.
As can be seen from the above, in order to improve the input accuracy, in the present embodiment, the input key J 'is determined after the image is taken by using the visual sensor, and then compared with the previously determined input key J for the input operation, whether the key J and the key J' are the same key is determined; if the key J and the key J' are the same key, determining that the key input by the input operation is J, and in some possible embodiments of the application, further displaying the input key information on a display interface of the electronic device; if the key J and the key J' are not the same key, determining that the input operation fails; in some possible embodiments of the present application, information of input failure may be further displayed on a display interface of the electronic device, or information may not be displayed, and a user may determine to continue inputting or to change inputting or delete inputting, etc. by observing the information on the display interface.
In some possible embodiments of the present invention, before projecting the keyboard to the designated position of the projection surface, the method may further include: acquiring a real-time posture of the electronic equipment;
and adjusting the postures of a projector, a receiver, a visual sensor and an infrared transmitter in the electronic equipment according to the real-time posture.
Wherein the real-time pose of the electronic device may include: whether the electronic device is placed horizontally or vertically, the tilt angle of the electronic device, and the like.
In some possible embodiments of the present invention, adjusting the pose of the projector, the receiver, the vision sensor, and the infrared emitter in the electronic device according to the real-time pose may include:
and adjusting the positions of the projector, the receiver, the visual sensor and the infrared emitter to ensure that the optical axis of the projector, the optical axis of the receiver, the optical axis of the visual sensor and the optical axis of the infrared emitter intersect at the same point.
In some possible embodiments of the present invention, the same point may be a center point of the projected keyboard.
The embodiment of the invention also provides a relevant device for implementing the scheme.
Referring to fig. 3-a, an embodiment of the present invention provides an input device 300 for an electronic apparatus, including:
an obtaining unit 301, configured to obtain a control instruction of the projected keyboard;
a processing unit 302, configured to project a keyboard to a specified position of a projection surface;
a transmitting unit 303 for controlling the infrared transmitter to transmit infrared light;
a first determination unit 304 configured to determine a pressing position of an input operation on the projection surface based on the reflected light of the infrared light received by the receiver;
a second determining unit 305, configured to determine an input key J according to the position of the keyboard on the projection surface and the pressing position of the input operation on the projection surface.
In some possible embodiments, the processing unit may be further configured to determine whether there is an input trend according to the reflected light of the infrared light received by the receiver;
the input device shown may also be as shown in fig. 3-b, and with respect to fig. 3-a, fig. 3-b may further include:
the starting unit 306 is used for starting the visual sensor when the processing unit judges that the input trend exists;
the triggering unit 307 is configured to trigger the visual sensor to take a picture when it is determined that the input operation presses the keyboard projected on the projection surface;
the recognition unit 308 is configured to recognize an input gesture according to a photo taken by the vision sensor;
a third determination unit 309 configured to determine an input key J' according to the input gesture; judging whether the key J and the key J' are the same key or not; if yes, determining that the key input by the input operation is J; and if not, determining that the input operation fails.
In some possible embodiments, the obtaining unit may be further configured to obtain a real-time pose of the electronic device before the processing unit projects the keyboard to the specified position of the projection surface;
the processing unit may be further configured to adjust the postures of the projector, the receiver, the visual sensor, and the infrared emitter in the electronic device according to the real-time posture of the electronic device acquired by the acquiring unit.
In some possible implementations, the real-time pose of the electronic device may include: whether the electronic device is laid horizontally or vertically, and an inclination angle of the electronic device.
In some possible embodiments, in adjusting the postures of the projector, the receiver, the vision sensor and the infrared emitter in the electronic device according to the real-time posture, the processing unit is specifically configured to adjust the positions of the projector, the receiver, the vision sensor and the infrared emitter so that the optical axis of the projector, the optical axis of the receiver, the optical axis of the vision sensor and the optical axis of the infrared emitter intersect at the same point.
In some possible embodiments, the same point is a projected center point of the keyboard.
Referring to fig. 4-a, an embodiment of the present application further provides an electronic device 400, which may include: a projector 401, an infrared transmitter 402, a receiver 403, a display 404, a memory component 405, and a processor 406 coupled to each other. Wherein the storage unit 405 is configured to store instructions and the processor 406 is configured to execute the instructions. When the processor 406 executes the instructions, the input method of the electronic device according to any of the above embodiments of the present application may be executed according to the instructions.
The steps of the above method may be performed by integrated logic circuits in hardware or instructions in the form of software in the processor 406 during implementation included in the electronic device. The processor 406 may be a general purpose processor, a digital signal processor, an application specific integrated circuit, an off-the-shelf programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components. Processor 406 may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules may reside in ram, flash, rom, prom, or eprom, registers, etc. of storage media known in the art. The storage medium is located in the storage unit 405, and the processor 406 can read information in the storage unit 405 and complete the steps of the method in combination with hardware thereof.
For example, the electronic device 400 may perform the corresponding method steps in the embodiment shown in FIG. 2-a described above.
In some possible embodiments of the present application, as shown in fig. 4-b, the electronic device 400 may also include a visual sensor 408. Corresponding method steps as described above in the embodiment illustrated in fig. 2-b may be performed by other components in the electronic device 400.
The input device of the electronic equipment provided by the embodiment of the application is applied to the electronic equipment with a projection function. The electronic device may be, for example, a notebook computer, a tablet computer, a personal computer, a mobile phone, or a video server.
In addition, a computer-readable storage medium storing program codes is provided in an embodiment of the present application. The program code includes instructions for performing some or all of the steps of any one of the input methods of the electronic device provided by the embodiments of the present invention.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or adapted as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is substantially or partly contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The above-mentioned embodiments are only used for illustrating the technical solution of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and these modifications or substitutions do not depart from the spirit of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. An input method of an electronic device, the method comprising:
adjusting the positions of a projector, a receiver, a visual sensor and an infrared emitter in electronic equipment to enable the optical axis of the projector, the optical axis of the receiver, the optical axis of the visual sensor and the optical axis of the infrared emitter to intersect at the same point;
acquiring a control instruction of the projected keyboard;
projecting a keyboard to a specified position of a projection surface, wherein the specified position is a position which enables one side of the projected keyboard to be parallel to an intersection line of the electronic equipment and the projection surface, the distance is a preset distance, and a connecting line of a central point of the projected keyboard and a central point of the electronic equipment is perpendicular to the intersection line;
controlling the infrared emitter to emit infrared light;
determining a pressing position of an input operation on the projection surface according to the reflected light of the infrared light received by the receiver;
determining an input key J according to the position of the keyboard on the projection surface and the pressing position of the input operation on the projection surface;
wherein the method further comprises:
judging whether an input trend exists according to the reflected light of the infrared light received by the receiver;
when the input trend is judged, starting a visual sensor;
triggering the visual sensor to take a picture when the input operation is judged to press the keyboard projected on the projection surface;
recognizing an input gesture according to a photo obtained by photographing by the vision sensor;
determining an input key J' according to the input gesture and a preset input gesture library;
judging whether the key J and the key J' are the same key or not;
if yes, determining that the key input by the input operation is J; and if not, determining that the input operation fails.
2. The method of claim 1, wherein adjusting the position of the projector, the receiver, the vision sensor, and the infrared emitter in the electronic device comprises:
acquiring a real-time posture of the electronic equipment;
and adjusting the postures of a projector, a receiver, a visual sensor and an infrared transmitter in the electronic equipment according to the real-time posture.
3. The method of claim 2, wherein the real-time pose of the electronic device comprises: whether the electronic device is laid horizontally or vertically, and an inclination angle of the electronic device.
4. The method according to any one of claims 1 to 3,
the same point is the projected central point of the keyboard.
5. An input device for an electronic device, the device comprising:
the processing unit is used for adjusting the positions of a projector, a receiver, a visual sensor and an infrared emitter in the electronic equipment, so that the optical axis of the projector, the optical axis of the receiver, the optical axis of the visual sensor and the optical axis of the infrared emitter intersect at the same point;
the acquisition unit is used for acquiring a control instruction of the projected keyboard;
the processing unit is used for projecting a keyboard to a specified position of a projection surface, wherein the specified position is a position which enables one side of the projected keyboard to be parallel to an intersection line of the electronic equipment and the projection surface, the distance is a preset distance, and a connecting line of a central point of the projected keyboard and a central point of the electronic equipment is perpendicular to the intersection line;
the transmitting unit is used for controlling the infrared transmitter to transmit infrared light;
a first determination unit configured to determine a pressing position of an input operation on the projection surface based on the reflected light of the infrared light received by the receiver;
a second determination unit, configured to determine an input key J according to a position of the keyboard on the projection surface and a pressing position of the input operation on the projection surface;
the processing unit is further used for judging whether an input trend exists according to the reflected light of the infrared light received by the receiver;
the starting unit is used for starting the vision sensor when the processing unit judges that the input trend exists;
the triggering unit is used for triggering the visual sensor to take a picture when the input operation is judged to press the keyboard projected on the projection surface;
the recognition unit is used for recognizing an input gesture according to a picture obtained by photographing by the vision sensor;
a third determining unit, configured to determine an input key J' according to the input gesture and a preset input gesture library; judging whether the key J and the key J' are the same key or not; if yes, determining that the key input by the input operation is J; and if not, determining that the input operation fails.
6. The input device of claim 5,
the acquisition unit is further used for acquiring the real-time posture of the electronic equipment before the processing unit projects the keyboard to the specified position of the projection surface;
the processing unit is further configured to adjust the postures of the projector, the receiver, the visual sensor and the infrared emitter in the electronic device according to the real-time posture of the electronic device acquired by the acquisition unit.
7. The input device of claim 6, wherein the real-time gestures of the electronic device comprise: whether the electronic device is laid horizontally or vertically, and an inclination angle of the electronic device.
8. The input device according to any one of claims 5 to 7,
the same point is the projected central point of the keyboard.
9. An electronic device, comprising:
a projector, an infrared emitter, a receiver, a display, a processor, and a storage component coupled to one another; wherein the processor is configured to perform the input method of any one of claims 1 to 4.
10. The electronic device of claim 9, further comprising:
a vision sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710767456.4A CN109426355B (en) | 2017-08-31 | 2017-08-31 | Input method and input device of electronic equipment and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710767456.4A CN109426355B (en) | 2017-08-31 | 2017-08-31 | Input method and input device of electronic equipment and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109426355A CN109426355A (en) | 2019-03-05 |
| CN109426355B true CN109426355B (en) | 2022-12-30 |
Family
ID=65505179
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710767456.4A Active CN109426355B (en) | 2017-08-31 | 2017-08-31 | Input method and input device of electronic equipment and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109426355B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110456922B (en) * | 2019-08-16 | 2021-07-20 | 清华大学 | Input method, input device, input system and electronic equipment |
| CN111813272A (en) * | 2020-05-29 | 2020-10-23 | 维沃移动通信有限公司 | Information input method and device and electronic equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101093581A (en) * | 2006-06-23 | 2007-12-26 | 佳能株式会社 | Information processing method and apparatus for calculating information regarding measurement target on the basis of captured images |
| CN101957195A (en) * | 2005-09-12 | 2011-01-26 | 特里伯耶拿有限公司 | Surveying instrument and method of providing survey data of a target region using a surveying instrument |
| CN102591488A (en) * | 2010-11-30 | 2012-07-18 | 意法半导体(R&D)有限公司 | Input device and associated method |
| TW201238326A (en) * | 2011-03-04 | 2012-09-16 | Tung-Fa Wu | Real-time interactive 3D entertainment device and 3D replication |
| CN103189823A (en) * | 2010-11-12 | 2013-07-03 | 3M创新有限公司 | Interactive polarization-preserving projection display |
| JP2014109440A (en) * | 2012-11-30 | 2014-06-12 | Mitsubishi Space Software Co Ltd | Dimension estimation apparatus, dimension estimation program and dimension estimation method |
| CN205003596U (en) * | 2015-09-28 | 2016-01-27 | 刘小涛 | Portable multi -functional host computer |
| CN106933376A (en) * | 2017-03-23 | 2017-07-07 | 哈尔滨拓博科技有限公司 | A kind of scaling method of smooth projected keyboard |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150261429A1 (en) * | 2014-01-02 | 2015-09-17 | Benjamin Firooz Ghassabian | Systems to enhance data entry in mobile and fixed environment |
| JP5072688B2 (en) * | 2008-04-02 | 2012-11-14 | キヤノン株式会社 | Scanning imaging device |
| JP2013057785A (en) * | 2011-09-08 | 2013-03-28 | Ushio Inc | Laser source device and image projection apparatus |
| CN102701033A (en) * | 2012-05-08 | 2012-10-03 | 华南理工大学 | Elevator key and method based on image recognition technology |
| CN103336583B (en) * | 2013-06-18 | 2016-08-24 | 中国联合网络通信集团有限公司 | Projected keyboard and projected keyboard character code determine method |
| DE102013211904A1 (en) * | 2013-06-24 | 2014-12-24 | Robert Bosch Gmbh | Method and device for determining gestures in the beam area of a projector |
| CN105528086A (en) * | 2014-09-29 | 2016-04-27 | 百辰光电股份有限公司 | Virtual keyboard input device and input method thereof |
| CN104461003B (en) * | 2014-12-11 | 2019-02-05 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN105892760A (en) * | 2014-12-17 | 2016-08-24 | 广东新锦光电科技有限公司 | Virtual keyboard control method and apparatus using the same |
| CN105446646B (en) * | 2015-12-11 | 2019-01-11 | 小米科技有限责任公司 | Content input method, device and touch control device based on dummy keyboard |
| CN105825128B (en) * | 2016-03-15 | 2020-05-19 | 华为技术有限公司 | Data input method and device and user equipment |
-
2017
- 2017-08-31 CN CN201710767456.4A patent/CN109426355B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101957195A (en) * | 2005-09-12 | 2011-01-26 | 特里伯耶拿有限公司 | Surveying instrument and method of providing survey data of a target region using a surveying instrument |
| CN101093581A (en) * | 2006-06-23 | 2007-12-26 | 佳能株式会社 | Information processing method and apparatus for calculating information regarding measurement target on the basis of captured images |
| CN103189823A (en) * | 2010-11-12 | 2013-07-03 | 3M创新有限公司 | Interactive polarization-preserving projection display |
| CN102591488A (en) * | 2010-11-30 | 2012-07-18 | 意法半导体(R&D)有限公司 | Input device and associated method |
| TW201238326A (en) * | 2011-03-04 | 2012-09-16 | Tung-Fa Wu | Real-time interactive 3D entertainment device and 3D replication |
| JP2014109440A (en) * | 2012-11-30 | 2014-06-12 | Mitsubishi Space Software Co Ltd | Dimension estimation apparatus, dimension estimation program and dimension estimation method |
| CN205003596U (en) * | 2015-09-28 | 2016-01-27 | 刘小涛 | Portable multi -functional host computer |
| CN106933376A (en) * | 2017-03-23 | 2017-07-07 | 哈尔滨拓博科技有限公司 | A kind of scaling method of smooth projected keyboard |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109426355A (en) | 2019-03-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110581947B (en) | Taking pictures within virtual reality | |
| CN110169056B (en) | Method and equipment for acquiring dynamic three-dimensional image | |
| CN107528938B (en) | Video call method, terminal and computer readable storage medium | |
| CN107040698B (en) | Image capturing method of unmanned image capturing apparatus and electronic apparatus supporting the same | |
| US8818027B2 (en) | Computing device interface | |
| WO2020103526A1 (en) | Photographing method and device, storage medium and terminal device | |
| EP2950180B1 (en) | Method for determining screen display mode and terminal device | |
| EP3923239B1 (en) | Distance measurement method and electronic device | |
| KR102106296B1 (en) | Electric device including camera and operating method thereof | |
| EP3640732B1 (en) | Method and terminal for acquire panoramic image | |
| US11163995B2 (en) | User recognition and gaze tracking in a video system | |
| CN106657455B (en) | Electronic equipment with rotatable camera | |
| WO2022110614A1 (en) | Gesture recognition method and apparatus, electronic device, and storage medium | |
| CN106791437B (en) | Panoramic image shooting method and mobile terminal | |
| WO2021035646A1 (en) | Wearable device and control method therefor, gesture recognition method, and control system | |
| EP3171293A1 (en) | Method and device for controlling intelligent equipment | |
| KR20140035244A (en) | Apparatus and method for user interfacing, and terminal apparatus using the method | |
| CN109426355B (en) | Input method and input device of electronic equipment and electronic equipment | |
| US20170302908A1 (en) | Method and apparatus for user interaction for virtual measurement using a depth camera system | |
| US10270963B2 (en) | Angle switching method and apparatus for image captured in electronic terminal | |
| CN110213407B (en) | Electronic device, operation method thereof and computer storage medium | |
| CN210401976U (en) | Cloud platform camera | |
| CN108353102B (en) | Obstacle prompting method and terminal equipment | |
| US20180039371A1 (en) | Electronic apparatus and controlling method thereof | |
| KR101204868B1 (en) | Projector with virtual input interface and Method of inputting data with virtual input interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 523808 Southern Factory Building (Phase I) Project B2 Production Plant-5, New Town Avenue, Songshan Lake High-tech Industrial Development Zone, Dongguan City, Guangdong Province Applicant after: HUAWEI DEVICE Co.,Ltd. Address before: 523808 Southern Factory Building (Phase I) Project B2 Production Plant-5, New Town Avenue, Songshan Lake High-tech Industrial Development Zone, Dongguan City, Guangdong Province Applicant before: Huawei terminal (Dongguan) Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |