CN112000241A - Operation recognition method and device, storage medium and electronic device - Google Patents
Operation recognition method and device, storage medium and electronic device Download PDFInfo
- Publication number
- CN112000241A CN112000241A CN202010761832.0A CN202010761832A CN112000241A CN 112000241 A CN112000241 A CN 112000241A CN 202010761832 A CN202010761832 A CN 202010761832A CN 112000241 A CN112000241 A CN 112000241A
- Authority
- CN
- China
- Prior art keywords
- infrared
- projection area
- light spot
- infrared light
- contact operation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000004590 computer program Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 11
- 238000010586 diagram Methods 0.000 description 17
- 238000005516 engineering process Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 210000002784 stomach Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0412—Digitisers structurally integrated in a display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention provides an operation identification method and device, a storage medium and an electronic device, wherein the method comprises the following steps: collecting infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device; and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot. The invention solves the problem that the invalid contact operation of the interferent cannot be identified in the related art.
Description
Technical Field
The present invention relates to the field of communications, and in particular, to an operation recognition method and apparatus, a storage medium, and an electronic apparatus.
Background
An ultra-short-focus desktop projection and infrared touch device, such as a projection sound box, is a device which is placed on a desktop, can display a projection rectangular picture on the desktop, and can realize finger-click touch operation on the projection picture. Although the projection technology and the infrared detection technology are relatively mature, the product combining the projection technology and the infrared detection technology has many challenges or has many unstable factors, which are mainly reflected in that the infrared touch is susceptible to interference. For example, when there are pen, eraser, mouse, wires, protrusions on the desktop, even whole palm, arm, stomach, clothes and other interferents in the projection display area, these all can seriously affect the finger touch effect, causing the phenomena of finger touch insensitivity, false triggering and the like.
In the related art, an effective technical scheme has not been proposed yet for the problem that the invalid contact operation of the interfering object cannot be identified.
Disclosure of Invention
The embodiment of the invention provides an operation identification method and device, a storage medium and an electronic device, which are used for at least solving the problem that invalid contact operation of an interfering object cannot be identified in the related art.
According to an embodiment of the present invention, there is provided an operation recognition method including:
collecting infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot.
Optionally, the identifying whether the contact of the target object on the projection area is an effective contact operation according to the size of the infrared spot includes: determining that the contact of a first object on the projection area is invalid contact operation under the condition that a first light spot exists in at least one infrared light spot; wherein the size of the first light spot is smaller than or equal to a first threshold value, or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays by the first object contacting the projection area, and the target object comprises the first object.
Optionally, the identifying whether the contact of the target object on the projection area is an effective contact operation according to the size of the infrared spot includes: judging whether a second light spot exists in at least one infrared light spot, wherein the size of the second light spot is larger than a first threshold value and smaller than a second threshold value; determining the number of at least one second light spot in the presence of the second light spot; under the condition that the number meets a third preset condition, determining that the contact of the second object on the projection area is effective contact operation; wherein the second light spot is formed by reflection of the infrared ray by the second object contacting the projection area, and the target object includes the second object.
Optionally, after the determining the size of the infrared light spot and identifying whether the contact of the target object on the projection area is an effective contact operation according to the size of the infrared light spot, the method further includes: and under the condition that the contact of the target object to the projection area is identified as effective contact operation, responding to the effective contact operation, and generating a touch signal corresponding to the effective contact operation.
Optionally, the generating, in response to the effective contact operation, a touch signal corresponding to the effective contact operation when it is recognized that the contact of the target object on the projection area is the effective contact operation includes: determining coordinates of the effective contact operation according to the emitted light forming the infrared light spot; and generating a touch signal corresponding to the effective contact operation according to the coordinates.
Optionally, before the collecting the infrared light spot, the method further comprises: and projecting the target area through the projection device to obtain the projection area, and emitting an infrared beam to the projection area through an infrared laser emitter.
According to another embodiment of the present invention, there is provided an operation recognition apparatus including:
the infrared camera comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring infrared light spots through an infrared camera, the infrared light spots are formed by reflecting infrared rays through a target object in a contact projection area, and the projection area is obtained by projecting the infrared rays to the target area through a projection device;
and the identification module is used for determining the size of the infrared light spot and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot.
Optionally, the identification module is further configured to: determining that the contact of a first object on the projection area is invalid contact operation under the condition that a first light spot exists in at least one infrared light spot; wherein the size of the first light spot is smaller than or equal to a first threshold value, or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays by the first object contacting the projection area, and the target object comprises the first object.
Alternatively, according to another embodiment of the present invention, a storage medium is provided, in which a computer program is stored, wherein the computer program is arranged to perform the above-mentioned method when executed.
Alternatively, according to another embodiment of the present invention, there is provided an electronic apparatus, including a memory in which a computer program is stored and a processor configured to execute the computer program to perform the above method.
According to the invention, infrared light spots are collected through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device; and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot. Therefore, the problem that invalid contact operation of the interferent cannot be identified in the related technology can be solved, the identification accuracy of the contact operation is improved, and the user experience is optimized.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a flow chart of a method of operating an identification according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an ultra-short-focus desktop projection and infrared touch device according to an embodiment of the present invention;
FIG. 3 is a flow chart of a method of operating an identification according to another embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating a touch operation according to an embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating a touch operation according to another embodiment of the present invention;
FIG. 6 is a schematic diagram illustrating a touch operation according to another embodiment of the present invention;
fig. 7 is a block diagram of the structure of an operation recognition apparatus according to an embodiment of the present invention;
fig. 8 is a block diagram of the structure of an operation recognition apparatus according to another embodiment of the present invention;
fig. 9 is a block diagram of the structure of an operation recognition apparatus according to still another embodiment of the present invention;
fig. 10 is a schematic structural diagram of an alternative electronic device according to an embodiment of the invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
An embodiment of the present invention provides an operation identification method, and fig. 1 is a flowchart of the operation identification method according to the embodiment of the present invention, as shown in fig. 1, including:
step S102, collecting infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
and step S104, determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation according to the size of the infrared light spot.
According to the invention, infrared light spots are collected through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device; and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot. Therefore, the problem that invalid contact operation of the interferent cannot be identified in the related technology can be solved, the identification accuracy of the contact operation is improved, and the user experience is optimized.
In the above embodiment, before the collecting the infrared light spot, the method further includes: and projecting the target area through the projection device to obtain the projection area, and emitting an infrared beam to the projection area through an infrared laser emitter. As an alternative embodiment, the projection device may be an ultra-short focal length machine, for example, the projection device projects the target area through the ultra-short focal length machine to form a projection area, and emits an infrared beam to the projection area through an infrared laser emitter, when the target object contacts the projection area, the infrared beam is reflected by the target object, the emitted light forms an infrared spot, and at this time, the infrared spot is collected by the infrared camera.
The size of the infrared light spot can be the diameter or the area of the infrared light spot, or when the infrared light spot is in a band shape, the size of the infrared light spot can be the width of the infrared light spot.
Based on the above embodiment, the identifying whether the contact of the target object to the projection area is an effective contact operation according to the size of the infrared spot includes: determining that the contact of a first object on the projection area is invalid contact operation under the condition that a first light spot exists in at least one infrared light spot; wherein the size of the first light spot is smaller than or equal to a first threshold value, or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays by the first object contacting the projection area, and the target object comprises the first object.
Under the condition that the first light spots with the sizes smaller than or equal to the first threshold or larger than or equal to the second threshold exist in the infrared light spots collected by the infrared camera, the first object corresponding to the first light spots is determined to be an interference object, the first light spots are invalid light spots, and the first object contacts the projection area in an invalid contact mode, so that the identification of the invalid contact operation of the interference object is achieved, the influence of the interference object on the touch operation is avoided, the accuracy of the touch operation is improved, and the user experience is optimized.
In the above embodiment, the identifying whether the contact of the target object on the projection area is an effective contact operation according to the size of the infrared spot further includes: judging whether a second light spot exists in at least one infrared light spot, wherein the size of the second light spot is larger than a first threshold value and smaller than a second threshold value; determining the number of at least one second light spot in the presence of the second light spot; under the condition that the number meets a third preset condition, determining that the contact of the second object on the projection area is effective contact operation; wherein the second light spot is formed by reflection of the infrared ray by the second object contacting the projection area, and the target object includes the second object.
Based on the above embodiment, when there is a second light spot having a size larger than the first threshold value and smaller than the second threshold value in the infrared light spots collected by the infrared camera, it is determined that the second object corresponding to the second light spot is not an interfering object. Since the number of touch points supported by the touch device is limited, it needs to be further determined whether the number of the second light spots meets a third preset condition, for example, the third preset condition is that the number of the second light spots is smaller than a number threshold. And under the condition that the number of the second light spots accords with a third preset condition, determining that the contact of the second object to the projection area is effective contact operation, and determining that the second light spots are effective light spots, so that the effective contact operation supported by the touch equipment can be identified, and the accuracy of the touch operation is improved.
After determining the size of the infrared light spot and identifying whether the contact of the target object to the projection area is an effective contact operation according to the size of the infrared light spot, the embodiment may further perform the following technical solution: and under the condition that the contact of the target object to the projection area is identified as effective contact operation, responding to the effective contact operation, and generating a touch signal corresponding to the effective contact operation.
It should be noted that, since the valid contact operation is recognized, the touch device can be touched according to the touch information number by generating the touch signal in response to the valid contact operation.
Wherein, in a case where it is recognized that the contact of the target object to the projection area is an effective contact operation, generating, in response to the effective contact operation, a touch signal corresponding to the effective contact operation includes: determining coordinates of the effective contact operation according to the emitted light forming the infrared light spot; and generating a touch signal corresponding to the effective contact operation according to the coordinates.
In the embodiment, the coordinates of the effective contact operation are determined, and the touch signal corresponding to the effective contact operation is generated according to the coordinates, so that an accurate touch signal can be generated according to the effective contact operation, and the accuracy of the touch operation is improved.
The above operation identification method is explained with reference to an example, but is not limited to the technical solution of the embodiment of the present invention.
The operation identification method of the embodiment of the invention can be applied to desktop projection and infrared touch equipment, such as ultra-short-focus desktop projection and infrared touch equipment shown in fig. 2. Fig. 2 is a schematic diagram of an ultra-short-focus desktop projection and infrared touch device according to an embodiment of the present invention, and as shown in fig. 2, the ultra-short-focus desktop projection and infrared touch device 21 projects a target area to obtain a projection area 22. The ultra-short-focus desktop projection and infrared touch control equipment comprises a projection device, an infrared laser emitter, an infrared camera and a processor.
The ultra-short focal length machine is used for projecting a rectangular picture with a specified size (for example, 23 inches) on a desktop to obtain a projection area; the infrared laser transmitter is used for transmitting a beam of infrared light, and the infrared light passes through the conical optical device to realize covering of a layer of infrared light on the whole projection area; the infrared camera is used for detecting reflected infrared light formed after the infrared light is blocked by a target object, wherein the reflected infrared light forms infrared light spots; the processor is used for controlling the projection of the ultra-short focal length machine and determining the coordinates of the reflected light received by the infrared camera and the size of the reflected light spot.
Fig. 3 is a flowchart of an operation recognition method according to another embodiment of the present invention, as shown in fig. 3, the embodiment of the present invention includes the following steps:
step 1: starting up the touch control equipment;
step 2: after the touch control equipment is started, the processor controls the ultra-short focal length machine to perform projection;
and step 3: controlling an infrared laser to normally emit infrared rays;
and 4, step 4: controlling an infrared camera to collect light spots;
and 5: judging whether the infrared camera collects infrared light spots;
if no infrared light spot is collected, step 9 is executed. If no infrared light spot is collected, no finger touch is indicated in the projection area, and no interference object exists;
if the infrared camera collects the infrared light spots, executing the step 6;
step 6: the processor processes and analyzes the infrared light spots and judges whether the infrared light spots are effective contact operation (namely effective touch, such as finger touch).
In the embodiment of the invention, when the size of the infrared light spot (for example, the diameter of the light spot) is 10 mm-20 mm, the infrared light spot can be determined to be caused by finger touch; the infrared light spot of less than 10mm is determined to be caused by small interferents (such as a desktop salient point, an electric wire and the like) in the projection area; the infrared light spot of more than 20mm is determined to be caused by the existence of a relatively large interfering object in the projection area. And determining the infrared light spot below 10mm and the infrared light spot above 20mm as the interference light spot caused by the interference object, and determining the invalid contact operation at the moment. Since finger touches are typically set to acceptable numbers of points (e.g., 10-point touches and 5-point touches) depending on the device hardware configuration, valid finger touches within the set number of points will all respond. Therefore, when the infrared light spots are between 10mm and 20mm, whether the number of the infrared light spots between 10mm and 20mm is within the set point number needs to be further determined, and if so, the processor determines that the contact in the projection area is an effective contact operation.
If the contact operation is invalid, executing the step 8; otherwise, executing step 7;
and 7: and carrying out normal picture response according to the effective touch operation.
And 8: the processor will filter and mask the light spot and will not respond according to the invalid contact operation;
and step 9: and no touch operation is received and no response is made.
Fig. 4 is a schematic diagram of a touch operation according to an embodiment of the invention. As shown in fig. 4, normal finger touch operation exists in the projection area. The touch control equipment can catch the infrared reflection light spots through the infrared camera and accurately identify the finger touch control coordinates through calculation, so that the processor makes a correct picture feedback response.
The touch device in the related art has a very high requirement on the flatness of the desktop. Firstly, the desktop is required to be flat and cannot be uneven, otherwise, touch control is unavailable or false triggering is easily caused; secondly, the desktop can not have foreign matters such as pens, erasers, wires and the like, otherwise, the desktop can recognize that an object triggers touch control to perform touch control response, and when a finger clicks a projection picture (namely a projection area) again. Fig. 5 is a schematic diagram of a touch operation according to another embodiment of the present invention, as shown in fig. 5, in addition to the finger touch, there are interferents in the projection area, and at this time, the finger touch is not responded or the response is disordered; thirdly, when one hand presses or the arm is positioned in the projection area, and the other hand clicks the projection area again, the confusion can be responded. FIG. 6 is a schematic diagram of a touch operation according to another embodiment of the present invention, as shown in FIG. 6, one hand of the projection area is pressed on the projection area, and when the other hand is used to click on the projection area again, a response disorder occurs. Therefore, in order to realize accurate touch control, the projection surface must be strictly controlled, otherwise, the operation experience effect is seriously affected.
Through the embodiment, the problems that touch control experience is affected due to the fact that the interferent is inflexible and triggers mistakenly in the projection area can be solved, invalid contact operation caused by the interferent is filtered, operation stability of touch control equipment is improved, natural smoothness of touch control operation is guaranteed, and user experience is improved.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
According to another embodiment of the present invention, an operation recognition apparatus is provided, which is used for implementing the above embodiments and preferred embodiments, and the description of the operation recognition apparatus is omitted. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 7 is a block diagram of an operation recognition apparatus according to an embodiment of the present invention, the apparatus including:
the acquisition module 72 is configured to acquire an infrared light spot through an infrared camera, where the infrared light spot is formed by reflecting infrared light by a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spot to the target area through a projection device;
and the identification module 74 is configured to determine the size of the infrared light spot, and identify whether the contact of the target object to the projection area is an effective contact operation according to the size of the infrared light spot.
According to the invention, infrared light spots are collected through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device; and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot. Therefore, the problem that invalid contact operation of the interferent cannot be identified in the related technology can be solved, the identification accuracy of the contact operation is improved, and the user experience is optimized.
Wherein the identification module 74 is further configured to: determining that the contact of a first object on the projection area is invalid contact operation under the condition that a first light spot exists in at least one infrared light spot; wherein the size of the first light spot is smaller than or equal to a first threshold value, or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays by the first object contacting the projection area, and the target object comprises the first object.
It should be noted that, in the above embodiment, the identifying module 74 is further configured to: judging whether a second light spot exists in at least one infrared light spot, wherein the size of the second light spot is larger than a first threshold value and smaller than a second threshold value; determining the number of at least one second light spot in the presence of the second light spot; under the condition that the number meets a third preset condition, determining that the contact of the second object on the projection area is effective contact operation; wherein the second light spot is formed by reflection of the infrared ray by the second object contacting the projection area, and the target object includes the second object.
Fig. 8 is a block diagram of an operation recognition apparatus according to another embodiment of the present invention. As shown in fig. 8, the apparatus further includes: and a generating module 76, configured to, in a case that it is identified that the contact of the target object on the projection area is an effective contact operation, generate a touch signal corresponding to the effective contact operation in response to the effective contact operation.
Wherein the generating module 76 is further configured to: determining coordinates of the effective contact operation according to the emitted light forming the infrared light spot; and generating a touch signal corresponding to the effective contact operation according to the coordinates.
Fig. 9 is a block diagram of an operation recognition apparatus according to still another embodiment of the present invention. As shown in fig. 9, the apparatus further includes: the projection module 78 is configured to obtain the projection area by projecting the projection device to the target area; and the emitting module 80 is used for emitting an infrared beam to the projection area through an infrared laser emitter.
An embodiment of the present invention further provides a storage medium including a stored program, wherein the program executes any one of the methods described above.
Alternatively, in the present embodiment, the storage medium may be configured to store program codes for performing the following steps:
s1, collecting infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
and S2, determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation according to the size of the infrared light spot.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, collecting infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
and S2, determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation according to the size of the infrared light spot.
Fig. 10 is a schematic structural diagram of an alternative electronic device according to an embodiment of the invention. Alternatively, it can be understood by those skilled in the art that the structure shown in fig. 10 is only an illustration, and the electronic device may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palm computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 10 is a diagram illustrating a structure of the electronic device. For example, the electronic device may also include more or fewer components (e.g., network interfaces, etc.) than shown in FIG. 10, or have a different configuration than shown in FIG. 10.
The memory 1002 may be used to store software programs and modules, such as program instructions/modules corresponding to the operation recognition method and the operation recognition apparatus in the embodiment of the present invention, and the processor 1004 executes various functional applications and data processing by executing the software programs and modules stored in the memory 1002, that is, the operation recognition method described above is implemented. The memory 1002 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 1002 may further include memory located remotely from the processor 1004, which may be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. As an example, the memory 1002 may include, but is not limited to, the acquisition module 72, the identification module 74, the generation module 76, the projection module 78, and the transmission module 80 of the operation recognition device. In addition, other module units in the operation recognition device may also be included, but are not limited to, and are not described in detail in this example.
Optionally, the transmission device 1006 is used for receiving or transmitting data via a network. Examples of the network may include a wired network and a wireless network. In one example, the transport device 1006 includes a Network adapter (NIC) that can be connected to a router via a Network cable to communicate with the internet or a local area Network. In one example, the transmission device 1006 is a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In addition, the electronic device further includes: a display 1008 for displaying a screen operated by the current operation device; and a connection bus 1010 for connecting the respective module parts in the above-described electronic apparatus.
In other embodiments, the terminal or the server may be a node in a distributed system, wherein the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting a plurality of nodes through a network communication form. Nodes can form a Peer-To-Peer (P2P, Peer To Peer) network, and any type of computing device, such as a server, a terminal, and other electronic devices, can become a node in the blockchain system by joining the Peer-To-Peer network.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. An operation recognition method, comprising:
collecting infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot.
2. The method according to claim 1, wherein the identifying whether the contact of the target object to the projection area is a valid contact operation according to the size of the infrared spot comprises:
determining that the contact of a first object on the projection area is invalid contact operation under the condition that a first light spot exists in at least one infrared light spot; wherein the size of the first light spot is smaller than or equal to a first threshold value, or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays by the first object contacting the projection area, and the target object comprises the first object.
3. The method according to claim 1, wherein the identifying whether the contact of the target object to the projection area is a valid contact operation according to the size of the infrared spot comprises:
judging whether a second light spot exists in at least one infrared light spot, wherein the size of the second light spot is larger than a first threshold value and smaller than a second threshold value;
determining the number of at least one second light spot in the presence of the second light spot;
under the condition that the number meets a third preset condition, determining that the contact of the second object on the projection area is effective contact operation; wherein the second light spot is formed by reflection of the infrared ray by the second object contacting the projection area, and the target object includes the second object.
4. The method of claim 1, wherein after the determining the size of the infrared spot and identifying whether the contact of the target object to the projection area is an active contact operation according to the size of the infrared spot, the method further comprises:
and under the condition that the contact of the target object to the projection area is identified as effective contact operation, responding to the effective contact operation, and generating a touch signal corresponding to the effective contact operation.
5. The method according to claim 4, wherein in a case where it is recognized that the contact of the target object to the projection area is an effective contact operation, generating a touch signal corresponding to the effective contact operation in response to the effective contact operation comprises:
determining coordinates of the effective contact operation according to the emitted light forming the infrared light spot;
and generating a touch signal corresponding to the effective contact operation according to the coordinates.
6. The method of claim 1, wherein prior to said collecting infrared spots, the method further comprises:
and projecting the target area through the projection device to obtain the projection area, and emitting an infrared beam to the projection area through an infrared laser emitter.
7. An operation recognition apparatus characterized by comprising:
the infrared camera comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring infrared light spots through an infrared camera, the infrared light spots are formed by reflecting infrared rays through a target object in a contact projection area, and the projection area is obtained by projecting the infrared rays to the target area through a projection device;
and the identification module is used for determining the size of the infrared light spot and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot.
8. The apparatus of claim 7, wherein the identification module is further configured to:
determining that the contact of a first object on the projection area is invalid contact operation under the condition that a first light spot exists in at least one infrared light spot; wherein the size of the first light spot is smaller than or equal to a first threshold value, or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays by the first object contacting the projection area, and the target object comprises the first object.
9. A storage medium, in which a computer program is stored, wherein the computer program is arranged to perform the method of any of claims 1 to 6 when executed.
10. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method of any of claims 1 to 6 by means of the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010761832.0A CN112000241B (en) | 2020-07-31 | 2020-07-31 | Operation recognition method and device, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010761832.0A CN112000241B (en) | 2020-07-31 | 2020-07-31 | Operation recognition method and device, storage medium and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112000241A true CN112000241A (en) | 2020-11-27 |
| CN112000241B CN112000241B (en) | 2023-11-28 |
Family
ID=73462635
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010761832.0A Active CN112000241B (en) | 2020-07-31 | 2020-07-31 | Operation recognition method and device, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112000241B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113721769A (en) * | 2021-08-31 | 2021-11-30 | 歌尔科技有限公司 | Projection interference detection method, device, equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007328754A (en) * | 2006-05-12 | 2007-12-20 | Assist:Kk | Touch panel system and its operation method |
| CN102364419A (en) * | 2011-10-08 | 2012-02-29 | 广东威创视讯科技股份有限公司 | Camera type touch control method and system thereof |
| CN102622137A (en) * | 2012-02-29 | 2012-08-01 | 广东威创视讯科技股份有限公司 | Touch screen multi-point touch control method and device for front positioning of cameras |
| CN108701365A (en) * | 2017-08-29 | 2018-10-23 | 广东虚拟现实科技有限公司 | Luminous point recognition methods, device and system |
| CN110162225A (en) * | 2019-05-05 | 2019-08-23 | 青岛小鸟看看科技有限公司 | A kind of projection lamp and the touch control method for projection lamp |
| CN110213407A (en) * | 2019-05-28 | 2019-09-06 | Oppo（重庆）智能科技有限公司 | A kind of operating method of electronic device, electronic device and computer storage medium |
| CN110221732A (en) * | 2019-05-15 | 2019-09-10 | 青岛小鸟看看科技有限公司 | A kind of touch control projection system and touch action recognition methods |
| CN110308817A (en) * | 2019-06-10 | 2019-10-08 | 青岛小鸟看看科技有限公司 | A kind of touch action recognition methods and touch control projection system |
-
2020
- 2020-07-31 CN CN202010761832.0A patent/CN112000241B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007328754A (en) * | 2006-05-12 | 2007-12-20 | Assist:Kk | Touch panel system and its operation method |
| CN102364419A (en) * | 2011-10-08 | 2012-02-29 | 广东威创视讯科技股份有限公司 | Camera type touch control method and system thereof |
| CN102622137A (en) * | 2012-02-29 | 2012-08-01 | 广东威创视讯科技股份有限公司 | Touch screen multi-point touch control method and device for front positioning of cameras |
| CN108701365A (en) * | 2017-08-29 | 2018-10-23 | 广东虚拟现实科技有限公司 | Luminous point recognition methods, device and system |
| CN110162225A (en) * | 2019-05-05 | 2019-08-23 | 青岛小鸟看看科技有限公司 | A kind of projection lamp and the touch control method for projection lamp |
| CN110221732A (en) * | 2019-05-15 | 2019-09-10 | 青岛小鸟看看科技有限公司 | A kind of touch control projection system and touch action recognition methods |
| CN110213407A (en) * | 2019-05-28 | 2019-09-06 | Oppo（重庆）智能科技有限公司 | A kind of operating method of electronic device, electronic device and computer storage medium |
| CN110308817A (en) * | 2019-06-10 | 2019-10-08 | 青岛小鸟看看科技有限公司 | A kind of touch action recognition methods and touch control projection system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113721769A (en) * | 2021-08-31 | 2021-11-30 | 歌尔科技有限公司 | Projection interference detection method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112000241B (en) | 2023-11-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI772290B (en) | Stylus pen, sensor controller and electronic ruler | |
| CN110008110B (en) | User interface testing method and device | |
| CN107422915B (en) | Response control mehtod, device, storage medium and the terminal of touch screen | |
| CN109656827B (en) | Control tree generation method and terminal equipment | |
| CN110851006B (en) | Touch pen mode switching method, device and equipment and readable storage medium | |
| CN109766071B (en) | Display adjustment method and device for bar-shaped electronic shelf label | |
| US10514458B2 (en) | Detection system, detection device, and detection method | |
| CN113596832B (en) | Network connection establishment method and device, storage medium and electronic device | |
| WO2017161495A1 (en) | Stripe-set search method, device, and system | |
| JP7482706B2 (en) | Method performed by a stylus and sensor controller, stylus and sensor controller | |
| CN112000241A (en) | Operation recognition method and device, storage medium and electronic device | |
| CN110825303A (en) | Interaction method, device, terminal and computer readable medium | |
| CN105528172A (en) | Method for adjusting response area of icon, and terminal | |
| CN106249968B (en) | Scanning method and device | |
| CN106708332B (en) | threshold setting method and device of proximity sensor and terminal | |
| CN110460713B (en) | Terminal operation method and device, storage medium and electronic device | |
| CN106776092B (en) | State detection method and device of proximity sensor and terminal | |
| CN109298805A (en) | Proximity state recognition methods, device, terminal device and storage medium | |
| EP3661195A1 (en) | Information processing device, information processing system, electronic whiteboard device and control method | |
| CN112751799A (en) | Verification method and device based on picture verification code | |
| CN109190589A (en) | Fingerprint identification method, device, electronic equipment and computer storage medium | |
| KR102669446B1 (en) | Server for providing access information and method for operating thereof | |
| US20210168180A1 (en) | Information processing apparatus, information processing system, and remote sharing method | |
| KR102072391B1 (en) | Object recongnition method and system using touch screen | |
| JP2021061061A (en) | Stylus, control method performed by stylus, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |