CN106610757A - Projection touch method, device and equipment - Google Patents

Projection touch method, device and equipment Download PDF

Info

Publication number
CN106610757A
CN106610757A CN201610741260.3A CN201610741260A CN106610757A CN 106610757 A CN106610757 A CN 106610757A CN 201610741260 A CN201610741260 A CN 201610741260A CN 106610757 A CN106610757 A CN 106610757A
Authority
CN
China
Prior art keywords
intensity
touch
reflected light
determined
control object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610741260.3A
Other languages
Chinese (zh)
Other versions
CN106610757B (en
Inventor
姜訢
曹腾
黄永顺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Asu Tech Co Ltd
Original Assignee
Beijing Asu Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Asu Tech Co Ltd filed Critical Beijing Asu Tech Co Ltd
Priority to CN201610741260.3A priority Critical patent/CN106610757B/en
Publication of CN106610757A publication Critical patent/CN106610757A/en
Priority to PCT/CN2017/085550 priority patent/WO2018036229A1/en
Application granted granted Critical
Publication of CN106610757B publication Critical patent/CN106610757B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

The embodiment of the invention discloses a projection touch method, device and equipment. The method comprises the following steps: receiving reflected light of invisible laser, determining the intensity of the reflected light, receiving a reflection signal of a ultrasonic pulse signal, and determining the intensity of the reflection signal; determining a touch position coordinate of a touch object when the intensity of the reflected light is changed, acquiring a touch track formed by the determined touch position coordinate within a target time period, and determining the distance between the touch object and a projection region according to the time for emitting the ultrasonic pulse signal, the time sequence and intensity for receiving the reflection signal of the ultrasonic pulse signal, judging whether the distance is less than a preset threshold value, and responding to a touch action corresponding to the touch track if the distance is less than the preset threshold value. Visibly, the touch position coordinate is determined by use of the intensity of the reflected light, and the distance between the touch object and the projection region is determined through the ultrasonic pulse signal, so that the touch action can be quickly and precisely determined, and the accuracy of the projection touch is greatly improved.

Description

One kind projection touch control method, device and equipment
Technical field
The present invention relates to projection art, more particularly to a kind of projection touch control method, device and equipment.
Background technology
At present, projector equipment is widely used in the places such as work, study and amusement.Projector equipment when in use typically with electricity The electronic equipments such as brain, mobile phone connect, and user can only control cutting for projected picture content by the mouse of electronic equipment, keyboard etc. Change, in projection process, user needs to frequently click on mouse or keyboard to complete the manipulation to projected picture content, it is clear that This man-machine interaction mode is very troublesome, and Consumer's Experience is not good.
The appearance of the portable translucent equipment with Touch screen effectively improves what above-mentioned man-machine interaction mode was present Problem, user directly can manipulate in the Touch screen of projector equipment to projected picture content, its control method with it is right The control method of the Touch screen of the electronic equipments such as the mobile phone with Touch screen, panel computer is similar to, and can be clicked on, be slided It is dynamic to wait operation.But, because Touch screen is typically small, projection is controlled by the mode of operation of click or slip Touch screen Image content, is easy to deviation occur in selection interface content, and Consumer's Experience is still bad.
In recent years, the research to (projection touch-control) is directly manipulated to project content on projected picture has been obtained necessarily Although achievement, this projection touch control manner improves Consumer's Experience, but it recognizes use typically by way of photographic head shooting The click at family or slide, it is impossible to accurately carry out projection touch-control, and the power consumption of photographic head is very big.
The content of the invention
The embodiment of the invention discloses a kind of projection touch control method, device and equipment, to solve existing projection touch technology Middle projection touch-control accuracy is low, the big problem of power consumption.Technical scheme is as follows:
In a first aspect, embodiments providing a kind of projection touch control method, scan-type projector equipment is applied to, it is described Scan-type projector equipment projects invisible laser and launches ultrasonic pulse signal to view field, wherein, it is described invisible sharp The invisible laser region that light is formed covers the view field, and methods described includes:
The reflected light of the invisible laser is received, the intensity of the reflected light is determined, and receives the ultrasonic pulse The reflected signal of signal, determines the intensity of the reflected signal;
When the intensity of the reflected light changes, according to the intensity of the reflected light before and after changing, it is determined that touching The position of touch coordinate of control thing;
In target time section, the touch trajectory that position of touch coordinate determined by acquisition is formed, and according to transmitting ultrasound Time of wave pulse signal, receive the ultrasonic pulse signal reflected signal time serieses and intensity, determine described touching The distance between control thing and described view field, wherein, the target time section is:Start preset duration forward from current time Time period;
Judge the distance whether less than default threshold value;
If it is, responding the corresponding touch of the touch trajectory.
Optionally, the intensity of the reflected light, determines the position of touch coordinate of touch control object before and after the basis changes, Including:
Intensity of reflected light frame before changing is determined according to the intensity of the reflected light before changing, according to The intensity of the reflected light determines the intensity of reflected light frame after changing after changing;
By the intensity of reflected light information after the intensity of reflected light frame before described changing and described changing Image carries out difference processing, obtains the intensity of reflected light frame of touch control object;
The intensity of reflected light frame of the touch control object is detected by sophisticated detection algorithm, determines the touch-control The position of touch coordinate of thing.
Optionally, it is described in target time section, the touch trajectory that position of touch coordinate determined by acquisition is formed, bag Include:
The position of touch coordinate according to determined by target time section, obtains mobile route and the movement side of the touch control object To;
According to the mobile route and the moving direction, touch trajectory is determined.
Optionally, time, the reflection of the reception ultrasonic pulse signal according to transmitting ultrasonic pulse signal The time serieses and intensity of signal, determine the distance between the touch control object and described view field, including:
The spread speed of current period ultrasonic pulse signal is determined according to current operating temperature;
According to the intensity of the reflected signal of the ultrasonic pulse signal, the throwing is determined by ultrasonic echo Processing Algorithm The surface reflected signal of shadow zone field surface;
According to launching the time of the ultrasonic pulse signal, receiving the time serieses of the surface reflected signal, calculate Second propagation time sequence of the ultrasound wave;
According to the second propagation time sequence and the spread speed, the second depth of view information of the view field is determined Image;
The first depth of view information image and the second depth of view information image of the view field that a upper cycle is determined Difference processing is carried out, the 3rd depth of view information image is obtained;
The 3rd depth of view information image is detected by sophisticated detection algorithm, determines the touch control object with the throwing The distance between shadow zone domain.
Optionally, the invisible laser is iraser.
Second aspect, the embodiment of the present invention additionally provides a kind of projection contactor control device, is applied to scan-type projector equipment, institute State scan-type projector equipment to project invisible laser and launch ultrasonic pulse signal to view field, wherein, it is described invisible The invisible laser region that laser is formed covers the view field, and described device includes:
Receiver module, for receiving the reflected light of the invisible laser, determines the intensity of the reflected light, and receives institute The reflected signal of ultrasonic pulse signal is stated, the intensity of the reflected signal is determined;
First determining module, for when the intensity of the reflected light changes, according to described anti-before and after changing The intensity of light is penetrated, the position of touch coordinate of touch control object is determined;
Second determining module, in target time section, the touch-control rail that position of touch coordinate determined by acquisition is formed Mark, wherein, the target time section is:Start the time period of preset duration forward from current time;
3rd determining module, for according to time, the reception institute for launching ultrasonic pulse signal in the target time section The time serieses and intensity of the reflected signal of ultrasonic pulse signal are stated, is determined between the touch control object and the view field Distance;
Judge module, for judging the distance whether less than default threshold value;
Respond module, moves for responding the corresponding touch-control of the touch trajectory when the distance is less than default threshold value Make.
Optionally, first determining module includes:
First strength information image determination unit, for determining occur according to the intensity of the reflected light before changing Intensity of reflected light frame before change, the reflection after changing is determined according to the intensity of the reflected light after changing Intensity information image;
Second strength information image determination unit, for by the intensity of reflected light frame before described changing and institute Stating the intensity of reflected light frame after changing carries out difference processing, obtains the intensity of reflected light frame of touch control object;
Position of touch coordinate determining unit, for the intensity of reflected light information by sophisticated detection algorithm to the touch control object Image detected, determines the position of touch coordinate of the touch control object.
Optionally, second determining module includes:
Path and direction-determining unit, for the position of touch coordinate according to determined by target time section, obtain described The mobile route and moving direction of touch control object;
Touch trajectory determining unit, for according to the mobile route and the moving direction, determining touch trajectory.
Optionally, the 3rd determining module includes:
Spread speed determining unit, for determining the propagation of current period ultrasonic pulse signal according to current operating temperature Speed;
Reflected signal determining unit, for according to the intensity of the reflected signal of the ultrasonic pulse signal, by ultrasound Echo Processing algorithm determines the surface reflected signal on the view field surface;
Propagation time determining unit, for anti-according to the time of the transmitting ultrasonic pulse signal, the reception surface The time serieses of signal are penetrated, the second propagation time sequence of the ultrasound wave is calculated;
Depth of view information determining unit, for according to the second propagation time sequence and the spread speed, it is determined that described Second depth of view information image of view field;
Difference processing unit, for the first depth of view information image of the view field for determining a upper cycle with it is described Second depth of view information image carries out difference processing, obtains the 3rd depth of view information image;
Distance determining unit, for being detected to the 3rd depth of view information image by sophisticated detection algorithm, it is determined that The distance between the touch control object and described view field.
Optionally, the invisible laser is iraser.
The third aspect, the embodiment of the present invention additionally provides a kind of projection touch control device, including:Laser projection device, ultrasound Wave pulse signal discharger, reflection laser reception device, reflectance ultrasound wave pulse signal reception device and data processing equipment; Wherein,
The laser projection device, for projecting visible laser to view field with scan mode projected picture is formed, and Invisible laser is projected with scan mode and forms invisible laser region to the view field, wherein, the invisible laser View field described in region overlay;
The ultrasonic pulse signal discharger, for launching ultrasonic pulse signal to the view field;
The reflection laser reception device, for receiving the reflected light of the invisible laser, determines the reflected light Intensity, and the intensity of the reflected light is sent to the data processing equipment;
The reflectance ultrasound wave pulse signal reception device, for receiving the reflected signal of the ultrasonic pulse signal, Determine the intensity of the reflected signal, and obtain the time for launching the ultrasonic pulse signal and receive the reflected signal Time serieses, and the intensity of the time serieses for being obtained and the reflected signal is sent to the data processing equipment;
The data processing equipment, for receiving the intensity of reflected light that the reflection laser reception device sends, connects The time serieses of the reflectance ultrasound wave pulse signal reception device transmission and the intensity of reflected signal are received, when the reflection When the intensity of light changes, according to the intensity of the reflected light before and after changing, the position of touch coordinate of touch control object is determined, The touch trajectory that position of touch coordinate determined by target time section is formed is obtained, and is launched according in the target time section Time of ultrasonic signal, the time serieses and intensity that receive reflected signal, determine the touch control object and the view field it Between distance, and the distance is judged whether less than default threshold value, if it is, responding the corresponding touch-control of the touch trajectory Action, wherein, the target time section is:Start the time period of preset duration forward from current time.
Optionally, the data processing equipment, determines specifically for the intensity according to the reflected light before changing Intensity of reflected light frame before changing, determines after changing according to the intensity of the reflected light after changing Intensity of reflected light frame;By the reflection after the intensity of reflected light frame before described changing and described changing Intensity information image carries out difference processing, obtains the intensity of reflected light frame of touch control object;By sophisticated detection algorithm pair The intensity of reflected light frame of the touch control object detected, determines the position of touch coordinate of the touch control object.
Optionally, the data processing equipment, specifically for the position of touch coordinate according to determined by target time section, Obtain the mobile route and moving direction of the touch control object;According to the mobile route and the moving direction, touch-control rail is determined Mark.
Optionally, the projection touch control device also includes:Temperature sensor;The temperature sensor, it is current for measuring Operating temperature, and the current operating temperature is sent to the data processing equipment;
The data processing equipment, specifically for receiving the current operating temperature that the temperature sensor sends, and The spread speed of ultrasonic pulse signal according to the current operating temperature determines current period;According to the ultrasound wave arteries and veins The intensity of the reflected signal of signal is rushed, the surface reflection letter on the view field surface is determined by ultrasonic echo Processing Algorithm Number;According to launch in the target time section ultrasonic pulse signal time, receive the surface reflected signal when Between sequence, calculate the ultrasound wave for the one the second propagation time sequences of the view field and for the touch control object The second propagation time;According to first propagation time and the spread speed, first depth of field of the view field is determined Frame,;And according to the second propagation time sequence and the spread speed, determine the of view field's touch control object Two depth of view information images;The first depth of view information image and second scape of the view field that a upper cycle is determined Deep frame carries out difference processing, obtains the 3rd depth of view information image;The 3rd depth of field is believed by sophisticated detection algorithm Breath image detected, determines the distance between the touch control object and described view field.
Optionally, the invisible laser is iraser.
In scheme provided in an embodiment of the present invention, the reflected light of invisible laser is received first, determine the intensity of reflected light, And the reflected signal of ultrasonic pulse signal is received, when the intensity of reflected light changes, according to reflection before and after changing The intensity of light, determines the position of touch coordinate of touch control object, then obtains position of touch coordinate shape determined by target time section Into touch trajectory, and determine the distance between touch control object and described view field, finally judge the distance whether less than default Threshold value, if it is, responding the corresponding touch of the touch trajectory.It can be seen that, because the intensity using reflected light determines The position of touch coordinate of touch control object, determines the distance of touch control object and view field, it is not necessary to image by ultrasonic pulse signal Head shoots, and can quickly and accurately determine touch, while the power consumption of projector equipment is effectively reduced, even if in projected area Accurate touch-control can also be carried out during only 10 centimetres of domain and projector equipment distance, the accuracy of projection touch-control is substantially increased.
Description of the drawings
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing The accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with Other accompanying drawings are obtained according to these accompanying drawings.
The flow chart of the first projection touch control method that Fig. 1 is provided by the embodiment of the present invention;
A kind of schematic diagram of projection contactor control device that Fig. 2 is provided by the embodiment of the present invention;
A kind of schematic diagram of projection touch control device that Fig. 3 is provided by the embodiment of the present invention;
The difference image schematic diagram that Fig. 4 is provided by the embodiment of the present invention;
The projection touch-control schematic diagram that Fig. 5 is provided by the embodiment of the present invention;
The depth image schematic diagram that Fig. 6 is provided by the embodiment of the present invention;
The touch schematic diagram that Fig. 7 is provided by the embodiment of the present invention;
The touch trajectory schematic diagram that Fig. 8 is provided by the embodiment of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than the embodiment of whole.It is based on Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made Embodiment, belongs to the scope of protection of the invention.
In order to improve the accuracy of projection touch-control, the power consumption of projector equipment is reduced, embodiments provide one kind Projection touch control method, device and equipment.
A kind of projection touch control method for being provided the embodiment of the present invention first below is introduced.
Firstly the need of explanation, a kind of projection touch control method that the present invention is provided is applied to scan-type projector equipment, should Scan-type projector equipment forms projected picture in a physical plane with scan mode projection visible laser, that is, define projected area Domain, when projecting invisible laser to the view field with scan mode, the physical plane defines invisible laser region again, its In, the invisible laser region that the invisible laser is formed covers the view field.For the visible laser and invisible laser, By the method for optical design by they and beam so that each pixel in the projected picture that view field shows, except tool Have outside visible laser element, be also superimposed an invisible laser element, that is to say, that each the pixel bag in projected picture Containing two parts of visible laser and invisible laser.The visible laser can be the visible laser of tri- kinds of colors of R, G, B, it is also possible to It is the visible laser of any one color, here is not specifically limited.
As shown in figure 1, a kind of projection touch control method, comprises the following steps:
S101, receives the reflected light of the invisible laser, determines the intensity of the reflected light, and receives the ultrasound wave The reflected signal of pulse signal, determines the intensity of the reflected signal;
When the invisible laser of projection reaches the physical plane and then reflected by the physical plane, being formed this can not See the reflected light of laser.Scan-type projector equipment is received after the reflected light of the invisible laser, just can determine the reflected light Intensity.Because each pixel in projected picture includes two parts of visible laser and invisible laser, so each pixel Corresponding reflected light corresponds to the visible laser that the pixel is included, that is to say, that the reflected light is and includes visible laser Pixel it is one-to-one.Wherein, the invisible laser is preferably iraser.
It should be noted that the reflected light is the invisible laser that whole view field is reflected on the physical plane, and It is not the reflected light of a certain position.Explanation is needed further exist for, determining the mode of the intensity of the reflected light can adopt existing Any-mode, here is not specifically limited.
In the same manner, ultrasonic pulse signal is launched to the view field, when the ultrasonic pulse signal runs into the entity Reflected signal will be formed after plane, scan-type projector equipment just can receive the reflected signal, and then just can determine this The intensity of reflected signal.It should be noted that the reflected signal is all reflected signals of the ultrasonic pulse signal, for example, When view field is human body the back of the hand, can reflect when the ultrasonic pulse signal runs into dorsal surface skin, can also pass through skin, Running into blood vessel of human body etc. also can reflect, so in order to result of calculation is more accurate, needing to receive the ultrasonic pulse letter Number all reflected signals.It is of course also possible to a rational reception time is set according to experiment experience, more than the reception time Reflected signal just no longer received.
S102, when the intensity of the reflected light changes, according to the intensity of the reflected light before and after changing, really Determine the position of touch coordinate of touch control object;
When the intensity of the reflected light changes, explanation may have touch control object to enter view field.Due to touch control object with The distance of scan-type projector equipment is typically near than the distance of view field and the distance of scan-type projector equipment, so projecting tactile The reflected light of the invisible laser on control thing can be more higher than projecting the reflected light of the invisible laser of view field.
According to the intensity of before and after reflected light that changes, determine that the concrete mode of the position of touch coordinate of touch control object can be with For:
Intensity of reflected light frame before changing, root are determined according to the intensity of the reflected light before changing The intensity of reflected light frame after changing is determined according to the intensity of the reflected light after changing;
By the intensity of reflected light information after the intensity of reflected light frame before described changing and described changing Image carries out difference processing, obtains the intensity of reflected light frame of touch control object;
The intensity of reflected light frame of the touch control object is detected by sophisticated detection algorithm, determines the touch-control The position of touch coordinate of thing.
Specifically, the reflected light before changing can respectively be determined according to the intensity of the reflected light before and after changing Strength information image and the intensity of reflected light frame after changing, due to projecting the invisible laser on touch control object Reflected light is than projecting the reflective light intensity of the invisible laser of view field, so the intensity of reflected light letter before and after to changing Breath image carries out difference processing, just can obtain the intensity of reflected light frame of touch control object.The difference processing is will be occurred Intensity of reflected light frame before and after change, for example can be using difference processings such as inter-frame difference algorithm, background difference algorithms Algorithm.If as shown in figure 4, the touch control object is finger, by difference processing, be just likely to be obtained several typical tactile in Fig. 4 The intensity of reflected light frame of control thing.
It should be noted that the intensity of reflected light frame of several touch control objects shown in Fig. 4 is may in the present invention The intensity of reflected light frame of the several frequently seen touch control object for obtaining, is not available all touch control objects in the present invention Intensity of reflected light frame.
Because each pixel in projected picture includes two parts of visible laser and invisible laser, the touch control object is obtained Intensity of reflected light frame after, the region in the projected picture that the touch control object is sheltered from just can be obtained, due to general Touch control object (such as finger, pointer etc.) in touch-control is operated using tip, it is possible to calculated by tip detection The method of the simple image procossing such as method easily finds the sophisticated position of touch of common strip or bar-shaped touch control object Coordinate.
As shown in figure 5, it is x/y plane to define view field place physical plane, then just can determine by said method Go out sophisticated position of touch coordinate (x, y) of touch control object (finger)., wherein it is desired to explanation, the direction that coordinate z-axis is represented is View field place physical plane and the direction of scan-type projector equipment line, the direction of the reflected light of as invisible laser. The determination method of coordinate z will the explanation in subsequent step.
It should be noted that the position of touch coordinate can also be the coordinate in the intensity of reflected light frame, by Coordinate in the intensity of reflected light frame is one-to-one with the coordinate in view field, as long as so determining this Coordinate in intensity of reflected light frame, has also determined that the position of the touch control object correspondence in view field.
Explanation is needed further exist for, above-mentioned image difference algorithm and sophisticated detection algorithm are image commonly used in the art Processing method, here is not illustrated.
S103, in target time section, the touch trajectory that position of touch coordinate determined by acquisition is formed, and according to transmitting Time of ultrasonic pulse signal, receive the ultrasonic pulse signal reflected signal time serieses and intensity, determine institute State the distance between touch control object and described view field;
Wherein, the target time section is to start time period of preset duration forward from current time.The target time section one As can be set according to actual needs, for example, it can be set to be 150 milliseconds, 200 milliseconds etc., here is not specifically limited.
Because in actual applications, touch control object is often relatively near with the distance between view field, is particularly closely throwing During shadow, such as when the wrist projector equipment shown in Fig. 5 is projected on the back of the hand, the distance between view field and view field are only More than ten centimetres, the distance between touch control object and view field by photographic head then closer to other existing modes such as shooting and can not Accurately determine the distance between the touch control object and view field.Because ultrasonic pulse signal can carry out in-plant survey Away from, so in order to the distance between the touch control object and view field is determined more accurately, can be by launching ultrasonic pulse Time of signal and time of reflected signal is received, determine the distance between the touch control object and described view field.
Specifically, determining the mode of the touch trajectory can include:
The position of touch coordinate according to determined by target time section, obtains mobile route and the movement side of the touch control object To;
According to the mobile route and the moving direction, touch trajectory is determined.
Specifically, in target time section, it may be determined that several position of touch coordinate (x, y), by these touch-control positions Putting coordinate (x, y) can obtain the mobile route and moving direction of the touch control object.It is understood that each two adjacent moment pair The position of touch coordinate answered can determine mobile route of the touch control object within two adjacent moments corresponding time period and Moving direction, and then just can determine according to the mobile route and moving direction at all moment determined in the target time section Go out a touch trajectory in x/y plane.
Further, it is determined that while the touch trajectory, because scan-type projector equipment is in real-time reception ultrasound wave arteries and veins Rush the reflected signal of signal, it is possible to according to transmitting ultrasonic pulse signal time and receive the ultrasonic pulse signal The time serieses and intensity of reflected signal, determine the distance between the touch control object and view field.Wherein it is determined that the touch control object with The determination mode of the distance between view field may comprise steps of:
The spread speed of current period ultrasonic pulse signal is determined according to current operating temperature;
According to the intensity of the reflected signal of the ultrasonic pulse signal, the throwing is determined by ultrasonic echo Processing Algorithm The surface reflected signal of shadow zone field surface;
According to launching the time of the ultrasonic pulse signal, receiving the time serieses of the surface reflected signal, calculate Second propagation time sequence of the ultrasound wave;
According to the second propagation time sequence and the spread speed, the second depth of view information of the view field is determined Image;
The first depth of view information image and the second depth of view information image of the view field that a upper cycle is determined Difference processing is carried out, the 3rd depth of view information image is obtained;
The 3rd depth of view information image is detected by sophisticated detection algorithm, determines the touch control object with the throwing The distance between shadow zone domain.
Because the spread speed of ultrasonic pulse signal can be affected by temperature, so in order to ensure the accurate of data Property, the spread speed of current period ultrasonic pulse signal can be determined according to current operating temperature first.It should be noted that The spread speed of ultrasonic pulse signal is common knowledge with the corresponding relation of temperature, and here is not illustrated.
Further, because the distance between the touch control object and scan-type projector equipment and view field project with scan-type The distance between equipment is different, so the two reflection moment to the ultrasonic pulse signal is also different, and then is received The time of the reflected signal of the two is also different.It should be noted that between the described touch control object and scan-type projector equipment Distance and the distance between view field and scan-type projector equipment refer to launching position by ultrasonic pulse signal With the distance on straight line determined by touch control object, the distance in as Fig. 5 along the z-axis direction, rather than view field's place plane Normal direction distance.
Because the surface and inside of view field can be reflected ultrasonic pulse signal, so the reflection for receiving Signal includes the reflected signal of view field surface and internal reflection.Obviously, the reflected signal of view field's internal reflection is simultaneously Can not be used for calculating the distance between touch control object and view field, for example, when view field is human body the back of the hand, the ultrasound wave arteries and veins Rushing when signal runs into dorsal surface skin to reflect, and can also pass through skin, and running into blood vessel of human body etc. also can reflect, and people The reflected signal of the blood vessel of body can not be used for calculating the distance between touch control object and view field, it is therefore desirable to super according to this The intensity of the reflected signal of sound wave pulse signal, by ultrasonic echo Processing Algorithm the surface reflection letter on view field surface is determined Number.
If it should be noted that there is touch control object in current period view field, then by the strong of surface reflected signal Degree still can determine the reflected signal on touch control object surface, and for example, touch control object is finger, then by ultrasonic echo Processing Algorithm Just can determine the reflected signal of finger surface.Now, it is determined that the surface reflected signal on view field surface be touch control object The surface reflected signal of the view field that the reflected signal on surface and removing are blocked by touch control object.
Which is determined in the reflected signal that current period is received is after the reflected signal of surface, just can should according to transmitting The time of ultrasonic pulse signal, the time serieses for receiving the surface reflected signal, calculate the second propagation time of the ultrasound wave Sequence.
It should be noted that the second propagation time sequence is not some point corresponding time in view field, and Be the whole view field of current period it is corresponding transmitting ultrasonic pulse signal time and receiving surface reflected signal when Between time difference, because surface reflected signal is the surface reflected signal of whole view field, and view field is probably inclined-plane, It is also likely to be rough surface, so the time for receiving the surface reflected signal is different, it is a series of different Time, that is, above-mentioned time serieses.
After calculating the second propagation time sequence of current period ultrasound wave, it is possible to according to flight time algorithm (Time Of Flight, TOF) and ultrasound imaging techniques determine the second depth of view information image of view field.
Specifically, computing formula can be:d2=v2t2/ 2, wherein, v2For the corresponding current period ultrasound wave of Current Temperatures The spread speed of pulse signal, t2For the second propagation time sequence.It is understood that due to t2It is a series of different times, So calculated second depth of view information d2Also a series of different depth of field value information of whole view field is corresponded to.
Calculate for convenience and subsequent step carrying out, it is possible to use ultrasound imaging techniques are according to second depth of field letter Breath draws the second depth of view information image, such as in Fig. 5 shown in (2), in figure color more deeply feel it is bright with scan-type projector equipment away from Close to more, it can be seen that the first depth of view information image is to project to corresponding depth of view information image on an inclined-plane, The second depth of view information image that such as wrist projection back in one's hands is obtained.As can be seen that the second depth of view information figure There is the depth of view information of obvious touch control object in right side as in, because the distance of touch control object and scan-type projector equipment is relative to projection The distance of region and scan-type projector equipment is closer to so the color in region is more in the corresponding second depth of view information image of touch control object It is deep.It is emphasized that the first depth of view information image in Fig. 5 shown in (2) is a kind of possible situation that the present invention is provided, The restriction to the second depth of view information image provided by the present invention can not be constituted.
In the same manner, the first depth of view information image of the view field in a upper cycle can be determined according to aforesaid way, specifically Computing formula can be:d1=v1t1/ 2, wherein, v1For the spread speed of upper cycle ultrasonic pulse signal, t1For upper one week Phase launches time, the seasonal effect in time series time difference of receiving surface reflected signal, i.e. the first propagation time of ultrasonic pulse signal Sequence.It is understood that due to t1It it is also a series of different times, so calculated first depth of view information d1It is also Corresponding to a series of different depth of field value information of whole view field.First depth of field can determine according to first depth of view information Frame, due to concrete determination mode it is identical with the determination mode of the second depth of view information image, so here is no longer gone to live in the household of one's in-laws on getting married State.
For example, the first depth of view information image in Fig. 5 shown in (1), can go out from figure, the first depth of view information image It is corresponding with (2) in Fig. 5, when not having touch control object, projects to corresponding depth of view information image on an inclined-plane, such as wrist is thrown Shadow equipment projects to what is obtained on the back of the hand.It is emphasized that the first depth of view information image in Fig. 5 shown in (1) is this A kind of possible situation of bright offer, can not constitute the restriction to the first depth of view information image provided by the present invention.
After obtaining above-mentioned first depth of view information image and the second depth of view information image, the two is subtracted each other and pass through difference processing Algorithm just can obtain touch control object the 3rd depth of view information image corresponding with the distance between view field.
Specifically, if the depth of view information in the 3rd depth of view information image for obtaining is 0, illustrate in current period without touch-control Thing enters view field, then continue to the reflected signal in next cycle, repeats said process.If by the two by poor With the presence of the depth of view information of touch control object in the 3rd depth of view information image that office reason is obtained, then the distance for obtaining is whole touch-control The distance between thing and view field, rather than the distance between certain point and view field on touch control object, due to general touch-control Thing (such as finger, pointer etc.) in touch-control is operated using tip, so now can be calculated by tip detection Method detects the sophisticated neighbouring position of touch control object from the 3rd depth of view information image, so as to obtain the sophisticated neighbouring position of touch control object The distance between with view field.
It should be noted that due to touch control object sophisticated neighbouring position and view field between there may be multiple distances, And the plurality of distance may be unequal, it is possible to according to actual projection situation and control mode by minima in the distance or The meansigma methodss of all distances between the tip location and view field of maximum or the touch control object for obtaining are used as touch control object and throwing The distance between shadow zone domain, here is not specifically limited.It is understood that determining after the distance, also determine that in Fig. 5 The coordinate z of touch control object.
Explanation is needed further exist for, in target time section, there may be corresponding 3rd depth of view information figure of multiple cycles All there is the depth of view information of touch control object as in, then between the touch control object that can be obtained the plurality of cycle and view field away from From meansigma methodss or minima or maximum etc. as the distance between final touch control object and view field, here is not done specifically Limit.
Whether S104, judge the distance less than default threshold value, if it is, execution step S105;
In order to avoid user misoperation has undesirable effect to the accuracy for projecting touch-control, touch control object and projected area are calculated Behind the distance between domain, the distance can be compared with the default threshold value whether effectively to judge touch, in root Touch control operation is carried out according to comparative result.
Wherein, the default threshold value can be set according to practical operation needs and user's custom, due to general touch-control Thing is in itself with certain thickness, it is possible to further set according to the touch control object for being used, and for example, can be arranged For 1 centimetre, 1.5 centimetres etc., here is not specifically limited.Different touch trajectories can certainly be directed to and set different thresholds Value, to reach the purpose of more accurate touch-control.
S105, responds the corresponding touch of the touch trajectory.
When judging that the distance is less than the default threshold value, illustrate that the corresponding touch of the touch trajectory is effective , then just can respond the touch.The touch may to click on, sliding, it is long press and double-click etc. touch, Here is not specifically limited.
And when judging that the distance is not less than the default threshold value, illustrate that the corresponding touch of the touch trajectory is invalid , it is likely to the maloperation of user, then just do not carry out any operation, proceed step S101.
For example, as shown in fig. 7, in figure 701 be wrist projector equipment, 702 for projection visible laser and it is invisible swash The device of light, 703 are reflection optical pickup apparatus, and 704 is touch control object (finger), and 706 is that ultrasonic pulse signal is launched and received Device.As can be seen that touch control object is different from the distance of view field in (1) and (2) in Fig. 7, and in (1), the point of touch control object 704 End is that finger tip is close with the distance between view field, by calculating as 0.8 centimetre.And in (2), touch control object 704 Tip be finger tip with the distance between view field farther out, by calculating as 2.5 centimetres, if default threshold value is 1 centimetre, because 0.8 centimetre less than 1 centimetre, and 2.5 centimetres are more than 1 centimetre, so the corresponding touch-control of touch control object 704 is moved in (1) As effective action, the touch is responded, and the corresponding touch of touch control object 704 is invalid action in (2), does not carry out appointing What is operated.Obviously, the habitual movement clicked on according to finger, the position in (2) in the actual click of touch control object 704 to view field should This is the dash area in figure on the back of the hand, if not to the distance between the tip of touch control object 704 and view field and default Threshold value is judged, it is believed that it is effective action, directly by the position of touch coordinate of touch control object 704 in (2) as click action Position, carry out click action, then the touch of execution mistake.
It can be seen that, in this programme, the reflected light of invisible laser is received first, determine the intensity of reflected light, and receive ultrasound The reflected signal of wave pulse signal, when the intensity of reflected light changes, according to the intensity of before and after reflected light that changes, really Determine the position of touch coordinate of touch control object, then obtain the touch-control rail that position of touch coordinate determined by target time section is formed Mark, and determine the distance between touch control object and described view field, whether the distance is finally judged less than default threshold value, if It is then to respond the corresponding touch of the touch trajectory.It can be seen that, the touch-control due to determining touch control object using the intensity of reflected light Position coordinateses, by ultrasonic pulse signal the distance of touch control object and view field is determined, it is not necessary to which photographic head shoots, can be fast Speed is accurately determined touch, while the power consumption of projector equipment is effectively reduced, even if in view field and projector equipment Distance only 10 centimetres when can also carry out accurate touch-control, substantially increase projection touch-control accuracy.
Below by taking click touch and sliding touch action as an example, to a kind of projection touch-control side provided by the present invention Method is described in detail.
Embodiment 1
One kind projection touch control method, is applied to scan-type projector equipment, may comprise steps of:
The reflected light of the invisible laser is received, the intensity of the reflected light is determined, and receives the ultrasonic pulse The reflected signal of signal;
When the intensity of the reflected light changes, according to the intensity of the reflected light before and after changing, it is determined that touching The position of touch coordinate of control thing;
The touch trajectory that position of touch coordinate determined by target time section is formed is obtained, and according to the object time The time of transmitting ultrasonic pulse signal, the time of reception reflected signal, determine the touch control object with the view field in section The distance between;
Specifically, in the target time section determined by the touch trajectory that formed of position of touch coordinate be a point, such as Fig. 8 (1) shown in.
Further, determine that the tip location of the touch control object is the touch control object with the minima of the distance between view field The distance between with the view field.
Judge the distance whether less than default threshold value;
If it is, responding the click touch.
Embodiment 2
It is with the difference of embodiment 1:
The touch trajectory that position of touch coordinate determined by the target time section is formed is one in setting regions Shown in straight line, such as Fig. 8 (2), the setting regions can be set according to user operation habits, for example, can be for 10 pixels The border circular areas of diameter, or the square area that the length of side is 15 pixels etc., here is not specifically limited.
Further, determine that the tip location of the touch control object is the touch control object with the meansigma methodss of the distance between view field The distance between with the view field.
Embodiment 3
It is with the difference of embodiment 1:
The touch trajectory that position of touch coordinate determined by the target time section is formed is one in setting regions Shown in curve, such as Fig. 8 (3), the setting regions can be set according to user operation habits, for example, can be for 10 pixels Border circular areas of diameter etc., or the square area that the length of side is 15 pixels, here is not specifically limited.
Further, determine that the tip location of the touch control object is the touch control object with the maximum of the distance between view field The distance between with the view field.
Embodiment 4
One kind projection touch control method, is applied to scan-type projector equipment, may comprise steps of:
The reflected light of the invisible laser is received, the intensity of the reflected light is determined, and receives the ultrasonic pulse The reflected signal of signal;
When the intensity of the reflected light changes, according to the intensity of the reflected light before and after changing, it is determined that touching The position of touch coordinate of control thing;
The touch trajectory that position of touch coordinate determined by target time section is formed is obtained, and according to the object time The time of transmitting ultrasonic pulse signal, the time of reception reflected signal, determine the touch control object with the view field in section The distance between;
Specifically, in the target time section determined by the touch trajectory that formed of position of touch coordinate be straight line, such as Shown in Fig. 8 (4).And the scope of y values is less than preset value in the position of touch coordinate shape on the straight line, it should be noted that should Preset value can be set according to user operation habits, for example, can be 100 pixels, 150 pixels etc., and here is not done to be had Body is limited.
Further, determine that the tip location of the touch control object is the touch control object with the minima of the distance between view field The distance between with the view field.
Judge the distance whether less than default threshold value;
If it is, responding the sliding touch action.
Wherein, the line direction using the position coordinateses of the starting point of the touch trajectory and the position coordinateses of terminating point is used as this The glide direction of sliding touch action.
Embodiment 5
It is with the difference of embodiment 4:
The touch trajectory that position of touch coordinate determined by the target time section is formed is a broken line, such as Fig. 8 (5) institute Show.And the scope of y values is less than preset value in the position of touch coordinate shape on the broken line, it should be noted that the preset value can To be set according to user operation habits, for example, can be 100 pixels, 150 pixels etc., here is not specifically limited.
Further, determine that the tip location of the touch control object is the touch control object with the maximum of the distance between view field The distance between with the view field.
Embodiment 6
It is with the difference of embodiment 4:
The touch trajectory that position of touch coordinate determined by the target time section is formed is a curve, such as Fig. 8 (6) institute Show.And the scope of y values is less than preset value in the position of touch coordinate shape on the curve, it should be noted that the preset value can To be set according to user operation habits, for example, can be 100 pixels, 150 pixels etc., here is not specifically limited.
Further, determine that the tip location of the touch control object is the touch control object with the meansigma methodss of the distance between view field The distance between with the view field.
Corresponding to said method embodiment, the embodiment of the present invention additionally provides projection contactor control device, below to of the invention real Apply example a kind of projection contactor control device is provided and be introduced.
Firstly the need of explanation, a kind of projection contactor control device that the present invention is provided is applied to scan-type projector equipment, should Scan-type projector equipment projects invisible laser and launches ultrasonic pulse signal to view field, wherein, the invisible laser The invisible laser region for being formed covers view field.
As shown in Fig. 2 a kind of projection contactor control device, is applied to scan-type projector equipment, can include:
Receiver module 210, for receiving the reflected light of the invisible laser, determines the intensity of the reflected light, and connects The reflected signal of the ultrasonic pulse signal is received, the intensity of the reflected signal is determined;
First determining module 220, for when the intensity of the reflected light changes, described in before and after change The intensity of reflected light, determines the position of touch coordinate of touch control object;
Second determining module 230, in target time section, the touch-control that position of touch coordinate determined by acquisition is formed Track;
Wherein, the target time section is:Start the time period of preset duration forward from current time.
Second determining module 240, for according to time, the reception for launching ultrasonic pulse signal in the target time section The time serieses and intensity of the reflected signal of the ultrasonic pulse signal, determine between the touch control object and the view field Distance;
Judge module 250, for judging the distance whether less than default threshold value;
Respond module 260, for responding the corresponding touch-control of the touch trajectory when the distance is less than default threshold value Action.
It can be seen that, in this programme, the reflected light of invisible laser is received first, determine the intensity of reflected light, and receive ultrasound The reflected signal of wave pulse signal, when the intensity of reflected light changes, according to the intensity of before and after reflected light that changes, really Determine the position of touch coordinate of touch control object, then obtain the touch-control rail that position of touch coordinate determined by target time section is formed Mark, and determine the distance between touch control object and described view field, whether the distance is finally judged less than default threshold value, if It is then to respond the corresponding touch of the touch trajectory.It can be seen that, the touch-control due to determining touch control object using the intensity of reflected light Position coordinateses, by ultrasonic pulse signal the distance of touch control object and view field is determined, it is not necessary to which photographic head shoots, can be fast Speed is accurately determined touch, while the power consumption of projector equipment is effectively reduced, even if in view field and projector equipment Distance only 10 centimetres when can also carry out accurate touch-control, substantially increase projection touch-control accuracy.
Preferably, the invisible laser is iraser.
Specifically, first determining module 220 can include:
First strength information image determination unit, for determining occur according to the intensity of the reflected light before changing Intensity of reflected light frame before change, the reflection after changing is determined according to the intensity of the reflected light after changing Intensity information image;
Second strength information image determination unit, for by the intensity of reflected light frame before described changing and institute Stating the intensity of reflected light frame after changing carries out difference processing, obtains the intensity of reflected light frame of touch control object;
Position of touch coordinate determining unit, for the intensity of reflected light information by sophisticated detection algorithm to the touch control object Image detected, determines the position of touch coordinate of the touch control object.
Specifically, second determining module 230 can include:
Path and direction-determining unit, for the position of touch coordinate according to determined by target time section, obtain described The mobile route and moving direction of touch control object;
Touch trajectory determining unit, for according to the mobile route and the moving direction, determining touch trajectory.
Specifically, the 3rd determining module 240 can include:
Spread speed determining unit, for determining the propagation of current period ultrasonic pulse signal according to current operating temperature Speed;
Reflected signal determining unit, for according to the intensity of the reflected signal of the ultrasonic pulse signal, by ultrasound Echo Processing algorithm determines the surface reflected signal on the view field surface;
Propagation time determining unit, for anti-according to the time of the transmitting ultrasonic pulse signal, the reception surface The time serieses of signal are penetrated, the second propagation time sequence of the ultrasound wave is calculated;
Depth of view information determining unit, for according to the second propagation time sequence and the spread speed, it is determined that described Second depth of view information image of view field;
Difference processing unit, for the first depth of view information image of the view field for determining a upper cycle with it is described Second depth of view information image carries out difference processing, obtains the 3rd depth of view information image;
Distance determining unit, for being detected to the 3rd depth of view information image by sophisticated detection algorithm, it is determined that The distance between the touch control object and described view field.
The embodiment of the present invention additionally provides projection touch control device, and a kind of projection touch-control is provided the embodiment of the present invention below Equipment is introduced.
As shown in figure 3, a kind of projection touch control device, including:Laser projection device 310, ultrasonic pulse signal transmitting dress Put 320, reflection laser reception device 330, reflectance ultrasound wave pulse signal reception device 340 and data processing equipment 350;Its In,
Laser projection device 310, for projecting visible laser to view field's formation projected picture with scan mode, and with Scan mode projects invisible laser and forms invisible laser region to the view field;
Wherein, the invisible laser region covers the view field.
Ultrasonic pulse signal discharger 320, for launching ultrasonic pulse signal to the view field;
Reflection laser reception device 330, for receiving the reflected light of the invisible laser, determines the strong of the reflected light Degree, and the intensity of the reflected light is sent to the data processing equipment 350;
Reflectance ultrasound wave pulse signal reception device 340, for receiving the reflected signal of the ultrasonic pulse signal, really The intensity of the fixed reflected signal, and obtain the time for launch ultrasonic pulse signal and the reception reflected signal when Between sequence, and the intensity of the time serieses for being obtained and the reflected signal is sent to the data processing equipment 350;
Data processing equipment 350, for receiving the intensity of reflected light that the machine-operated reception device of the reflection sends, receives The time serieses and the intensity of reflected signal that the reflectance ultrasound wave pulse signal reception device sends, when the reflected light Intensity when changing, according to the intensity of the reflected light before and after changing, determine the position of touch coordinate of touch control object, obtain The touch trajectory that position of touch coordinate determined by target time section is formed is obtained, and is surpassed according to launching in the target time section The time of sound wave pulse signal, the time serieses and intensity that receive reflected signal, determine the touch control object with the view field The distance between, and whether the distance is judged less than default threshold value, if it is, responding, the touch trajectory is corresponding to be touched Control action.
Wherein, the target time section is:Start the time period of preset duration forward from current time.
It can be seen that, in this equipment, laser projection device projects invisible laser to view field, ultrasonic pulse signal transmitting Device launches ultrasonic pulse signal to view field, and reflection laser reception device receives the reflected light of invisible laser, reflection Ultrasonic pulse signal reception device receives the reflected signal of ultrasonic pulse signal, intensity of the data processing equipment in reflected light When changing, according to the intensity of before and after reflected light that changes, the position of touch coordinate of touch control object is determined, then obtain target The touch trajectory that position of touch coordinate determined by time period is formed, and determine between touch control object and the view field away from From the distance being judged whether less than default threshold value, if it is, responding the corresponding touch of the touch trajectory.It can be seen that, Position of touch coordinate due to being determined touch control object using the intensity of reflected light, is determined touch control object and is thrown by ultrasonic pulse signal The distance in shadow zone domain, it is not necessary to which photographic head shoots, and touch can be quickly and accurately determined, while effectively reduce projection setting Standby power consumption, even if can also carry out accurate touch-control when view field and projector equipment are apart from only 10 centimetres, carries significantly The high accuracy of projection touch-control.
Preferably, the invisible laser is iraser.
Specifically, the data processing equipment 350 is used for:
Intensity of reflected light frame before changing, root are determined according to the intensity of the reflected light before changing The intensity of reflected light frame after changing is determined according to the intensity of the reflected light after changing;Change described Front intensity of reflected light frame carries out difference processing with the intensity of reflected light frame after described changing, and is touched The intensity of reflected light frame of control thing;The intensity of reflected light frame of the touch control object is carried out by sophisticated detection algorithm Detection, determines the position of touch coordinate of the touch control object.
Further, the data processing equipment 350 is used for:
The position of touch coordinate according to determined by target time section, obtains mobile route and the movement side of the touch control object To;According to the mobile route and the moving direction, touch trajectory is determined.
Further, the projection touch control device can also include:
Temperature sensor, for measuring current operating temperature, and the current operating temperature is sent to the data Reason device 350;
Accordingly, the data processing equipment 350, specifically receives the work at present temperature that the temperature sensor sends Degree, and the spread speed of current period ultrasonic pulse signal is determined according to current operating temperature;According to the ultrasonic pulse The intensity of the reflected signal of signal, by ultrasonic echo Processing Algorithm the surface reflected signal on the view field surface is determined; Time, the time serieses of reception reflected signal according to the transmitting ultrasonic pulse signal, calculate the ultrasound wave Second propagation time sequence;According to the second propagation time sequence and the spread speed, the of the view field is determined Two depth of view information images;First depth of view information image of the view field that a upper cycle is determined is believed with second depth of field Breath image carries out difference processing, obtains the 3rd depth of view information image;By sophisticated detection algorithm to the 3rd depth of view information figure As being detected, the distance between the touch control object and described view field are determined.
It should be noted that data processing equipment 350 can send the first control signal to grenade instrumentation 310, to control Laser projection device 310 projects visible laser and forms projected picture to view field, and projects invisible laser to the projection Region forms invisible laser region.The second control signal can also be sent to ultrasonic pulse signal discharger 320, to control Ultrasonic pulse signal discharger 320 processed launches ultrasonic pulse signal to the view field.Certainly, grenade instrumentation 310 And ultrasonic pulse signal discharger 320 can also just start action while the projection touch control device starts, this is all Reasonably.
It should be noted that herein, such as first and second or the like relational terms are used merely to a reality Body or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or deposit between operating In any this actual relation or order.And, term " including ", "comprising" or its any other variant are intended to Nonexcludability is included, so that a series of process, method, article or equipment including key elements not only will including those Element, but also including other key elements being not expressly set out, or also include for this process, method, article or equipment Intrinsic key element.In the absence of more restrictions, the key element for being limited by sentence "including a ...", it is not excluded that Also there is other identical element in process, method, article or equipment including the key element.
Each embodiment in this specification is described by the way of correlation, identical similar portion between each embodiment Divide mutually referring to what each embodiment was stressed is the difference with other embodiment.Especially for device reality For applying example, because it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method Part explanation.
One of ordinary skill in the art will appreciate that realize that all or part of step in said method embodiment is can Completed with instructing the hardware of correlation by program, described program can be stored in computer read/write memory medium, The storage medium for obtaining designated herein, such as:ROM/RAM, magnetic disc, CD etc..
Presently preferred embodiments of the present invention is the foregoing is only, protection scope of the present invention is not intended to limit.It is all Any modification, equivalent substitution and improvements made within the spirit and principles in the present invention etc., are all contained in protection scope of the present invention It is interior.

Claims (15)

1. a kind of projection touch control method, is applied to scan-type projector equipment, it is characterised in that the scan-type projector equipment projection Invisible laser simultaneously launches ultrasonic pulse signal to view field, wherein, the invisible laser that the invisible laser is formed View field described in region overlay, methods described includes:
The reflected light of the invisible laser is received, the intensity of the reflected light is determined, and receives the ultrasonic pulse signal Reflected signal, determine the intensity of the reflected signal;
When the intensity of the reflected light changes, according to the intensity of the reflected light before and after changing, touch control object is determined Position of touch coordinate;
In target time section, the touch trajectory that position of touch coordinate determined by acquisition is formed, and according to transmitting ultrasound wave arteries and veins Time, the time serieses of the reflected signal of the reception ultrasonic pulse signal and the intensity of signal are rushed, the touch control object is determined The distance between with the view field, wherein, the target time section is:From current time start preset duration forward when Between section;
Judge the distance whether less than default threshold value;
If it is, responding the corresponding touch of the touch trajectory.
2. the method for claim 1, it is characterised in that the basis change before and after the reflected light intensity, Determine the position of touch coordinate of touch control object, including:
Intensity of reflected light frame before changing is determined according to the intensity of the reflected light before changing, according to generation The intensity of the reflected light determines the intensity of reflected light frame after changing after change;
By the intensity of reflected light frame after the intensity of reflected light frame before described changing and described changing Difference processing is carried out, the intensity of reflected light frame of touch control object is obtained;
The intensity of reflected light frame of the touch control object is detected by sophisticated detection algorithm, determines the touch control object Position of touch coordinate.
3. the method for claim 1, it is characterised in that described in target time section, touch-control position determined by acquisition The touch trajectory of coordinate formation is put, including:
The position of touch coordinate according to determined by target time section, obtains the mobile route and moving direction of the touch control object;
According to the mobile route and the moving direction, touch trajectory is determined.
4. the method for claim 1, it is characterised in that time according to transmitting ultrasonic pulse signal, receive The time serieses and intensity of the reflected signal of the ultrasonic pulse signal, determine between the touch control object and the view field Distance, including:
The spread speed of current period ultrasonic pulse signal is determined according to current operating temperature;
According to the intensity of the reflected signal of the ultrasonic pulse signal, the projected area is determined by ultrasonic echo Processing Algorithm The surface reflected signal of field surface;
According to launching the time of the ultrasonic pulse signal, receiving the time serieses of the surface reflected signal, calculate described Second propagation time sequence of ultrasound wave;
According to the second propagation time sequence and the spread speed, the second depth of view information figure of the view field is determined Picture;
First depth of view information image of the view field that a upper cycle is determined is carried out with the second depth of view information image Difference processing, obtains the 3rd depth of view information image;
The 3rd depth of view information image is detected by sophisticated detection algorithm, determines the touch control object with the projected area The distance between domain.
5. the method as described in any one of claim 1-4, it is characterised in that the invisible laser is iraser.
6. a kind of projection contactor control device, is applied to scan-type projector equipment, it is characterised in that the scan-type projector equipment projection Invisible laser simultaneously launches ultrasonic pulse signal to view field, wherein, the invisible laser that the invisible laser is formed View field described in region overlay, described device includes:
Receiver module, for receiving the reflected light of the invisible laser, determines the intensity of the reflected light, and receives described super The reflected signal of sound wave pulse signal, determines the intensity of the reflected signal;
First determining module, for when the intensity of the reflected light changes, according to the reflected light before and after changing Intensity, determine the position of touch coordinate of touch control object;
Second determining module, in target time section, the touch trajectory that position of touch coordinate determined by acquisition is formed, its In, the target time section is:Start the time period of preset duration forward from current time;
3rd determining module, for described super according to the time of transmitting ultrasonic pulse signal, reception in the target time section The time serieses and intensity of the reflected signal of sound wave pulse signal, determine between the touch control object and the view field away from From;
Judge module, for judging the distance whether less than default threshold value;
Respond module, for responding the corresponding touch of the touch trajectory when the distance is less than default threshold value.
7. device as claimed in claim 6, it is characterised in that first determining module includes:
First strength information image determination unit, changes for being determined according to the intensity of the reflected light before changing Front intensity of reflected light frame, the reflective light intensity after changing is determined according to the intensity of the reflected light after changing Degree frame;
Second strength information image determination unit, for by the intensity of reflected light frame before described changing with described Intensity of reflected light frame after changing carries out difference processing, obtains the intensity of reflected light frame of touch control object;
Position of touch coordinate determining unit, for the intensity of reflected light frame by sophisticated detection algorithm to the touch control object Detected, determined the position of touch coordinate of the touch control object.
8. device as claimed in claim 6, it is characterised in that second determining module includes:
Path and direction-determining unit, for the position of touch coordinate according to determined by target time section, obtain the touch-control The mobile route and moving direction of thing;
Touch trajectory determining unit, for according to the mobile route and the moving direction, determining touch trajectory.
9. device as claimed in claim 6, it is characterised in that the 3rd determining module includes:
Spread speed determining unit, for determining the propagation speed of current period ultrasonic pulse signal according to current operating temperature Degree;
Reflected signal determining unit, for according to the intensity of the reflected signal of the ultrasonic pulse signal, by ultrasonic echo Processing Algorithm determines the surface reflected signal on the view field surface;
Propagation time determining unit, for according to time, the reception surface reflection letter for launching the ultrasonic pulse signal Number time serieses, calculate the second propagation time sequence of the ultrasound wave;
Depth of view information determining unit, for according to the second propagation time sequence and the spread speed, determining the projection The second depth of view information image in region;
Difference processing unit, the first depth of view information image and described second of the view field for a upper cycle to be determined Depth of view information image carries out difference processing, obtains the 3rd depth of view information image;
Distance determining unit, for being detected to the 3rd depth of view information image by sophisticated detection algorithm, it is determined that described The distance between touch control object and described view field.
10. the device as described in any one of claim 6-9, it is characterised in that the invisible laser is iraser.
11. a kind of projection touch control devices, it is characterised in that include:Laser projection device, ultrasonic pulse signal discharger, Reflection laser reception device, reflectance ultrasound wave pulse signal reception device and data processing equipment;Wherein,
The laser projection device, projected picture is formed for projecting visible laser with scan mode to view field, and to sweep The mode of retouching projects invisible laser and forms invisible laser region to the view field, wherein, the invisible laser region Cover the view field;
The ultrasonic pulse signal discharger, for launching ultrasonic pulse signal to the view field;
The reflection laser reception device, for receiving the reflected light of the invisible laser, determines the intensity of the reflected light, And the intensity of the reflected light is sent to the data processing equipment;
The reflectance ultrasound wave pulse signal reception device, for receiving the reflected signal of the ultrasonic pulse signal, it is determined that The intensity of the reflected signal, and obtain the time for launching the ultrasonic pulse signal and receive the time of the reflected signal Sequence, and the intensity of the time serieses for being obtained and the reflected signal is sent to the data processing equipment;
The data processing equipment, for receiving the intensity of reflected light that the reflection laser reception device sends, receives institute The time serieses of reflectance ultrasound wave pulse signal reception device transmission and the intensity of reflected signal are stated, when the reflected light When intensity changes, according to the intensity of the reflected light before and after changing, the position of touch coordinate of touch control object is determined, obtain The touch trajectory that position of touch coordinate determined by target time section is formed, and according to transmitting ultrasound in the target time section The time of ripple signal, the time serieses and intensity that receive reflected signal, determine between the touch control object and the view field Distance, and whether the distance is judged less than default threshold value, if it is, respond the corresponding touch-control of the touch trajectory moving Make, wherein, the target time section is:Start the time period of preset duration forward from current time.
12. equipment as claimed in claim 11, it is characterised in that
The data processing equipment, determines before changing specifically for the intensity according to the reflected light before changing Intensity of reflected light frame, the intensity of reflected light letter after changing is determined according to the intensity of the reflected light after changing Breath image;By the intensity of reflected light hum pattern after the intensity of reflected light frame before described changing and described changing As carrying out difference processing, the intensity of reflected light frame of touch control object is obtained;By sophisticated detection algorithm to the touch control object Intensity of reflected light frame detected, determines the position of touch coordinate of the touch control object.
13. equipment as claimed in claim 11, it is characterised in that
The data processing equipment, specifically for the position of touch coordinate according to determined by target time section, obtains described touching The mobile route and moving direction of control thing;According to the mobile route and the moving direction, touch trajectory is determined.
14. equipment as claimed in claim 11, it is characterised in that the projection touch control device also includes:Temperature sensor;Institute Temperature sensor is stated, for measuring current operating temperature, and the current operating temperature is sent to the data processing equipment;
The data processing equipment, the current operating temperature specifically for receiving the temperature sensor transmission, and according to The current operating temperature determines the spread speed of ultrasonic pulse signal described in current period;Believed according to the ultrasonic pulse Number reflected signal intensity, the surface reflected signal on the view field surface is determined by ultrasonic echo Processing Algorithm;Root According to launching the time of the ultrasonic pulse signal in the target time section, receive the time sequence of the surface reflected signal Row, calculate the ultrasound wave for the one the second propagation time sequences of the view field and for the of the touch control object Two propagation times;According to first propagation time and the spread speed, the first depth of view information of the view field is determined Image,;And according to the second propagation time sequence and the spread speed, determine the second scape of view field's touch control object Deep frame;The first depth of view information image of the view field that a upper cycle is determined is believed with second depth of field Breath image carries out difference processing, obtains the 3rd depth of view information image;By sophisticated detection algorithm to the 3rd depth of view information figure As being detected, the distance between the touch control object and described view field are determined.
15. equipment as described in any one of claim 11-14, it is characterised in that the invisible laser is iraser.
CN201610741260.3A 2016-08-26 2016-08-26 A kind of projection touch control method, device and equipment Active CN106610757B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610741260.3A CN106610757B (en) 2016-08-26 2016-08-26 A kind of projection touch control method, device and equipment
PCT/CN2017/085550 WO2018036229A1 (en) 2016-08-26 2017-05-23 Projection touch control method, device and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610741260.3A CN106610757B (en) 2016-08-26 2016-08-26 A kind of projection touch control method, device and equipment

Publications (2)

Publication Number Publication Date
CN106610757A true CN106610757A (en) 2017-05-03
CN106610757B CN106610757B (en) 2019-08-02

Family

ID=58615020

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610741260.3A Active CN106610757B (en) 2016-08-26 2016-08-26 A kind of projection touch control method, device and equipment

Country Status (2)

Country Link
CN (1) CN106610757B (en)
WO (1) WO2018036229A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107315509A (en) * 2017-06-05 2017-11-03 青岛胶南海尔洗衣机有限公司 A kind of contactless actuation means, signal processing method and its household electrical appliance
WO2018036229A1 (en) * 2016-08-26 2018-03-01 青岛海尔股份有限公司 Projection touch control method, device and equipment
CN108089772A (en) * 2018-01-15 2018-05-29 潍坊歌尔电子有限公司 A kind of projection touch control method and device
CN108089773A (en) * 2018-01-23 2018-05-29 歌尔科技有限公司 A kind of touch control identification method, device and projection part based on depth of field projection
CN108090336A (en) * 2017-12-19 2018-05-29 西安易朴通讯技术有限公司 A kind of unlocking method and electronic equipment applied in the electronic device
WO2018205275A1 (en) * 2017-05-12 2018-11-15 Microsoft Technology Licensing, Llc. Touch operated surface
CN108829294A (en) * 2018-04-11 2018-11-16 卡耐基梅隆大学 A kind of projection touch control method, device and projection touch control device
CN108984042A (en) * 2017-06-05 2018-12-11 青岛胶南海尔洗衣机有限公司 A kind of contactless control device, signal processing method and its household electrical appliance
CN109298798A (en) * 2018-09-21 2019-02-01 歌尔科技有限公司 Method of controlling operation thereof, equipment and the intelligent terminal of Trackpad
CN112716117A (en) * 2020-12-28 2021-04-30 维沃移动通信有限公司 Intelligent bracelet and control method thereof
CN113293832A (en) * 2021-05-12 2021-08-24 唐山惠米智能家居科技有限公司 Laser projection control system and method of intelligent toilet
CN113349742A (en) * 2021-07-07 2021-09-07 异象科技(北京)有限公司 Intelligent light and shadow control bracelet for monitoring vital signs
CN114756162A (en) * 2021-01-05 2022-07-15 成都极米科技股份有限公司 Touch system and method, electronic device and computer readable storage medium

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110688032B (en) * 2019-09-25 2023-04-07 京东方科技集团股份有限公司 Touch device, touch method and electronic equipment
CN113220167B (en) * 2021-05-19 2024-03-12 京东方科技集团股份有限公司 Display module and ultrasonic touch detection method
CN113325425B (en) * 2021-06-25 2024-02-27 湖南友哲科技有限公司 Method for detecting existence of test tube and test tube detection device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100199232A1 (en) * 2009-02-03 2010-08-05 Massachusetts Institute Of Technology Wearable Gestural Interface
CN105589607A (en) * 2016-02-14 2016-05-18 京东方科技集团股份有限公司 Touch system, touch display system and touch interaction method
CN205375438U (en) * 2016-02-14 2016-07-06 京东方科技集团股份有限公司 Touch -control system and touch -control display system
CN105808022A (en) * 2016-03-10 2016-07-27 海信(山东)空调有限公司 Projection key control method, projection key device and air conditioner

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324298B (en) * 2013-06-05 2016-06-29 海信集团有限公司 Ultrasonic laser projection keyboard and data inputting method
JP6387644B2 (en) * 2014-01-21 2018-09-12 セイコーエプソン株式会社 Position detection device, position detection system, and position detection method
CN106610757B (en) * 2016-08-26 2019-08-02 北京一数科技有限公司 A kind of projection touch control method, device and equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100199232A1 (en) * 2009-02-03 2010-08-05 Massachusetts Institute Of Technology Wearable Gestural Interface
CN105589607A (en) * 2016-02-14 2016-05-18 京东方科技集团股份有限公司 Touch system, touch display system and touch interaction method
CN205375438U (en) * 2016-02-14 2016-07-06 京东方科技集团股份有限公司 Touch -control system and touch -control display system
CN105808022A (en) * 2016-03-10 2016-07-27 海信(山东)空调有限公司 Projection key control method, projection key device and air conditioner

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018036229A1 (en) * 2016-08-26 2018-03-01 青岛海尔股份有限公司 Projection touch control method, device and equipment
WO2018205275A1 (en) * 2017-05-12 2018-11-15 Microsoft Technology Licensing, Llc. Touch operated surface
US11061514B2 (en) 2017-05-12 2021-07-13 Microsoft Technology Licensing, Llc Touch operated surface
CN107315509A (en) * 2017-06-05 2017-11-03 青岛胶南海尔洗衣机有限公司 A kind of contactless actuation means, signal processing method and its household electrical appliance
CN108984042B (en) * 2017-06-05 2023-09-26 青岛胶南海尔洗衣机有限公司 Non-contact control device, signal processing method and household appliance thereof
CN107315509B (en) * 2017-06-05 2023-09-15 青岛胶南海尔洗衣机有限公司 Non-contact control device, signal processing method and household appliance thereof
CN108984042A (en) * 2017-06-05 2018-12-11 青岛胶南海尔洗衣机有限公司 A kind of contactless control device, signal processing method and its household electrical appliance
CN108090336A (en) * 2017-12-19 2018-05-29 西安易朴通讯技术有限公司 A kind of unlocking method and electronic equipment applied in the electronic device
CN108090336B (en) * 2017-12-19 2021-06-11 西安易朴通讯技术有限公司 Unlocking method applied to electronic equipment and electronic equipment
CN108089772B (en) * 2018-01-15 2021-04-20 潍坊歌尔电子有限公司 Projection touch method and device
WO2019136989A1 (en) * 2018-01-15 2019-07-18 歌尔科技有限公司 Projection touch control method and device
CN108089772A (en) * 2018-01-15 2018-05-29 潍坊歌尔电子有限公司 A kind of projection touch control method and device
CN108089773B (en) * 2018-01-23 2021-04-30 歌尔科技有限公司 Touch identification method and device based on depth-of-field projection and projection component
CN108089773A (en) * 2018-01-23 2018-05-29 歌尔科技有限公司 A kind of touch control identification method, device and projection part based on depth of field projection
CN108829294A (en) * 2018-04-11 2018-11-16 卡耐基梅隆大学 A kind of projection touch control method, device and projection touch control device
CN108829294B (en) * 2018-04-11 2021-08-27 卡耐基梅隆大学 Projection touch method and device and projection touch equipment
CN109298798A (en) * 2018-09-21 2019-02-01 歌尔科技有限公司 Method of controlling operation thereof, equipment and the intelligent terminal of Trackpad
CN109298798B (en) * 2018-09-21 2021-08-17 歌尔科技有限公司 Operation control method and device of touch pad and intelligent terminal
CN112716117A (en) * 2020-12-28 2021-04-30 维沃移动通信有限公司 Intelligent bracelet and control method thereof
CN114756162A (en) * 2021-01-05 2022-07-15 成都极米科技股份有限公司 Touch system and method, electronic device and computer readable storage medium
CN114756162B (en) * 2021-01-05 2023-09-05 成都极米科技股份有限公司 Touch system and method, electronic device and computer readable storage medium
CN113293832A (en) * 2021-05-12 2021-08-24 唐山惠米智能家居科技有限公司 Laser projection control system and method of intelligent toilet
CN113349742A (en) * 2021-07-07 2021-09-07 异象科技(北京)有限公司 Intelligent light and shadow control bracelet for monitoring vital signs

Also Published As

Publication number Publication date
CN106610757B (en) 2019-08-02
WO2018036229A1 (en) 2018-03-01

Similar Documents

Publication Publication Date Title
CN106610757A (en) Projection touch method, device and equipment
US11656336B2 (en) Advanced gaming and virtual reality control using radar
KR101914850B1 (en) Radar-based gesture recognition
CN105324078B (en) The tracking for not depending on scanner to intervention apparatus
CN106125921B (en) Gaze detection in 3D map environment
KR101945553B1 (en) Manual and camera-based avatar control
US8843857B2 (en) Distance scalable no touch computing
JP2018092648A (en) Non-line-of-sight radar-based gesture recognition
JP5238900B2 (en) GAME DEVICE, GAME DEVICE CONTROL METHOD, AND PROGRAM
CN105260024B (en) A kind of method and device that gesture motion track is simulated on screen
CN107665042A (en) The virtual touchpad and touch-screen of enhancing
WO2010088034A2 (en) Body scan
US10936053B2 (en) Interaction system of three-dimensional space and method for operating same
CN101714044B (en) Camera positioning-based touch screen system
US10606372B2 (en) System and method for interaction with a computer implemented interactive application using a depth aware camera
JP5971816B2 (en) GAME DEVICE AND PROGRAM
JP2004272598A (en) Pointing method, device and program
CN207965847U (en) A kind of touch-control control device
CN116149482A (en) Gesture interaction method and device, electronic equipment and storable medium
CN109528121A (en) Dish-washing machine and method, apparatus, equipment and the medium for identifying operation trace

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant