CN106970709A - A kind of 3D exchange methods and device based on holographic imaging - Google Patents
A kind of 3D exchange methods and device based on holographic imaging Download PDFInfo
- Publication number
- CN106970709A CN106970709A CN201710204357.5A CN201710204357A CN106970709A CN 106970709 A CN106970709 A CN 106970709A CN 201710204357 A CN201710204357 A CN 201710204357A CN 106970709 A CN106970709 A CN 106970709A
- Authority
- CN
- China
- Prior art keywords
- image
- somatosensory device
- information
- projection
- predeterminable area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Holo Graphy (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a kind of 3D exchange methods and device based on holographic imaging, belongs to holographic interaction technique field.This method includes：Obtain image to be detected information in predeterminable area；When image to be detected information meets preset standard, holographic imaging projecting apparatus is opened；The image file prestored is projected into default destination locations；When detecting the destination locations and having the projection of image file, the somatosensory device is opened；The behavior posture of user is obtained based on the somatosensory device；Control projection completes the action corresponding with the behavior posture.The application obtains in predeterminable area whether have user by obtaining the image information in predeterminable area, and judged by the way that image information is matched with human body image information, so that it is determined that whether the object occurred in estimation range is people, when occurring that people, open holographic imaging projecting apparatus, allow users to produce the sensation for entering 3D scenes suddenly, a precipitate visual difference is brought to user.
Description
Technical field
The present invention relates to holographic interaction technique field, in particular to a kind of 3D exchange methods based on holographic imaging
And device.
Background technology
With continuing to develop for science and technology, the equipment interacted based on 3D is more and more, but way traditional at present is to pass through
User, which actively goes progress to open equipment, can just interact, or could enter virtual reality.Yet with being in order at user
Actively carry out so that user can not have no to be put into virtual reality either other 3D interactions in the case of preparing again so that
The experience sense of user significantly declines, it is impossible to bring a novelty, the interactive experience stimulated to user.Therefore, how to solve
Problem is stated, is the technical barrier of current urgent need to resolve.
The content of the invention
The present invention provides a kind of 3D exchange methods and device based on holographic imaging, it is intended to improve above mentioned problem.
A kind of 3D exchange methods based on holographic imaging that the present invention is provided, applied to 3D interactive systems, the 3D interactions
System includes holographic imaging projecting apparatus and somatosensory device, and methods described includes：Obtain image to be detected information in predeterminable area；
When image to be detected information meets preset standard, the holographic imaging projecting apparatus is opened；The image file prestored is thrown
Shadow is to default destination locations；When detecting the destination locations and having the projection of the image file, the somatosensory device is opened；
The behavior posture of user is obtained based on the somatosensory device；The control projection completes corresponding with the behavior posture move
Make.
Preferably, the step of image to be detected information in described acquisition predeterminable area includes：Gather the preset areas
The image information of the mobile object occurred in domain, believes the image information of the mobile object gathered as described image to be detected
Breath.
Preferably, it is described when image to be detected information meets preset standard the step of include：Will be described to be checked
Image in altimetric image information is divided into multiple regions；The marking area in the multiple region is obtained, the marking area is used
In the region for representing that there is vision significance in described image；Calculate the confidence level of each marking area, the confidence level
For representing that the image in the corresponding marking area is the probability of facial image；By each confidence level respectively with presetting
Threshold values is compared, and when any one of confidence level is equal to or more than the pre-set threshold value in multiple confidence levels, is sentenced
Determine described image information and default human body image information match.Preferably, the destination locations are provided with photoelectric sensor, institute
State when the destination locations detect the projection of the image file, open somatosensory device the step of include：Receive institute
State the detection information of photoelectric sensor return；When the detection information meets the second preset rules, somatosensory device is opened.
Preferably, the somatosensory device is provided with infrared sensor and positioner, the described unlatching somatosensory device
The step of include：Obtain the coordinate value of the positioner；By the default seat corresponding to the coordinate value and the predeterminable area
Mark interval is matched, and when coordinate value position is with preset coordinate interval, controls the infrared sensor to be examined
Look into；Receive the detected value that the infrared sensor is returned；When the detected value meets three preset rules, the body-sensing is judged
Equipment opens the somatosensory device entrained by the user in the predeterminable area.
A kind of 3D interactive devices based on holographic imaging that the present invention is provided, applied to 3D interactive systems, the 3D interactions
System includes holographic imaging projecting apparatus and somatosensory device, and described device includes：Image collection module, for obtaining in predeterminable area
Image to be detected information；Image judge module, for when image to be detected information meets preset standard, opening described
Holographic imaging projecting apparatus；Projection module, for the image file prestored to be projected into default destination locations；Projection process module,
For when detecting the destination locations and having the projection of the image file, opening the somatosensory device；User's posture is obtained
Module, the behavior posture for obtaining user based on the somatosensory device；Performing module, for controlling the projection to complete and institute
State the corresponding action of behavior posture.
Preferably, described image acquisition module specifically for：Gather the figure of the mobile object occurred in the predeterminable area
As information, the image information of the mobile object gathered is regard as image to be detected information.
Preferably, the somatosensory device be provided with infrared sensor, described image judge module specifically for：Treated described
Image in detection image information is divided into multiple regions；Obtain the marking area in the multiple region, the marking area
For the region for representing that there is vision significance in described image；Calculate the confidence level of each marking area, the confidence
Spend for representing that the image in the corresponding marking area is the probability of facial image；Will each confidence level respectively with advance
If threshold values is compared, when any one of confidence level is equal to or more than the pre-set threshold value in multiple confidence levels,
Judge described image information and default human body image information match.
Preferably, the destination locations are provided with photoelectric sensor, and the projection process module is additionally operable to：Receive the photoelectricity
The detection information that sensor is returned；When the detection information meets the second preset rules, somatosensory device is opened.
Preferably, the somatosensory device is provided with infrared sensor and positioner, and the projection process module is additionally operable to：
Obtain the coordinate value of the positioner；By the preset coordinate interval progress corresponding to the coordinate value and the predeterminable area
Match somebody with somebody, when coordinate value position is with preset coordinate interval, control the infrared sensor to be checked；Receive described red
The detected value that outer sensor is returned；When the detected value meets three preset rules, judge the somatosensory device by positioned at institute
State entrained by the user in predeterminable area, open the somatosensory device.
A kind of 3D exchange methods and device based on holographic imaging that the invention described above is provided, the application are default by obtaining
Image to be detected information in region obtains whether have user in predeterminable area, and by by image to be detected information with it is default
Standard is matched to be judged, so that it is determined that whether image to be detected information gathered in estimation range meets standard,
When meeting standard, holographic imaging projecting apparatus is opened, the video file being stored in advance in holographic imaging projecting apparatus is played so that
User can produce the sensation for entering 3D scenes suddenly, and a precipitate visual difference is brought to user.And pass through inspection
When survey has projected to target location, somatosensory device is opened, allows the user to what is projected with holographic imaging projecting apparatus
Image carries out 3D interactions so that user can realize that 3D is interacted in the case of involuntary, bring user one brand-new interaction
Experience.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be attached to what is used required in embodiment
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, therefore is not construed as pair
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to this
A little accompanying drawings obtain other related accompanying drawings.
Fig. 1 is a kind of illustrative view of functional configuration of 3D interactive systems provided in an embodiment of the present invention；
Fig. 2 shows for the functional structure that the holographic imaging projecting apparatus in the 3D interactive systems shown in Fig. 1 is connected with somatosensory device
It is intended to；
Fig. 3 is the of the invention real first flow chart for applying a kind of 3D exchange methods based on holographic imaging that example is provided；
Fig. 4 is the of the invention real second structured flowchart for applying a kind of 3D interactive devices based on holographic imaging that example is provided.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
A part of embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.Therefore,
The detailed description of the embodiments of the invention to providing in the accompanying drawings is not intended to limit the model of claimed invention below
Enclose, but be merely representative of the selected embodiment of the present invention.Based on the embodiment in the present invention, those of ordinary skill in the art are not having
There is the every other embodiment made and obtained under the premise of creative work, belong to the scope of protection of the invention.
Fig. 1 and Fig. 2 are refer to, the 3D interactive systems 100 include holographic imaging projecting apparatus 110 and somatosensory device 120.Entirely
Breath imaging projector 110 is communicatively coupled by network with the somatosensory device 120, to enter row data communication or interaction.Institute
Holographic imaging projecting apparatus 110 is stated by obtaining the behavior posture of the user that somatosensory device 120 is captured, so that user and institute
State the image progress 3D interactions that holographic imaging projecting apparatus 110 is projected.
In the present embodiment, the holographic imaging projecting apparatus 110 includes projecting apparatus 112, controller 111, line holographic projections film
114 and image collecting device 113.Described image harvester 113, the line holographic projections film 114 and the projecting apparatus 112 with
The controller 111 is coupled.The controller 111 is coupled with the somatosensory device 120.
In the present embodiment, the controller 111 can be general processor, including central processing unit (Central
Processing Unit, abbreviation CPU), network processing unit (Network Processor, abbreviation NP) etc.；It can also be numeral
Signal processor (DSP), application specific integrated circuit (ASIC), ready-made programmable gate array (FPGA) or other programmable logic devices
Part, discrete gate or transistor logic, discrete hardware components.Here, not limiting specifically.
Described image harvester 113 can be camera or thermal infrared imager.Here, being not especially limited.
For example, the model of the camera can be ov7725.The model of the thermal infrared imager can be FLIR T390.
In the present embodiment, the line holographic projections film 114 is provided with photoelectric sensor 1141.The photoelectric sensor 1141
Coupled with the controller 113.The line holographic projections film 114 is used to receive the image that the projecting apparatus 112 is projected.
In the present embodiment, the somatosensory device 120 is provided with infrared sensor 121 and positioner 122.It is described infrared
Sensor 121 and the positioner 122 are coupled with the controller 111.
In the present embodiment, the somatosensory device 120 can be space mouse or touch gloves, can also be
Brand-new body-sensing sensing external member (Kinect).It is not especially limited herein.For example, the model of the space mouse can be MxAir.
Referring to Fig. 3, a kind of flow of the 3D exchange methods based on holographic imaging provided for first embodiment of the invention
Figure.The idiographic flow shown in Fig. 3 will be described in detail below.
Step S301, obtains image to be detected information in predeterminable area.
In the present embodiment, the holographic imaging projecting apparatus is provided with image collecting device, and described image harvester can
To be camera or thermal infrared imager.Here, being not especially limited.For example, the model of the camera can be
ov7725.The model of the thermal infrared imager can be FLIR T390.
The predeterminable area refers to that the image collecting device set on the holographic imaging projecting apparatus can collect image
A region.The specific selection mode of the predeterminable area can according to the installation site of holographic imaging projecting apparatus in practice with
And the collection visual angle of image collecting device is chosen.
Image to be detected information refers to the image in the predeterminable area.
, can be by the mobile object that occurs described in image acquisition device in predeterminable area as a kind of embodiment
Image information, regard the image information of the mobile object gathered as image to be detected information.Wherein, mobile object is
Fingering enters the object in the predeterminable area.
As another embodiment, the mobile object occurred in the predeterminable area can be gathered by thermal infrared imager
Image information, regard the image information of the mobile object gathered as image to be detected information.Pass through infrared thermal imagery
The mode of the infrared imaging of instrument scans the image for obtaining the object occurred in predeterminable area.
Step S302, when image to be detected information meets preset standard, opens the holographic imaging projecting apparatus.
Wherein, preset standard refers to gathered image to be detected information and the human body image information match prestored.
As a kind of embodiment, the image in image to be detected information is divided into multiple regions；Obtain described
Marking area in multiple regions, the marking area is the region with vision significance in described image.By by image
Being divided into multiple regions can make it that, when obtaining marking area, multiple sample areas can be got so that detect every time
Regional extent is smaller.If for example, not being divided into multiple regions, whole image can be caused as a region, therefore can lead
Cause will be greatly promoted for the complexity that the object in a region is detected.Calculate the confidence of each marking area
Degree, the image that the confidence level is used to represent in the corresponding marking area is the probability of facial image；Described put each
Reliability is compared with pre-set threshold value respectively, described in any one of confidence level is equal to or more than in multiple confidence levels
During pre-set threshold value, described image information and default human body image information match are judged.By using by the confidence level with
The mode that pre-set threshold value is compared, can make it that the mode for obtaining the confidence level for meeting rule is easier, so as to improve
Treatment effeciency.
As a kind of preferred embodiment, each confidence level is compared in advance, the multiple put then is obtained
The maximum objective degrees of confidence of numerical value in reliability；The objective degrees of confidence and pre-set threshold value are compared, by first obtaining one
Objective degrees of confidence, is then compared, can effectively reduce by the maximum objective degrees of confidence of the numerical value of confidence level with pre-set threshold value
The complexity of processing, and then improve the time for obtaining the marking area corresponding to objective degrees of confidence.When the objective degrees of confidence is big
When the pre-set threshold value, described image information and default human body image information match are judged, open the holographic imaging
Projecting apparatus.
In the present embodiment, each candidate's marking area in image can be obtained by saliency algorithm, it is described
Candidate's marking area is the rectangular area with vision significance in the image.Specifically, feature extraction is mainly based upon with showing
Figure generation is write, so as to find each candidate's marking area.The feature extraction refers to first input picture gaussian pyramid table
Show to come.For example, when the number of plies of the gaussian pyramid is 9 layers, wherein the 0th layer is input picture, 1 to 8 layers be respectively with 5 ×
5 Gaussian filter is filtered and sampled what is formed to input picture, and size is 1/2 to the 1/256 of input picture respectively.So
Various features are extracted respectively to each layer of pyramid afterwards：Brightness I, red R, green G, blueness B, yellow Y, direction, so as to be formed
Brightness pyramid, colourity pyramid and direction pyramid.Brightness and color characteristic are obtained by equation below：
I=(r+g+b)/3；
R=r- (g+b)/2；
G=g- (r+b)/2；
B=b- (r+g)/2；
Y=r+g-2 (| r-g |+b).
Wherein, r, g, b are three components of red, green, blue of input picture respectively.In the present embodiment, negative value is set to 0.
O (σ, θ) is the Gabor pyramids that the Gabor functions filtering to brightness I in yardstick direction is obtained.Wherein：
σ ∈ [0,1,2,3 ... 8], θ ∈ [0 °, 45 °, 90 °, 135 °], thus turn into 9 pyramids by character representation：Brightness 1,
Colourity 4 (red respectively, blueness, green, yellow), 4, direction (being 0 °, 45 °, 90 °, 135 ° respectively).Aforementioned four colourity
Response of the feature to black and white is zero, and (red, blueness, green, yellow) monochromatic to each self-corresponding saturation has maximum
Response.Poor are made the pyramidal different scale of feature respectively various features by receptive field.Receptive field center corresponds to chi
Spend c characteristic image vegetarian refreshments (c ∈ { 2,3,4 }), receptive field neighboring area correspond to yardstick s characteristic image vegetarian refreshments (s=c+ δ,
δ ∈ { 3,4 }).And after the resolution ratio difference of different scale feature figures by interpolation, it is necessary to make two images size identical, pass through
Point-to-point work is poor between two images.This process can be represented with Θ.So as to obtain center (yardstick c) and periphery (yardstick s)
Feature contrast expression center and periphery local orientation feature contrast.
Wherein, I (c, s)=| I (c) Θ I (s) |；RG (c, s)=| (R (c)-G (c)) Θ (G (s)-R (s)) |；BY (c,
S)=| (B (c)-Y (c)) Θ (Y (s)-B (s)) |；O (c, s, θ)=| O (c, θ) Θ O (s, θ) |.
Wherein I (c, s) represents brightness figure, specifically, represents the contrast of brightness.RG (c, s) and BY (c, s) represents face
Color characteristic figure, specifically, represents double Antagonistic reactions of color in visual cortex.It is center and RG (c, s) is red green characteristic pattern
Red contrast and the green difference between red contrast of periphery to green, represents red green and green/red pair of Antagonistic reaction.
BY (c, s) is blue/yellow characteristic pattern, is the blue to the difference between the contrast of yellow and the contrast of periphery yellow over blue of center,
Represent the double Antagonistic reactions of blue/yellow and yellow blue.What O (c, s, θ) was represented is direction character figure, is same direction θ feature not
Make what difference was obtained with yardstick, represent the contrast of the local orientation feature of center and periphery.Due to center yardstick c and periphery yardstick s
Between have 6 kinds of combinations (2-5,2-6,3-6,3-7,4-7,4-8), so four formulas can obtain 6 characteristic patterns,
The characteristic pattern (being 6 brightness figures, 12 color characteristic figures, 24 direction character figures respectively) of totally 42 different scales.
Wherein, notable map generalization can be by normalized function N () to each pixel in above-mentioned characteristic pattern
Saliency value normalize to an interval [0, M], the synthesis notable figure of a width this feature is formed, then again by the aobvious of different characteristic
Work figure, which is normalized, obtains best visual saliency map.I.e. described notable figure is above-mentioned marking area.By will be every
The saliency value of individual pixel normalizes to an interval [0, M], can effectively eliminate the notable Distribution value because different characteristic
The different influences produced in interval, secondly find the global maximum M in characteristic pattern, calculate the flat of every other local maximum
AverageFinally each position in characteristic pattern is multiplied byThus by potential marking area in every width characteristic pattern
Position is exaggerated so that the saliency value of those positions is more prominent relative to background.Specifically, can be as follows by formula：
Wherein,The average value of brightness figure is represented,The average value of color characteristic figure is represented,Represent direction character figure
Average value, S represents visual saliency map.
The ratio of width to height in each candidate's marking area is finally in candidate's marking area mark in default aspect ratio field
It is designated as marking area.Wherein, can be [0.2,5] between the default aspect ratio field.
Wherein, the detection method for marking area can bottom-up can also be top-down to examine
Look into.Specifically, for example the either detection model based on depth information of the conspicuousness detection model based on frequency-domain analysis is all certainly
The detection method of the upward marking area in bottom.Here, being not especially limited.
Wherein, the confidence level can be obtained by neural network algorithm.Specifically, the network in neutral net
General to be registered by three layers, first layer is input layer, and input layer is used to receive the information of extraneous input and passes to next layer, at this
In embodiment, the information of the extraneous input refers to each marking area in acquired image information.The second layer is implicit
After layer, the signal for receiving input interval velocity, by default transmission function by the signal received incoming next layer again, i.e.,
Third layer output layer, final result is directly given by output layer.Wherein, transmission function is：For above-mentioned net
Network structure, its function expression is：
Wherein, nin and nhid are respectively the nodes of input layer and hidden layer, WhliIt is that connection l hidden nodes and i-th are defeated
The weight of ingress, WojlFor the weight of connection jth output node and l hidden nodes, WobjFor the threshold values of jth output node, Hl
And HidlThe respectively input of l hidden nodes and output valve, OjAnd YjThe respectively input of jth output node and output valve.At this
In embodiment, the objective degrees of confidence refers to the maximum confidence level of numerical value in all confidence levels.
In the present embodiment, the pre-set threshold value refers to the comparison threshold values pre-set.For example, the pre-set threshold value
Can be 95%.
Step S303, default destination locations are projected to by the image file prestored.
Wherein, described image file refers to the file of the holographic imaging projecting apparatus needs projection.
In the present embodiment, described image file can be stored in locally, can also in real time be obtained and be stored in by network
Image file on the either server of high in the clouds.
Wherein, default destination locations refer to for the fixed position set by the projection of the holographic imaging projecting apparatus.Only
When the holographic imaging projecting apparatus by image projecting to default destination locations when, user could be caused to see hologram.For example,
When line holographic projections film is previously provided with the destination locations, the holographic imaging projecting apparatus is only by image projecting to described complete
When ceasing on projection film, 3D images could be formed.
Step S304, when detecting the destination locations and having the projection of the image file, opens the somatosensory device.
Wherein, the somatosensory device refers to that action or the voice messaging of user by inductor, can be received, so as to
Complete an equipment of interaction.
As a kind of embodiment, the somatosensory device is provided with infrared sensor.The infrared sensor can be
Honeywell model SE2470 a infrared sensor or model SD2440 a infrared sensor,
It can also be model SE1450 a infrared sensor.Here, being not especially limited.
By receiving the detected value that the infrared sensor is returned；When the detected value meets the first preset rules, sentence
The fixed somatosensory device opens the somatosensory device entrained by the user in the predeterminable area.Wherein, the detection
Value can be the body temperature value for the user that the infrared sensor is detected.First preset rules refer to detected value whether be
Zero.When detected value is not zero, that is, meet the first preset rules.When meeting the first preset rules, the somatosensory device is represented
Entrained by the user in predeterminable area.For example, when the hand-held somatosensory device of user, it is red in the somatosensory device
Outer sensor will gather the body temperature for the user for holding the somatosensory device by the hand of user.
As another embodiment, positioner and the infrared sensor are additionally provided with the somatosensory device.It is described
Positioner can be GPS location chip.For example, the GPS location chip can be SiRFstar III (GSW 3.0/
3.1)。
By the coordinate value for obtaining the positioner；Again will be default corresponding to the coordinate value and the predeterminable area
Coordinate interval is matched, and when coordinate value position is with preset coordinate interval, controls the infrared sensor to carry out
Check；Receive the detected value that the infrared sensor is returned；When the detected value meets three preset rules, the body is judged
Equipment is felt entrained by the user in the predeterminable area, opens the somatosensory device.Wherein, the 3rd preset rules
Whether refer to detected value is zero.When detected value is not zero, that is, meet the 3rd preset rules.When meeting three preset rules,
Represent the somatosensory device entrained by the user in predeterminable area.
Wherein, the coordinate value of the somatosensory device is obtained by obtaining the coordinate value of positioner, then by the institute of acquisition
State coordinate value to be matched with preset coordinate interval, so as to judge whether the coordinate value is located in coordinate interval, enter one
Step judges whether the somatosensory device is located in preset coordinate interval, and the coordinate interval is the coordinate of the predeterminable area
Value, so as to judge whether the somatosensory device is located in the predeterminable area.Judged by the coordinate to the somatosensory device, can
To cause the infrared sensor without detection in real time, and only when the somatosensory device is located in the predeterminable area,
Checked, so as to efficiently reduce the working time of the infrared sensor, and then save process resource.
As another embodiment, the somatosensory device is provided with photoelectric sensor, and the photoelectric sensor can be
A model E3JK-5M3 photoelectric sensors of Omron.By receiving the detection information that the photoelectric sensor is returned；When
When the detection information meets the second preset rules, the somatosensory device is opened.Wherein, the detection information refers to the photoelectricity
The photosignal value that sensor is gathered, that is, convert optical signals to electric signal, specifically, is gathered by the photoelectric sensor
The optical signal projected on the destination locations, so as to determine whether image projecting to the destination locations.Described second
Whether the value of electrical signals with pre-setting matches the photosignal value that preset rules refer in the detection information.Work as matching
When, so as to open somatosensory device.
Step S305, the behavior posture of user is obtained based on the somatosensory device.
Wherein, the behavior posture refers to the action behavior of user.For example, the behavior posture can be wave arm or
Person is jump etc..It is not especially limited herein.Specifically, the behavior appearance of user is obtained by the inductor in somatosensory device
State.
Step S306, controls the projection to complete the action corresponding with the behavior posture.
Wherein, after the holographic imaging projecting apparatus receives the behavior posture that the somatosensory device is returned, by the row
Real-time, interactive is carried out for posture and the image projected at destination locations, that is, the behavior posture of image and user are matched.
For example, user, which makes, will occur a deliberate action related to throwing away thing in an action for throwing away thing, image.
Referring to Fig. 4, a kind of function of the 3D interactive devices based on holographic imaging provided for second embodiment of the invention
Module diagram.The 3D interactive devices 400 based on holographic imaging include image collection module 410, image judge module
420th, projection module 430, projection process module 440, user's posture acquisition module 450 and performing module 460.
Image collection module 410, for obtaining image to be detected information in predeterminable area.
Wherein, described image acquisition module 410 specifically for：Gather the figure of the mobile object occurred in the predeterminable area
As information, the image information of the mobile object gathered is regard as image to be detected information.
Image judge module 420, for when image to be detected information meets preset standard, open it is described it is holographic into
As projecting apparatus, wherein, the preset standard refers to and human body image information match.
Wherein, the somatosensory device be provided with infrared sensor, described image judge module 420 specifically for：Will be described
Image in image to be detected information is divided into multiple regions；Obtain the marking area in the multiple region, the notable area
Domain is used to represent the region in described image with vision significance；The confidence level of each marking area is calculated, it is described to put
The image that reliability is used to represent in the corresponding marking area is the probability of facial image；Will each confidence level respectively with
Pre-set threshold value is compared, when any one of confidence level is equal to or more than the pre-set threshold value in multiple confidence levels
When, judge described image information and default human body image information match.
Projection module 430, for the image file prestored to be projected into default destination locations.
Projection process module 440, for when detecting the destination locations and having the projection of the image file, opening institute
State somatosensory device.
In the present embodiment, the somatosensory device is provided with infrared sensor, and the infrared sensor can be
Honeywell model SE2470 a infrared sensor or model SD2440 a infrared sensor,
It can also be model SE1450 a infrared sensor.Here, being not especially limited.
The projection process module 440 specifically for：There is the projection of the image file when detecting the destination locations
When, receive the detected value that the infrared sensor is returned；When the detected value meets the first preset rules, the body-sensing is judged
Equipment opens the somatosensory device entrained by the user in the predeterminable area.
In the present embodiment, the destination locations are provided with photoelectric sensor.For example, the photoelectric sensor can be ohm
A model E3JK-5M3 photoelectric sensors of dragon.
As a kind of embodiment, the projection process module 440 is additionally operable to：Receive the inspection that the photoelectric sensor is returned
Measurement information；When the detection information meets the second preset rules, somatosensory device is opened.
In the present embodiment, the somatosensory device is provided with infrared sensor and positioner.The infrared sensor can
Be Honeywell model SE2470 a infrared sensor or model SD2440 a infrared biography
Sensor, can also be model SE1450 a infrared sensor.Here, being not especially limited.The positioner can be with
It is GPS location chip.For example, the GPS location chip can be SiRFstar III (GSW 3.0/3.1).
As another embodiment, the projection process module 440 is additionally operable to：Obtain the coordinate of the positioner
Value；The coordinate value is matched with the preset coordinate interval corresponding to the predeterminable area, when coordinate value position and institute
When stating in preset coordinate interval, the infrared sensor is controlled to be checked；Receive the detected value that the infrared sensor is returned；
When the detected value meets three preset rules, judge that the somatosensory device is taken by the user in the predeterminable area
Band, opens the somatosensory device.
User's posture acquisition module 450, the behavior posture for obtaining user based on the somatosensory device.
Performing module 460, for controlling the projection to complete the action corresponding with the behavior posture.
In summary, the present invention provides a kind of 3D exchange methods and device based on holographic imaging, and the application is by obtaining
Image to be detected information in predeterminable area obtains whether have user in predeterminable area, and by by image to be detected information with
Preset standard is matched to be judged, so that it is determined that whether image to be detected information gathered in estimation range meets mark
Standard, when meeting standard, opens holographic imaging projecting apparatus, plays the video file being stored in advance in holographic imaging projecting apparatus,
Allow users to produce the sensation for entering 3D scenes suddenly, a precipitate visual difference is brought to user.And lead to
Cross and detect that unlatching somatosensory device allows the user to be thrown with holographic imaging projecting apparatus when having projected to target location
The image of shadow carries out 3D interactions so that user can realize that 3D is interacted in the case of involuntary, brings user one brand-new
Interactive experience.
In several embodiments provided herein, it should be understood that disclosed apparatus and method, it can also pass through
Other modes are realized.Device embodiment described above is only schematical, for example, flow chart and block diagram in accompanying drawing
Show according to the device of multiple embodiments of the present invention, the architectural framework in the cards of method and computer program product,
Function and operation.At this point, each square frame in flow chart or block diagram can represent the one of a module, program segment or code
Part a, part for the module, program segment or code is used to realize holding for defined logic function comprising one or more
Row instruction.It should also be noted that in some implementations as replacement, the function of being marked in square frame can also with different from
The order marked in accompanying drawing occurs.For example, two continuous square frames can essentially be performed substantially in parallel, they are sometimes
It can perform in the opposite order, this is depending on involved function.It is also noted that every in block diagram and/or flow chart
The combination of individual square frame and block diagram and/or the square frame in flow chart, can use the special base for performing defined function or action
Realize, or can be realized with the combination of specialized hardware and computer instruction in the system of hardware.
In addition, each functional module in each embodiment of the invention can integrate to form an independent portion
Point or modules individualism, can also two or more modules be integrated to form an independent part.
If the function is realized using in the form of software function module and is used as independent production marketing or in use, can be with
It is stored in a computer read/write memory medium.Understood based on such, technical scheme is substantially in other words
The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are to cause a computer equipment (can be individual
People's computer, server, or network equipment etc.) perform all or part of step of each of the invention embodiment methods described.
And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), arbitrary access
Memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.Need
It is noted that herein, such as first and second or the like relational terms are used merely to an entity or operation
Made a distinction with another entity or operation, and not necessarily require or imply these entities or exist between operating any this
Actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to nonexcludability
Comprising so that process, method, article or equipment including a series of key elements are not only including those key elements, but also wrap
Include other key elements being not expressly set out, or also include for this process, method, article or equipment intrinsic want
Element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that wanted including described
Also there is other identical element in process, method, article or the equipment of element.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should be included in the scope of the protection.It should be noted that：Similar label and letter exists
Similar terms is represented in following accompanying drawing, therefore, once being defined in a certain Xiang Yi accompanying drawing, is then not required in subsequent accompanying drawing
It is further defined and explained.
Claims (10)
1. a kind of 3D exchange methods based on holographic imaging, applied to 3D interactive systems, the 3D interactive systems include it is holographic into
As projecting apparatus and somatosensory device, it is characterised in that methods described includes：
Obtain image to be detected information in predeterminable area；
When image to be detected information meets preset standard, the holographic imaging projecting apparatus is opened；
The image file prestored is projected into default destination locations；
When detecting the destination locations and having the projection of the image file, the somatosensory device is opened；
The behavior posture of user is obtained based on the somatosensory device；
The control projection completes the action corresponding with the behavior posture.
2. according to the method described in claim 1, it is characterised in that the described image to be detected information obtained in predeterminable area
The step of include：
The image information of the mobile object in the predeterminable area is gathered, the image information of the mobile object gathered is regard as institute
State image to be detected information.
3. according to the method described in claim 1, it is characterised in that described is marked with advance when image to be detected information is met
Punctual step includes：
Image in image to be detected information is divided into multiple regions；
The marking area in the multiple region is obtained, the marking area is used to represent there is vision significance in described image
Region；
The confidence level of each marking area is calculated, the confidence level is used to represent the image in the corresponding marking area
It is the probability of facial image；
Each confidence level is compared with pre-set threshold value respectively, when any one of confidence in multiple confidence levels
When degree is equal to or more than the pre-set threshold value, image to be detected information and default human body image information match are judged.
4. according to the method described in claim 1, it is characterised in that the destination locations are provided with photoelectric sensor, described works as
When the destination locations detect the projection of the image file, the step of opening somatosensory device includes：
Receive the detection information that the photoelectric sensor is returned；
When the detection information meets the second preset rules, the somatosensory device is opened.
5. according to the method described in claim 1, it is characterised in that the somatosensory device is filled provided with infrared sensor and positioning
Put, include the step of the described unlatching somatosensory device：
Obtain the coordinate value of the positioner；
The coordinate value is matched with the preset coordinate interval corresponding to the predeterminable area, when coordinate value position and institute
When stating in preset coordinate interval, the infrared sensor is controlled to be checked；
Receive the detected value that the infrared sensor is returned；
When the detected value meets three preset rules, judge the somatosensory device by the user in the predeterminable area
It is entrained, open the somatosensory device.
6. a kind of 3D interactive devices based on holographic imaging, applied to 3D interactive systems, the 3D interactive systems include it is holographic into
As projecting apparatus and somatosensory device, it is characterised in that described device includes：
Image collection module, for obtaining image to be detected information in predeterminable area；
Image judge module, for when image to be detected information meets preset standard, opening the holographic imaging projection
Instrument；
Projection module, for described image file to be projected into default destination locations；
Projection process module, for when detecting the destination locations and having the projection of the image file, opening the body-sensing
Equipment；
User's posture acquisition module, the behavior posture for obtaining user based on the somatosensory device；
Performing module, for controlling the projection to complete the action corresponding with the behavior posture.
7. device according to claim 6, it is characterised in that described image acquisition module specifically for：
The image information of the mobile object in the predeterminable area is gathered, the image information of the mobile object gathered is regard as institute
State image to be detected information.
8. device according to claim 6, it is characterised in that the somatosensory device is provided with infrared sensor, the figure
As judge module specifically for：
Image in image to be detected information is divided into multiple regions；
The marking area in the multiple region is obtained, the marking area is used to represent there is vision significance in described image
Region；
The confidence level of each marking area is calculated, the confidence level is used to represent the image in the corresponding marking area
It is the probability of facial image；
Each confidence level is compared with pre-set threshold value respectively, when any one of confidence in multiple confidence levels
When degree is equal to or more than the pre-set threshold value, described image information and default human body image information match are judged.
9. device according to claim 6, it is characterised in that the destination locations are provided with photoelectric sensor, the projection
Processing module is additionally operable to：
Receive the detection information that the photoelectric sensor is returned；
When the detection information meets the second preset rules, somatosensory device is opened.
10. device according to claim 6, it is characterised in that the somatosensory device is provided with infrared sensor and positioning
Device, the projection process module is additionally operable to：
Obtain the coordinate value of the positioner；
The coordinate value is matched with the preset coordinate interval corresponding to the predeterminable area, when coordinate value position and institute
When stating in preset coordinate interval, the infrared sensor is controlled to be checked；
Receive the detected value that the infrared sensor is returned；
When the detected value meets three preset rules, judge the somatosensory device by the user in the predeterminable area
It is entrained, open the somatosensory device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710204357.5A CN106970709B (en) | 2017-03-30 | 2017-03-30 | 3D interaction method and device based on holographic imaging |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710204357.5A CN106970709B (en) | 2017-03-30 | 2017-03-30 | 3D interaction method and device based on holographic imaging |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106970709A true CN106970709A (en) | 2017-07-21 |
| CN106970709B CN106970709B (en) | 2020-01-17 |
Family
ID=59336368
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710204357.5A Active CN106970709B (en) | 2017-03-30 | 2017-03-30 | 3D interaction method and device based on holographic imaging |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106970709B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107908384A (en) * | 2017-11-18 | 2018-04-13 | 深圳市星野信息技术有限公司 | A kind of method, apparatus, system and the storage medium of real-time display holographic portrait |
| CN108555422A (en) * | 2018-03-02 | 2018-09-21 | 广州市盘古机器人科技有限公司 | More infrared sensor three-dimensional coordinate posture acquiring technologies |
| CN110096144A (en) * | 2019-04-08 | 2019-08-06 | 汕头大学 | A kind of interaction holographic projection methods and system based on three-dimensional reconstruction |
| CN112782683A (en) * | 2020-12-30 | 2021-05-11 | 广州市德晟光电科技股份有限公司 | System and method for ground radar projection interaction |
| WO2022012194A1 (en) * | 2020-07-16 | 2022-01-20 | 腾讯科技（深圳）有限公司 | Interaction method and apparatus, display device, and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102307288A (en) * | 2011-07-27 | 2012-01-04 | 中国计量学院 | Projection system moving along with sightline of first person based on human face recognition |
| JP2013038751A (en) * | 2011-08-11 | 2013-02-21 | Panasonic Corp | Photographing apparatus |
| CN105763917A (en) * | 2016-02-22 | 2016-07-13 | 青岛海信电器股份有限公司 | Terminal booting control method and terminal booting control system |
| CN205644372U (en) * | 2016-04-20 | 2016-10-12 | 李科 | Can replace intelligent wearing equipment of module |
| CN205788091U (en) * | 2016-04-22 | 2016-12-07 | 吴丰盛 | A kind of human body senses computer equipment automatically |
| CN106295515A (en) * | 2016-07-28 | 2017-01-04 | 北京小米移动软件有限公司 | Determine the method and device of human face region in image |
| CN106372484A (en) * | 2016-09-14 | 2017-02-01 | 珠海市魅族科技有限公司 | Equipment control method and equipment control device |
-
2017
- 2017-03-30 CN CN201710204357.5A patent/CN106970709B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102307288A (en) * | 2011-07-27 | 2012-01-04 | 中国计量学院 | Projection system moving along with sightline of first person based on human face recognition |
| JP2013038751A (en) * | 2011-08-11 | 2013-02-21 | Panasonic Corp | Photographing apparatus |
| CN105763917A (en) * | 2016-02-22 | 2016-07-13 | 青岛海信电器股份有限公司 | Terminal booting control method and terminal booting control system |
| CN205644372U (en) * | 2016-04-20 | 2016-10-12 | 李科 | Can replace intelligent wearing equipment of module |
| CN205788091U (en) * | 2016-04-22 | 2016-12-07 | 吴丰盛 | A kind of human body senses computer equipment automatically |
| CN106295515A (en) * | 2016-07-28 | 2017-01-04 | 北京小米移动软件有限公司 | Determine the method and device of human face region in image |
| CN106372484A (en) * | 2016-09-14 | 2017-02-01 | 珠海市魅族科技有限公司 | Equipment control method and equipment control device |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107908384A (en) * | 2017-11-18 | 2018-04-13 | 深圳市星野信息技术有限公司 | A kind of method, apparatus, system and the storage medium of real-time display holographic portrait |
| CN108555422A (en) * | 2018-03-02 | 2018-09-21 | 广州市盘古机器人科技有限公司 | More infrared sensor three-dimensional coordinate posture acquiring technologies |
| CN110096144A (en) * | 2019-04-08 | 2019-08-06 | 汕头大学 | A kind of interaction holographic projection methods and system based on three-dimensional reconstruction |
| CN110096144B (en) * | 2019-04-08 | 2022-11-15 | 汕头大学 | Interactive holographic projection method and system based on three-dimensional reconstruction |
| WO2022012194A1 (en) * | 2020-07-16 | 2022-01-20 | 腾讯科技（深圳）有限公司 | Interaction method and apparatus, display device, and storage medium |
| US11948243B2 (en) | 2020-07-16 | 2024-04-02 | Tencent Technology (Shenzhen) Company Limited | Three-dimensional virtual object interaction method and apparatus, display device, and storage medium |
| CN112782683A (en) * | 2020-12-30 | 2021-05-11 | 广州市德晟光电科技股份有限公司 | System and method for ground radar projection interaction |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106970709B (en) | 2020-01-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106970709A (en) | A kind of 3D exchange methods and device based on holographic imaging | |
| CN105843386B (en) | A kind of market virtual fitting system | |
| JP4970195B2 (en) | Person tracking system, person tracking apparatus, and person tracking program | |
| Meivel et al. | Mask detection and social distance identification using internet of things and faster R-CNN algorithm | |
| US7065232B2 (en) | Three-dimensional ear biometrics system and method | |
| CN106384106A (en) | Anti-fraud face recognition system based on 3D scanning | |
| CN110458895A (en) | Conversion method, device, equipment and the storage medium of image coordinate system | |
| CN109816745A (en) | Human body thermodynamic chart methods of exhibiting and Related product | |
| CN104246793A (en) | Three-dimensional face recognition for mobile devices | |
| JP2019009752A (en) | Image processing device | |
| US20140064602A1 (en) | Method and apparatus for object positioning by using depth images | |
| CN206322194U (en) | A kind of anti-fraud face identification system based on 3-D scanning | |
| CN110263768A (en) | A kind of face identification method based on depth residual error network | |
| JPH06266840A (en) | Status detector for moving object | |
| US20230085384A1 (en) | Characterizing and improving of image processing | |
| CN113688793A (en) | Training method of face model and face recognition system | |
| CN113222973A (en) | Image processing method and device, processor, electronic device and storage medium | |
| CN114677754A (en) | Behavior recognition method and device, electronic equipment and computer readable storage medium | |
| CN110443179B (en) | Off-post detection method and device and storage medium | |
| CN115273208A (en) | Track generation method, system and device and electronic equipment | |
| JP7304235B2 (en) | Trained model, learning device, learning method, and learning program | |
| CN109816628A (en) | Face evaluation method and Related product | |
| CN112613359B (en) | Construction method of neural network for detecting abnormal behaviors of personnel | |
| JP6773825B2 (en) | Learning device, learning method, learning program, and object recognition device | |
| JP2010238134A (en) | Image processor and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |