CN209028562U - A kind of interaction and feedback device based on no medium air-borne imagery - Google Patents
A kind of interaction and feedback device based on no medium air-borne imagery Download PDFInfo
- Publication number
- CN209028562U CN209028562U CN201821892790.9U CN201821892790U CN209028562U CN 209028562 U CN209028562 U CN 209028562U CN 201821892790 U CN201821892790 U CN 201821892790U CN 209028562 U CN209028562 U CN 209028562U
- Authority
- CN
- China
- Prior art keywords
- borne imagery
- air
- feedback device
- interaction
- control system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The utility model provides a kind of interaction based on no medium air-borne imagery and feedback device, including air-borne imagery device, depth image identification device, information feedback device and master control system；The air-borne imagery device includes optical imaging element and display equipment；The optical imaging element is inclined above the display equipment, and the display equipment connects the master control system, and the depth image identification device connects the master control system through the information feedback device；The depth image identification device is set to right above the air-borne imagery device；The information feedback device includes the radio wave radio wave vibration mould group and auditory visual mould group being connected to each other.The utility model can provide interactive operation and feedback information for line holographic projections, give the more perfect operating experience of user.
Description
Technical field
The utility model belongs to technical field of virtual reality, and in particular to a kind of interaction based on no medium air-borne imagery and
Feedback device.
Background technique
With the development of science and technology, people never stopped the pursuit of vision, optimal display mode is holographic
It has been shown that, in the air without media imaging, due to no any medium, the touch manner of traditional capacitance plate touch screens can not be used,
If a kind of object recognition technique based on depth image can be provided, may be implemented to interact with the real image in air, and
And available feedback, then more perfect experience can be provided the user with.
Summary of the invention
In view of the problems of the existing technology, the utility model provides a kind of interaction based on no medium air-borne imagery and anti-
Device is presented, interactive operation and feedback information can be provided for line holographic projections, gives the more perfect operating experience of user.This is practical
Novel technical solution are as follows:
A kind of interaction and feedback device based on no medium air-borne imagery, including the identification of air-borne imagery device, depth image
Device, information feedback device and master control system；The air-borne imagery device includes optical imaging element and display equipment；Institute
It states optical imaging element to be inclined above the display equipment, the display equipment connects the master control system, described
Depth image identification device connects the master control system through the information feedback device；The depth image identification device setting
Right above the air-borne imagery device；The information feedback device includes the radio wave radio wave vibration mould being connected to each other
Group and auditory visual mould group.
Further, the optical imaging element is preferably equivalent negative refractive index flat plate lens.
Further, the equivalent negative refractive index flat plate lens include the upper layer lens array and lower layer's eyeglass fitted closely
Array, the upper layer lens array and lower layer's lens array by multiple top and bottom it is transparent elongated reflection bar fitting and
At the left and right side of each reflection bar is coated with single or double reflectance coating, the upper layer lens array and lower layer's eyeglass battle array
The reflection bar of the reflection bar quadrature arrangement of column, two layers of lens array constitutes Dihedral Corner Reflectors array (dihedral corner
Reflector array, DCRA), it can make image light in DCRA after at least 2 secondary reflections, be formed and incident image pair
The mid-air real image answered.
Further, the depth image identification device includes binocular camera, TOF detector, structure light and laser thunder
Up to the one or more combination in detector, microwave detector, wifi signal sensor.
Further, the master control system includes PC end system, mobile end system.
The advantages of the utility model and have the beneficial effect that the utility model solves in the air without media imaging combination user's
Interactive and feedback problem, comprehensive feedback system is provided for user, allows user's truly feels to interact to air-borne imagery true
Sense.
Detailed description of the invention
Fig. 1 is the interaction of the utility model and a kind of structural schematic diagram of feedback device, and wherein 1- master control system, 2- believe
Breath feedback device, 3- depth image identification device, 4- equivalent negative refractive index flat plate lens, 5- show equipment, and 6-5 is thrown in air
The real image shot out.
Fig. 2 is that the upper layer lens array of the equivalent negative refractive index flat plate lens of the utility model and lower layer's lens array reflect
The arrangement schematic diagram of item.
Fig. 3 is that the depth map of the utility model is set as a result, wherein 3-1 is 1 object of identification, and 3-2 is 2 objects of identification
Body.
Fig. 4 is the depth map interactive interface based on structure light of the utility model.
Fig. 5 is the definition of the utility model gesture, and wherein 5-1 is to recognize the later amplification behaviour of 2 objects (hand, pen)
Make, 5-2 is to recognize the later reduction operation of 2 objects (hand, pen), and 5-3 is to recognize the later rotation of 2 objects (hand, pen)
Turn operation, 5-4 is that after recognizing 1 object then sharp downward movement returns to origin-location, and 5-5 is to recognize 1 object
Then later fast upward motion returns to origin-location, 5-6 be quickly moved downward after recognizing 1 object then return it is former
Come position, 5-7 is quickly to move right then to return to origin-location after recognizing 1 object.
Specific embodiment
In the description of the present invention, it should be noted that term the instructions such as ' on ', ' under ', ' left side ', ' right side ' orientation
Or positional relationship is to be based on the orientation or positional relationship shown in the drawings, and is merely for convenience of description the utility model and simplification is retouched
It states, rather than the device or element of indication or suggestion meaning must have a particular orientation, be constructed and operated in a specific orientation,
Therefore it should not be understood as limiting the present invention.
It is further to note that unless otherwise clearly defined and limited, term ' connected ', ' connection ' should do broad sense reason
Solution, for example, it may be being fixedly connected, may be a detachable connection, or be integrally connected；It can be mechanical connection, it can also be with
It is electrical connection；It can be directly connected, can also can also be the company inside two elements indirectly connected through an intermediary
It is logical, it can be wireless connection, be also possible to wired connection.It for the ordinary skill in the art, can be with concrete condition
Understand the concrete meaning of above-mentioned term in the present invention.
The utility model is described in further details with specific embodiment with reference to the accompanying drawing, described is practical to this
Novel explanation rather than limit.
As shown in Figure 1, the utility model provides a kind of interaction based on no medium air-borne imagery and feedback device, including sky
Middle imaging device, depth image identification device 3, information feedback device are with 2 and master control system 1；The air-borne imagery device packet
Include equivalent negative refractive index flat plate lens 4 and display equipment 5；Equivalent negative refractive index flat plate lens 4 (DCT-Plate) inclination is set
It sets above the display equipment 5, the display equipment 5 connects the master control system 1；The depth image identification device 3
It is set to right above the air-borne imagery device, the depth image identification device 3 connects described through the information feedback device 2
Master control system 1；The information feedback device 2 includes the radio wave vibration mould group and auditory visual mould group being connected to each other, and is used
In offer vibrational feedback function.
The equivalent negative refractive index flat plate lens include the upper layer lens array and lower layer's lens array fitted closely, described
Upper layer lens array and lower layer's lens array are bonded by the transparent elongated reflection bar in multiple top and bottom, each reflection
The left and right side of item is coated with single or double reflectance coating, and the reflection bar of the upper layer lens array and lower layer's lens array is just
Arrangement is handed over, as shown in Fig. 2, the reflection bar of two layers of lens array constitutes Dihedral Corner Reflectors array (dihedral corner
Reflector array, DCRA), it can make image light in DCRA after at least 2 secondary reflections, be formed and incident image pair
The mid-air real image answered.
Distance of the interaction technique of the utility model by object in depth image, size, direction method filter out properly
Object.The real image of no medium air-borne imagery is acted on, interactive action is completed.Interaction and feedback system without medium air-borne imagery
Realization process specifically: will show that equipment is placed on and keep certain below equivalent negative refractive index flat plate lens (DCT-Plate)
Inclination angle.By DCT-Plate it can be seen that showing that the equivalent real image of equipment is presented in air, is identified and filled according to depth image
The depth image for setting offer identifies that nearest object includes hand, face or any other object.Object is extracted from air
The nearest position of middle real image is as interaction point.Interaction is based on first demarcating the principle used afterwards, it is necessary first to adopt to aerial real image
It is demarcated with fix point method, minimum three points of calibration form the real image face in an air, can be on real image after calibration
The face with depth information is obtained, the object that depth image recognizes is handed over by the object in real image face and air-borne imagery
Mutually, radio wave feedback module can provide a kind of true touch perception in interactive process, and auditory visual mould group can also make phase
The feedback operation answered allows user to interact experience with holographic material picture in a manner of completely new true by design.
Depth image identification, can screen object in several ways, 1) by the size of object, i.e., from being up to most
Maximum object is identified in small object.2) by the distance of object, i.e., nearest from being identified recently into farthest object
's.3) by the direction of object, i.e., the object of rightmost is identified to the left side on the right of image.The object of identification has standard
True depth information, object include hand, face or any other object.
Carry out the detailed process of object identification are as follows:
(1) all objects are detected from foreground image,
(2) then lesser object (may be as caused by noise) is abandoned,
(3) effective object is arranged according to some way in size, distance, direction, utilizes set Rules Filtering
Satisfactory object,
(4) finally the object of standardization is saved in object list.
Depth map obtain principle: the depth image identification device include binocular camera, TOF detector, structure light and
Laser radar detection device, microwave detector, one or more combinations in wifi signal sensor.Now introduce several can be used for
The case where the utility model: 1) it is by two cameras separated by a distance while to obtain that binocular camera, which obtains depth map,
Two width different angle images of Same Scene, find corresponding pixel in two images, subsequent root using Stereo Matching Algorithm
Parallax information is calculated according to triangle principle, and parallax information can be used for characterizing the depth information of object in scene by conversion.2)
It is to emit continuous near-infrared pulse by target scene that TOF, which obtains depth map, is then received with sensor and is reflected back by object
Light pulse.The phase difference for comparing transmitting light pulse and the light pulse by object reflection, can calculate to obtain between light pulse
Transmission delay so that obtain distance of the object relative to transmitter, and obtain the depth information of piece image.3) structure light obtains
Taking depth map is by capturing pattern accordingly with structure light by project structured light to scene, and by imaging sensor.By
It can be because the shape of object deforms, through mode image in capturing obtained image in the mode pattern of structure light
Position and deformation degree calculated using triangle principle and the depth information of each point in image can be obtained.4) laser radar obtains
Depth map be by according to certain time interval to spatial emission laser, and record the signal of each scanning element from laser radar to
Object in tested scene, is then passed through the interval time that object reflects back into laser radar, extrapolates body surface accordingly
The distance between laser radar, to obtain the depth information of image.It has obtained available after the depth information of image
The object recognized provides better experience at a distance from mid-air real image, for interaction.
Object identification principle: the range for occurring gray scale mutation in image is all found out with algorithm, most common algorithm is
Convolution algorithm defines the matrix of convolution algorithm, starts to scan entire image, the every shifting of matrix moves a step, and program will calculating matrix
The gray value summation of middle first half, the difference with matrix rear portion gray value summation.If the color of this block image in matrix is one
It causes, that is to say, that the gray scale in matrix finds a gray scale catastrophe point of object, together very close to gray scale mutation is otherwise indicated
Reason can find remaining point, and the object found can be hand, face or any other object.Pass through depth map, Wo Menke
To obtain the depth information of object any point, and interacted with the real image in air.
The master control system of the utility model includes PC end system, mobile end system.
Embodiment 1
By above-described imaging mode, is formed in real image such as image 4 project building in air in air,
User can not interact with building at this time, by the depth recognition device of No. 3 positions in Fig. 1, can calibrate in air
Real image position, further identification near real image position object, such as the hand in Fig. 3, when the depth information of this hand
Reach No. 6 positions in Fig. 1, software systems can issue instruction, and screen is clicked in simulation, can be with to interact with real image, in Fig. 3
Multiple objects are set, as user while two objects being taken to be identified to, the gesture operation in Fig. 5 can be carried out, when identification
Two object distances become larger, and the building in image 4 widens, when two object distances of identification become smaller, the building in image 4
It reduces.
The preferred embodiment of the utility model has shown and described in above description, but as previously described, it should be understood that practical new
Type is not limited to forms disclosed herein, and should not be regarded as an exclusion of other examples, and can be used for various other groups
Conjunction, modification and environment, and above-mentioned introduction or the technology of related fields can be passed through within the scope of the inventive concept described herein
Or knowledge is modified.And changes and modifications made by those skilled in the art do not depart from the spirit and scope of utility model, then all
It should be in the protection scope of utility model appended claims.
Claims (5)
1. a kind of interaction and feedback device based on no medium air-borne imagery, which is characterized in that including air-borne imagery device, depth
Pattern recognition device, information feedback device and master control system；The air-borne imagery device includes optical imaging element and shows
Show equipment；The optical imaging element is inclined above the display equipment, and the display equipment connects the main control
System, the depth image identification device connect the master control system through the information feedback device；The depth image is known
Other device is set to right above the air-borne imagery device；The information feedback device includes that the radio wave that is connected to each other is wireless
Electric wave vibrates mould group and auditory visual mould group.
2. a kind of interaction and feedback device based on no medium air-borne imagery according to claim 1, which is characterized in that institute
Stating optical imaging element is preferably equivalent negative refractive index flat plate lens.
3. a kind of interaction and feedback device based on no medium air-borne imagery according to claim 2, which is characterized in that institute
Stating equivalent negative refractive index flat plate lens includes the upper layer lens array and lower layer's lens array fitted closely, the upper layer eyeglass battle array
Column and lower layer's lens array are bonded by the transparent elongated reflection bar in multiple top and bottom, the left and right sides of each reflection bar
Face is coated with single or double reflectance coating, the reflection bar quadrature arrangement of the upper layer lens array and lower layer's lens array.
4. a kind of interaction and feedback device based on no medium air-borne imagery according to claim 1, which is characterized in that institute
State depth image identification device include binocular camera, TOF detector, structure light and laser radar detection device, microwave detector,
One or more combinations in wifi signal sensor.
5. a kind of interaction and feedback device based on no medium air-borne imagery according to claim 1, which is characterized in that institute
Stating master control system includes PC end system, mobile end system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201821892790.9U CN209028562U (en) | 2018-11-16 | 2018-11-16 | A kind of interaction and feedback device based on no medium air-borne imagery |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201821892790.9U CN209028562U (en) | 2018-11-16 | 2018-11-16 | A kind of interaction and feedback device based on no medium air-borne imagery |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN209028562U true CN209028562U (en) | 2019-06-25 |
Family
ID=66909785
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201821892790.9U Active CN209028562U (en) | 2018-11-16 | 2018-11-16 | A kind of interaction and feedback device based on no medium air-borne imagery |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN209028562U (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110246442A (en) * | 2019-07-12 | 2019-09-17 | 长春明轩文化传媒有限公司 | Hologram display systems |
| CN110471249A (en) * | 2019-09-17 | 2019-11-19 | 荆门市探梦科技有限公司 | Live holographic display system |
| CN111366338A (en) * | 2020-04-24 | 2020-07-03 | 华中科技大学 | Imaging quality detection device and method of virtual image forming optical system |
| CN111419172A (en) * | 2020-04-29 | 2020-07-17 | 华中科技大学 | Imaging quality detection method and detection device for vision detection system |
| CN111422129A (en) * | 2020-03-17 | 2020-07-17 | 博众成(武汉)科技有限公司 | Automobile, and eliminating device and eliminating method for eliminating automobile A column blind area |
| CN111800623A (en) * | 2020-07-28 | 2020-10-20 | 核桃智能科技（常州）有限公司 | Holographic communication device and method using air imaging lens |
| CN112336469A (en) * | 2019-08-07 | 2021-02-09 | 江苏一影医疗设备有限公司 | Operating room imaging device |
| WO2021023082A1 (en) * | 2019-08-02 | 2021-02-11 | 北京三快在线科技有限公司 | Method and apparatus for displaying alert indicator of unmanned device, and unmanned device |
| CN112764593A (en) * | 2021-01-15 | 2021-05-07 | 安徽省东超科技有限公司 | Touch feedback control method, storage medium, touch feedback system and terminal device |
| CN113436370A (en) * | 2021-06-22 | 2021-09-24 | 安徽省东超科技有限公司 | Entrance guard's equipment |
| CN113838395A (en) * | 2021-09-18 | 2021-12-24 | 湖南美景创意文化建设有限公司 | Ultra-high contrast medium-free aerial imaging display screen for museum |
| CN113848654A (en) * | 2021-09-18 | 2021-12-28 | 湖南美景创意文化建设有限公司 | Exhibition room dielectric-free aerial imaging display screen with gesture interaction function |
| CN113885701A (en) * | 2021-09-29 | 2022-01-04 | 安徽省东超科技有限公司 | Control method for aerial imaging touch feedback, touch feedback subsystem and device |
| CN114265381A (en) * | 2021-11-11 | 2022-04-01 | 四川华能宝兴河水电有限责任公司 | Remote fault diagnosis system for hydropower station |
-
2018
- 2018-11-16 CN CN201821892790.9U patent/CN209028562U/en active Active
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110246442A (en) * | 2019-07-12 | 2019-09-17 | 长春明轩文化传媒有限公司 | Hologram display systems |
| WO2021023082A1 (en) * | 2019-08-02 | 2021-02-11 | 北京三快在线科技有限公司 | Method and apparatus for displaying alert indicator of unmanned device, and unmanned device |
| CN112336469A (en) * | 2019-08-07 | 2021-02-09 | 江苏一影医疗设备有限公司 | Operating room imaging device |
| CN110471249A (en) * | 2019-09-17 | 2019-11-19 | 荆门市探梦科技有限公司 | Live holographic display system |
| CN110471249B (en) * | 2019-09-17 | 2024-03-05 | 荆门市探梦科技有限公司 | In-situ holographic display system |
| CN111422129A (en) * | 2020-03-17 | 2020-07-17 | 博众成(武汉)科技有限公司 | Automobile, and eliminating device and eliminating method for eliminating automobile A column blind area |
| CN111366338B (en) * | 2020-04-24 | 2021-11-19 | 华中科技大学 | Imaging quality detection device and method of virtual image forming optical system |
| CN111366338A (en) * | 2020-04-24 | 2020-07-03 | 华中科技大学 | Imaging quality detection device and method of virtual image forming optical system |
| CN111419172A (en) * | 2020-04-29 | 2020-07-17 | 华中科技大学 | Imaging quality detection method and detection device for vision detection system |
| CN111419172B (en) * | 2020-04-29 | 2021-05-18 | 华中科技大学 | Imaging quality detection method and detection device for vision detection system |
| CN111800623A (en) * | 2020-07-28 | 2020-10-20 | 核桃智能科技（常州）有限公司 | Holographic communication device and method using air imaging lens |
| CN112764593A (en) * | 2021-01-15 | 2021-05-07 | 安徽省东超科技有限公司 | Touch feedback control method, storage medium, touch feedback system and terminal device |
| CN113436370A (en) * | 2021-06-22 | 2021-09-24 | 安徽省东超科技有限公司 | Entrance guard's equipment |
| CN113838395A (en) * | 2021-09-18 | 2021-12-24 | 湖南美景创意文化建设有限公司 | Ultra-high contrast medium-free aerial imaging display screen for museum |
| CN113848654A (en) * | 2021-09-18 | 2021-12-28 | 湖南美景创意文化建设有限公司 | Exhibition room dielectric-free aerial imaging display screen with gesture interaction function |
| CN113885701A (en) * | 2021-09-29 | 2022-01-04 | 安徽省东超科技有限公司 | Control method for aerial imaging touch feedback, touch feedback subsystem and device |
| CN114265381A (en) * | 2021-11-11 | 2022-04-01 | 四川华能宝兴河水电有限责任公司 | Remote fault diagnosis system for hydropower station |
| CN114265381B (en) * | 2021-11-11 | 2024-02-09 | 四川华能宝兴河水电有限责任公司 | Remote fault diagnosis system for hydropower station |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN209028562U (en) | A kind of interaction and feedback device based on no medium air-borne imagery | |
| EP3347738B1 (en) | Mixed-mode depth detection | |
| WO2019179417A1 (en) | Data fusion method and related device | |
| US9826216B1 (en) | Systems and methods for compact space-time stereo three-dimensional depth sensing | |
| TWI547828B (en) | Calibration of sensors and projector | |
| US9432593B2 (en) | Target object information acquisition method and electronic device | |
| US10699430B2 (en) | Depth estimation apparatus, autonomous vehicle using the same, and depth estimation method thereof | |
| CN110793544B (en) | Method, device and equipment for calibrating parameters of roadside sensing sensor and storage medium | |
| TWI501130B (en) | Virtual touch control system | |
| EP2531979B1 (en) | Depth camera compatibility | |
| US20140037135A1 (en) | Context-driven adjustment of camera parameters | |
| CN102455779B (en) | Messaging device and method | |
| CN105723300A (en) | Determining a segmentation boundary based on images representing an object | |
| CN113260951B (en) | Fade-in user interface display based on finger distance or hand proximity | |
| CN107749070A (en) | The acquisition methods and acquisition device of depth information, gesture identification equipment | |
| WO2023015880A1 (en) | Acquisition method for training sample set, model training method and related apparatus | |
| US10055881B2 (en) | Video imaging to assess specularity | |
| WO2021078003A1 (en) | Obstacle avoidance method and device for unmanned vehicle, and unmanned vehicle | |
| WO2022179207A1 (en) | Window occlusion detection method and apparatus | |
| WO2018066352A1 (en) | Image generation system, program and method, and simulation system, program and method | |
| CN111209840A (en) | 3D target detection method based on multi-sensor data fusion | |
| CN105093802A (en) | Light-turning three-dimensional imaging apparatus and projection device and method thereof | |
| CN106204604B (en) | Project touch control display apparatus and its exchange method | |
| CN113052884A (en) | Information processing method, information processing apparatus, storage medium, and electronic device | |
| CN209167945U (en) | A kind of equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220928 Address after: Floor 1, building A3, chuanggu Science Park, No. 900, Wangjiang West Road, hi tech Zone, Hefei City, Anhui Province Patentee after: ANHUI EASPEED TECHNOLOGY Co.,Ltd. Address before: 2 / F, building 13, 27 Xinjinqiao Road, Pudong New Area pilot Free Trade Zone, Shanghai Patentee before: SHANGHAI XIANYAN OPTOELECTRONIC TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |