CN110267029A - A kind of long-range holographic personage's display technology based on AR glasses - Google Patents

A kind of long-range holographic personage's display technology based on AR glasses Download PDF

Info

Publication number
CN110267029A
CN110267029A CN201910660472.2A CN201910660472A CN110267029A CN 110267029 A CN110267029 A CN 110267029A CN 201910660472 A CN201910660472 A CN 201910660472A CN 110267029 A CN110267029 A CN 110267029A
Authority
CN
China
Prior art keywords
image
glasses
processing unit
data
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910660472.2A
Other languages
Chinese (zh)
Inventor
孙磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Mingwei Software Co Ltd
Original Assignee
Guangzhou Mingwei Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Mingwei Software Co Ltd filed Critical Guangzhou Mingwei Software Co Ltd
Priority to CN201910660472.2A priority Critical patent/CN110267029A/en
Publication of CN110267029A publication Critical patent/CN110267029A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/122Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/324Colour aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Holo Graphy (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Long-range holographic personage's display technology based on AR glasses that the invention discloses a kind of, including data collection terminal, control terminal and AR glasses end, data collection terminal includes depth camera, colour imagery shot and microphone, control terminal includes central processing unit, image acquisition units, audio collection unit, image processing unit, AR glasses end includes image data receiving unit and image data display unit, data collection terminal connects control terminal, control terminal connects AR glasses end, working principle of the present invention is simple, with feeling of immersion and the sense of reality, it can allow the both sides or multi-party of communication exchange not in the same space, the same space can be in be exchanged, interaction.

Description

A kind of long-range holographic personage's display technology based on AR glasses
Technical field
The present invention relates to image display technology field, specially a kind of long-range holographic personage based on AR glasses shows skill Art.
Background technique
History is looked forward to, the mankind never stop for how technically solving the exploration of proximity communication, from the book of early stage Letter is linked up, and arrives telephonic communication, the visual communication of Internet era, then pass through holographic personage realizing both sides' ditch into science fiction movies It is logical.Nothing is not intended to by technology to another party of communication be taken to the three-dimensional space of oneself, links up face-to-face to realize.So With the further development of AR augmented reality, the both sides that will be linked up or multi-party band may be implemented completely by technological means Into the three-dimensional space of another party, to realize face-to-face communication way truly.Certainly the capital equipment linked up is just It is current AR glasses.
There are the following problems for current visual communication way:
(1) sense of reality lacks: although current visual communication way can see that other side's is real-time by PC or mobile phone Video information, but both sides still adhere to separately in respective space, lead to no any sense of reality.
(2) figure image for linking up both sides can not accomplish that no background is shown: showing without background refer to other side personage's shape here As relevant background information can be filtered out by technical approach.Current visual communication technology can not be accomplished.
(3) linking up both sides can not interact: interaction here refers to, exists simultaneously due to linking up both sides in a space, this Sample both sides can manipulate same object in the same space, for example father can play game with child in the same space, learn English Language etc..Current visual communication technology can not be accomplished.
Summary of the invention
Long-range holographic personage's display technology based on AR glasses that the purpose of the present invention is to provide a kind of, to solve above-mentioned back The problem of being proposed in scape technology.
To achieve the above object, the invention provides the following technical scheme: a kind of long-range holographic personage based on AR glasses is aobvious Show technology, including data collection terminal, control terminal and AR glasses end, the data collection terminal includes depth camera, colored camera shooting Head and microphone, the control terminal include central processing unit, image acquisition units, audio collection unit, image processing unit, institute Stating AR glasses end includes image data receiving unit and image data display unit, and the data collection terminal connects control terminal, institute Control terminal connection AR glasses end is stated, the depth camera, colour imagery shot are connected at image by image acquisition units respectively Unit is managed, described image processing unit connects central processing unit, and the microphone connects central processing by audio collection unit Device, the central processing unit connect AR glasses end by data transmission unit.
Preferably, display methods the following steps are included:
A, image acquisition units collect the spatial information of collected object, colour imagery shot by depth camera first It is responsible for collecting the colour information of collected object;
B, the colour information of object and spatial information superposition are integrated and are filtered out according to these information by image processing unit After background data, colored object of the object in three-dimensional space is formed, and be transmitted to central processing unit;
C, central processing unit transfers data to these object data informations after integrating by data transmission unit The AR glasses end of the network other end;
D, after AR glasses end receives object data, the image data receiving unit in AR glasses end receives data, picture number It is responsible for showing object information in system three-dimensional space according to display unit, realizes the display of the holographic object in three-dimensional space.
Preferably, image processing unit processing method is as follows in the step B:
A, the pixel of the image of acquisition being divided into several figure layers according to brightness value, the brightness of each figure layer is different, and Each figure layer is pressed into brightness value, is arranged from low to high, and the boundary of the image in each figure layer is all by closed curve structure At;
B, the figure layer minimum for brightness and the maximum figure layer of brightness first individually carry out histogram equalization processing, then Ambient noise is removed, noise removal is finally carried out;
C, the figure layer among minimum brightness and maximum brightness is first removed into noise, then removes ambient noise, it is most laggard Column hisgram equalization processing;
D, the All Layers after finally will be processed merge into the enhanced image of piece image.
Preferably, the data transmission unit uses UDP or TCP transmission agreement.
Compared with prior art, the beneficial effects of the present invention are: working principle of the present invention is simple, due to communication a side or Person can reside in the same space in many ways, improves the sense of reality and feeling of immersion of communication, can allow not in the same space The both sides of communication exchange are multi-party, can be in the same space and be exchanged, interacted.
Detailed description of the invention
Fig. 1 is one functional block diagram of the embodiment of the present invention;
Fig. 2 is one flow chart of the embodiment of the present invention;
Fig. 3 is two functional block diagram of the embodiment of the present invention;
Fig. 4 is two flow chart of the embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
Embodiment one:
The present invention provides a kind of technical solution referring to FIG. 1-2: a kind of long-range holographic personage's display skill based on AR glasses Art, including data collection terminal 1, control terminal 2 and AR glasses end 3, the data collection terminal 1 include depth camera 4, colored camera shooting First 5 and microphone 6, the control terminal 2 includes central processing unit 7, image acquisition units 8, audio collection unit 9, image procossing Unit 10, AR glasses end 3 include image data receiving unit 11 and image data display unit 12, the data collection terminal 1 connection control terminal 2, the control terminal 2 connect AR glasses end 3, and the depth camera 4, colour imagery shot 5 pass through image respectively Acquisition unit 8 connects image processing unit 10, and described image processing unit 10 connects central processing unit 7, and the microphone 6 passes through Audio collection unit 9 connects central processing unit 7, and the central processing unit 7 connects AR glasses end 3 by data transmission unit 13.
The display methods of the present embodiment the following steps are included:
A, image acquisition units collect the spatial information of collected object, colour imagery shot by depth camera first It is responsible for collecting the colour information of collected object;
B, the colour information of object and spatial information superposition are integrated and are filtered out according to these information by image processing unit After background data, colored object of the object in three-dimensional space is formed, and be transmitted to central processing unit;
C, central processing unit transfers data to these object data informations after integrating by data transmission unit The AR glasses end of the network other end, data transmission unit use UDP or TCP transmission agreement;
D, after AR glasses end receives object data, the image data receiving unit in AR glasses end receives data, picture number It is responsible for showing object information in system three-dimensional space according to display unit, realizes the display of the holographic object in three-dimensional space.
In the present embodiment, image processing unit processing method is as follows in step B:
A, the pixel of the image of acquisition being divided into several figure layers according to brightness value, the brightness of each figure layer is different, and Each figure layer is pressed into brightness value, is arranged from low to high, and the boundary of the image in each figure layer is all by closed curve structure At;
B, the figure layer minimum for brightness and the maximum figure layer of brightness first individually carry out histogram equalization processing, then Ambient noise is removed, noise removal is finally carried out;
C, the figure layer among minimum brightness and maximum brightness is first removed into noise, then removes ambient noise, it is most laggard Column hisgram equalization processing;
D, the All Layers after finally will be processed merge into the enhanced image of piece image.
Image processing unit processing method reduces the global luminance difference of image, enhances picture contrast, effectively Noise is inhibited, the clarity of image is further improved.
Embodiment two:
A kind of long-range holographic personage's display technology based on AR glasses, including data collection terminal 1, control terminal 2 and AR glasses End 3, the data collection terminal 1 include depth camera 4, colour imagery shot 5 and microphone 6, and the control terminal 2 includes centre Device 7, image acquisition units 8, audio collection unit 9 are managed, AR glasses end 3 connects including image processing unit 10, image data Unit 11 and image data display unit 12 are received, the data collection terminal 1 connects control terminal 2, and the control terminal 2 connects AR glasses End 3, the depth camera 4, colour imagery shot 5 connect central processing unit 7, the Mike by image acquisition units 8 respectively Wind 6 connects central processing unit 7 by audio collection unit 9, and the central processing unit 7 connects AR by data transmission unit 13 Mirror end 3, it is single that image data receiving unit 11 in AR glasses end 3 by image processing unit 10 connects image data display Member 12.
The display methods of the present embodiment the following steps are included:
A, image acquisition units collect the spatial information of collected object, colour imagery shot by depth camera first It is responsible for collecting the colour information of collected object and is transmitted to central processing unit;
B, the object data information of acquisition it is another to be transferred data to network by data transmission unit by central processing unit The AR glasses end of one end, data transmission unit use UDP or TCP transmission agreement;
C, after AR glasses end receives object data, image data receiving unit in AR glasses end receives data, at image After the colour information of object and spatial information superposition are integrated according to these information and filter out background data by reason unit, being formed should Colored object of the object in three-dimensional space;
D, image data display unit is responsible for showing object information in system three-dimensional space, realizes in three-dimensional space The display of holographic object.
In the present embodiment, image processing unit processing method is as follows:
A, the pixel of the image of acquisition being divided into several figure layers according to brightness value, the brightness of each figure layer is different, and Each figure layer is pressed into brightness value, is arranged from low to high, and the boundary of the image in each figure layer is all by closed curve structure At;
B, the figure layer minimum for brightness and the maximum figure layer of brightness first individually carry out histogram equalization processing, then Ambient noise is removed, noise removal is finally carried out;
C, the figure layer among minimum brightness and maximum brightness is first removed into noise, then removes ambient noise, it is most laggard Column hisgram equalization processing;
D, the All Layers after finally will be processed merge into the enhanced image of piece image.
Image processing unit processing method reduces the global luminance difference of image, enhances picture contrast, effectively Noise is inhibited, the clarity of image is further improved.
In conclusion working principle of the present invention is simple, due to communication a side or in many ways can reside in the same space It is interior, the sense of reality and feeling of immersion of communication are improved, can allow the both sides or multi-party of communication exchange not in the same space, it can It exchanged, interacted with being in the same space.
It although an embodiment of the present invention has been shown and described, for the ordinary skill in the art, can be with A variety of variations, modification, replacement can be carried out to these embodiments without departing from the principles and spirit of the present invention by understanding And modification, the scope of the present invention is defined by the appended.

Claims (4)

1. a kind of long-range holographic personage's display technology based on AR glasses, including data collection terminal (1), control terminal (2) and AR Mirror end (3), it is characterised in that: the data collection terminal (1) includes depth camera (4), colour imagery shot (5) and microphone (6), the control terminal (2) includes central processing unit (7), image acquisition units (8), audio collection unit (9), image procossing list First (10), AR glasses end (3) includes image data receiving unit (11) and image data display unit (12), the data Collection terminal (1) connects control terminal (2), and the control terminal (2) connects AR glasses end (3), and the depth camera (4), colour are taken the photograph Image processing unit (10) are connected as head (5) pass through image acquisition units (8) respectively, in described image processing unit (10) connection Central processor (7), the microphone (6) pass through audio collection unit (9) connection central processing unit (7), the central processing unit (7) pass through data transmission unit (13) connection AR glasses end (3).
2. a kind of long-range holographic personage's display technology based on AR glasses according to claim 1, it is characterised in that: it is aobvious Show method the following steps are included:
A, image acquisition units collect the spatial information of collected object by depth camera first, and colour imagery shot is responsible for Collect the colour information of collected object;
B, the colour information of object and spatial information superposition are integrated according to these information and filter out background by image processing unit After data, colored object of the object in three-dimensional space is formed, and be transmitted to central processing unit;
C, these object data informations after integrating are transferred data to network by data transmission unit by central processing unit The AR glasses end of the other end;
D, after AR glasses end receives object data, the image data receiving unit in AR glasses end receives data, and image data is aobvious Show that unit is responsible for showing object information in system three-dimensional space, realizes the display of the holographic object in three-dimensional space.
3. a kind of long-range holographic personage's display technology based on AR glasses according to claim 2, it is characterised in that: described Image processing unit processing method is as follows in step B:
A, the pixel of the image of acquisition is divided into several figure layers according to brightness value, the brightness of each figure layer is different, and will be every A figure layer presses brightness value, is arranged from low to high, and the boundary of the image in each figure layer is made of closed curve;
B, the figure layer minimum for brightness and the maximum figure layer of brightness first individually carry out histogram equalization processing, then remove Ambient noise finally carries out noise removal;
C, the figure layer among minimum brightness and maximum brightness is first removed into noise, then removes ambient noise, finally carried out straight Square figure equalization processing;
D, the All Layers after finally will be processed merge into the enhanced image of piece image.
4. a kind of long-range holographic personage's display technology based on AR glasses according to claim 2, it is characterised in that: described Data transmission unit uses UDP or TCP transmission agreement.
CN201910660472.2A 2019-07-22 2019-07-22 A kind of long-range holographic personage's display technology based on AR glasses Pending CN110267029A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910660472.2A CN110267029A (en) 2019-07-22 2019-07-22 A kind of long-range holographic personage's display technology based on AR glasses

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910660472.2A CN110267029A (en) 2019-07-22 2019-07-22 A kind of long-range holographic personage's display technology based on AR glasses

Publications (1)

Publication Number Publication Date
CN110267029A true CN110267029A (en) 2019-09-20

Family

ID=67927553

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910660472.2A Pending CN110267029A (en) 2019-07-22 2019-07-22 A kind of long-range holographic personage's display technology based on AR glasses

Country Status (1)

Country Link
CN (1) CN110267029A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111491125A (en) * 2020-04-20 2020-08-04 深圳市谦视智能科技有限责任公司 AR intelligence glasses and record appearance

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104318542A (en) * 2014-11-20 2015-01-28 上海华力创通半导体有限公司 Image enhancement processing algorithm
CN104392045A (en) * 2014-11-25 2015-03-04 沈阳建筑大学 Real-time enhanced virtual reality system and method based on intelligent mobile terminal
CN107277429A (en) * 2017-07-14 2017-10-20 福建铁工机智能机器人有限公司 A kind of method that teleconference is carried out using AR
JP6275087B2 (en) * 2015-08-03 2018-02-07 株式会社オプティム Head mounted display, data output method, and head mounted display program.
CN108053489A (en) * 2017-12-08 2018-05-18 快创科技(大连)有限公司 The trade mark display systems of commodity based on AR technologies
CN108076307A (en) * 2018-01-26 2018-05-25 南京华捷艾米软件科技有限公司 Video conferencing system based on AR and the video-meeting method based on AR
CN108174183A (en) * 2018-01-11 2018-06-15 鲁东大学 A kind of VR image data control systems based on Internet of Things
CN108491069A (en) * 2018-03-01 2018-09-04 湖南西冲智能家居有限公司 A kind of augmented reality AR transparence display interaction systems
CN109691980A (en) * 2019-01-07 2019-04-30 哈尔滨理工大学 A kind of diabetic retina image lesion detection method
CN109886975A (en) * 2019-02-19 2019-06-14 武汉大学 It is a kind of that raindrop method and system is gone based on the image optimization processing for generating confrontation network
CN109975258A (en) * 2019-03-25 2019-07-05 武汉理工大学 A kind of micro-fluidic detection system of signal enhancing

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104318542A (en) * 2014-11-20 2015-01-28 上海华力创通半导体有限公司 Image enhancement processing algorithm
CN104392045A (en) * 2014-11-25 2015-03-04 沈阳建筑大学 Real-time enhanced virtual reality system and method based on intelligent mobile terminal
JP6275087B2 (en) * 2015-08-03 2018-02-07 株式会社オプティム Head mounted display, data output method, and head mounted display program.
CN107277429A (en) * 2017-07-14 2017-10-20 福建铁工机智能机器人有限公司 A kind of method that teleconference is carried out using AR
CN108053489A (en) * 2017-12-08 2018-05-18 快创科技(大连)有限公司 The trade mark display systems of commodity based on AR technologies
CN108174183A (en) * 2018-01-11 2018-06-15 鲁东大学 A kind of VR image data control systems based on Internet of Things
CN108076307A (en) * 2018-01-26 2018-05-25 南京华捷艾米软件科技有限公司 Video conferencing system based on AR and the video-meeting method based on AR
CN108491069A (en) * 2018-03-01 2018-09-04 湖南西冲智能家居有限公司 A kind of augmented reality AR transparence display interaction systems
CN109691980A (en) * 2019-01-07 2019-04-30 哈尔滨理工大学 A kind of diabetic retina image lesion detection method
CN109886975A (en) * 2019-02-19 2019-06-14 武汉大学 It is a kind of that raindrop method and system is gone based on the image optimization processing for generating confrontation network
CN109975258A (en) * 2019-03-25 2019-07-05 武汉理工大学 A kind of micro-fluidic detection system of signal enhancing

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111491125A (en) * 2020-04-20 2020-08-04 深圳市谦视智能科技有限责任公司 AR intelligence glasses and record appearance
CN111491125B (en) * 2020-04-20 2022-05-13 深圳市谦视智能科技有限责任公司 AR intelligence glasses and record appearance

Similar Documents

Publication Publication Date Title
DE102015100926B4 (en) Presentation of enhanced communication between remote participants through advanced and virtual reality
CN104392045B (en) A kind of real time enhancing virtual reality system and method based on intelligent mobile terminal
US20150358539A1 (en) Mobile Virtual Reality Camera, Method, And System
CN101345843B (en) Method and system for implementing full view video of visible mobile terminal
WO2016000309A1 (en) Augmented reality method and system based on wearable device
CN101431613A (en) Network group photo implementing method
CN108377355A (en) A kind of video data handling procedure, device and equipment
KR20190140396A (en) Image processing apparatus, method and storage medium
CN104902263A (en) System and method for showing image information
CA2926235A1 (en) Image blur with preservation of detail
CN105959620A (en) Panorama video synchronization display method and panorama video synchronization display device
CN109716769A (en) The system and method for the scaling of object-oriented are provided in multimedia messages
CN108076307A (en) Video conferencing system based on AR and the video-meeting method based on AR
CN103442137A (en) Method for allowing a user to look over virtual face of opposite side in mobile phone communication
CN110120049A (en) By single image Combined estimator scene depth and semantic method
CN105391984A (en) UAV (Unmanned Aerial Vehicle) driving experience system and method
CN109964481A (en) Experience shared system
CN104601930A (en) System and method for automatically switching and displaying video image and desktop image
CN104900111A (en) High fidelity simulation driving system and method
CN110267029A (en) A kind of long-range holographic personage's display technology based on AR glasses
CN112492231A (en) Remote interaction method, device, electronic equipment and computer readable storage medium
WO2018154589A1 (en) An apparatus, method, and system for capturing 360/virtual reality video using a mobile phone add-on
CN205545426U (en) Three -dimensional mobile telephone device of panoramic shooting group
CN202721763U (en) Panoramic video acquisition device
CN115086686A (en) Video processing method and related device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190920

RJ01 Rejection of invention patent application after publication