CN106354247A - Display control method and device for headset intelligent glasses - Google Patents
Display control method and device for headset intelligent glasses Download PDFInfo
- Publication number
- CN106354247A CN106354247A CN201510422357.3A CN201510422357A CN106354247A CN 106354247 A CN106354247 A CN 106354247A CN 201510422357 A CN201510422357 A CN 201510422357A CN 106354247 A CN106354247 A CN 106354247A
- Authority
- CN
- China
- Prior art keywords
- image
- display
- intelligent glasses
- synthesis
- sdk
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a display control method and device for headset intelligent glasses. The display control device includes copying the display image of a computer screen; zooming the copied image; handling the aforementioned zoomed image through the software development toolkit SDK; replicating and synthesizing the handled image; outputting and displaying the aforementioned replicated and synthesized image. Correspondingly, the present invention discloses also a display control device for headset intelligent glasses. The control accuracy and convenience introduced by the present device with the technique of using the headset glasses to experience virtual reality, increases the experiencing effect of people participating in the virtual reality world.
Description
Technical field
The present invention relates to technical field of virtual reality is and in particular to a kind of head-wearing type intelligent based on virtual reality
Glasses control method and control device, particularly head-wearing type intelligent glasses screen display and the control method of operation
And control device.
Background technology
Virtual reality (virtual reality, abbreviation vr) is the new and high technology occurring in recent years, also referred to as manually
Environment.Virtual reality is to produce a three-dimensional virtual world using computer simulation, provides user to close
In the simulation of the sense organs such as vision, audition, tactile, allow user as on the spot in person, can in time,
Observe the things in three-dimensional space without limitation.Wear-type visual device (head mounted display)
It is that the mankind realize one of equipment of virtual reality technology, also known as head-wearing type intelligent glasses.
The present head-wearing type intelligent glasses that entirely immerse are using being connected with computer, data syn-chronization；Work as wear-type
Intelligent glasses and computer link after success, and the display screen of computer and desktop show, are synchronously directly displayed at head
Wear on the built-in display screen of formula intelligent glasses；Because in head-wearing type intelligent glasses optical system, right and left eyes light path is all
It is independent, that is, people's left eye is only capable of by head-wearing type intelligent glasses seeing the built-in screen of head-wearing type intelligent glasses
Left-half shows, people's right eye is only capable of seeing the built-in screen of head-wearing type intelligent glasses by head-wearing type intelligent glasses
The right half part of curtain shows, therefore, under prior art operation, when wear-type intelligent glasses and computer UNICOM
Afterwards, by head-wearing type intelligent glasses, people's right and left eyes are seen that the computer screen desktop not being complete shows；People
Operational control cannot be synchronized with computer after putting on head-wearing type intelligent glasses, so operation is not very square
Just.Therefore, how to improve head-wearing type intelligent glasses manipulation convenience, become one and need to be solved further
Problem.
Content of the invention
The present invention provides a kind of head-wearing type intelligent glasses display control method based on virtual reality and device, profit
With technology such as copying image, scaling, sdk process and synthesis, in order to solve to wear in existing virtual reality technology
There is manipulation inconvenience, the problem of impact Consumer's Experience effect in formula intelligent glasses.
In order to realize foregoing invention purpose, the invention provides a kind of head-wearing type intelligent glasses display control method,
Including:
Replicate computer screen display image；
Zoom in and out process for described duplicating image；
By SDK sdk, the image after described scaling is processed；
For the image after described process, carry out replicating synthesis；
The image after synthesis is replicated described in output display.
Preferably, in said method,
Described duplication computer screen display image, is further included: replicated by Graphics Device Interface gdi
Or Multimedia Programming interface direct x replicates.
Preferably, in said method,
Described gdi replicates, and further includes:
Obtain the display context dc corresponding to display image screen；
Create the display context dc associating with target image；
Replicated corresponding to described acquisition display image screen by calling bitblt application programming interface api
Display context dc create in the display context dc that associates with target image to described；
Obtain internal memory target image, export internal memory target image.
Preferably, in said method,
Described direct x replicates, and further includes:
The dynamic link library dll of execution copy function is remotely injected target process；
The dynamic link library dll of initialization copy function, and related by hook technology hook direct x
api；
Replicate display picture to shared drive in the function of hook；
Obtain internal memory target image, export internal memory target image.
Preferably, in said method,
Api described in described hook technology hook direct x correlation api step, further includes: frame is cut
Change and operate related api or with assuming present more new interface correlation api with position switching transmission.
Preferably, in said method,
Zoom in and out process scaling for described duplicating image to process, further include:
Described duplicating image is contracted to 1/2nd or presets size.
Preferably, in said method,
Described for described process after image, carry out replicate synthesis；Refer to further:
With the image after described process as standard, replicate a width identical image；
By the image of the image after processing and described duplication, splicing synthesis piece image.
Preferably, in said method,
Before described duplication computer screen display image, described intelligent glasses access computer.
Preferably, in said method,
Connection between described intelligent glasses and computer, can be wired connection and wireless connection further；
Described wired connection, further includes but is not limited to, and video passes through HDMI hdmi
Transmission, data feedback is transmitted by USB (universal serial bus) usb；
Described wireless connection, further includes but is not limited to, video pass through wireless family digital interface whdi or
WirelessHD agreement wirelesshd is transmitted, and data feedback passes through bluetooth or industrial science media ism frequency range passes
Defeated.
Accordingly, present invention also offers a kind of head-wearing type intelligent glasses display control unit, comprising:
Replication module, for replicating computer screen display image；
Zoom module, for zooming in and out process for described duplicating image；
Sdk processing module, for by SDK sdk, at the image after described scaling
Reason；
Replicate synthesis module, for for the image after described process, carrying out replicating synthesis；
Output module, for replicating the image after synthesis described in output display.
By using head-wearing type intelligent glasses display control method provided by the present invention and device, can be very big
Improve manipulation accuracy and the degree of convenience experiencing virtual reality technology by head-wearing type intelligent glasses, improve people
Participate in the experience effect of virtual reality world.
Brief description
Fig. 1 is the schematic flow sheet of the display control method described in the embodiment of the present invention；
Fig. 2 is the structural representation of the display control unit described in the embodiment of the present invention.
Specific embodiment
Before the statement embodiment of the present invention, lower three-dimensional imaging General Principle: the institute of the vision of people is described in advance
So that distance can be differentiated, it is the gap by two eyes.Two of people separately about 5 centimeters, two eyes except
Aim at beyond dead ahead, see any the same thing, the angle of two is all without identical.Although gap very little,
But pass in brain through retina, brain just with this small gap, produces far and near depth, thus producing
Third dimension.Although eyes can see object, to object, far and near distance is difficult to differentiate.According to this
One principle, if same image, producing two images with the gap at two eyes visual angles, then allows two
Eyes one on one side, respective eyeball sees the image of oneself, can be so that brain produces through retina
The third dimension of the raw depth of field.
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clearly
Chu, it is fully described by it is clear that described embodiment is only a part of embodiment of the present invention, rather than entirely
The embodiment in portion.Based on embodiments of the invention, those of ordinary skill in the art are not under having creative work
The every other embodiment being obtained, broadly falls into the scope of protection of the invention.
As shown in figure 1, a kind of head-wearing type intelligent glasses display control method described in the embodiment of the present invention, should
For an electronic equipment.It is head-wearing type intelligent glasses, intelligent head that this electronic equipment is preferably virtual reality device
Helmet and head-mounted display etc..Described screen control method comprises the following steps:
Step 11, replicates computer screen display image；
Step 12, zooms in and out process for described duplicating image；
Step 13, by SDK sdk, the image after described scaling is processed；
Step 14, for the image after described process, carries out replicating synthesis；
Step 15, the image after duplication synthesis described in output display.
In above step 11, described duplication computer screen display image, refer to show computer screen
Copying image is in internal memory.
Described duplication computer screen display image, is further included: replicated by Graphics Device Interface gdi
Or Multimedia Programming interface direct x replicates.
Described gdi replicates, and further includes: obtains the display context dc corresponding to display image screen
(display context)；Create the display context dc associating with target image；By calling bitblt
Application programming interface api replicates the described display context dc obtaining corresponding to display image screen to institute
State and create in the display context dc associating with target image；Obtain internal memory target image, export internal memory target
Image.
Described direct x replicates, and further includes: will be long-range for the dynamic link library dll of execution copy function
Injection target process；The dynamic link library dll of initialization copy function, and pass through hook technology hook direct
X correlation api；Replicate display picture to shared drive in the function of hook；Obtain internal memory target image,
Output internal memory target image.Api described in hook technology hook direct x correlation api step described above,
Further include: frame switching operates related api or with assuming present more new interface phase with position switching transmission
Close api.
In above step 12, zoom in and out process for described duplicating image, refer to show for computer screen
The copying image shown, to the target image produced in internal memory, zooms in and out process.For described duplicating image
Zoom in and out process scaling to process, further include: described duplicating image is contracted to 1/2nd or in advance
It is sized.
Operational approach in terms of image scaling is typically, and arranges zooming parameter first, then to each
Pixel to be drawn, does coordinate scaling.It suppose former coordinate (200,100), zooming parameter is 0.5, then coordinate
It is changed into (100,50).
In above step 13, the image after described scaling carries out sdk process, refers to by SDK
Bag sdk, the image after described scaling is processed；Described sdk process includes the image after scaling is carried out
Distortion correction, undistorted after human eye to ensure that image is entered by head-wearing type intelligent glasses, picture feeling of immersion is good,
Image displaying quality is high.
In above step 14, for the image after described sdk process, carry out replicating synthesis；Refer to further:
Image after being processed with described sdk, as standard, replicates a width identical image；Image after sdk is processed and
The image of described duplication, splicing synthesis piece image.I.e. piece image is with intermediate line as demarcation line, left and right two
Department is the identical image of size or picture, is shown with being suitable for head-wearing type intelligent glasses；Described image is multiple
Building-up process processed is generally also referred to as the operation of image split screen.
The split screen operation of various pictures is (entirely to write open graphics by using open graphic library opengl
Library) carry out operation to realize.Opengl is to define one to connect across programming language, cross-platform programming
The graphic package interface of the specialty of mouth specification.It is used for 3-D view (two dimension also can), is that One function is strong
Greatly, call convenient underlying graphics storehouse.Opengl designs according to pipeline-type, and hardware is unrelated, and this allows
It can run on various graphic hardwares.It is also that software is unrelated simultaneously, can run on not
Same operating system, and only need operating system only need to provide a graphic user interface allowing opengl to run
(graphical user interface, abbreviation gui) storehouse, same opengl yet can provide description
Threedimensional model or read picture file method, required to do is to by a series of three-dimensional pels (such as point,
Line, triangle), to form three-dimensional body.
Split screen operation in above-mentioned 14 steps in the present embodiment is exactly by using open graphic library opengl
(entirely writing open graphics library) carries out operation and realizes.In the technical operation of split screen, it will use
To shader and fragment shaders；Shader is tinter, and its work is exactly to read your net
Lattice simultaneously render on screen；Fragment shaders fragment shader, becomes a series of geometric figures into 2d
Pixel color on screen is it is allowed to you once change the color of a pixel and the coordinate bit of texture mapping
Put.Generally it is divided into two steps, first determine whether a certain pixel whether in the range of drawing；Then
Respective operations are carried out according to judged result, even a certain pixel in the range of drawing, is then come using frame of video
Filling, otherwise, then fills background colour.
Above-mentioned steps 15, the image after duplication synthesis described in output display；Refer to further, at step 14
After completing copying image synthesis, by the described image output display replicating after synthesis to wear-type Brilliant Eyes
In mirror.I.e. in head-wearing type intelligent glasses display screen, can show that the left and right consistent with computer screen content is divided
Screen image, now puts on intelligent glasses, and the image that human body left eye can be seen is left display screen or display screen is left
The image that half part shows, this image is consistent with the screen picture content shown by computer；Human body right eye energy
The image seen is the image that right display screen or display screen right half part show, shown by this image and computer
Screen picture content consistent；Therefore, after human body eyes put on intelligent glasses, by right and left eyes seen complete
Whole stereoscopic image can and computer screen show and be consistent；Greatly facilitate the user manipulation of intelligent glasses
Intelligent glasses.
Before carrying out above-mentioned steps 11, that is, before described duplication computer screen display image, described intelligence
Glasses access computer.Connection between described intelligent glasses and computer, can be wired connection further
Connect with wireless；Described wired connection, further includes but is not limited to, and video passes through high-definition multimedia
Interface hdmi transmits, and data feedback is transmitted by USB (universal serial bus) usb；Described wireless connection, further
Including but not limited to, video passes through wireless family digital interface whdi or WirelessHD agreement wirelesshd
Transmission, data feedback passes through bluetooth or industrial science media ism band transmissions.
The embodiment of the present invention, additionally provides a kind of head-wearing type intelligent glasses screen control device, as shown in Fig. 2
This device includes:
Replication module, for replicating computer screen display image；
Zoom module, for zooming in and out process for described duplicating image；
Sdk processing module, for by SDK sdk, at the image after described scaling
Reason；
Replicate synthesis module, for for the image after described process, carrying out replicating synthesis；
Output module, for replicating the image after synthesis described in output display.
Obviously, those skilled in the art can carry out various changes and modification without deviating from this to the present invention
Bright spirit and scope.So, if the present invention these modification and modification belong to the claims in the present invention and
Within the scope of its equivalent technologies, then the present invention is also intended to comprise these changes and modification.
Claims (10)
1. a kind of head-wearing type intelligent glasses display control method, comprising:
Replicate computer screen display image；
Zoom in and out process for described duplicating image；
By SDK sdk, the image after described scaling is processed；
For the image after described process, carry out replicating synthesis；
The image after synthesis is replicated described in output display.
2. method according to claim 1 it is characterised in that
Described duplication computer screen display image, is further included: replicated by Graphics Device Interface gdi
Or Multimedia Programming interface direct x replicates.
3. method according to claim 2 it is characterised in that
Described gdi replicates, and further includes:
Obtain the display context dc corresponding to display image screen；
Create the display context dc associating with target image；
Replicated corresponding to described acquisition display image screen by calling bitblt application programming interface api
Display context dc create in the display context dc that associates with target image to described；
Obtain internal memory target image, export internal memory target image.
4. method according to claim 2 it is characterised in that
Described direct x replicates, and further includes:
The dynamic link library dll of execution copy function is remotely injected target process；
The dynamic link library dll of initialization copy function, and related by hook technology hook direct x
api；
Replicate display picture to shared drive in the function of hook；
Obtain internal memory target image, export internal memory target image.
5. method according to claim 4 it is characterised in that
Api described in described hook technology hook direct x correlation api step, further includes: frame is cut
Change and operate related api or with assuming present more new interface correlation api with position switching transmission.
6. method according to claim 1 it is characterised in that
Zoom in and out process scaling for described duplicating image to process, further include:
Described duplicating image is contracted to 1/2nd or presets size.
7. method according to claim 1 it is characterised in that
Described for described process after image, carry out replicate synthesis；Refer to further:
With the image after described process as standard, replicate a width identical image；
By the image of the image after processing and described duplication, splicing synthesis piece image.
8. method according to claim 1 it is characterised in that
Before described duplication computer screen display image, described intelligent glasses access computer.
9. method according to claim 8 it is characterised in that
Connection between described intelligent glasses and computer, can be wired connection and wireless connection further；
Described wired connection, further includes but is not limited to, and video passes through HDMI hdmi
Transmission, data feedback is transmitted by USB (universal serial bus) usb；
Described wireless connection, further includes but is not limited to, video pass through wireless family digital interface whdi or
WirelessHD agreement wirelesshd is transmitted, and data feedback passes through bluetooth or industrial science media ism frequency range passes
Defeated.
10. a kind of head-wearing type intelligent glasses display control unit, comprising:
Replication module, for replicating computer screen display image；
Zoom module, for zooming in and out process for described duplicating image；
Sdk processing module, for by SDK sdk, at the image after described scaling
Reason；
Replicate synthesis module, for for the image after described process, carrying out replicating synthesis；
Output module, for replicating the image after synthesis described in output display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510422357.3A CN106354247A (en) | 2015-07-17 | 2015-07-17 | Display control method and device for headset intelligent glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510422357.3A CN106354247A (en) | 2015-07-17 | 2015-07-17 | Display control method and device for headset intelligent glasses |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106354247A true CN106354247A (en) | 2017-01-25 |
Family
ID=57842482
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510422357.3A Pending CN106354247A (en) | 2015-07-17 | 2015-07-17 | Display control method and device for headset intelligent glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106354247A (en) |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1621939A (en) * | 2003-11-28 | 2005-06-01 | 陈定万 | Stereoscopic projection method and apparatus for non-stereo filmstrip |
| US20070035831A1 (en) * | 2003-12-19 | 2007-02-15 | Gutierrez Novelo Manuel R | 3D Videogame system |
| CN101046742A (en) * | 2006-03-28 | 2007-10-03 | 联想(北京)有限公司 | Method and equipment for real-time acquiring multi-media image |
| CN101211258A (en) * | 2006-12-28 | 2008-07-02 | 联想(北京)有限公司 | Method for intactly obtaining GDI and DirectX data |
| CN101763625A (en) * | 2009-12-24 | 2010-06-30 | 广东威创视讯科技股份有限公司 | Image pixel processing method |
| CN101961556A (en) * | 2009-07-22 | 2011-02-02 | 科乐美数码娱乐株式会社 | Video game apparatus, game information display control method and recording medium |
| CN102186092A (en) * | 2011-04-26 | 2011-09-14 | 深圳创维－Rgb电子有限公司 | Method, system and display for displaying two-dimensional (2D) menu in three-dimensional (3D) display mode |
| CN102340679A (en) * | 2010-07-23 | 2012-02-01 | 深圳Tcl新技术有限公司 | System for adjusting three dimensional (3D) video sharpness and method thereof |
| CN102521876A (en) * | 2011-11-29 | 2012-06-27 | 康佳集团股份有限公司 | Method and system for realizing three dimensional (3D) stereoscopic effect of user interface |
| CN103248946A (en) * | 2012-02-03 | 2013-08-14 | 海尔集团公司 | Method and system for rapidly transmitting video image |
| CN103823683A (en) * | 2014-02-27 | 2014-05-28 | 北京六间房科技有限公司 | Video recording device and method |
| CN103853576A (en) * | 2012-12-06 | 2014-06-11 | 腾讯科技（深圳）有限公司 | Screenshot method and device |
| CN104125452A (en) * | 2014-08-08 | 2014-10-29 | 北京行云时空科技有限公司 | Two-dimensional and three-dimensional image display and operation control system for stereoscopic glasses |
| CN104333769A (en) * | 2014-11-20 | 2015-02-04 | 广州华多网络科技有限公司 | Method and device for live video streaming |
| CN204423304U (en) * | 2014-12-15 | 2015-06-24 | 上海乐相科技有限公司 | A kind of device realizing virtual reality technology |
-
2015
- 2015-07-17 CN CN201510422357.3A patent/CN106354247A/en active Pending
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1621939A (en) * | 2003-11-28 | 2005-06-01 | 陈定万 | Stereoscopic projection method and apparatus for non-stereo filmstrip |
| US20070035831A1 (en) * | 2003-12-19 | 2007-02-15 | Gutierrez Novelo Manuel R | 3D Videogame system |
| CN101046742A (en) * | 2006-03-28 | 2007-10-03 | 联想(北京)有限公司 | Method and equipment for real-time acquiring multi-media image |
| CN101211258A (en) * | 2006-12-28 | 2008-07-02 | 联想(北京)有限公司 | Method for intactly obtaining GDI and DirectX data |
| CN101961556A (en) * | 2009-07-22 | 2011-02-02 | 科乐美数码娱乐株式会社 | Video game apparatus, game information display control method and recording medium |
| CN101763625A (en) * | 2009-12-24 | 2010-06-30 | 广东威创视讯科技股份有限公司 | Image pixel processing method |
| CN102340679A (en) * | 2010-07-23 | 2012-02-01 | 深圳Tcl新技术有限公司 | System for adjusting three dimensional (3D) video sharpness and method thereof |
| CN102186092A (en) * | 2011-04-26 | 2011-09-14 | 深圳创维－Rgb电子有限公司 | Method, system and display for displaying two-dimensional (2D) menu in three-dimensional (3D) display mode |
| CN102521876A (en) * | 2011-11-29 | 2012-06-27 | 康佳集团股份有限公司 | Method and system for realizing three dimensional (3D) stereoscopic effect of user interface |
| CN103248946A (en) * | 2012-02-03 | 2013-08-14 | 海尔集团公司 | Method and system for rapidly transmitting video image |
| CN103853576A (en) * | 2012-12-06 | 2014-06-11 | 腾讯科技（深圳）有限公司 | Screenshot method and device |
| CN103823683A (en) * | 2014-02-27 | 2014-05-28 | 北京六间房科技有限公司 | Video recording device and method |
| CN104125452A (en) * | 2014-08-08 | 2014-10-29 | 北京行云时空科技有限公司 | Two-dimensional and three-dimensional image display and operation control system for stereoscopic glasses |
| CN104333769A (en) * | 2014-11-20 | 2015-02-04 | 广州华多网络科技有限公司 | Method and device for live video streaming |
| CN204423304U (en) * | 2014-12-15 | 2015-06-24 | 上海乐相科技有限公司 | A kind of device realizing virtual reality technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9886102B2 (en) | Three dimensional display system and use | |
| Tecchia et al. | 3D helping hands: a gesture based MR system for remote collaboration | |
| US20180292971A1 (en) | Zero Parallax Drawing within a Three Dimensional Display | |
| CA2984785A1 (en) | Virtual reality editor | |
| US20060152579A1 (en) | Stereoscopic imaging system | |
| US20190026935A1 (en) | Method and system for providing virtual reality experience based on ultrasound data | |
| US20050264559A1 (en) | Multi-plane horizontal perspective hands-on simulator | |
| US20060250391A1 (en) | Three dimensional horizontal perspective workstation | |
| WO2018086295A1 (en) | Application interface display method and apparatus | |
| US9681122B2 (en) | Modifying displayed images in the coupled zone of a stereoscopic display based on user comfort | |
| US10616567B1 (en) | Frustum change in projection stereo rendering | |
| JP2007536608A (en) | Horizontal perspective hands-on simulator | |
| Berning et al. | A study of depth perception in hand-held augmented reality using autostereoscopic displays | |
| KR101919077B1 (en) | Method and apparatus for displaying augmented reality | |
| CN102005062A (en) | Method and device for producing three-dimensional image for three-dimensional stereo display | |
| US20210337176A1 (en) | Blended mode three dimensional display systems and methods | |
| CN104581119A (en) | Display method of 3D images and head-wearing equipment | |
| WO2017191702A1 (en) | Image processing device | |
| CN102063735B (en) | Method and device for manufacturing three-dimensional image source by changing viewpoint angles | |
| JP4235522B2 (en) | Image processing apparatus, image processing method, and program | |
| CN207603822U (en) | A kind of bore hole 3D display systems | |
| US6559844B1 (en) | Method and apparatus for generating multiple views using a graphics engine | |
| CN108616729A (en) | Enhance the method and system of user interface three-dimensional stereo effect | |
| KR101874760B1 (en) | Information processing device, control method and recording medium | |
| JP2006254240A (en) | Stereoscopic image display apparatus, and method and program therefor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170125 |
|
| RJ01 | Rejection of invention patent application after publication |