CN109561298A - Image processing system and method - Google Patents
Image processing system and method Download PDFInfo
- Publication number
- CN109561298A CN109561298A CN201710889015.1A CN201710889015A CN109561298A CN 109561298 A CN109561298 A CN 109561298A CN 201710889015 A CN201710889015 A CN 201710889015A CN 109561298 A CN109561298 A CN 109561298A
- Authority
- CN
- China
- Prior art keywords
- screenshot
- image processing
- information
- head
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Abstract
The present invention provides a kind of image processing system and methods, image processing system includes a head-mounted display apparatus and an image processing apparatus, above-mentioned image processing apparatus includes a processor, and processor sends a helmet information of the above-mentioned head-mounted display apparatus of correspondence to user's mode driver；Above-mentioned user's mode driver generates one second screenshot according to above-mentioned helmet information and one first screenshot from a Kernel-mode driver, and above-mentioned second screenshot is supplied to above-mentioned processor.In addition, above-mentioned processor directly generates a display information according to above-mentioned second screenshot, and above-mentioned head-mounted display apparatus receives above-mentioned display information, and shows picture according to above-mentioned display information.Application program can be not required to directly link up with user's mode driver by DirectX graphical interfaces frame, thus save the time of instruction and signal transmission, because the time that the picture caused by instruction or the transmission of signal postpones will be reduced.
Description
Technical field
Description of the invention is predominantly about an image processing techniques, more particularly in passing through virtual reality (virtual
Reality, VR) head-mounted display apparatus directly display Direct3D and OpenGL content image processing techniques, be related to one
Kind image processing system and method.
Background technique
With the development of science and technology the also day also evolution of the display technology of image.Virtual reality (Virtual Reality, referred to as
It VR) is a kind of display technology that virtual three-dimensional space is simulated using computer technology.User can be filled by dedicated wearing
Set (such as: the helmet, glasses), allow user to have feeling on the spot in person by vision.
However, display content shown by current virtual implementing helmet, is all the independently developed exploitation of exploitation quotient
Platform is developed.Therefore, it current virtual implementing helmet and can not support to directly display the interior of Direct3D and OpenGL
The picture of appearance.However, since current most 3D software and 3D game are all based on Direct3D and OpenGL, both draw
It holds up to be developed.Therefore, if virtual implementing helmet can not be supported to directly display the picture of the content of Direct3D and OpenGL,
Display content shown by virtual implementing helmet will be restricted.
Summary of the invention
In view of above-mentioned problem of the prior art, the present invention provides straight by virtual reality (VR) head-mounted display apparatus
Connect the image processing system and method for the content of display Direct3D and OpenGL.
An embodiment according to the present invention provides a kind of image processing system, and described image processing system is worn including one
Formula display device and an image processing apparatus, described image processing unit include a processor, and processor will the corresponding head
The helmet information for wearing formula display device sends user's mode driver to, user's mode driver according to
The helmet information and one first screenshot from a Kernel-mode driver, generate one second screenshot, and by described the
Two screenshots are supplied to the processor；The processor directly generates a display information, and the head according to second screenshot
It wears formula display device and receives the display information, and picture is shown according to the display information.
According to some embodiments of the invention, the helmet information includes the resolution letter of the head-mounted display apparatus
Breath.
According to some embodiments of the invention, first screenshot is the picture generated from Direct 3D and OpenGL technology
It is selected.
According to some embodiments of the invention, user's mode driver is according to the resolution information and described
First screenshot is converted to second screenshot for being applicable in the resolution information by the first screenshot.
According to some embodiments of the invention, the processor is directly according to two eye pupil hole of second screenshot and user
Distance, generate right and left eyes picture shown by the head-mounted display apparatus.
A step of embodiment according to the present invention provides a kind of image processing method, described image processing method is wrapped
It includes: sending a helmet information of a corresponding head-mounted display apparatus to user's mode driver；According to the helmet
Information and one first screenshot from a Kernel-mode driver generate one second screenshot；Directly according to described second section
Figure generates a display information；And picture is shown according to the display information.
The image processing system and method provided through the above embodiments of the present invention, application program can be not required to pass through
DirectX graphical interfaces frame is directly linked up with user's mode driver, thus saves instruction and signal transmission
Time, further, because the time that the picture caused by instruction or the transmission of signal postpones will be reduced.
About other additional features and advantages of the invention, those skilled in the art are not departing from spirit and model of the invention
In enclosing, when can do a little variation according to the system and method disclosed in this case implementation method and obtain with retouching.
Detailed description of the invention
Fig. 1 is the block diagram of image processing system 100 described in a display embodiment according to the present invention.
Fig. 2 is the schematic diagram that driving operation is shown according to shown in one embodiment of the invention.
Fig. 3 is the flow chart 300 of the image processing method according to one embodiment of the invention.
Description of symbols:
100 image processing systems；
110 image processing apparatus；
111 processors；
112 display devices；
120 head-mounted display apparatus；
210 Direct3D execute program library；
220 OpenGL execute program library；
230 DirectX graphical interfaces frames；
240 user's mode drivers；
250 DirectX cores；
260 Kernel-mode drivers；
300 flow charts；
A1, A2 application software；
F1, F2 screenshot
Specific embodiment
What this section was described is preferred embodiment of the present invention, it is therefore intended that illustrate spirit of the invention rather than to
It limits the scope of protection of the present invention, protection scope of the present invention is when being subject to the protection scope that claim defined.
Fig. 1 is the block diagram of image processing system 100 described in a display embodiment according to the present invention.As shown in Figure 1,
Image processing system 100 may include an image processing apparatus 110 and a head-mounted display apparatus (head-mounted
Display, abbreviation HMD) 120.An embodiment according to the present invention, image processing apparatus 110 may include a processor 111 and
One display device 112.It is noted that, the block diagram in Fig. 1, illustrates the embodiment of the present invention only for facilitating, but the present invention
It is not limited thereto.Image processing apparatus 110 also may include other elements.
According to one embodiment of the invention, image processing apparatus 110 can be laptop, a smart phone or a lithographic plate
Computer, but invention is not limited thereto.According to one embodiment of the invention, display device 112 can be general display device, example
Such as: the screen of laptop screen, smart phone screen or desktop computer, but invention is not limited thereto.According to of the invention
One embodiment, head-mounted display apparatus 120 can be a virtual reality (virtual reality, VR) helmet.When user wants
When watching the picture of virtual reality, head-mounted display apparatus 120 can be coupled to image processing apparatus 110, with aobvious from wear-type
The picture of the viewing virtual reality of showing device 120.
Fig. 2 is the schematic diagram that driving operation is shown according to shown in one embodiment of the invention.In implementation benefit of the invention
In, processor 111 can be used to execute the relevant operation and operation of display driving shown in Fig. 2.As shown in Fig. 2, display driving behaviour
It can be divided into application program (applications) layer, user's mode (User Mode) layer and core schema (Kernel
Mode) layer.Be noted that, the schematic diagram in Fig. 2, illustrate the embodiment of the present invention only for facilitating, but the present invention not with
This is limited.
An embodiment according to the present invention contains the application program to be executed in application layer, such as: application
Program A1 and application program A2.
An embodiment according to the present invention may include that a Direct3D (D3D) executes program library in user's mode layer
(Runtime Library) 210, one OpenGL executes program library 220, a DirectX graphical interfaces frame (DirectX
Graphics Infrastructure (DXGI) Framework) 230 and user's mode driver (User Mode
Driver)240。
An embodiment according to the present invention, core schema layer may include a DirectX core (DXG Kernel) 250 and
One Kernel-mode driver (Kernel Mode Driver) 260.
An embodiment according to the present invention, when by shown by display device 112 as produced by D3D and OpenGL technology
Image when being transformed into head-mounted display apparatus 120, processor 111 can execute an application program A1, will correspond to wear-type and show
The helmet information of showing device 120 sends user's mode driver 240 to.As shown in Fig. 2, shown by display device 112
The image as caused by D3D and OpenGL technology can execute image caused by an application program A2 for processor 111.
An embodiment according to the present invention, helmet information may include the resolution of head-mounted display apparatus 120.According to this hair
A bright embodiment, user's mode driver 240 may include user's mode display driving software (User-mode
Display driver), the mountable Client Driver of an OpenGL (installable client driver), Yi Jizhen
Operation of the invention is developed an application program editing interface (application programming interface,
API)。
An embodiment according to the present invention, when user's mode driver 240 receives head-mounted display apparatus 120
After helmet information, user's mode driver 240 directly can obtain 112 institute of display device from Kernel-mode driver 260
Screenshot (framebuffer) F1 of the image of the D3D and OpenGL content of display.That is, in this embodiment, user
Mode driver 240 can not have to through DirectX core 250, and directly obtain display from Kernel-mode driver 260
The screenshot F1 of image shown by device 112.In traditional display driving operation, user's mode driver 240 needs
It can just be linked up with Kernel-mode driver 260 by DirectX core 250.For example, user's mode activated journey
Sequence 240 needs to give an order by DirectX core 250 just drive display device 112 aobvious to Kernel-mode driver 260
Show the image of D3D and OpenGL content.Therefore, in this embodiment, also can be considered the function of 250 part of DirectX core
It is passed to Kernel-mode driver 260.Therefore, D3D and OpenGL content is shown when passing through head-mounted display apparatus 120
During virtual reality image, user's mode driver 240 can not have to through DirectX core 250, and directly and core
Heart mode driver 260 is linked up, to save the time of instruction and signal transmission.Therefore, because of instruction or the transmission of signal
The time of caused picture delay will be reduced.
An embodiment according to the present invention obtains D3D shown by display device 112 from Kernel-mode driver 260
After the screenshot F1 of the image of OpenGL content, user's mode driver 240 can be generated according to helmet information and screenshot F1
One screenshot F2.Since the resolution of display device 112 and the resolution of head-mounted display apparatus 120 are different, implement herein
In example, Kernel-mode driver 260 can be according to acquired helmet information, by cutting for image shown by display device 112
Figure F1 is converted into the screenshot F2 for being suitble to the resolution of head-mounted display apparatus 120 to show.An embodiment according to the present invention, display
The resolution of device 112 can be 1920 × 1080 (i.e. screen width high ratio is 16:9) or 800 × 600 (i.e. screen width high ratio is
4:3), the resolution of head-mounted display apparatus 120 then can be 2880 × 1440, but invention is not limited thereto.
An embodiment according to the present invention, after user's mode driver 240 generates screenshot F2, user's mode is driven
Dynamic program 240 can directly transmit screenshot F2 and give application program A1.That is, application program A1 can directly drive from user's mode
Dynamic program 240 obtains the screenshot F2 for being suitble to the resolution of head-mounted display apparatus 120 to show, without passing through DirectX again
Graphical interfaces frame 230 obtains the screenshot F2 that the resolution of suitable head-mounted display apparatus 120 is shown.Therefore, implement herein
Example in, application program A1 can be not required to by DirectX graphical interfaces frame 230 directly with user's mode driver 240 into
Row is linked up, thus saves the time of instruction and signal transmission.Therefore, because instruction or signal transmission caused by picture postpone
Time will be reduced.
An embodiment according to the present invention, application program A1 obtain screenshot F2 after, application program A1 can according to screenshot F2 with
And the oculopupillary distance of user two of head-mounted display apparatus 120, generate right and left eyes shown by head-mounted display apparatus 120
Picture, and send the right and left eyes picture of generation to head-mounted display apparatus 120.Head-mounted display apparatus 120 obtains right and left eyes
After the information of picture, information the picture of a virtual reality can be shown based on the received.Therefore, implementation through the invention
Example, head-mounted display apparatus 120 can show the picture of the virtual reality of D3D and OpenGL content.
Fig. 3 is the flow chart 300 of the image processing method according to one embodiment of the invention.This image processing method is suitable
With image processing apparatus 110.In step S310, the helmet information of a corresponding head-mounted display apparatus is sent to user mode
Driver.One is generated according to helmet information and one first screenshot from a Kernel-mode driver in step S320
Second screenshot.In step S330, a display information is directly generated according to above-mentioned second screenshot.In step S340, according to above-mentioned aobvious
Show that information shows picture.An embodiment according to the present invention, helmet information can be the resolution of head-mounted display apparatus
Information.
An embodiment according to the present invention, step S320 further include, according to the resolution information of head-mounted display apparatus and
First screenshot is converted to the second screenshot for being applicable in the resolution information of head-mounted display apparatus by the first screenshot.
An embodiment according to the present invention, step S330 further include, according to the second screenshot and user two it is oculopupillary away from
From right and left eyes picture shown by generation head-mounted display apparatus.
By image processing method of the invention, application software, which can be obtained directly from user's mode driver, is suitble to void
The image of the resolution of the quasi- reality helmet, to show that the virtual reality with D3D and OpenGL content is drawn from virtual implementing helmet
Face.In addition, image processing method through the invention, virtual implementing helmet will can be supported in display Direct3D and OpenGL
Hold, thus increases the compatibility of virtual implementing helmet displayable content.In addition, image processing method through the invention, it can
When reducing the image of tradition display D3D and OpenGL content, because of the picture delay caused by instruction or the transmission of signal.
The step of method disclosed in specification of the invention and algorithm, directly can directly be answered by executing a processor
With in the combination of hardware, software module or both.One software module (including execute instruction and related data) and other data
It can be stored in data storage, seem random access memory (RAM), flash memory (flash memory), read-only deposit
Reservoir (ROM), electronics erasable programmable read-only memory (EEPROM), is kept at erasable programmable read-only memory (EPROM)
Any other electricity in device, hard disk, portable hard disk, compact disc read-only memory (CD-ROM), DVD or the technology known to this field
The storage media format that brain can be read.One storage media may be coupled to an installations, for example, seem computer/processor
(in order to be described conveniently, being indicated in this specification with processor), above-mentioned processor can by come read information (as
It is procedure code), and write information to storage media.One storage media can integrate a processor.One special application integrated circuit
It (ASIC) include processor and storage media.One user equipment then includes a special application integrated circuit.In other words, processor
With storage media in a manner of the user equipment that is not directly connected, it is contained in user equipment.In addition, in some embodiments, appointing
What is suitble to the product of computer program to include the storage media that can be read, wherein the storage media that can be read includes and one or more institutes
The relevant procedure code of disclosure embodiment.In some embodiments, the product of computer program may include encapsulating material.
" embodiment " that is previously mentioned in this specification or " embodiment " indicate the specific spy related with embodiment
Sign, structure or characteristic are to include in an at least embodiment according to the present invention, it is not intended that they are present in each implementation
In example.Therefore, in the present specification different places occur " in one embodiment " or " in embodiment " phrase not necessarily
Indicate identical embodiment of the invention.
The above paragraph is described using a variety of levels.Obvious, the teaching of this paper may be implemented in a variety of ways, and in example
Disclosed any certain architectures or function are only a representative situation.According to the teaching of this paper, anyone skilled in the art
It should be understood that each level disclosed herein can independent implementation or two or more levels can merge implementation.
Although the present invention has been described by way of example and in terms of the preferred embodiments, however, it is not to limit the invention, any this field skill
Art personnel without departing from the spirit and scope of the present invention, when can make a little variation and retouching, therefore protection model of the invention
It encloses when being subject to the protection scope that claim defined.
Claims (10)
1. a kind of image processing system characterized by comprising
One head-mounted display apparatus；And
One image processing apparatus, comprising:
One processor sends a helmet information of the correspondence head-mounted display apparatus to user's mode driver；
Wherein user's mode driver is according to the helmet information and one from a Kernel-mode driver
First screenshot generates one second screenshot, and second screenshot is supplied to the processor；
Wherein the processor directly generates a display information according to second screenshot, and the head-mounted display apparatus receives
The display information, and picture is shown according to the display information.
2. image processing system as described in claim 1, wherein the helmet information includes the head-mounted display apparatus
One resolution information.
3. image processing system as claimed in claim 2, wherein first screenshot is from Direct3D and OpenGL technology
Selected by the picture of generation.
4. image processing system as claimed in claim 2, wherein user's mode driver is according to the resolution
First screenshot is converted to second screenshot for being applicable in the resolution information by information and first screenshot.
5. image processing system as described in claim 1, wherein the processor directly according to second screenshot and makes
The oculopupillary distance of user two, generates right and left eyes picture shown by the head-mounted display apparatus.
6. a kind of image processing method characterized by comprising
Send a helmet information of a corresponding head-mounted display apparatus to user's mode driver；
According to the helmet information and one first screenshot from a Kernel-mode driver, one second screenshot is generated；
A display information is directly generated according to second screenshot；And
Picture is shown according to the display information.
7. image processing method as claimed in claim 6, wherein the helmet information includes the head-mounted display apparatus
One resolution information.
8. image processing method as claimed in claim 7, wherein first screenshot is from Direct3D and OpenGL technology
Selected by the picture of generation.
9. image processing method as claimed in claim 7, further includes:
According to the resolution information and first screenshot, first screenshot is converted to and is applicable in the resolution information
Second screenshot.
10. image processing method as claimed in claim 6, further includes:
According to second screenshot and the oculopupillary distance of user two, a left side shown by the head-mounted display apparatus is generated
Right eye picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710889015.1A CN109561298A (en) | 2017-09-27 | 2017-09-27 | Image processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710889015.1A CN109561298A (en) | 2017-09-27 | 2017-09-27 | Image processing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109561298A true CN109561298A (en) | 2019-04-02 |
Family
ID=65863821
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710889015.1A Withdrawn CN109561298A (en) | 2017-09-27 | 2017-09-27 | Image processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109561298A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200537851A (en) * | 2004-02-27 | 2005-11-16 | Newnham Res Ltd | Computer network architecture and method of providing display data |
| CN101175218A (en) * | 2006-10-31 | 2008-05-07 | 凌阳科技股份有限公司 | Method and system for performing image process in computer equipment |
| CN104915979A (en) * | 2014-03-10 | 2015-09-16 | 苏州天魂网络科技有限公司 | System capable of realizing immersive virtual reality across mobile platforms |
| CN105320271A (en) * | 2014-07-10 | 2016-02-10 | 精工爱普生株式会社 | HMD calibration with direct geometric modeling |
| US20160077842A1 (en) * | 2013-05-03 | 2016-03-17 | Displayink (Uk) Limited | System for connecting a display over a general-purpose data transport |
| CN105704478A (en) * | 2015-08-31 | 2016-06-22 | 深圳超多维光电子有限公司 | Stereoscopic display method, device and electronic equipment used for virtual and reality scene |
-
2017
- 2017-09-27 CN CN201710889015.1A patent/CN109561298A/en not_active Withdrawn
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200537851A (en) * | 2004-02-27 | 2005-11-16 | Newnham Res Ltd | Computer network architecture and method of providing display data |
| CN101175218A (en) * | 2006-10-31 | 2008-05-07 | 凌阳科技股份有限公司 | Method and system for performing image process in computer equipment |
| US20160077842A1 (en) * | 2013-05-03 | 2016-03-17 | Displayink (Uk) Limited | System for connecting a display over a general-purpose data transport |
| CN104915979A (en) * | 2014-03-10 | 2015-09-16 | 苏州天魂网络科技有限公司 | System capable of realizing immersive virtual reality across mobile platforms |
| CN105320271A (en) * | 2014-07-10 | 2016-02-10 | 精工爱普生株式会社 | HMD calibration with direct geometric modeling |
| CN105704478A (en) * | 2015-08-31 | 2016-06-22 | 深圳超多维光电子有限公司 | Stereoscopic display method, device and electronic equipment used for virtual and reality scene |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10740966B2 (en) | Fake thickness on a two-dimensional object | |
| KR20150091474A (en) | Low latency image display on multi-display device | |
| KR102341267B1 (en) | Apparatus and Method of rendering for binocular disparity image | |
| CN117873313A (en) | Mixed reality system with color virtual content distortion and method for generating virtual content using the same | |
| WO2001015127A1 (en) | Display method for multiple layered screens | |
| CN111051959B (en) | Generating new frames using rendered and non-rendered content from previous perspectives | |
| JP2016529593A (en) | Interleaved tiled rendering of 3D scenes | |
| CN109696953B (en) | Virtual reality character display method and device and virtual reality equipment | |
| US10748003B2 (en) | Mitigation of augmented reality markup blindness | |
| US20220092847A1 (en) | Managing multi-modal rendering of application content | |
| US20110004898A1 (en) | Attracting Viewer Attention to Advertisements Embedded in Media | |
| JP4307222B2 (en) | Mixed reality presentation method and mixed reality presentation device | |
| US11416939B1 (en) | Financial future visualization and training | |
| WO2007129476A1 (en) | Image processing program and image processor | |
| CN109558001A (en) | Image processing system and method | |
| CN109561298A (en) | Image processing system and method | |
| US20190355326A1 (en) | Operating method of tracking system, hmd (head mounted display) device, and tracking system | |
| TWI653081B (en) | Image processing system and method | |
| TW201915938A (en) | Image processing system and method | |
| US9251766B2 (en) | Composing stereo 3D windowed content | |
| US20240066403A1 (en) | Method and computer device for automatically applying optimal configuration for games to run in 3d mode | |
| CN117635813A (en) | Method and computer device for generating 3D picture | |
| US20230179754A1 (en) | Electronic device and method for generating stereoscopic light-field data | |
| TW202409973A (en) | Method and computer device for 3d scene generation | |
| CN116820645A (en) | Method, device, system and storage medium for generating UI in 3D space |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20190402 |