CN110324705A - It is a kind of based on wear display equipment image processing method and system - Google Patents
It is a kind of based on wear display equipment image processing method and system Download PDFInfo
- Publication number
- CN110324705A CN110324705A CN201810277821.8A CN201810277821A CN110324705A CN 110324705 A CN110324705 A CN 110324705A CN 201810277821 A CN201810277821 A CN 201810277821A CN 110324705 A CN110324705 A CN 110324705A
- Authority
- CN
- China
- Prior art keywords
- image
- played
- display equipment
- attribute information
- processing method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Abstract
The embodiment of the invention discloses it is a kind of based on wear display equipment image processing method and system, the method includes the steps: obtain image to be played；The image to be played is parsed, with the attribute information of the determination image to be played；Judge whether the attribute information meets preset condition；If it is not, then being handled based on default neural network model the image to be played, to obtain target image, wherein the image quality of the target image is higher than the image quality of the image to be played；The target image is shown in the display interface for wearing display equipment.This method is based on neural network model and handles the image to be played, reduces sawtooth sense, improves the clarity of display image, and does not need to improve video card configuration.
Description
Technical field
The present invention relates to fields of communication technology, and in particular to it is a kind of based on wear display equipment image processing method and be
System.
Background technique
In recent years, as gradually maturation, the various virtual implementing helmets of virtual reality technology occur successively, realization principle
It is to amplify image caused by small two-dimension display by optical system.Specifically, the light that miniscope is emitted
Line generates image similar to distant place effect because of refraction by convex lens.Right and left eyes screen is shown respectively by left and right eyelens simultaneously
The image of right and left eyes, human eye are generated in the brain after obtaining this information with parallax with relief image.
The problems such as that there are pictures is not clear enough for most of current virtual implementing helmet, and sawtooth is serious, has seriously affected view
Feel sense organ.The simple image quality that improves can propose excessively high requirement to video card again, therefore, how in the case where not promoting video card configuration
Improving virtual reality and showing the clarity of image and reduce sawtooth sense becomes the problem that field of virtual reality needs to solve.
Summary of the invention
The purpose of the present invention is to provide a kind of based on the image processing method and system of wearing display equipment, reduces saw
Tooth sense, improves the clarity of display image, and does not need to improve video card configuration.
The embodiment of the invention provides a kind of based on the image processing method for wearing display equipment, comprising steps of
Obtain image to be played；
The image to be played is parsed, with the attribute information of the determination image to be played；
Judge whether the attribute information meets preset condition；
If it is not, then the image to be played is handled based on default neural network model, to obtain target image,
In, the image quality of the target image is higher than the image quality of the image to be played；
The target image is shown in the display interface for wearing display equipment.
Correspondingly, the embodiment of the present invention also provides a kind of based on the image processing system for wearing display equipment, comprising:
Acquiring unit, for obtaining image to be played；
Resolution unit, for being parsed to the image to be played, with the attribute information of the determination image to be played；
Judging unit, for judging whether the attribute information meets preset condition；
Processing unit, for handling the image to be played based on preset neural network model, to obtain
Target image；
Display unit, for showing the target image in the display interface for wearing display equipment.
It is provided in an embodiment of the present invention based on wear display equipment image processing method and system, obtain first to be played
Image, and the image to be played is parsed, with the attribute information of the determination image to be played；Then judge the category
Whether property information meets preset condition；If it is not, then the image to be played is handled based on default neural network model, with
Obtain target image；Finally the target image is shown in the display interface for wearing display equipment.This method is based on nerve
Network model handles the image to be played, reduces sawtooth sense, improves the clarity of display image, and is not required to
Improve video card configuration.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is flow chart of the embodiment of the present invention based on the image processing method for wearing display equipment；
Fig. 2 is another flow chart of the embodiment of the present invention based on the image processing method for wearing display equipment；
Fig. 3 is default neural network schematic diagram provided in an embodiment of the present invention；
Fig. 4 is schematic diagram of the embodiment of the present invention based on the image processing system for wearing display equipment；
Fig. 5 is another schematic diagram of the embodiment of the present invention based on the image processing system for wearing display equipment
Fig. 6 is the schematic diagram of server involved in the embodiment of the present invention.
Specific embodiment
Schema is please referred to, wherein identical component symbol represents identical component, the principle of the present invention is to implement one
It is illustrated in computing environment appropriate.Following will be combined with the drawings in the embodiments of the present invention, in the embodiment of the present invention
Technical solution is clearly and completely described, it is clear that and described embodiments are only a part of the embodiments of the present invention, without
It is whole embodiments.Based on the embodiments of the present invention, those skilled in the art are without creative efforts
Every other embodiment obtained, shall fall within the protection scope of the present invention.
In the following description, specific embodiments of the present invention will refer to the step as performed by one or multi-section computer
And symbol illustrates, unless otherwise stating clearly.Therefore, these steps and operation will have to mention for several times is executed by computer, this paper institute
The computer execution of finger includes by representing with the computer processing unit of the electronic signal of the data in a structuring pattern
Operation.This operation is converted at the data or the position being maintained in the memory system of the computer, reconfigurable
Or in addition change the running of the computer in mode known to the tester of this field.The maintained data structure of the data
For the provider location of the memory, there is the specific feature as defined in the data format.But the principle of the invention is with above-mentioned text
Word illustrates that be not represented as a kind of limitation, this field tester will appreciate that plurality of step and behaviour as described below
Also it may be implemented in hardware.
Term as used herein " module " can regard the software object to execute in the arithmetic system as.It is as described herein
Different components, module, engine and service can be regarded as the objective for implementation in the arithmetic system.And device as described herein and side
Method is preferably implemented in the form of software, can also be implemented on hardware certainly, within that scope of the present invention.
The embodiment of the present invention provides a kind of based on the image processing method and system of wearing display equipment.Below will respectively into
Row is described in detail.
Referring to Fig. 1, Fig. 1 is flow chart of the embodiment of the present invention based on the image processing method for wearing display equipment.?
In the present embodiment, provide a kind of based on the image processing method method for wearing display equipment.The method comprising the steps of:
Step S101, image to be played is obtained.
For example, the available image to be played wearing display device Host and transmitting, it can also be by otherwise
Obtain image to be played.
Step S102, the image to be played is parsed, with the attribute information of the determination image to be played.
For obtaining and wear the image to be played that display device Host transmits, which is solved
Analysis, obtains the attribute information of the image to be played after parsing, such as image resolution ratio and pixel number.
Step S103, judge whether the attribute information meets preset condition；
For example, the attribute information is the resolution ratio of image to be played, judge whether the resolution ratio of image to be played is greater than
Default resolution ratio；If so, the resolution ratio of the image to be played meets preset condition, then it is the image transmitting to be played is aobvious to wearing
Show in the display interface of equipment.If it is not, the resolution ratio of the image to be played is unsatisfactory for preset condition, then to the image to be played
Carry out next step operation.
Step S104, if it is not, then being handled based on default neural network model the image to be played, to obtain mesh
Logo image, wherein the image quality of the target image is higher than the image quality of the image to be played；
For example, being waited for based on default neural network model this if the resolution ratio of image to be played is unsatisfactory for preset condition
It plays image to carry out eliminating sawtooth and pixel backfill processing, to obtain target image.Wherein, the picture matter of the target image
Amount is higher than the image quality of the image to be played.
Step S105, the target image is shown in the display interface for wearing display equipment.
Specifically, target image is transmitted on the display worn in display equipment, to wear the aobvious of display equipment
Show target image described in interface display.
From the foregoing, it will be observed that it is provided in this embodiment based on the image processing method for wearing display equipment, it obtains first to be played
Image, and the image to be played is parsed, with the attribute information of the determination image to be played；Then judge the category
Whether property information meets preset condition；If it is not, then the image to be played is handled based on default neural network model, with
Obtain target image；Finally the target image is shown in the display interface for wearing display equipment.This method is based on nerve
Network model handles the image to be played, reduces sawtooth sense, improves the clarity of display image, and is not required to
Improve video card configuration.
Referring to Fig. 2, Fig. 2 is another process of the embodiment of the present invention based on the image processing method for wearing display equipment
Figure.This method comprises:
Step S201, image to be played is obtained.
For example, the available image to be played wearing display device Host and transmitting, it can also be by otherwise
Obtain image to be played.
Step S202, the image to be played is parsed, with the attribute information of the determination image to be played.
For obtaining and wear the image to be played that display device Host transmits, which is solved
Analysis, obtains the attribute information of the image to be played after parsing, such as image resolution ratio and pixel number.
Step S203, judge whether the attribute information meets preset condition.
For example, the attribute information is the resolution ratio of image to be played, judge whether the resolution ratio of image to be played is greater than
Default resolution ratio；If so, the resolution ratio of the image to be played meets preset condition, then it is the image transmitting to be played is aobvious to wearing
Show in the display interface of equipment.If it is not, the resolution ratio of the image to be played is unsatisfactory for preset condition, then to the image to be played
Carry out next step operation.
Step S204, based on default neural network model, eliminate sawtooth processing to the image to be played to obtain
Anti-aliased image.
For example, eliminate sawtooth processing to image to be played based on default full-screen anti-aliasing neural network model to obtain
To anti-aliased image.Its main method is will to will cause the pixel of sawtooth in image border and cause the picture around aliased pixels
Element makees an average operation, i.e., samples to the image to be played, the sawtooth sense of smaller image, to reach image smoothing
Effect, to obtain anti-aliased image.Specifically, can by super sampling anti-aliasing (SSAA) technology to image to be played into
Row eliminates sawtooth processing, the current resolution ratio of image to be played is significantly improved first, such as the resolution ratio of present image is
1024*768, after opening twice of SSAA, picture is amplified to 2048*1536, and this makes it possible to the sawtooth senses for significantly reducing image
?.
Step S205, based on default neural network model, pixel backfill processing is carried out to obtain to the image to be played
Repair image.
The method for obtaining repairing image is specifically as follows: based on default neural network model, the default neural network model
Can be DRCN (Deeply-Recursive Convolutional Network for Image Super-Resolution)
Model carries out pixel backfill processing to the image to be played if the resolution ratio of image to be played is unsatisfactory for preset condition to obtain
To reparation image.Specifically, referring to Fig. 3, Fig. 3 is default neural network schematic diagram provided in an embodiment of the present invention, the network
It include: insertion sub-network (Embedding network), reasoning sub-network (Inference Network) and reconstruction subnet
Network (Reconstruction Network).Input picture is mainly changed into a series of feature by Embedding network
Image indicates that the sub-network is mainly focused on extracting feature, and characteristic image is sent into Inference Network and goes to restore low
The high-definition picture lacked in image in different resolution.And Inference Net is then the most important sub-network of present networks, it is main
If the high frequency detail of processing super-resolution process is resumed work.Inference Net is a recursive sub-network, by not
In the case where increasing number of parameters, the receptive field of increase network big as far as possible.Inference Net uses recursive convolution layer,
Each recurrence all uses the convolution kernel as last time, therefore, while increasing receptive field, does not introduce additional ginseng
Number.It is obtained it should be noted that each layer of Inference Net of convolution results all pass through the same Reconstruction Net
To a reconstructed results, so that several reconstructed results be obtained, Reconstruction Net adds several reconstructed results
Weight average obtains final output, that is, repairs image.
It should be noted that the execution sequence of step S204 and step S205 are in no particular order.
Step S206, target image is placed in corresponding position, is superimposed on the target object in the image of reality scene,
To obtain augmented reality picture.
It is provided in this embodiment based on wear display equipment image processing method, obtain image to be played first, and right
The image to be played is parsed, with the attribute information of the determination image to be played；Then judging the attribute information is
It is no to meet preset condition；If it is not, then based on default neural network model, to the image to be played eliminate sawtooth processing with
Anti-aliased image is obtained, and is based on default neural network model, pixel backfill processing is carried out to obtain to the image to be played
To reparation image, and the anti-aliased image and the reparation image are integrated, to obtain target image；Finally in the head
The display interface for wearing display equipment shows the target image.This method be based on neural network model to the image to be played into
Row processing, reduces sawtooth sense, improves the clarity of display image, and does not need to improve video card configuration.
Referring to fig. 4, Fig. 4 is schematic diagram of the embodiment of the present invention based on the image processing system for wearing display equipment.
This is based on the image processing system for wearing display equipment, comprising:
Acquiring unit 301, for obtaining image to be played；
For example, the available image to be played wearing display device Host and transmitting of acquiring unit 301, acquiring unit
301 can also be by obtaining image to be played otherwise
Resolution unit 302 is believed for parsing to the image to be played with the attribute of the determination image to be played
Breath；
For obtaining and wear the image to be played that display device Host transmits, resolution unit 302 is to be played to this
Image is parsed, and obtains the attribute information of the image to be played after parsing, such as image resolution ratio and pixel number
Deng.
Judging unit 303, for judging whether the attribute information meets preset condition；
For example, the attribute information is the resolution ratio of image to be played, judging unit 303 judges the resolution of image to be played
Whether rate is greater than default resolution ratio；If so, the resolution ratio of the image to be played meets preset condition, then the image to be played is passed
It transports in the display unit 305 for wearing display equipment.If it is not, the resolution ratio of the image to be played is unsatisfactory for preset condition, then
To the image transmitting to be played into processing unit 304.
Processing unit 304, for handling the image to be played based on preset neural network model, with
To target image；
For example, being waited for based on default neural network model this if the resolution ratio of image to be played is unsatisfactory for preset condition
It plays image to carry out eliminating sawtooth and pixel backfill processing, to obtain target image.Wherein, the picture matter of the target image
Amount is higher than the image quality of the image to be played.Therefore, processing unit 304 includes antialiasing subelement 306 and repairs sub
Unit 307, as shown in Figure 5.
For example, based on default full-screen anti-aliasing neural network model, sawtooth subelement 306 eliminates image to be played
Sawtooth processing is to obtain anti-aliased image.Its main method is will to will cause the pixel of sawtooth in image border and cause sawtooth
Pixel around pixel makees an average operation, i.e., samples to the image to be played, the sawtooth sense of smaller image, to reach
To the effect of image smoothing, to obtain anti-aliased image.Specifically, super sampling anti-aliasing (SSAA) technology pair can be passed through
Image to be played carries out eliminating sawtooth processing, the current resolution ratio of image to be played is significantly improved first, such as present image
Resolution ratio be 1024*768, open twice of SSAA after, picture is amplified to 2048*1536, and this makes it possible to significantly reduce figure
The sawtooth sense of picture.
And the method for obtaining repairing image is based on default neural network model, which can be DRCN
(Deeply-Recursive Convolutional Network for Image Super-Resolution) model, if to
The resolution ratio for playing image is unsatisfactory for preset condition, repairs subelement 307 and carries out pixel backfill processing to the image to be played
To obtain repairing image.Specifically, referring to Fig. 3, Fig. 3 be default neural network schematic diagram provided in an embodiment of the present invention, should
Network includes: insertion sub-network (Embedding network), reasoning sub-network (Inference Network) and rebuilds
Sub-network (Reconstruction Network).Embedding network mainly changes into input picture a series of
Characteristic image indicates that the sub-network is mainly focused on extracting feature, and will go in characteristic image feeding Inference Network extensive
The high-definition picture lacked in multiple low-resolution image.And Inference Net is then the most important subnet of present networks
The high frequency detail of network, mainly processing super-resolution process is resumed work.Inference Net is a recursive sub-network,
In the case where not increasing number of parameters, the receptive field of increase network big as far as possible.Inference Net is rolled up using recurrence
Lamination, each recurrence all use the convolution kernel as last time, therefore, additional there is no introducing while increasing receptive field
Parameter.It should be noted that each layer of Inference Net of convolution results all pass through the same Reconstruction
Net obtains a reconstructed results, so that several reconstructed results be obtained, several are rebuild and are tied by Reconstruction Net
Fruit is weighted and averaged to obtain final output, that is, repairs image.
Display unit 305, for showing the target image in the display interface for wearing display equipment.
In some embodiments, this system can also include sound laminating module, and sound laminating module is used for image
Reason system is overlapped voice signal, so that virtual image is more life-like.Such as increase the sound walked, rainy sound.
Voice signal can also change intensity of sound according to occurring source relative motion, such as the sound of an automobile, with connecing for distance
Close and intensity of sound is increasing, with the separate of distance, intensity of sound is smaller and smaller.
It should be noted that above embodiment can be shown by wear-type virtual reality device, wear-type is virtually existing
Real equipment can be wirelessly connected with server, and wireless mode includes the modes such as WIFI connection, bluetooth connection.Wherein wear-type is empty
Quasi- real world devices can be the VR helmet, VR glasses etc..
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to above with respect to the detailed description based on the image processing method for wearing display equipment, details are not described herein again.
When it is implemented, above each device can be used as independent entity to realize, any combination can also be carried out, is made
It is realized for same or several entities, the specific implementation of above each device can be found in the embodiment of the method for front, herein not
It repeats again.
It is provided in an embodiment of the present invention based on the image processing system for wearing display equipment, acquiring unit 301 obtains first
Image to be played, then resolution unit 302 parses the image to be played, with the attribute of the determination image to be played
Information；Judge whether the attribute information meets preset condition followed by judging unit 303；If it is not, then processing unit 304 is based on
Default neural network model handles the image to be played, to obtain target image；Finally in the aobvious of display unit 305
Show target image described in interface display.This system processing unit 304 is based on neural network model and carries out to the image to be played
Processing, reduces the sawtooth sense of image to be played, improves the clarity of image to be played, and does not need raising video card and match
It sets.
This specifically can integrate in virtual reality device based on the image processing system for wearing display equipment.
Referring to Fig. 5, Fig. 5 is the schematic diagram of server involved in the embodiment of the present invention.In the present embodiment, the server
It may include radio frequency (RF, Radio Frequency) circuit 601, include one or more computer-readable storage medium
The memory 602 of matter, input module 603, display module 604, sensor 605, voicefrequency circuit 606, Wireless Fidelity (WiFi,
Wireless Fidelity) module 607, include one or more than one the processor 608 and power supply of processing core
609 equal components.It will be understood by those skilled in the art that server shown in Fig. 6 is not constituted to image processing server
It limits, may include perhaps combining certain components or different component layouts than illustrating more or fewer components.Wherein:
RF circuit 601 can be used for receiving and sending messages or communication process in, signal sends and receivees, particularly, by base station
After downlink information receives, one or the processing of more than one processor 608 are transferred to；In addition, the data for being related to uplink are sent to
Base station.In general, RF circuit 601 includes but is not limited to antenna, at least one amplifier, tuner, one or more oscillators, uses
Family identity module (SIM, Subscriber Identity Module) card, transceiver, coupler, low-noise amplifier
(LNA, Low Noise Amplifier), duplexer etc..In addition, RF circuit 601 can also by wireless communication with network and its
He communicates equipment.Any communication standard or agreement, including but not limited to global system for mobile telecommunications system can be used in the wireless communication
Unite (GSM, Global System of Mobile communication), general packet radio service (GPRS, General
Packet Radio Service), CDMA (CDMA, Code Division Multiple Access), wideband code division it is more
Location (WCDMA, Wideband Code Division Multiple Access), long term evolution (LTE, Long Term
Evolution), Email, short message service (SMS, Short Messaging Service) etc..
Memory 602 can be used for storing software program and module, and processor 608 is stored in memory 602 by operation
Software program and module, thereby executing various function application and data processing.Memory 602 can mainly include storage journey
Sequence area and storage data area, wherein storing program area can application program needed for storage program area, at least one function etc.；
Storage data area, which can be stored, uses created data (such as model, replacement object etc.) etc. according to server.In addition, storage
Device 602 may include high-speed random access memory, can also include nonvolatile memory, for example, at least a disk storage
Device, flush memory device or other volatile solid-state parts.Correspondingly, memory 602 can also include that memory controls
Device, to provide the access of processor 608 and input module 603 to memory 602.
Input module 603 can be used for receiving the number or character information of input, and generate and user setting and function
Control related microphone, touch screen, body-sensing input equipment, keyboard, mouse, operating stick, optics or trackball signal input.
Specifically, in a specific embodiment, input module 603 may include touch sensitive surface and other input equipments.Touch-sensitive table
Face, also referred to as touch display screen or Trackpad, collect user on it or nearby touch operation (such as user use hand
The operation of any suitable object or attachment such as finger, stylus on touch sensitive surface or near touch sensitive surface), and according to setting in advance
Fixed formula drives corresponding attachment device.Optionally, touch sensitive surface may include touch detecting apparatus and touch controller two
Part.Wherein, the touch orientation of touch detecting apparatus detection user, and touch operation bring signal is detected, signal is transmitted
To touch controller；Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate, then send
To processor 608, and order that processor 608 is sent can be received and executed.Furthermore, it is possible to using resistance-type, condenser type,
The multiple types such as infrared ray and surface acoustic wave realize touch sensitive surface.In addition to touch sensitive surface, input module 603 can also include it
His input equipment.Specifically, other input equipments can include but is not limited to physical keyboard, function key (for example press by volume control
Key, switch key etc.), trace ball, mouse, one of operating stick etc. or a variety of.
Display module 604 can be used for showing information input by user or be supplied to user information and terminal it is various
Graphical user interface, these graphical user interface can be made of figure, text, icon, video and any combination thereof.Display
Module 604 may include display panel, optionally, can using liquid crystal display (LCD, Liquid Crystal Display),
The forms such as Organic Light Emitting Diode (OLED, Organic Light-Emitting Diode) configure display panel.Further
, touch sensitive surface can cover display panel, after touch sensitive surface detects touch operation on it or nearby, send processing to
Device 608 is followed by subsequent processing device 608 and is provided on a display panel accordingly according to the type of touch event to determine the type of touch event
Visual output.Although touch sensitive surface and display panel are to realize input and input as two independent components in Fig. 6
Function, but in some embodiments it is possible to touch sensitive surface and display panel are integrated and realizes and outputs and inputs function.
Server may also include at least one sensor 605, such as optical sensor, motion sensor and other sensings
Device.Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel, and proximity sensor can be moved in one's ear in virtual augmented reality product repairing
When, close display panel and/or backlight.As a kind of motion sensor, gravity accelerometer can detect all directions
The size of upper (generally three axis) acceleration, can detect that size and the direction of gravity, can be used to identify mobile phone posture when static
Application (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (for example pedometer, strikes
Hit) etc.；The other sensors such as the gyroscope, barometer, hygrometer, thermometer, the infrared sensor that can also configure as terminal,
Details are not described herein.But it is understood that and be not belonging to must be configured into for server, can according to need completely not
Change in the range of the essence of invention and omits.
Voicefrequency circuit 606, loudspeaker, microphone can provide the audio interface between user and terminal.Voicefrequency circuit 606 can
By the electric signal after the audio data received conversion, it is transferred to loudspeaker, voice signal output is converted to by loudspeaker；It is another
The voice signal of collection is converted to electric signal by aspect, microphone, is converted to audio data after being received by voicefrequency circuit 606, then
After the processing of audio data output processor 608, it is sent to such as another terminal through RF circuit 601, or by audio data
Output is further processed to memory 602.Voicefrequency circuit 606 is also possible that earphone jack, with provide peripheral hardware earphone with
The communication of terminal.
WiFi belongs to short range wireless transmission technology, and terminal can help user's transceiver electronics postal by WiFi module 607
Part, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 6 is shown
WiFi module 607, but it is understood that, and it is not belonging to must be configured into for server, it is can according to need completely not
Change in the range of the essence of invention and omits.
Processor 608 is the control centre of terminal, using the various pieces of various interfaces and the entire server of connection,
By running or execute the software program and/or module that are stored in memory 602, and calls and be stored in memory 602
Data, the various functions of execute server and processing data, to carry out integral monitoring to server.Optionally, processor
608 may include one or more processing cores；Preferably, processor 608 can integrate application processor and modem processor,
Wherein, the main processing operation system of application processor, user interface and application program etc., modem processor mainly handles nothing
Line communication.It is understood that above-mentioned modem processor can not also be integrated into processor 608.
Image processing server further includes the power supply 609 (such as battery) powered to all parts, it is preferred that power supply can be with
It is logically contiguous by power-supply management system and processor 608, thus by power-supply management system realize management charging, electric discharge, with
And the functions such as power managed.Power supply 609 can also include one or more direct current or AC power source, recharging system,
The random components such as power failure detection circuit, power adapter or inverter, power supply status indicator.
Although being not shown, image processing server can also include camera, bluetooth module etc., and details are not described herein.Tool
In the present embodiment, the processor 608 in server can be according to following instruction, by one or more application program for body
The corresponding executable file of process be loaded into memory 602, and run by processor 608 storage in the memory 602
Application program, to realize various functions:
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to the detailed description above with respect to information sharing method, details are not described herein again.
It is provided in an embodiment of the present invention based on wear display equipment image processing system, be for example computer, plate electricity
Brain, mobile phone with touch function etc., it is described based in the image processing system and foregoing embodiments of wearing display equipment
Belong to same design based on the image processing method for wearing display equipment, described based on the image procossing system for wearing display equipment
It is specific real based on either offer in the image processing method embodiment for wearing display equipment method described in being run on system
Now process is detailed in described based on the image processing method embodiment for wearing display equipment, and details are not described herein again.
It should be noted that this field is commonly surveyed to the present invention is based on for the image processing method for wearing display equipment
Examination personnel are understood that realize all or part based on the image processing method for wearing display equipment described in the embodiment of the present invention
Process is relevant hardware can be controlled by computer program to complete, and the computer program can be stored in a calculating
It in machine read/write memory medium, is such as stored in the memory of server, and is held by least one processor in the server
Row may include the process such as the embodiment based on the image processing method for wearing display equipment in the process of implementation.Wherein,
The storage medium can be magnetic disk, CD, read-only memory (ROM, Read Only Memory), random access memory
(RAM, Random Access Memory) etc..
For the embodiment of the present invention is based on the image processing system for wearing display equipment, each functional module can collect
In Cheng Yi processing chip, it is also possible to modules and physically exists alone, it can also be integrated with two or more modules
In a module.Above-mentioned integrated module both can take the form of hardware realization, can also be using software function module
Form is realized.If the integrated module is realized in the form of software function module and sells or use as independent product
When, also can store in a computer readable storage medium, the storage medium is for example read-only memory, disk or
CD etc..
Be provided for the embodiments of the invention above it is a kind of based on wear display equipment image processing method and system into
It has gone and has been discussed in detail, used herein a specific example illustrates the principle and implementation of the invention, the above implementation
The explanation of example is merely used to help understand method and its core concept of the invention；Meanwhile for those skilled in the art, according to
According to thought of the invention, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification
It should not be construed as limiting the invention.
Claims (10)
1. a kind of based on the image processing method for wearing display equipment characterized by comprising
Obtain image to be played；
The image to be played is parsed, with the attribute information of the determination image to be played；
Judge whether the attribute information meets preset condition；
If it is not, then being handled based on default neural network model the image to be played, to obtain target image, wherein
The image quality of the target image is higher than the image quality of the image to be played；
The target image is shown in the display interface for wearing display equipment.
2. image processing method according to claim 1, which is characterized in that the attribute information includes resolution ratio；
It is described that the step of whether attribute information meets preset condition judged, comprising:
Judge whether the resolution ratio is greater than default resolution ratio；
If so, determining that the attribute information meets preset condition；
If it is not, then determining that the attribute letter is unsatisfactory for preset condition.
3. image processing method according to claim 1, which is characterized in that described to be based on default neural network model to institute
It states image to be played to be handled, the step of to obtain target image, comprising:
Based on default neural network model, eliminate sawtooth processing to the image to be played with obtain anti-aliased image, with
And pixel backfill processing is carried out to obtain repairing image to the image to be played；
The anti-aliased image and the reparation image are integrated, to obtain target image.
4. image processing method according to claim 3, described to carry out eliminating sawtooth processing to the image to be played
Step, comprising:
It is handled using pixel of the sampling algorithm to the image to be played, obtains anti-aliased image.
5. image processing method according to claim 3, described to carry out pixel backfill processing to the image to be played
Step, comprising:
Extract the characteristic information of the image to be played；
Conversion process is carried out to the characteristic information, characteristic image is obtained according to the characteristic information after conversion process；
The characteristic image is handled, obtains repairing image.
6. image processing method according to claim 1-5, which is characterized in that described to wear display described and set
The step of standby display interface shows the target image, comprising:
Target image is placed in corresponding position, is superimposed on the target object in the image of reality scene, it is existing to obtain enhancing
Real picture.
7. a kind of based on the image processing system for wearing display equipment characterized by comprising
Acquiring unit, for obtaining image to be played；
Resolution unit, for being parsed to the image to be played, with the attribute information of the determination image to be played；
Judging unit, for judging whether the attribute information meets preset condition；
Processing unit, for handling the image to be played based on preset neural network model, to obtain target
Image；
Display unit, for showing the target image in the display interface for wearing display equipment.
8. according to claim 7 based on the image processing system for wearing display equipment, which is characterized in that
The judging unit, specifically for judging whether the resolution ratio is greater than default resolution ratio.
9. according to claim 8 based on the image processing system for wearing display equipment, which is characterized in that the processing is single
Member includes:
Antialiasing subelement handles specifically for the pixel to the image to be played, obtains anti-aliased image；
Subelement is repaired, specifically for extracting the characteristic information of the image to be played；The characteristic information is carried out at transformation
Reason, obtains characteristic image according to the characteristic information after conversion process.
10. according to claim 6 based on the image processing system for wearing display equipment, which is characterized in that
Target image is placed in corresponding position by the display unit, is superimposed on the target object in the image of reality scene,
To obtain augmented reality picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810277821.8A CN110324705A (en) | 2018-03-30 | 2018-03-30 | It is a kind of based on wear display equipment image processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810277821.8A CN110324705A (en) | 2018-03-30 | 2018-03-30 | It is a kind of based on wear display equipment image processing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110324705A true CN110324705A (en) | 2019-10-11 |
Family
ID=68111874
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810277821.8A Pending CN110324705A (en) | 2018-03-30 | 2018-03-30 | It is a kind of based on wear display equipment image processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110324705A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116055778A (en) * | 2022-05-30 | 2023-05-02 | 荣耀终端有限公司 | Video data processing method, electronic device and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6466206B1 (en) * | 1998-02-17 | 2002-10-15 | Sun Microsystems, Inc. | Graphics system with programmable real-time alpha key generation |
| CN103116451A (en) * | 2013-01-25 | 2013-05-22 | 腾讯科技（深圳）有限公司 | Virtual character interactive method, device and system of intelligent terminal |
| CN105916096A (en) * | 2016-05-31 | 2016-08-31 | 努比亚技术有限公司 | Sound waveform processing method and device, mobile terminal and VR head-mounted device |
| CN107371012A (en) * | 2017-07-04 | 2017-11-21 | 歌尔科技有限公司 | A kind of VR image procossings and display methods and device |
-
2018
- 2018-03-30 CN CN201810277821.8A patent/CN110324705A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6466206B1 (en) * | 1998-02-17 | 2002-10-15 | Sun Microsystems, Inc. | Graphics system with programmable real-time alpha key generation |
| CN103116451A (en) * | 2013-01-25 | 2013-05-22 | 腾讯科技（深圳）有限公司 | Virtual character interactive method, device and system of intelligent terminal |
| CN105916096A (en) * | 2016-05-31 | 2016-08-31 | 努比亚技术有限公司 | Sound waveform processing method and device, mobile terminal and VR head-mounted device |
| CN107371012A (en) * | 2017-07-04 | 2017-11-21 | 歌尔科技有限公司 | A kind of VR image procossings and display methods and device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116055778A (en) * | 2022-05-30 | 2023-05-02 | 荣耀终端有限公司 | Video data processing method, electronic device and readable storage medium |
| CN116055778B (en) * | 2022-05-30 | 2023-11-21 | 荣耀终端有限公司 | Video data processing method, electronic device and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104134230B (en) | A kind of image processing method, device and computer equipment | |
| CN103905885B (en) | Net cast method and device | |
| CN104618217B (en) | Share method, terminal, server and the system of resource | |
| CN105867730B (en) | The display methods and device of status bar | |
| CN109213728A (en) | Cultural relic exhibition method and system based on augmented reality | |
| CN104298491B (en) | Message treatment method and device | |
| CN104252341B (en) | The client device of the skin change method of application program, device and application program | |
| CN105022616A (en) | Method and device for generating web page | |
| CN107122760A (en) | Fingerprint identification method and related product | |
| CN109213885A (en) | Car show method and system based on augmented reality | |
| CN103313139A (en) | History display method and device and electronic device | |
| CN109426783A (en) | Gesture identification method and system based on augmented reality | |
| CN107943417A (en) | Image processing method, terminal, computer-readable storage medium and computer program | |
| CN109934220A (en) | A kind of methods of exhibiting, device and the terminal of image point of interest | |
| CN106127829A (en) | The processing method of a kind of augmented reality, device and terminal | |
| CN106504303B (en) | A kind of method and apparatus playing frame animation | |
| CN104915091A (en) | Method and device for displaying status bar prompt message | |
| CN104699501B (en) | A kind of method and device for running application program | |
| CN110070129A (en) | A kind of image detecting method, device and storage medium | |
| CN105447124A (en) | Virtual article sharing method and device | |
| CN107770478A (en) | video call method and related product | |
| CN104571778B (en) | screen locking picture setting method and device | |
| CN108958629A (en) | Split screen exits method, apparatus, storage medium and electronic equipment | |
| CN107171740A (en) | Radio frequency interference processing method, device, storage medium and terminal | |
| CN107396193B (en) | The method and apparatus of video playing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191011 |