CN110505471A - One kind wearing display equipment and its screen capture method, apparatus - Google Patents

One kind wearing display equipment and its screen capture method, apparatus Download PDF

Info

Publication number
CN110505471A
CN110505471A CN201910688257.3A CN201910688257A CN110505471A CN 110505471 A CN110505471 A CN 110505471A CN 201910688257 A CN201910688257 A CN 201910688257A CN 110505471 A CN110505471 A CN 110505471A
Authority
CN
China
Prior art keywords
screen
trigger action
virtual extended
original image
screenshotss
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910688257.3A
Other languages
Chinese (zh)
Other versions
CN110505471B (en
Inventor
李为
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Pico Technology Co Ltd
Original Assignee
Qingdao Pico Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Pico Technology Co Ltd filed Critical Qingdao Pico Technology Co Ltd
Priority to CN201910688257.3A priority Critical patent/CN110505471B/en
Publication of CN110505471A publication Critical patent/CN110505471A/en
Application granted granted Critical
Publication of CN110505471B publication Critical patent/CN110505471B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781Games
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video

Abstract

This application discloses one kind to wear display equipment and its screen capture method, apparatus.Method includes: to obtain under screen capture Optimizing Mode and wear the corresponding original image of the 3D rendering that shows in display device screen with described;In response to specifying trigger action, corresponding screen capture file is generated according to the original image;Wherein, the specified trigger action includes screenshotss trigger action, record screen trigger action and throwing screen trigger action.The embodiment of the present application avoids the problem of being directly acquired to the image of left and right split screen and presence distortion, lead to follow-up play and poor display effect, poor user experience.

Description

One kind wearing display equipment and its screen capture method, apparatus
Technical field
This application involves wear display equipment technical field, and in particular to one kind wears display equipment and its screen capture side Method, device.
Background technique
Existing many mobile end equipments (such as mobile phone) obtain when carrying out the operation of the screen captures such as throwing screen/record screen/screenshotss To picture material and mobile phone screen on show consistent, be 2D image, this is mobile terminal system such as android system The scene of the state of default itself and user and developer's habit.
But if display equipment (such as Virtual Reality equipment) is worn by being applied to the operation of the screen capture of mobile phone In, 3D rendering is shown in display device screen due to wearing, directly progress screen capture, then obtained throwing screen file/ Image in record screen file/screenshotss file is left and right split screen and the image that there is distortion, influences subsequent viewing effect.
Summary of the invention
The present invention provides one kind to wear display equipment and its screen capture method, apparatus, is generated and is thrown based on original image Shield file/record screen file/screenshotss file, avoid directly to left and right split screen and exist distortion image be acquired cause it is subsequent The problem of playing with poor display effect, poor user experience.
According to the one aspect of the application, a kind of screen capture method for wearing display equipment is provided, comprising:
Under screen capture Optimizing Mode, obtains and wear the corresponding original of the 3D rendering that shows in display device screen with described Beginning image;
In response to specifying trigger action, corresponding screen capture file is generated according to the original image;
Wherein, the specified trigger action includes screenshotss trigger action, record screen trigger action and throwing screen trigger action.
According to further aspect of the application, a kind of screen capture device for wearing display equipment is provided, comprising:
Image collection module is shown in display device screen for obtaining under screen capture Optimizing Mode with described wear The corresponding original image of the 3D rendering shown;
Screen capture module, for generating corresponding screen according to the original image and adopting in response to specifying trigger action Collect file;Wherein, the specified trigger action includes screenshotss trigger action, record screen trigger action and throwing screen trigger action.
According to another aspect of the application, provides one kind and wear display equipment, comprising: processor, and be configured For store computer executable instructions memory,
The executable instruction realizes the step of the method as described in the application one aspect when being executed by the processor Suddenly.
It is obtained under screen capture Optimizing Mode using the screen capture scheme for wearing display equipment of the embodiment of the present application Original image corresponding with the 3D rendering that shows in display device screen is worn is taken, in response to specifying trigger action, according to original Image generates corresponding screen capture file, on the one hand, be related to when wearing display equipment progress screenshotss/record screen/throwing screen etc. To display content acquisition function when, under the premise of not influencing to wear display device screen display itself, to screenshotss/record screen/ It throws screen file to optimize, improves screenshotss/record screen/subsequent display effect of throwing screen file, support screenshotss/record screen/throwing screen etc. a variety of Application scenarios, it is versatile.On the other hand, it is adopted using wearing corresponding with 3D rendering original image in display equipment and generate screen Collect file, guarantees the lossless process of content, while turning the process of 2D image without 3D rendering, performance consumption is lower.
Detailed description of the invention
Fig. 1 is the flow diagram of the screen capture method for wearing display equipment of the application one embodiment;
Fig. 2 is the flow chart of the screen capture method for wearing display equipment of the application another embodiment;
Fig. 3 is the block diagram of the screen capture device for wearing display equipment of the application one embodiment;
Fig. 4 is the block diagram for wearing display equipment of the application one embodiment.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real Applying mode, the present invention is described in further detail.Obviously, described embodiments are some of the embodiments of the present invention, without It is whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not before making creative work Every other embodiment obtained is put, shall fall within the protection scope of the present invention.
For ease of understanding, screen capture is illustrated here.Screen capture is to carry out multimedia collection to device screen Operation, mainly include screenshotss, record screen and throw screen three kinds.Screenshotss are the operations for showing content on screen printing and saving into image. Record screen mainly carries out multi-medium data acquisition to the screen of terminal, and generates the process of video file.Throw screen be by one to The content for throwing the terminal (such as wearing display equipment, mobile phone) of screen shares to other terminal device (usually electricity for having display screen Depending on) on play out.
Display equipment (Head Mount Display, abbreviation HMD) is worn, i.e. head is aobvious, shows and sets by various wear-types It is standby, optical signalling is sent to user, the different effects such as virtual reality (VR), augmented reality (AR), mixed reality (MR) may be implemented Fruit.VR (Virtual Reality, virtual reality) equipment, AR (Augmented Reality, augmented reality) equipment, MR equipment Difference between (Mixed Reality, mixed reality) three is that the object that user sees in virtual reality device is all virtual Out;Augmented reality equipment is virtual thing to be added on the thing of reality;And mixed reality equipment is first true Thing virtualization, be then added in virtual world.
By taking VR equipment as an example, mostly uses right and left eyes to be displayed separately greatly in VR application at present, i.e., exported simultaneously when screen is shown Two images: the right view image of the left view image of corresponding left eye and corresponding right eye, to realize that 3D is imitated by binocular vision difference Fruit.That is, in VR equipment, although user it is seen that a normal image, its real user be through VR equipment, Respectively by right and left eyes, there are also the images that optical lens is seen, if user directly sees the content on VR device display screen curtain, meeting It is the discovery that two images of left and right split screen and has distortion.
When wearing the operations such as display equipment progress screenshotss/record screen/throwing screen, obtained image is left and right split screen as the aforementioned And having the image of distortion, this will affect pictures subsequent display effect.In this regard, the embodiment of the present application proposes: separation is worn display and is set The content when functions such as the standby content seen to user and realization screenshotss/record screen/throwing screen, to improve screenshotss/record screen/throwing screen text The display effect and user experience of part.Here symbol "/" indicate or.
Fig. 1 is the flow diagram of the screen capture method for wearing display equipment of the application one embodiment;Referring to figure 1, the present embodiment wear display equipment screen capture method include:
Step S101 is obtained and is schemed with the 3D shown in display device screen that wears under screen capture Optimizing Mode As corresponding original image.
Screen optimization of collection mode can be configured in wearing display equipment in practical application, and by wearing display equipment User's interaction receive user the switch of screen capture Optimizing Mode selected.For example, the screen capture for receiving user's input is excellent The control instruction of change mode enters screen capture Optimizing Mode, and acquisition and institute if the control instruction is open command State the corresponding original image of the 3D rendering worn and shown in display device screen.That is, when the unlatching for receiving user refers to It when enabling, wears display equipment and enters screen capture Optimizing Mode, screen capture file is carried out in screen capture Optimizing Mode excellent Change.
Certainly, in some embodiments, user also can choose close screen capture Optimizing Mode, with directly to wearing it is aobvious Show that the 3D rendering shown on device screen carries out the operations such as screenshotss, record screen and throwing screen, the screen capture adapted under special scenes needs It wants.
Step S102 generates corresponding screen capture file according to the original image in response to specifying trigger action.Its In, the specified trigger action includes screenshotss trigger action, record screen trigger action and throwing screen trigger action.
After system judgement enters screen capture Optimizing Mode, the specified trigger action of user is detected, when detecting specified touching When hair operation occurs, in response to specifying the generation of trigger action, generated according to the original image obtained in previous step corresponding Screen capture file.Here original image is image corresponding with the 3D rendering that shows in display device screen is worn, note: 3D Image is obtained after handling according to the requirement for wearing display equipment 3D display effect original image, and 3D rendering includes left and right point Two images of screen, 3D rendering is there are certain distortion, and original image is worn in display equipment using (for example game is answered With, Video Applications) the original 2D image that generates.
Specified trigger action includes one of screenshotss, record screen and throwing screen or a variety of, that is to say, that the embodiment of the present application branch A variety of screen capture application scenarios are held, it is versatile.Record screen and the difference of screenshotss are that screenshotss are to the screen on a time point Image is intercepted, and recording screen is to showing on (such as 5 seconds, record screen has starting and end time) screen in a period of time Each video frame shown record and is saved into video flowing.Throwing screen is then each video frame real-time delivery for will showing on screen to another It is played out in terminal.Unlike screenshotss in the prior art, record screen and throwing screen, the embodiment of the present application is not direct enemy The screen picture for wearing display equipment is acquired, but generates screen capture file according to the corresponding original image of screen picture.
As shown in Figure 1 it is found that the screen capture method for wearing display equipment of the embodiment of the present application, solves and wear display Equipment screenshotss/record screen/subsequent display effect of throwing screen file is poor, the bad problem of user experience, supports screenshotss/record screen/throwing screen etc. Plurality of application scenes, it is versatile.And use is worn original image generation screen corresponding with 3D rendering in display equipment and is adopted Collect file, is theoretically obtainable the lossless process of content, display effect is more preferable, while being transformed into the mistake of 2D image without 3D Journey, performance consumption are lower.
In view of the requirement of different application scene sub-screen acquisition file is different, for example the resolution ratio of image is required when screenshotss Height, and resolution ratio can be lower when record screen, direct basis original image generates corresponding screen capture file and although can be avoided The problem of acquisition 3D rendering leads to subsequent poor display effect, but not can be carried out picture editting, image procossing, in this regard, the application Embodiment proposes creation virtual extended screen, and original image is output on virtual extended screen, based on virtual extended screen Content generate screen capture file, and the parameter of virtual extended screen and the parameter of original image support it is customized, in this way User can preset the parameter of virtual extended screen according to oneself demand, and edited, screened to original image, beat The processing such as watermark.
It is illustrated below with reference to realization step of the Fig. 2 to the method for the present embodiment, Fig. 2 is another embodiment of the application Wear display equipment screen capture method flow chart, referring to fig. 2,
Obtain the original image of HMD application.
Here HMD wears display equipment, it will be understood that wearing operation in display equipment has application, these applications are 3D application, such as 3D game.
SDK processing.
The application for wearing display equipment is needed using specific SDK (Software Development Kit, software development Kit) it is developed, what it is using generation is not the optical imagery for meeting HMD device requirement, and at this moment SDK can be to original image Processing, which generates HMD, needs optical imagery to be shown, i.e. the 3D rendering of adaptation binocular, adaptation HMD device optical texture in Fig. 2.
Judge whether to need to process, is to be reprocessed according to function, is otherwise output on physical display screen.
For 3D rendering, it can generally be directly displayed on the physical screen for wearing display equipment, consider some particular fields Scape, such as application render and carry out a game picture, normal flow be wear the picture of display game in display equipment, but if Screen currently is being recorded, it would be possible that the interface element for needing currently recording screen in game picture superposition instruction is (such as common Red spots) and the contents such as recording time, here it is reprocess 3D rendering according to function.
Referring to fig. 2, for original image, screenshotss/record screen/throwing screen trigger action is judged whether there is, is cut in no starting It is without processing for performance consideration in the case where screen/record screen/screen projection function.
That is, not handled original image if specified trigger action is not detected.
The detection of trigger action is the function of wearing display equipment and have, and can be realized using the prior art, for example, user Starting screenshotss function etc. is triggered by wearing the shortcut key triggering starting screenshotss function of display equipment, or by voice command, this In do not do excessive explanation.
With continued reference to Fig. 2, when detecting specified trigger action, that is, when there is screenshotss/record screen/throwing screen trigger action, this Application embodiment handles original image, and avoiding screenshotss file/record screen file/throwing screen file includes left and right split screen and presence Fault image.
In one embodiment, in response to specifying trigger action, virtual extended screen, each original graph that will acquire are created As being output on the virtual extended screen, based on the content of the virtual extended screen, corresponding screen capture file is generated.
Here in response to specify trigger action, creation virtual extended screen include: in response to the screenshotss trigger action, One or more of the record screen trigger action and throwing screen trigger action, create at least one virtual extended screen.
Referring to fig. 2, a virtual extended screen is created according to functional requirement (that is, screenshotss/record screen/throwing screen functional requirement) Curtain, and original image is processed as needed, it is output on virtual extended screen.Such as when screenshotss, user wishes To clearly image, then screen and image parameter can be arranged it is finer, and in user wishes when recording screen and throwing screen Appearance is smooth, can shield and throw the smaller of parameter (resolution ratio) setting shielded record, to guarantee that fluency is more preferable.
Followed by the content based on the virtual extended screen, corresponding screen capture file is generated, comprising: will be described The content of virtual extended screen is encoded, and the corresponding image file of screenshotss trigger action is generated, or, generating record screen triggering behaviour Work/corresponding the video file of throwing screen trigger action.That is, corresponding record screen function, by virtual extended screen research content at video flowing Form output is saved into video file.Virtual extended screen content is carried out coding and saved into image file by corresponding screenshotss function.It is right Screen projection function is answered, virtual extended screen research content is saved at video into video file.
It should be noted that the present embodiment can be corresponding according to specifically needing the content to virtual extended screen to carry out Processing, neither influence user watches 3D content by physical display screen, and available screenshotss/record screen/throwing screen display effect is more Good file.
It is aforementioned to be carried out with compatible screenshotss/record screen/screen projection function simultaneously, and only for one virtual extended screen of creation Explanation.In this case, the video frame and throw the size for the video frame that screen obtains, lattice that screenshotss obtain image, record screen obtain Formula etc. is identical.Screenshotss/record screen/three kinds of throwing screen function shares many treatment processes, therefore reduces the performance consumption of system.
Certainly, if screenshotss/requirement difference of the record screen/throwing screen to image is larger, muti-piece virtual extended screen can also be created The processing that curtain is distinguished.That is, in response to specifying trigger action, creating virtual extended in embodiments herein Screen includes: in response to the screenshotss trigger action, according to the creation of screenshotss parameter and the screenshotss parameter from screenshotss application The virtual extended screen of adaptation;Or, in response to the record shield trigger action, according to from record screen application recording parameter creation with The virtual extended screen for recording parameter adaptation;Or, shielding trigger action in response to the throwing, according to from the throwing for throwing screen application Shield parameter creation and the virtual extended screen for throwing screen parameter adaptation;Wherein, throwing screen parameter be based on current network state, It is determined wait throw the data volume of screen content, the resolution ratio for being thrown screen end, thrown at least one of the screen proportion at screen end information.
In one embodiment, if currently detected screenshotss trigger actions, according to screenshotss trigger action, creation with (the virtual extended screen of the application has resolution ratio category to first virtual extended screen of screenshotss parameter (such as resolution ratio) adaptation Property, user can be with the attribute value of custom resolution to adapt to different demands), it is virtual that the original image that will acquire is output to first In extended screen, the subsequent first virtual extended screen that is based on generates screenshotss image.If currently detected screenshotss trigger actions Shield trigger action with record, then it is virtual to create first be adapted to screenshotss parameter (such as resolution ratio) according to screenshotss trigger action Extended screen, the original image that will acquire are output on the second virtual extended screen, subsequent to be based on the life of the first virtual extended screen Shield trigger action at screenshotss image, and according to record, creates the second virtual extended being adapted to record screen parameter (such as resolution ratio) Screen, the original image that will acquire are output on the second virtual extended screen, and the subsequent second virtual extended screen that is based on generates record Shield video data.
In this way, being handled respectively screenshotss and record screen, for screenshotss function, relatively sharp image can be exported, for record Shield function, can export that clarity is low but video is shielded in the smaller record of small the occupancys memory space of data volume, it is each to meet different function From demand.Therefore, the favorable expandability of the present embodiment.
It wears and screenshotss application, the application of record screen is installed in display equipment and throw screen application, include setting in advance in screenshotss application The screenshotss parameter set, such as clarity, size these parameters of screenshotss image also include presetting in same record screen application Record screen parameter, throw screen application in also include throw screen parameter.Screen is thrown to be a difference in that applied to what the application of record screen and screenshotss were applied Throwing screen is to record and play the operating process that real-time is high, has compatibility requirements to receiving device, therefore throw screen parameter and be based on working as At least one of preceding network state, the data volume wait throw screen content, the resolution ratio for being thrown screen end, the screen proportion for being thrown screen end Information determines.The present embodiment by improve parameter come optimize throw screen effect, such as according to network state, amount of content data, thrown Shield the resolution ratio at end, thrown the best parameters of dynamic selects such as the screen proportion for shielding end to meet throwing screen demand.For example, due to electricity Different depending on the screen proportion of itself, the 3D picture for wearing display equipment cannot stretch, and otherwise easy ratio is not right, lead to user's body Test difference.The present embodiment by modification virtual extended screen parameter and output video flowing parameter, ensure that throwing screen content with Tv aspect ratio adaptation improves throwing screen effect directly with the output of parameter needed for TV.For another example, present mobile phone or It wears when display equipment throws screen and the slack situation of Caton often occurs, this programme can optimize this problem, according to current Network state, if network communication status well if improve the clarity of video and reduce the clear of video if network state is poor Clear degree, these can be realized by modifying the parameter of the parameter of virtual extended screen and the video flowing of output.
In the present embodiment, it includes: to described that each original image that will acquire, which is output on the virtual extended screen, Original image is output on the virtual extended screen after carrying out cutting processing;Or, the original image described in the multiframe of acquisition into Row screening, each original image filtered out is output on the virtual extended screen.
That is, after getting original image, according to screenshotss apply in parameter request original image is carried out It cuts, the original image after cutting is output on virtual extended screen, image processing requirements are met.In addition, carrying out record screen When Deng operating, the image of acquisition can be screened, only the original image filtered out being output on virtual extended screen, is kept away Having exempted from obtained record screen file includes the video content unrelated with target application, improves record screen effect.
It, should in the present embodiment after each original image that will acquire is output on the virtual extended screen Method further include: be embedded in watermarking images on each original image, obtain the content of the virtual extended screen.Add watermark It is that is conducive to by identification and is cut for the screenshotss file, record screen file or throwing screen file progress uniqueness label for wearing display equipment generation The source for shielding the screen captures files such as file, avoids dispute.
Hereafter explanation wears the screen capture process for showing equipment for recording the realization of screen function:
Operation 3D application in display equipment is worn, the image of 3D application is shown on wearing display device screen.
User triggers record screen function, and system shields function trigger event in response to record, creates one piece of virtual extended screen.
The red dot of the image superposition instruction record screen state of 3D application and record screen time are (that is, carry out content seen in user Transformation) after be shown in and wear in display device screen.
Original image (image of non-adaptation binocular) is output to virtual extended screen.
It is emphasized that being that original image is output to virtual extended screen here, so being that no user is wearing The instruction record screen state red dot seen in display equipment and record screen these interface elements of time, because these information are literary in record screen Nonsensical in part, therefore, the user experience of the embodiment of the present application is more preferable.
The content of virtual extended screen is carried out to be encoded into video file.
Can be with customized video parameter while coding, while this virtual extended screen can also be used to screenshot, this Sample flexibility is more preferable, and performance consumption is also small.And end processing sequences when record screen can be reduced.For example, during record screen, no Wish recorded video start or at the end of picture, then directly can be arranged and sentence to current picture in record screen function Disconnected, if current picture is not the picture of target 3D application (such as game application), these images are not output to virtually by control Extended screen goes modification record screen file, problem complicated for operation so as to avoid recording again later.
So far, the split screen distortion of 3D application is shown on the physical screen for wearing display equipment of the present embodiment and with record screen The image of information;And recording the file that screen obtains is that monocular is undistorted, (can not need aobvious by wearing for user's direct viewing Show equipment) image, do not record screen information, do not record that screen information is more reasonable, and experience is more preferable.
From the foregoing, it will be observed that the screen capture method for wearing display equipment of the embodiment of the present application, obtained record screen/screenshotss/throwing The files such as screen can be for user's direct viewing, and display effect is more preferable, and solving record shielding to 3D rendering in the prior art causes Poor user experience the problem of.Also, it can be compatible with simultaneously when screenshotss/record screen/screen projection function triggers simultaneously, i.e., it is compatible to cut Plurality of application scenes, the versatilities such as screen/record screen/throwing screen are good;A virtual extended screen can only be created to complete this three screens and adopt Collect function, the performance consumption of system is small, can also create the processing that muti-piece virtual screen is distinguished, favorable expandability.It is virtual to expand The parameter support of the parameter and original image of opening up screen is customized, can balance in performance and effect, flexibility is stronger.
Compared with being processed into the scheme of 2D image after first obtaining 3D rendering, the application's is more efficient;And in 3D Certainly there is the consumption in the loss and performance on image when being converted into 2D, and this programme directly uses original image, can accomplish The lossless process of content, effect is more preferable, while the process of translated image, performance consumption be not lower.
It should be noted that the description and claims of this application and term " first " in above-mentioned attached drawing, " Two " etc. be to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that using in this way Object be interchangeable under appropriate circumstances, so as to the embodiment of the present invention described herein can in addition to illustrating herein or Sequence other than those of description is implemented.
Fig. 3 is the block diagram of the screen capture device for wearing display equipment of the application one embodiment, referring to Fig. 3, this reality Apply example wear display equipment screen capture device 300 include:
Image collection module 301, for obtaining and being worn in display device screen with described under screen capture Optimizing Mode The corresponding original image of the 3D rendering of display;
Screen capture module 302, for generating corresponding screen according to the original image in response to specifying trigger action Acquire file;Wherein, the specified trigger action includes screenshotss trigger action, record screen trigger action and throwing screen trigger action.
In one embodiment of the application, the screen capture module 302 is specifically used for, in response to specified triggering behaviour Make, create virtual extended screen, each original image that will acquire is output on the virtual extended screen, is based on the void The content of quasi- extended screen, generates corresponding screen capture file.
In one embodiment of the application, the screen capture module 302 is specifically used for triggering in response to the screenshotss One or more of operation, record screen trigger action and throwing screen trigger action, create at least one virtual extended screen Curtain.
In one embodiment of the application, the screen capture module 302 is specifically used for triggering in response to the screenshotss Operation, the virtual extended screen according to screenshotss parameter creation and the screenshotss parameter adaptation from screenshotss application;Or, in response to Trigger action is shielded in the record, according to the recording parameter creation applied from record screen and the virtual extended screen for recording parameter adaptation Curtain;Or, shielding trigger action in response to the throwing, shield parameter adaptation with the throwing according to from the throwing screen parameter creation for throwing screen application Virtual extended screen;Wherein, described to throw the data volume shielded parameter based on current network state, wait throw screen content, thrown and shield end Resolution ratio, at least one of the screen proportion information of being thrown screen end determines.
In one embodiment of the application, the screen capture module 302 is specifically used for, and carries out to the original image It is output on the virtual extended screen after cutting processing;Or, the original image described in the multiframe of acquisition screens, will screen Each original image out is output on the virtual extended screen.
In one embodiment of the application, the screen capture module 302 is specifically used for, in each institute that will acquire It states after original image is output on the virtual extended screen, is embedded in watermarking images on each original image, obtains institute State the content of virtual extended screen;The content of the virtual extended screen is encoded, it is corresponding to generate screenshotss trigger action Image file, or the content of the virtual extended screen is encoded, the corresponding video file of record screen trigger action is generated, Or, the content of the virtual extended screen is encoded, the corresponding video file of record screen trigger action is generated.
In one embodiment of the application, the screen capture module 302 is specifically used for receiving the screen of user's input The control instruction of optimization of collection mode enters screen capture Optimizing Mode if the control instruction is open command, and obtains It takes and wears the corresponding original image of the 3D rendering that shows in display device screen with described.
The citing solution of each function performed by each module in the screen capture device of display equipment is worn shown in Fig. 3 Explanation is released, it is consistent with the illustration explanation in preceding method embodiment, it no longer repeats one by one here.
Fig. 4 is the block diagram for wearing display equipment of the application one embodiment.As shown in figure 4, this wears display equipment 400 Including processor 401, and it is configured as the memory 402 of storage computer executable instructions, the executable instruction is in quilt It is realized when the processor 401 executes such as the step of the aforementioned screen capture method for wearing display equipment.
In addition, the logical order in above-mentioned memory 402 can be realized by way of SFU software functional unit and conduct Independent product when selling or using, can store in a computer readable storage medium.Based on this understanding, originally Substantially the part of the part that contributes to existing technology or the technical solution can be in other words for the technical solution of invention The form of software product embodies, which is stored in a storage medium, including some instructions to So that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation of the application The all or part of the steps of example the method.And storage medium above-mentioned include: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. it is various It can store the medium of program code.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more, The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces The form of product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real The dress for the function of being specified in one box or multiple boxes of one process or multiple processes and/or block diagrams of present flow chart It sets.
It should be noted that the terms "include", "comprise" or its any other variant are intended to the packet of nonexcludability Contain, so that the process, method, article or equipment for including a series of elements not only includes those elements, but also including Other elements that are not explicitly listed, or further include for elements inherent to such a process, method, article, or device. In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element Process, method, article or equipment in there is also other identical elements.
In specification of the invention, numerous specific details are set forth.Although it is understood that the embodiment of the present invention can To practice without these specific details.In some instances, well known method, structure and skill is not been shown in detail Art, so as not to obscure the understanding of this specification.Similarly, it should be understood that disclose in order to simplify the present invention and helps to understand respectively One or more of a inventive aspect, in the above description of the exemplary embodiment of the present invention, each spy of the invention Sign is grouped together into a single embodiment, figure, or description thereof sometimes.However, should not be by the method solution of the disclosure It is interpreted into and reflects an intention that i.e. the claimed invention requires more than feature expressly recited in each claim More features.More precisely, just as the following claims reflect, inventive aspect is single less than disclosed above All features of embodiment.Therefore, it then follows thus claims of specific embodiment are expressly incorporated in the specific embodiment party Formula, wherein each, the claims themselves are regarded as separate embodiments of the invention.
The above description is merely a specific embodiment, under above-mentioned introduction of the invention, those skilled in the art Other improvement or deformation can be carried out on the basis of the above embodiments.It will be understood by those skilled in the art that above-mentioned tool Body description only preferably explains that the purpose of the present invention, protection scope of the present invention are subject to the protection scope in claims.

Claims (10)

1. a kind of screen capture method for wearing display equipment characterized by comprising
Under screen capture Optimizing Mode, obtains and wear the corresponding original graph of the 3D rendering that shows in display device screen with described Picture;
In response to specifying trigger action, corresponding screen capture file is generated according to the original image;
Wherein, the specified trigger action includes screenshotss trigger action, record screen trigger action and throwing screen trigger action.
2. the method as described in claim 1, which is characterized in that it is described in response to specifying trigger action, according to the original graph Include: as generating corresponding screen capture file
In response to specified trigger action, virtual extended screen is created,
Each original image that will acquire is output on the virtual extended screen, based in the virtual extended screen Hold, generates corresponding screen capture file.
3. method according to claim 2, which is characterized in that it is described in response to specifying trigger action, create virtual extended screen Curtain include:
Shield one or more of trigger action in response to the screenshotss trigger action, record screen trigger action and the throwing, Create at least one virtual extended screen.
4. method according to claim 2, which is characterized in that it is described in response to specifying trigger action, create virtual extended screen Curtain include:
In response to the screenshotss trigger action, according to the creation of screenshotss parameter and the screenshotss parameter adaptation from screenshotss application Virtual extended screen;Or,
Shield trigger action in response to the record, according to from the creation of recording parameter and the recording parameter adaptation for recording screen application Virtual extended screen;Or,
Shield trigger action in response to the throwing, is created and the throwing screen parameter adaptation according to the throwing screen parameter applied from throwing screen Virtual extended screen;Wherein, described to throw the data volume shielded parameter based on current network state, wait throw screen content, thrown screen end At least one of resolution ratio, the screen proportion for being thrown screen end information is determining.
5. method according to claim 2, which is characterized in that each original image that will acquire is output to the void Include: in quasi- extended screen
It is output on the virtual extended screen after carrying out cutting processing to the original image;
Or, the original image described in the multiframe of acquisition screens, each original image filtered out is output to the void In quasi- extended screen.
6. the method as described in any one of claim 2-5, which is characterized in that in each original image that will acquire After being output on the virtual extended screen, this method further include:
Watermarking images are embedded on each original image, obtain the content of the virtual extended screen;
The content based on the virtual extended screen, generating corresponding screen capture file includes:
The content of the virtual extended screen is encoded, the corresponding image file of screenshotss trigger action is generated, or, will be described The content of virtual extended screen is encoded, and the corresponding video file of record screen trigger action is generated, or, by the virtual extended screen The content of curtain is encoded, and the corresponding video file of record screen trigger action is generated.
7. method according to any one of claims 1 to 5, which is characterized in that it is described under screen capture Optimizing Mode, it obtains It takes and includes: with the corresponding original image of the 3D rendering that is shown in display device screen of wearing
The control instruction of the screen capture Optimizing Mode of user's input is received,
Enter screen capture Optimizing Mode if the control instruction is open command, and obtains and wear display equipment with described The corresponding original image of the 3D rendering shown on screen.
8. a kind of screen capture device for wearing display equipment characterized by comprising
Image collection module is obtained and to be shown in display device screen with described wear under screen capture Optimizing Mode The corresponding original image of 3D rendering;
Screen capture module, for generating corresponding screen capture text according to the original image in response to specifying trigger action Part;Wherein, the specified trigger action includes screenshotss trigger action, record screen trigger action and throwing screen trigger action.
9. device as claimed in claim 8, which is characterized in that the screen capture module is specifically used for, in response to specified touching Hair operation, creates virtual extended screen, and each original image that will acquire is output on the virtual extended screen, is based on institute The content for stating virtual extended screen generates corresponding screen capture file.
10. one kind wears display equipment characterized by comprising processor, and it is configured as the executable finger of storage computer The memory of order,
The executable instruction realizes the step such as method of any of claims 1-7 when being executed by the processor Suddenly.
CN201910688257.3A 2019-07-29 2019-07-29 Head-mounted display equipment and screen acquisition method and device thereof Active CN110505471B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910688257.3A CN110505471B (en) 2019-07-29 2019-07-29 Head-mounted display equipment and screen acquisition method and device thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910688257.3A CN110505471B (en) 2019-07-29 2019-07-29 Head-mounted display equipment and screen acquisition method and device thereof

Publications (2)

Publication Number Publication Date
CN110505471A true CN110505471A (en) 2019-11-26
CN110505471B CN110505471B (en) 2021-09-14

Family

ID=68587565

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910688257.3A Active CN110505471B (en) 2019-07-29 2019-07-29 Head-mounted display equipment and screen acquisition method and device thereof

Country Status (1)

Country Link
CN (1) CN110505471B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112732088A (en) * 2021-01-18 2021-04-30 海信视像科技股份有限公司 Virtual reality equipment and monocular screen capturing method
CN112732089A (en) * 2021-01-18 2021-04-30 海信视像科技股份有限公司 Virtual reality equipment and quick interaction method
CN112965651A (en) * 2021-03-16 2021-06-15 深圳市前海手绘科技文化有限公司 Optimization method for demonstrating video source output
CN113064684A (en) * 2021-01-18 2021-07-02 海信视像科技股份有限公司 Virtual reality equipment and VR scene screen capturing method
CN114630101A (en) * 2021-09-30 2022-06-14 海信视像科技股份有限公司 Display device, VR device and display control method of virtual reality application content
WO2022151864A1 (en) * 2021-01-18 2022-07-21 海信视像科技股份有限公司 Virtual reality device

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012133586A (en) * 2010-12-21 2012-07-12 Ntt Docomo Inc Display device, screen image transfer method and program
CN103338405A (en) * 2013-06-03 2013-10-02 四川长虹电器股份有限公司 Screen capture application method, equipment and system
CN104407829A (en) * 2014-11-06 2015-03-11 北京凌阳益辉科技有限公司 Method and device thereof for displaying image mirror
CN204440491U (en) * 2015-03-26 2015-07-01 天机数码创新技术有限公司 A kind of augmented reality system with a key screenshotss sharing function
CN105242827A (en) * 2015-09-28 2016-01-13 小米科技有限责任公司 Screen capture method, apparatus and system
CN105404455A (en) * 2015-12-16 2016-03-16 北京奇虎科技有限公司 Method and apparatus for performing screen capture on mobile terminal by utilizing terminal
CN105677142A (en) * 2015-12-29 2016-06-15 上海孩子国科教设备有限公司 Method and client terminal for acquiring screenshot
CN105678684A (en) * 2014-11-18 2016-06-15 中兴通讯股份有限公司 Image capture method and device
CN105760090A (en) * 2016-02-25 2016-07-13 惠州Tcl移动通信有限公司 Screenshot obtaining method and system based on mobile terminal and mobile terminal
CN105959666A (en) * 2016-06-30 2016-09-21 乐视控股(北京)有限公司 Method and device for sharing 3d image in virtual reality system
CN106201275A (en) * 2016-07-29 2016-12-07 北京小米移动软件有限公司 Snapshot is as processing method and processing device
CN106911850A (en) * 2017-02-27 2017-06-30 努比亚技术有限公司 Mobile terminal and its screenshotss method
CN108108117A (en) * 2018-01-23 2018-06-01 中兴通讯股份有限公司 A kind of screenshotss method, apparatus and terminal
CN109255990A (en) * 2018-09-30 2019-01-22 杭州乔智科技有限公司 A kind of tutoring system based on AR augmented reality
CN109275019A (en) * 2018-10-30 2019-01-25 青岛海信电器股份有限公司 When playing 3D video to the processing method and processing device of current display screen shot
CN109523462A (en) * 2018-11-14 2019-03-26 北京奇艺世纪科技有限公司 A kind of acquisition methods and device of VR video screenshotss image
CN109934764A (en) * 2019-01-31 2019-06-25 北京奇艺世纪科技有限公司 Processing method, device, terminal, server and the storage medium of panoramic video file

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012133586A (en) * 2010-12-21 2012-07-12 Ntt Docomo Inc Display device, screen image transfer method and program
CN103338405A (en) * 2013-06-03 2013-10-02 四川长虹电器股份有限公司 Screen capture application method, equipment and system
CN104407829A (en) * 2014-11-06 2015-03-11 北京凌阳益辉科技有限公司 Method and device thereof for displaying image mirror
CN105678684A (en) * 2014-11-18 2016-06-15 中兴通讯股份有限公司 Image capture method and device
CN204440491U (en) * 2015-03-26 2015-07-01 天机数码创新技术有限公司 A kind of augmented reality system with a key screenshotss sharing function
CN105242827A (en) * 2015-09-28 2016-01-13 小米科技有限责任公司 Screen capture method, apparatus and system
CN105404455A (en) * 2015-12-16 2016-03-16 北京奇虎科技有限公司 Method and apparatus for performing screen capture on mobile terminal by utilizing terminal
CN105677142A (en) * 2015-12-29 2016-06-15 上海孩子国科教设备有限公司 Method and client terminal for acquiring screenshot
CN105760090A (en) * 2016-02-25 2016-07-13 惠州Tcl移动通信有限公司 Screenshot obtaining method and system based on mobile terminal and mobile terminal
CN105959666A (en) * 2016-06-30 2016-09-21 乐视控股(北京)有限公司 Method and device for sharing 3d image in virtual reality system
CN106201275A (en) * 2016-07-29 2016-12-07 北京小米移动软件有限公司 Snapshot is as processing method and processing device
CN106911850A (en) * 2017-02-27 2017-06-30 努比亚技术有限公司 Mobile terminal and its screenshotss method
CN108108117A (en) * 2018-01-23 2018-06-01 中兴通讯股份有限公司 A kind of screenshotss method, apparatus and terminal
CN109255990A (en) * 2018-09-30 2019-01-22 杭州乔智科技有限公司 A kind of tutoring system based on AR augmented reality
CN109275019A (en) * 2018-10-30 2019-01-25 青岛海信电器股份有限公司 When playing 3D video to the processing method and processing device of current display screen shot
CN109523462A (en) * 2018-11-14 2019-03-26 北京奇艺世纪科技有限公司 A kind of acquisition methods and device of VR video screenshotss image
CN109934764A (en) * 2019-01-31 2019-06-25 北京奇艺世纪科技有限公司 Processing method, device, terminal, server and the storage medium of panoramic video file

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112732088A (en) * 2021-01-18 2021-04-30 海信视像科技股份有限公司 Virtual reality equipment and monocular screen capturing method
CN112732089A (en) * 2021-01-18 2021-04-30 海信视像科技股份有限公司 Virtual reality equipment and quick interaction method
CN113064684A (en) * 2021-01-18 2021-07-02 海信视像科技股份有限公司 Virtual reality equipment and VR scene screen capturing method
CN113655887A (en) * 2021-01-18 2021-11-16 海信视像科技股份有限公司 Virtual reality equipment and static screen recording method
CN114286142A (en) * 2021-01-18 2022-04-05 海信视像科技股份有限公司 Virtual reality equipment and VR scene screen capturing method
WO2022151864A1 (en) * 2021-01-18 2022-07-21 海信视像科技股份有限公司 Virtual reality device
CN112965651A (en) * 2021-03-16 2021-06-15 深圳市前海手绘科技文化有限公司 Optimization method for demonstrating video source output
CN114630101A (en) * 2021-09-30 2022-06-14 海信视像科技股份有限公司 Display device, VR device and display control method of virtual reality application content

Also Published As

Publication number Publication date
CN110505471B (en) 2021-09-14

Similar Documents

Publication Publication Date Title
CN110505471A (en) One kind wearing display equipment and its screen capture method, apparatus
CN107682688B (en) Video real-time recording method and recording equipment based on augmented reality
JP4879326B2 (en) System and method for synthesizing a three-dimensional image
US9055258B2 (en) Video display apparatus and video display method
JP2012085301A (en) Three-dimensional video signal processing method and portable three-dimensional display device embodying the method
JP2007280046A (en) Image processor and its control method, and program
JP2007110360A (en) Stereoscopic image processing apparatus and program
CN107995482B (en) Video file processing method and device
CN106569700B (en) Screenshot method and screenshot device
CN104898280B (en) The display methods and head mounted display of a kind of head mounted display
JP2014021570A (en) Moving image generation device
CN106162303B (en) Information processing method, information processing unit and user equipment
JP2017208676A (en) Method of providing virtual space, program, and recording medium
US20190347864A1 (en) Storage medium, content providing apparatus, and control method for providing stereoscopic content based on viewing progression
US10237563B2 (en) System and method for controlling video encoding using content information
CN114442814B (en) Cloud desktop display method, device, equipment and storage medium
US10043302B2 (en) Method and apparatus for realizing boot animation of virtual reality system
JP6126272B1 (en) Method, program, and recording medium for providing virtual space
KR20140146592A (en) Color grading preview method and apparatus
US8712225B2 (en) Playback device for stereoscopic viewing, integrated circuit, and program
CN110708591B (en) Image processing method and device and electronic equipment
CN105867615A (en) Information processing method and electronic device
CN105630170B (en) Information processing method and electronic equipment
KR101773929B1 (en) System for processing video with wide viewing angle, methods for transmitting and displaying vide with wide viewing angle and computer programs for the same
US11962743B2 (en) 3D display system and 3D display method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant