CN107038164A - A kind of method for sharing virtual reality image, apparatus and system - Google Patents
A kind of method for sharing virtual reality image, apparatus and system Download PDFInfo
- Publication number
- CN107038164A CN107038164A CN201610076353.9A CN201610076353A CN107038164A CN 107038164 A CN107038164 A CN 107038164A CN 201610076353 A CN201610076353 A CN 201610076353A CN 107038164 A CN107038164 A CN 107038164A
- Authority
- CN
- China
- Prior art keywords
- fish
- images
- eye
- image
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/01—Social networking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
Abstract
The invention discloses a kind of method for sharing virtual reality image, apparatus and system.This method includes：When receiving request and sharing the instruction of VR images, VR images are shot by external fish eye lens, and determine external fish-eye type information；The fish-eye type is made a distinction by different visual angles scope；The fish-eye type information determined and captured VR images are uploaded into network side server to preserve, so that other-end obtains VR images by server.The technical scheme that the present invention is provided, due to fish eye lens have the visual field of ultra-wide angle, cost it is low, using simple and the features such as be convenient for carrying, VR photos or VR videos are shot using the external fish eye lens of terminal and are sent to network side, the shooting of VR videos and sharing for social networks can be realized at low cost, whenever and wherever possible, and user is simple to operate so that user shares VR pictures on social networks or VR videos are possibly realized.
Description
Technical field
The present invention relates to Internet technical field, more particularly to one kind shares virtual reality (VR) image
Method, apparatus and system.
Background technology
Among current various social network sites, social activity APP, user upload and share oneself shoot photo,
Video has become a kind of fashion, and user can whenever and wherever possible be shot using mobile terminal, share oneself at one's side
Interesting people and thing, and exchange and interdynamic are carried out based on network.
But current various social network sites, social activity APP are uploaded and shared video is all traditional 2D photo
And video, with the development of virtual reality (Virtual Reality, VR) technology, people expect can be free
Shoot, share VR photos or VR videos (being referred to as VR images in this application), VR technologies are one
The computer simulation technique with the experiencing virtual world can be created by planting, and it can generate a kind of simulated environment, carry
For real-time dynamic 3 D stereo photorealism, user can be made to obtain sensation on the spot in person, this is immersed in
Among simulated environment, VR photos or VR videos have traditional photo or the incomparable advantage of video.
But existing VR photos or VR videos are shot by the VR video cameras of specialty, this to take the photograph
As equipment, volume is big costly, in addition, heavy, it is impossible to be popularized among ordinary consumer, also just more without
Method is applicable in the application of various social networks.
The content of the invention
In view of the above problems, it is proposed that the present invention overcomes above mentioned problem or at least in part to provide one kind
The one kind solved the above problems shares the method for virtual reality (VR) image, apparatus and system.
In a first aspect, the embodiment of the present invention provides a kind of method for sharing virtual reality image, including：
When receiving request and sharing the instruction of Virtual Reality image, pass through external fish eye lens and shoot
VR images, and determine the external fish-eye type information；The fish-eye type passes through
Different visual angles scope makes a distinction；
The fish-eye type information determined and captured VR images are uploaded to network side clothes
Business device is preserved, and the VR images are obtained so that other-end passes through the server.
In one embodiment, external fish-eye type information is determined, including：
The selection instruction to each preset options of fish-eye type is received, according to the selection instruction, it is determined that
The fish-eye type information.
In one embodiment, external fish-eye type information is determined, including：
Gather the image of predetermined patterns or the image of the acquisition fish eye lens collection on the fish eye lens
The image of middle predeterminated position；
Mark in collection or acquisition image is identified, the fish-eye type letter is determined
Breath.
In one embodiment, external fish-eye type information is determined, including：
External fish-eye attribute information is read by wireless signal, according to the fish-eye attribute
Information, determines external fish-eye type information；
The wireless signal includes following one or more：Bluetooth signal, infrared signal, WIFI signal and
Near-field communication NFC signals.
In one embodiment, the image of predeterminated position in the image of camera lens collection is obtained, including：
Obtain the image in the region of black border in the image of the fish eye lens collection；The black border area
The image with the unique mark for characterizing the fish eye lens type is included in domain in image.
In one embodiment, the image of predetermined patterns on the fish eye lens is gathered, including：
Predetermined patterns on the fish eye lens framework are shot, the predetermined patterns are the fish eye lens
Framework and external fish-eye terminal binding site, have on the predetermined patterns of the framework and characterize institute
State the unique mark of fish eye lens type.
In one embodiment, the unique mark passes through the point matrix representation that is arranged according to preset rules.
Second aspect, the embodiment of the present invention provides a kind of method for sharing virtual reality image, including：
The Virtual Reality image and the external fish-eye type of the terminal of receiving terminal upload are believed
Breath；The VR images are that the terminal is obtained by the external fish eye lens shooting；The flake mirror
The type of head is made a distinction by different visual angles scope；
Store and issue after being encoded to the VR images；
When receiving other-end to the playing requests of the VR images of issue, by the VR images after coding
The other-end is sent to corresponding fish-eye type information, so that the other-end is according to institute
Type information is stated to decode the VR images.
In one embodiment, stored after the VR images to terminal are encoded, including：
The same VR images uploaded for terminal, according to default different coding parameter, to the VR
Image is encoded respectively, generates the different editions of same VR images；The coding parameter includes following
One or more：Bit rate, resolution ratio, frame rate, sample rate, encapsulation format and aspect ratio；
Store the corresponding different editions of same VR images.
In one embodiment, will when receiving other-end to the playing requests of the VR images of issue
VR images after coding send the other-end to, including：
The broadcast performance information of the other-end is parsed from the playing request；The broadcast performance letter
Breath includes following one or more：Resolution ratio, screen size and the broadcast format supported；
Among the different editions of the same VR images, selection and the broadcast performance of the other-end
The version of information match, sends the VR images of the version to the other-end.
The third aspect, the embodiment of the present invention provides a kind of terminal, including：
Taking module, for when receive request share the instruction of Virtual Reality image when, by external
Fish eye lens shoot VR images；
Determining module, for determining the external fish-eye type information；The fish-eye class
Type is made a distinction by different visual angles scope；
Uploading module, for by the fish-eye type information determined and captured VR images
Network side server preservation is uploaded to, so that other-end obtains the VR images by the server.
In one embodiment, the determining module, it is each to fish-eye type default specifically for receiving
The selection instruction of option, according to the selection instruction, determines the fish-eye type information.
In one embodiment, the determining module, including：
Gather submodule, the image for gathering predetermined patterns on the fish eye lens；
The image of predeterminated position in acquisition submodule, the image for obtaining the fish eye lens collection；
Determination sub-module, for the mark in collection or acquisition image to be identified, determines the fish
The type information of glasses head.
In one embodiment, the determining module, for reading external fish eye lens by wireless signal
Attribute information, according to the fish-eye attribute information, determine external fish-eye type information；
The wireless signal includes following one or more：Bluetooth signal, infrared signal, WIFI signal and near field
Communicate NFC signals.
In one embodiment, the collection submodule, the figure specifically for obtaining the fish eye lens collection
Image as in the region of black border；Include to have in image in the black border region and characterize the fish
The image of the unique mark of eye lens type.
In one embodiment, the acquisition submodule, specifically for being preset on the fish eye lens framework
Position is shot, and the predetermined patterns are the framework of the camera lens and the combination of external fish-eye terminal
There is the unique mark for characterizing the fish eye lens type on position, the predetermined patterns of the framework.
In one embodiment, the unique mark passes through the point matrix representation that is arranged according to preset rules.
Fourth aspect, the embodiment of the present invention provides a kind of server, including：
Receiving module, the Virtual Reality image and the external flake of the terminal uploaded for receiving terminal
The type information of camera lens；The VR images are that the terminal is obtained by the external fish eye lens shooting；
The fish-eye type is made a distinction by different visual angles scope；
Coding module, is stored after being encoded to the VR images that the terminal is uploaded；
Release module, the VR images for the terminal to be uploaded are issued；
Delivery module, for when receiving other-end to the playing requests of the VR images of issue, will compile
VR images and corresponding fish-eye type information after code send the other-end to, so as to described
Other-end is decoded according to the type information to the VR images.
In one embodiment, the coding module, schemes specifically for the same VR uploaded for terminal
Picture, according to default different coding parameter, is encoded respectively to the VR images, is generated same
The different editions of VR images；The coding parameter includes following one or more：Bit rate, resolution ratio,
Frame rate, sample rate, encapsulation format and aspect ratio；Store the corresponding different editions of same VR images.
In one embodiment, the delivery module, including：
Analyzing sub-module, the broadcast performance for parsing the other-end from the playing request is believed
Breath；The broadcast performance information includes following one or more：Resolution ratio, screen size and broadcasting of being supported
Put form；
Select submodule, among the different editions of the same VR images, selection with it is described its
The version of the broadcast performance information match of his terminal；
Submodule is transmitted, for sending the VR images of the version to the other-end.
5th aspect, a kind of system for sharing virtual reality image provided in an embodiment of the present invention, including：Extremely
A few terminal and server；
The terminal, for when receiving the instruction for shooting Virtual Reality image, passing through external fish
Eye lens shooting VR images, and determine the external fish-eye type information；The fish eye lens
Type made a distinction by different visual angles scope；By the fish-eye type information determined and institute
The VR images of shooting are uploaded to network side server preservation；And obtain announced by the server
VR images and corresponding fish-eye type information, according to the type information to the announced VR
Image is decoded；
The terminal of the server, the VR images uploaded for receiving and the shooting VR images is external
Fish-eye type information；Store and issue after being encoded to the VR images；When receive to hair
During the playing request of the VR images of cloth, by the VR images after coding and corresponding fish-eye class
Terminal of the type information transmission to request.
The beneficial effect of above-mentioned technical proposal provided in an embodiment of the present invention at least includes：
In the method provided in an embodiment of the present invention for sharing virtual reality (VR) image, apparatus and system,
When terminal, which receives the request that user sends, shares the instruction of VR images, pass through external fish eye lens and clap
Take the photograph VR images, and determine external fish-eye type (being which kind of angular field of view), then will determine
Fish-eye type information and captured VR images are uploaded to network side server preservation, so as to social activity
Other-end downloads the VR images by server in network, and server is compiled the VR images of upload
Issue, when receiving other playback terminals to the playing requests of the VR images of issue, will compile after code storage
VR images and corresponding fish-eye type information after code, so that other-end is according to the type information
Decoded.Above-mentioned technical proposal provided in an embodiment of the present invention, because fish eye lens has regarding for ultra-wide angle
Wild, cost is low, using simple and the features such as be convenient for carrying, and utilizes the external fish eye lens of terminal to shoot VR
Photo or VR videos are simultaneously sent to network side, you can realize the bat of VR videos at low cost, whenever and wherever possible
Take the photograph and share with social networks, and user is simple to operate so that user shares VR on social networks
Picture or VR videos are possibly realized.
Further, the method provided in an embodiment of the present invention for sharing virtual reality (VR) image, device
And system, can be by gathering the figure that the image of predetermined patterns or acquisition fish eye lens are gathered on fish eye lens
The image of predeterminated position, realizes the Intelligent Recognition of fish eye lens type, eliminates user manual confirmation fish as in
The step of glasses head, the operation that user shares VR images is further simplify, user experience is improved.
Other features and advantages of the present invention will be illustrated in the following description, also, partly from explanation
Become apparent, or understood by implementing the present invention in book.The purpose of the present invention and other advantages can
Realize and obtain by specifically noted structure in the specification, claims and accompanying drawing write
.
Below by drawings and examples, technical scheme is described in further detail.
Brief description of the drawings
Accompanying drawing is used for providing a further understanding of the present invention, and constitutes a part for specification, with this hair
Bright embodiment is used to explain the present invention together, is not construed as limiting the invention.In the accompanying drawings：
Fig. 1 is the flow chart of method in end side provided in an embodiment of the present invention for sharing VR images；
Fig. 2A and Fig. 2 B are the schematic diagram of external fish-eye example provided in an embodiment of the present invention；
Fig. 2 C are the interface schematic diagram of the option of selection VR cameras provided in an embodiment of the present invention；
Fig. 3 is the flow chart of the fish-eye type of automatic identification provided in an embodiment of the present invention；
Fig. 4 is the schematic diagram for the photo that fish eye lens provided in an embodiment of the present invention is shot；
Fig. 5 is the flow chart of method in server side provided in an embodiment of the present invention for sharing VR images；
Fig. 6 is the structural representation of terminal provided in an embodiment of the present invention；
Fig. 7 is the structural representation of determining module provided in an embodiment of the present invention；
Fig. 8 is the structural representation of server provided in an embodiment of the present invention；
Fig. 9 is the structural representation of delivery module provided in an embodiment of the present invention；
Figure 10 is the structural representation of the system provided in an embodiment of the present invention for sharing virtual reality image.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although being shown in accompanying drawing
The exemplary embodiment of the disclosure, it being understood, however, that may be realized in various forms the disclosure without should be by
Embodiments set forth here is limited.It is opposite to be able to be best understood from this there is provided these embodiments
It is open, and can by the scope of the present disclosure completely convey to those skilled in the art.
Below in conjunction with the accompanying drawings, to the method provided in an embodiment of the present invention for sharing virtual reality (VR) image,
The embodiment of device and system is described in detail.
The method provided in an embodiment of the present invention for sharing VR images, it is terminal to be related to two ends, i.e. one end, separately
One end is network side server.Terminal can various possess shooting, the soft hardware equipment of playing function, example
Such as with the various mobile phones of shoot function, tablet personal computer, various wearable devices for example the helmet, intelligent glasses,
Bracelet etc..Terminal is used to shoot VR videos or photo and is uploaded to the server of network side, and server is protected
Depositing and issue other users in the VR videos or photo, social networks can be by the terminal of oneself, in net
Oneself VR videos or VR photos interested are checked or searched in network, it is achieved thereby that in social networks
In share VR videos or VR photos.
The method provided in an embodiment of the present invention for sharing VR images, it is adaptable to the terminal that request is shared, such as schemes
Shown in 1, this method can comprise the steps：
S11, when receiving the instruction for shooting VR images, VR images are shot by external fish eye lens,
And determine external fish-eye type information；Fish-eye type carries out area by different visual angles scope
Point；
S12, the fish-eye type information determined and captured VR images be uploaded to network side
Server is preserved, so that other-end obtains the VR images by server.
The above-mentioned method for sharing VR images provided in an embodiment of the present invention, when receiving the request that user sends
When sharing the instruction of VR images, VR images are shot by external fish eye lens, and determine external flake
The type (be which kind of angular field of view) of camera lens, then by the fish-eye type information determined and captured
VR images be uploaded to network side server preservation, so that other-end passes through under server in social networks
Carry and play the VR images, the above-mentioned method for sharing VR images provided in an embodiment of the present invention, due to fish
Glasses head have the visual field of ultra-wide angle, cost it is low, using simple and the features such as be convenient for carrying, using terminal outside
The fish eye lens connect shoots VR photos or VR videos and is sent to network side, you can at low cost, at any time
The shooting of VR videos and sharing for social networks are realized everywhere, and user is simple to operate so that user
Share VR pictures on social networks or VR videos are possibly realized.
In embodiments of the present invention, equipment can use the external fish eye lens of various ways, be contacted with equipment
Mode is for example directly connected fish eye lens by clamping, threaded connection or other connected modes, for example, scheme
Example shown in 2A, mobile phone is connected with a fish eye lens.
Or by the way of not contacted with equipment, for example, fish eye lens is connected by wireless signal, shooting
When, both are communicated by wireless signal, for example the example shown in Fig. 2 B, and mobile phone passes through bluetooth and one
Individual fish eye lens connection.
Further, external fish-eye type information is determined in above-mentioned flow, in S11, can be with
There are numerous embodiments.For example it is following this：
By receiving the selection instruction to each preset options of fish-eye type, according to selection instruction, it is determined that
Fish-eye type information.
When its VR image is shared in user's request, terminal can show interface as that shown in fig. 2 c to user,
There is provided the option of multiple VR cameras in the interface, such as 180 ° VR cameras, 235 ° of VR cameras
With 360 ° of VR cameras etc. option.
User sends corresponding selection instruction by clicking these options to terminal, terminal according to selection instruction,
It just could be aware that external fish-eye type information.
, it is necessary to which user artificially recognizes bottom is shot by which kind of fish eye lens in this mode,
Then by way of man-machine interaction, fish-eye relevant information is inputed into terminal.
The embodiment of the present invention can also provide other embodiment, in this embodiment, can be automatic
Fish-eye type is recognized, the operation of user's identification fish eye lens type is saved so that shares VR images
Process operation it is more simplified, lifted user experience.
For example, external fish-eye attribute information can be read by wireless signal, according to fish eye lens
Attribute information, determine external fish-eye type information；Wherein：Wireless signal includes following one
Or it is multinomial：Bluetooth signal, infrared signal, WIFI signal and near-field communication (Near Field Communication,
NFC) signal.
When equipment connects fish eye lens by way of wireless signal, wireless signal such as bluetooth can be passed through
Communicated Deng with fish eye lens.When wirelessly connecting fish eye lens, fish is determined by attribute information
The type information of glasses head, for example, can be communicated with fish eye lens by way of bluetooth, obtain fish eye lens
Angular field of view information.
The APP for example in equipment installed carries out Bluetooth pairing with fish eye lens, and flake mirror is installed in equipment
The driver of head, can obtain fish-eye attribute information by software APP etc..
In another example, as shown in figure 3, the fish-eye type of following step automatic identification can also be passed through：
It is pre- in the image that the image or acquisition fish eye lens of predetermined patterns are gathered on S31, collection fish eye lens
If the image of position；
S32, the mark in collection or acquisition image is identified, determines the type information of camera lens.
In above-mentioned S31, S32, the identification to lens type is realized by two ways.
Further, the image of predetermined patterns on fish eye lens is gathered in above-mentioned S31, can be by flake
Predetermined patterns are shot on lens barrel frame, framework and external fish-eye end of the predetermined patterns for camera lens
There is the unique mark for characterizing the fish eye lens type on the binding site at end, the predetermined patterns of framework.
Fish-eye framework is the portion for being used to wrap up, support and protect lens in camera lens (one or more)
Predetermined patterns on the framework in aforesaid way, are shot, schemed by the image photographed by part
As identification so as to identify the unique mark of the sign lens type wherein included, identification camera lens is finally reached
Purpose.
Predetermined patterns are the framework of camera lens and the binding site of external fish-eye terminal, select such position
It is advantageous in that, in external fish eye lens, terminal can exactly be adopted by the shooting of the binding site
Collect the image on correspondence position on lens barrel frame.Mark in the image to collection is identified, so that it may
To know fish-eye type.
Further, the step of image of predeterminated position in the image of camera lens collection is obtained in above-mentioned S31, can
To be embodied as：Obtain the image in the region of black border, the black border area in the image of fish eye lens collection
The image with the unique mark for characterizing fish eye lens type is included in domain in image.
The edge of the image of fish eye lens collection is black, in the black region, by recognizing setting
Pattern or word, could be aware that fish-eye type.
In order to show the pattern or word of setting in the black border region for the image that fish eye lens is shot,
It can be set by using punching on the outer back-up ring (belonging to framework) of fish eye lens lens or carving other
The modes such as pattern, so, when shooting, light can also spill from this part, so that in the image of shooting
Corresponding mark occurs in fringe region.The mark can be word or the pattern set.
Further, the unique mark of the fish-eye type can be by the point that is arranged according to preset rules
Matrix representation.
Certainly, the embodiment of the present invention does not limit the concrete form of above-mentioned mark, may be used using other patterns yet.
Such as example as shown in Figure 4, in the black border for the photo that fish eye lens is shot, has with four
The dot matrix of individual point, by the light and shade of four points in this dot matrix, and each pattern and fish eye lens type are reflected
Penetrate relation, it is possible to know what type the fish eye lens belongs to.
For example：Each mark pattern of dot matrix (correspondence) for pre-saving angular field of view different from fish eye lens
The mapping table of (i.e. different types) is as follows：
Table 1
Assuming that in four points of the dot matrix, each bright spot is expressed as " 1 ", and each dim spot is expressed as " 0 ", such as scheme
Shown in 4, when the pattern be identified be designated " 1011 " (be followed successively by bright spot from left to right, it is dim spot, bright
Point, bright spot) when, matched with table 1, then it is 235 ° finally to determine the type of current camera lens
Fish eye lens.
The method provided in an embodiment of the present invention for sharing VR images, in server side, as shown in figure 5, can
To comprise the steps：
S51, the Virtual Reality image of receiving terminal upload and the external fish-eye type letter of terminal
Breath；The VR images are that terminal is obtained by external fish eye lens shooting；Fish-eye type passes through not
Made a distinction with angular field of view；
S52, VR images are encoded after store and issue；
S53, when receiving other-end to the playing requests of the VR images of issue, by the VR after coding
Image and corresponding fish-eye type information send other-end to, so that other-end is believed according to type
Breath is decoded to VR images.
For server side, it receives the VR videos or VR that terminal is shot by fish eye lens
In the interface that webpage or APP after photo, is encoded, stored and be published to it, other are used
The user of terminal can check, search the VR image informations of other-end issue by the interface, for example, lead to
The mode of keyword retrieval is crossed, oneself VR image interested is found, then downloads and is watched, so that
Realize the shared of VR images.
It should be noted that in the embodiment of the present invention, the picture shot by fish eye lens is used in end side
Black border recognize the unique mark of the fish eye lens type in the case of, due to being finally uploaded to server
VR images in contained the image of the mark, this parts of images to user without in all senses,
Therefore, server after this VR images are received, it is necessary to which first the mark to the edge of the VR images is entered
Row processing, removes this partial information, and coding, storage and the issue of follow-up VR images are then carried out again
Operation.
For the ease of suitable for various types of terminals, server needs to encode VR videos, so as to
In transmission and the broadcasting of terminal.
Further, in order to be widely used in the terminal of various different screens, different broadcast performance, in service
Device side, above-mentioned steps S52 is stored after being encoded to the VR images of terminal, may be implemented as：
The same VR images uploaded for terminal, according to default different coding parameter, scheme to the VR
As being encoded respectively, the different editions of same VR images are generated；Wherein, coding parameter can include
Following one or more：Bit rate, resolution ratio, frame rate, sample rate, encapsulation format and aspect ratio；
Store the corresponding different editions of same VR images.
Above-mentioned encapsulation format refers to various Image Coding modes, can there is a variety of, for example H.263~H.265
Deng the embodiment of the present invention is not limited this.
Different aspect ratios is adapted to different in width, the display screen of different proportion.
Similarly, the video of different resolution, is adapted to support the terminal and not of different screen resolutions
Same network transmission bandwidth.
Correspondingly, in above-mentioned steps S53, when receiving broadcasting of the other-end to the VR images of issue
During request, other-end broadcasting to the other-end that is carried in the playing request of the VR images of issue is parsed
Put performance information；Broadcast performance information includes following one or more：Resolution ratio, screen size and supported
Broadcast format；
Among the different editions of same VR images, the broadcast performance information phase with other-end is selected
The version matched somebody with somebody, sends the VR images of the version to other-end.
In above-mentioned steps S53, after server transfers the VR images of its request to other-end, due to
Terminal is used for generally compatible (such as 180 °, 235 ° and 360 of the different visual angles scope of decoder of image decoding
°) VR videos decoding, therefore VR images for the request that easily can be issued according to server
Corresponding fish-eye angular field of view, is decoded to the VR images of download exactly, promptly.
Based on same inventive concept, the embodiment of the present invention additionally provides a kind of terminal, server and shared
The system of VR images, by the principle that these terminals, server and system solve problem is shared with foregoing
The method of virtual reality image is similar, therefore the implementation of the terminal, server and system may refer to foregoing side
The implementation of method, repeats part and repeats no more.
Terminal provided in an embodiment of the present invention, as shown in fig. 6, including：
Taking module 61, for when receive request share the instruction of Virtual Reality image when, by outer
The fish eye lens connect shoots VR images；
Determining module 62, for determining external fish-eye type information；Fish-eye type passes through
Different visual angles scope makes a distinction；
Uploading module 63, for by the fish-eye type information determined and captured VR images
Network side server preservation is reached, so that other-end obtains VR images by the server.
Further, above-mentioned determining module 62, specifically for receiving to each preset options of fish-eye type
Selection instruction, according to selection instruction, determine fish-eye type information.
In one embodiment, above-mentioned determining module 62, for reading external flake mirror by wireless signal
The attribute information of head, according to fish-eye attribute information, determines external fish-eye type information；
The wireless signal includes following one or more：Bluetooth signal, infrared signal, WIFI signal and near field
Communicate (NFC) signal.
Further, above-mentioned determining module 62, as shown in fig. 7, comprises：
Gather submodule 621, the image for gathering predetermined patterns on the fish eye lens；
The image of predeterminated position in acquisition submodule 622, the image for obtaining the fish eye lens collection；
Determination sub-module 623, for the mark in collection or acquisition image to be identified, determines fish
The type information of glasses head.
Further, in above-mentioned collection submodule 621, the image specifically for obtaining fish eye lens collection
Image in the region of black border；Included in the region of black border in image with sign fish eye lens type
The image of unique mark.
Further, above-mentioned acquisition submodule 622, specifically for entering to predetermined patterns on fish eye lens framework
Row is shot, and predetermined patterns are fish-eye framework and the binding site of external fish-eye terminal, the frame
There is the unique mark for characterizing the fish eye lens type on the predetermined patterns of frame.
Further, above-mentioned unique mark can be by the point matrix representation that is arranged according to preset rules.
Server provided in an embodiment of the present invention, as shown in figure 8, including：
Receiving module 81, the VR images uploaded for receiving terminal and the external fish-eye type of terminal
Information；VR images are that terminal is obtained by the external fish eye lens shooting；Fish-eye type is led to
Different visual angles scope is crossed to make a distinction；
Coding module 82, is stored after being encoded to the VR images that terminal is uploaded；
Release module 83, the VR images for terminal to be uploaded are issued；
Delivery module 84, will for when receiving other-end to the playing requests of the VR images of issue
VR images and corresponding fish-eye type information after coding send other-end to, so as to other ends
End is decoded according to type information to the VR images.
Further, above-mentioned coding module 82, specifically for the same VR images uploaded for terminal,
According to default different coding parameter, the VR images are encoded respectively, same VR figures are generated
The different editions of picture；The coding parameter includes following one or more：Bit rate, resolution ratio, frame rate,
Sample rate, encapsulation format and aspect ratio；Store the corresponding different editions of same VR images.
Further, above-mentioned delivery module 84, as shown in figure 9, including：
Analyzing sub-module 841, the broadcast performance for parsing the other-end from the playing request
Information；The broadcast performance information includes following one or more：Resolution ratio, screen size and supported
Broadcast format；
Submodule 842 is selected, among the different editions of same VR images, selecting and other ends
The version of the broadcast performance information match at end；
Submodule 843 is transmitted, for sending the VR images of version to other-end.
The embodiment of the present invention additionally provides a kind of system for sharing virtual reality image, as shown in Figure 10, bag
Include：At least one terminal 101 and server 102；
Terminal 101, for when receiving the instruction for shooting Virtual Reality image, passing through external fish
Eye lens shooting VR images, and determine the external fish-eye type information；The fish eye lens
Type made a distinction by different visual angles scope；By the fish-eye type information determined and institute
The VR images of shooting are uploaded to network side server preservation；And obtain announced by the server
VR images and corresponding fish-eye type information, according to the type information to the announced VR
Image is decoded；
The terminal of server 102, the VR images uploaded for receiving and the shooting VR images is external
Fish-eye type information；Store and issue after being encoded to the VR images；When receive to hair
During the playing request of the VR images of cloth, by the VR images after coding and corresponding fish-eye class
Terminal of the type information transmission to request.
In the specific implementation, above-mentioned terminal 101 can be that mobile phone, tablet personal computer, band are taken the photograph to the embodiment of the present invention
As function or the VR helmets (can not be uploaded without camera function to watch) without camera function,
Notebook computer with camera function or without camera function etc. equipment, the embodiment of the present invention is to terminal
Type is not limited.It is any to realize the specific reality of the function of above-mentioned terminal 101 provided in an embodiment of the present invention
Mode is applied all may be used.
The embodiment of the present invention also provides a kind of device for sharing virtual reality image, including：
Processor；
Memory for storing processor executable command；
Wherein, processor is configured as：When receive request share the instruction of Virtual Reality image when,
VR images are shot by external fish eye lens, and determine the external fish-eye type information；
The fish-eye type is made a distinction by different visual angles scope；
The fish-eye type information determined and captured VR images are uploaded to network side clothes
Business device is preserved, so that other-end is obtained by the server and plays the VR images.
The embodiment of the present invention provides a kind of device for sharing virtual reality image again, including：
Processor；
Memory for storing processor executable command；
Wherein, processor is configured as：
The Virtual Reality image and the external fish-eye type of the terminal of receiving terminal upload are believed
Breath；The VR images are that the terminal is obtained by the external fish eye lens shooting；The flake mirror
The type of head is made a distinction by different visual angles scope；
Store and issue after being encoded to the VR images；
When receiving other-end to the playing requests of the VR images of issue, by the VR images after coding
The other-end is sent to corresponding fish-eye type information, so that the other-end is according to institute
Type information is stated to decode the VR images.
The embodiment of the present invention additionally provides a kind of non-transitorycomputer readable storage medium, when the storage is situated between
Instruction in matter by the computing device of terminal when so that terminal is able to carry out one kind and shares virtual reality image
Method, methods described includes：
When receiving request and sharing the instruction of Virtual Reality image, pass through external fish eye lens and shoot
VR images, and determine the external fish-eye type information；The fish-eye type passes through
Different visual angles scope makes a distinction；
The fish-eye type information determined and captured VR images are uploaded to network side clothes
Business device is preserved, so that other-end is obtained by the server and plays the VR images.
The embodiment of the present invention additionally provides a kind of non-transitorycomputer readable storage medium, when the storage is situated between
Instruction in matter by the computing device of server when so that server is able to carry out one kind and shares virtual reality
The method of image, methods described includes：
The Virtual Reality image and the external fish-eye type of the terminal of receiving terminal upload are believed
Breath；The VR images are that the terminal is obtained by the external fish eye lens shooting；The flake mirror
The type of head is made a distinction by different visual angles scope；
Store and issue after being encoded to the VR images；
When receiving other-end to the playing requests of the VR images of issue, by the VR images after coding
The other-end is sent to corresponding fish-eye type information, so that the other-end is according to institute
Type information is stated to decode the VR images.
In the method provided in an embodiment of the present invention for sharing virtual reality (VR) image, apparatus and system,
When terminal, which receives the request that user sends, shares the instruction of VR images, pass through external fish eye lens and clap
Take the photograph VR images, and determine external fish-eye type (being which kind of angular field of view), then will determine
Fish-eye type information and captured VR images are uploaded to network side server preservation, so as to social activity
Other-end downloads the VR images by server in network, and server is compiled the VR images of upload
Issue, when receiving other playback terminals to the playing requests of the VR images of issue, will compile after code storage
VR images and corresponding fish-eye type information after code, so that other-end is according to the type information
Decoded.Above-mentioned technical proposal provided in an embodiment of the present invention, because fish eye lens has regarding for ultra-wide angle
Wild, cost is low, using simple and the features such as be convenient for carrying, and utilizes the external fish eye lens of terminal to shoot VR
Photo or VR videos are simultaneously sent to network side, you can realize the bat of VR videos at low cost, whenever and wherever possible
Take the photograph and share with social networks, and user is simple to operate so that user shares VR on social networks
Picture or VR videos are possibly realized.
Further, the method provided in an embodiment of the present invention for sharing virtual reality (VR) image, device
And system, can be by gathering the figure that the image of predetermined patterns or acquisition fish eye lens are gathered on fish eye lens
The image of predeterminated position, realizes the Intelligent Recognition of fish eye lens type, eliminates user manual confirmation fish as in
The step of glasses head, the operation that user shares VR images is further simplify, user experience is improved.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or meter
Calculation machine program product.Therefore, the present invention can be using complete hardware embodiment, complete software embodiment or knot
The form of embodiment in terms of conjunction software and hardware.Wherein wrapped one or more moreover, the present invention can be used
Containing computer usable program code computer-usable storage medium (include but is not limited to magnetic disk storage and
Optical memory etc.) on the form of computer program product implemented.
The present invention is with reference to the production of method according to embodiments of the present invention, equipment (system) and computer program
The flow chart and/or block diagram of product is described.It should be understood that can by computer program instructions implementation process figure and
/ or each flow and/or square frame in block diagram and the flow in flow chart and/or block diagram and/
Or the combination of square frame.These computer program instructions can be provided to all-purpose computer, special-purpose computer, insertion
Formula processor or the processor of other programmable data processing devices are to produce a machine so that pass through and calculate
The instruction of the computing device of machine or other programmable data processing devices is produced for realizing in flow chart one
The device for the function of being specified in individual flow or multiple flows and/or one square frame of block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or the processing of other programmable datas to set
In the standby computer-readable memory worked in a specific way so that be stored in the computer-readable memory
Instruction produce include the manufacture of command device, the command device realization in one flow or multiple of flow chart
The function of being specified in one square frame of flow and/or block diagram or multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices, made
Obtain and perform series of operation steps on computer or other programmable devices to produce computer implemented place
Reason, so that the instruction performed on computer or other programmable devices is provided for realizing in flow chart one
The step of function of being specified in flow or multiple flows and/or one square frame of block diagram or multiple square frames.
Obviously, those skilled in the art can carry out various changes and modification without departing from this to the present invention
The spirit and scope of invention.So, if these modifications and variations of the present invention belong to the claims in the present invention
And its within the scope of equivalent technologies, then the present invention is also intended to comprising including these changes and modification.
Claims (20)
1. a kind of method for sharing virtual reality image, it is characterised in that including：
When receiving request and sharing the instruction of Virtual Reality image, pass through external fish eye lens and shoot
VR images, and determine the external fish-eye type information；The fish-eye type passes through
Different visual angles scope makes a distinction；
The fish-eye type information determined and captured VR images are uploaded to network side clothes
Business device is preserved, so that other-end is obtained by the server and plays the VR images.
2. the method as described in claim 1, it is characterised in that determine external fish-eye type
Information, including：
The selection instruction to each preset options of fish-eye type is received, according to the selection instruction, it is determined that
The fish-eye type information.
3. the method as described in claim 1, it is characterised in that determine external fish-eye type
Information, including：
Gather the image of predetermined patterns or the image of the acquisition fish eye lens collection on the fish eye lens
The image of middle predeterminated position；
Mark in collection or acquisition image is identified, the fish-eye type letter is determined
Breath.
4. the method as described in claim 1, it is characterised in that determine external fish-eye type
Information, including：
External fish-eye attribute information is read by wireless signal, according to the fish-eye attribute
Information, determines external fish-eye type information；
The wireless signal includes following one or more：Bluetooth signal, infrared signal, WIFI signal and
Near-field communication NFC signals.
5. method as claimed in claim 3, it is characterised in that obtain in the image of camera lens collection and preset
The image of position, including：
Obtain the image in the region of black border in the image of the fish eye lens collection；The black border area
The image with the unique mark for characterizing the fish eye lens type is included in domain in image.
6. method as claimed in claim 3, it is characterised in that preset portion on the collection fish eye lens
The image of position, including：
Predetermined patterns on the fish eye lens framework are shot, the predetermined patterns are the fish eye lens
Framework and external fish-eye terminal binding site, have on the predetermined patterns of the framework and characterize institute
State the unique mark of fish eye lens type.
7. the method as described in claim 5 or 6, it is characterised in that the unique mark by according to
The point matrix representation of preset rules arrangement.
8. a kind of method for sharing virtual reality image, it is characterised in that including：
The Virtual Reality image and the external fish-eye type of the terminal of receiving terminal upload are believed
Breath；The VR images are that the terminal is obtained by the external fish eye lens shooting；The flake mirror
The type of head is made a distinction by different visual angles scope；
Store and issue after being encoded to the VR images；
When receiving other-end to the playing requests of the VR images of issue, by the VR images after coding
The other-end is sent to corresponding fish-eye type information, so that the other-end is according to institute
Type information is stated to decode the VR images.
9. method as claimed in claim 8, it is characterised in that the VR images to terminal are carried out
Stored after coding, including：
The same VR images uploaded for terminal, according to default different coding parameter, to the VR
Image is encoded respectively, generates the different editions of same VR images；The coding parameter includes following
One or more：Bit rate, resolution ratio, frame rate, sample rate, encapsulation format and aspect ratio；
Store the corresponding different editions of same VR images.
10. method as claimed in claim 9, it is characterised in that when receiving other-end to issue
During the playing request of VR images, the VR images after coding are sent to the other-end, including：
The broadcast performance information of the other-end is parsed from the playing request；The broadcast performance letter
Breath includes following one or more：Resolution ratio, screen size and the broadcast format supported；
Among the different editions of the same VR images, selection and the broadcast performance of the other-end
The version of information match, sends the VR images of the version to the other-end.
11. a kind of terminal, it is characterised in that including：
Taking module, for when receive request share the instruction of Virtual Reality image when, by external
Fish eye lens shoot VR images；
Determining module, for determining the external fish-eye type information；The fish-eye class
Type is made a distinction by different visual angles scope；
Uploading module, for by the fish-eye type information determined and captured VR images
Network side server preservation is uploaded to, so that other-end obtains the VR images by the server.
12. terminal as claimed in claim 11, it is characterised in that the determining module, specifically for
The selection instruction to each preset options of fish-eye type is received, according to the selection instruction, it is determined that described
Fish-eye type information.
13. terminal as claimed in claim 11, it is characterised in that the determining module, including：
Gather submodule, the image for gathering predetermined patterns on the fish eye lens；
The image of predeterminated position in acquisition submodule, the image for obtaining the fish eye lens collection；
Determination sub-module, for the mark in collection or acquisition image to be identified, determines the fish
The type information of glasses head.
14. terminal as claimed in claim 13, it is characterised in that the collection submodule, specific to use
Image in the image for obtaining the fish eye lens collection in the region of black border；The black border region
The image with the unique mark for characterizing the fish eye lens type is included in interior image.
15. terminal as claimed in claim 11, it is characterised in that the acquisition submodule, specific to use
Predetermined patterns are shot on to the fish eye lens framework, and the predetermined patterns are the framework of the camera lens
With the binding site of external fish-eye terminal, have on the predetermined patterns of the framework and characterize the flake
The unique mark of lens type.
16. the terminal as described in claims 14 or 15, it is characterised in that the unique mark by by
The point matrix representation arranged according to preset rules.
17. a kind of server, it is characterised in that including：
Receiving module, the Virtual Reality image and the external flake of the terminal uploaded for receiving terminal
The type information of camera lens；The VR images are that the terminal is obtained by the external fish eye lens shooting；
The fish-eye type is made a distinction by different visual angles scope；
Coding module, is stored after being encoded to the VR images that the terminal is uploaded；
Release module, the VR images for the terminal to be uploaded are issued；
Delivery module, for when receiving other-end to the playing requests of the VR images of issue, will compile
VR images and corresponding fish-eye type information after code send the other-end to, so as to described
Other-end is decoded according to the type information to the VR images.
18. server as claimed in claim 17, it is characterised in that the coding module, specific to use
In the same VR images uploaded for terminal, according to default different coding parameter, the VR is schemed
As being encoded respectively, the different editions of same VR images are generated；The coding parameter includes following one
Item is multinomial：Bit rate, resolution ratio, frame rate, sample rate, encapsulation format and aspect ratio；Storage is same
The corresponding different editions of one VR image.
19. server as claimed in claim 18, it is characterised in that the delivery module, including：
Analyzing sub-module, the broadcast performance for parsing the other-end from the playing request is believed
Breath；The broadcast performance information includes following one or more：Resolution ratio, screen size and broadcasting of being supported
Put form；
Select submodule, among the different editions of the same VR images, selection with it is described its
The version of the broadcast performance information match of his terminal；
Submodule is transmitted, for sending the VR images of the version to the other-end.
20. a kind of system for sharing virtual reality image, it is characterised in that including：At least one terminal and
Server；
The terminal, for when receiving the instruction for shooting Virtual Reality image, passing through external fish
Eye lens shooting VR images, and determine the external fish-eye type information；The fish eye lens
Type made a distinction by different visual angles scope；By the fish-eye type information determined and institute
The VR images of shooting are uploaded to network side server preservation；And obtain announced by the server
VR images and corresponding fish-eye type information, according to the type information to the announced VR
Image is decoded；
The terminal of the server, the VR images uploaded for receiving and the shooting VR images is external
Fish-eye type information；Store and issue after being encoded to the VR images；When receive to hair
During the playing request of the VR images of cloth, by the VR images after coding and corresponding fish-eye class
Terminal of the type information transmission to request.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610076353.9A CN107038164A (en) | 2016-02-03 | 2016-02-03 | A kind of method for sharing virtual reality image, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610076353.9A CN107038164A (en) | 2016-02-03 | 2016-02-03 | A kind of method for sharing virtual reality image, apparatus and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107038164A true CN107038164A (en) | 2017-08-11 |
Family
ID=59532139
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610076353.9A Pending CN107038164A (en) | 2016-02-03 | 2016-02-03 | A kind of method for sharing virtual reality image, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107038164A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107635152A (en) * | 2017-09-28 | 2018-01-26 | 深圳晶恒数码科技有限公司 | A kind of method and device of shared VR videos |
| CN109429072A (en) * | 2017-08-28 | 2019-03-05 | 触信（厦门）智能科技有限公司 | A kind of sharing method of panoramic pictures or panoramic video |
| CN112861252A (en) * | 2020-12-24 | 2021-05-28 | 中国航空工业集团公司成都飞机设计研究所 | Self-defined lattice standard unit and lattice structure |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102740158A (en) * | 2012-07-04 | 2012-10-17 | 合一网络技术(北京)有限公司 | System and method for uploading 3D (three-dimensional) video to video website by user |
| CN103581698A (en) * | 2012-07-31 | 2014-02-12 | 联想(北京)有限公司 | Terminal device and video data releasing method |
| CN103747058A (en) * | 2013-12-23 | 2014-04-23 | 乐视致新电子科技（天津）有限公司 | Method and apparatus for displaying picture |
| CN104010225A (en) * | 2014-06-20 | 2014-08-27 | 合一网络技术(北京)有限公司 | Method and system for displaying panoramic video |
| TW201506645A (en) * | 2014-10-15 | 2015-02-16 | Pc From Expert Co Ltd | A system and method for augmented reality project management |
-
2016
- 2016-02-03 CN CN201610076353.9A patent/CN107038164A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102740158A (en) * | 2012-07-04 | 2012-10-17 | 合一网络技术(北京)有限公司 | System and method for uploading 3D (three-dimensional) video to video website by user |
| CN103581698A (en) * | 2012-07-31 | 2014-02-12 | 联想(北京)有限公司 | Terminal device and video data releasing method |
| CN103747058A (en) * | 2013-12-23 | 2014-04-23 | 乐视致新电子科技（天津）有限公司 | Method and apparatus for displaying picture |
| CN104010225A (en) * | 2014-06-20 | 2014-08-27 | 合一网络技术(北京)有限公司 | Method and system for displaying panoramic video |
| TW201506645A (en) * | 2014-10-15 | 2015-02-16 | Pc From Expert Co Ltd | A system and method for augmented reality project management |
Non-Patent Citations (1)
| Title |
|---|
| 中国田园狗: "360全景拍摄为什么要使用鱼眼镜头,与超广角镜头区别？", 《HTTPS://BLOG.CSDN.NET/U012277891/ARTICLE/DETAILS/17189247》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109429072A (en) * | 2017-08-28 | 2019-03-05 | 触信（厦门）智能科技有限公司 | A kind of sharing method of panoramic pictures or panoramic video |
| CN107635152A (en) * | 2017-09-28 | 2018-01-26 | 深圳晶恒数码科技有限公司 | A kind of method and device of shared VR videos |
| CN112861252A (en) * | 2020-12-24 | 2021-05-28 | 中国航空工业集团公司成都飞机设计研究所 | Self-defined lattice standard unit and lattice structure |
| CN112861252B (en) * | 2020-12-24 | 2022-07-12 | 中国航空工业集团公司成都飞机设计研究所 | Lattice standard unit and lattice structure for aircraft structure design and modeling |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11671712B2 (en) | Apparatus and methods for image encoding using spatially weighted encoding quality parameters | |
| US10573351B2 (en) | Automatic generation of video and directional audio from spherical content | |
| US20220080261A1 (en) | Recommendation Method Based on Exercise Status of User and Electronic Device | |
| CN105874780B (en) | The method and apparatus that text color is generated to one group of image | |
| CN104012106B (en) | It is directed at the video of expression different points of view | |
| KR20180118816A (en) | Content collection navigation and auto forwarding | |
| CN105340279A (en) | Display update time reduction for a near-eye display | |
| CN107771395A (en) | The method and apparatus for generating and sending the metadata for virtual reality | |
| US20220417416A1 (en) | Photographing method in telephoto scenario and mobile terminal | |
| EP3364646A1 (en) | Electronic device and method for displaying 360-degree image in the electronic device | |
| CN106488120B (en) | Wearable intelligent shooting device and intelligent shooting system based on cloud technology | |
| CN107332977B (en) | Augmented reality method and augmented reality equipment | |
| CN113038165B (en) | Method, apparatus and storage medium for determining encoding parameter set | |
| CN107038164A (en) | A kind of method for sharing virtual reality image, apparatus and system | |
| KR20170094745A (en) | Method for video encoding and electronic device supporting the same | |
| CN114637890A (en) | Method for displaying label in image picture, terminal device and storage medium | |
| KR20130101380A (en) | System and method for providing information using a wearable display device | |
| CN105809618A (en) | Picture processing method and device | |
| CN109429072A (en) | A kind of sharing method of panoramic pictures or panoramic video | |
| CN108401163A (en) | A kind of method, apparatus and OTT operation systems for realizing VR live streamings | |
| CN107707830A (en) | Panoramic video based on one-way communication plays camera system | |
| CN107659356B (en) | Information transmission method and device | |
| CN116797767A (en) | Augmented reality scene sharing method and electronic device | |
| CN107872666A (en) | Image stream transmission method and the electronic equipment for supporting this method | |
| CN108924410B (en) | Photographing control method and related device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170811 |
|
| WD01 | Invention patent application deemed withdrawn after publication |