CN106682959A - Virtual reality terminal data processing method and virtual reality terminal - Google Patents

Virtual reality terminal data processing method and virtual reality terminal Download PDF

Info

Publication number
CN106682959A
CN106682959A CN201611079800.2A CN201611079800A CN106682959A CN 106682959 A CN106682959 A CN 106682959A CN 201611079800 A CN201611079800 A CN 201611079800A CN 106682959 A CN106682959 A CN 106682959A
Authority
CN
China
Prior art keywords
user
virtual image
image
merchandise news
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611079800.2A
Other languages
Chinese (zh)
Inventor
齐双成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201611079800.2A priority Critical patent/CN106682959A/en
Publication of CN106682959A publication Critical patent/CN106682959A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • G06Q30/0643Graphical representation of items or shoppers

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a virtual reality terminal data processing method and a virtual reality terminal. The virtual reality terminal comprises a plurality of cameras in different locations. The method comprises the following steps that the cameras collect the shape parameters of users from different positions; user virtual images are generated according to the shape parameters; commodity information selected by the users is received; the user virtual images are combined with the commodity information, and target virtual images are generated; the target virtual images are displayed. In the method, the user virtual images are generated and combined with the commodity information to generate the target virtual images, the target virtual images are displayed in the virtual reality terminal, the comprehensive effect of the target virtual images provides a reference for judging whether the users shop online, online shopping time and energy of the users are saved, the user experience is improved, and sources are saved.

Description

A kind of data processing method and virtual reality terminal of virtual reality terminal
Technical field
The present invention relates to the technical field of virtual reality, more particularly to a kind of data processing method of virtual reality terminal With a kind of virtual reality terminal.
Background technology
With the progress of science and technology, virtual reality (Virtual Reality, abbreviation VR) technology gradually causes user's Note.Virtual reality technology is a kind of computer simulation system that can be created with the experiencing virtual world, and it utilizes computer to give birth to It is interactively Three-Dimensional Dynamic what comes into a driver's and the system emulation of entity behavior of a kind of Multi-source Information Fusion into a kind of simulated environment, User can be made to be immersed in virtual environment, the sensation in true border is such as faced in experience.
In traditional economic field, user often likes attempting purchase clothing inside solid shop;And with electric business Economic rise, increasing user is liked in online virtual shop's purchase clothing.But the purchase clothes in virtual shop During dress, usually can be different because of the size at user's figure or other positions of body, and make the clothing (commodity) that user buys It is improper, it is unfavorable for the development of virtual shop.Although user can replace clothing (commodity) with repetitious, so can waste The time of user and energy.
The content of the invention
In view of the above problems, the embodiment of the present invention provides a kind of data processing method and virtual reality of virtual reality terminal Terminal, to solve prior art in the size of commodity bought in virtual shop of user is inaccurate or pattern is unsatisfied above-mentioned asks Topic.
In order to solve the above problems, the embodiment of the invention discloses a kind of data processing method of virtual reality terminal, institute Stating virtual reality terminal includes being distributed in multiple photographic head of diverse location, and methods described includes:
Using the plurality of photographic head respectively from the Geometrical Parameter of different station acquisition users;
User's virtual image is generated according to the Geometrical Parameter;
The merchandise news that receive user is selected;
User's virtual image and the merchandise news are combined, and generates destination virtual image;
Represent the destination virtual image.
A kind of virtual reality terminal is also disclosed in the embodiment of the present invention, the virtual reality terminal includes being distributed in difference Multiple photographic head of position, the terminal includes:
Parameter collection module, for using the plurality of photographic head respectively from the Geometrical Parameter of different station acquisition users;
Virtual image generation module, for generating user's virtual image according to the Geometrical Parameter;
Merchandise news receiver module, for the merchandise news that receive user is selected;
Destination virtual image generation module, for user's virtual image and the merchandise news to be combined, and generates Destination virtual image;
Destination virtual picture showing module, for representing the destination virtual image.
The embodiment of the present invention includes advantages below:
In the embodiment of the present invention, virtual reality terminal includes being distributed in multiple photographic head of diverse location, using described many Individual photographic head from the Geometrical Parameter of different station acquisition users, according to the Geometrical Parameter user's virtual image is generated respectively, is connect The merchandise news that user selects is received, user's virtual image and the merchandise news is combined, and generate destination virtual image, Represent the destination virtual image;In the embodiment of the present invention, the virtual image of user is generated, generate target with reference to merchandise news empty Intend image, and represent destination virtual image in virtual reality terminal, the resultant effect of the destination virtual image can be for user No net purchase provides reference frame, saves net purchase time and the energy of user, improves the experience of user, save resources.
Description of the drawings
Technical scheme in order to be illustrated more clearly that the embodiment of the present invention, below will be to making needed for embodiment description Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for For those of ordinary skill in the art, on the premise of not paying creative work, can be obtaining other according to these accompanying drawings Accompanying drawing.
The step of Fig. 1 is a kind of data processing method embodiment one of virtual reality terminal of embodiment of the present invention flow process Figure;
The step of Fig. 2 is a kind of data processing method embodiment two of virtual reality terminal of embodiment of the present invention flow process Figure;
Fig. 3 is a kind of structured flowchart of virtual reality terminal of device embodiment three in the embodiment of the present invention;
Fig. 4 is a kind of structured flowchart of virtual reality terminal of device embodiment four in the embodiment of the present invention.
Specific embodiment
In order that technical problem, technical scheme and beneficial effect that the embodiment of the present invention is solved become more apparent, with Lower combination drawings and Examples, further describe to the embodiment of the present invention.It should be appreciated that described herein be embodied as Example is not intended to limit the present invention only to explain the present invention.
Embodiment of the method one
With reference to Fig. 1, a kind of data processing method embodiment one of virtual reality terminal of the embodiment of the present invention is shown Flow chart of steps, the virtual reality terminal includes being distributed in multiple photographic head of diverse location, can specifically include following step Suddenly:
Step 101, using the plurality of photographic head respectively from the Geometrical Parameter of different station acquisition users;
In the embodiment of the present invention, the virtual reality terminal includes mobile terminal, optical module and construction module, certainly also External connection module, such as photographic head, sensor, localizer and controller, the external connection module and the virtual reality can be included Connected mode between the modules of terminal can be data wire connection or wirelessly connect, the interface of the data wire connection Can include USB (Universal Serial Bus, USB (universal serial bus)) interface, HDMI (HDMI, High Definition Multimedia Interface) interface etc.;The wireless connection can be Wi-Fi (Wireless- Fidelity, Wireless Fidelity), bluetooth, ZigBee (ZigBee protocol), NFC (Near Field Communication, closely Wireless communication technology) etc..
In the embodiment of the present invention, the mobile terminal can be the terminals such as smart mobile phone, panel computer, or can pacify The other-end of dress application program, such as intelligent watch etc., the present invention is not construed as limiting to the particular type of mobile terminal, the shifting The operating system of dynamic terminal can include Android (ARIXTRA), IOS, Windows Phone, Windows etc..
In the embodiment of the present invention, the optical module is described convex by two groups of convex lenss and optics governor motion structure composition Lens can single eyeglass or many eyeglasses;The optics governor motion can be used for adjusting between the convex lenss and human eye away from From, or for adjusting the distance between two groups of convex lenss, or for adjusting the diopter of convex lenss.
In the embodiment of the present invention, the construction module includes the circuit board of the enclosure interior of virtual reality terminal, described Physical button is set outside the housing of virtual reality terminal, related function, such as ON/OFF are realized by physical button and circuit board Machine, play, exit, returning.
It should be noted that the virtual reality terminal in the embodiment of the present invention includes being distributed in multiple shootings of diverse location Head, it is used for respectively from the Geometrical Parameter of different station acquisition users as external connection module;For example, the number of photographic head is three It is individual, front, rear and top that it is separately positioned on user;Or, the number of photographic head is five, its its be separately positioned on use The front at family, rear, left, right and top;Again or, the number of photographic head is nine, and it is separately positioned on before user Side, rear, left, right, left front, right front, left back, right back and top, etc..The position of setting and photographic head Number is more, then the Geometrical Parameter for gathering is more accurate.The Geometrical Parameter can by the photographic head between the user away from Obtain from calculating, the external dimensions information for characterizing user's difference body part, such as measurements of the chest, waist and hips data, the length of arm can be included The diameter of degree, the length of finger and its cross section or the length of circumscribed circle etc..The shape of user is acquired using multiple photographic head The mode of body parameter, can be using being coordinated between each two photographic head, according to the principle of dual camera triangulation come The mode for the photographic head being obtained to the distance between the user and further being calculated, or coordinated using photographic head and swash The mode that optical sensor determines photographic head to the distance between the user and further calculated, the embodiment of the present invention is concrete It is not restricted.
Step 102, according to the Geometrical Parameter user's virtual image is generated;
In being applied to the embodiment of the present invention, after obtaining above-mentioned Geometrical Parameter, virtual reality terminal can adopt the shape Body parameter sets up the threedimensional model of the user, then recycles the threedimensional model further to generate user's virtual image.Described three Dimension module sets up mode and can set up model, such as Sketchup softwares using various software, SolidWorks softwares, AUTOcad softwares etc., are not specifically restricted in the embodiment of the present invention.
Step 103, the merchandise news that receive user is selected;
Specific to the embodiment of the present invention, the virtual reality terminal can mutually carry out data exchange with server.It is described Server storage has various merchandise newss, and merchandise news can be the commodity three-dimensional image information of the commodity (including X, Y, Z coordinate Positional value on axle, and around X, Y, Z coordinate axle axle rotational value), item property (for example size, size, material, color, Applicable sex etc.), commodity price and commodity applicable position information etc.;Such as the commodity are " ring ", then corresponding merchandise news Can include:It is " finger " for " 1000 yuans " and commodity applicable position information that item property is " jewelry ", commodity price. In the embodiment of the present invention, when user chooses commodity from the display device of the virtual reality terminal, virtual reality terminal from Server downloads the corresponding merchandise news of the commodity, and shows on the display apparatus;I.e. from from the perspective of user, the business Product information will be showed in the tridimensional virtual environment residing for it.Also, the merchandise news is the real information of physical goods, above-mentioned Three-dimensional image information, size dimension, color etc. are also in kind with commodity consistent.
Step 104, user's virtual image and the merchandise news are combined, and generate destination virtual image;
For reality, above-mentioned user's virtual image and merchandise news are combined and are generated destination virtual figure by virtual reality terminal The step of picture, includes:Virtual reality terminal extracts image location information from user's virtual image, and extracts from merchandise news Go out commodity applicable position information and three-dimensional image information;By the virtual image positional information and the commodity applicable position Information carries out matching degree judgement, when described image positional information information is consistent with commodity applicable position information matches degree, by institute State merchandise news and be added in user's virtual image corresponding picture position, generate the destination virtual figure comprising merchandise news Picture.Specifically, the three-dimensional image information of commodity is suitable for image location information and adds to the corresponding figure of user's virtual image according to its Image position, to generate destination virtual image;That is, when user chooses the commodity in virtual environment, virtual reality terminal will The threedimensional model of the commodity is added on the corresponding picture position of user's virtual image.
In a particular embodiment, the positional information in above-mentioned user's virtual image includes:The three-dimensional position of parts of body Information (including the positional value on X, Y, Z coordinate axle, and around X, Y, Z coordinate axle axle rotational value).First, virtual reality end End extracts the three dimensional local information at each position of intended body from user's virtual image, and extracts from merchandise news applicable Positional information, commodity 3-D view and item property, price etc..Then, virtual reality terminal is by user's virtual image Target position information carries out matching degree judgement with the commodity applicable position information chosen, when the target position of user's virtual image When confidence breath is consistent with the applicable position information matches degree of commodity, by the other information of the commodity (such as three-dimensional image information, Item property, color, price etc.) target location that is added in user's virtual image, and generate and include the matching commodity The destination virtual image of information.That is, the three-dimensional image information of commodity is added to user's virtual three-dimensional according to its applicable position information The target location of image, and show the other information (such as item property, color, price etc.) of the commodity, it is empty to generate target Intend image;That is, when user chooses the commodity in virtual environment, virtual reality terminal is by the three-dimensional model information of the commodity And other merchandise newss are added on the target location of user's virtual image.User can know above-mentioned commodity in virtual environment Material object is added to the overall virtual effect of actual human body, can with direct feeling, whether the commodity desirable, be whether to determine that purchase is carried Foundation for reference.
For example, the commodity that user selects in virtual environment are " ring ", and virtual reality terminal is from user's virtual image The three dimensional local information of finger position is extracted, the three dimensional local information of the virtual image can be accurate to the position of inhomogeneity finger Put, the position that for example thumb, forefinger, middle finger, the third finger, tail refer to can also be accurate to left hand or right-hand lay;Simultaneously from ring Merchandise news in extract its applicable position information, it is possible to be accurate to suitably wear finger classification (for example it is wearable extremely Thumb, forefinger, middle finger, the third finger or tail refer to), can also be accurate to and suitably wear left hand or right-hand lay.Now, if user Be to pull fingers in the online ring for selecting, and this pulled into finger to be worn on the left hand of the virtual image third finger, virtual reality terminal by The nameless image three-dimensional positional information of the left hand carries out matching degree judgement with the applicable position information of the ring, and pulls the suitable of finger Thumb is generally with position, then virtual reality terminal is judged as both " mismatch ";For another example, user is in the online ring for selecting It is wedding ring, and the wedding ring is worn on the toe of virtual image, and do not include " toe " in the applicable position information of wedding ring, then Virtual reality terminal is judged as both " mismatch ";If above-mentioned wedding ring to be worn on user the right ring finger of virtual image On image, and comprising " the left hand third finger or right ring finger " in the applicable position information of wedding ring, then virtual reality terminal will be sentenced Break as " matching ".After commodity applicable position information is consistent with the matching of the target body site positional information of virtual image, should " wedding Other merchandise newss of ring ", for example:(fineness of gold or silver are pure for 3-D view, count, interior girth, diameter, thickness, material Degree), weight, color etc. the position of right ring finger then being extracted and be added in virtual image by virtual reality terminal.Finally, The destination virtual stereo-picture that right ring finger has worn above-mentioned wedding ring is generated, and the right ring finger side of the virtual image is also Show the merchandise news of the wedding ring.User can directly observe in virtual environment and experience right ring finger and wear above-mentioned Whole structure after " wedding ring ".
Further, virtual reality terminal except to virtual image positional information and the commodity applicable position information Judged with degree, also the dimension information and the matching degree of the commercial size information of the virtual image are judged.More Specifically, the information of the parts of body in user's virtual three-dimensional image also includes dimension information, and above-mentioned merchandise news also includes Dimension information.First, virtual reality terminal extracts the dimension information of target body site (including three from user's virtual image Dimensional data image, the length of extremity trunk, cross-sectional area or diameter etc.), and the position of commodity is extracted from merchandise news Information and other information (the corresponding extremity torso length of such as clothes trousers, cross-sectional area or diameter, the size of jewelry, chi Very little, material, color etc.).Then, the target site dimension information of the virtual image is carried out with the dimension information of the commodity Matching degree judges, when the target site dimension information of the virtual image and the consistent dimension information matching degree of commodity, by institute State commodity other information (such as three-dimensional image information, size, size, material, color, price etc.) be added to it is described virtual The target body site of image, generates the destination virtual image comprising matching merchandise news.User can obtain in virtual environment Know that above-mentioned commodity material object is added to the overall virtual effect of actual human body, whether can be closed with the size dimension of the direct feeling commodity Body.
For example, the commodity that user selects in virtual environment are " ring ", and virtual reality terminal is from user's virtual three-dimensional figure The dimension information at nameless position is extracted as in, it is assumed that a diameter of 15.7mm of its cross section;Believe from the commodity of ring simultaneously It is No. 9 (a diameter of 15.5mm) that its count is extracted in breath, and virtual reality terminal guards against the nameless dimension information with this No. 9 The dimension information of finger carries out matching degree judgement, because No. 9 ring diameters of the third finger of 15.7mm with diameter greater than 15.5mm, if Thick finger fills in little ring then makes human body sensory uncomfortable, and virtual reality terminal is judged as both " mismatch ";If the use Family have selected No. 10 rings (diameter is 15.8mm) on the net, because No. 10 rings of the nameless diameter of 15.7mm and 15.8mm Relatively, and wear the ring more slightly larger than finger had not only made user have comfort sense but also will not be loose to diameter, then virtual reality terminal Both are judged as " matching ".After commercial size information is consistent with the matching of the target body site dimension information of virtual image, The other information of " ring " is somebody's turn to do, for example:(fineness of gold is white for three-dimensional image information, count, interior girth, diameter, thickness, material Silver-colored purity), weight, color etc. then extract and be added on the nameless position in virtual image by virtual reality terminal.Most Afterwards, the destination virtual image that the third finger has worn above-mentioned ring is generated, and the nameless side of the virtual image also shows that the ring The merchandise news of finger, user can observe the whole structure worn after above-mentioned " ring " in virtual environment.
Certainly, the addition of the clothes image of different model or style can be also bound to user's virtual three-dimensional image by this step, And obtain the whole structure of destination virtual image.It is not described in detail here.
Step 105, represents the destination virtual image.
In the embodiment of the present invention, virtual reality terminal represents the destination virtual figure comprising merchandise news in display device Picture;The effect that i.e. user can observe and experience after user's virtual image addition merchandise news in virtual environment.
In the embodiment of the present invention, virtual reality terminal includes being distributed in multiple photographic head of diverse location, using described many Individual photographic head from the Geometrical Parameter of different station acquisition users, according to the Geometrical Parameter user's virtual image is generated respectively, is connect The merchandise news that user selects is received, user's virtual image and the merchandise news is combined, and generate destination virtual image, Represent the destination virtual image;In the embodiment of the present invention, the virtual image of user is generated, generate target with reference to merchandise news empty Intend image, and represent destination virtual image in virtual reality terminal, the resultant effect of the destination virtual image can be for user No net purchase provides reference frame, saves net purchase time and the energy of user, improves the experience of user, save resources.
Embodiment of the method two
With reference to Fig. 2, a kind of data processing method embodiment two of virtual reality terminal of the embodiment of the present invention is shown Flow chart of steps, the virtual reality terminal includes being distributed in multiple photographic head of diverse location, can specifically include following step Suddenly:
Step 201, using the plurality of photographic head respectively from the Geometrical Parameter of different station acquisition users;
In the embodiment of the present invention, the external connection module of virtual reality terminal includes multiple photographic head, using multiple photographic head from Diverse location gathers the Geometrical Parameter of user.Wherein, the mode of collection can be using being coordinated between each two photographic head, Or coordinated by the way of laser sensor using photographic head, the embodiment of the present invention is not any limitation as.The distributing position of photographic head and Number is arranged as described in embodiment one, be will not be described here.
Step 202, using the Geometrical Parameter threedimensional model of user is set up;
Further, virtual reality terminal sets up the threedimensional model of user, specific implementation using the Geometrical Parameter Can carry out setting up model using existing software, such as:Sketchup softwares, SolidWorks softwares, AUTOcad softwares etc..
Step 203, using threedimensional model user's virtual image is generated;
Specifically, after the threedimensional model for generating user, user's color data is added to the threedimensional model, it is raw Into the corresponding user's virtual image of the user.User can check corresponding user's virtual image in virtual environment.
Step 204, the merchandise news that receive user is selected;
Specifically, when user selects the commodity oneself wanted in virtual environment, virtual reality terminal is received from service The merchandise news that device is downloaded, merchandise news can be the commodity 3-D view of the commodity, and merchandise news can also belong to including commodity Property, commodity price and commodity applicable position information etc., it is concrete as described in embodiment one, will not be described here.
Step 205, user's virtual image and the merchandise news are combined, and generate destination virtual image;
In a kind of preferred embodiment of the embodiment of the present invention, user's virtual image and the merchandise news are combined simultaneously The step of generating destination virtual image includes:Commodity applicable position information is extracted from the merchandise news, and, from the use Family virtual image extracts image location information;Judge described image positional information and the commodity applicable position information whether one Cause;If so, then the merchandise news is added in user's virtual image corresponding picture position, generates destination virtual figure Picture.
It is described by user's virtual image and the merchandise news in another kind of preferred embodiment of the embodiment of the present invention With reference to, and also include the step of generate destination virtual image:Commercial size information is extracted from the merchandise news, and, from User's virtual image extracts image dimension information;Judge described image dimension information and the commercial size information It is whether consistent with spending;If so, then the merchandise news is added in user's virtual image corresponding picture position, generated Destination virtual image.
Above-mentioned user's virtual image and merchandise news are combined and generate destination virtual image process by virtual reality terminal: Virtual reality terminal extracts image location information from user's virtual image, and commodity applicable position is extracted from merchandise news Information, matching degree judgement is carried out by described image positional information with the commodity applicable position information, when described image position letter When breath is consistent with the matching degree of commodity applicable position information, by the corresponding commodity 3-D view of the merchandise news according to picture position Information adds into user's virtual image corresponding picture position, to generate destination virtual image.Detailed process is performed as described above example Described in one, will not be described here.
In the embodiment of the present invention, the merchandise news also includes color data, described that the merchandise news is added to into institute The step of stating corresponding picture position in user's virtual image, generation destination virtual image includes:By color data addition To the target location in user's virtual image, destination virtual image is generated.The destination virtual image of the addition color data Process can refer to the point of addition information of embodiment one or the process of dimension information, will not be described here.
Step 206, represents the destination virtual image;
In being applied to the embodiment of the present invention, user can observe and experience the addition of user's virtual image in virtual environment Effect after merchandise news.
Step 207, using the sensor mobile range data of user are obtained;
The virtual reality terminal of the embodiment of the present invention also includes sensor, and the sensor can include acceleration sensing Device, range sensor, displacement transducer, gyroscope etc., the embodiment of the present invention is not restricted to this;Virtual reality terminal can be adopted The mobile range data at each position of user's body are obtained with the sensor.
Whether step 208, judge the mobile range data more than predetermined threshold value;
Step 209, when the mobile range data are more than predetermined threshold value, return to step 201.
In the embodiment of the present invention, methods described also includes:The mobile range data of user are obtained using the sensor;Sentence Whether the mobile range data of breaking are more than predetermined threshold value;When the mobile range data are more than predetermined threshold value, return described Using the plurality of photographic head respectively from the Geometrical Parameter of different station acquisition users the step of, for example, the mobile width Degrees of data can with the hand underarm area of user clockwise on moved 30cm, and predetermined threshold value could be arranged to 2cm, then the shifting Dynamic amplitude data is more than predetermined threshold value, and virtual reality TCP return to step 201 re-executes acquisition step, needs Illustrate, the predetermined threshold value can be any numerical value that those skilled in the art set according to practical situation, the present invention Enforcement is not specifically restricted.
In specific to the embodiment of the present invention, when the sensor of one of the external connection module of virtual reality terminal, user is collected Body part mobile range data when, judge that the mobile range data whether more than predetermined threshold value, that is, detect that user is It is no, when mobile amplitude is more than certain threshold value, to determine that user has mobile its body part in mobile its body part, will Return to step 201, rerun routine.
In the embodiment of the present invention, using the plurality of photographic head respectively from the Geometrical Parameter of different station acquisition users, adopt The threedimensional model of user is set up with the Geometrical Parameter, user's virtual image, receive user choosing are generated using threedimensional model The merchandise news selected, user's virtual image and the merchandise news are combined, and generate destination virtual image, represent described Destination virtual image, in the embodiment of the present invention, solves user and buys the inappropriate problem of commodity in virtual store, reduces user The number of times of trip, saves time and the energy of user, further increases the experience of user.
It should be noted that for embodiment of the method, in order to be briefly described, therefore it to be all expressed as a series of action group Close, but those skilled in the art should know, and the embodiment of the present invention is not limited by described sequence of movement, because according to According to the embodiment of the present invention, some steps can adopt other orders or while carry out.Secondly, those skilled in the art also should Know, embodiment described in this description belongs to preferred embodiment, the involved action not necessarily present invention is implemented Example is necessary.
Device embodiment three
Fig. 3 is the structured flowchart of the virtual reality terminal of one embodiment of the invention, and the virtual reality terminal includes dividing Cloth diverse location multiple photographic head, the virtual reality terminal 300 shown in Fig. 3 include parameter collection module 301, virtual image Generation module 302, merchandise news receiver module 303, destination virtual image generation module 304 and destination virtual picture showing mould Block 305.
Parameter collection module 301, for being joined from the body of different station acquisition users respectively using the plurality of photographic head Number;
Virtual image generation module 302, for generating user's virtual image according to the Geometrical Parameter;
Merchandise news receiver module 303, for the merchandise news that receive user is selected;
Destination virtual image generation module 304 is for user's virtual image and the merchandise news to be combined and raw Into destination virtual image;
Destination virtual picture showing module 305, for representing the destination virtual image.
Preferably, the virtual reality terminal includes sensor, and the terminal also includes:
Data acquisition module, for obtaining the mobile range data of user using the sensor;
Judge module, for judging the mobile range data whether more than predetermined threshold value;
Module is returned, for when the mobile range data are more than predetermined threshold value, return is described to be taken the photograph using the plurality of As head respectively from the Geometrical Parameter of different station acquisition users the step of.
Preferably, the virtual image generation module 302 includes:
Three-dimension modeling submodule, for setting up the threedimensional model of user using the Geometrical Parameter;
Virtual image generates submodule, for generating user's virtual image using threedimensional model.
Preferably, the destination virtual image generation module 304 includes:
First extracting sub-module, for extracting commodity applicable position information from the merchandise news, and, from the use Family virtual image extracts image location information;
First judging submodule, for judging described image positional information and the commodity applicable position information whether one Cause;
First object virtual image generates submodule, for believing with the commodity applicable position when described image positional information When ceasing consistent, then the merchandise news is added in user's virtual image corresponding image location information, generates target Virtual image.
Preferably, the destination virtual image generation module 304 also includes:
Second extracting sub-module, for extracting commercial size information from the merchandise news, and, it is empty from the user Intend image zooming-out and go out image dimension information;
Second judging submodule, for judge described image dimension information and the commercial size information matching degree whether Unanimously;
Second destination virtual image generates submodule, for when described image dimension information and the commercial size information When matching degree is consistent, then the merchandise news is added in user's virtual image corresponding picture position, generates target Virtual image.
Preferably, the merchandise news includes color data, and the destination virtual image generates submodule to be included:
Destination virtual image generation unit, for the color data to be added in user's virtual image accordingly Picture position, generates destination virtual image.
Device embodiment four
Fig. 4 is the structured flowchart of the virtual reality terminal of another embodiment of the present invention.The virtual reality terminal 400 is wrapped Mobile terminal 407, optical module 408 and construction module 409 are included, external connection module 410 can also be included.
Wherein, the mobile terminal 407 in the virtual reality terminal shown in Fig. 4 includes:At least one processor 401, storage Device 402, at least one network interface 404 and other users interface 403.Each component in mobile terminal 400 is by total linear system System 405 is coupled.It is understood that bus system 405 is used to realize the connection communication between these components.Bus system 405 In addition to including data/address bus, also including power bus, controlling bus and status signal bus in addition.But illustrate in order to clear See, in the diagram various buses are all designated as into bus system 405.
Wherein, user interface 403 can include display, keyboard or pointing device (for example, mouse, trace ball (trackball), touch-sensitive plate or touch screen etc..
It is appreciated that the memorizer 402 in the embodiment of the present invention can be volatile memory or nonvolatile memory, Or may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read only memory (Read- OnlyMemory, ROM), programmable read only memory (ProgrammableROM, PROM), Erasable Programmable Read Only Memory EPROM (ErasablePROM, EPROM), Electrically Erasable Read Only Memory (ElectricallyEPROM, EEPROM) dodge Deposit.Volatile memory can be random access memory (RandomAccessMemory, RAM), and it is used as outside slow at a high speed Deposit.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM (StaticRAM, SRAM), dynamic random access memory (DynamicRAM, DRAM), Synchronous Dynamic Random Access Memory (SynchronousDRAM, SDRAM), double data speed synchronous dynamic RAM (DoubleDataRate SDRAM, DDRSDRAM), enhancement mode Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links Dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct rambus random access memory (DirectRambusRAM, DRRAM).The memorizer 402 of the system and method for embodiment of the present invention description is intended to include but does not limit In these memorizeies with any other suitable type.
In some embodiments, memorizer 402 stores following element, can perform module or data structure, or Person their subset, or their superset:Operating system 4021 and application program 4022.
Wherein, operating system 4021, comprising various system programs, such as ccf layer, core library layer, driving layer etc., are used for Realize various basic businesses and process hardware based task.Application program 4022, comprising various application programs, such as media Player (MediaPlayer), browser (Browser) etc., for realizing various applied business.Realize embodiment of the present invention side The program of method may be embodied in application program 4022.
In embodiments of the present invention, by call memorizer 402 store program or instruction, specifically, can be application The program stored in program 4022 or instruction, the virtual reality terminal includes being distributed in multiple photographic head of diverse location, place Reason device 401 is used for using the plurality of photographic head respectively from the Geometrical Parameter of different station acquisition users;Join according to the body Number generates user's virtual image;The merchandise news that receive user is selected;User's virtual image and the merchandise news are tied Close, and generate destination virtual image;Represent the destination virtual image.
The method that the embodiments of the present invention are disclosed can apply in processor 401, or be realized by processor 401. A kind of possibly IC chip of processor 401, the disposal ability with signal.During realization, said method it is each Step can be completed by the instruction of the integrated logic circuit of the hardware in processor 401 or software form.Above-mentioned process Device 401 can be general processor, digital signal processor (DigitalSignalProcessor, DSP), special IC (ApplicationSpecific IntegratedCircuit, ASIC), ready-made programmable gate array (FieldProgrammableGateArray, FPGA) either other PLDs, discrete gate or transistor logic Device, discrete hardware components.Can realize or perform disclosed each method in the embodiment of the present invention, step and box Figure.General processor can be microprocessor or the processor can also be any conventional processor etc..With reference to the present invention The step of method disclosed in embodiment, can be embodied directly in hardware decoding processor and perform and complete, or use decoding processor In hardware and software module combination execution complete.Software module may be located at random access memory, and flash memory, read only memory can In the ripe storage medium in this area such as program read-only memory or electrically erasable programmable memory, depositor.The storage Medium is located at memorizer 402, and processor 401 reads the information in memorizer 402, with reference to its hardware the step of said method is completed Suddenly.
It is understood that the embodiment of the present invention description these embodiments can with hardware, software, firmware, middleware, Microcode or its combination are realizing.For hardware is realized, processing unit can be realized in one or more special ICs (ApplicationSpecificIntegratedCircuits, ASIC), digital signal processor (DigitalSignalProcessing, DSP), digital signal processing appts (DSPDevice, DSPD), programmable logic device (ProgrammableLogicDevice, PLD), field programmable gate array (Field-ProgrammableGateArray, FPGA), general processor, controller, microcontroller, microprocessor, other the electronics lists for performing herein described function In unit or its combination.
For software realize, can pass through perform the embodiment of the present invention described in function module (such as process, function etc.) come Realize the technology described in the embodiment of the present invention.Software code is storable in memorizer and by computing device.Memorizer can To realize within a processor or outside processor.
Alternatively, processor 401 is additionally operable to:The mobile range data of user are obtained using the sensor;
Alternatively, processor 401 is additionally operable to:Judge the mobile range data whether more than predetermined threshold value;
Alternatively, processor 401 is additionally operable to:When the mobile range data are more than predetermined threshold value, the employing is returned The plurality of photographic head respectively from the Geometrical Parameter of different station acquisition users the step of.
Alternatively, processor 401 is additionally operable to:The threedimensional model of user is set up using the Geometrical Parameter;
Alternatively, processor 401 is additionally operable to:User's virtual image is generated using threedimensional model.
Alternatively, processor 401 is additionally operable to:Commodity applicable position information is extracted from the merchandise news, and, from institute State user's virtual image and extract image location information;
Alternatively, processor 401 is additionally operable to:Judge whether are described image positional information and the commodity applicable position information Unanimously;
Alternatively, processor 401 is additionally operable to:If so, then the merchandise news is added in user's virtual image Corresponding picture position, generates destination virtual image.
Alternatively, processor 401 is additionally operable to:Commercial size information is extracted from the merchandise news, and, from the use Family virtual image extracts image dimension information;
Alternatively, processor 401 is additionally operable to:Judge the matching degree of described image dimension information and the commercial size information It is whether consistent;
Alternatively, processor 401 is additionally operable to:If so, then the merchandise news is added in user's virtual image Corresponding picture position, generates destination virtual image.
Alternatively, processor 401 is additionally operable to:The color data is added in user's virtual image and is schemed accordingly Image position, generates destination virtual image.
Mobile terminal 400 can realize each process that mobile terminal is realized in previous embodiment, to avoid repeating, here Repeat no more.
In the embodiment of the present invention, virtual reality terminal includes being distributed in multiple photographic head of diverse location, using described many Individual photographic head from the Geometrical Parameter of different station acquisition users, according to the Geometrical Parameter user's virtual image is generated respectively, is connect The merchandise news that user selects is received, user's virtual image and the merchandise news is combined, and generate destination virtual image, Represent the destination virtual image;In the embodiment of the present invention, user's virtual image of user is generated, with reference to merchandise news mesh is generated Mark virtual image, and virtual reality terminal represents destination virtual image, realizes that user can stay indoors and is done shopping, and economizes on The time at family and energy, improve the experience of user, save resources.
Those of ordinary skill in the art it is to be appreciated that with reference to disclosed in the embodiment of the present invention embodiment description it is each The unit and algorithm steps of example, being capable of being implemented in combination in electronic hardware or computer software and electronic hardware.These Function is performed with hardware or software mode actually, depending on the application-specific and design constraint of technical scheme.Specialty Technical staff can use different methods to realize described function to each specific application, but this realization should not Think beyond the scope of this invention.
Those skilled in the art can be understood that, for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be described here.
In embodiment provided herein, it should be understood that disclosed apparatus and method, can pass through other Mode is realized.For example, device embodiment described above is only schematic, and for example, the division of the unit is only A kind of division of logic function, can there is an other dividing mode when actually realizing, such as multiple units or component can with reference to or Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual Between coupling or direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, device or unit Connect, can be electrical, mechanical or other forms.
The unit as separating component explanation can be or may not be it is physically separate, it is aobvious as unit The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can according to the actual needs be selected to realize the mesh of this embodiment scheme 's.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, it is also possible to It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.
If the function is realized and as independent production marketing or when using using in the form of SFU software functional unit, can be with In being stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be individual People's computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the invention. And aforesaid storage medium includes:USB flash disk, portable hard drive, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes Medium.
The above, the only specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, all should contain Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.

Claims (12)

1. a kind of data processing method of virtual reality terminal, it is characterised in that the virtual reality terminal includes being distributed in not With multiple photographic head of position, methods described includes:
Using the plurality of photographic head respectively from the Geometrical Parameter of different station acquisition users;
User's virtual image is generated according to the Geometrical Parameter;
The merchandise news that receive user is selected;
User's virtual image and the merchandise news are combined, and generates destination virtual image;
Represent the destination virtual image.
2. method according to claim 1, it is characterised in that the virtual reality terminal includes sensor, methods described Also include:
The mobile range data of user are obtained using the sensor;
Judge the mobile range data whether more than predetermined threshold value;
When the mobile range data be more than predetermined threshold value when, return it is described using the plurality of photographic head respectively from diverse location The step of Geometrical Parameter of collection user.
3. method according to claim 1, it is characterised in that described to generate user's virtual image according to the Geometrical Parameter The step of include:
The threedimensional model of user is set up using the Geometrical Parameter;
User's virtual image is generated using threedimensional model.
4. method according to claim 1, it is characterised in that described by user's virtual image and the merchandise news With reference to, and include the step of generate destination virtual image:
Commodity applicable position information is extracted from the merchandise news, and, extract image position from user's virtual image Confidence ceases;
Judge whether described image positional information is consistent with the matching degree of the commodity applicable position information;
If so, then the merchandise news is added in user's virtual image corresponding picture position, generates destination virtual Image.
5. method according to claim 1, it is characterised in that described by user's virtual image and the merchandise news With reference to, and also include the step of generate destination virtual image:
Commercial size information is extracted from the merchandise news, and, extract picture size letter from user's virtual image Breath;
Judge whether described image dimension information is consistent with the matching degree of the commercial size information;
If so, then the merchandise news is added in user's virtual image corresponding picture position, generates destination virtual Image.
6. the method according to claim 4 or 5, it is characterised in that the merchandise news includes color data, described by institute State the step of merchandise news is added in user's virtual image corresponding image location information, generation destination virtual image and wrap Include:
The color data is added in user's virtual image corresponding image location information, destination virtual figure is generated Picture.
7. a kind of virtual reality terminal, it is characterised in that the virtual reality terminal includes that being distributed in the multiple of diverse location takes the photograph As head, the terminal includes:
Parameter collection module, for using the plurality of photographic head respectively from the Geometrical Parameter of different station acquisition users;
Virtual image generation module, for generating user's virtual image according to the Geometrical Parameter;
Merchandise news receiver module, for the merchandise news that receive user is selected;
Destination virtual image generation module, for user's virtual image and the merchandise news to be combined, and generates target Virtual image;
Destination virtual picture showing module, for representing the destination virtual image.
8. terminal according to claim 7, it is characterised in that the virtual reality terminal includes sensor, the terminal Also include:
Data acquisition module, for obtaining the mobile range data of user using the sensor;
Judge module, for judging the mobile range data whether more than predetermined threshold value;
Module is returned, for when the mobile range data are more than predetermined threshold value, returning described using the plurality of photographic head Respectively from the Geometrical Parameter of different station acquisition users the step of.
9. terminal according to claim 7, it is characterised in that the virtual image generation module includes:
Three-dimension modeling submodule, for setting up the threedimensional model of user using the Geometrical Parameter;
Virtual image generates submodule, for generating user's virtual image using threedimensional model.
10. terminal according to claim 7, it is characterised in that the destination virtual image generation module includes:
First extracting sub-module, for extracting commodity applicable position information from the merchandise news, and, it is empty from the user Intend image zooming-out and go out image location information;
First judging submodule, for judging whether described image positional information is consistent with the commodity applicable position information;
First object virtual image generates submodule, for when described image positional information and the commodity applicable position information one During cause, then the merchandise news is added in user's virtual image corresponding picture position, generates destination virtual image.
11. terminals according to claim 7, it is characterised in that the logo image generation module also includes:
Second extracting sub-module, for extracting commercial size information from the merchandise news, and, from user's virtual graph As extracting image dimension information;
Second judging submodule, for judging the matching degree of described image dimension information and the commercial size information whether Cause;
Second destination virtual image generates submodule, for matching when described image dimension information and the commercial size information When spending consistent, then the merchandise news is added in user's virtual image corresponding picture position, generates destination virtual Image.
12. terminals according to claim 10 or 11, it is characterised in that the merchandise news includes color data, described Destination virtual image generates submodule to be included:
Destination virtual image generation unit, for the color data to be added in user's virtual image into corresponding image Position, generates destination virtual image.
CN201611079800.2A 2016-11-29 2016-11-29 Virtual reality terminal data processing method and virtual reality terminal Pending CN106682959A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611079800.2A CN106682959A (en) 2016-11-29 2016-11-29 Virtual reality terminal data processing method and virtual reality terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611079800.2A CN106682959A (en) 2016-11-29 2016-11-29 Virtual reality terminal data processing method and virtual reality terminal

Publications (1)

Publication Number Publication Date
CN106682959A true CN106682959A (en) 2017-05-17

Family

ID=58866305

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611079800.2A Pending CN106682959A (en) 2016-11-29 2016-11-29 Virtual reality terminal data processing method and virtual reality terminal

Country Status (1)

Country Link
CN (1) CN106682959A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107862563A (en) * 2017-09-16 2018-03-30 深圳市赛亿科技开发有限公司 Virtual shopping method and system
CN108227927A (en) * 2018-01-09 2018-06-29 北京小米移动软件有限公司 Product introduction method, apparatus and electronic equipment based on VR
CN110308792A (en) * 2019-07-01 2019-10-08 北京百度网讯科技有限公司 Control method, device, equipment and the readable storage medium storing program for executing of virtual role
CN110517110A (en) * 2019-08-13 2019-11-29 蚌埠聚本电子商务产业园有限公司 A kind of e-commerce purchasing method and system based on long-range AR trial assembly
CN115810073A (en) * 2022-12-19 2023-03-17 支付宝(杭州)信息技术有限公司 Virtual image generation method and device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102842089A (en) * 2012-07-18 2012-12-26 上海交通大学 Network virtual fit system based on 3D actual human body model and clothes model
JP5605885B1 (en) * 2014-02-27 2014-10-15 木下 泰男 Virtual try-on system and virtual try-on program
CN104159037A (en) * 2014-08-26 2014-11-19 厦门美图之家科技有限公司 Self-timer method for automatically photographing
CN104637084A (en) * 2015-01-29 2015-05-20 吴宇晖 Method for building garment virtual three-dimensional model and virtual garment trying-on system
CN105303411A (en) * 2015-11-17 2016-02-03 北京三件客科技有限公司 Internet-based 3D garment customization scanning system and method thereof
CN105825414A (en) * 2016-03-15 2016-08-03 成都爆米花信息技术有限公司 Virtual fitting system
CN105989617A (en) * 2014-08-08 2016-10-05 株式会社东芝 Virtual try-on apparatus and virtual try-on method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102842089A (en) * 2012-07-18 2012-12-26 上海交通大学 Network virtual fit system based on 3D actual human body model and clothes model
JP5605885B1 (en) * 2014-02-27 2014-10-15 木下 泰男 Virtual try-on system and virtual try-on program
CN105989617A (en) * 2014-08-08 2016-10-05 株式会社东芝 Virtual try-on apparatus and virtual try-on method
CN104159037A (en) * 2014-08-26 2014-11-19 厦门美图之家科技有限公司 Self-timer method for automatically photographing
CN104637084A (en) * 2015-01-29 2015-05-20 吴宇晖 Method for building garment virtual three-dimensional model and virtual garment trying-on system
CN105303411A (en) * 2015-11-17 2016-02-03 北京三件客科技有限公司 Internet-based 3D garment customization scanning system and method thereof
CN105825414A (en) * 2016-03-15 2016-08-03 成都爆米花信息技术有限公司 Virtual fitting system

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107862563A (en) * 2017-09-16 2018-03-30 深圳市赛亿科技开发有限公司 Virtual shopping method and system
CN108227927A (en) * 2018-01-09 2018-06-29 北京小米移动软件有限公司 Product introduction method, apparatus and electronic equipment based on VR
CN108227927B (en) * 2018-01-09 2021-07-23 北京小米移动软件有限公司 VR-based product display method and device and electronic equipment
CN110308792A (en) * 2019-07-01 2019-10-08 北京百度网讯科技有限公司 Control method, device, equipment and the readable storage medium storing program for executing of virtual role
CN110308792B (en) * 2019-07-01 2023-12-12 北京百度网讯科技有限公司 Virtual character control method, device, equipment and readable storage medium
CN110517110A (en) * 2019-08-13 2019-11-29 蚌埠聚本电子商务产业园有限公司 A kind of e-commerce purchasing method and system based on long-range AR trial assembly
CN115810073A (en) * 2022-12-19 2023-03-17 支付宝(杭州)信息技术有限公司 Virtual image generation method and device

Similar Documents

Publication Publication Date Title
CN106682959A (en) Virtual reality terminal data processing method and virtual reality terminal
US11164381B2 (en) Clothing model generation and display system
CA2863097C (en) System and method for simulating realistic clothing
US20220258049A1 (en) System and method for real-time calibration of virtual apparel using stateful neural network inferences and interactive body measurements
KR20210011425A (en) Image processing method and device, image device, and storage medium
CN105956912A (en) Method for realizing network fitting
CN110021061A (en) Collocation model building method, dress ornament recommended method, device, medium and terminal
CN107251025A (en) System and method for generating virtual content from threedimensional model
Gültepe et al. Real-time virtual fitting with body measurement and motion smoothing
CN113129450B (en) Virtual fitting method, device, electronic equipment and medium
CN102201032A (en) Personalized appareal and accessories inventory and display
Jimeno-Morenilla et al. Augmented and virtual reality techniques for footwear
CN106097067A (en) A kind of sweater based on the Internet customizes design system and method
CN114612643B (en) Image adjustment method and device for virtual object, electronic equipment and storage medium
US20190026809A1 (en) Highly Custom and Scalable Design System and Method for Articles of Manufacture
CN106779774A (en) Virtual fitting system and virtual fit method
Li et al. Feature curve-net-based three-dimensional garment customization
WO2022262508A1 (en) Augmented reality-based intelligent trying on method and system, terminal, and medium
Liu Computer 5G virtual reality environment 3D clothing design
CN108875496A (en) The generation of pedestrian's portrait and the pedestrian based on portrait identify
CN107168606A (en) Dialog control display methods, device and user terminal
CN105204630A (en) Method and system for garment design through motion sensing
CN105046738A (en) Clothes dynamic three-dimension making method and making apparatus
al-Qerem Virtual dressing room implementation using body image–clothe mapping
CN106022887A (en) Simulation dressing mirror

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170517

RJ01 Rejection of invention patent application after publication