CN107909654A - Home Fashion & Design Shanghai experiencing system based on AR technologies - Google Patents

Home Fashion & Design Shanghai experiencing system based on AR technologies Download PDF

Info

Publication number
CN107909654A
CN107909654A CN201711296337.1A CN201711296337A CN107909654A CN 107909654 A CN107909654 A CN 107909654A CN 201711296337 A CN201711296337 A CN 201711296337A CN 107909654 A CN107909654 A CN 107909654A
Authority
CN
China
Prior art keywords
msub
mrow
image
model
salient region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711296337.1A
Other languages
Chinese (zh)
Inventor
孙文新
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fast Creation Technology (dalian) Co Ltd
Original Assignee
Fast Creation Technology (dalian) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fast Creation Technology (dalian) Co Ltd filed Critical Fast Creation Technology (dalian) Co Ltd
Priority to CN201711296337.1A priority Critical patent/CN107909654A/en
Publication of CN107909654A publication Critical patent/CN107909654A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/04Architectural design, interior design
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20Indexing scheme for editing of 3D models
    • G06T2219/2016Rotation, translation, scaling

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a kind of Home Fashion & Design Shanghai experiencing system based on AR technologies, including:The data message that the model unit for being printed with the image information of the entity finishing material of house fitting-up needs, the acquiring unit, the reception acquiring unit that gather image information all on model unit transmit is combined indoor each goods of furniture for display rather than for use with floor or wallpaper the design cell and AR display units of progress interior decoration design.The system carries out the setting and planning and then the displaying by AR display units progress augmented reality of finishing general layout by the sofa image, tea table image, floor image to scanning etc. centralized integration into an application scenarios, user is comprehensively watched the finishing effect in future, and be recognized that the details of each household items.

Description

Home Fashion & Design Shanghai experiencing system based on AR technologies
Technical field
The present invention relates to the augmented reality field of image, more particularly to the Home Fashion & Design Shanghai experience system based on AR technologies System.
Background technology
Conspicuousness detection and augmented reality are arrived involved in image procossing.
Conspicuousness detection technique is the important step that the object in image can clearly be shown, the image in image procossing Salient region be typically a small part, but the background of image but occupies the major part of image, therefore we need Quickly to obtain the salient region of the image.
Augmented reality (Augmented Reality, abbreviation AR), be grow up on the basis of virtual reality it is new Skill, art, are also referred to as mixed reality.It is that the information provided by computer system increases the skill that user perceives real world Art, by virtual Information application to real world, and dummy object, scene or the system prompt information superposition that computer is generated Into real scene, so as to fulfill the enhancing to reality, simultaneously as contacting and be not switched off with real world, hand over Mutual mode also just seems more natural.Augmented reality is produced in actual environment not by computer graphics techniques and visualization technique Existing virtual objects, and by virtual objects, accurately " placement ", will by display device in true environment by sensing technology Virtual objects combine together with true environment, and are presented to one real new environment of sensory effects of user.This augmented reality System is combined with actual situation, real-time, interactive, the new feature of three-dimensional registration.
At present in terms of house fitting-up, many decoration companies are still to use by the sample graphics of finishing either brochure Family is seen, does not allow user to obtain more vivid experience to the effect of finishing, the finishing for causing user to complete to have to household in finishing Not enough satisfied phenomenon.
The content of the invention
According to problem existing in the prior art, the invention discloses a kind of Home Fashion & Design Shanghai experiencing system based on AR technologies, Including:
It is printed with the model unit of the image information of the entity finishing material of house fitting-up needs;Wherein model unit is piece Shape carrier, the frontal design of the carrier have nanoscale lenticule round dot optical grating construction, and the front of the carrier is printed with house fitting-up In floor sample image information, the image information of wallpaper sample, the image information of each indoor decorations;
The acquiring unit of image information all on model unit is gathered, wherein acquiring unit is gathered on model unit successively The image information of floor sample, the image information of wallpaper sample, the image information of each indoor decorations, the image set that will be collected In be incorporated into an application scenarios;
The acquiring unit reads the image information obtained and carries out at the feature extraction of image information and the conspicuousness of image Reason:The salient region of the characteristic area of image is extracted first, and salient region is carried out rotation obtains rotation copy, will be notable Property region and rotation copy composition template group be standardized generation wave filter group, to wave filter group carry out correlation filtering life Into response diagram;
The acquiring unit includes memory module, the memory module include the model informations of indoor decorations, floor and The model information of wallpaper, wherein model include at least desk lamp model, pendent lamp model, sofa model and tea table model, the acquisition Unit carries out the model in storage unit according to response diagram information the matching image of image rendering and addition generation household goods of furniture for display rather than for use With finishing style information;
The AR display units of the scene information of the finishing pattern of the acquiring unit transmission are received, the AR display units will The two-dimensional scene received is converted into three-dimensional scenic and carries out 3D displayings, and the AR display units include suggestion module, the suggestion Module reads the decoration style that the finishing pattern that current acquiring unit obtains is selected according to user and provides suggestion for revision or provide new Design pattern.
Further, the AR display units further include light and provide module, and it is a variety of not that the light provides module offer Same intensity of illumination.
Further, augmented reality application data are provided with the AR display units, the wherein data include at least room Character introduction information, image recommended information, video display information and the voice messaging of interior goods of furniture for display rather than for use model.
Further, the acquiring unit is by using such as lower section when salient region and its revolute constitutive modeling plate group Formula:
According to the border point coordinates of initial salient region feature modeling salient region copy, salient region rotation is calculated Turn the boundary point of copy:
IfFor initial salient region border CiIt is θ in rotation anglejWhen, rotation produces new border point coordinates:
Wherein 1 is all 1 column vector, T for all elementsjFor affine transformation matrix;
The rotation copy of salient region is intercepted in duplicate pictures are rotated using the rotation copy border of salient region, Utilize the rotation copy border that salient region is calculatedIn rotation duplicate picturesInterception area SiJ-th it is notable The rotation copy in property region
By each salient region and its rotation replica group template group, each salient region and its rotation copy composition n are utilized A template group T={ T1,T2,…,Tn, wherein:
By adopting the above-described technical solution, a kind of Home Fashion & Design Shanghai experiencing system based on AR technologies provided by the invention, The floor image printed on model unit, wallpaper image, sofa image etc. are gathered first, and the image of acquisition is focused on one In application scenarios, the characteristic that image is obtained by the conspicuousness processing to image provides decorating scheme to the user, and should System can design decorating scheme for user, according to the sofa mould of decoration style input by user system reading storage inside Type, tea table model etc., multiple models are grouped together and design new decorating scheme, the decorating scheme that will finally design The displaying of 3D effect is carried out by AR display units, allows the effect for watching following family finishing that user is clear, true to nature Video.
Brief description of the drawings
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, below will be to embodiment or existing There is attached drawing needed in technology description to be briefly described, it should be apparent that, drawings in the following description are only this Some embodiments described in application, for those of ordinary skill in the art, without creative efforts, Other attached drawings can also be obtained according to these attached drawings.
Fig. 1 is the structure diagram of the Home Fashion & Design Shanghai experiencing system of the invention based on AR technologies.
Embodiment
To make technical scheme and advantage clearer, with reference to the attached drawing in the embodiment of the present invention, to this Technical solution in inventive embodiments is clearly completely described:
Home Fashion & Design Shanghai experiencing system based on AR technologies as shown in Figure 1, including:
It is printed with the model unit of the image information of the entity finishing material of house fitting-up needs;Wherein model unit is piece Shape carrier, the frontal design of the carrier have nanoscale lenticule round dot optical grating construction, and the front of the carrier is printed with house fitting-up In floor sample image information, the image information of wallpaper sample, the image information of each indoor decorations;Sell finishing material Businessman floor image, wallpaper image, sofa image, tea table image, pendent lamp image etc. all concentrated are printed on model unit On, since the surface of model unit is provided with optical grating construction, ensure that image information is undistorted after printing, image definition is very It is high.And ensure that model unit can be used and preserved for a long time.
The acquiring unit of image information all on model unit is gathered, wherein acquiring unit is gathered on model unit successively The image information of floor sample, the image information of wallpaper sample, the image information of each indoor decorations, the image set that will be collected In be incorporated into an application scenarios;
The acquiring unit reads the image information obtained and carries out at the feature extraction of image information and the conspicuousness of image Reason:The salient region of the characteristic area of image is extracted first, and salient region is carried out rotation obtains rotation copy, will be notable Property region and rotation copy composition template group be standardized generation wave filter group, to wave filter group carry out correlation filtering life Into response diagram.Acquiring unit can quickly capture the characteristic information, simultaneously of image when obtaining image using aforesaid way And the image information captured is more accurate.
The acquiring unit includes memory module, the memory module include the model informations of indoor decorations, floor and The model information of wallpaper, wherein model include at least desk lamp model, pendent lamp model, sofa model and tea table model, the acquisition Unit carries out the model in storage unit according to response diagram information the matching image of image rendering and addition generation household goods of furniture for display rather than for use With finishing style information;User is watched after the finishing effect that the image shows obtained from model unit come out if fitted up Style or finishing effect are not satisfied enough, for example, if the collocation to sofa is not satisfied enough, can be transferred from storage unit new Desk lamp model, sofa model etc. redesigned, and the decoration style liked can be inputted, the then suggestion mould Block can provide the collocation of finishing opinion and related ornaments, provide a variety of decorating schemes to the user.
The AR display units of the scene information of the finishing pattern of the acquiring unit transmission are received, the AR display units will The two-dimensional scene received is converted into three-dimensional scenic and carries out 3D displayings, and the AR display units include suggestion module, the suggestion Module reads the decoration style that the finishing pattern that current acquiring unit obtains is selected according to user and provides suggestion for revision or provide new Design pattern.Suggestion module reads the decoration style that the finishing pattern that current acquiring unit obtains is selected according to user and provides modification Opinion provides new design pattern.The more vivid displaying of effect can will be fitted up by AR display units, allow user from Multiple angles watch the following effect video fitted up.
Further, the AR display units further include light and provide module, and it is a variety of not that the light provides module offer Same intensity of illumination.Since interior received different sunlight intensities, the different indoor finishing effects of light in one day Fruit is different, therefore we provide the different luminous intensity of unit offer to check that finishing at different moments is imitated using light Fruit.
Further, augmented reality application data are provided with the AR display units, the wherein data include at least room Character introduction information, image recommended information, video display information and the voice messaging of interior goods of furniture for display rather than for use model.Pass through AR display units Carry out finishing effect displaying when, can have relevant character introduction to each goods of furniture for display rather than for use for example desk lamp, sofa, bottom plate color Jie Continue, company-information, the detailed description information of sofa can also be introduced, can be described in detail with affix phonetic function and Displaying, eliminates the phenomenon introduced now with sales force.
Further, the acquiring unit is by using such as lower section when salient region and its revolute constitutive modeling plate group Formula:
According to the border point coordinates of initial salient region feature modeling salient region copy, salient region rotation is calculated Turn the boundary point of copy:
IfFor initial salient region border CiIt is θ in rotation anglejWhen, rotation produces new border point coordinates:
Wherein 1 is all 1 column vector, T for all elementsjFor affine transformation matrix;
The rotation copy of salient region is intercepted in duplicate pictures are rotated using the rotation copy border of salient region, Utilize the rotation copy border that salient region is calculatedIn rotation duplicate picturesInterception area SiJ-th it is notable The rotation copy in property region
By each salient region and its rotation replica group template group, each salient region and its rotation copy composition n are utilized A template group T={ T1,T2,…,Tn, wherein:
Calculating through the above way makes sofa image, tea table image, wallpaper image of acquiring unit acquisition etc. more Clearly, user can be with 360 ° of the effect video for watching finishing when while ensure that 3 D stereo display.
The foregoing is only a preferred embodiment of the present invention, but protection scope of the present invention be not limited thereto, Any one skilled in the art the invention discloses technical scope in, technique according to the invention scheme and its Inventive concept is subject to equivalent substitution or change, should be covered by the protection scope of the present invention.

Claims (4)

  1. A kind of 1. Home Fashion & Design Shanghai experiencing system based on AR technologies, it is characterised in that including:
    It is printed with the model unit of the image information of the entity finishing material of house fitting-up needs;Wherein model unit carries for sheet Body, the frontal design of the carrier have nanoscale lenticule round dot optical grating construction, and the front of the carrier is printed with house fitting-up The image information of floor sample, the image information of wallpaper sample, the image information of each indoor decorations;
    The acquiring unit of image information all on model unit is gathered, wherein acquiring unit gathers floor on model unit successively The image information of sample, the image information of wallpaper sample, the image information of each indoor decorations, will be whole in the image set collected Close in an application scenarios;
    The acquiring unit reads the image information obtained and carries out the feature extraction of image information and the conspicuousness processing of image:It is first The salient region of the characteristic area of image is first extracted, salient region is carried out rotation obtains rotation copy, by conspicuousness area Domain and rotation copy composition template group are standardized generation wave filter group, and correlation filtering generation is carried out to wave filter group and is rung Ying Tu;
    The acquiring unit includes memory module, and the memory module includes model information, floor and the wallpaper of indoor decorations Model information, wherein model includes at least desk lamp model, pendent lamp model, sofa model and tea table model, the acquiring unit The matching image and dress of image rendering and addition generation household goods of furniture for display rather than for use are carried out to the model in storage unit according to response diagram information Repair style information;
    The AR display units of the scene information of the finishing pattern of the acquiring unit transmission are received, the AR display units will receive To two-dimensional scene be converted into three-dimensional scenic and carry out 3D displayings, the AR display units include suggestion module, the suggestion module The decoration style that the finishing pattern that current acquiring unit obtains is selected according to user is read suggestion for revision is provided or new design is provided Pattern.
  2. 2. the Home Fashion & Design Shanghai experiencing system according to claim 1 based on AR technologies, it is characterised in that:The AR presents single Member further includes light and provides module, and the light provides module and provides a variety of different intensities of illumination.
  3. 3. the Home Fashion & Design Shanghai experiencing system according to claim 1 based on AR technologies, it is characterised in that:The AR presents single Augmented reality application data are provided with member, the wherein data include at least the character introduction information of indoor decorations model, image Recommended information, video display information and voice messaging.
  4. 4. the Home Fashion & Design Shanghai experiencing system according to claim 1 based on AR technologies, it is characterised in that:The acquiring unit By when salient region and its revolute constitutive modeling plate group in the following way:
    According to the border point coordinates of initial salient region feature modeling salient region copy, salient region revolute is calculated This boundary point:
    IfFor initial salient region border CiIt is θ in rotation anglejWhen, rotation produces new border point coordinates:
    <mfenced open = "" close = ""> <mtable> <mtr> <mtd> <mrow> <mo>&amp;lsqb;</mo> <msub> <mi>C</mi> <mrow> <msub> <mi>i&amp;theta;</mi> <mi>j</mi> </msub> </mrow> </msub> <mo>,</mo> <mn>1</mn> <mo>&amp;rsqb;</mo> <mo>=</mo> <mo>&amp;lsqb;</mo> <msub> <mi>C</mi> <mi>i</mi> </msub> <mo>,</mo> <mn>1</mn> <mo>&amp;rsqb;</mo> <mo>&amp;times;</mo> <msub> <mi>T</mi> <mi>j</mi> </msub> </mrow> </mtd> <mtd> <mrow> <mi>i</mi> <mo>=</mo> <mn>1</mn> <mo>,</mo> <mn>2</mn> <mo>,</mo> <mo>...</mo> <mo>,</mo> <mi>n</mi> </mrow> </mtd> <mtd> <mrow> <mi>j</mi> <mo>=</mo> <mn>0</mn> <mo>,</mo> <mn>1</mn> <mo>,</mo> <mn>2</mn> <mo>,</mo> <mo>...</mo> <mo>,</mo> <mi>m</mi> </mrow> </mtd> </mtr> </mtable> </mfenced>
    Wherein 1 is all 1 column vector, T for all elementsjFor affine transformation matrix;
    The rotation copy of salient region is intercepted in duplicate pictures are rotated using the rotation copy border of salient region, is utilized The rotation copy border of salient region is calculatedIn rotation duplicate picturesJ-th of conspicuousness area of interception area Si The rotation copy in domain
    By each salient region and its rotation replica group template group, n mould is formed using each salient region and its rotation copy Plate group T={ T1,T2,…,Tn, wherein:
    <mrow> <mtable> <mtr> <mtd> <mrow> <msub> <mi>T</mi> <mi>i</mi> </msub> <mo>=</mo> <mo>{</mo> <msub> <mi>S</mi> <mrow> <msub> <mi>i&amp;theta;</mi> <mn>0</mn> </msub> </mrow> </msub> <mo>,</mo> <msub> <mi>S</mi> <mrow> <msub> <mi>i&amp;theta;</mi> <mn>1</mn> </msub> </mrow> </msub> <mo>,</mo> <mo>...</mo> <mo>,</mo> <msub> <mi>S</mi> <mrow> <msub> <mi>i&amp;theta;</mi> <mi>m</mi> </msub> </mrow> </msub> <mo>}</mo> </mrow> </mtd> <mtd> <mrow> <mi>i</mi> <mo>=</mo> <mn>1</mn> <mo>,</mo> <mn>2</mn> <mo>,</mo> <mo>...</mo> <mo>,</mo> <mi>n</mi> </mrow> </mtd> </mtr> </mtable> <mo>.</mo> </mrow>
CN201711296337.1A 2017-12-08 2017-12-08 Home Fashion & Design Shanghai experiencing system based on AR technologies Pending CN107909654A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711296337.1A CN107909654A (en) 2017-12-08 2017-12-08 Home Fashion & Design Shanghai experiencing system based on AR technologies

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711296337.1A CN107909654A (en) 2017-12-08 2017-12-08 Home Fashion & Design Shanghai experiencing system based on AR technologies

Publications (1)

Publication Number Publication Date
CN107909654A true CN107909654A (en) 2018-04-13

Family

ID=61864884

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711296337.1A Pending CN107909654A (en) 2017-12-08 2017-12-08 Home Fashion & Design Shanghai experiencing system based on AR technologies

Country Status (1)

Country Link
CN (1) CN107909654A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108596971A (en) * 2018-04-27 2018-09-28 北京小米移动软件有限公司 Image display method and apparatus
CN109102047A (en) * 2018-08-08 2018-12-28 深圳市易晨虚拟现实技术有限公司 Effect methods of exhibiting and its system are put based on ADT building blocks
CN109300191A (en) * 2018-08-28 2019-02-01 百度在线网络技术(北京)有限公司 AR model treatment method, apparatus, electronic equipment and readable storage medium storing program for executing
CN109741460A (en) * 2018-11-16 2019-05-10 成都生活家网络科技有限公司 Indoor decoration data visualization method, device and AR equipment based on AR

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106530404A (en) * 2016-11-09 2017-03-22 大连文森特软件科技有限公司 Inspection system of house for sale based on AR virtual reality technology and cloud storage
CN106791778A (en) * 2016-12-12 2017-05-31 大连文森特软件科技有限公司 A kind of interior decoration design system based on AR virtual reality technologies
CN107436943A (en) * 2017-07-31 2017-12-05 大连海事大学 A kind of live shoe sole print search method of combination subjectivity conspicuousness

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106530404A (en) * 2016-11-09 2017-03-22 大连文森特软件科技有限公司 Inspection system of house for sale based on AR virtual reality technology and cloud storage
CN106791778A (en) * 2016-12-12 2017-05-31 大连文森特软件科技有限公司 A kind of interior decoration design system based on AR virtual reality technologies
CN107436943A (en) * 2017-07-31 2017-12-05 大连海事大学 A kind of live shoe sole print search method of combination subjectivity conspicuousness

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108596971A (en) * 2018-04-27 2018-09-28 北京小米移动软件有限公司 Image display method and apparatus
CN108596971B (en) * 2018-04-27 2024-03-19 北京小米移动软件有限公司 Image display method and device
CN109102047A (en) * 2018-08-08 2018-12-28 深圳市易晨虚拟现实技术有限公司 Effect methods of exhibiting and its system are put based on ADT building blocks
CN109102047B (en) * 2018-08-08 2021-08-06 深圳市易晨虚拟现实技术有限公司 ADT building block-based placing effect display method and system
CN109300191A (en) * 2018-08-28 2019-02-01 百度在线网络技术(北京)有限公司 AR model treatment method, apparatus, electronic equipment and readable storage medium storing program for executing
CN109741460A (en) * 2018-11-16 2019-05-10 成都生活家网络科技有限公司 Indoor decoration data visualization method, device and AR equipment based on AR

Similar Documents

Publication Publication Date Title
US9652895B2 (en) Augmented reality image transformation
CN102449680B (en) Information presentation device
CN106575450B (en) It is rendered by the augmented reality content of albedo model, system and method
CN107909654A (en) Home Fashion & Design Shanghai experiencing system based on AR technologies
US20190347865A1 (en) Three-dimensional drawing inside virtual reality environment
CN104808956B (en) System and method for controlling display
CN102201032A (en) Personalized appareal and accessories inventory and display
CN110517355A (en) Environment for illuminating mixed reality object synthesizes
CN104750931A (en) Intelligent device control arrangement system applied to interior design
CN108510594A (en) Virtual fit method, device and terminal device
CN105139446A (en) Holographic virtual fitting system based on kinect
CN106791778A (en) A kind of interior decoration design system based on AR virtual reality technologies
CN111833458B (en) Image display method and device, equipment and computer readable storage medium
CN104270577A (en) Image processing method and device for mobile intelligent terminal
CN108053490A (en) House fitting-up management system based on AR technologies
CN106982240A (en) The display methods and device of information
CN106600669A (en) Device based on variable-color fluorescent drawing board and augmented reality, and operation method
CN106504337A (en) House for sale based on AR virtual reality technologies is investigated and collaboration decorations system
WO2023116396A1 (en) Rendering display method and apparatus, computer device, and storage medium
WO2019012314A1 (en) Method of displaying a wide-format augmented reality object
CN111640190A (en) AR effect presentation method and apparatus, electronic device and storage medium
KR101643569B1 (en) Method of displaying video file and experience learning using this
CN108038914A (en) Household furnishing management system based on AR technologies
CN106875461A (en) One kind is tinted plane picture 3D model transformation systems and method
CN206282360U (en) The system of museum&#39;s Temporary Display planning and designing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180413