CN104349111A - Meeting place creating method and system of video conference - Google Patents
Meeting place creating method and system of video conference Download PDFInfo
- Publication number
- CN104349111A CN104349111A CN201310313831.XA CN201310313831A CN104349111A CN 104349111 A CN104349111 A CN 104349111A CN 201310313831 A CN201310313831 A CN 201310313831A CN 104349111 A CN104349111 A CN 104349111A
- Authority
- CN
- China
- Prior art keywords
- image
- user
- virtual
- images
- virtual conference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 24
- 238000012545 processing Methods 0.000 claims description 35
- 230000000007 visual effect Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to a meeting place creating method of a video conference. The method comprises: acquiring image information of at least two users which are respectively located at different places and are at a video conference state, wherein the image information comprises user images and background images, and the users are participants of the video conference; separating the user images from the background images to obtain the independent user images; creating a virtual conference desk; superposing the independent user images with the virtual conference desk to obtain superposed images; and displaying the superposed images through a display screen. According to the embodiments of the invention, in case of numerous attendants, it is ensured that observers can effectively observe real perspective video images of the attendants, at the same time, a feeling that all the attendants are at the same large conference room can be created, and the observers or speakers can see useful video image states in real time.
Description
Technical Field
The invention relates to the field of computers, in particular to a method and a system for establishing a video conference meeting place.
Background
Video conferencing is a multi-party communication in a conferencing manner that is primarily intended to convey visual information. The communication mode of carrying out conference and transmitting sound and image in real time between users at two or more places. It can also be used to transmit still image, document, fax, etc. People participating in the video conference can make opinions through videos, simultaneously observe the image, the action, the expression and the like of the other party, show real television images of real objects, drawings, documents and the like or display characters and pictures written on a blackboard and a whiteboard, so that people participating in the conference at different places feel like people having face-to-face conversation with the other party, and the video conference can effectively replace the conference held on site. The distance between the meeting representatives is shortened, the atmosphere of the meeting is enhanced, people can participate in the meeting at the same place, and the working efficiency is obviously improved.
When there are a large number of participating conferees, ideally, the participant wants to see all of the participants of the other conference sites. However, due to the limited display space and the high probability of having a large number of participants in a multipoint conference, it is currently difficult to effectively achieve an image size that is useful for the viewer to display video images of all the participants.
Disclosure of Invention
The invention aims to provide a video conference site creating method, which is a system or a method for ensuring that an observer effectively observes real perspective video images of all participants when a plurality of participants participate in a multipoint video conference.
In a first aspect, an embodiment of the present invention provides a method for creating a video conference meeting place, where the method includes:
acquiring image information of at least two users in a video conference state, wherein the users are respectively positioned at different places, and the image information comprises images of the users and background images;
separating the user image from the background image to obtain an independent user image;
creating at least one virtual conference table;
overlapping the independent user image with the virtual conference table to obtain an overlapped image;
and displaying the superposed image through a display screen.
Based on the first aspect, in a first possible implementation manner, the capturing at least two users in a video conference state who are located at different places includes image information of the users and a background image; wherein,
the image information is obtained through a depth camera, and the user image and the background image in the image information have different depths.
The separating the user image from the background image to obtain an independent user image specifically includes:
separating the user image and the background image according to different depths of the user image and the background image.
In a second possible implementation manner, based on the first aspect or the first possible implementation manner of the first aspect, after the creating the plurality of virtual conference tables, the method further includes:
arranging the plurality of virtual conference tables in at least two rows.
In a third possible implementation manner, based on the second possible implementation manner of the first aspect, when the overlaying the independent user image with the virtual conference table and obtaining an overlaid image, the method further includes:
and adjusting the size of the user image according to a set proportion, and overlapping the user images with different proportions with the virtual conference table according to the front and back sequence of the at least two rows of virtual conference tables.
In a fourth possible implementation manner based on the first aspect, the at least one virtual conference table includes a virtual speaking table, and when a user needs to speak, an image of the user who is speaking is moved from a virtual conference table position where the user is located to the virtual speaking table position through sound control.
In a second aspect, an embodiment of the present invention provides a system for creating a video conference meeting place, where the system includes: the system comprises a hardware layer of camera equipment, display equipment and a data processing subsystem, wherein the data processing subsystem further comprises a central processing unit and a memory; the software layer comprises an image processing module running in the data processing subsystem
The camera device is used for acquiring image information of at least two users in a video conference state, wherein the users are located at different places, and the image information comprises images of the users and background images;
the image processing module separates the user image from the background image, acquires an independent user image, creates at least one virtual conference table, and superimposes the independent user image and the virtual conference table to acquire a superimposed image;
the display device displays the overlay image.
In a first possible implementation manner based on the second aspect, the user image and the background image in the video information acquired by the imaging apparatus have different depths.
The image processing module separates the user image and the background image according to different depths of the user image and the background image.
Based on the second aspect, in a second possible implementation manner, the image processing module arranges the plurality of virtual conference tables into at least two rows, adjusts the size of the user image according to a set proportion, and superimposes the user images with different proportions and the virtual conference tables according to the front-back sequence of the at least two rows of virtual conference tables
In a third possible implementation manner based on the second aspect, the hardware layer further includes a sound recording device for collecting voice information of the user.
In a fourth possible implementation manner based on the second aspect, the at least one virtual conference table includes a virtual speaking table, and when a user needs to speak, the image processing module moves, through sound control, an image of the user who is speaking from a position of the virtual conference table where the user is located to a position of the virtual speaking table.
By adopting the method provided by the embodiment of the invention, the image information of at least two users in a video conference state at different places is collected, and the user image and the background image are separated to obtain an independent user image; creating a virtual conference table; overlapping the independent user image with the virtual conference table to obtain an overlapped image; and displaying the superposed image through a display screen. The embodiment of the invention can ensure that an observer can effectively observe real perspective video images of all participants when a large number of participants participate, and simultaneously creates the feeling that all conference rooms are in the same large conference room, and the observer or speaker can see the useful video image state in real time.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is an architecture diagram of a video conference site creation system provided in an embodiment of the present invention;
fig. 2 is a flowchart of an embodiment of a method for creating a video conference site according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of an application scenario state according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a background separation state of an embodiment of the present invention;
FIG. 5 is a diagram illustrating a state splicing of a conference table according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating an application scenario state according to an embodiment of the present invention;
fig. 7 is a schematic diagram of another scene state according to an embodiment of the present invention.
Detailed Description
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
As shown in fig. 1, an embodiment of the present invention provides a video conference site creation system, where the system includes: a data processing subsystem 10 and peripheral devices 20, including image capture devices, display devices and audio recording devices. The data processing subsystem 10 further comprises a central processing unit and a memory, wherein the memory further comprises a ROM and a RAM, the ROM can be used for storing data such as system files and the like which cannot be changed at will, and the RAM can be used for writing or reading data; the software layer includes conventional software such as an image processing module and an audio processing module that run in the data processing subsystem.
The camera device can collect image information of at least two users in video conference states at different places, wherein the image information comprises images of the users and background images;
the image processing module separates the user image from the background image, acquires an independent user image, creates at least one virtual conference table, and superimposes the independent user image and the virtual conference table to acquire a superimposed image;
the display device displays the overlay image.
In an embodiment of the present invention, the image capturing apparatus may be a depth camera, which has the capability of actively acquiring a depth map of a scene, for example, by emitting infrared rays, and determining the distance of an object by detecting the intensity of infrared rays reflected physically, so as to determine the depth of different objects in the scene.
The image processing module can separate the background from the user according to different depths of the user and the background in the influence information, and obtain an independent user image.
At least one virtual conference table, such as a conference table, a speaking table, etc., may further be created by an image processing module in the CPU. Optionally, the virtual conference table that the image processing module can create may be a complete conference table, or may be a conference table with a larger volume that is formed by splicing a plurality of conference tables with smaller volumes.
The virtual conference table can be arranged in several rows according to the required effect and presents the effect from near to far and from low to high, so the image processing module can adjust the size displayed by the virtual conference table according to the set proportion, the corresponding image processing module can also adjust the size of the user image, and the user images with different proportions and the virtual conference table are superposed according to the front and back sequence of the at least two rows of virtual conference tables
Based on the above system, an embodiment of the present invention provides a method for creating a video conference meeting place, where the method includes:
the method comprises the steps that 201, image information of at least two users in video conference states at different places is collected, wherein the image information comprises images and background images of the users, and the users are video conference participants;
in particular, when a user at a different location needs to conduct a video conference, it is often necessary to arrange a display screen for displaying other video conference participants at a remote end.
As shown in fig. 3, a local conference table may be provided locally, and a display screen may be provided in front of which a plurality of cameras may be provided, which may capture dynamic image information of local video conference participants.
Similarly, a video participant at another remote location may also set a local conference table and a camera, which are not described in detail.
202, separating the user image from the background image to obtain an independent user image;
specifically, after the camera collects the image information of the video conference participant, the image information is sent to the data processing subsystem, and the image processing program running in the data processing subsystem separates the image affecting the participant from the background image in the image data, as shown in fig. 4.
203, creating at least one virtual conference table;
specifically, the image processing software running in the data processing subsystem may create a plurality of virtual conference tables through a 3D effect graph, for example, as shown in fig. 5, the virtual conference table may be a complete conference table, or a conference table with a large volume formed by splicing a plurality of conference tables with a small volume, and may further include one or more speaking tables. For example, the first row of virtual conference tables in the upper left corner of fig. 5 are speech tables on both sides.
204, overlapping the independent user image and the virtual conference table to obtain an overlapped image;
specifically, the image processing software running in the data processing subsystem may arrange the created virtual conference tables into a required number of rows, and adjust the display size of the virtual conference tables in the order of distance, height, and the like.
Similarly, the image processing software running in the data processing subsystem may also combine the independent images of the video conference participants with the created virtual conference table according to the set sequence, so that the image sizes of the video conference participants also need to be adjusted according to the sequence of distance, height, and the like, and the effect is as shown in fig. 6.
205, displaying the overlay image through a display screen.
Specifically, after the synthesis effect of the video data is completed, as shown in fig. 6, the synthesized video data can be displayed on a display screen, so that the local speaker can feel that the local speaker and the remote video conference participant are in the same space, and the experience of face-to-face meeting is achieved.
Optionally, the display screen may be a complete display screen, or may be formed by combining a plurality of display screens with smaller areas as shown in fig. 6, as shown in fig. 7, which is not described in detail.
Preferably, when a video conference participant needs to speak, the image of the video conference participant can be moved away from the original virtual conference table position to the position of the speaking table in a mode of voice control and the like, and refer to fig. 6, so as to enhance the user experience.
By adopting the method provided by the embodiment of the invention, the image information of at least two users in different places in a video conference state is collected, and the user image and the background image are separated to obtain an independent user image; creating a plurality of virtual conference tables; overlapping the independent user image with the virtual conference table to obtain an overlapped image; and displaying the superposed image through a display screen. The embodiment of the invention can ensure that an observer can effectively observe real perspective video images of all participants when a large number of participants participate, and simultaneously creates the feeling that all conference rooms are in the same large conference room, and the observer or speaker can see the useful video image state in real time.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (10)
1. A method for creating a videoconference session, the method comprising:
acquiring image information of at least two users in a video conference state, wherein the users are respectively located at different places, the image information comprises images and background images of the users, and the users are participants of the video conference;
separating the user image from the background image to obtain an independent user image;
creating at least one virtual conference table;
overlapping the independent user image with the virtual conference table to obtain an overlapped image;
and displaying the superposed image through a display screen.
2. The method according to claim 1, wherein the capturing at least two users in a video conference state at different locations includes image information of the users and background images; wherein,
the image information is acquired through a depth camera, and the user image and the background image in the image information have different depths;
the separating the user image from the background image to obtain an independent user image specifically includes:
separating the user image and the background image according to different depths of the user image and the background image.
3. The method of claim 1 or 2, wherein after said creating at least one virtual conference table, further comprising:
arranging the virtual conference tables into at least two rows.
4. The method of claim 3, wherein overlaying the separate user image with the virtual conference table, when obtaining an overlay image, further comprises:
and adjusting the size of the user image according to a set proportion, and overlapping the user images with different proportions with the virtual conference table according to the front and back sequence of the at least two rows of virtual conference tables.
5. The method as claimed in claim 1 or 2, wherein said at least one virtual conference table comprises a virtual speaking table, and when a user needs to speak, the image of the speaking user is moved from the virtual conference table position where the user is located to the virtual speaking table position through sound control.
6. A video conference site creation system, comprising: the system comprises a hardware layer of camera equipment, display equipment and a data processing subsystem, wherein the data processing subsystem further comprises a central processing unit and a memory; the software layer comprises an image processing module running in the data processing subsystem
The camera device is used for acquiring image information of at least two users in a video conference state, wherein the users are located at different places, and the image information comprises images of the users and background images;
the image processing module separates the user image from the background image, acquires an independent user image, creates at least one virtual conference table, and superimposes the independent user image and the virtual conference table to acquire a superimposed image;
the display device displays the overlay image.
7. The videoconference session creation system of claim 6, wherein said user image and a background image in said visual information captured by said camera device have different depths.
The image processing module separates the user image and the background image according to different depths of the user image and the background image.
8. The system of claim 6, wherein the image processing module arranges the plurality of virtual conference tables into at least two rows, adjusts the size of the user image according to a set ratio, and superimposes the user images with different ratios of sizes on the virtual conference tables according to a front-to-back sequence of the at least two rows of virtual conference tables.
9. The video conference site creation system of claim 6, wherein the hardware layer further comprises a sound recording device for collecting voice information of the user.
10. The system of claim 6, wherein the at least one virtual conference table comprises a virtual speaking table, and when a user needs to speak, the image processing module moves the image of the speaking user from the virtual conference table position to the virtual speaking table position through sound control.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310313831.XA CN104349111A (en) | 2013-07-24 | 2013-07-24 | Meeting place creating method and system of video conference |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310313831.XA CN104349111A (en) | 2013-07-24 | 2013-07-24 | Meeting place creating method and system of video conference |
Publications (1)
Publication Number | Publication Date |
---|---|
CN104349111A true CN104349111A (en) | 2015-02-11 |
Family
ID=52503809
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310313831.XA Pending CN104349111A (en) | 2013-07-24 | 2013-07-24 | Meeting place creating method and system of video conference |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104349111A (en) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018010700A1 (en) * | 2016-07-11 | 2018-01-18 | 中兴通讯股份有限公司 | Image processing method and device |
CN108055495A (en) * | 2017-12-14 | 2018-05-18 | 南京美桥信息科技有限公司 | A kind of visual virtual party method and system |
CN108076307A (en) * | 2018-01-26 | 2018-05-25 | 南京华捷艾米软件科技有限公司 | Video conferencing system based on AR and the video-meeting method based on AR |
WO2018095317A1 (en) * | 2016-11-28 | 2018-05-31 | 中兴通讯股份有限公司 | Data processing method, device, and apparatus |
CN108449569A (en) * | 2018-03-13 | 2018-08-24 | 重庆虚拟实境科技有限公司 | Virtual meeting method, system, device, computer installation and storage medium |
CN112312062A (en) * | 2020-10-30 | 2021-02-02 | 上海境腾信息科技有限公司 | 3D display method, storage medium and terminal equipment for multi-person conference recording and playback |
CN113676690A (en) * | 2020-05-14 | 2021-11-19 | 钉钉控股(开曼)有限公司 | Method, device and storage medium for realizing video conference |
CN113784189A (en) * | 2021-08-31 | 2021-12-10 | Oook(北京)教育科技有限责任公司 | Method, device, medium and electronic equipment for generating round table video conference |
WO2022011653A1 (en) * | 2020-07-16 | 2022-01-20 | Huawei Technologies Co., Ltd. | Method and apparatus for video conferencing |
WO2023015868A1 (en) * | 2021-08-13 | 2023-02-16 | 华为技术有限公司 | Image background generation method and aparatus, and computer-readable storage medium |
WO2023165182A1 (en) * | 2022-03-01 | 2023-09-07 | 腾讯科技(深圳)有限公司 | Display method and apparatus for online conference interface, and medium and computer program product |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101610421A (en) * | 2008-06-17 | 2009-12-23 | 深圳华为通信技术有限公司 | Video communication method, Apparatus and system |
US8279254B2 (en) * | 2007-08-02 | 2012-10-02 | Siemens Enterprise Communications Gmbh & Co. Kg | Method and system for video conferencing in a virtual environment |
-
2013
- 2013-07-24 CN CN201310313831.XA patent/CN104349111A/en active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8279254B2 (en) * | 2007-08-02 | 2012-10-02 | Siemens Enterprise Communications Gmbh & Co. Kg | Method and system for video conferencing in a virtual environment |
CN101610421A (en) * | 2008-06-17 | 2009-12-23 | 深圳华为通信技术有限公司 | Video communication method, Apparatus and system |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107612869A (en) * | 2016-07-11 | 2018-01-19 | 中兴通讯股份有限公司 | Image processing method and device |
WO2018010700A1 (en) * | 2016-07-11 | 2018-01-18 | 中兴通讯股份有限公司 | Image processing method and device |
WO2018095317A1 (en) * | 2016-11-28 | 2018-05-31 | 中兴通讯股份有限公司 | Data processing method, device, and apparatus |
CN108055495A (en) * | 2017-12-14 | 2018-05-18 | 南京美桥信息科技有限公司 | A kind of visual virtual party method and system |
CN108076307B (en) * | 2018-01-26 | 2021-01-05 | 南京华捷艾米软件科技有限公司 | AR-based video conference system and AR-based video conference method |
CN108076307A (en) * | 2018-01-26 | 2018-05-25 | 南京华捷艾米软件科技有限公司 | Video conferencing system based on AR and the video-meeting method based on AR |
CN108449569A (en) * | 2018-03-13 | 2018-08-24 | 重庆虚拟实境科技有限公司 | Virtual meeting method, system, device, computer installation and storage medium |
CN113676690A (en) * | 2020-05-14 | 2021-11-19 | 钉钉控股(开曼)有限公司 | Method, device and storage medium for realizing video conference |
WO2022011653A1 (en) * | 2020-07-16 | 2022-01-20 | Huawei Technologies Co., Ltd. | Method and apparatus for video conferencing |
CN112312062A (en) * | 2020-10-30 | 2021-02-02 | 上海境腾信息科技有限公司 | 3D display method, storage medium and terminal equipment for multi-person conference recording and playback |
WO2023015868A1 (en) * | 2021-08-13 | 2023-02-16 | 华为技术有限公司 | Image background generation method and aparatus, and computer-readable storage medium |
CN113784189A (en) * | 2021-08-31 | 2021-12-10 | Oook(北京)教育科技有限责任公司 | Method, device, medium and electronic equipment for generating round table video conference |
CN113784189B (en) * | 2021-08-31 | 2023-08-01 | Oook(北京)教育科技有限责任公司 | Round table video conference generation method and device, medium and electronic equipment |
WO2023165182A1 (en) * | 2022-03-01 | 2023-09-07 | 腾讯科技(深圳)有限公司 | Display method and apparatus for online conference interface, and medium and computer program product |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104349111A (en) | Meeting place creating method and system of video conference | |
US8638354B2 (en) | Immersive video conference system | |
DE102015100911B4 (en) | Improved communication between remote participants using advanced and virtual reality | |
JP6171263B2 (en) | Remote conference system and remote conference terminal | |
EP2323425B1 (en) | Method and device for generating audio signals | |
US9097968B1 (en) | Audiovisual presentation system comprising an enclosure screen and outside projectors directed towards the enclosure screen | |
KR20100126812A (en) | Displaying panoramic video image streams | |
KR101784266B1 (en) | Multi user video communication system and method using 3d depth camera | |
WO2014172109A1 (en) | System and method for providing separate communication zones in a large format videoconference | |
US9253442B1 (en) | Holopresence system | |
Yao et al. | Focalspace: multimodal activity tracking, synthetic blur and adaptive presentation for video conferencing | |
CN114531564B (en) | Processing method and electronic equipment | |
CN104380720A (en) | Video conference processing method and device | |
US11831454B2 (en) | Full dome conference | |
US8384757B2 (en) | System and method for providing videoconferencing among a plurality of locations | |
JP2002300602A (en) | Window-type image pickup/display device and two-way communication method using the same | |
US9131109B2 (en) | Information processing device, display control system, and computer program product | |
JP2009239459A (en) | Video image composition system, video image composition device, and program | |
CN109076251B (en) | Teleconferencing transmission | |
US20130050399A1 (en) | Defining a layout for displaying images | |
Willert et al. | The Extended Window Metaphor for Large High-Resolution Displays. | |
CN114598835A (en) | System and method for displaying users participating in a communication session | |
JP2007221437A (en) | Remote conference system | |
KR102619761B1 (en) | Server for TelePresentation video Conference System | |
WO2024190489A1 (en) | Display method, display processing device and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150211 |
|
RJ01 | Rejection of invention patent application after publication |