CN102025970A - Method and system for automatically adjusting display mode of video conference - Google Patents

Method and system for automatically adjusting display mode of video conference Download PDF

Info

Publication number
CN102025970A
CN102025970A CN 201010589283 CN201010589283A CN102025970A CN 102025970 A CN102025970 A CN 102025970A CN 201010589283 CN201010589283 CN 201010589283 CN 201010589283 A CN201010589283 A CN 201010589283A CN 102025970 A CN102025970 A CN 102025970A
Authority
CN
China
Prior art keywords
video
change
rate
participant
display mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 201010589283
Other languages
Chinese (zh)
Inventor
谢艳霞
刘明宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vtron Technologies Ltd
Original Assignee
Vtron Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vtron Technologies Ltd filed Critical Vtron Technologies Ltd
Priority to CN 201010589283 priority Critical patent/CN102025970A/en
Publication of CN102025970A publication Critical patent/CN102025970A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention provides a method and system for automatically adjusting display mode of a video conference. The method comprises the following steps of: receiving an audio/video signal of each participant; acquiring the change rate of the voice and image of each participant; when the change rate conforms to a pre-determined rule, changing the video display mode parameters; and synthesizing the video according to the video display mode parameters and sending to each participant. In the method and system for automatically adjusting the display mode of the video conference, the change rate of voice and image is acquired in real time; when the change rate conforms to certain conditions, the video display mode can be automatically adjusted; thus, the speaker can be highlighted in the video conference without manual configuration, and operation troubles caused by manual configuration are avoided.

Description

Automatically adjust the method and system of video conference display mode
Technical field
The present invention relates to the multimedia communication technology field, the particularly a kind of method and system that can adjust the video conference display mode automatically.
Background technology
By the fast development of the Internet, video conference has realized smooth long-distance video and audio sync communication, and real conference scenario is presented, and helps the home-confined information-based communication that can carry out teleconference, commercial affairs, office of enterprise.In time, video conference mode efficiently can realize undelayed real-time communication, reach the high-speed synchronous transmission and the interaction of information, it has successfully replaced traditional phone, the communication way of going on business, and can significantly reduce the expenditure of enterprise on traveling expense, communication fee, in high effective information transmission, successfully reduce traveling expense, optimize aspect the financial position of the enterprise with the obvious advantagely, become the preferred manner of the numerous large, medium and small enterprises under the cost pressure.
Yet when participating in a conference in many ways, how all sides of attending a meeting show in screen how ratio distributes, and use which kind of display mode, need a cover control corresponding mechanism.In the existing video conference, the terminal software of attending a meeting provides several modes to select to the user, when a certain side who attends a meeting will allow the image displaying ratio of oneself become big, reach the effect that highlights, made a speech as beginning, then need manually to change display mode to realize highlighting of speaker, as shown in Figure 3, participant A is arranged, B, C, D totally 4 sides has participated in same video conference, in the meeting, each side's video display frame all is mean allocation, realize that as shown in Figure 4 a certain side highlights and other three parts dwindles the effect of demonstration, can only change video display modes by manual mode, can't realize the automatic adjustment of video display modes, therefore operate cumbersome.
Summary of the invention
The invention provides a kind of method of automatic adjustment video conference display mode, do not need manual operation, can adjust the display mode of video conference automatically.
The method of automatic adjustment video conference display mode of the present invention may further comprise the steps:
Step S1 receives each participant's audio-video signal;
Step S2 obtains each participant's the sound and the rate of change of image;
Step S3 changes the video display modes parameter when rate of change meets pre-defined rule;
Step S4 is according to video display modes parameter synthetic video and send to each participant.
The system of automatic adjustment video conference display mode of the present invention comprises a plurality of terminals and multiple spot processing unit MCU;
The function of each terminal is that audio-video signal is sent to multiple spot processing unit MCU; And the audio-video signal among the reception multiple spot processing unit MCU;
The function of MCU is the audio-video signal that receives each terminal, obtain the sound of each terminal and the rate of change of image, when meeting pre-defined rule, rate of change changes the video display modes parameter, and according to this video display modes parameter synthetic video, the audio-video signal of the video after will synthesizing then sends to each terminal.
From above scheme as can be seen, the method and system of automatic adjustment video conference display mode of the present invention, rate of change by real-time collection sound and image, when reaching certain specification, rate of change can adjust video display modes automatically, do not need manual configuration can realize speaker highlighting in video conference, the operational trouble of having avoided manual configuration to bring.
Description of drawings
Fig. 1 adjusts the method flow diagram of video conference display mode automatically for the present invention;
Fig. 2 adjusts the system configuration schematic diagram of video conference display mode automatically for the present invention;
The schematic diagram that Fig. 3 is evenly distributed for each participant in the video conference;
The schematic diagram that Fig. 4 highlights for speaker in the video conference.
Embodiment
The invention provides a kind of method and system of automatic adjustment video conference display mode, these method and system can solve the problem that needs the manual configuration video display modes in the prior art.
As shown in Figure 3, each participant A, B, C, D were mean allocation in video display frame when video conference began, and the present invention will realize is to wave an assistant suddenly as certain participant (such as A), perhaps speak aloud suddenly, this participant corresponding image in meeting will become big so, reach the purpose that highlights, and other participant's image complies with and dwindles, as shown in Figure 4.This whole process does not need the participant manually to be configured, and judges execution automatically by server fully.
For this reason, the invention provides a kind of method of automatic adjustment video conference display mode, as shown in Figure 1, may further comprise the steps:
Step S1, the terminal of respectively attending a meeting of video conference sends encoded audio-video signal to MCU(Multipoint Control Units, the multiple spot processing unit), MCU is the core of video conferencing system, can provide group's meeting for the user, organize the Connection Service of meeting more, after MCU receives each participant's audio-video signal, carry out decode operation, restore the preceding audio-video signal of coding.
Step S2 obtains each participant's the sound and the rate of change of image.When MCU receives a certain frame audio-video signal of a certain terminal, obtain this frame signal of this terminal and the rate of previous frame signal from audio/video decoder, this rate is rate of change.
Step S3 changes the video display modes parameter when rate of change meets pre-defined rule.This pre-defined rule can be decided as the case may be, as an embodiment preferably, it is regular as follows that the present invention adopts: when certain rate of change of attending a meeting all reaches more than 30%, and the variation duration reached more than 5 seconds, then change the video display modes parameter, this participant's ratio is made as maximum.It only is example with the vision signal, when the participant's who receives vision signal is compared with the previous frame vision signal of obtaining from audio/video decoder, rate of change reaches more than 30%, and transformation period continued more than 5 seconds, can think that then the participant on this terminal will make a speech, therefore change the video display modes parameter among the MCU, the ratio that is about to this participant is made as maximum.Processing and vision signal for audio signal are similar.
In addition, when the rate of change of vision signal reaches more than 30%, but the duration that changes do not reach 5 seconds, then can not change the operation of video display modes parameter.Why temporal restrictive condition is set, be for fear of causing misoperation, when for example a certain participant yawns or stretches oneself, because action is bigger, the image change rate that audio/video decoder obtains can be greater than 30%, but the participant wants to make a speech in this case, also not be used in the video conference and highlight, therefore the duration of considering these actions of yawning or stretch oneself is no more than 5 seconds, is provided with to change the duration and need reach the operation that just changes the video display modes parameter more than 5 seconds.
Step S4, the effect of the video display modes parameter among the step S3 is to be provided with the display mode of composograph, comprise the displaying ratio of the terminal of respectively attending a meeting and the information such as position of each terminal in this parameter, in case this parameter setting, MCU will be according to this video display modes parameter synthetic video, and sends to the terminal of respectively attending a meeting.The video display modes parameter can be according to concrete needs setting, for example be arranged to participant A, the B among Fig. 3, the 1:1:1:1 of C, D, perhaps be arranged to the 9:1:1:1 among Fig. 4, the pattern that can certainly be arranged to other has a participant's who highlights ratio maximum in a word such as 4:3:2:1 etc.When a video conference initial creation, it is synthetic that MCU carries out image according to the pattern of 1:1:1:1, and each terminal shows also is picture according to this ratio mean allocation; Meet predetermined when regular as the rate of change of certain terminal, then this terminal obtains the position of terminal A among Fig. 4, picture becomes 9:1:1:1, detailed process is as follows: the video display modes parameter is changed to 9:1:1:1, MCU determines the position of displaying ratio and each terminal according to this new argument, make each terminal carry out image according to new display mode and synthesize, the video image after will synthesizing then sends to the terminal of respectively attending a meeting, and makes each terminal finally be shown as the video pictures that terminal A highlights.
The whole video meeting may continue one long period, make a speech and in the middle of meeting, also inevitably have other participants, for example when terminal B also reaches change condition in the meeting way, then this terminal B will obtain the position that highlights of participant A among Fig. 2, participant A then loses the position that highlights, MCU only need reset the video display modes parameter for this reason, carries out image according to new display mode parameter then and synthesizes, and can realize the demand that terminal B highlights.
The frequent variations of screen in the video conference, as a preferred embodiment, in the condition that changes video display modes, add a time term of validity (for example 10s), promptly a video display modes changes back (or claiming the synthetic back of video one time), even there is the another one terminal to reach the variation requirement, but in the time of this 10s term of validity, video display modes no longer changes, if change still existence later up to this term of validity, then change the operation of video display modes.
In addition, if bigger variation all takes place in a plurality of terminals of attending a meeting, and rate of change also all meets pre-defined rule, then change video display modes according to the time order and function order, the participant's that the video display modes parameter is set to formerly change ratio maximum, be whom who changes then earlier with the right that obtains to highlight, and the participant that ignorance changes in the back is (if a time term of validity is gone over certainly, and the participant who changes in the back still has the variation of sound and image, then can according to circumstances give prominence to this participant's who changes in the back demonstration).Also has a kind of situation, if the rate of change of a plurality of terminals of attending a meeting all meets pre-defined rule, and the time that changes is also identical, the size that then compares each participant's image change rate earlier, if the image change of participant A is 31%, and the image change rate of participant B is 33%, then in the video display modes parameter ratio of participant B is made as maximum, and changing video display modes is that the bigger participant B of image change rate is for highlighting; In addition, if the time that the rate of change of a plurality of terminals of attending a meeting all meets pre-defined rule, change is identical, and the size of the rate of change of image is also identical, at this time can respectively change the size of the sound variation rate of terminal, and the participant's that the sound variation rate is bigger ratio is made as maximum in the video display modes parameter, promptly changes video and is shown as the pattern that the bigger participant of sound variation rate highlights.
The present invention also provides a kind of system of automatic adjustment video conference display mode in addition, as shown in Figure 2, comprises a plurality of terminals and MCU;
The function of each terminal is that audio-video signal is sent to MCU; And the audio-video signal among the reception MCU;
The function of MCU is the audio-video signal that receives in each terminal, obtain the sound of each terminal and the rate of change of image, when meeting pre-defined rule, rate of change changes the video display modes parameter, and according to this video display modes parameter synthetic video, the audio-video signal of the video after will synthesizing then sends to each terminal.
Comprise audio/video decoder among the MCU, the function of this audio/video decoder is that the audio-video signal that receives is decoded, and the rate (being rate of change) that obtains decoded this frame signal and previous frame signal, most in the market audio/video decoder all has above-mentioned functions.
The method and system of automatic adjustment video conference display mode of the present invention, rate of change by real-time collection sound and image, when meeting certain condition, rate of change can adjust video display modes automatically, do not need manual configuration can realize speaker highlighting in video conference, when bringing visual intuitive for each participant, the operational trouble of having avoided manual configuration to bring.
Above-described embodiment of the present invention does not constitute the qualification to protection range of the present invention.Any modification of being done within the spirit and principles in the present invention, be equal to and replace and improvement etc., all should be included within the claim protection range of the present invention.

Claims (8)

1. a method of adjusting the video conference display mode automatically is characterized in that, may further comprise the steps:
Step S1 receives each participant's audio-video signal;
Step S2 obtains described each participant's the sound and the rate of change of image;
Step S3 changes the video display modes parameter when described rate of change meets pre-defined rule;
Step S4 is according to described video display modes parameter synthetic video and send to described each participant.
2. the method for automatic adjustment video conference display mode according to claim 1, it is characterized in that, step S3 is specially: when participant's rate of change reaches more than 30%, and the variation duration reached more than 5 seconds, then change the video display modes parameter, this participant's ratio is made as maximum.
3. the method for automatic adjustment video conference display mode according to claim 2 is characterized in that, after video described in the step S4 is synthetic a time term of validity is arranged, and video display modes remains unchanged in this time term of validity.
4. the method for automatic adjustment video conference display mode according to claim 2, it is characterized in that, if a plurality of participants' rate of change all meets described pre-defined rule, then the participant's that will formerly change in described video display modes parameter ratio is made as maximum.
5. the method for automatic adjustment video conference display mode according to claim 2, it is characterized in that, if a plurality of participants' rate of change all meets described pre-defined rule, and the time that changes is identical, and then the participant's that the image change rate is bigger ratio is made as maximum in described video display modes parameter.
6. the method for automatic adjustment video conference display mode according to claim 2, it is characterized in that, if the time that a plurality of participants' rate of change all meets described pre-defined rule, change is identical, and the size of described image change rate is also identical, and then the participant's that the sound variation rate is bigger ratio is made as maximum in described video display modes parameter.
7. a system that adjusts the video conference display mode automatically comprises a plurality of terminals, it is characterized in that, also comprises multiple spot processing unit MCU;
Described each terminal is used for audio-video signal is sent to described multiple spot processing unit MCU; And receive audio-video signal among the described multiple spot processing unit MCU;
Described multiple spot processing unit MCU is used to receive the audio-video signal of described each terminal, obtain the sound of described each terminal and the rate of change of image, when meeting pre-defined rule, described rate of change changes the video display modes parameter, and according to this video display modes parameter synthetic video, the audio-video signal of the video after will synthesizing then sends to described each terminal.
8. the system of automatic adjustment video conference display mode according to claim 7, it is characterized in that, comprise audio/video decoder among the described multiple spot processing unit MCU, described audio/video decoder is used for the audio-video signal that receives is decoded, and the rate of change that obtains this decoded signal and previous frame signal.
CN 201010589283 2010-12-15 2010-12-15 Method and system for automatically adjusting display mode of video conference Pending CN102025970A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010589283 CN102025970A (en) 2010-12-15 2010-12-15 Method and system for automatically adjusting display mode of video conference

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010589283 CN102025970A (en) 2010-12-15 2010-12-15 Method and system for automatically adjusting display mode of video conference

Publications (1)

Publication Number Publication Date
CN102025970A true CN102025970A (en) 2011-04-20

Family

ID=43866744

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010589283 Pending CN102025970A (en) 2010-12-15 2010-12-15 Method and system for automatically adjusting display mode of video conference

Country Status (1)

Country Link
CN (1) CN102025970A (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102256099A (en) * 2011-06-20 2011-11-23 中兴通讯股份有限公司 Parameter control method and device
WO2012103820A2 (en) * 2012-03-08 2012-08-09 华为技术有限公司 Method, device, and system for highlighting party of interest
CN102833519A (en) * 2011-06-14 2012-12-19 华为终端有限公司 Method, device and system for adaption processing on video image
CN103002247A (en) * 2011-09-13 2013-03-27 索尼公司 Signal processing apparatus, signal processing method, and program
CN103297743A (en) * 2012-03-05 2013-09-11 联想(北京)有限公司 Video conference display window adjusting method and video conference service equipment
CN103347165A (en) * 2013-07-25 2013-10-09 广东威创视讯科技股份有限公司 Method for processing video data and terminal
CN103428406A (en) * 2012-05-23 2013-12-04 中兴通讯股份有限公司 Method and device for analyzing monitoring video
CN104469261A (en) * 2014-12-26 2015-03-25 北京网视通联科技有限公司 Video conference system and method based on CDN
CN104539873A (en) * 2015-01-09 2015-04-22 京东方科技集团股份有限公司 Teleconference system and method for conducting teleconference
TWI504272B (en) * 2014-05-08 2015-10-11 Aver Information Inc Video conference system and display allocation method thereof
CN105141882A (en) * 2015-08-06 2015-12-09 北京奇艺世纪科技有限公司 Display control method and device
CN105812713A (en) * 2014-08-28 2016-07-27 三星Sds株式会社 Method for extending participants of multiparty video conference service and MCU gateway
CN107005678A (en) * 2014-11-19 2017-08-01 杜比实验室特许公司 Adjust the Space Consistency in video conferencing system
WO2019223736A1 (en) * 2018-05-25 2019-11-28 中兴通讯股份有限公司 Video control method, video conference terminal and multi-point control unit (mcu)
CN111492651A (en) * 2017-12-26 2020-08-04 三菱电机株式会社 Inter-passenger conversation device and inter-passenger conversation method
CN113099157A (en) * 2021-03-17 2021-07-09 海南视联通信技术有限公司 Video conference control method and device
CN113556504A (en) * 2021-07-19 2021-10-26 西安万像电子科技有限公司 Video conference display image processing method and device and video conference system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070111270A (en) * 2006-05-17 2007-11-21 삼성전자주식회사 Displaying method using voice recognition in multilateral video conference
CN101080000A (en) * 2007-07-17 2007-11-28 华为技术有限公司 Method, system, server and terminal for displaying speaker in video conference
JP2008294724A (en) * 2007-05-24 2008-12-04 Panasonic Corp Image receiver
CN101478642A (en) * 2009-01-14 2009-07-08 镇江畅联通信科技有限公司 Multi-picture mixing method and apparatus for video meeting system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070111270A (en) * 2006-05-17 2007-11-21 삼성전자주식회사 Displaying method using voice recognition in multilateral video conference
JP2008294724A (en) * 2007-05-24 2008-12-04 Panasonic Corp Image receiver
CN101080000A (en) * 2007-07-17 2007-11-28 华为技术有限公司 Method, system, server and terminal for displaying speaker in video conference
CN101478642A (en) * 2009-01-14 2009-07-08 镇江畅联通信科技有限公司 Multi-picture mixing method and apparatus for video meeting system

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102833519A (en) * 2011-06-14 2012-12-19 华为终端有限公司 Method, device and system for adaption processing on video image
WO2012171452A1 (en) * 2011-06-14 2012-12-20 华为终端有限公司 Method, device and system for adapting video image processing
CN102256099A (en) * 2011-06-20 2011-11-23 中兴通讯股份有限公司 Parameter control method and device
CN103002247A (en) * 2011-09-13 2013-03-27 索尼公司 Signal processing apparatus, signal processing method, and program
CN103297743A (en) * 2012-03-05 2013-09-11 联想(北京)有限公司 Video conference display window adjusting method and video conference service equipment
US9041764B2 (en) 2012-03-08 2015-05-26 Huawei Technologies Co., Ltd. Method, device, and system for highlighting party of interest in video conferencing
CN102714705A (en) * 2012-03-08 2012-10-03 华为技术有限公司 Method, device, and system for highlighting party of interest
WO2012103820A3 (en) * 2012-03-08 2013-02-21 华为技术有限公司 Method, device, and system for highlighting party of interest
WO2012103820A2 (en) * 2012-03-08 2012-08-09 华为技术有限公司 Method, device, and system for highlighting party of interest
CN103428406A (en) * 2012-05-23 2013-12-04 中兴通讯股份有限公司 Method and device for analyzing monitoring video
CN103428406B (en) * 2012-05-23 2017-11-07 中兴通讯股份有限公司 Monitoring video analysis method and device
CN103347165A (en) * 2013-07-25 2013-10-09 广东威创视讯科技股份有限公司 Method for processing video data and terminal
TWI504272B (en) * 2014-05-08 2015-10-11 Aver Information Inc Video conference system and display allocation method thereof
US9338395B2 (en) 2014-05-08 2016-05-10 Aver Information Inc. Video conference system and display allocation method thereof
CN105812713A (en) * 2014-08-28 2016-07-27 三星Sds株式会社 Method for extending participants of multiparty video conference service and MCU gateway
CN107005678A (en) * 2014-11-19 2017-08-01 杜比实验室特许公司 Adjust the Space Consistency in video conferencing system
CN104469261A (en) * 2014-12-26 2015-03-25 北京网视通联科技有限公司 Video conference system and method based on CDN
CN104469261B (en) * 2014-12-26 2017-12-05 北京网视通联科技有限公司 A kind of video conferencing system and method based on CDN
CN104539873A (en) * 2015-01-09 2015-04-22 京东方科技集团股份有限公司 Teleconference system and method for conducting teleconference
US9706169B2 (en) 2015-01-09 2017-07-11 Boe Technology Group Co., Ltd. Remote conference system and method of performing remote conference
CN105141882A (en) * 2015-08-06 2015-12-09 北京奇艺世纪科技有限公司 Display control method and device
CN111492651A (en) * 2017-12-26 2020-08-04 三菱电机株式会社 Inter-passenger conversation device and inter-passenger conversation method
WO2019223736A1 (en) * 2018-05-25 2019-11-28 中兴通讯股份有限公司 Video control method, video conference terminal and multi-point control unit (mcu)
CN110536097A (en) * 2018-05-25 2019-12-03 中兴通讯股份有限公司 A kind of video control method, video conference terminal and multipoint control unit MCU
US11973812B2 (en) 2018-05-25 2024-04-30 Xi'an Zhongxing New Software Co., Ltd. Video control method, video conference terminal and multi-point control unit (MCU)
CN113099157A (en) * 2021-03-17 2021-07-09 海南视联通信技术有限公司 Video conference control method and device
CN113556504A (en) * 2021-07-19 2021-10-26 西安万像电子科技有限公司 Video conference display image processing method and device and video conference system

Similar Documents

Publication Publication Date Title
CN102025970A (en) Method and system for automatically adjusting display mode of video conference
CN101309390B (en) Visual communication system, apparatus and subtitle displaying method
WO2018006574A1 (en) Method implementing video conference screen sharing
US9179100B2 (en) Video conferencing method and device thereof
EP2863642B1 (en) Method, device and system for video conference recording and playing
US8208004B2 (en) Device, methods, and media for providing multi-point video conferencing unit functions
CN101291417B (en) Polling method and system for videoconference system
EP2472858A1 (en) Method, device and system for presenting virtual conference site of video conference
CN105376516A (en) Mobile video conference system and implementing method thereof
CN101645952A (en) Conference telephone terminal, system and method for sharing data
CN105763832A (en) Video interaction and control method and device
CN202918417U (en) Video conversation system based on Android set top box
CN103051864A (en) Mobile video conference method and system thereof
CN1411278A (en) IP network TV conference system
CN108933914B (en) Method and system for carrying out video conference by using mobile terminal
CN103888712A (en) Multilingual synchronous audio and video conference system
WO2015003532A1 (en) Multimedia conferencing establishment method, device and system
US20150341565A1 (en) Low data-rate video conference system and method, sender equipment and receiver equipment
CN102223515A (en) Remote presentation meeting system and method for recording and replaying remote presentation meeting
WO2016026336A1 (en) Remote interaction method and system in audio/video conference and mcu
CN102033707A (en) System and method for processing audio/video data in multi-window display
CN104427295A (en) Method for processing video in video conference and terminal
WO2016206471A1 (en) Multimedia service processing method, system and device
CN102438119B (en) Audio/video communication system of digital television
CN111083427B (en) Data processing method of embedded terminal and 4K video conference system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20110420