CN111372034A - Video conference device and face positioning method thereof - Google Patents

Video conference device and face positioning method thereof Download PDF

Info

Publication number
CN111372034A
CN111372034A CN202010286320.3A CN202010286320A CN111372034A CN 111372034 A CN111372034 A CN 111372034A CN 202010286320 A CN202010286320 A CN 202010286320A CN 111372034 A CN111372034 A CN 111372034A
Authority
CN
China
Prior art keywords
camera
video conference
panoramic
sound
disposed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010286320.3A
Other languages
Chinese (zh)
Inventor
黄健刚
王金华
张飞滔
徐尚
张东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Minrray Industry Corp ltd
Original Assignee
Shenzhen Minrray Industry Corp ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Minrray Industry Corp ltd filed Critical Shenzhen Minrray Industry Corp ltd
Priority to CN202010286320.3A priority Critical patent/CN111372034A/en
Publication of CN111372034A publication Critical patent/CN111372034A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Studio Devices (AREA)

Abstract

The invention relates to the technical field of video conferences, in particular to a video conference device and a face positioning method thereof. The video conference device comprises an installation main body, wherein the installation main body is provided with a cavity; the sound positioning mechanism is used for acquiring sound signals from a plurality of directions so as to identify the directions of the sound signals and perform angle range positioning; the panoramic camera is used for shooting and acquiring a panoramic image; the two camera mechanisms can respectively rotate by taking the horizontal direction and the vertical direction of the mounting main body as axes so as to shoot and obtain images in different directions; the main control module is respectively connected with the sound positioning mechanism, the panoramic camera and the two camera shooting mechanisms and respectively controls the sound positioning mechanism, the panoramic camera and the two camera shooting mechanisms; wherein, sound positioning mechanism, two camera mechanisms and panoramic camera all set up in the installation main part, and main control module locates in the cavity. The invention can realize multi-person multi-angle panoramic video conference with a simple and compact structure, is convenient to install and use and occupies small space.

Description

Video conference device and face positioning method thereof
Technical Field
The invention relates to the technical field of video conferences, in particular to a video conference device and a face positioning method thereof.
Background
The video conference refers to a conference in which people located at two or more sites have face-to-face conversations through a communication device and a network, and the video conference can be divided into a point-to-point conference and a multipoint conference according to the number of participating sites. The video conference system is an application system which supports real-time information communication of people across space based on network and can develop cooperative work, and the video conference system transmits video and audio information in real time by accessing video acquisition equipment, audio acquisition equipment and the like to realize remote real and intuitive audio and video communication of cooperative personnel.
In the prior art, there is a video conference with a single angle through a single camera such as a mobile phone and a computer, but this kind of equipment is not convenient for more personnel to carry out a large-scale video conference, and there is also a plurality of cameras arranged indoors, and a plurality of corresponding control equipment and microphone equipment are equipped with simultaneously to carry out a multi-angle panoramic video conference, but this kind of equipment is inconvenient to install and use, and the equipment occupation space is large.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a video conference device and a face positioning method thereof, aiming at the above defects of the prior art, and solving the problems that the existing video conference device for performing multi-angle panoramic video conference is inconvenient to install and use and large in occupied space of equipment.
The technical scheme adopted by the invention for solving the technical problems is as follows: there is provided a video conference apparatus comprising:
the mounting body is provided with a cavity;
the sound positioning mechanism is used for acquiring sound signals from a plurality of directions so as to identify the directions of the sound signals and perform angle range positioning;
the panoramic camera is used for shooting and acquiring a panoramic image;
the two camera mechanisms can respectively rotate by taking the horizontal direction and the vertical direction of the mounting main body as axes so as to shoot and obtain images in different directions; and
the main control module is respectively connected with the sound positioning mechanism, the panoramic camera and the two camera mechanisms, controls the sound positioning mechanism to acquire sound signals from a plurality of directions, performs angle range positioning according to panoramic images acquired by the panoramic camera to acquire the spatial position of a human face, and controls the two camera mechanisms to rotate to the spatial position; wherein the content of the first and second substances,
the sound positioning mechanism, the two camera shooting mechanisms and the panoramic camera are all arranged on the installation main body, and the main control module is arranged in the cavity.
Further preferred embodiments of the present invention are: the sound positioning mechanism comprises a plurality of microphones used for acquiring sound signals, and the microphones are arranged on one end face of the mounting main body in a linear interval mode.
Further preferred embodiments of the present invention are: the camera shooting mechanism comprises a camera, a first driving part, a second driving part and a support, wherein the first driving part and the second driving part are arranged on the installation main body, the support is respectively connected with the first driving part and the second driving part, the first driving part drives the support to rotate by taking the vertical direction of the installation main body as an axis, and the second driving part drives the camera to rotate by taking the horizontal direction of the installation main body as an axis.
Further preferred embodiments of the present invention are: first drive division includes first motor, the action wheel of being connected with first motor and with leg joint from the driving wheel, the action wheel passes through the hold-in range and drives from driving wheel work to the vertical direction that drives the support and use the installation main part rotates as the axle, first motor, action wheel, follow driving wheel and hold-in range set up in the cavity.
Further preferred embodiments of the present invention are: the second driving part comprises two second motors which are distributed on two sides of the camera and arranged on the support, and the second motors drive the camera to rotate by taking the horizontal direction of the installation main body as an axis.
Further preferred embodiments of the present invention are: the video conference device further comprises a main circuit board and an auxiliary circuit board which are arranged in the cavity, the main control module is arranged on the main circuit board, and the microphones are arranged on the auxiliary circuit board.
Further preferred embodiments of the present invention are: the two camera shooting mechanisms are respectively distributed on two sides of the panoramic camera.
Further preferred embodiments of the present invention are: the video conference device further comprises an interface module used for connecting external equipment and the video conference device, and the interface module is connected with the main control module and arranged on the installation main body.
Further preferred embodiments of the present invention are: the interface module comprises at least one of a network interface, an HDMI high-definition interface and an audio interface.
The technical scheme adopted by the invention for solving the technical problems is as follows: a face positioning method of a video conference device is provided, the face positioning method is applied to any one of the video conference devices, and the face positioning method comprises the following steps:
shooting to obtain a panoramic image;
acquiring sound signals from a plurality of directions, identifying the directions of the sound signals, and positioning an angle range;
capturing a face image in the positioned angle range in the panoramic image to obtain the spatial position of the face;
and controlling the camera shooting mechanism to rotate to the corresponding spatial position.
Compared with the prior art, the multi-person multi-angle panoramic video conference has the advantages that the mounting main body with the cavity is arranged, the sound positioning mechanism, the two camera shooting mechanisms and the panoramic camera are arranged on the mounting main body, the main control module is arranged in the cavity and controls the two camera shooting mechanisms to rotate respectively by taking the horizontal direction and the vertical direction of the mounting main body as axes, the sound positioning mechanism and the panoramic camera are matched to acquire sound signals and face images, the multi-person multi-angle panoramic video conference is realized by a simple and compact structure, the mounting and the use are convenient, and the occupied space is small.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
fig. 1 is a schematic perspective view of a video conference apparatus according to the present invention;
FIG. 2 is a schematic perspective view of a video conferencing device of the present invention from another angle;
fig. 3 is a schematic structural diagram of a video conference apparatus of the present invention;
FIG. 4 is a schematic perspective view of the camera mechanism of the present invention;
FIG. 5 is a schematic view of the construction of the camera mechanism of the present invention;
fig. 6 is a flow chart of a face positioning method of the video conference apparatus of the present invention.
Detailed Description
The preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
As shown in fig. 1 to 3, the present invention provides a preferred embodiment of a video conference apparatus.
With reference to fig. 1 to 3, the video conference device includes an installation main body 10 provided with a cavity 11, a sound positioning mechanism 20, a panoramic camera 40, two cameras 30 and a main control module, wherein the sound positioning mechanism 20, the two cameras 30 and the panoramic camera 40 are all disposed on the installation main body 10, and the main control module is disposed in the cavity 11. The sound positioning mechanism 20 is used for acquiring sound signals from a plurality of directions, and identifying the directions of the sound signals to perform angular range positioning; the panoramic camera 40 is used for shooting and acquiring a panoramic image; each of the image capturing mechanisms 30 can rotate around the horizontal direction and the vertical direction of the installation body 10 as an axis, so as to capture images in different directions; the main control module is respectively connected with the sound positioning mechanism 20, the panoramic camera 40 and the two camera mechanisms 30, controls the sound positioning mechanism 20 to acquire sound signals from a plurality of directions, performs angle range positioning to acquire the spatial position of a human face according to the panoramic image acquired by the panoramic camera 40, controls the two camera mechanisms 30 to rotate to the spatial position, and shoots and acquires the image of the spatial position.
The two camera mechanisms 30 are arranged to rotate by taking the horizontal direction and the vertical direction of the installation main body 10 as axes respectively, the sound positioning mechanism 20 and the panoramic camera 40 are matched to acquire sound signals and face images, the multi-person multi-angle panoramic video conference is realized by a simple and compact structure, the installation and the use are convenient, and the occupied space is small.
The two imaging mechanisms 30 may be disposed at any position of the mounting body 10, and capture images in different directions. Preferably, the two camera mechanisms 30 are respectively disposed at two sides of the panoramic camera 40.
In this embodiment, the sound positioning mechanism 20 includes a plurality of microphones 21 for acquiring sound signals, and the plurality of microphones 21 are arranged on an end surface of the mounting main body 10 at intervals in a straight line. The microphones 21 transmit the acquired sound signals to the main control module, the main control module performs angle range positioning on the sound signals according to the directions of the sound signals acquired by the different microphones 21, the panoramic camera 40 is combined to shoot the acquired panoramic image, the face image in the positioned angle range is grabbed in the panoramic image, the spatial position of the face is acquired, and the camera mechanism 30 can be conveniently rotated to the spatial position.
Referring to fig. 4 and 5, in this embodiment, the image capturing mechanism 30 includes a camera 31, a first driving portion 32 and a second driving portion 33 which are disposed on the installation main body 10, and a bracket 34 which is connected to the first driving portion 32 and the second driving portion 33 respectively, the first driving portion 32 drives the bracket 34 to rotate with the vertical direction of the installation main body 10 as an axis, and the second driving portion 33 drives the camera 31 to rotate with the horizontal direction of the installation main body 10 as an axis. When the spatial position of the face is obtained, the main control module controls the first driving part 32 and the second driving part 33 in the camera mechanism 30 to work, drives the camera 31 to rotate by taking the horizontal direction and the vertical direction of the installation main body 10 as axes, rotates to the spatial position corresponding to the face, shoots and obtains the face image, and is convenient for displaying the face image subsequently. Of course, in other embodiments, the main control module may control both the two image capturing mechanisms 30 to rotate to the directions corresponding to the face images. In addition, the camera 31 may also be driven by the first driving part 32 and the second driving part 33 to rotate to other angular orientations, so as to obtain images in different orientations. Through adopting first drive division 32 and second drive division 33, camera 31 can rotate to different angle position to acquire the image in different positions, need not to set up a plurality of cameras 31 in different positions, simple structure, simple to operate, occupation space is little.
Further, referring to fig. 4 and 5, the first driving part 32 includes a first motor 321, a driving wheel 322 connected to the first motor 321, and a driven wheel 323 connected to the bracket 34, the driving wheel 322 drives the driven wheel 323 to operate through a timing belt 324 to drive the bracket 34 to rotate around the vertical direction of the installation body 10, and the first motor 321, the driving wheel 322, the driven wheel 323, and the timing belt 324 are disposed in the cavity 11. The structure that adopts first motor 321, action wheel 322, follow driving wheel 323 and hold-in range 324 to combine drives support 34 and uses the vertical direction of installation main part 10 as the axle and rotates, and sets up these several in the cavity 11 of installation main part 10, compact structure, whole small of whole video conferencing device.
Further, referring to fig. 5, the second driving portion 33 includes two second motors 331 distributed on two sides of the camera 31 and disposed on the bracket 34, the second motors 331 drive the camera 31 to rotate around the horizontal direction of the installation main body 10, and the bracket 34 is driven by the first driving portion 32 to rotate around the vertical direction of the installation main body 10, so that the camera 31 can rotate around the horizontal direction and the vertical direction of the installation main body 10 to a spatial position corresponding to the face image or rotate to different angular orientations to obtain images in different orientations.
Referring to fig. 3, in this embodiment, the video conference apparatus further includes a main circuit board 50 and an auxiliary circuit board 60 disposed in the cavity 11, the main control module is disposed on the main circuit board 50, and the plurality of microphones 21 are disposed on the auxiliary circuit board 60. Specifically, the main circuit board 50 is provided on a bottom wall surface inside the mounting body 10, and the sub circuit board 60 is provided on a side wall surface inside the mounting body 10.
Referring to fig. 2 and 3, in the embodiment, the video conference apparatus further includes an interface module 70 for connecting an external device and the video conference apparatus, and the interface module 70 is connected to the main control module and is disposed on the installation main body 10. Specifically, the interface module 70 includes at least one of a network interface 71, an HDMI high definition interface 72, and an audio interface 73. Preferably, in the present embodiment, a network interface 71, an HDMI high-definition interface 72, and an audio interface 73 are provided on the mounting body 10. Through this interface module 70, the video conference device can connect external equipment and carry out network connection, high definition video transmission, broadcast audio frequency etc. and this video conference device's the degree of integrating is high. Of course, the interface module 70 may also include a USB3.0 interface, a 3G-SDI interface, and the like.
As shown in fig. 6, the present invention further provides a preferred embodiment of a face positioning method of a video conference device.
The face positioning method is applied to the video conference device. The face positioning method comprises the following steps:
s10, shooting to obtain a panoramic image;
s20, acquiring sound signals from a plurality of directions, identifying the directions of the sound signals, and positioning an angle range;
s30, capturing a face image in the positioned angle range in the panoramic image, and acquiring the spatial position of the face;
and S40, controlling the camera shooting mechanism 30 to rotate to the corresponding space position.
Based on the above video conference device, panoramic camera 40 shoots the panoramic picture that obtains the scope greatly, sound positioning mechanism 20 obtains the sound signal from a plurality of azimuths, transmit the sound signal to host system, host system discerns the position of sound signal according to the sound signal who obtains, carry out the angle range location, and then from the face image of the angle range department of locating in the panoramic picture, obtain the spatial position of people's face, control camera mechanism 30 and use the horizontal direction and the vertical direction of installation main part 10 as the axle and rotate, so that camera mechanism 30 rotates to the spatial position that the face image corresponds, shoot people's face, so that follow-up shows the broadcast to the face image. The face positioning method based on the video conference device can realize face identification and positioning in a multi-person multi-angle panoramic video conference based on equipment with simple structure and small occupied size, and is convenient to use.
It should be understood that the above embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same, and those skilled in the art can modify the technical solutions described in the above embodiments, or make equivalent substitutions for some technical features; and all such modifications and alterations are intended to fall within the scope of the appended claims.

Claims (10)

1. A video conferencing apparatus, comprising:
the mounting body is provided with a cavity;
the sound positioning mechanism is used for acquiring sound signals from a plurality of directions so as to identify the directions of the sound signals and perform angle range positioning;
the panoramic camera is used for shooting and acquiring a panoramic image;
the two camera mechanisms can respectively rotate by taking the horizontal direction and the vertical direction of the mounting main body as axes so as to shoot and obtain images in different directions; and
the main control module is respectively connected with the sound positioning mechanism, the panoramic camera and the two camera mechanisms, controls the sound positioning mechanism to acquire sound signals from a plurality of directions, performs angle range positioning according to panoramic images acquired by the panoramic camera to acquire the spatial position of a human face, and controls the two camera mechanisms to rotate to the spatial position; wherein the content of the first and second substances,
the sound positioning mechanism, the two camera shooting mechanisms and the panoramic camera are all arranged on the installation main body, and the main control module is arranged in the cavity.
2. The video conferencing device of claim 1, wherein the sound locator includes a plurality of microphones for capturing sound signals, the plurality of microphones being disposed in a line spaced apart on an end surface of the mounting body.
3. The video conference device according to claim 1, wherein the camera mechanism comprises a camera, a first driving portion, a second driving portion and a bracket, the first driving portion and the second driving portion are disposed on the mounting body, the bracket is driven by the first driving portion to rotate around a vertical direction of the mounting body, and the bracket is driven by the second driving portion to rotate around a horizontal direction of the mounting body.
4. The video conference device according to claim 3, wherein the first driving portion comprises a first motor, a driving wheel connected to the first motor, and a driven wheel connected to the bracket, the driving wheel drives the driven wheel to operate through a synchronous belt to drive the bracket to rotate around a vertical direction of the mounting body, and the first motor, the driving wheel, the driven wheel, and the synchronous belt are disposed in the cavity.
5. The video conference device as claimed in claim 3, wherein the second driving portion comprises two second motors disposed on two sides of the camera and disposed on the bracket, and the two second motors drive the camera to rotate around the horizontal direction of the mounting body.
6. The video conferencing device of claim 2, further comprising a main circuit board and an auxiliary circuit board disposed in the cavity, wherein the main control module is disposed on the main circuit board, and the plurality of microphones are disposed on the auxiliary circuit board.
7. The video conferencing device of claim 1, wherein the two cameras are respectively disposed at two sides of the panoramic camera.
8. The video conference device according to any one of claims 1 to 7, wherein the video conference device further comprises an interface module for connecting an external device with the video conference device, the interface module being connected with the main control module and being disposed on the mounting body.
9. The video conferencing device of claim 8, wherein the interface module comprises at least one of a network interface, an HDMI high definition interface, and an audio interface.
10. A face localization method of a video conference apparatus, wherein the face localization method is applied to the video conference apparatus according to any one of claims 1 to 9, and the face localization method comprises the steps of: shooting to obtain a panoramic image;
acquiring sound signals from a plurality of directions, identifying the directions of the sound signals, and positioning an angle range;
capturing a face image in the positioned angle range in the panoramic image to obtain the spatial position of the face;
and controlling the camera shooting mechanism to rotate to the corresponding spatial position.
CN202010286320.3A 2020-04-13 2020-04-13 Video conference device and face positioning method thereof Pending CN111372034A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010286320.3A CN111372034A (en) 2020-04-13 2020-04-13 Video conference device and face positioning method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010286320.3A CN111372034A (en) 2020-04-13 2020-04-13 Video conference device and face positioning method thereof

Publications (1)

Publication Number Publication Date
CN111372034A true CN111372034A (en) 2020-07-03

Family

ID=71212151

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010286320.3A Pending CN111372034A (en) 2020-04-13 2020-04-13 Video conference device and face positioning method thereof

Country Status (1)

Country Link
CN (1) CN111372034A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112839165A (en) * 2020-11-27 2021-05-25 深圳市捷视飞通科技股份有限公司 Method and device for realizing face tracking camera shooting, computer equipment and storage medium
TWI826768B (en) * 2021-01-22 2023-12-21 圓展科技股份有限公司 Video conferencing system and method thereof

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112839165A (en) * 2020-11-27 2021-05-25 深圳市捷视飞通科技股份有限公司 Method and device for realizing face tracking camera shooting, computer equipment and storage medium
TWI826768B (en) * 2021-01-22 2023-12-21 圓展科技股份有限公司 Video conferencing system and method thereof

Similar Documents

Publication Publication Date Title
US9860486B2 (en) Communication apparatus, communication method, and communication system
EP2622851B1 (en) Method and apparatus for tracking an audio source in a video conference using multiple sensors
US20100118112A1 (en) Group table top videoconferencing device
US8054336B2 (en) High definition pan tilt zoom camera with embedded microphones and thin cable for data and power
WO2004112290A3 (en) Receiving system for video conferencing system
MX2007015184A (en) Normalized images for cameras.
CN106341667A (en) UAV (Unmanned Aerial Vehicle) based 3D panorama video remote monitoring system and image acquisition control method thereof
WO2015070558A1 (en) Video shooting control method and device
CN111372034A (en) Video conference device and face positioning method thereof
KR20180048982A (en) Devices for video-conferences
CN109068090B (en) Wireless video conference system
TW201943259A (en) Window system based on video communication
CN111343413A (en) Video conference system and display method thereof
TW201943258A (en) Video communication device and method for connecting video communication to other device
CN110083250A (en) A kind of accessible conference system for supporting sign language translation on line
US10979666B2 (en) Asymmetric video conferencing system and method
CN211630270U (en) Video conference system
US7986336B2 (en) Image capture apparatus with indicator
JP2002300602A (en) Window-type image pickup/display device and two-way communication method using the same
CN211982004U (en) Video conference device
WO2011124066A1 (en) Remote representation system and camera group thereof
JP2012010059A (en) Imaging apparatus and remote communication system using the same
CN221127405U (en) Image pickup apparatus
CN213213667U (en) Interactive conference device based on visual and sound fusion
CN113271427A (en) Conference projection system based on flight control design and control method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination