CN117615158A - Personnel ground operation command and monitoring system and signaling interaction method - Google Patents
Personnel ground operation command and monitoring system and signaling interaction method Download PDFInfo
- Publication number
- CN117615158A CN117615158A CN202410096250.3A CN202410096250A CN117615158A CN 117615158 A CN117615158 A CN 117615158A CN 202410096250 A CN202410096250 A CN 202410096250A CN 117615158 A CN117615158 A CN 117615158A
- Authority
- CN
- China
- Prior art keywords
- command
- terminal
- shadow
- central
- central command
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 81
- 230000003993 interaction Effects 0.000 title claims abstract description 61
- 230000011664 signaling Effects 0.000 title claims abstract description 51
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000006854 communication Effects 0.000 claims abstract description 81
- 238000004891 communication Methods 0.000 claims abstract description 80
- 230000009471 action Effects 0.000 claims abstract description 7
- 230000005540 biological transmission Effects 0.000 claims description 29
- 238000007726 management method Methods 0.000 claims description 19
- 230000002452 interceptive effect Effects 0.000 claims description 16
- 230000007613 environmental effect Effects 0.000 claims description 8
- 238000013500 data storage Methods 0.000 claims description 6
- 206010063385 Intellectualisation Diseases 0.000 abstract description 4
- 230000008569 process Effects 0.000 description 33
- 238000010586 diagram Methods 0.000 description 15
- 241000209140 Triticum Species 0.000 description 12
- 235000021307 Triticum Nutrition 0.000 description 12
- 230000008859 change Effects 0.000 description 7
- 230000008030 elimination Effects 0.000 description 4
- 238000003379 elimination reaction Methods 0.000 description 4
- 241001083514 Gayophytum Species 0.000 description 2
- 230000002457 bidirectional effect Effects 0.000 description 2
- 239000003054 catalyst Substances 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000007599 discharging Methods 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008033 biological extinction Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000036772 blood pressure Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The invention relates to the technical field of shadow ground operation, and provides a shadow ground operation command and monitoring system and a signaling interaction method, wherein the system comprises the following components: a plurality of central command terminals; and a plurality of operation terminals in communication connection with each central command terminal. The invention establishes communication connection between the central command terminal and the operation terminal belonging to the shadow operation point, unifies and efficiently communicates data, videos, characters and pictures with the location by adopting a signaling interaction mode, helps the operation point to execute efficient and accurate shadow ground operation, unifies the operation point, the command center and the management center, realizes the operation command and monitoring of consultation, live action and panorama, provides live action interaction command based on real-time video interaction, live action safety monitoring based on video and data acquisition and regional operation consultation based on real-time video interaction, realizes group communication and collaborative operation of the terminal corresponding to the target operation task, and improves the intellectualization and the efficiency.
Description
Technical Field
The invention relates to the technical field of shadow ground operation, in particular to a shadow ground operation command and monitoring system and a signaling interaction method.
Background
Artificial influence on weather is simply called a shadow, and is to spread a catalyst to a cloud layer with a sky height of 2-10 km under proper conditions for disaster reduction and prevention, so as to realize the purposes of increasing rain, hail suppression, rain elimination, fog elimination, forest fire prevention (fire extinction), public pollution elimination and the like. The catalyst can be delivered to a proper position by using aircraft, high shells, rocket shells and ground smoke modes, wherein the high shells, the rocket shells and the ground smoke modes are all called as ground operation modes, and are called as ground operation for short. The ground operation needs proper operation points, the operation points are distributed in a wider area for one city/county, the command center sends operation instructions to each operation point through radar data or weather forecast conditions, and the sending process is necessarily carried out through communication means.
However, the task issuing and the operation command and monitoring during the execution of the existing shadow ground operation do not have complete matching systems, and at present, the detailed operation command and monitoring cannot be realized only by adopting simple telephone, social software and other modes, and particularly in the scenes of facing multiple command management levels, multiple shadow operation points and scattered operation points, the command and monitoring on the shadow ground operation cannot meet the operation management requirement.
Disclosure of Invention
To solve the above-mentioned problems of the prior art, a first aspect of the present invention provides a system for commanding and monitoring operation of a shadow ground, comprising:
a plurality of central command terminals; and
a plurality of operation terminals in communication connection with each central command terminal;
the central command terminal is connected with the command reference database to acquire command reference data, and generates an operation task according to the command reference data; each central command terminal is in communication connection with a plurality of corresponding operation terminals through a special meteorological network, and the operation terminals execute personnel and ground operation according to operation tasks transmitted by the central command terminals through the special meteorological network;
the central command terminal and the corresponding operation terminals are provided with live-action interaction command systems, the operation terminals transmit operation scenes and operation data to the central command terminal through the live-action interaction command systems, and the central command terminal executes operation commands based on the operation scenes and the operation data through the live-action interaction command systems;
the central command terminal and the corresponding operation terminals are provided with a panoramic safety monitoring system, the operation terminals transmit environment data and supervision data of an operation area to the central command terminal through the panoramic safety monitoring system, and the central command terminal executes safety monitoring based on the environment data and the supervision data through the panoramic safety monitoring system.
Optionally, the central command terminal is arranged in a county figure center or a city figure center, and the operation terminal is arranged at a figure operation point;
each shadow operation point belongs to the corresponding county shadow office, each county shadow office belongs to the corresponding city state shadow center, and each city state shadow center is affiliated to the corresponding provincial shadow center;
the center command terminals of the county figure office, the city state figure center and the figure-saving center, which each figure operation point belongs to, comprise a first center command terminal divided into command centers and a second center command terminal divided into management monitoring centers;
the operation terminal of each shadow operation point is in communication connection with the first central command terminal so as to realize that the operation terminal executes the shadow ground operation according to the operation task transmitted by the first central command terminal through the special meteorological network, and the first central command terminal executes operation command and safety monitoring on the operation terminal;
the operation terminals of each shadow operation point are in communication connection with the second central command terminal, so that the second central command terminal can monitor and manage the shadow ground operation executed by the operation terminals.
Optionally, the live-action interaction command system includes:
the video acquisition transmission assembly, the audio acquisition transmission and play assembly and the display assembly are arranged on the operation terminal and the central command terminal;
the video acquisition and transmission assembly is used for acquiring and transmitting an operation picture of the operation terminal and a command picture of the central command terminal, and the audio acquisition, transmission and play assembly is used for acquiring, transmitting and playing operation audio of the operation terminal and command audio of the central command terminal;
the display component is used for displaying the operation picture and the command picture on the operation terminal and the central command terminal and displaying the environment data and the supervision data on the central command terminal.
Optionally, the central command terminal specifically includes:
the regional independent command group establishment module; the regional independent command group establishing module is configured to establish regional independent command groups between the operation terminals of the plurality of shadow operation points and the central command terminal, and the operation terminals and the central command terminal in the same regional independent command group execute shadow ground operation, operation command and safety monitoring;
a group communication mode switching module; the group communication mode switching module is configured to control the communication modes of the operation terminals in each regional independent command group according to the mode control instruction of the central command terminal.
Optionally, the communication mode includes a conference mode and a command mode; wherein:
when the mode control instruction is to switch the conference mode, establishing video full duplex communication and voice full duplex communication between each operation terminal and the central command terminal in the regional independent command group, and inputting voice information when the central command terminal starts voice communication by each operation terminal;
when the mode control instruction is to switch the command mode, establishing video full duplex communication and voice half duplex communication between each operation terminal and the central command terminal in the regional independent command group, and inputting voice information when the operation terminal and the central command terminal successfully execute the wheat-rushing action.
Optionally, when the central command terminal includes a first central command terminal as a command center and a second central command terminal as a management monitoring center, if the communication mode is a command mode, other central command terminals or operation terminals execute voice information input only when the central command terminal with higher membership level does not input voice information.
Optionally, each of the shadow operating points is provided with a data storage server, the data storage server is used for locally storing data of the shadow ground operation executed by the operating terminal of the shadow operating point, and the operating terminal of each shadow operating point only transmits the locally stored shadow ground operation data, environment data and supervision data, and operation images and operation audios to the central command terminal as required when detecting that the shadow ground operation data, environment data and supervision data enter the regional independent command group.
Optionally, the central command terminal specifically includes:
the regional collaboration command group establishment module; the regional collaboration command group establishing module is configured to establish regional collaboration command groups among a plurality of central command terminals, and the central command terminals in the same regional collaboration command group transmit or receive command reference data to other central command terminals to realize command reference data sharing;
a collaborative human shadow ground operation generation module; and the collaborative human shadow ground operation generating module generates an operation task of an operation terminal under a human shadow operation point corresponding to each central command terminal according to shared command reference data of each central command terminal in the regional collaborative command group.
Optionally, the panoramic security monitoring system specifically includes:
the environment data acquisition component and the supervision data acquisition component are configured on the operation terminal;
the environment data acquisition component is used for acquiring environment information of the shadow operation points and state information of operation equipment, and the supervision data acquisition component is used for acquiring state information of the shadow operation personnel;
the central command terminal generates panoramic monitoring event information according to the environment information transmitted by the operation terminal, the state information of the operation equipment and the state information of the personnel and the shadow operation personnel, and displays the panoramic monitoring event information on a display component of the central command terminal.
To solve the above-mentioned problems of the prior art, a second aspect of the present invention provides a signaling interaction method of a personnel operation command and monitor system, for the personnel operation command and monitor system, comprising:
s1: the central command terminal is connected with the command reference database and generates an operation task according to the command reference database;
s2: the central command terminal establishes communication connection with a plurality of operation terminals through a weather private network and transmits operation tasks to the corresponding operation terminals;
s3: the operation terminal receives the operation task transmitted by the central command terminal, and executes the shadow ground operation according to the operation task;
s4: the operation terminal transmits the operation scene and operation data for executing the shadow ground operation to the central command terminal;
s5: the central command terminal displays the operation scene and the operation data, executes the operation command based on the operation scene and the operation data, and transmits the operation command data to the operation terminal;
s6: the operation terminal displays the operation command data and transmits the environment data and the supervision data of the operation area to the central command terminal;
s7: and the central command terminal displays the environmental data and the supervision data, and performs security monitoring based on the environmental data and the supervision data.
The invention has the beneficial effects that: the system comprises: a plurality of central command terminals; and a plurality of operation terminals in communication connection with each central command terminal. The invention establishes communication connection between the central command terminal and the operation terminal belonging to the shadow operation point, unifies and efficiently communicates data, videos, characters and pictures with the location in a signaling interaction mode, helps the operation point to execute efficient and accurate shadow ground operation, unifies the operation point, the command center and the management center, realizes the operation command and monitoring of consultation, real scenes and panorama, and simultaneously realizes the operation command and safety monitoring of the central command terminal on each shadow operation point according to the configured real scene interaction command system and panorama safety monitoring system, thereby providing real scene interaction command based on real-time video interaction, real scene safety monitoring based on video and data acquisition and regional operation consultation based on real-time video interaction, realizing group communication and collaborative operation of the terminal corresponding to the target operation task, and improving the intellectualization and high efficiency of the operation command and monitoring of the shadow ground.
Drawings
FIG. 1 is a schematic diagram of a system for commanding and monitoring operation of a human shadow ground provided by the invention;
FIG. 2 is a diagram of a four-level artifact management hierarchy according to the present invention;
FIG. 3 is a schematic diagram of a central command terminal for county accounting as a command and monitor subject in accordance with the present invention;
FIG. 4 is a schematic diagram of a central command terminal of the state image center of the local city as a command and monitor subject;
fig. 5 is a schematic diagram of the establishment principle of the regional collaboration commanding group according to the present invention;
FIG. 6 is a schematic flow chart of a signaling interaction method of the human-image ground operation command and monitor system provided by the invention;
FIG. 7 is a schematic diagram of the interaction process for establishing signaling for a point-to-point real-time interactive video call between a command center and an operation point provided by the invention;
fig. 8 is a schematic diagram of an interaction process of the speech signaling of the point-to-point command mode center between the command center and the operation point provided by the invention;
fig. 9 is a schematic diagram of a signaling interaction process provided by the invention for a point-to-point command mode operation point speech between a command center and an operation point by a center microphone;
FIG. 10 is a schematic diagram of a signaling interaction process for point-to-point closed communication between a command center and a job point provided by the present invention;
FIG. 11 is a schematic diagram of an interaction process for group real-time interactive video setup and pull-in signaling between a command center and a plurality of job points according to the present invention;
FIG. 12 is a schematic diagram of an interactive process for group real-time interactive video closure between a command center and a plurality of job points according to the present invention;
fig. 13 is a schematic diagram of a signaling interaction process for failure of wheat robbing for a group command mode between a command center and a plurality of operation points;
fig. 14 is a schematic diagram of a signaling interaction process provided by the invention for failure of the operation point to rob wheat and success of the center to rob wheat for a group command mode between a command center and a plurality of operation points;
fig. 15 is a schematic diagram of a signaling interaction process of video monitoring provided by the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1:
referring to fig. 1, fig. 1 is a schematic structural diagram of a command and monitor system for operation on the ground of a shadow according to an embodiment of the present invention.
As shown in fig. 1, a system for commanding and monitoring a shadow ground operation, comprising: a plurality of central command terminals; and a plurality of operation terminals in communication connection with each central command terminal.
In this embodiment, the central command terminal is connected with a command reference database to obtain command reference data, and generates an operation task according to the command reference data; each central command terminal is in communication connection with a plurality of corresponding operation terminals through a special meteorological network, and the operation terminals execute personnel and ground operation according to operation tasks transmitted by the central command terminals through the special meteorological network; the central command terminal and the corresponding operation terminals are provided with live-action interaction command systems, the operation terminals transmit operation scenes and operation data to the central command terminal through the live-action interaction command systems, and the central command terminal executes operation commands based on the operation scenes and the operation data through the live-action interaction command systems; the central command terminal and the corresponding operation terminals are provided with a panoramic safety monitoring system, the operation terminals transmit environment data and supervision data of an operation area to the central command terminal through the panoramic safety monitoring system, and the central command terminal executes safety monitoring based on the environment data and the supervision data through the panoramic safety monitoring system.
It should be noted that, the task issuing and the operation command and monitoring during the execution of the existing personnel ground operation do not have complete matching systems, and at present, only simple telephone, social software and other modes are adopted to carry out information transmission, so that detailed operation command and monitoring cannot be realized, and especially in the scenes of facing multiple command management levels, multiple personnel operation points and scattered operation points, the command and monitoring on the personnel ground operation cannot meet the operation management requirement. Therefore, the embodiment executes high-efficiency and accurate personnel ground operation by establishing communication connection between the central command terminal and the operation terminals belonging to the personnel operation points, and simultaneously realizes operation command and safety monitoring of each personnel operation point by the central command terminal according to the configured live-action interaction command system and the panoramic safety monitoring system, thereby providing live-action interaction command based on real-time video interaction, live-action safety monitoring based on video and data acquisition and regional operation consultants based on real-time video interaction, realizing group communication and collaborative operation of the terminals corresponding to target operation tasks, and improving the intellectualization and high efficiency of personnel ground operation command and monitoring. In practical application, the command reference database is a radar database and a satellite database, and the operation tasks sent to each operation terminal are generated according to cloud layer information in the target area range recorded by the radar database and the satellite database.
In a preferred embodiment, the central command terminal is arranged in a county portrait office or a city state portrait center or a provincial portrait center, and the operation terminal is arranged at a portrait operation point; each shadow operation point belongs to the corresponding county shadow office, each county shadow office belongs to the corresponding city state shadow center, and each city state shadow center is affiliated to the corresponding provincial shadow center; the center command terminals of the county figure office, the city state figure center and the figure-saving center, which each figure operation point belongs to, comprise a first center command terminal divided into command centers and a second center command terminal divided into management monitoring centers; the operation terminal of each shadow operation point is in communication connection with the first central command terminal so as to realize that the operation terminal executes the shadow ground operation according to the operation task transmitted by the first central command terminal through the special meteorological network, and the first central command terminal executes operation command and safety monitoring on the operation terminal; the operation terminals of each shadow operation point are in communication connection with the second central command terminal, so that the second central command terminal can monitor and manage the shadow ground operation executed by the operation terminals.
In this embodiment, as shown in fig. 2, a system for commanding and monitoring a human shadow ground operation with four levels of human shadow operation management levels is provided, wherein the system comprises a human shadow operation point, a county human shadow office, a city state human shadow center and a human shadow saving center. As shown in fig. 3, a plurality of operation points/shots may be configured under each county portrait office, each city state portrait center belongs to a plurality of superior management units of the county portrait office, and so on, each provincial portrait center belongs to a plurality of superior management units of the city state portrait centers.
When the operation terminals of the personnel operation points are commanded and monitored, the command and monitoring main body serving as each operation terminal can be a central command terminal arranged in the personnel handling of county, a central command terminal arranged in the personnel center of city, city and state, or a central command terminal arranged in the personnel saving center, the central command terminal serving as the command and monitoring main body is used as a first central command terminal, and the rest of central command terminals, namely a second central command terminal, are used as personnel ground operation monitoring management main bodies. As shown in fig. 3, the organization structure is provided when the central command terminal of the county portrait office is used as a command and monitoring subject, and the central command terminal of the city state portrait center is used as a monitoring management subject; as shown in fig. 4, the organization structure is provided when the central command terminal of the city state figure center is used as a command and monitor subject and the central command terminal of the county figure office is used as a monitor management subject. Therefore, the embodiment provides a shadow job management system with more reasonable and clear architecture and more definite job task allocation, and the shadow ground job multistage management and redundancy control can be realized by flexibly configuring the central command terminal for actually executing the shadow job command and monitoring.
In a preferred embodiment, the live-action interactive command system includes: the video acquisition transmission assembly, the audio acquisition transmission and play assembly and the display assembly are arranged on the operation terminal and the central command terminal; the video acquisition and transmission assembly is used for acquiring and transmitting an operation picture of the operation terminal and a command picture of the central command terminal, and the audio acquisition, transmission and play assembly is used for acquiring, transmitting and playing operation audio of the operation terminal and command audio of the central command terminal; the display component is used for displaying the operation picture and the command picture on the operation terminal and the central command terminal and displaying the environment data and the supervision data on the central command terminal.
In this embodiment, the video acquisition transmission subassembly includes the camera, the audio acquisition transmission and broadcast subassembly includes microphone and stereo set loudspeaker, and the display module includes the display, through all being provided with at operation terminal and central command terminal video acquisition transmission subassembly, audio acquisition transmission and broadcast subassembly and display module, constitutes the interactive command system of outdoor scene, from this, realizes the interactive command of video outdoor scene based on real-time video.
In a preferred embodiment, the central command terminal specifically includes: the regional independent command group establishment module; the regional independent command group establishing module is configured to establish regional independent command groups between the operation terminals of the plurality of shadow operation points and the central command terminal, and the operation terminals and the central command terminal in the same regional independent command group execute shadow ground operation, operation command and safety monitoring; a group communication mode switching module; the group communication mode switching module is configured to control the communication modes of the operation terminals in each regional independent command group according to the mode control instruction of the central command terminal.
In a preferred embodiment, the communication modes include a conference mode and a command mode; wherein: when the mode control instruction is to switch the conference mode, establishing video full duplex communication and voice full duplex communication between each operation terminal and the central command terminal in the regional independent command group, and inputting voice information when the central command terminal starts voice communication by each operation terminal; when the mode control instruction is to switch the command mode, establishing video full duplex communication and voice half duplex communication between each operation terminal and the central command terminal in the regional independent command group, and inputting voice information when the operation terminal and the central command terminal successfully execute the wheat-rushing action.
In a preferred embodiment, when the central command terminal includes a first central command terminal as a command center and a second central command terminal as a management monitoring center, if the communication mode is a command mode, other central command terminals or operation terminals perform voice information input only when a central command terminal with a higher membership level does not input voice information.
In this embodiment, the central command terminal may establish an area independent command group according to a user input request, where the area independent command group includes the central command terminal itself and operation terminals of a plurality of different shadow operation points, and the shadow ground operations, operation commands and security monitoring executed by the central command terminal and the operation terminals are all implemented by the area independent command group. Meanwhile, in order to realize different communication demands, the embodiment provides two mode selections of a conference mode and a command mode, the central command terminal can control the communication mode of the current group according to a mode control instruction input by a user, when the conference mode is adopted, each terminal in the group can realize video full duplex communication and voice full duplex communication, and the central command terminal can execute mute control on any operation terminal so as to realize free communication in the conference mode; when the command mode is adopted, each terminal in the group realizes video full duplex communication and voice half duplex communication, the terminals at the same level can perform voice communication according to the robbery microphone, and the terminals at the high level can rob the voice communication microphone of the terminals at the low level, so that the communication limiting requirement during the command of the image operation in the group is realized.
In a preferred embodiment, each of the shadow work points is provided with a data storage server, the data storage server is used for locally storing data of the shadow ground work executed by the work terminal of the shadow work point, and the work terminal of each shadow work point only transmits the locally stored shadow ground work data, environment data and supervision data and work pictures and work audio to the central command terminal as required when detecting that the shadow work terminal enters the independent command group.
In this embodiment, in order to satisfy the flow of communication transmission of a plurality of operation terminals, a data storage server for storing the operation data, the environment data and the supervision data of the human shadow ground and the operation images and the operation audio frequency is locally arranged at each human shadow operation point, and the operation data is transmitted to the central command terminal through a dedicated communication network only when the operation terminals enter a group, so that the flow use control according to the requirement is realized, and the transmission of the operation command and the supervision of the human shadow point to the central command terminal is maximally ensured not to be blocked and delayed under the condition of the limitation of the communication network.
In a preferred embodiment, the central command terminal specifically includes: the regional collaboration command group establishment module; the regional collaboration command group establishing module is configured to establish regional collaboration command groups among a plurality of central command terminals, and the central command terminals in the same regional collaboration command group transmit or receive command reference data to other central command terminals to realize command reference data sharing; a collaborative human shadow ground operation generation module; and the collaborative human shadow ground operation generating module generates an operation task of an operation terminal under a human shadow operation point corresponding to each central command terminal according to shared command reference data of each central command terminal in the regional collaborative command group.
In this embodiment, as shown in fig. 5, the central command terminal may establish an area collaboration command group according to a user input request, where the area collaboration command group includes the central command terminal itself and central command terminals corresponding to a plurality of other operation terminals; the other operation terminals can be operation terminals for executing the operation of the shadow ground in the adjacent areas of the self area, so that group communication is established through a plurality of central command terminals, sharing of command reference data (such as a weather radar chart) can be realized in the group, and collaborative operation of the cross-area shadow ground can be realized according to the command reference data. Specifically, when the central command terminal receives the human shadow operation task (for example, the region a holds a large-scale sport meeting at the target time, the region a needs to carry out a manual rain elimination task at the target time), command reference data change information (for example, cloud layer change information) of the region a from the current time to the target time is acquired by calling command reference data in a command reference database, the cloud layer formation and movement characteristics are required to execute the human shadow operation task on the region a, and meanwhile, cloud layers formed by moving the surrounding region to the region a are required to be considered from the command reference data change information, so that the central command terminal needs to acquire a larger preset region B including the region a first, extract the command reference data change information from the region B, identify the command reference data change information meeting the requirement of forming a moving cloud layer on the region a according to the rule of the preset command reference data change information, after the identification is successful, other regions capable of generating the moving cloud layer on the region a in the region B are also used as operation regions, the operation terminals and the central terminals to which the corresponding operation terminals belong are required to be executed, the central command terminals to which the operation terminals and the corresponding operation terminals belong are required to be respectively, the central command terminals which are required to be generated, the central command terminals and the corresponding operation terminals and the central command terminals and the corresponding operation terminals are used for the human shadow interaction operation terminals are generated by the corresponding to the human shadow operation center command reference data change terminals, and the corresponding to the human shadow operation center command operation terminal.
In a preferred embodiment, the panoramic security monitoring system specifically comprises: the environment data acquisition component and the supervision data acquisition component are configured on the operation terminal; the environment data acquisition component is used for acquiring environment information of the shadow operation points and state information of operation equipment, and the supervision data acquisition component is used for acquiring state information of the shadow operation personnel; the central command terminal generates panoramic monitoring event information according to the environment information transmitted by the operation terminal, the state information of the operation equipment and the state information of the personnel and the shadow operation personnel, and displays the panoramic monitoring event information on a display component of the central command terminal.
In this embodiment, the environmental information of the shadow operation point includes water immersion data, smoke sensing data, temperature and humidity data, intrusion data detected by the peripheral electronic fence, and the like of the operation area, the status information of the operation device includes ammunition status data, operation device displacement data, and the like, and the status information of the operation personnel includes personnel alcohol detection data, blood pressure detection data, and the like. The central command terminal can generate panoramic monitoring event information according to the environment information, the state information of the operation equipment and the state information of the personnel, and the panoramic monitoring event information is displayed on a panoramic monitoring event wall, so that the acquisition, transmission and visualization intellectualization of the personnel ground operation environment data and the supervision data are improved.
Example 2:
referring to fig. 6, fig. 6 is a flow chart of a signaling interaction method of a personnel ground operation command and monitoring system according to an embodiment of the present invention.
As shown in fig. 6, a signaling interaction method of a personnel operation command and monitor system for the personnel operation command and monitor system, as described above, includes the following steps:
s1: the central command terminal is connected with the command reference database and generates an operation task according to the command reference database;
s2: the central command terminal establishes communication connection with a plurality of operation terminals through a weather private network and transmits operation tasks to the corresponding operation terminals;
s3: the operation terminal receives the operation task transmitted by the central command terminal, and executes the shadow ground operation according to the operation task;
s4: the operation terminal transmits the operation scene and operation data for executing the shadow ground operation to the central command terminal;
s5: the central command terminal displays the operation scene and the operation data, executes the operation command based on the operation scene and the operation data, and transmits the operation command data to the operation terminal;
s6: the operation terminal displays the operation command data and transmits the environment data and the supervision data of the operation area to the central command terminal;
S7: and the central command terminal displays the environmental data and the supervision data, and performs security monitoring based on the environmental data and the supervision data.
As shown in fig. 7, the present embodiment provides an interactive process for point-to-point real-time interactive video call and signaling establishment between a command center and a job point. In the interaction process, the command center firstly transmits a signaling of a calling operation point to the server, the server feeds back the call ID to the command center after generating the call ID, and the command center acquires and returns session configuration and creates and returns transmission information through the session configuration with the server, so that bidirectional data transmission of a transmission layer of the command center and the server is established. After that, the command center issues audio/video to the server, the server calls the operation point, and the operation point processes the call request of the command center, transmits and receives the call signaling to the server, and has the signaling that the server returns the receiving state to the command center; therefore, the operation point realizes session configuration acquisition and return with the server, the transmission layer is created in the return, and the bidirectional data transmission between the operation point and the transmission layer of the server is established. The method comprises the steps of enabling an operation point to subscribe to audio and video of a command center, enabling the command center to subscribe to the audio and video of the operation point through the operation point, and finally enabling the command center to interact with the operation point in a point-to-point real-time mode.
As shown in fig. 8, the present embodiment provides an interactive process for point-to-point command mode center floor signaling between a command center and a job point. In the interaction process, the command center firstly transmits a wheat-grabbing signaling to the server, the server starts the audio of the command center, feeds back a wheat-grabbing prompt to the command center and feeds back a speaking prompt to the operation point, if the server receives the wheat-grabbing signaling of the operation point, judges whether the current command center speaks, if yes, wheat grabbing fails, and if the wheat-grabbing signaling transmitted by the command center is received, the server mutes the audio of a wheat-playing user. This process describes the process of the command center speaking in command mode, attempting to rob the wheat by the job site, but failing.
As shown in fig. 9, the present embodiment provides a signaling interaction procedure for a point-to-point command mode operation point utterance between a command center and an operation point to be robbed by the center. In the interaction process, the operation point transmits a wheat-grabbing instruction to the server, the server starts the operation point audio, feeds back a wheat-grabbing prompt to the operation point and feeds back a speaking prompt to the command center, if the command center transmits the wheat-grabbing signaling to the server, the server mutes the operation point audio and starts the command center audio, meanwhile feeds back the speaking prompt to the operation point and feeds back the wheat-grabbing prompt to the command center, and if the command center transmits a wheat-discharging signaling to the server, the server mutes the wheat-discharging user audio. The process describes the process that the operation point in the command mode speaks and the command center successfully robs wheat.
As shown in fig. 10, the present embodiment provides a signaling interaction procedure for point-to-point closed communication between a command center and a job point. In the interaction process, the command center transmits a communication closing signaling to the server, the server feeds back a state to the command center and feeds back a communication ending state to the operation point, the operation point transmits the communication closing signaling to the server, and the server feeds back the state to the operation point and finally completes the cleaning session. This process describes the process of closing the communication point-to-point.
As shown in fig. 11, the present embodiment provides an interactive process of establishing and pulling signaling for a group real-time interactive video between a command center and a plurality of job points. In the interaction process, firstly, a command center transmits a signaling for establishing group communication to a server, and after a session is established by the server and fed back to the command center, the command center is informed of the communication from the corresponding operation point 1 to the operation point N. After that, the command center and each operation point are respectively and successively acquired and returned with the server through session configuration, the transmission layer is created in the return and other steps to realize the establishment of the transmission layer link and issue video/audio, so that the command center subscribes the audio and video of the operation point 1 to the operation point N, the operation point 1 subscribes the audio and video of the operation point 2 to the operation point N until the establishment of the communication link of each user in the group is completed, and the group real-time interactive video between the command center and a plurality of operation points is realized.
As shown in fig. 12, the present embodiment provides an interactive process for group real-time interactive video closure between a command center and a plurality of job points. In the interaction process, the command center and each operation point can respectively close the communication process of each user in the group with the server by closing the transmission of communication signaling and returning to the state.
As shown in fig. 13, the present embodiment provides a signaling interaction procedure for failure of job point robbery of a group command mode between a command center and a plurality of job points. In the interaction process, after the command center transmits the wheat-grabbing signaling to the server, the server starts audio of the command center, feeds back the wheat-grabbing prompt to the command center and feeds back the speaking prompt to the operation point, if the server receives the wheat-grabbing signaling of the operation point, judges whether the command center speaks, if so, the wheat-grabbing fails, and until the command center transmits the wheat-playing signaling to the server. The process describes the implementation process of the command center speaking in command mode, and the operation point tries to rob wheat.
As shown in fig. 14, the present embodiment provides a signaling interaction procedure for failure of the job point to rob the wheat and success of the center to rob the wheat for the group command mode between the command center and the plurality of job points. In the interaction process, the operation point 1 transmits a wheat-grabbing signaling to a server, the server starts the audio of the operation point 1, feeds back a wheat-grabbing prompt to the operation point 1 and feeds back a speaking prompt to other operation points and command centers; if the server receives the wheat-grabbing signaling of the operation point N, judging whether the operation point 1 has a speech, if so, the same-level wheat grabbing fails; if the server receives the command center's command for wheat rescue, the mute operation point audio starts the command center audio, and feeds back the command center with the command rescue prompt and the speech prompt until the command center transmits the command for wheat discharge to the server. The process describes the implementation of the microphone robbing of the job point talk center in command mode.
As shown in fig. 15, the present embodiment provides a signaling interaction procedure for video monitoring. In the interaction process, a command center transmits a signaling for playing a media request to a server, the server judges a media stream and transmits the signaling for requesting the media to a gateway, the gateway transmits the signaling for requesting the media to a corresponding media source after the request passes verification, the media source feeds back the media stream to the gateway, the gateway feeds back a return state and the media stream to the server, the server feeds back the received media stream to the command center, after the command center finishes playing, the server judges a playing state, if the playing is finished, the signaling for closing the media is transmitted to the gateway, and then the gateway transmits the signaling for closing the media to the media source; therefore, video is called as required, and the video monitoring process is completed according to the actual shadow operation condition. The media source may be a video camera, a file, a video recorder, etc.
Therefore, the central command terminal is connected with the operation terminals belonging to the shadow operation points in a communication manner, the data, videos, characters and pictures are unified and efficiently communicated in a signaling interaction manner, the operation points are helped to execute efficient and accurate shadow ground operation, the operation points, the command center and the management center are unified, consultation, live view and panoramic operation command and monitoring are realized, meanwhile, according to the configured live view interaction command system and panoramic safety monitoring system, the operation command and safety monitoring of the central command terminal on each shadow operation point are realized, and therefore live view interaction command based on real-time video interaction, live view safety monitoring based on video and data acquisition and regional operation consultation based on real-time video interaction are provided, group communication and collaborative operation of the terminals corresponding to target operation tasks can be realized, and the intelligentization and high efficiency of the shadow ground operation command and monitoring are improved.
The specific implementation of the signaling interaction method of the personnel ground operation command and monitoring system is basically the same as that of each embodiment of the personnel ground operation command and monitoring system, and is not repeated here.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (10)
1. A people and video ground operation command and monitoring system, comprising:
a plurality of central command terminals; and a plurality of operation terminals in communication with each central command terminal;
the central command terminal is connected with the command reference database to acquire command reference data, and generates an operation task according to the command reference data; each central command terminal is in communication connection with a plurality of corresponding operation terminals through a special meteorological network, and the operation terminals execute personnel and ground operation according to operation tasks transmitted by the central command terminals through the special meteorological network;
the central command terminal and the corresponding operation terminals are provided with live-action interaction command systems, the operation terminals transmit operation scenes and operation data to the central command terminal through the live-action interaction command systems, and the central command terminal executes operation commands based on the operation scenes and the operation data through the live-action interaction command systems;
The central command terminal and the corresponding operation terminals are provided with a panoramic safety monitoring system, the operation terminals transmit environment data and supervision data of an operation area to the central command terminal through the panoramic safety monitoring system, and the central command terminal executes safety monitoring based on the environment data and the supervision data through the panoramic safety monitoring system.
2. The system according to claim 1, wherein the central command terminal is disposed at a county people handling center or a city people handling center, and the operation terminal is disposed at a people operation point;
each shadow operation point belongs to the corresponding county shadow office, each county shadow office belongs to the corresponding city state shadow center, and each city state shadow center is affiliated to the corresponding provincial shadow center;
the center command terminals of the county figure office, the city state figure center and the figure-saving center, which each figure operation point belongs to, comprise a first center command terminal divided into command centers and a second center command terminal divided into management monitoring centers;
The operation terminal of each shadow operation point is in communication connection with the first central command terminal so as to realize that the operation terminal executes the shadow ground operation according to the operation task transmitted by the first central command terminal through the special meteorological network, and the first central command terminal executes operation command and safety monitoring on the operation terminal;
the operation terminals of each shadow operation point are in communication connection with the second central command terminal, so that the second central command terminal can monitor and manage the shadow ground operation executed by the operation terminals.
3. The shadow floor work command and monitor system of claim 2, wherein the live action interactive command system comprises:
the video acquisition transmission assembly, the audio acquisition transmission and play assembly and the display assembly are arranged on the operation terminal and the central command terminal;
the video acquisition and transmission assembly is used for acquiring and transmitting an operation picture of the operation terminal and a command picture of the central command terminal, and the audio acquisition, transmission and play assembly is used for acquiring, transmitting and playing operation audio of the operation terminal and command audio of the central command terminal;
the display component is used for displaying the operation picture and the command picture on the operation terminal and the central command terminal and displaying the environment data and the supervision data on the central command terminal.
4. A shadow ground work command and monitor system according to claim 3, wherein the central command terminal comprises in particular:
the regional independent command group establishment module; the regional independent command group establishing module is configured to establish regional independent command groups between the operation terminals of the plurality of shadow operation points and the central command terminal, and the operation terminals and the central command terminal in the same regional independent command group execute shadow ground operation, operation command and safety monitoring;
a group communication mode switching module; the group communication mode switching module is configured to control the communication modes of the operation terminals in each regional independent command group according to the mode control instruction of the central command terminal.
5. The shadow floor work command and monitor system of claim 4, wherein the communication modes include a conference mode and a command mode; wherein:
when the mode control instruction is to switch the conference mode, establishing video full duplex communication and voice full duplex communication between each operation terminal and the central command terminal in the regional independent command group, and inputting voice information when the central command terminal starts voice communication by each operation terminal;
When the mode control instruction is to switch the command mode, establishing video full duplex communication and voice half duplex communication between each operation terminal and the central command terminal in the regional independent command group, and inputting voice information when the operation terminal and the central command terminal successfully execute the wheat-rushing action.
6. The system according to claim 5, wherein when the central command terminal includes a first central command terminal as a command center and a second central command terminal as a management monitoring center, if the communication mode is a command mode, other central command terminals or operation terminals perform voice information input only when a central command terminal of a higher membership level does not input voice information.
7. The system according to claim 6, wherein each of the shadow work points is provided with a data storage server for locally storing data of the shadow work performed by the work terminals of the shadow work points, and the work terminals of each of the shadow work points transmit the locally stored shadow work data, environmental data and supervision data, and work pictures and work audios to the central command terminal as needed only when detecting entry into the regional independent command group.
8. A shadow ground work command and monitor system according to claim 3, wherein the central command terminal comprises in particular:
the regional collaboration command group establishment module; the regional collaboration command group establishing module is configured to establish regional collaboration command groups among a plurality of central command terminals, and the central command terminals in the same regional collaboration command group transmit or receive command reference data to other central command terminals to realize command reference data sharing;
a collaborative human shadow ground operation generation module; and the collaborative human shadow ground operation generating module generates an operation task of an operation terminal under a human shadow operation point corresponding to each central command terminal according to shared command reference data of each central command terminal in the regional collaborative command group.
9. The people and ground operation command and monitoring system according to claim 3, characterized in that said panoramic safety monitoring system comprises in particular:
the environment data acquisition component and the supervision data acquisition component are configured on the operation terminal;
the environment data acquisition component is used for acquiring environment information of the shadow operation points and state information of operation equipment, and the supervision data acquisition component is used for acquiring state information of the shadow operation personnel;
The central command terminal generates panoramic monitoring event information according to the environment information transmitted by the operation terminal, the state information of the operation equipment and the state information of the personnel and the shadow operation personnel, and displays the panoramic monitoring event information on a display component of the central command terminal.
10. A signaling interaction method for a personnel floor operation command and monitor system according to any one of claims 1-9, comprising:
s1: the central command terminal is connected with the command reference database and generates an operation task according to the command reference database;
s2: the central command terminal establishes communication connection with a plurality of operation terminals through a weather private network and transmits operation tasks to the corresponding operation terminals;
s3: the operation terminal receives the operation task transmitted by the central command terminal, and executes the shadow ground operation according to the operation task;
s4: the operation terminal transmits the operation scene and operation data for executing the shadow ground operation to the central command terminal;
s5: the central command terminal displays the operation scene and the operation data, executes the operation command based on the operation scene and the operation data, and transmits the operation command data to the operation terminal;
S6: the operation terminal displays the operation command data and transmits the environment data and the supervision data of the operation area to the central command terminal;
s7: and the central command terminal displays the environmental data and the supervision data, and performs security monitoring based on the environmental data and the supervision data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410096250.3A CN117615158B (en) | 2024-01-24 | 2024-01-24 | Personnel ground operation command and monitoring system and signaling interaction method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410096250.3A CN117615158B (en) | 2024-01-24 | 2024-01-24 | Personnel ground operation command and monitoring system and signaling interaction method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117615158A true CN117615158A (en) | 2024-02-27 |
| CN117615158B CN117615158B (en) | 2024-03-26 |
Family
ID=89944705
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410096250.3A Active CN117615158B (en) | 2024-01-24 | 2024-01-24 | Personnel ground operation command and monitoring system and signaling interaction method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117615158B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050031109A1 (en) * | 2003-08-05 | 2005-02-10 | Fernandez Christopher Lawrence | Group communication system |
| US20060025165A1 (en) * | 2004-07-31 | 2006-02-02 | Nextel Communications, Inc. | Wireless communication system providing seamless switching between full-duplex and half-duplex modes |
| US20070239885A1 (en) * | 2006-04-07 | 2007-10-11 | Cisco Technology, Inc. | System and method for dynamically upgrading / downgrading a conference session |
| CN204409128U (en) * | 2014-12-25 | 2015-06-24 | 贵州省威宁彝族回族苗族自治县气象局 | Weather modification monitoring command and management application system |
| CN105721838A (en) * | 2016-04-27 | 2016-06-29 | 南京中网卫星通信股份有限公司 | Doppler human shadow monitoring and commanding system |
| CN106680899A (en) * | 2016-12-08 | 2017-05-17 | 深圳市元征科技股份有限公司 | Environment monitoring method and system based on vehicles |
| CN106971275A (en) * | 2017-04-01 | 2017-07-21 | 福建省气象科学研究所 | A kind of weather modification command system |
| CN108983314A (en) * | 2018-04-25 | 2018-12-11 | 成都润联科技开发有限公司 | A kind of Weather modification operation safety management application system and its working method |
| CN109194904A (en) * | 2018-10-25 | 2019-01-11 | 成都零壹众科技有限公司 | A kind of mobile video consultation system suitable for command scheduling business |
| WO2020119324A1 (en) * | 2018-12-10 | 2020-06-18 | 中兴通讯股份有限公司 | Cluster communication method, service platform, and storage medium |
| CN116455923A (en) * | 2022-09-28 | 2023-07-18 | 四川省天链星通科技有限公司 | Communication command and management system for artificial influence weather fusion |
-
2024
- 2024-01-24 CN CN202410096250.3A patent/CN117615158B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050031109A1 (en) * | 2003-08-05 | 2005-02-10 | Fernandez Christopher Lawrence | Group communication system |
| US20060025165A1 (en) * | 2004-07-31 | 2006-02-02 | Nextel Communications, Inc. | Wireless communication system providing seamless switching between full-duplex and half-duplex modes |
| US20070239885A1 (en) * | 2006-04-07 | 2007-10-11 | Cisco Technology, Inc. | System and method for dynamically upgrading / downgrading a conference session |
| CN204409128U (en) * | 2014-12-25 | 2015-06-24 | 贵州省威宁彝族回族苗族自治县气象局 | Weather modification monitoring command and management application system |
| CN105721838A (en) * | 2016-04-27 | 2016-06-29 | 南京中网卫星通信股份有限公司 | Doppler human shadow monitoring and commanding system |
| CN106680899A (en) * | 2016-12-08 | 2017-05-17 | 深圳市元征科技股份有限公司 | Environment monitoring method and system based on vehicles |
| CN106971275A (en) * | 2017-04-01 | 2017-07-21 | 福建省气象科学研究所 | A kind of weather modification command system |
| CN108983314A (en) * | 2018-04-25 | 2018-12-11 | 成都润联科技开发有限公司 | A kind of Weather modification operation safety management application system and its working method |
| CN109194904A (en) * | 2018-10-25 | 2019-01-11 | 成都零壹众科技有限公司 | A kind of mobile video consultation system suitable for command scheduling business |
| WO2020119324A1 (en) * | 2018-12-10 | 2020-06-18 | 中兴通讯股份有限公司 | Cluster communication method, service platform, and storage medium |
| CN116455923A (en) * | 2022-09-28 | 2023-07-18 | 四川省天链星通科技有限公司 | Communication command and management system for artificial influence weather fusion |
Non-Patent Citations (1)
| Title |
|---|
| 王丽;李云鹏;甄熙;: "浅析互联网大数据在气象行业的应用", 电脑知识与技术, no. 24, 17 September 2018 (2018-09-17) * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117615158B (en) | 2024-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110445773B (en) | Fire control commander regulation and control system based on thing networking | |
| US6466258B1 (en) | 911 real time information communication | |
| CN102469295B (en) | Conference control method, related equipment and system | |
| CN202773002U (en) | Integrated visualized command and dispatch platform | |
| CN106850768A (en) | A kind of system and method that audio/video linkage is realized based on fusion scheduling | |
| US11206372B1 (en) | Projection-type video conference system | |
| CN106656310A (en) | Method and system for unmanned aerial vehicles to execute tasks | |
| CN104410605A (en) | Scheduling terminal, scheduling console, scheduling method and communication scheduling command method | |
| CN113727320A (en) | Communication-converged emergency command scheduling system and method | |
| CN113489687B (en) | Audio and video information intercommunication method and client across multiple networks | |
| CN110417885A (en) | Flattening video directing and scheduling system and method based on wisdom police service | |
| CN102546976A (en) | Commanding/scheduling method based on video surveillance and device | |
| CN112008736A (en) | Welcome robot allocation method and device, storage medium and electronic device | |
| US11805202B2 (en) | Real-time crime center solution with dispatch directed digital media payloads | |
| CN113542101A (en) | Help seeking information sending and responding method, device and storage medium | |
| CN117615158B (en) | Personnel ground operation command and monitoring system and signaling interaction method | |
| CN112954254B (en) | Emergency command fusion communication platform | |
| CN107426065B (en) | Three-dimensional prevention and control system | |
| CN103986900A (en) | Combat instruction issuing method and device based on audio and video files, images and characters | |
| CN115209391B (en) | Network police management system capable of matching alarm matters with personnel | |
| CN116193062A (en) | Conference interconnection method and device, electronic equipment and storage medium | |
| US11587416B1 (en) | Dynamic video analytics rules based on human conversation | |
| CN112911212A (en) | Scenic spot command system and method based on big data processing | |
| CN113938636A (en) | Voice talkback method, device, storage medium and computer program product | |
| CN206533462U (en) | Emergent platform all-in-one |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |