CN114827553A - Video patrol control method, device, equipment and storage medium - Google Patents
Video patrol control method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN114827553A CN114827553A CN202210738590.2A CN202210738590A CN114827553A CN 114827553 A CN114827553 A CN 114827553A CN 202210738590 A CN202210738590 A CN 202210738590A CN 114827553 A CN114827553 A CN 114827553A
- Authority
- CN
- China
- Prior art keywords
- plan
- patrol
- instruction
- video
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The invention mainly relates to the technical field of safety monitoring, in particular to a video patrol control method, a device, equipment and a storage medium, wherein the video patrol control method comprises the following steps: receiving a video patrol instruction of a user, and determining a scene to be patrolled according to the video patrol instruction; searching a corresponding target patrol control plan from a plan list according to a scene to be patrolled and controlled; and controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan, obtaining a plan monitoring image, and displaying the plan monitoring image. According to the method and the device, the target patrol plan closest to the user requirement in the plan list is inquired by receiving the video patrol command of the user, and the corresponding image acquisition device is controlled to acquire the image of the scene to be monitored according to the target patrol plan, so that the user can quickly position the corresponding scene according to the patrol requirement to carry out video patrol, the polling is more targeted, and the user can conveniently check the required monitoring condition.
Description
Technical Field
The invention mainly relates to the technical field of safety monitoring, in particular to a video patrol control method, a device, equipment and a storage medium.
Background
At present, with social development, the flow of people in public places and key places is getting larger and larger, and accordingly, when major activities and guards occur and emergencies occur, the control difficulty of people is getting higher and higher, complete monitoring of key places is difficult to realize only by visual observation, and at the moment, video monitoring is needed to monitor and record places.
The existing video monitoring polling technology is that all videos are played in polling mode without being subdivided into certain scenes, the monitoring strength of key places or key positions of the scenes is not further improved, and the targeted monitoring of different scenes is lacked, so that emergency situations cannot be quickly positioned, and the user cannot conveniently position the needed monitoring live situations.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a video patrol control method, a video patrol control device, video patrol control equipment and a storage medium, and aims to solve the technical problem that the prior art lacks of targeted monitoring on different scenes.
In order to achieve the above object, the present invention provides a video patrol method, which comprises the following steps:
receiving a video patrol instruction of a user, and determining a scene to be patrolled according to the video patrol instruction;
searching a corresponding target patrol control plan from a plan list according to the scene to be patrolled and controlled;
and controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan, obtaining a plan monitoring image, and displaying the plan monitoring image.
Optionally, after searching for the corresponding target patrol control plan from the plan list according to the scene to be patrolled and controlled, the method further includes:
when the target patrol control plan is not found, according to plan parameters carried in the video patrol control instruction, performing parameter configuration on the initial patrol control plan to obtain a target patrol control plan, executing image acquisition by an image acquisition device at a preset position controlled according to the target patrol control plan to obtain a plan monitoring image, and displaying the plan monitoring image;
and the initial patrol control plan is the patrol control plan which is matched with the video patrol control instruction in the plan list to the highest degree.
Optionally, before the step of receiving a video patrol instruction of a user and determining a scene to be patrolled according to the video patrol instruction, the method includes:
when a plan configuration instruction is detected, displaying a default patrol plan;
receiving an editing instruction, and performing parameter configuration on the default patrol control plan according to the editing instruction to obtain a patrol control plan to be processed;
adding position information of different image acquisition devices in the patrol control plan to be processed to obtain a target patrol control plan;
and adding the target patrol plan into a plan list.
Optionally, the receiving an editing instruction, and performing parameter configuration on the default patrol control plan according to the editing instruction to obtain a to-be-processed patrol control plan includes:
receiving an editing instruction, and setting the classification of the default patrol control plan according to the editing instruction;
naming the classified default patrol control plan according to name data carried in the editing instruction to obtain a patrol control plan to be edited;
setting a sharing mode and a split screen mode of the patrol control plan to be edited according to the editing instruction to obtain a patrol control plan to be planned;
and selecting the monitoring resource of the patrol control plan to be planned according to the editing instruction, planning the monitoring path of the patrol control plan to be planned based on the selected monitoring resource, and generating the patrol control plan to be processed.
Optionally, the adding position information of different image acquisition devices to the to-be-processed patrol control plan to obtain the target patrol control plan includes:
receiving a first retrieval instruction, selecting a corresponding monitoring lens point position in a lens directory list according to the first retrieval instruction, and adding the monitoring lens point position to the patrol control plan to be processed to obtain the target patrol control plan;
or receiving a first retrieval instruction, and framing the monitoring lens point position in the GIS map according to the first retrieval instruction;
when the position information of the different image acquisition devices exists in the pre-arranged planning catalog, the lens monitoring point positions are omitted;
and when the position information of the different image acquisition devices does not exist in the plan arrangement catalog, adding the point position of the monitoring lens to the to-be-processed patrol plan to obtain the target patrol plan.
Optionally, the video patrol control instruction includes a voice control instruction, and the parameter configuration is performed on the initial patrol control plan according to a plan parameter carried in the video patrol control instruction, further including:
converting the voice control instruction into a character instruction through a natural language processing technology;
and when the preset instruction information contained in the character instruction is detected, carrying out parameter configuration on the initial patrol control plan according to the preset instruction information contained in the character instruction.
Optionally, the controlling, according to the target patrol control plan, an image acquisition device at a preset position to acquire an image, obtaining a plan monitoring image, and displaying the plan monitoring image includes:
controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan to obtain a plan monitoring image;
calling a corresponding historical plan monitoring image at the preset position;
adjusting a screen splitting mode and a sharing mode of the target patrol control plan according to the video patrol control instruction;
and displaying the plan monitoring image and the historical plan monitoring image based on the adjusted target patrol plan.
In addition, in order to achieve the above object, the present invention further provides a video patrol device, including: the instruction receiving module is used for receiving a video patrol instruction of a user and determining a scene to be patrolled according to the video patrol instruction;
the plan searching module is used for searching whether a corresponding target patrol control plan exists in a plan list according to the scene to be patrolled and controlled;
and the image display module is used for controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan, acquiring a plan monitoring image and displaying the plan monitoring image.
In addition, in order to achieve the above object, the present invention further provides a video patrol apparatus, including: a memory, a processor, and a video patrol program stored on the memory and executable on the processor, the video patrol program configured to implement the steps of the video patrol method as described above.
In addition, to achieve the above object, the present invention further provides a storage medium, which stores a video patrol program, and the video patrol program implements the steps of the video patrol method as described above when executed by a processor.
The invention mainly relates to the technical field of safety monitoring, in particular to a video patrol control method, a device, equipment and a storage medium, wherein the video patrol control method comprises the following steps: receiving a video patrol instruction of a user, and determining a scene to be patrolled according to the video patrol instruction; searching a corresponding target patrol control plan from a plan list according to the scene to be patrolled and controlled; and controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan, obtaining a plan monitoring image, and displaying the plan monitoring image. According to the method and the device, the target patrol control plan which is closest to the user requirement in the plan list is inquired by receiving the video patrol control instruction of the user, and the corresponding image acquisition device is controlled to acquire the image of the scene to be monitored according to the target patrol control plan, so that the user can quickly position the corresponding scene according to the patrol control requirement to perform video patrol control, the polling is more targeted, and the user can conveniently check the required monitoring situation.
Drawings
Fig. 1 is a schematic structural diagram of a video patrol device in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a first exemplary embodiment of a video patrol method according to the present invention;
FIG. 3 is another schematic flow chart of a first embodiment of a video patrol method according to the present invention;
FIG. 4 is a flowchart illustrating a second embodiment of a video patrol method according to the present invention;
FIG. 5 is a schematic flow chart illustrating a second embodiment of a video patrol method according to the present invention;
fig. 6 is a block diagram of a first embodiment of the video patrol device according to the present invention.
The implementation, functional features and advantages of the present invention will be further described with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a video patrol device in a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 1, the video patrol apparatus may include: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the video patrol device, and may include more or fewer components than those shown, or some components in combination, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a storage medium, may include therein an operating system, a network communication module, a user interface module, and a video patrol program.
In the video patrol device shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 of the video patrol apparatus according to the present invention may be provided in the video patrol apparatus, and the video patrol apparatus calls the video patrol program stored in the memory 1005 through the processor 1001 and executes the video patrol method provided by the embodiment of the present invention.
An embodiment of the present invention provides a video patrol method, and referring to fig. 2, fig. 2 is a schematic flow chart of a first embodiment of the video patrol method according to the present invention.
In this embodiment, the video patrol control method includes the following steps:
step S10: and receiving a video patrol instruction of a user, and determining a scene to be patrolled according to the video patrol instruction.
It should be noted that the execution main body of the embodiment may be an electronic device with data processing, network communication and program running functions, such as a mobile phone, a tablet computer, a personal computer, etc., or other electronic devices capable of implementing the same or similar functions, such as the above-mentioned video patrol device, which is not limited in this embodiment. The present embodiment and the following embodiments are specifically described below by taking the video patrol device as an example.
It should be understood that the video patrol instruction may include location information and time information of a target scene that a user needs to view, such as: three-dimensional coordinates of the target scene, monitoring time points of the target scene, and the like. The scene to be patrolled and controlled may be represented by the position information of the target scene, and may also be represented by the position information and the time information of the target scene, for example, the scene to be patrolled and controlled 1: [ longitude, latitude ], scene to be patrolled 2[ longitude, latitude, time information ].
In specific implementation, the video patrol control device may extract a three-dimensional coordinate of a target scene and a monitoring time point of the target scene in the video patrol control instruction, then determine a scene to be patrolled, which has the highest similarity to a requirement of a user, according to the three-dimensional coordinate of the target scene and the monitoring time point of the target scene, where the highest similarity is obtained by performing difference operation on a three-dimensional coordinate input by the user and a three-dimensional coordinate of a preset scene, and use the preset scene with the smallest variance according to the difference operation as the scene to be patrolled.
Step S20: and searching whether a corresponding target patrol control plan exists in a plan list according to the scene to be patrolled and controlled.
It should be understood that the plan list may be an excel document, each patrol control plan in the plan list corresponds to a serial number, each character in the serial number represents a feature of the plan corresponding to the serial number, when searching is performed, the feature of the plan corresponding to the serial number can be known by querying the serial number, for example, the serial number is a code composed of 10 character numbers or letters, the first 6 bits represent the position of the patrol control scene of the plan corresponding to the serial number, and the last four bits represent the time of the patrol control scene of the plan corresponding to the serial number.
In a specific implementation, the video patrol control device may retrieve each plan in a plan list, query whether each plan in the plan list includes the scene to be patrolled and controlled, and output a plan in the plan list, which can correspond to the position information and the time information of the scene to be patrolled and controlled, as a target patrol and control plan.
For example, a plan a, a plan B, and a plan C exist in the plan list, the three-dimensional positions of the preset scenes of the plan a coincide but the monitoring time points do not coincide, the monitoring time points of the preset scenes of the plan B coincide but the three-dimensional positions do not coincide, and both the three-dimensional positions of the preset scenes of the plan C and the monitoring time points coincide with the scene to be patrolled and controlled. At this time, the video patrol equipment outputs the schedule C as a target patrol schedule.
Step S30: and controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan, obtaining a plan monitoring image, and displaying the plan monitoring image.
It should be understood that the image acquisition device is a device capable of acquiring, storing and transmitting images, such as: a monitor probe, a mobile phone camera, a video recorder, etc., which are not limited in this embodiment.
It should be understood that the displaying the protocol monitoring image includes: when a plurality of image acquisition devices are arranged at the preset position, the situation that a plurality of paths exist in the preset scheme monitoring images is indicated, at this time, the preset scheme monitoring images can be displayed in a split screen/divided area mode, only one path of the preset scheme monitoring images can be displayed in a round-robin mode at each time, and the next path of the preset scheme monitoring images is automatically switched to be displayed after the preset duration (for example, 1 minute) is displayed.
In specific implementation, the video patrol control device can play and display the scheduled monitoring image through a display screen integrated with the video patrol control device or an external display screen, and can also play the scheduled monitoring image through devices with video playing functions such as mobile phones and computers.
The embodiment provides a video patrol control method, which comprises the steps of receiving a video patrol control instruction of a user, and determining a scene to be patrolled according to the video patrol control instruction; searching a corresponding target patrol control plan from a plan list according to the scene to be patrolled and controlled; and controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan, obtaining a plan monitoring image, and displaying the plan monitoring image. By classifying the video monitoring under the specific scene into the plan grouped playing, when a user calls a target patrol plan according to patrol needs, patrol control is carried out on the scene to be patrolled, the patrol playing video can be more targeted, and the user can conveniently locate the required monitoring live.
As shown in fig. 3, as another implementation manner, in order to implement comparative patrol of the to-be-patrolled scene in a current time and a past time, the step S30 in this embodiment further includes:
step S31: and controlling an image acquisition device at a preset position to acquire images according to the target patrol control plan to obtain a plan monitoring image.
As another implementation manner of step S31, the video patrol controlling apparatus may further control an image capturing device at a preset position to capture an image according to a polling rule set in a monitoring task corresponding to the target patrol plan. The control polling rule may include preset polling picture segmentation, polling interval, polling code stream type, and the like.
It should be understood that the round inspection mode of the present embodiment includes a combination round inspection and a time-sharing round inspection, and the combination round inspection includes: and in a plurality of groups selected, if the cameras in each group exceed a preset value, performing round-robin display on a fixed picture according to the time and strategy in the monitoring task.
For example, the preset number and the number of fixed frames may be any number greater than 1, for example, the preset number is 9, the number of fixed frames includes 1, 4, 6, 8, and 9, and the policy includes: the method comprises the steps of internal group wheel patrol priority, display picture fixation, display picture change along with actual picture change and the like. The time-sharing round patrol comprises: each round trip scenario is executed as a separate plan, for example: 9: 00 to 10: and 00, automatically triggering the round patrol plan to be executed when 9 points are reached, and finishing the round patrol when 10 points are reached.
Step S32: and calling a corresponding historical plan monitoring image at the preset position.
It should be noted that the preset position is a position of the image capture device included in the target patrol plan in the scene to be patrolled and controlled, and the preset position is already set before the plan is created, and is irrelevant to creation, modification and editing of the plan.
It should be understood that the above-mentioned historical plan monitoring image includes a pre-stored image acquisition record in the past period of the scene to be patrolled, for example, the current time is 9: 00, the scene to be patrolled and stored in the memory may be called 8: 00.
Step S33: and adjusting the split screen mode and the sharing mode of the target patrol control plan according to the video patrol control instruction.
It should be understood that the split-screen mode is a display mode of the image display apparatus, and includes that images captured by a plurality of image capturing devices are collected on a display screen of one image display apparatus for playing.
For example, 4, 6, 8, 9 images are stitched to obtain a complete picture, and if the number of actually acquired images is not 4, 6, 8, 9, a maximum value closest to the number of actually acquired images is selected as the number of split screens of the images, the actually acquired images are displayed in each split screen, and the split screens which cannot be displayed are displayed as black screens, for example: when 3 actually acquired images need to be displayed, selecting a four-split screen, displaying the actually acquired images by using first to third split screens of the four-split screen, and displaying the fourth split screen as a black screen.
It should be understood that the sharing mode includes sharing the image played by the image display device playing according to the current plan to the other image display device for playing, and by setting the sharing mode option in the plan, the sharing mode is turned on/off to allow/prohibit the other image display device from playing the actually captured image.
In a specific implementation, there is a judgment program in the target patrol control plan, and when the video patrol control instruction is received, the judgment program adjusts the split screen mode and the shared mode of the target patrol control plan according to a mode adjustment instruction in the video patrol control instruction, for example, a judgment value corresponding to the split screen mode in the mode adjustment instruction is X, a judgment value corresponding to the shared mode is Y, when the split screen mode and the shared mode need to be adjusted to be turned on, the judgment value X, Y is 1, and when the split screen mode and the shared mode need to be adjusted to be turned off, the judgment value X, Y is 0.
Step S34: and displaying the plan monitoring image and the historical plan monitoring image based on the adjusted target patrol plan.
It should be understood that, the predetermined plan monitoring image and the historical predetermined plan monitoring image may be displayed simultaneously, or may be displayed separately, and when the predetermined plan monitoring image and the historical predetermined plan monitoring image are displayed simultaneously, the predetermined plan monitoring image and the historical predetermined plan monitoring image are displayed in two adjacent split screens; and when the preset plan monitoring image and the historical preset plan monitoring image are displayed at intervals, the historical preset plan monitoring image is played again when the preset plan monitoring image is played.
As another embodiment, in order to ensure that the video patrol can be performed smoothly when the target patrol plan is found accurately from the plan list, after the step S20, the method further includes:
step S30': when the target patrol control plan is not found, according to plan parameters carried in the video patrol control instruction, performing parameter configuration on the initial patrol control plan to obtain a target patrol control plan, executing image acquisition by an image acquisition device at a preset position controlled according to the target patrol control plan to obtain a plan monitoring image, and displaying the plan monitoring image; and the initial patrol control plan is the patrol control plan which is matched with the video patrol control instruction in the plan list to the highest degree.
It should be understood that the initial patrol plan is a patrol plan in the plan list that matches the video patrol instruction most closely, and includes: and comparing parameters in the initial patrol control plan with parameters of the scene to be patrolled and controlled contained in the video patrol control instruction, for example, comparing the three-dimensional coordinates of the corresponding patrol control scene in the initial patrol control plan with the three-dimensional coordinates of the scene to be patrolled and controlled in the video patrol control instruction, wherein the smaller the distance of the three-dimensional coordinates in space, the highest matching degree of the three-dimensional coordinates is considered.
In a specific implementation, by searching the sequence number in the plan list, extracting the position information and the time information contained in the corresponding target patrol plan according to the characteristics represented by the sequence number, comparing the extracted position information and time information with the position information and time information in the video patrol command respectively, preferentially using the judgment of the position information as the judgment of the matching degree, considering that the matching degree of the two is higher as the spatial positions are closer, and when the judgment of the position information is consistent, that is, the position information of at least two patrol plans in the plan list is consistent, judging whether the patrol time in the patrol plans contains the time in the video patrol command as the matching degree, that is, when the patrol time in the patrol plans contains the time in the video patrol command, considering that the matching degree is high, and when the patrol time of at least two patrol plans comprises the time in the video patrol command, the shorter the patrol time of the patrol plans is, the higher the matching degree is.
In a specific implementation, the step of configuring the parameters of the initial patrol plan according to the plan parameters carried in the video patrol command includes: configuring the picture style, the corresponding view relation between the picture and the front-end equipment, and creating, editing, modifying, executing, pausing, manually turning pages, recovering and the like for the monitoring task so that a user can edit and store a plan at any time according to the actual working requirement.
As another embodiment, in order to make the plan editing simpler and more user-friendly, the step S30' further includes:
step S31': and converting the voice control instruction into a text instruction by a natural language processing technology.
It should be understood that the natural Language processing technology is nlp (natural Language processing) technology, and is used for realizing interaction between a person and a computer, and in this embodiment, the natural Language processing technology converts input voice information into a machine Language that can be recognized by a machine, so as to realize interaction between a person and a machine through voice input.
Step S32': and when the preset instruction information contained in the character instruction is detected, carrying out parameter configuration on the initial patrol control plan according to the preset instruction information contained in the character instruction.
It should be understood that the preset instruction information is an instruction for controlling the computer to edit the plan, including creating, editing, modifying, pausing, resuming, executing, and the like.
In concrete realization, the user types voice information into the video patrol control equipment through radio equipment, the voice input can be real-time, also can be through inputting the recording file, the video patrol control equipment is transferred to the word information through natural language processing technology, and then through retrieving the keyword in the word information, judge the connection mode of the keyword, confirm the preset instruction information in the voice information, input the video patrol control equipment, simultaneously generate the word instruction for the user to confirm, when the user confirms, the video patrol control equipment executes the control command in the voice information.
Referring to fig. 4, fig. 4 is a flowchart illustrating a video patrol method according to a second embodiment of the present invention.
Based on the first embodiment, in this embodiment, before the step S10, the method further includes:
step S00: and when a plan configuration instruction is detected, displaying a default patrol plan.
It should be understood that the plan configuration instruction includes an operation which can be recognized by a machine and has a tendency to perform a plan operation, and in an actual operation, the operation includes opening a plan editing page, selecting a plan editing template, and the like; the default patrol control plan is a plan editing template, and comprises setting options of plan parameters, adjustable options of plan modes and the like.
In a specific implementation, when a user opens a plan editing program, the video patrol control device displays the default patrol control plan on a display, receives a plan configuration instruction of the user, and the plan editing program performs parameter configuration on the default patrol control plan according to the plan configuration instruction. And the plan editing program is stored in the video patrol control equipment.
Step S01: and receiving an editing instruction, and performing parameter configuration on the default patrol control plan according to the editing instruction to obtain a patrol control plan to be processed.
It should be understood that the editing instruction may edit the default patrol control plan according to the manually input text information, or may be obtained by dragging an operation entry preset in the editing template, and when receiving a manual input, the input text is associated with the parameter of the default patrol control plan so as to change the parameter of the default patrol control plan, and when receiving an operation entry preset in the dragging, the parameter of the default patrol control plan is adjusted according to the content of the operation entry.
As another embodiment, in order to further refine the default patrol plan so that the user experience is better, as shown in fig. 5, step S01 described with reference to fig. 5 includes:
step S011: and receiving an editing instruction, and setting the classification of the default patrol control plan according to the editing instruction.
It should be understood that, the default patrol plan is selected according to the editing instruction, and the default patrol plan is hooked under a different plan directory according to the plan classification.
In specific implementation, if the default patrol plan 1 is selected as a patrol plan for the periphery of the location a, the default patrol plan 2 is selected as a patrol plan for the center of the location a, and the default patrol plan 3 is selected as a patrol plan for the center of the location B, the default patrol plan 1 and the default patrol plan 3 are classified into a class of patrol for the center, and the default patrol plan 1 and the default patrol plan 2 are classified into a class of patrol for the location a.
Step S012: and naming the classified default patrol control plan according to name data carried in the editing instruction to obtain the patrol control plan to be edited.
It should be understood that the name data may be a user's custom name, or may be a code name for machine identification, and when the custom name is received by the default patrol plan, the internal code is set according to the time when the name is created.
In specific implementation, when the storage operation is performed, the default patrol control plans are sorted according to the internal codes, and when the scheduling operation of the plans is performed, the corresponding default patrol control plans are scheduled through the internal codes.
Step S013: and setting the sharing mode and the split screen mode of the patrol control plan to be edited according to the editing instruction to obtain the patrol control plan to be planned.
It should be understood that, here, editing of the patrol plan sharing mode and the split screen mode is performed again, in the actual operation process, step S013 performs an initial value assigning operation on the setting values of the sharing mode and the split screen mode when creating the target patrol plan for the operator, and step S33 performs editing again on the sharing mode and the split screen mode according to the needs of the user when the user uses the patrol plan, so that the target patrol plan meets the use requirements of the user.
Step S014: and selecting the monitoring resource of the patrol control plan to be planned according to the editing instruction, planning the monitoring path of the patrol control plan to be planned based on the selected monitoring resource, and generating the patrol control plan to be processed.
It should be understood that the monitoring resource includes information of the number, position, etc. of the monitoring lenses.
It should be understood that, the planning of the monitoring path of the patrol plan to be planned based on the selected monitoring resource includes: and according to the position of the monitoring lens determined in the monitoring resource, taking any point as a starting point, taking the monitoring lens as No. 1, selecting another monitoring lens which is not selected and is closest to the monitoring lens as No. 2, and so on until all the selected lenses are numbered.
Step S02: and adding position information of different image acquisition devices in the to-be-processed patrol control plan to obtain a target patrol control plan.
As another embodiment, in order to improve the redundancy of the image capturing device added to the pre-pattern to be processed, the step S02 includes:
step S021: and receiving a first retrieval instruction, selecting a corresponding monitoring lens point position in a lens directory list according to the first retrieval instruction, and adding the monitoring lens point position to the to-be-processed patrol control plan to obtain the target patrol control plan.
It should be understood that the first retrieval instruction includes shot information required by a plan, a shot is retrieved from a shot directory according to the first retrieval instruction, the shot information includes a shot number, a shot name, and the like, a shot with the same shot number or shot name as a requirement is queried in the shot directory list through the shot information, and then a shot point is written in the patrol plan to be processed.
Step S021': and receiving a first retrieval instruction, and framing the monitoring lens point position in the GIS map according to the first retrieval instruction.
It is understood that the gis (geographic Information science) map is used for collecting, storing, managing, computing, analyzing, displaying and describing relevant geographic distribution data in the whole or part of the space of the earth's surface layer (including the atmosphere).
It should be understood that the framing of the shot points in the GIS map according to the first retrieval instruction includes: the user can use a mouse to select frames in the GIS map, or fingers can select frames on the GIS map on the touch screen.
Step S022': and when the position information of the different image acquisition devices exists in the pre-arranged list, the lens monitoring point positions are omitted.
When it needs to be understood, the plan arrangement directory may include a lens directory built in the plan, and may also include a planned path of the patrol point location, and the like.
It should be understood that, when the framing operation is performed on the map, the same target lens point location may be framed repeatedly for many times, and when a certain lens patrol point location already exists in the pre-arranged planning list, and the lens patrol point location is added again, it is easy to cause an error in path planning of the lens monitoring point location, and at this time, the lens monitoring point locations added for the second time and later are omitted, so as to avoid the occurrence of repeated lens monitoring point locations in the pre-arranged planning list.
Step S023': and when the position information of the different image acquisition devices does not exist in the plan arrangement catalog, adding the point position of the monitoring lens to the to-be-processed patrol plan to obtain the target patrol plan.
It should be understood that, in practical operation, when the position information of the different image capturing devices is selected by means of frame selection, it is easy to repeatedly capture the position information of the same image capturing device, and at this time, the position information of the image capturing device is omitted for the second time, so as to avoid the existence of two identical position information of the image capturing devices in the pre-arranged list.
Step S03: and adding the target patrol plan into a plan list.
It should be understood that at least one target patrol plan may be included in the plan list.
In a specific implementation, the target patrol control plan may be edited by a user or an operator in the background, when the target patrol control plan in the plan list exceeds a threshold of the number of plans, the target patrol control plan with the editing time being longest from the current time is deleted, the threshold of the number of plans may be set to any number greater than 1, and the number may be set according to the storage capacity of the memory in the video patrol control apparatus, so that the video patrol control apparatus can store all target patrol control plans below the threshold of the number of plans.
The embodiment provides a method for creating a patrol control plan, which includes editing a default patrol control plan according to a received instruction, converting the default patrol control plan into a target patrol control plan, and adding the target patrol control plan into a plan list, so that a user can set the plan in a personalized manner according to needs, and further, a patrol playing video is provided with targeted monitoring on key points, and the user can quickly locate a required monitoring scene.
In addition, an embodiment of the present invention further provides a storage medium, where a video patrol program is stored on the storage medium, and the video patrol program, when executed by a processor, implements the steps of the video patrol method described above.
Referring to fig. 6, fig. 6 is a block diagram of a first embodiment of the video patrol device according to the present invention;
as shown in fig. 6, the present embodiment further provides a video patrol device, where the video patrol device includes:
the instruction receiving module 601 is configured to receive a video patrol instruction of a user, and determine a scene to be patrolled according to the video patrol instruction;
a plan searching module 602, configured to search, according to the scene to be patrolled and controlled, whether a corresponding target patrol and control plan exists in a plan list;
and the image display module 603 is configured to control an image acquisition device at a preset position to acquire an image according to the target patrol control plan, obtain a plan monitoring image, and display the plan monitoring image.
The method comprises the steps of receiving a video patrol instruction of a user, and determining a scene to be patrolled according to the video patrol instruction; searching a corresponding target patrol control plan from a plan list according to the scene to be patrolled and controlled; and controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan, obtaining a plan monitoring image, and displaying the plan monitoring image. In the embodiment, the video monitoring under the specific scene is classified into the predetermined plan grouping playing, when the user calls the target patrol control predetermined plan according to patrol control requirements, patrol control is carried out on the scene to be patrolled, the patrol playing video can be more targeted, and the user can conveniently locate the required monitoring live.
Based on the first embodiment of the video patrol device of the present invention, a second embodiment of the video patrol device of the present invention is provided.
In this embodiment, the instruction receiving module 601 is further configured to display a default patrol plan when a plan configuration instruction is detected; receiving an editing instruction, and performing parameter configuration on the default patrol control plan according to the editing instruction to obtain a patrol control plan to be processed; adding position information of different image acquisition devices in the patrol control plan to be processed to obtain a target patrol control plan; and adding the target patrol plan into a plan list.
Further, the instruction receiving module 601 is further configured to receive an editing instruction, and set classification of the default patrol control plan according to the editing instruction; naming the classified default patrol control plan according to name data carried in the editing instruction to obtain a patrol control plan to be edited; setting a sharing mode and a split screen mode of the patrol control plan to be edited according to the editing instruction to obtain the patrol control plan to be planned; and selecting the monitoring resource of the patrol control plan to be planned according to the editing instruction, planning the monitoring path of the patrol control plan to be planned based on the selected monitoring resource, and generating the patrol control plan to be processed.
Further, the instruction receiving module 601 is further configured to receive a first retrieval instruction, select a corresponding monitoring lens point location in a lens directory list according to the first retrieval instruction, add the monitoring lens point location to the patrol control plan to be processed, and obtain the target patrol control plan; or receiving a first retrieval instruction, and framing a monitoring lens point position in the GIS map according to the first retrieval instruction; when the position information of the different image acquisition devices exists in the pre-arranged planning catalog, the lens monitoring point positions are omitted; and when the position information of the different image acquisition devices does not exist in the plan arrangement catalog, adding the point position of the monitoring lens to the patrol plan to be processed to obtain the target patrol plan.
Further, the image display module 603 is further configured to, when the target patrol control plan is not found, perform parameter configuration on the initial patrol control plan according to a plan parameter carried in the video patrol control instruction to obtain a target patrol control plan, perform image acquisition by using the image acquisition device at the preset position controlled according to the target patrol control plan to obtain a plan monitoring image, and display the plan monitoring image;
further, the image display module 603 is further configured to convert the voice control instruction into a text instruction through a natural language processing technology; and when the preset instruction information contained in the character instruction is detected, carrying out parameter configuration on the initial patrol control plan according to the preset instruction information contained in the character instruction. And the initial patrol control plan is a patrol control plan which is matched with the video patrol control instruction in the plan list to the highest degree.
Further, the image display module 603 is further configured to control an image acquisition device at a preset position to acquire an image according to the target patrol control plan, so as to obtain a plan monitoring image; calling a corresponding historical plan monitoring image at the preset position; adjusting a screen splitting mode and a sharing mode of the target patrol control plan according to the video patrol control instruction; and displaying the plan monitoring image and the historical plan monitoring image based on the adjusted target patrol plan.
Other embodiments or specific implementation manners of the video patrol control device of the present invention may refer to the above method embodiments, and are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., a rom/ram, a magnetic disk, an optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A video patrol control method is characterized by comprising the following steps:
receiving a video patrol instruction of a user, and determining a scene to be patrolled according to the video patrol instruction;
searching a corresponding target patrol control plan from a plan list according to the scene to be patrolled and controlled;
and controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan, obtaining a plan monitoring image, and displaying the plan monitoring image.
2. The video patrol method according to claim 1, wherein after searching for the corresponding target patrol plan from the plan list according to the scene to be patrolled, the method further comprises:
when the target patrol control plan is not found, according to a plan parameter carried in the video patrol control instruction, performing parameter configuration on an initial patrol control plan to obtain a target patrol control plan, executing image acquisition by an image acquisition device at a preset position according to the target patrol control plan to obtain a plan monitoring image, and displaying the plan monitoring image;
and the initial patrol control plan is the patrol control plan which is matched with the video patrol control instruction in the plan list to the highest degree.
3. The video patrol method according to claim 2, wherein the step of receiving the video patrol command of the user and determining the scene to be patrolled according to the video patrol command comprises:
when a plan configuration instruction is detected, displaying a default patrol plan;
receiving an editing instruction, and performing parameter configuration on the default patrol control plan according to the editing instruction to obtain a patrol control plan to be processed;
adding position information of different image acquisition devices in the patrol control plan to be processed to obtain a target patrol control plan;
and adding the target patrol plan into a plan list.
4. The video patrol method according to claim 3, wherein the receiving an edit instruction, and performing parameter configuration on the default patrol plan according to the edit instruction to obtain a patrol plan to be processed comprises:
receiving an editing instruction, and setting the classification of the default patrol control plan according to the editing instruction;
naming the classified default patrol control plan according to name data carried in the editing instruction to obtain a patrol control plan to be edited;
setting a sharing mode and a split screen mode of the patrol control plan to be edited according to the editing instruction to obtain the patrol control plan to be planned;
and selecting the monitoring resource of the patrol control plan to be planned according to the editing instruction, planning the monitoring path of the patrol control plan to be planned based on the selected monitoring resource, and generating the patrol control plan to be processed.
5. The video patrol method according to claim 3, wherein the adding position information of different image capture devices to the to-be-processed patrol plan to obtain the target patrol plan comprises:
receiving a first retrieval instruction, selecting a corresponding monitoring lens point position in a lens directory list according to the first retrieval instruction, and adding the monitoring lens point position to the patrol control plan to be processed to obtain the target patrol control plan;
or receiving a first retrieval instruction, and framing the monitoring lens point position in the GIS map according to the first retrieval instruction;
when the position information of the different image acquisition devices exists in the pre-arranged planning catalog, the lens monitoring point positions are omitted;
and when the position information of the different image acquisition devices does not exist in the plan arrangement catalog, adding the point position of the monitoring lens to the to-be-processed patrol plan to obtain the target patrol plan.
6. The video patrol method according to claim 2, wherein the video patrol command includes a voice control command, and the parameter configuration is performed on the initial patrol plan according to a plan parameter carried in the video patrol command, further comprising:
converting the voice control instruction into a character instruction through a natural language processing technology;
and when the preset instruction information contained in the character instruction is detected, carrying out parameter configuration on the initial patrol control plan according to the preset instruction information contained in the character instruction.
7. The video patrol method according to any one of claims 1 to 6, wherein the controlling, according to the target patrol plan, an image capturing device at a preset position to capture an image, obtaining a plan monitoring image, and displaying the plan monitoring image comprises:
controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan to obtain a plan monitoring image;
calling a corresponding historical plan monitoring image at the preset position;
adjusting a screen splitting mode and a sharing mode of the target patrol control plan according to the video patrol control instruction;
and displaying the plan monitoring image and the historical plan monitoring image based on the adjusted target patrol plan.
8. A video patrol device, the device comprising:
the instruction receiving module is used for receiving a video patrol instruction of a user and determining a scene to be patrolled according to the video patrol instruction;
the plan searching module is used for searching whether a corresponding target patrol control plan exists in a plan list according to the scene to be patrolled and controlled;
and the image display module is used for controlling an image acquisition device at a preset position to acquire an image according to the target patrol control plan, acquiring a plan monitoring image and displaying the plan monitoring image.
9. A video patrol apparatus, characterized in that the apparatus comprises: a memory, a processor, and a video patrol program stored on the memory and executable on the processor, the video patrol program configured to implement the steps of the video patrol method according to any one of claims 1 to 7.
10. A storage medium having a video patrol program stored thereon, wherein the video patrol program, when executed by a processor, implements the steps of the video patrol method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210738590.2A CN114827553B (en) | 2022-06-28 | 2022-06-28 | Video patrol control method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210738590.2A CN114827553B (en) | 2022-06-28 | 2022-06-28 | Video patrol control method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114827553A true CN114827553A (en) | 2022-07-29 |
| CN114827553B CN114827553B (en) | 2022-10-28 |
Family
ID=82522216
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210738590.2A Active CN114827553B (en) | 2022-06-28 | 2022-06-28 | Video patrol control method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114827553B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115439787A (en) * | 2022-09-07 | 2022-12-06 | 长扬科技(北京)股份有限公司 | AI visual detection method and device for grain depot, electronic equipment and storage medium |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080204552A1 (en) * | 2005-12-02 | 2008-08-28 | Wolfgang Niem | Device for monitoring with at least one video camera |
| CN102724224A (en) * | 2011-03-30 | 2012-10-10 | 上海炎翔通信科技有限公司 | Global eye network video monitoring system and realization method thereof |
| CN103338392A (en) * | 2013-06-14 | 2013-10-02 | 福建星网锐捷安防科技有限公司 | Method for seamless switching of images in video polling |
| US20140129274A1 (en) * | 2012-11-07 | 2014-05-08 | Position Logic Llc | Security escort assignment and monitoring system and method |
| CN204375021U (en) * | 2014-12-18 | 2015-06-03 | 湖南泰达讯科技有限公司 | A kind of indoor intelligent inspection device |
| CN108174160A (en) * | 2018-01-04 | 2018-06-15 | 上海电气集团股份有限公司 | A kind of more split screen taking turn methods of monitor video |
| CN108345829A (en) * | 2017-12-18 | 2018-07-31 | 武汉烽火众智数字技术有限责任公司 | Remote monitoring goes on patrol the device at scene in the street |
| CN110740295A (en) * | 2019-09-30 | 2020-01-31 | 视联动力信息技术股份有限公司 | Method and device for polling and playing video streams monitored by video network |
| CN110876037A (en) * | 2018-08-31 | 2020-03-10 | 杭州海康威视系统技术有限公司 | Inspection method, device, equipment and system |
| CN112437264A (en) * | 2020-11-12 | 2021-03-02 | 珠海大横琴科技发展有限公司 | Monitoring video processing method and device |
| CN112468776A (en) * | 2020-11-19 | 2021-03-09 | 青岛海尔科技有限公司 | Video monitoring processing method and device, storage medium and electronic device |
| CN112738477A (en) * | 2020-12-30 | 2021-04-30 | 珠海大横琴科技发展有限公司 | Security monitoring system |
| CN112907777A (en) * | 2021-01-18 | 2021-06-04 | 厦门熵基科技有限公司 | Patrol method, device and equipment based on video |
-
2022
- 2022-06-28 CN CN202210738590.2A patent/CN114827553B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080204552A1 (en) * | 2005-12-02 | 2008-08-28 | Wolfgang Niem | Device for monitoring with at least one video camera |
| CN102724224A (en) * | 2011-03-30 | 2012-10-10 | 上海炎翔通信科技有限公司 | Global eye network video monitoring system and realization method thereof |
| US20140129274A1 (en) * | 2012-11-07 | 2014-05-08 | Position Logic Llc | Security escort assignment and monitoring system and method |
| CN103338392A (en) * | 2013-06-14 | 2013-10-02 | 福建星网锐捷安防科技有限公司 | Method for seamless switching of images in video polling |
| CN204375021U (en) * | 2014-12-18 | 2015-06-03 | 湖南泰达讯科技有限公司 | A kind of indoor intelligent inspection device |
| CN108345829A (en) * | 2017-12-18 | 2018-07-31 | 武汉烽火众智数字技术有限责任公司 | Remote monitoring goes on patrol the device at scene in the street |
| CN108174160A (en) * | 2018-01-04 | 2018-06-15 | 上海电气集团股份有限公司 | A kind of more split screen taking turn methods of monitor video |
| CN110876037A (en) * | 2018-08-31 | 2020-03-10 | 杭州海康威视系统技术有限公司 | Inspection method, device, equipment and system |
| CN110740295A (en) * | 2019-09-30 | 2020-01-31 | 视联动力信息技术股份有限公司 | Method and device for polling and playing video streams monitored by video network |
| CN112437264A (en) * | 2020-11-12 | 2021-03-02 | 珠海大横琴科技发展有限公司 | Monitoring video processing method and device |
| CN112468776A (en) * | 2020-11-19 | 2021-03-09 | 青岛海尔科技有限公司 | Video monitoring processing method and device, storage medium and electronic device |
| CN112738477A (en) * | 2020-12-30 | 2021-04-30 | 珠海大横琴科技发展有限公司 | Security monitoring system |
| CN112907777A (en) * | 2021-01-18 | 2021-06-04 | 厦门熵基科技有限公司 | Patrol method, device and equipment based on video |
Non-Patent Citations (1)
| Title |
|---|
| 梁必翔: ""工务巡道管理系统建设的实践及应用 "", 《湖南科技学院学报》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115439787A (en) * | 2022-09-07 | 2022-12-06 | 长扬科技(北京)股份有限公司 | AI visual detection method and device for grain depot, electronic equipment and storage medium |
| CN115439787B (en) * | 2022-09-07 | 2023-08-04 | 长扬科技(北京)股份有限公司 | AI visual detection method and device for grain depot, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114827553B (en) | 2022-10-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107481327B (en) | About the processing method of augmented reality scene, device, terminal device and system | |
| CN110147471A (en) | Trace tracking method, device, computer equipment and storage medium based on video | |
| JP4810420B2 (en) | Image processing apparatus, image processing method, server, control method therefor, program, and storage medium | |
| JP5662670B2 (en) | Image processing apparatus, image processing method, and program | |
| CN105323473A (en) | Method, device and system for modifying image including photographing restricted element | |
| BR112012002919A2 (en) | linked metadata identification system, image search method, and device | |
| CN107871001B (en) | Audio playing method and device, storage medium and electronic equipment | |
| JP2003150932A (en) | Image processing unit and program | |
| TWI586160B (en) | Real time object scanning using a mobile phone and cloud-based visual search engine | |
| US10971152B2 (en) | Imaging control method and apparatus, control device, and imaging device | |
| CN107038462B (en) | Equipment control operation method and system | |
| CN114827553B (en) | Video patrol control method, device, equipment and storage medium | |
| CN111881740A (en) | Face recognition method, face recognition device, electronic equipment and medium | |
| JP2003150617A (en) | Image processor and program | |
| CN108419112B (en) | Streaming media video cataloging method, retrieval method and device based on measurement and control track information | |
| EP3929804A1 (en) | Method and device for identifying face, computer program, and computer-readable storage medium | |
| JP7271327B2 (en) | Generation device, generation system, generation method, and method for generating teaching material data | |
| JP4867295B2 (en) | Image management apparatus and image management program | |
| CN109816986A (en) | The mobile communications device and method of user's director information of vehicle part are provided | |
| CN111259198A (en) | Management method and device for shot materials and electronic equipment | |
| CN107016351A (en) | Shoot the acquisition methods and device of tutorial message | |
| CN108320075A (en) | A kind of visualized presence monitoring system and method having photo management function | |
| JP2007108989A (en) | Information processing system and information processing method | |
| CN114037889A (en) | Image identification method and device, electronic equipment and storage medium | |
| CN113454634A (en) | Information processing system, information processing apparatus, information processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |