CN110191324A - Image processing method, device, server and storage medium - Google Patents
Image processing method, device, server and storage medium Download PDFInfo
- Publication number
- CN110191324A CN110191324A CN201910579253.1A CN201910579253A CN110191324A CN 110191324 A CN110191324 A CN 110191324A CN 201910579253 A CN201910579253 A CN 201910579253A CN 110191324 A CN110191324 A CN 110191324A
- Authority
- CN
- China
- Prior art keywords
- image
- shooting
- group
- image group
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Abstract
This application discloses a kind of image processing method, device, server and storage medium, which is applied to server, which includes: the shooting image for obtaining multiple cameras;Obtain multiple cameras shooting image in exist at least one preset mobile object shooting image;The shooting image that mobile object will be present is grouped according to different default mobile objects, obtains multiple first image groups;Setting content present in the shooting image of each first image group is removed, multiple second image groups are obtained;According to the shooting time sequencing of shooting image, the shooting image of the second image group each in multiple second image groups is subjected to splicing synthesis, obtains the corresponding video file of multiple default mobile objects.Motion video when default mobile object moves in multiple ranges can be generated in this method.
Description
Technical field
This application involves technique for taking fields, more particularly, to a kind of image processing method, device, server and deposit
Storage media.
Background technique
Currently, being widely used in daily life with technique for taking, demand of the people to video capture is more and more.
For example, more and more places start to arrange monitoring system, state and the personage in some region are monitored by using camera
Activity etc..But since the shooting area of camera is limited, i.e., visible angle is limited, camera can only often fix some
Region shot, therefore the content taken is limited.
Summary of the invention
It in view of the above problems, can be with present applicant proposes a kind of image processing method, device, server and storage medium
It realizes and obtains to same mobile object in a wide range of interior monitor video.
In a first aspect, the embodiment of the present application provides a kind of image processing method, be applied to server, the server with
Multiple camera communication connections, the multiple camera are distributed in different location, two neighboring camera shooting in the multiple camera
The shooting area of head is adjacent or presence partially overlaps, which comprises obtains the shooting image of the multiple camera;It obtains
Take the multiple camera shooting image in exist at least one preset mobile object shooting image;There is movement for described
The shooting image of object is grouped according to different default mobile objects, obtains multiple first image groups, the first image
Group is the set of the shooting image comprising same default mobile object, and the corresponding default mobile object of each first image group is not
Together;Setting content present in the shooting image of each the first image group is removed, multiple second image groups are obtained;According to bat
The shooting time sequencing for taking the photograph image spells the shooting image of the second image group each in the multiple second image group
It is bonded into, obtains the corresponding video file of multiple default mobile objects.
Second aspect, the embodiment of the present application provide a kind of picture processing unit, be applied to server, the server with
Multiple camera communication connections, the multiple camera are distributed in different location, two neighboring camera shooting in the multiple camera
The shooting area of head is adjacent or in the presence of partially overlapping, and described device includes: the first image collection module, the second image acquisition mould
Block, image grouping module, content removal module and Video Composition module, wherein the first image obtains module for obtaining
Take the shooting image of the multiple camera;Second image collection module is used to obtain the shooting figure of the multiple camera
There are the shooting images of at least one default mobile object as in;Described image grouping module is used for that there are mobile objects by described
Shooting image be grouped according to different default mobile objects, obtain multiple first image groups, the first image group is
The set of shooting image comprising same default mobile object;The content removal module is for removing each the first image
Setting content present in the shooting image of group, obtains multiple second image groups;The Video Composition module is used for according to shooting
The shooting time sequencing of image splices the shooting image of the second image group each in the multiple second image group
Synthesis, obtains the corresponding video file of multiple default mobile objects.
The third aspect, the embodiment of the present application provide a kind of server, comprising: one or more processors;Memory;One
A or multiple application programs, wherein one or more of application programs are stored in the memory and are configured as by institute
One or more processors execution is stated, one or more of programs are configured to carry out at the image that above-mentioned first aspect provides
Reason method.
Fourth aspect, the embodiment of the present application provides a kind of computer-readable storage medium, described computer-readable
Program code is stored in storage medium, said program code can be called the image for executing above-mentioned first aspect and providing by processor
Processing method.
Scheme provided by the present application is applied to server, and server and multiple cameras communicate to connect, multiple cameras point
It is distributed in different location, the shooting area of two neighboring camera is adjacent in multiple cameras or presence partially overlaps.By obtaining
The shooting image for taking multiple cameras, obtain multiple cameras shooting image in exist at least one preset mobile object bat
Image is taken the photograph, the shooting image that mobile object will be present is grouped according to different default mobile objects, obtains multiple first figures
As group, wherein the first image group is the set of the shooting image comprising same default mobile object, and each first image group is corresponding
Default mobile object it is different, then remove setting content present in the shooting image of each first image group, obtain multiple
Second image group, according to the shooting time sequencing of shooting image, by the second image group each in multiple second image groups
Shooting image carries out splicing synthesis, obtains the corresponding video file of multiple default mobile objects, to realize to default movement pair
As the shooting image in multiple shooting areas carries out splicing synthesis, obtain what default mobile object was taken in multiple shooting areas
Complete monitor video improves monitoring effect, and the setting content in video file is removed, avoid setting content to
The interference at family individually checks the shooting image of each shooting area without user, prompts user experience.
Detailed description of the invention
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application, for
For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 shows the schematic diagram of distributed system provided by the embodiments of the present application.
Fig. 2 shows the image processing method flow charts according to the application one embodiment.
Fig. 3 shows the grouping schematic diagram of the image grouping provided according to the application one embodiment.
Fig. 4 shows the image processing method flow chart according to another embodiment of the application.
Fig. 5 shows the image processing method flow chart according to another embodiment of the application.
Fig. 6 shows the image processing method flow chart according to the application further embodiment
Fig. 7 shows a kind of block diagram of the image processing apparatus according to the application one embodiment.
Fig. 8 shows a kind of block diagram of content removal module in the image processing apparatus according to the application one embodiment.
Fig. 9 shows another frame of content removal module in the image processing apparatus according to the application one embodiment
Figure.
Figure 10 is the embodiment of the present application for executing the server of the image processing method according to the embodiment of the present application
Block diagram.
Figure 11 is the embodiment of the present application for saving or carrying the image processing method realized according to the embodiment of the present application
The storage unit of the program code of method.
Specific embodiment
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application
Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described.
With the development of society and the progress of science and technology, more and more places start to arrange monitoring system, and are passing through
In most application scenarios that monitoring system is monitored, used camera often can only all be carried out the region that some is fixed
Monitoring.In this case, it can be only formed the video to single area monitoring, user is in the video for needing to check multiple regions monitoring
When, can only the monitor video respectively to each region check.To solve the above problems, having risen panoramic video prison in the market
Control system, overall view monitoring system are synthesized using the camera shooting image for being set to different location, and by these shooting images
Panoramic picture, but range acquired in panoramic picture is excessive, can not be monitored for some object, user is needing to check
When the monitor video of some object, the overall view monitoring video that checking monitoring content is more is needed, causes user experience bad.
In view of the above-mentioned problems, inventor has found by long-term research and proposes at image provided by the embodiments of the present application
Method, apparatus, server and storage medium are managed, is monitored shooting by multiple cameras for being distributed in different location, so
Be grouped afterwards according to shooting image of the different mobile objects to multiple cameras, the shooting image in grouping is set in
After the removal of appearance, splicing synthesis is carried out according to the shooting image in grouping, forms the corresponding video file of different mobile objects, and
And setting content is eliminated in video file, it is possible to reduce interference of the setting content to user facilitates user to check.Wherein, have
The image processing method of body is described in detail in subsequent embodiment.
It will be described below for the distributed system suitable for image processing method provided by the embodiments of the present application.
Referring to Fig. 1, Fig. 1 shows the schematic diagram of distributed system provided by the embodiments of the present application, wherein the distribution
System includes server 100 and multiple cameras 200 (quantity of camera 200 shown in Fig. 1 is 4), wherein server 100
It is connected respectively with each camera 200 in multiple cameras 200, for carrying out data interaction with each camera 200 respectively,
For example, server 100, which receives the image of the transmission of camera 200, server 100, sends instruction etc. to camera 200, do not do herein
It is specific to limit.In addition, the server 100 can be Cloud Server, or traditional server, the camera 200 can be with
For gun-type camera, hemisphere camera, high-definition intelligent spherical shape camera, pen holder type camera, veneer camera, flying saucer camera shooting
Head, Mobile phone type camera etc., and the camera lens of the camera can use wide-angle lens, standard lens, telephoto lens, varifocal mirror
Head, pin hole mirror head etc., do not do specific restriction herein.
In some embodiments, different positions is arranged in for shooting different regions in multiple cameras 200, and more
The shooting area of every two adjacent camera 200 in a camera 200 is adjacent or partially overlaps.It is understood that every
A camera 200 can correspond to according to the difference of its field angle and setting position and shoot different regions, by the way that every two is arranged
The shooting area of adjacent camera 200 is adjacent or partially overlaps, and the region that distributed system can be made to be shot is covered entirely
Lid.Wherein, multiple cameras 200 can be spaced along a length direction is arranged side by side, for shooting the length direction region
Image, multiple cameras 200 can also be spaced setting along a circumferential direction, for shooting the figure in the annular region
Picture, certainly, multiple cameras 200 can also include other set-up modes, herein not as restriction.
Referring to Fig. 2, the flow diagram of the image processing method provided Fig. 2 shows the application one embodiment.Institute
Image processing method is stated for being monitored shooting by multiple cameras for being distributed in different location, then according to different movements
Object is grouped the shooting image of multiple cameras, after the removal that setting content is carried out to the shooting image in grouping, root
Splicing synthesis is carried out according to the shooting image in grouping, forms the corresponding video file of different mobile objects, and in video file
Eliminate setting content, it is possible to reduce interference of the setting content to user facilitates user to check.In the particular embodiment, institute
Image processing method is stated applied to image processing apparatus 400 as shown in Figure 7 and configured with described image processing unit 400
Server 100 (Figure 10).It will illustrate the detailed process of the present embodiment by taking server as an example below, it will of course be understood that, this
Server applied by embodiment can be Cloud Server, or traditional server, it is not limited here.It should be taken the photograph with multiple
As head communication connection, the multiple camera is distributed in different location, the bat of two neighboring camera in the multiple camera
It takes the photograph area adjacency or exists and partially overlap.It will be explained in detail below for process shown in Fig. 2, shown image procossing
Method can specifically include following steps:
Step S110: the shooting image of the multiple camera is obtained.
In the embodiment of the present application, the multiple cameras for being distributed in different location can shoot its shooting area,
Each camera can shoot to obtain the shooting image of corresponding shooting area.The shooting figure that multiple cameras can will take
As being uploaded to server, server can receive the shooting image of multiple camera shooting overhead pass.Since multiple cameras are distributed in
Different location, and the shooting area adjoining or presence of two neighboring camera partially overlap, so that server is available
To the shooting image of different shooting areas, and these shooting areas may be constructed a complete region, that is to say, that service
The shooting image of device available to one large-scale complete area.The mode for imaging overhead pass shooting figure picture can be not as
It limits, for example, it may be being uploaded to shooting image according to setting interval duration.
In some embodiments, each camera can be in open state in multiple cameras, so as to right
Entire shooting area corresponding to multiple cameras is shot, wherein each camera can set in multiple cameras
Period is constantly in open state.Certainly, each camera in multiple cameras can also be according to the control received
System instruction, in the open state or closed state, control instruction may include that the server connecting with camera is sent automatically
Instruction, electronic equipment are sent to the instruction of camera, instruction that user generates in camera triggering etc. by server, herein not
It limits.
Step S120: obtain the multiple camera shooting image in exist at least one preset mobile object shooting
Image.
In the present embodiment, server, can be from multiple cameras after getting the shooting image of multiple cameras
It shoots and determines that there are the shooting images of at least one default mobile object in image.Wherein, server can be from multiple cameras
The shooting image that there is default mobile object is determined in the shooting image uploaded at present, can also be from camera in current time
The shooting image uploaded in preceding set period of time.Default mobile object can be preset mobile object, and mobile object can be with people
The transportable object such as object, animal, vehicle.
In some embodiments, the image that server can take each camera identifies, takes the photograph from each
In the image taken as head, the shooting image including at least one default mobile object is extracted.
In some embodiments, the information of multiple default mobile objects, server can be previously stored in server
It can be from the local information for reading pre-stored multiple default mobile objects, wherein the information of default mobile object can wrap
Image, the characteristic information of default mobile object etc. for including default mobile object, are not limited thereto.In other embodiments
In, the information of multiple default mobile objects can also be sent to server by the electronic equipment of user, so as to according to user
Demand and choose the shooting image in the presence of default mobile object.
In some embodiments, server can use the information of multiple default mobile objects, to multiple cameras
Shooting image is identified, to determine that the shooting image including at least one default mobile object can be extracted in all images.
It is understood that there may also be multiple pre- there may be at least one default mobile object in the shooting image determined
If mobile object, it is not limited here.
As an alternative embodiment, the information of default mobile object includes the image of multiple default mobile objects.
The each shooting image and default mobile object that server can will acquire after getting the shooting image of multiple cameras
Image matched, the content of the images match of mobile object is preset with any one if existed in shooting image, really
Surely it shoots in image and there is default mobile object.So as to determine exist from all shooting images of multiple cameras
The shooting image of at least one default mobile object.
Certainly, specifically there are the shooting figures of at least one default mobile object for acquisition from the shooting image of multiple cameras
The mode of picture can be not as restriction.
Step S130: the shooting image there are mobile object is grouped according to different default mobile objects,
Multiple first image groups are obtained, the first image group is the set of the shooting image comprising same default mobile object, each
The corresponding default mobile object of first image group is different.
Server is being got there are after the shooting image of at least one default mobile object, can be according to different default shiftings
The shooting image of multiple cameras is grouped by dynamic object in real time, obtains multiple first image groups, multiple first image groups and
Multiple default mobile objects correspond, i.e., each first image group corresponds to different default mobile objects.To which server can
To obtain all shooting images that default mobile object is photographed.It should be understood that since there may be more in shooting image
A default mobile object, it is thus possible to which there are identical mobile objects in the shooting image of different first image groups.
For example, referring to Fig. 3, default mobile object includes target 1 and target 2, and target 1, target 2, target 3 are in difference
When moving in camera shooting head region, the camera of corresponding region is shot, and to target 1 and the corresponding shooting image of target 2
It is grouped, so as to obtain the corresponding image group of target 1 and the corresponding image group of target 2.
Step S140: removing setting content present in the shooting image of each the first image group, obtains multiple
Two image groups.
In the embodiment of the present application, server, can be to multiple first image groups after obtaining multiple first image groups
In each first image group shooting image, carry out the removal of setting content.Wherein, setting content can check user for meeting
The content of interference is generated when the video file of default mobile object, setting content may include target person, target piece, target
The contents such as background, setting content can be stored by server local, can also be set by the user, it is not limited here.
In some embodiments, server is in setting present in the shooting image for removing each first image group
Rong Shi can carry out the identification of setting content, if shooting image exists in setting to every shooting image in the first image group
Hold, is then removed the setting content shot in image, so that server is somebody's turn to do in every image to the first image group
After operation, then it may be implemented to remove setting content present in the shooting image of each first image group.Wherein, server can be with
According to the characteristic information of setting content, picture material etc., setting content is identified, it is not limited here.
It in some embodiments, may include: to cut in shooting image to the removal of setting content in shooting image
Setting content or blurring setting content.Being blurred setting content can be clarity, the brightness etc. of reduction setting content,
This is without limitation.
After server setting content present in the shooting image to each first image group is removed, it can will go
Except multiple first image groups after setting content are as multiple second image groups.
Step S150: according to the shooting time sequencing of shooting image, by the multiple second image group each the
The shooting image of two image groups carries out splicing synthesis, obtains the corresponding video file of multiple default mobile objects.
In the embodiment of the present application, server is after obtaining the default corresponding second image group of mobile object, can be according to
The shooting time sequencing for shooting image, carries out splicing conjunction for the shooting image of the second image group each in multiple images group
At obtaining the corresponding video file of multiple default mobile objects, wherein multiple second image groups and multiple default mobile objects one
One is corresponding.
In some embodiments, server can obtain shooting image in the file information according to the shooting image of storage
Shooting time.Wherein, camera can be retouched when uploading shooting image using shooting time as one of them of shooting image
State information and be sent to server, thus server receive shooting image when, also it is available shooting image shooting time.
Certainly, the mode that server obtains the shooting time of shooting image can be not as restriction, and for example, it can be servers from taking the photograph
As head searches the shooting time of shooting image.
In some embodiments, server can be directed to each second image group, by the institute in each second image group
There is the shooting time of shooting image to carry out the sequence after arriving first, obtains the sequencing of shooting time.Further according to sequencing,
Splicing synthesis is carried out to all shooting images of each second image group, obtains the corresponding default movement pair of each second image group
The video file of elephant.That is, the every frame image shot in image construction video file in the second image group, and every frame
Sequencing of the image in video file is identical as the sequencing of shooting time.
In some embodiments, which can also be sent to electronic equipment or third-party platform by server
(such as APP, webpage mailbox), to facilitate user to check and download, so that user can be directly viewable about default movement pair
The video that the shooting image of elephant is constituted.
In addition, the time is needed since default mobile object is moved to another shooting area from a shooting area,
Different cameras can successively take default mobile object, cause the shooting time for shooting image to have sequencing, to take
Device be engaged according to the sequencing of shooting time, splices and can reflect default mobile object in the video of synthesis in multiple camera structures
At shooting area in action trail.And since the shooting area of two neighboring camera in multiple cameras is adjacent or
In the presence of partially overlapping, so that the shooting area that multiple cameras are constituted is a complete region, therefore splice the video text of synthesis
Part can reflect default mobile object in the activity change of a biggish region content.
Image processing method provided by the embodiments of the present application, the bat that multiple cameras by being distributed in different location are shot
Image is taken the photograph, selects that there are the shooting images that at least one presets mobile object from the shooting image of multiple cameras, then
The shooting image of selection is grouped according to difference default mobile object, setting content is carried out to the shooting image in grouping
After removal, splicing synthesis is carried out according to the shooting image in grouping, the corresponding video file of different mobile objects is formed, improves
Monitoring effect, and the setting content in video file is removed, and interference of the setting content to user is avoided, without user
Individually the shooting image of each shooting area is checked, prompts user experience.
Referring to Fig. 4, Fig. 4 shows the flow diagram of the image processing method of another embodiment of the application offer.
This method is applied to above-mentioned server, and the server and multiple cameras communicate to connect, and the multiple camera is distributed in difference
Position, the shooting area of two neighboring camera is adjacent in the multiple camera or exists and partially overlaps.It will be directed to below
Process shown in Fig. 4 is explained in detail, and shown image processing method can specifically include following steps:
Step S210: the shooting image of the multiple camera is obtained.
Step S220: obtain the multiple camera shooting image in exist at least one preset mobile object shooting
Image.
In the embodiment of the present application, user can send the default movement pair for needing to check to server by electronic equipment
The characteristic information of elephant identifies that there are institutes in the shooting image of the multiple camera so that server is according to the characteristic information
State the shooting image of at least one default mobile object.Wherein, the characteristic information of the default mobile object can characterize default shifting
The surface of dynamic object.
In some embodiments, presetting mobile object is when presetting personage, and the characteristic information of default personage may include
Facial image wears feature, physical characteristic, gait feature etc., and the characteristic information of specific default personage can be not as restriction.In advance
If mobile object is default animal, the characteristic information of default animal may include fur feature, be characterized by, and not make herein
To limit.When default mobile object is preset vehicle, the characteristic information of preset vehicle may include license board information, vehicle color information,
Vehicle model information etc., herein not as restriction.
In some embodiments, server can receive the characteristic information of the default mobile object of electronic equipment transmission,
To be chosen from the shooting image of multiple cameras according to the characteristic information for presetting mobile object, there are at least one default shiftings
The shooting image of dynamic object, thus the video file for the default mobile object that user can check according to its demand, to server
Send the characteristic information of default mobile object.
Server, then can be according to feature after receiving the characteristic information of default mobile object of electronic equipment transmission
Information identifies that there are the photographing informations of at least one default mobile object in the shooting of multiple cameras.In some embodiments
In, when shooting in image in the presence of content matched with the characteristic information of default mobile object, then can determine in shooting image
There are the shooting images of default mobile object.
In some embodiments, default mobile object may include default personage, and characteristic information may include default people
The facial image of object.Server identifies in the shooting image of the multiple camera described in existing extremely according to the characteristic information
The shooting image of a few default mobile object, may include: to determine exist from the shooting image of the multiple camera
The first shooting image of personage;According to the facial image, is identified from the first shooting image and include and the face
The shooting image of the content of images match, obtains in the shooting image of the multiple camera that there are the shootings of the default personage
Image.
Server determines the shooting image that there is default mobile object in the shooting image of multiple cameras from acquisition
When, it can first determine that there are the first of personage to shoot image from the shooting image of multiple cameras.
In some embodiments, server can identify shooting image according to the barment tag (such as figure etc.) of people
In whether there is personage.As an alternative embodiment, for determining in shooting image with the presence or absence of the external special of personage
Sign can be the barment tag in addition to facial image, it is possible to understand that, when whether there is personage in shooting image due to determining,
Without being determined according to facial image, so as to promote the efficiency determined when shooting image there are the first of personage.Certainly,
Specific barment tag can be not as restriction.
Server is being got there are after the shooting image of the first of personage, then can identify packet from the first shooting image
Shooting image containing the matched content of facial image for presetting personage at least one.Wherein, to every first shooting image into
The identification of the facial image of the default personage of row, if there is at least one facial image for presetting personage in the first shooting image,
Then determine that there are at least one default personages in the first shooting image, it is default if there is no any one in the first shooting image
The facial image of personage, it is determined that there is no default personages in the first shooting image.
To which server can be identified from the first shooting image comprising default people according to the facial image of default personage
The shooting image of object.Due to server be from multiple cameras shooting image in choose there are personage first shooting image it
Afterwards, further according to the facial image of default personage, the shooting image that there is default personage is determined from the first shooting image, so that clothes
Business device is not necessarily to carrying out all shooting images into the content recognition of facial image, can promote the treatment effeciency of server.
Step S230: the shooting image there are mobile object is grouped according to different default mobile objects,
Multiple first image groups are obtained, the first image group is the set of the shooting image comprising same default mobile object, each
The corresponding default mobile object of first image group is different.
In the embodiment of the present application, step S230 can be refering to the content of previous embodiment, and details are not described herein.
Step S240: pre-stored setting content is read.
In the embodiment of the present application, the setting content in shooting image needed to remove can be previously stored in server.
The setting content of server storage may include characteristic information, content type, image of setting content etc., it is not limited here.
The setting content can be used as the content that interference is generated when can check the corresponding video of default mobile object to user.
Step S250: carrying out the identification of the setting content to the shooting image of each the first image group, obtains every
There are the target of setting content shooting image and the target shooting figures in the shooting image of a the first image group
The setting content as in.
In some embodiments, the setting content may include other movements in addition to the default mobile object
Object.It should be understood that presetting mobile object is multiple mobile objects its there may be multiple mobile objects in shooting image
In one, and default mobile object is only user's mobile object of interest, therefore, to avoid other mobile objects to user's
Interference, the setting content that other mobile objects can be removed as needs, so as to subsequent obtained default mobile object
The content of other mobile objects is not present in corresponding video file.For example, when default mobile object is personage A, then in setting
Hold to be other personages in all persons present in shooting figure picture in addition to personage A.
Further, server carries out the identification of setting content to the shooting image of each the first image group, obtains
There are the target of setting content shooting image and target shootings in the shooting image of each the first image group
The setting content in image may include:
Identify all mobile objects present in each shooting image of each the first image group;It is tied according to identification
Fruit determines there is the target shooting image of other mobile objects in all shooting images of the first image group, and really
Other described mobile objects present in the fixed target shooting image.
In some embodiments, server can carry out mobile object for every shooting image in the first image group
Identification, to identify all mobile objects present in each shooting image.As an implementation, mobile object is behaved
When object, then the mobile object in shooting image can be identified according to the characteristic information of personage, for example, by identification shooting image
Face, with determine shooting image existing for all persons.
To every shooting image, after the identification for carrying out mobile object, then the first figure can be determined according to recognition result
The target that there are other mobile objects in all shooting images of picture group shoots image, and deposits in determining target shooting image
Other mobile objects.Wherein, due to itself there is default mobile pair in the shooting image of the first image group of above-mentioned acquisition
As, therefore when recognizing in shooting image includes multiple mobile objects, determine that there are it in the shooting image of the first image group
His mobile object.In addition, server can be according to all mobile objects identified in shooting image, according to default movement pair
As other mobile objects in all mobile objects in addition to default mobile object being determined, for example, can be according to default movement
The characteristic information of object determines the position that mobile object is preset in multiple mobile objects in shooting image, so that it is determined that going out it
The position at his mobile object place in shooting image.
Server exists in setting in the above manner, can then obtain in the shooting image of each the first image group
The target shooting image and the setting content in target shooting image of appearance.
Step S260: the setting content of target shooting image in each the first image group is removed, is obtained
To multiple second image groups.
There are the targets of setting content to shoot image in the shooting image for obtaining each first image group for server, and
After target shoots the setting content in image, then target in each first image group can shot to the setting content in image
After being removed, obtain to multiple second image groups after shooting image removal setting content.
Step S270: according to the shooting time sequencing of shooting image, by the multiple second image group each the
The shooting image of two image groups carries out splicing synthesis, obtains the corresponding video file of multiple default mobile objects.
In the embodiment of the present application, step S270 can be refering to the content of previous embodiment, and details are not described herein.
Image processing method provided by the embodiments of the present application, the bat that multiple cameras by being distributed in different location are shot
Image is taken the photograph, selects that there are the shooting images that at least one presets mobile object from the shooting image of multiple cameras, then
The shooting image of selection is grouped according to difference default mobile object, then setting content is carried out to the shooting image in grouping
Identification, then in grouping shooting image carry out setting content removal after, spelled according to the shooting image in grouping
It is bonded into, forms the corresponding video file of different mobile objects, improve monitoring effect, and the setting content in video file
It is removed, avoids interference of the setting content to user, individually the shooting image of each shooting area is carried out without user
It checks, prompts user experience.
Referring to Fig. 5, Fig. 5 shows the flow diagram of the image processing method of the application further embodiment offer.
This method is applied to above-mentioned server, and the server and multiple cameras communicate to connect, and the multiple camera is distributed in difference
Position, the shooting area of two neighboring camera is adjacent in the multiple camera or exists and partially overlaps.It will be directed to below
Process shown in fig. 5 is explained in detail, and shown image processing method can specifically include following steps:
Step S310: the shooting image of the multiple camera is obtained.
Step S320: obtain the multiple camera shooting image in exist at least one preset mobile object shooting
Image.
Step S330: the shooting image there are mobile object is grouped according to different default mobile objects,
Multiple first image groups are obtained, the first image group is the set of the shooting image comprising same default mobile object, each
The corresponding default mobile object of first image group is different.
Step S340: obtaining the first object image group for meeting content removal condition from the multiple first image group,
The quantity that the removal condition includes at least target shooting image in the shooting image of the first image group is greater than the first setting
Threshold value, the target shooting image are the shooting image there are the setting content.
In the embodiment of the present application, server setting present in the shooting image for removing each the first image group
When content, the first image group for needing to be removed setting content can also be screened.
Step S350: the setting content that image is shot in the first object image group is removed, and is obtained new
First object image group, by other image groups in the multiple first image group in addition to the first object image group,
And the new first object image group, as the multiple second image group.
In some embodiments, when the quantity of target shooting image is greater than the first given threshold, first object figure is indicated
As the shooting image in group there are setting content is more, it is most likely that user is interfered, therefore server is subsequent can be right
The first image group that the quantity that target shoots image is greater than the first given threshold carries out the removal of setting content.And target shooting figure
When the quantity of picture is not more than the first image group of the first given threshold, then user may not be interfered, therefore can not
Carry out the removal of setting content.To being screened using the above removal condition to the first image group, it is possible to reduce server into
The quantity of first image group of row removal setting content, promotes server process efficiency.
In other embodiment, before step S350, the method also includes:
If there is the second target image group for being unsatisfactory for content removal condition in the multiple first image group, send
For suggestion content to electronic equipment, the suggestion content is used for the institute for prompting image whether will be shot in the second target image group
Setting content is stated to be removed.
It should be understood that there is the second target image group for being unsatisfactory for above content removal condition in the first image group
When, that is, when the quantity that there is target shooting image is not more than the second target image group of the first given threshold, then it can prompt to use
Whether family is also required to carry out these the second target image groups the removal of setting content.
In this embodiment, step S350 may include:
When receiving determine instruction, the setting content that image is shot in the first object image group is gone
It removes, obtains new first object image group;The setting content that image is shot in the second target image group is gone
It removes, obtains the second new target image group;By the new first object image group and the second new target image group
Other image groups, as the multiple second image group.
If receiving user after sending suggestion content and being used to be confirmed to the second mesh by what electronic equipment was sent
It, then can will be first in the first image group when shooting the determine instruction that the setting content of image is removed in logo image group
The shooting image of target image group carries out the removal of setting content, also the shooting image of the second target image group is set in
The removal of appearance, that is, the removal of setting content is carried out to the shooting image of each first image group in the first image group, it obtains
Multiple second image groups to after removal setting content.
In some embodiments, the embodiment of step S340 and step S350 also can be applied to aforementioned implementation
Example.
Step S360: according to the shooting time sequencing of shooting image, by the multiple second image group each the
The shooting image of two image groups carries out splicing synthesis, obtains the corresponding video file of multiple default mobile objects.
Image processing method provided by the embodiments of the present application, the bat that multiple cameras by being distributed in different location are shot
Image is taken the photograph, selects that there are the shooting images that at least one presets mobile object from the shooting image of multiple cameras, then
The shooting image of selection is grouped according to difference default mobile object, is set to the grouping for meeting content removal condition
After the removal for determining content, splicing synthesis is carried out further according to the shooting image in grouping, forms the corresponding video of different mobile objects
File improves monitoring effect, and the setting content in video file is removed, and avoids setting content and does to user
It disturbs, individually the shooting image of each shooting area is checked without user, prompt user experience.
Referring to Fig. 6, Fig. 6 shows the flow diagram of the image processing method of the application further embodiment offer.
This method is applied to above-mentioned server, and the server and multiple cameras communicate to connect, and the multiple camera is distributed in difference
Position, the shooting area of two neighboring camera is adjacent in the multiple camera or exists and partially overlaps.It will be directed to below
Process shown in fig. 6 is explained in detail, and shown image processing method can specifically include following steps:
Step S410: the shooting image of the multiple camera is obtained.
In the embodiment of the present application, step S410 can be refering to the content of previous embodiment, and details are not described herein.
Step S420: obtaining the second shooting image for meeting screening conditions from the shooting image of the multiple camera,
The screening conditions include the image of the camera shooting in specified region or the image of designated time period shooting.
In the embodiment of the present application, server is after getting the shooting image of multiple cameras, from multiple camera shootings
It, can also shooting image to multiple cameras before choosing the shooting image that there is default mobile object in the shooting image of head
It is screened, to meet user demand.
In some embodiments, the screening conditions screened for the shooting image to multiple cameras can wrap
It includes: the image of the camera shooting in specified region or the image of designated time period shooting.It should be understood that user may demand
It checks that default mobile object is specifying the motion video in region, therefore specified region can be chosen as screening conditions.User
Possible demand checks the motion video of default mobile object at the appointed time section, therefore can choose designated time period as screening
Condition.
As an implementation, the screening conditions include the image of the camera shooting in specified region.It is obtained described
It takes there are before the shooting image of at least one default mobile object in the shooting image of the multiple camera, the method is also
Include:
The data of multiple shooting areas corresponding to the multiple camera are sent to mobile terminal, the multiple camera
It is corresponded with the multiple shooting area;Receive that the mobile terminal sends to specifying region in the multiple shooting area
Selection instruction, the specified region is obtained according to the selection instruction, the selection instruction is by the mobile terminal according to institute
After the data display selection interface for stating multiple shooting areas, detect in the selection interface to the multiple shooting monitoring area
Selection operation when send.
Wherein, the corresponding shooting area of the available each camera of server, and by obtained multiple shooting areas
Data are sent to mobile terminal, so that mobile terminal can generate selection interface according to the data of multiple shooting areas.It is mobile whole
The selection interface that end generates may include whole region that multiple shooting areas are constituted, and whole region is divided into multiple
The corresponding multiple shooting areas of camera, multiple cameras and multiple shooting areas correspond, and user can be to the bat of demand
Region is taken the photograph to be chosen.
In some embodiments, it may include having shooting area that server, which is sent to the data of the shooting area of mobile terminal,
The title in domain, so that mobile terminal can facilitate user in the title of the mark shooting area of the shooting area in selection interface
Solve shooting area.For example, multiple cameras include camera 1, camera 2, camera 3, camera in household monitoring scene
4 and camera 5, the corresponding shooting area of camera 1 is bedroom 1, and the corresponding shooting area of camera 2 is bedroom 2, camera
3 corresponding shooting areas are parlor, and the corresponding shooting area of camera 4 is kitchen, and the corresponding shooting area of camera 5 is book
Room, then mobile terminal can show the title of each shooting area in multiple shooting areas of display interface, be convenient for
Motion video of the subsequent default mobile object for obtaining user demand in the specified region of selection.
In some embodiments, server refers to when receiving the selection instruction of electronic equipment transmission according to selection
After enabling the specified region for determining user's selection, it can be determined that whether specified region is continuous region, i.e., is in specified region
It is no that there are intermittent regions.For example, shooting area 1, shooting area 2, shooting area 3 and shooting area 4 successively abut, if
The specified region that user selects is shooting area 1, shooting area 3 and shooting area 4, then specifies in region in intermittent shooting
Region 2, therefore the specified region that user chooses is not continuum.
It further, can be to electricity if server judges that the specified region of user's selection is not continuous region
Sub- equipment is sent for prompting user to specify the discrete suggestion content in region, so that user chooses specified region again.It can be with
Understand, usual user needs to check default mobile object in the motion video of continuum, if specified region is not continuous
Region, then will lead to the demand for being unable to satisfy user, therefore send suggestion content and prompt user, can be convenient user's selection
Continuum is as specified region.
Certainly, user can also be sent to server to selected specified region (discrete region) by electronic equipment
The instruction being determined, server can carry out the screening of shooting image according to the specified region currently selected.
In some embodiments it is possible to the image and designated time period that simultaneously shoot the camera in specified region
The image of shooting conveniently obtains shooting area that default mobile object is checked in user demand and period as screening conditions
Motion video.Certainly, specific screening conditions can be not as restriction.
Step S430: there are the shooting images of at least one default mobile object for acquisition from the second shooting image.
It in the embodiment of the present application, then can be after screening after the shooting image to multiple cameras screens
There are the shooting images of at least one default mobile object for acquisition in second image, wherein obtains to preset there are at least one and move
The mode of the shooting image of dynamic object can be refering to the content of previous embodiment, and details are not described herein.
It should be noted that the embodiment of above-mentioned steps S420 and step S430 also can be applied to aforementioned implementation
Example, that is to say, that in the aforementioned embodiment, to obtain exist at least one preset mobile object shooting image before,
The the second shooting image for meeting screening conditions can be screened from the shooting image of multiple cameras.
Step S440: the shooting image there are mobile object is grouped according to different default mobile objects,
Multiple first image groups are obtained, the first image group is the set of the shooting image comprising same default mobile object, each
The corresponding default mobile object of first image group is different.
Step S450: removing setting content present in the shooting image of each the first image group, obtains multiple
Two image groups.
Step S460: according to the shooting time sequencing of shooting image, by the multiple second image group each the
The shooting image of two image groups carries out splicing synthesis, obtains the corresponding video file of multiple default mobile objects.
In some embodiments, server is after obtaining multiple second image groups, will in described multiple images group it is every
It, can also be to corresponding second image of each default mobile object before the shooting image of a second image group carries out splicing synthesis
Shooting image in group is screened.
As an implementation, server may determine that in the second image group whether include two neighboring camera same
Shooting image of one time to default mobile object;If including two neighboring camera in the second image group in the same time pair
The shooting image of default mobile object, then obtain the first camera in two neighboring camera the same time take the
One target image, and obtain the second target figure that second camera takes in the same time in two neighboring camera
Picture;The optimal image of the image quality parameter of default mobile object is screened from first object image and the second target image.
In this embodiment, the region of two neighboring camera shooting partially overlaps, therefore, when default mobile object exists
When positioned at the lap in the region that the two neighboring camera is shot, the two neighboring camera may the same time simultaneously
Take the default mobile object, therefore will include that two same times take in the shooting image that obtains of server includes
The shooting image of default mobile object.Therefore, the first camera (one of camera shooting in available two neighboring camera
Head) in the target image (being denoted as first object image) and the two neighboring camera that the same time takes second
The target image (being denoted as the second target image) that camera (another camera) takes in the same time.
Further, server can obtain default shifting after obtaining first object image and the second target image respectively
Image quality parameter (be denoted as first image quality parameter) and default mobile object of the object in first object image are moved in the second target
Image quality parameter (being denoted as the second image quality parameter) in image.Wherein, image quality parameter may include clarity, brightness, acutance, camera lens
Distortion, color, resolution, gamut range, purity etc., it is not limited here.
Server after obtaining the first image quality parameter and the second image quality parameter, then can compare the first image quality parameter with
And second the corresponding image quality effect of image quality parameter obtained from the first image quality parameter and the second image quality parameter according to comparison result
Optimal image quality parameter is taken, then filters out figure corresponding to optimal image quality parameter from first object image and the second target image
Picture.For example, it is clear highest can be obtained from first object image and the second target image when image quality parameter includes clarity
The corresponding image of degree.
Server after carrying out optical sieving as above to each second image group, then can to carry out optical sieving after
Each of the shooting image of the second image group carry out splicing synthesis, obtain the corresponding video file of multiple default mobile objects.
In some embodiments, server is after getting the corresponding video file of multiple default mobile objects, can be with
The corresponding video file of multiple default mobile objects is sent to electronic equipment.As a kind of mode, server can will be multiple
The default corresponding video file of mobile object is sent to same electronic equipment.Alternatively, mobile pair will each be preset
As corresponding video file sends electronic equipment corresponding to each default mobile object.
In some embodiments, the corresponding video file of multiple default mobile objects is sent to electronics and set by server
It is standby, it may include: in the corresponding second image group of each default mobile object of detection default mobile pair with the presence or absence of other
The shooting image of elephant;It default is moved pair if at least existing and there are other in the corresponding second image group of the first default mobile object
The shooting image of elephant is sent in prompt while sending the corresponding video file of the multiple default mobile object to electronic equipment
Hold to the electronic equipment, the suggestion content is for prompting to exist in the corresponding video file of the described first default mobile object
The content of other default mobile objects.
It should be understood that being preset in the corresponding video file of mobile object in some got, it is understood that there may be other are pre-
If the content of mobile object, and other default mobile objects are also user's content of concern.It therefore can be default by judging
With the presence or absence of the shooting image of other default mobile objects, that is, the default shifting of judgement in the corresponding second image group of mobile object
It whether include existing simultaneously the default mobile object and other default mobile objects in the dynamic corresponding second image group of object
Image is shot, so that it is determined that whether presetting the content of mobile objects in the default corresponding video file of mobile object including other.
Further, there is other default shiftings in the corresponding second image group of the first default mobile object if at least existed
The shooting image of dynamic object, server can be to send the corresponding video file of multiple default mobile objects same to electronic equipment
When send suggestion content to electronic equipment, exist so as to prompt user first to preset in the corresponding video file of mobile object
The content of other default mobile objects.
In some embodiments, server can also mark other default mobile objects in video file, facilitate use
Other default mobile objects in video file are checked at family.For example, in the scene that police investigates into a case evidence obtaining, if A pairs of the injured party
There are the contents of suspect B in the video file answered then can be convenient police and is quickly found out by marking the content of suspect B
Video evidence.
Certainly, embodiment of above also can be applied to previous embodiment, that is, mobile object pair is preset in above-mentioned determination
With the presence or absence of the content of other default mobile objects in the video file answered, and the mode for sending suggestion content also can be applied to
Previous embodiment.
In some embodiments, which can be applied to monitor the scene of default mobile object.Service
The corresponding video file of default mobile object that device obtains, can be used as the corresponding monitor video of default mobile object, and take
The monitor video can be sent to by business device presets the corresponding monitor terminal of mobile object with this, so that the monitor terminal is corresponding
User's timely learning presets the activity condition of mobile object.For example, the default mobile object can be old man or child, the monitoring
The case where terminal can correspond to the guardian of old man or child, can be with the old man or child of timely learning family so as to guardian,
Avoid the generation of fortuitous event.
Further, server, can also be automatically to the monitor video after the monitor video for obtaining default mobile object
It is analyzed, whether abnormal conditions occurs with the default mobile object judged in the monitor video, when to characterize this pre- for judging result
If abnormal conditions occurs in mobile object, warning message can be sent to this and preset the corresponding monitor terminal of mobile object, with
The corresponding user of monitor terminal is set to make corresponding processing in time.Wherein, abnormal conditions may include falling down, can not crouching long, crying
Tears, morbidity etc., it is not limited here.In addition, server can also send the monitoring when sending warning message to monitor terminal
Video or the corresponding video clip of the abnormal conditions are preset to monitor terminal so that the corresponding user of monitor terminal understands in time
The truth of mobile object.
In some embodiments, monitor terminal can be based on the prison after the monitor video for receiving server transmission
It controls video and sends target instruction target word information to server, correspondingly, server receives and responds the target after target instruction target word information and refer to
Information is enabled to execute corresponding operation, for example, dial the police emergency number, dial ambulance call etc..
Image processing method provided by the embodiments of the present application, the bat that multiple cameras by being distributed in different location are shot
Image is taken the photograph, screening meets the second shooting image of screening conditions from the shooting image of multiple cameras, then from the second shooting
It is selected in image there are the shooting image that at least one presets mobile object, further according to the default mobile object of difference to selection
Shooting image is grouped to obtain multiple first image groups, is carrying out setting content to the shooting image in multiple first image groups
Removal, obtain multiple second image groups, then splicing synthesis is carried out respectively to the shooting image of multiple second image groups, formed not
With the default corresponding video file of mobile object, and the interference information of setting content is eliminated in video file, reduce video
Interference of the setting content to user in file, thus facilitate user check the default mobile object of demand in specified shooting area or
It is in the activity change of multiple shooting areas in person's designated time period, reduces user's operation and user consults the time of video, it is full
The demand of sufficient user promotes user experience.
Referring to Fig. 7, it illustrates a kind of structural block diagram of image processing apparatus 400 provided by the embodiments of the present application, it should
Image processing apparatus 400 is applied to above-mentioned server, and the server and multiple cameras communicate to connect, the multiple camera point
It is distributed in different location, the shooting area of two neighboring camera is adjacent in the multiple camera or presence partially overlaps.It should
Image processing apparatus 400 include: the first image collection module 410, the second image collection module 420, image grouping module 430,
Content removes module 440 and Video Composition module 450.Wherein, it is described more for obtaining to obtain module 410 for the first image
The shooting image of a camera;Second image collection module 420 is used to obtain in the shooting image of the multiple camera
There are the shooting images that at least one presets mobile object;Described image grouping module 430 is used for that there are mobile objects by described
Shooting image be grouped according to different default mobile objects, obtain multiple first image groups, the first image group is
The set of shooting image comprising same default mobile object;The content removal module 440 is for removing each described first
Setting content present in the shooting image of image group obtains multiple second image groups;The Video Composition module 450 is for pressing
According to shooting image shooting time sequencing, by the shooting image of the second image group each in the multiple second image group into
Row splicing synthesis, obtains the corresponding video file of multiple default mobile objects.
In some embodiments, refer to Fig. 8, content remove module 440 may include: content reading unit 441, it is interior
Hold recognition unit 442 and removal execution unit 443.Content reading unit 441 is for reading pre-stored setting content;It is interior
Hold the identification that recognition unit 442 is used to carry out the shooting image of each the first image group the setting content, obtains every
There are the target of setting content shooting image and the target shooting figures in the shooting image of a the first image group
The setting content as in;Remove the institute that execution unit 443 is used to shoot target in each the first image group image
It states setting content to be removed, obtains multiple second image groups.
In this embodiment, the setting content includes other mobile objects in addition to the default mobile object.
Content recognition unit 442 can be specifically used for: identifying present in each shooting image of each the first image group and own
Mobile object;According to recognition result, determine in all shooting images of the first image group there are other described mobile objects
Target shoot image, and determine other described mobile objects present in target shooting image.
In some embodiments, Fig. 9 is referred to, it may include: image group screening unit 444 that content, which removes module 440,
And removal execution unit 443.Image group screening unit 444, which is used to obtain from the multiple first image group, meets content
Except the first object image group of condition, the removal condition includes at least target shooting in the shooting image of the first image group
The quantity of image is greater than the first given threshold, and the target shooting image is the shooting image there are the setting content;Removal
Execution unit 443 is obtained for the setting content in the multiple first image group in target image group to be removed
New first object image group, by other images in the multiple first image group in addition to the first object image group
Group and the new first object image group, as the multiple second image group.
In this embodiment, which can also include: content presentation module.Content presentation module
It is removed, obtains by the setting content for shooting image in the first object image group for removing execution unit 443
To new first object image group, by other images in the multiple first image group in addition to the first object image group
Group and the new first object image group, before the multiple second image group, if the multiple first image
There is the second target image group for being unsatisfactory for content removal condition in group, then sends suggestion content to electronic equipment, the prompt
Whether content is used to prompt to be removed the setting content for shooting image in the second target image group.Removal executes
Unit 443 can be specifically used for: when receiving determine instruction, set shooting in the first object image group described in image
Determine content to be removed, obtains new first object image group;It is set being shot in the second target image group described in image
Determine content to be removed, obtains the second new target image group;By the new first object image group and described new the
Other image groups of two target image groups, as the multiple second image group.
In some embodiments, the second image collection module 420 may include: that optical sieving unit and image obtain
Unit.Optical sieving unit meets the shooting image of screening conditions for obtaining from the shooting image of the multiple camera,
The screening conditions include the image of the camera shooting in specified region or the image of designated time period shooting;Image obtains single
There are the shooting images of at least one default mobile object for obtaining from the shooting image for meeting screening conditions for member.
In this embodiment, the screening conditions include the image of the camera shooting in specified region.The image procossing
Device 400 can also include: data transmission blocks and command reception module.Data transmission blocks are for sending the multiple take the photograph
The data of multiple shooting areas as corresponding to head are to mobile terminal, and the multiple camera and the multiple shooting area are one by one
It is corresponding;Command reception module is used to receive the selection to region is specified in the multiple shooting area that the mobile terminal is sent
Instruction, obtains the specified region according to the selection instruction, the selection instruction is by the mobile terminal according to the multiple
After the data of shooting area show selection interface, the selection in the selection interface to the multiple shooting monitoring area is detected
It is sent when operation.
It is apparent to those skilled in the art that for convenience and simplicity of description, foregoing description device and
The specific work process of module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, the mutual coupling of module can be electrical property, mechanical or other
The coupling of form.
It, can also be in addition, can integrate in a processing module in each functional module in each embodiment of the application
It is that modules physically exist alone, can also be integrated in two or more modules in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.
In conclusion scheme provided by the present application, is applied to server, server and multiple cameras communicate to connect, more
A camera is distributed in different location, and the shooting area of two neighboring camera is adjacent in multiple cameras or there is part weight
It closes.By obtaining the shooting image of multiple cameras, obtains to preset in the shooting image of multiple cameras there are at least one and move
The shooting image of dynamic object, the shooting image that mobile object will be present are grouped according to different default mobile objects, obtain
Multiple first image groups, wherein the first image group be comprising same default mobile object shooting image set, each first
The corresponding default mobile object of image group is different, then removes in setting present in the shooting image of each first image group
Hold, obtain multiple second image groups, according to the shooting time sequencing of shooting image, by multiple second image groups each the
The shooting image of two image groups carries out splicing synthesis, obtains the corresponding video file of multiple default mobile objects, thus realization pair
Default mobile object carries out splicing synthesis in the shooting image of multiple shooting areas, obtains default mobile object in multiple shooting areas
The complete monitor video that domain is taken, improves monitoring effect, without user individually to the shooting image of each shooting area into
Row is checked, user experience is prompted.
Referring to FIG. 10, it illustrates a kind of structural block diagrams of server provided by the embodiments of the present application.The server 100
It can be Cloud Server, be also possible to traditional server.Server 100 in the application may include one or more such as lower part
Part: processor 110, memory 120 and one or more application program, wherein one or more application programs can be stored
In memory 120 and be configured as being executed by one or more processors 110, one or more programs be configured to carry out as
Method described in preceding method embodiment.
Processor 110 may include one or more processing core.Processor 110 is whole using various interfaces and connection
Various pieces in a server 100, by running or executing the instruction being stored in memory 120, program, code set or refer to
Collection is enabled, and calls the data being stored in memory 120, the various functions and processing data of execute server 100.It is optional
Ground, processor 110 can use Digital Signal Processing (Digital Signal Processing, DSP), field programmable gate
Array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic
Array, PLA) at least one of example, in hardware realize.Processor 110 can integrating central processor (Central
Processing Unit, CPU), in image processor (Graphics ProcessingUnit, GPU) and modem etc.
One or more of combinations.Wherein, the main processing operation system of CPU, user interface and application program etc.;GPU is for being responsible for
Show the rendering and drafting of content;Modem is for handling wireless communication.It is understood that above-mentioned modem
It can not be integrated into processor 110, be realized separately through one piece of communication chip.
Memory 120 may include random access memory (Random Access Memory, RAM), also may include read-only
Memory (Read-Only Memory).Memory 120 can be used for store instruction, program, code, code set or instruction set.It deposits
Reservoir 120 may include storing program area and storage data area, wherein the finger that storing program area can store for realizing operating system
Enable, for realizing at least one function instruction (such as touch function, sound-playing function, image player function etc.), be used for
Realize the instruction etc. of following each embodiments of the method.What storage data area can be created in use with storage server 100
Data (such as phone directory, audio, video data, chat record data) etc..
Figure 11 is please referred to, it illustrates a kind of structural frames of computer readable storage medium provided by the embodiments of the present application
Figure.Program code is stored in the computer-readable medium 800, said program code can be called by processor and execute the above method
Method described in embodiment.
Computer readable storage medium 800 can be such as flash memory, EEPROM (electrically erasable programmable read-only memory),
The electronic memory of EPROM, hard disk or ROM etc.Optionally, computer readable storage medium 800 includes non-volatile meter
Calculation machine readable medium (non-transitory computer-readable storage medium).Computer-readable storage
Medium 800 has the memory space for the program code 810 for executing any method and step in the above method.These program codes can
With from reading or be written in one or more computer program product in this one or more computer program product.
Program code 810 can for example be compressed in a suitable form.
Finally, it should be noted that above embodiments are only to illustrate the technical solution of the application, rather than its limitations;Although
The application is described in detail with reference to the foregoing embodiments, those skilled in the art are when understanding: it still can be with
It modifies the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features;And
These are modified or replaceed, do not drive corresponding technical solution essence be detached from each embodiment technical solution of the application spirit and
Range.
Claims (10)
1. a kind of image processing method, which is characterized in that be applied to server, the server and multiple camera communication links
It connects, the multiple camera is distributed in different location, and the shooting area of two neighboring camera is adjacent in the multiple camera
Or exists and partially overlaps, which comprises
Obtain the shooting image of the multiple camera;
Obtain the multiple camera shooting image in exist at least one preset mobile object shooting image;
The shooting image there are mobile object is grouped according to different default mobile objects, obtains multiple first figures
As group, the first image group is the set of the shooting image comprising same default mobile object, and each first image group is corresponding
Default mobile object it is different;
Setting content present in the shooting image of each the first image group is removed, multiple second image groups are obtained;
According to the shooting time sequencing of shooting image, by the shooting of the second image group each in the multiple second image group
Image carries out splicing synthesis, obtains the corresponding video file of multiple default mobile objects.
2. the method according to claim 1, wherein the shooting image of each the first image group of removal
Present in setting content, obtain multiple second image groups, comprising:
Read pre-stored setting content;
The identification that the setting content is carried out to the shooting image of each the first image group, obtains each the first image
There are the settings in the target of setting content shooting image and target shooting image in the shooting image of group
Content;
The setting content of target shooting image in each the first image group is removed, multiple second images are obtained
Group.
3. according to the method described in claim 2, it is characterized in that, the setting content include except the default mobile object with
Other outer mobile objects, the identification that setting content is carried out to the shooting image of each the first image group, obtain every
There are the target of setting content shooting image and the target shooting figures in the shooting image of a the first image group
The setting content as in, comprising:
Identify all mobile objects present in each shooting image of each the first image group;
According to recognition result, determine there is the target of other mobile objects in all shooting images of the first image group
Image is shot, and determines other described mobile objects present in the target shooting image.
4. the method according to claim 1, wherein the shooting image of each the first image group of removal
Present in setting content, obtain multiple second image groups, comprising:
The first object image group for meeting content removal condition is obtained from the multiple first image group, the removal condition is extremely
The quantity of target shooting image is greater than the first given threshold in the shooting image including the first image group less, and the target is clapped
Taking the photograph image is the shooting image there are the setting content;
The setting content for shooting image in the first object image group is removed, new first object image is obtained
Group, by other image groups and described new the in the multiple first image group in addition to the first object image group
One target image group, as the multiple second image group.
5. according to the method described in claim 4, it is characterized in that, the institute of image will be shot in the first object image group
It states setting content to be removed, obtains new first object image group, first mesh will be removed in the multiple first image group
Other image groups and the new first object image group other than logo image group, as the multiple second image group it
Before, the method also includes:
If there is the second target image group for being unsatisfactory for content removal condition in the multiple first image group, prompt is sent
Whether content to electronic equipment, the suggestion content sets described in image for prompting to shoot in the second target image group
Determine content to be removed;
It is described to be removed the setting content that image is shot in the first object image group, obtain new first object
Image group, by other image groups in the multiple first image group in addition to the first object image group and described new
First object image group, as the multiple second image group, comprising:
When receiving determine instruction, the setting content that image is shot in the first object image group is removed,
Obtain new first object image group;
The setting content for shooting image in the second target image group is removed, the second new target image is obtained
Group;
By the new first object image group and described new other image groups of second target image group, as the multiple
Second image group.
6. method according to claim 1-5, which is characterized in that the shooting for obtaining the multiple camera
There are the shooting images of at least one default mobile object in image, comprising:
The shooting image for meeting screening conditions is obtained from the shooting image of the multiple camera, the screening conditions include referring to
Determine the image of the camera shooting in region or the image of designated time period shooting;
From the shooting image for meeting screening conditions, there are the shooting images of at least one default mobile object for acquisition.
7. according to the method described in claim 6, it is characterized in that, the screening conditions include the camera shooting in specified region
Image, there is at least one shooting image for presetting mobile object in the shooting image for obtaining the multiple camera
Before, the method also includes:
The data of multiple shooting areas corresponding to the multiple camera are sent to mobile terminal, the multiple camera and institute
Multiple shooting areas are stated to correspond;
The selection instruction to region specified in the multiple shooting area that the mobile terminal is sent is received, according to the selection
Instruction obtains the specified region, and the selection instruction is shown by the mobile terminal according to the data of the multiple shooting area
After selection interface, transmission when detecting the selection operation in the selection interface to the multiple shooting monitoring area.
8. a kind of picture processing unit, which is characterized in that be applied to server, the server and multiple camera communication links
It connects, the multiple camera is distributed in different location, and the shooting area of two neighboring camera is adjacent in the multiple camera
Or exist partially overlap, described device include: the first image collection module, the second image collection module, image grouping module,
Content removes module and Video Composition module, wherein
The first image obtains the shooting image that module is used to obtain the multiple camera;
Second image collection module is used to obtain to preset in the shooting image of the multiple camera there are at least one and move
The shooting image of dynamic object;
Described image grouping module be used for by it is described there are the shooting image of mobile object according to different default mobile objects into
Row grouping, obtains multiple first image groups, and the first image group is the collection of the shooting image comprising same default mobile object
It closes;
The content removal module is obtained for removing setting content present in the shooting image of each the first image group
Multiple second image groups;
The Video Composition module is used for the shooting time sequencing according to shooting image, will be in the multiple second image group
The shooting image of each second image group carries out splicing synthesis, obtains the corresponding video file of multiple default mobile objects.
9. a kind of server characterized by comprising
One or more processors;
Memory;
One or more application program, wherein one or more of application programs are stored in the memory and are configured
To be executed by one or more of processors, one or more of programs are configured to carry out as claim 1-7 is any
Method described in.
10. a kind of computer-readable storage medium, which is characterized in that be stored with journey in the computer-readable storage medium
Sequence code, said program code can be called by processor and execute the method according to claim 1 to 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910579253.1A CN110191324B (en) | 2019-06-28 | 2019-06-28 | Image processing method, image processing apparatus, server, and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910579253.1A CN110191324B (en) | 2019-06-28 | 2019-06-28 | Image processing method, image processing apparatus, server, and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110191324A true CN110191324A (en) | 2019-08-30 |
CN110191324B CN110191324B (en) | 2021-09-14 |
Family
ID=67724308
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910579253.1A Active CN110191324B (en) | 2019-06-28 | 2019-06-28 | Image processing method, image processing apparatus, server, and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110191324B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113524170A (en) * | 2020-04-21 | 2021-10-22 | 佳能株式会社 | Image processing apparatus for monitoring object, control method thereof, and storage medium |
WO2021212659A1 (en) * | 2020-04-24 | 2021-10-28 | 平安国际智慧城市科技股份有限公司 | Video data processing method and apparatus, and computer device and storage medium |
CN113906728A (en) * | 2020-04-17 | 2022-01-07 | 深圳市大疆创新科技有限公司 | Image processing method and device, camera module and movable equipment |
Citations (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1413343A (en) * | 1999-12-23 | 2003-04-23 | 维斯波特股份公司 | Monitoring method, system and module |
CN1658670A (en) * | 2004-02-20 | 2005-08-24 | 上海银晨智能识别科技有限公司 | Intelligent tracking monitoring system with multi-camera |
CN1928888A (en) * | 2005-09-09 | 2007-03-14 | 佳能株式会社 | Information processing apparatus, information processing method |
JP2007221423A (en) * | 2006-02-16 | 2007-08-30 | Matsushita Electric Ind Co Ltd | Imaging apparatus |
CN101035271A (en) * | 2007-04-12 | 2007-09-12 | 上海天卫通信科技有限公司 | Video monitoring system and method for tracking the motive target in the low-speed mobile network |
CN101075376A (en) * | 2006-05-19 | 2007-11-21 | 北京微视新纪元科技有限公司 | Intelligent video traffic monitoring system based on multi-viewpoints and its method |
CN101277429A (en) * | 2007-03-27 | 2008-10-01 | 中国科学院自动化研究所 | Method and system for amalgamation process and display of multipath video information when monitoring |
CN101527786A (en) * | 2009-03-31 | 2009-09-09 | 西安交通大学 | Method for strengthening definition of sight important zone in network video |
CN101626489A (en) * | 2008-07-10 | 2010-01-13 | 苏国政 | Method and system for intelligently identifying and automatically tracking objects under unattended condition |
US20100013935A1 (en) * | 2006-06-14 | 2010-01-21 | Honeywell International Inc. | Multiple target tracking system incorporating merge, split and reacquisition hypotheses |
CN102724482A (en) * | 2012-06-18 | 2012-10-10 | 西安电子科技大学 | Intelligent visual sensor network moving target relay tracking system based on GPS (global positioning system) and GIS (geographic information system) |
CN102881100A (en) * | 2012-08-24 | 2013-01-16 | 济南纳维信息技术有限公司 | Video-analysis-based antitheft monitoring method for physical store |
CN103077387A (en) * | 2013-02-07 | 2013-05-01 | 东莞中国科学院云计算产业技术创新与育成中心 | Method for automatically detecting carriage of freight train in video |
CN103108198A (en) * | 2011-11-09 | 2013-05-15 | 宏碁股份有限公司 | Image generation device and image adjusting method |
US20140099026A1 (en) * | 2012-10-09 | 2014-04-10 | Aravind Krishnaswamy | Color Correction Based on Multiple Images |
US20150085179A1 (en) * | 2012-04-17 | 2015-03-26 | E-Vision Smart Optics, Inc. | Systems, Devices, and Methods for Managing Camera Focus |
CN104660998A (en) * | 2015-02-16 | 2015-05-27 | 苏州阔地网络科技有限公司 | Relay tracking method and system |
JP2015158796A (en) * | 2014-02-24 | 2015-09-03 | アイホン株式会社 | Object detection device |
CN105915847A (en) * | 2016-04-29 | 2016-08-31 | 浙江理工大学 | Characteristics matching and tracking based video monitoring apparatus and method |
WO2017002118A1 (en) * | 2015-07-02 | 2017-01-05 | Agt International Gmbh | Multi-camera vehicle identification system |
US20170206424A1 (en) * | 2016-01-14 | 2017-07-20 | Canon Kabushiki Kaisha | Display apparatus, display method, and storage medium |
CN106971142A (en) * | 2017-02-07 | 2017-07-21 | 深圳云天励飞技术有限公司 | A kind of image processing method and device |
CN107566799A (en) * | 2017-09-15 | 2018-01-09 | 泾县麦蓝网络技术服务有限公司 | Home environment monitoring method and system based on mobile terminal control |
CN108111818A (en) * | 2017-12-25 | 2018-06-01 | 北京航空航天大学 | Moving target active perception method and apparatus based on multiple-camera collaboration |
CN108234961A (en) * | 2018-02-13 | 2018-06-29 | 欧阳昌君 | A kind of multichannel video camera coding and video flowing drainage method and system |
CN207601823U (en) * | 2017-12-06 | 2018-07-10 | 中科劲阳(北京)科技有限公司 | A kind of data policy service arrangement device |
CN108470353A (en) * | 2018-03-01 | 2018-08-31 | 腾讯科技(深圳)有限公司 | A kind of method for tracking target, device and storage medium |
CN108540754A (en) * | 2017-03-01 | 2018-09-14 | 中国电信股份有限公司 | Methods, devices and systems for more video-splicings in video monitoring |
US20180365843A1 (en) * | 2015-07-01 | 2018-12-20 | China University Of Mining And Technology | Method and system for tracking moving objects based on optical flow method |
CN109726716A (en) * | 2018-12-29 | 2019-05-07 | 深圳市趣创科技有限公司 | A kind of image processing method and system |
CN109862313A (en) * | 2018-12-12 | 2019-06-07 | 科大讯飞股份有限公司 | A kind of video concentration method and device |
-
2019
- 2019-06-28 CN CN201910579253.1A patent/CN110191324B/en active Active
Patent Citations (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1413343A (en) * | 1999-12-23 | 2003-04-23 | 维斯波特股份公司 | Monitoring method, system and module |
CN1658670A (en) * | 2004-02-20 | 2005-08-24 | 上海银晨智能识别科技有限公司 | Intelligent tracking monitoring system with multi-camera |
CN1928888A (en) * | 2005-09-09 | 2007-03-14 | 佳能株式会社 | Information processing apparatus, information processing method |
JP2007221423A (en) * | 2006-02-16 | 2007-08-30 | Matsushita Electric Ind Co Ltd | Imaging apparatus |
CN101075376A (en) * | 2006-05-19 | 2007-11-21 | 北京微视新纪元科技有限公司 | Intelligent video traffic monitoring system based on multi-viewpoints and its method |
US20100013935A1 (en) * | 2006-06-14 | 2010-01-21 | Honeywell International Inc. | Multiple target tracking system incorporating merge, split and reacquisition hypotheses |
CN101277429A (en) * | 2007-03-27 | 2008-10-01 | 中国科学院自动化研究所 | Method and system for amalgamation process and display of multipath video information when monitoring |
CN101035271A (en) * | 2007-04-12 | 2007-09-12 | 上海天卫通信科技有限公司 | Video monitoring system and method for tracking the motive target in the low-speed mobile network |
CN101626489A (en) * | 2008-07-10 | 2010-01-13 | 苏国政 | Method and system for intelligently identifying and automatically tracking objects under unattended condition |
CN101527786A (en) * | 2009-03-31 | 2009-09-09 | 西安交通大学 | Method for strengthening definition of sight important zone in network video |
CN103108198A (en) * | 2011-11-09 | 2013-05-15 | 宏碁股份有限公司 | Image generation device and image adjusting method |
US20150085179A1 (en) * | 2012-04-17 | 2015-03-26 | E-Vision Smart Optics, Inc. | Systems, Devices, and Methods for Managing Camera Focus |
CN102724482A (en) * | 2012-06-18 | 2012-10-10 | 西安电子科技大学 | Intelligent visual sensor network moving target relay tracking system based on GPS (global positioning system) and GIS (geographic information system) |
CN102881100A (en) * | 2012-08-24 | 2013-01-16 | 济南纳维信息技术有限公司 | Video-analysis-based antitheft monitoring method for physical store |
US20140099026A1 (en) * | 2012-10-09 | 2014-04-10 | Aravind Krishnaswamy | Color Correction Based on Multiple Images |
CN103077387A (en) * | 2013-02-07 | 2013-05-01 | 东莞中国科学院云计算产业技术创新与育成中心 | Method for automatically detecting carriage of freight train in video |
JP2015158796A (en) * | 2014-02-24 | 2015-09-03 | アイホン株式会社 | Object detection device |
CN104660998A (en) * | 2015-02-16 | 2015-05-27 | 苏州阔地网络科技有限公司 | Relay tracking method and system |
US20180365843A1 (en) * | 2015-07-01 | 2018-12-20 | China University Of Mining And Technology | Method and system for tracking moving objects based on optical flow method |
WO2017002118A1 (en) * | 2015-07-02 | 2017-01-05 | Agt International Gmbh | Multi-camera vehicle identification system |
US20170206424A1 (en) * | 2016-01-14 | 2017-07-20 | Canon Kabushiki Kaisha | Display apparatus, display method, and storage medium |
CN105915847A (en) * | 2016-04-29 | 2016-08-31 | 浙江理工大学 | Characteristics matching and tracking based video monitoring apparatus and method |
CN106971142A (en) * | 2017-02-07 | 2017-07-21 | 深圳云天励飞技术有限公司 | A kind of image processing method and device |
CN108540754A (en) * | 2017-03-01 | 2018-09-14 | 中国电信股份有限公司 | Methods, devices and systems for more video-splicings in video monitoring |
CN107566799A (en) * | 2017-09-15 | 2018-01-09 | 泾县麦蓝网络技术服务有限公司 | Home environment monitoring method and system based on mobile terminal control |
CN207601823U (en) * | 2017-12-06 | 2018-07-10 | 中科劲阳(北京)科技有限公司 | A kind of data policy service arrangement device |
CN108111818A (en) * | 2017-12-25 | 2018-06-01 | 北京航空航天大学 | Moving target active perception method and apparatus based on multiple-camera collaboration |
CN108234961A (en) * | 2018-02-13 | 2018-06-29 | 欧阳昌君 | A kind of multichannel video camera coding and video flowing drainage method and system |
CN108470353A (en) * | 2018-03-01 | 2018-08-31 | 腾讯科技(深圳)有限公司 | A kind of method for tracking target, device and storage medium |
CN109862313A (en) * | 2018-12-12 | 2019-06-07 | 科大讯飞股份有限公司 | A kind of video concentration method and device |
CN109726716A (en) * | 2018-12-29 | 2019-05-07 | 深圳市趣创科技有限公司 | A kind of image processing method and system |
Non-Patent Citations (1)
Title |
---|
叶泽雄: "基于视频内容分析的摘要以及检索系统", 《中国优秀硕士学位论文全文数据库(电子期刊)信息科技辑》 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113906728A (en) * | 2020-04-17 | 2022-01-07 | 深圳市大疆创新科技有限公司 | Image processing method and device, camera module and movable equipment |
CN113524170A (en) * | 2020-04-21 | 2021-10-22 | 佳能株式会社 | Image processing apparatus for monitoring object, control method thereof, and storage medium |
US11839980B2 (en) | 2020-04-21 | 2023-12-12 | Canon Kabushiki Kaisha | Image processing apparatus monitoring target, control method therefor, and storage medium storing control program therefor |
CN113524170B (en) * | 2020-04-21 | 2024-02-27 | 佳能株式会社 | Image processing apparatus for monitoring object, control method thereof, and storage medium |
WO2021212659A1 (en) * | 2020-04-24 | 2021-10-28 | 平安国际智慧城市科技股份有限公司 | Video data processing method and apparatus, and computer device and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN110191324B (en) | 2021-09-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110267008B (en) | Image processing method, image processing apparatus, server, and storage medium | |
CN110191324A (en) | Image processing method, device, server and storage medium | |
CN110177258A (en) | Image processing method, device, server and storage medium | |
CN105791707B (en) | Image processing method and device and electronic equipment | |
CN107395957B (en) | Photographing method and device, storage medium and electronic equipment | |
CN110267009A (en) | Image processing method, device, server and storage medium | |
CN107360366B (en) | Photographing method and device, storage medium and electronic equipment | |
CN106407984A (en) | Target object recognition method and device | |
CN104486546B (en) | The method, device and mobile terminal taken pictures | |
CN106803928B (en) | Reminding method, reminding device and terminal | |
CN111523384A (en) | Vision-based conference anti-candid method and device, storage medium and terminal | |
CN110278413A (en) | Image processing method, device, server and storage medium | |
JP6162345B2 (en) | Raw scene recognition that allows scene-dependent image modification before image recording or display | |
CN107172354A (en) | Method for processing video frequency, device, electronic equipment and storage medium | |
CN109948525A (en) | It takes pictures processing method, device, mobile terminal and storage medium | |
CN104394315A (en) | A method for photographing an image | |
CN110267011A (en) | Image processing method, device, server and storage medium | |
CN110266953B (en) | Image processing method, image processing apparatus, server, and storage medium | |
CN110264473A (en) | Image processing method, device and electronic equipment based on multiple image | |
US20230206093A1 (en) | Music recommendation method and apparatus | |
CN115086567A (en) | Time-delay shooting method and device | |
CN110267010B (en) | Image processing method, image processing apparatus, server, and storage medium | |
CN110267007A (en) | Image processing method, device, server and storage medium | |
CN106888353A (en) | A kind of image-pickup method and equipment | |
CN113259592B (en) | Shooting method and device, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |