CN103902967A - Image identification control device and image identification control method - Google Patents
Image identification control device and image identification control method Download PDFInfo
- Publication number
- CN103902967A CN103902967A CN201310742851.9A CN201310742851A CN103902967A CN 103902967 A CN103902967 A CN 103902967A CN 201310742851 A CN201310742851 A CN 201310742851A CN 103902967 A CN103902967 A CN 103902967A
- Authority
- CN
- China
- Prior art keywords
- image
- subject
- information
- data frame
- image data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Studio Devices (AREA)
Abstract
The invention provides an image identification control device and an image identification control method, relates to image shooting devices and image processing devices, and belongs to the application field of image shooting. According to an image shooting device in the prior art, the image of a shot object needs to be shot depending on the subjective experience of a user in the shooting process. According to the image identification control device and the image identification control method, based on the shot object identification information relevant to specific information, whether a specific shot object image exists in a shot image or not is detected, and the identification information of the shot object is switched conveniently according to the sorting order of the specific information; or when the specific shot object image is detected, a user is notified. Accordingly, the requirement for the technique of the user is lowered, the shooting quality and speed are improved, and working strength is lowered.
Description
Technical field
Image recognition control device of the present invention and image recognition control method, relate to hand-held shooting or the online various image capturing devices of taking, and receives and process the image processing equipment of image, and the application of photographic images.
Background technology
As known technology, image capturing device is widely used each field, for example, and at the industrial circle of focusing on repair based on condition of component, use the filming apparatus such as visible ray filming apparatus, thermal imaging device, ultraviolet filming apparatus, regularly equipment etc. is taken to the important ring into repair based on condition of component.
In such application, the workload of taking is quite heavy, taking an electric power 500KV transformer station as example, conventionally there are tens battery limits, and the subject that each battery limits have tens needs to take, at present, shooting personnel take subject according to subjective experience, and shooting efficiency is low, and working strength is large, also easily subject is clapped and omitted to mistake, its former because: subject One's name is legion, wherein similar subject is many, and a lot of dissimilar electric power subject profile is approximate, sometimes also need to take from multiple angles, easily leak and clap or mistake bat.And, user is the puzzled cognition of subject imaging form etc. under to correct shoot part position, shooting angle always, this depends on user's subjective idea and experience, cause at present if guarantee that the quality detecting needs the thinking of shooting limit, limit, shooting speed is very slow, if pick up speed, easily omits crucial position or the subject defect of taking, affect the effect of state estimation.Conventionally need the practice accumulation of several years, user just can reach higher detection level.
Have such technology, adopt the digitized image of collected by camera, employing picture signal processing element detects in real time, recognition and tracking target, and 200710072483.6 disclose such picture system.
But, but the subject that need to take in the application of image taking is numerous, how to convert suitable subject identifying information, and detecting specific shot body and being one has problem to be solved.
Therefore, understand need a kind of image capturing device, it can convert subject identifying information easily, can detect in captured image whether there is specific shot body image, when specific shot body image being detected, represent that the quality of this image can meet the requirement of subject identifying information (for example template), has ensured that the form of shot object image is correct, avoid omitting crucial shooting position or subject defect, thereby made the simple to operate of shooting; Maybe can also notify user, be beneficial to further analyze, storage etc. processes or operation.
Summary of the invention
The invention provides a kind of image recognition control device and image recognition control method, subject identifying information based on customizing messages association, detects in captured image, whether to have specific shot body image, and, according to the clooating sequence of customizing messages, switch easily subject identifying information.Or also in the time specific shot body image being detected, notify user.Thus, user's technical requirement is reduced, shooting quality and speed improve, and working strength lowers.
For this reason, by the following technical solutions, image recognition control device, comprising in the present invention:
Image acquiring unit, for obtaining continuously image data frame;
Information storage part, for pre-stored customizing messages and associated subject identifying information thereof;
Feature register, for registering subject identifying information;
Identification part, for according to the subject identifying information of feature register registration, carries out Check processing based on obtained image data frame;
Switch instruction unit, switch instruction for sending;
Described feature register, for responding the instruction of switching instruction unit, based on the clooating sequence of customizing messages, switches registered subject identifying information; And described identification part, for according to the subject identifying information after switching, carries out Check processing to obtained image data frame.
Image recognition control method of the present invention, comprising:
Image acquisition step, for obtaining continuously image data frame;
Feature register step, for based on the pre-stored customizing messages of information storage part and associated subject identifying information thereof, registers subject identifying information;
Identification step, for according to the subject identifying information of feature register step registration, carries out Check processing based on obtained image data frame;
Switch instruction step, switch instruction for sending;
Described feature register step, for responding the instruction of switching instruction step, based on the clooating sequence of customizing messages, switches registered subject identifying information; And described identification step, for according to the subject identifying information after switching, carries out Check processing to obtained image data frame.
Brief description of the drawings:
Fig. 1 is the block diagram that represents the summary formation of the image capturing device 100 of the example of the image recognition control device of embodiments of the invention 1.
Fig. 2 is the external form figure of the image capturing device 100 of embodiment 1.
Fig. 3 is the schematic diagram of subject information, the subject identifying information etc. stored in embodiment 1 storage medium.
Fig. 4 is the schematic diagram of detection window.
Fig. 5 is the schematic diagram that multiple detection windows detect.
Fig. 6 is the display case of the display interface of the processing procedure of embodiment 1.
Fig. 7 is the control flow chart that represents embodiment 1.
Embodiment
To describe with reference to the accompanying drawings now exemplary embodiments of the present invention in detail.Note, the embodiment that below will illustrate is for understanding better the present invention, thus do not limit the scope of the invention, and can change the various forms in scope of the present invention.And, although the present invention in following examples for the image picking-up apparatus of hand-held, shoot function not necessarily, can use the arbitrary image data source that will carry out special object survey for the present invention.Therefore the present invention is widely used in and reads and play or show document image or receive and process the image processing equipment of image from outside.Described image processing equipment comprises devices as various in personal computer, personal digital assistant etc.
Customizing messages (subject information) and the associated subject identifying information thereof of the image capturing device 100 of embodiment 1 based on storing in information storage part, the instruction of instruction unit is switched in response, based on the clooating sequence of customizing messages, switch registered subject identifying information; And described identification part, for according to the subject identifying information after switching, carries out Check processing to obtained image data frame.And image capturing device 100, based on detected specific shot body image, is notified user.
Fig. 1 is the block diagram that represents the summary formation of the image capturing device 100 of the example of the image recognition control device of embodiments of the invention 1.
Particularly, image capturing device 100 has shoot part 1, interim storage part 2, flash memory 3, communication I/F4, storage card I/F5, storage card 6, image processing part 7, identification part 8, display control unit 9, display part 10, control part 11, operating portion 12, control part 11 are connected with above-mentioned appropriate section with data bus 13 by controlling, and are responsible for the overall control of image capturing device 100.
Taking visible ray filming apparatus as example, a kind of embodiment, shoot part 1 is made up of not shown optics, lens driving parts, imageing sensor, signal pre-processing circuit etc.Optics is made up of optical lens, and shot object image incides imageing sensor from optics.Lens driving parts drive lens to carry out according to the control signal of control part 11 and focus on or zoom operation, in addition, also can be the optics of manual adjustments.Imageing sensor is for example made up of cmos type imageing sensor etc., and the shot object image by optics is converted to electric signal.Signal pre-processing circuit comprises sample circuit, A/D convertor circuit etc., by the electric signal producing from imageing sensor under the cycle of regulation, sample, the signal processing such as automatic gain control, AD conversion; The result of various signal processing is, generating digital picture signal.In the present embodiment, shoot part 1 is as the example of shoot part, for taking acquisition (numeral) picture signal.The processing of image processing part 7 for the picture signal obtaining by shoot part 1 is specified, the image data frame of acquisition image; For example implement the various image processing such as white balance compensation processing, Y compensation deals, YC conversion process, generate the image data frame being formed by digitized luminance signal and colour difference signal.In addition, based on the control of control part 11, image processing part 7 is for obtaining image data frame by picture signal processing according to the rules, and then this image data frame is recorded to as storage card 8 recording mediums such as grade.Image processing part 7 can adopt DSP or other microprocessors or programmable FPGA etc. to realize, or, also can be integrated with control part 11 or for same microprocessor.Be not limited to visible ray filming apparatus, for various types of filming apparatus, the processing of image processing part 7 is that data image signal is converted to the processing that is suitable for showing data such as using, record is used.
In the time that image capturing device 100 is various dissimilar imaging device, there is the difference of optics, imageing sensor etc., and the difference of image processing method formula.While being thermal imaging device as image capturing device 100, a kind of embodiment, shoot part 1 is made up of not shown optics, lens driving parts, infrared eye, signal pre-processing circuit etc.Optics is made up of infrared optics lens, for the infrared radiation of reception is focused on to infrared eye.Lens driving parts drive lens to carry out according to the control signal of control part 11 and focus on or zoom operation.Infrared eye, as the infrared focal plane detector of refrigeration or non-refrigeration type, is converted to electric signal the infrared radiation by optics.Signal pre-processing circuit comprises sample circuit, A/D convertor circuit etc., by the signal of reading from infrared eye under the cycle of regulation, sample, the signal processing such as automatic gain control, be converted to numeral (heat) picture signal through A/D convertor circuit.The processing that image processing part 7 specifies for (heat) picture signal to obtaining by shoot part 1, the processing of image processing part 7, as correction, interpolation, pseudo-coloured silk, compression, decompress(ion) etc., is converted to the processing that is suitable for showing data such as using, record is used.Wherein, the processing of (heat) picture signal Heat of Formation image (infrared thermal imagery) is as pseudo-color processing, a kind of embodiment, determine corresponding pseudo-colored steel scope according to the setting range of the scope of (heat) picture signal AD value or AD value, the view data by the concrete color value of the AD value of (heat) picture signal correspondence in pseudo-colored steel scope as respective pixel position in heat picture (infrared thermal imagery).
Above-mentioned these differences do not cause the significant difference of embodiment below.The thought of the following examples is applicable to general image capturing device, as various types of imaging devices such as visible ray filming apparatus, thermal imaging device, ultraviolet filming apparatus, laser image forming apparatus.In an embodiment, shoot part 1 is as the example of acquisition unit.
So-called image data frame, can be picture signal (the AD Value Data that image detector output signal obtains after AD conversion), or the view data of image, or other data that generate based on picture signal etc.So-called image data frame is taking picture signal as example hereinafter.
Flash memory 3, stores the program for controlling, and the various data that use in each several part control.In an embodiment, the information storage part using flash memory 3 as storage subject information etc. (also other be connected with image capturing device 100 or the storage medium that is arranged on image capturing device 100 as storage card 8 etc.) example.
In the present embodiment, (hereinafter referred to as table 3) as shown in Figure 3, the data relevant with identifying processing etc. are stored in flash memory 3, for example store the database (table 3) of subject identifying information, the judgment value of the subject information of each subject, subject identifying information, regulation is mutually corresponding, be stored in this property data base, in addition, also can store with the data file of specific format etc.At this, in the pre-stored table 3 in flash memory 3 of the judgment value of regulation, but also can prepare for other modes, as the judgment value of user's setting.
Wherein, subject information is the information relevant with subject, for example represent the information of subject place, type, numbering etc., in addition, can also exemplify the various information such as the relevant ownership unit of subject, classification grade (as electric pressure, important level etc.), model, manufacturer, performance and characteristic, the shooting in past or the resume of maintenance, build date, term of life.A kind of preferred implementation of storage subject information, subject information is made up of the attribute information of multiple attributes, as the subject information in table 4 " transformer station's 1 battery limits 1 equipment I A phase " has the attribute information that transformer station's attribute is corresponding " transformer station 1 ", the attribute information " battery limits 1 " that battery limits attribute is corresponding, the attribute information " equipment I " that device type attribute is corresponding, the attribute information " A phase " that separate attribute is corresponding.But be not limited to this, also can other forms store subject information as single attribute information.
Preferably, information storage part, for pre-stored multiple subject information of having added clooating sequence, wherein said clooating sequence has represented the clooating sequence between the plurality of subject information, multiple refer to two or more than.At this, information storage part indication can be the storage medium in image capturing device 100, as non-volatile memory mediums such as flash memory 9, storage cards 6, and the and for example volatile storage medium such as interim storage part 2; Can also be and wired or wireless other storage mediums that are connected of image capturing device 100, as by with storage medium in communication I/F4 wired or wireless other memory storages or other camera, the computing machine etc. that carry out communication being connected.Preferably, by pre-stored subject information in image capturing device 100 or in connected non-volatile memory medium.
Clooating sequence represents the clooating sequence that these subject information are additional, clooating sequence is discernible sequencing information, the discernible sequencing informations such as for example numeral, letter, coding, preferably, clooating sequence has represented the shooting order of subject corresponding to these subject information of having added clooating sequence, clooating sequence can set in advance at outer computer or in image capturing device 100, for example according to the shooting path of the subject in transformer station, subject information is carried out the clooating sequence of the representative shooting order of layout formulation, the mode of layout, the subject information with clooating sequence (typing order) of for example typing according to the rules order typing subject information acquisition, the numeral that represents clooating sequence is for example set, for example layout ordering rule is (as the ordering rule of time, the ordering rule etc. of letter) obtain the subject information of having added clooating sequence.
In addition, clooating sequence also can by the sequence portion of image capturing device 100, (control part 11 has sequence portion, not shown) realize, for example for example,, by the key word sequence of customizing messages (subject information), such as numeric sorting rule, letter sequence rule, Chinese pinyin ordering rule, Chinese stroke sorting rule and user carry out the artificial customizing messages sorting after the sequence obtaining etc. to key word.
Communication I/F4 is for example according to communication specifications such as USB, 1394, networks, image capturing device 100 is connected to the also interface of exchanges data with external device (ED), as external device (ED), for example, can enumerate personal computer, server, PDA(personal digital assistant device), other image capturing device, visible ray filming apparatus, memory storage etc.
Storage card I/F5, as the interface of storage card 6, on storage card I/F5, be connected with the storage card 6 as rewritable nonvolatile memory, be arranged in the draw-in groove of image capturing device 100 main bodys, according to data such as the control recording image data frames of the record control unit of control part 11 (omitting diagram) detachable.
The processing of image processing part 7 for the image data frame obtaining by shoot part 1 is specified, for example it is when the each arrival of Displaying timer, from be stored in the image data frame of stipulated time of described interim storage part 2 temporarily, select and read the frame of each specific time interval; The processing of image processing part 7 is as correction, interpolation, pseudo-color, synthetic, compression, decompress(ion) etc., is converted to and is suitable for showing the processing of using etc. data with, record.Image processing part 7 for example can adopt DSP or other microprocessors or programmable FPGA etc. to realize, or, also can be integrated with identification part 8, control part 11.
The image data frame of identification part 8 based on obtaining, carries out the relatedness computation between subject identifying information; So-called view data, can be picture signal (AD value), or the view data of image, or other data that obtain based on picture signal etc.; For example, the image data frame obtaining can be taken by reading the shoot part 1 of storing in interim storage part 2 in identification part 8, or by reading the image processing part stored in interim storage part 2, shoot part 1 is taken to the data that the image data frame that obtains carries out predetermined processing acquisition, the Check processing of the degree of correlation between the subject identifying information of carrying out and registering.The data that can be also outside input obtain by predetermined processing, for example, by the I/F4 image data frame that decoding obtains from other image capturing devices receive.Also can from recording medium, obtain, for example reading images file and obtaining from storage card 6.
So-called subject identifying information can be the template data for template matches; In addition, subject identifying information can be also the characteristic quantity of parametric description, so-called characteristic quantity features such as () point, line, surface, for example, for the value determining according to the state of the pixel comprising in detection window, as be central point, the area etc. of the profile of mean value, the specific shot body of ratio, the pixel value of the established part pixel in particular detection window.For example, for the subject 1 in table 3, subject identifying information is template data 301, and for the subject 3 in table 3, subject identifying information is characteristic quantity 303.In concrete application, can according to circumstances select the wherein combination of one or more modes.
Detection window setting unit, for arranging detection window.For example, according to the surveyed area of certain limit (as the G1 in Fig. 5), in this surveyed area G1, multiple detection windows are set, it can be the detection window of multiple different sizes, also can be the detection window after a nearly step tilts, as shown in Figure 4, the detection window that wherein Fig. 4 (a) is standard, Fig. 4 (b) is the detection window according to minification, Fig. 4 (c) is the detection window that up-sizing arranges, and Fig. 4 (d) is angle tilts to arrange according to the rules detection window.In order to equal the size of detection window, template image to be to dwindle or to amplify or the state that also tilts is used herein, or, also can prepare and template image that sizes of memory equals window size in order to using.In addition, also can by the view data in detection window with dwindle amplify or also tilt state used, with corresponding templates image.Detection window is not limited to square, can be also other shape, for example, can determine according to the shape of template.
Surveyed area also can be arranged according to taking custom by user; Or can be also prestore as with subject information association; Also can generate according to the position identifying last time; Surveyed area also can be set, and the scope of default image Frame is surveyed area.Also can be that position and the size that user specifies arranges multiple detection windows.In addition, and nonessential multiple detection windows are set, a detection window also can be only set.
It should be noted that the application for image taking, for example, in transformer station, be flooded with a large amount of profiles similar, but the different equipment of title, for avoiding misleading user and mistake is taken, surveyed area is preferably set.The mark of overlapping demonstration surveyed area (as shown in Figure 6 (b)) on image, user is easy to understand approximate location, the size etc. of captured shot object image, is convenient to take reference.But surveyed area also can not show.
Detecting unit, based on the control of control part 11, from interim storage part 2 reads image data frames, by the view data based in the set detection window of detection window setting unit in read image data frame, according to subject identifying information, obtain the value for evaluating the degree of correlation.In the time being provided with multiple detection window, for example can be using the value of maximal correlation degree that wherein detects acquisition as the value of the degree of correlation of this image data frame.
The Check processing of identification part 8 can be the detection mode based on template matches, and the view data based in detection window and template image carry out calculating and the comparison of the degree of correlation; For example, detecting unit calculate image in detection window and as the image of template mutually the difference between the pixel of corresponding position and, the difference calculating and less, the degree of correlation is higher.
Also can be configured to and extract the embodiment that mates of characteristic quantity, utilize and relatively carry out to determine the degree of correlation between the characteristic quantity of the view data in template and detection window.For example, extract the ratio of the specific pixel of the subject image in detection window, more approaching with the ratio of the specific pixel in template image, the degree of correlation is higher.
The Check processing of identification part 8 can be also the detection embodiment of the characteristic quantity based on parametric description, the computing specifying obtains the characteristic quantity of the view data in detection window, and compare with the reference value (subject identifying information) of characteristic quantity, obtain the value of the degree of correlation.For example, the ratio of the pixel that the reference value of described characteristic quantity is particular pixel values, the ratio of the pixel of particular pixel values in detecting unit computed image data, compares with the reference value of characteristic quantity, obtains the value of the degree of correlation between the two.
Preferred mode, adopt the template of contour images as coupling, identification part 8 for example comes in inspection image data frame, whether to have specific shot body by following processing, first, the view data that is arranged in detection window is extracted in identification part 8, according to the reservation threshold of AD value, the view data in the detection window reading is carried out to binaryzation; Then, extract the Contiguous graphics that the pixel with predetermined pixel value (1 or 0) of this bianry image is connected; Then judge whether this Contiguous graphics has the size of preset range; If judge the size of this Contiguous graphics in preset range, a nearly step is carried out relatively processing between the Contiguous graphics extracting and the template registered, for example calculate overlapping area between the two the ratio sum in the total area separately, thus, obtain the degree of correlation between the view data of extracting and template.
Judging unit, judges degree of correlation judgment value according to the rules; For example, in the time searching the value of the degree of correlation of the similar degree between template and exceeded the judgment value of regulation, the view data in this window is judged as with this template image similar, determines and specific shot body detected.
For the example detecting, as shown in Figure 5, identification part 8 from the upper left corner of the regulation surveyed area G1 of image data frame 501 to lower right corner moving window J1 to detect, the view data in cutout window, and detect the degree of correlation of itself and template image T1.Particularly, window J1 for example, moves with the window shifts (pixel) of setting to the right step by step from left end, and arriving after right-hand member, is set up and returns to left end and move down window shifts, and again move right step by step subsequently.For detecting accurately subject, the transformation range at window size, the window shifts detecting, the angle of inclination of window is predefined, the variation range of for example window size is from 150 × 50 pixel to 120 × 40 pixels, the variation range of window shifts is from 10 pixel to 1 pixels, and the variation range at the angle of inclination of window is 0 ° to 10 ° based on central point.Successively, each 5 pixels ground changes window size in identification part 8, and each 1 pixel ground changes window shifts, and each 2 ° of ground change window angle of inclination.The relatedness computation of template image T1 and image data frame 501 is carried out in identification part 8; After the detection that completes all detection windows, therefrom select the value of the degree of correlation that detection window that the degree of correlation is the highest obtains, as the value of the degree of correlation of these image data frame 501 correspondences.
Note, can, based on subject identifying information, carry out the whole bag of tricks of the degree of correlation of computed image Frame, the above-mentioned processing exemplifying be only can using method example.
In addition,, according to the difference of application, in the time calculating the provisioning information relevant with specific shot body, identification part 8 also can be configured to the structure of removing judging unit.
And, control part 11 has the instruction unit of switching 11A, be used for sending switching and indicate, described switching instruction can be that user sends by operating portion 12, but also can be sent by miscellaneous part, the trigger pip that other devices that for example reception is connected with image capturing device 100 send, switches instruction and send; Also can be by for example identification part 6, in the time specific shot body image being detected, send and switch instruction, also can there be other processing element such as analysis portion, diagnosis portion, the recording unit (not shown) etc. of image capturing device 100 after the processing specifying, switch instruction unit 11A, send and switch instruction.
And control part 11 has feature register 11B, for registering the subject identifying information relevant for relatedness computation; And, described feature register, the instruction of instruction unit 11A is switched in response, based on the clooating sequence of customizing messages, switches registered subject identifying information.For example, according to the clooating sequence of customizing messages, in the time receiving switching instruction, switch to the subject identifying information of next the customizing messages association in clooating sequence, this identifying information is registered as to the subject identifying information for identifying processing.The subject identifying information of registering is for example stored in the assigned position of interim storage part 2, or when storage is distinguished with other subject identifying informations of mark and storage.
And control part 11 has selection portion (not shown), select subject information for the subject information of storing from information storage part; Can be the selection of response user to shown subject indication information, select subject information.Also can respond the instruction of switching instruction unit, according to the clooating sequence based on subject information, switch selected subject information.
Display control unit 9, is presented at display part 10 for the view data of demonstration use that interim storage part 2 is stored.For example, in shooting standby mode, show continuously the image of taking the image data frame generation obtaining; At playback mode, show the image of reading and expanding from storage card 6, in addition, also can show various set informations.Particularly, display control unit 9 has VRAM, VRAM control module, signal generation unit (not shown) etc., and, signal generation unit is under the control of control part 11, from VRAM, regularly read image data frame (reading and store into the image data frame of VRAM from interim storage part 2), the output of generation vision signal, is presented at display part 10.In image capturing device 100, display part 10 is for example liquid crystal indicator.Be not limited to this, display part 10 can also be other display device that are connected with image capturing device 100, and can there is no display part in the electrical structure of image capturing device 100 self.Based on the control of control part 11, display control unit, for the subject information of storing based on information storage part, shows the subject indication information of the subject information acquisition of specified quantity; And preferred mode, shows subject indication information and the image of subject information acquisition jointly.
In addition, in an embodiment, display part 10, in the time the image data frame of the degree of correlation with the judgment value that is greater than regulation being detected, is notified; Except indicating the position of shot object image in the mode of mark, for example warn with writings and image, show the information of the degree of correlation, for example show the image that the image data frame of maximal correlation degree in the stipulated time obtains, or be also accompanied by word, image transparent rate, color, size, flicker, the mode such as variation notify.Wherein, the information of the degree of correlation, for example the value of the degree of correlation can be scaled signal matching degree be convenient to user understand information, show; For example the value of the degree of correlation being scaled to number percent as example (according to the table of comparisons of the regulation of the value of the degree of correlation and number percent), can be also other mode, for example, show the value of calculating the degree of correlation.Preferably, the information of the degree of correlation can be presented in mark.
In addition, the mode of notice can be also by the vibrating mass in image capturing device 100, pilot lamp (not shown), analysis component (not shown), deagnostic package (not shown), based on the control of control part 11, in the time the image data frame of maximal correlation degree being detected, also can produce light by pilot lamp and change, produce vibrations by vibrating device, be analyzed and display analysis result by analysis component, diagnosed and shown diagnostic result by deagnostic package, the colour of image changes; Or simultaneously in the above described manner one or more notified, as long as the appreciable mode of user all can.Wherein, the mode of notice can continue official hour.
Operating portion 12: carry out various instruction operations for user, or input the various operations such as set information, control part 11, according to the operation signal of operating portion 12, is carried out corresponding program.With reference to figure 2, operating portion 12 is described, provides that button that user operates records that key 1, focusing key 2, acknowledgement key 3, playback key 4, menu are strong 5, directionkeys 6 etc.; In addition, also can adopt touch-screen 7 or speech recognition component (not shown) etc. to realize relevant operation.
The variation of the display interface in shooting process is described with reference to figure 6, the control flow of the detecting pattern of image capturing device 100 is described referring to Fig. 7.This application scene is taken the subject of transformer station as user's hand-held image filming apparatus 100.The control program of control part 11 based on storage in flash memory 3, and the various data that use in each several part control, controlled the overall action of image capturing device 100 and the control of execution various modes processing.After switching on power, control part 11 carries out the initialization of internal circuit, then, enters standby screening-mode, and shoot part 1 is taken and obtained image data frame, is stored in interim storage part 2; Shoot part 1 is taken the processing that the image data frame of acquisition specifies by image processing part 7, be stored in the regulation region of interim storage part 2, on display part 10, show continuously image with dynamic image form, at this state, control part 11 is implemented its control, whether persistent surveillance has been switched to the processing of other patterns or has carried out power-off operation according to scheduled operation, if had, enters corresponding processing controls.The control step of detecting pattern is as follows:
Steps A 01, obtains image data frame, for example, the instant shoot part 1 acquisition image data frame of taking is sent to interim storage part 2; Control part 11 reads the subject information of the specified quantity that will show from the table 3 of flash memory 3 according to clooating sequence; Display part 10 shows the image that the subject indication information of these subject Information generations and the image data frame that shoot part shooting obtains generate; As shown in Figure 6 (a).Wherein, the subject indication information obtaining according to subject information, can be that the partial information of the whole of subject information or regulation obtains, and can predetermine in subject information the formation of the information for obtaining subject indication information.
Preferred embodiment, will in subject information, be used for generating the provisioning information of subject indication information, tree-shaped demonstration is carried out in position according to the rules.Particularly, display control unit has tree structure allocation units, for distributing level and the attribute information corresponding to each level of tree structure; The attribute information of the subject information based on storing in storage medium, when described display control unit makes display part show the image of described image data frame generation, level and the attribute information corresponding to each level of the tree structure that the attribute information of the subject information of specified quantity is distributed according to tree structure allocation units show.The for example subject indication information in Fig. 6 display interface, display control unit is divided into three layers of position display according to the rules by subject indication information according to the attribute information that represents transformer station, battery limits, device type and separate regulation attribute; Compared with being shown as a row with the subject indication information in display interface, obviously, same row's number of words reduces, and user is convenient to observe and select.
User's image space, size, angle in the morphological feature of shot object image and the image at its place of can puzzling is in the past to ensure shooting quality specification; User has carried out the selection to subject indication information; When user is according to the cognition of the subject to floor " transformer station's 1 battery limits 1 equipment I B phase ", for example check on-the-spot equipment direction board, by operating portion 11(as touch-screen, or directionkeys) 601 shown " transformer station's 1 battery limits 1 equipment I A phases " on display part 10 are selected.Enter steps A 02.
In addition, be not limited to user's selection, selection portion also can, according to read subject information, according to putting in order of subject information, be selected the subject information of sort first (or position is for example given tacit consent in miscellaneous stipulations position) automatically.
Steps A 02, selection portion response user's selection operation, has just selected the subject information corresponding with this subject indication information; Then, show especially the subject indication information of this subject information acquisition.At this, the common demonstration in display interface of subject indication information and image, can also further be superimposed upon the subject indication information of selected subject information acquisition or subject indication information in image, as shown in the image display window 602 in Fig. 6.
At this, show especially, refer to, with user can be from the subject indication information of specified quantity the mode of cognitive selected subject indication information, show selected subject indication information.For example, adopt the difference of being convenient to display position that user distinguishes, color, background, size, font, explanatory note etc. to be used as the special display mode of the subject indication information that is different from other.As shown in the subject indication information display window 602 in Fig. 6, control part 11 is controlled, and user's's selected " equipment I B phase " underscore mark, to be different from other subject indication information.
And, the template data 301 of feature register 11B registration for mating.For example, the table 3 of control part 11 based on storage in flash memory 3, the subject indication information of subject Information generation is presented to display part 10, when user is according to the subject of floor " subject 1 ", select " subject 1 " shown on display part 10 by operating portion 12, feature register 11B is according to user's selection, just determined to be used for the subject identifying information of coupling, from flash memory 3, read template data 301, be sent to interim storage part 2.
Then, in steps A 03, detection window setting unit, reads image data frame, arranges detection window.For example, the upper left corner of the surveyed area G1 based on regulation, is first provided with detection window;
Steps A 04, carries out the processing of the relatedness computation between view data and the subject identifying information in detection window.
In steps A 05, identification part 8 judges while detection window being set in image data frame whether calculated the degree of correlation for all detection windows.If the region (being no in steps A 05) that residue is not also calculated the degree of correlation, gets back in steps A 03, detection window setting unit is in a predetermined direction by the position skew intended pixel number of detection window, this position is set to the next position of detection window, and repeats follow-up processing.
In addition, from image data frame search with like template class when frame part, when amplifying and dwindle and detection window is tilted to detection window after predetermined angular, the Check processing that also carries out similar above-mentioned explanation.
If calculated the degree of correlation (being yes in steps A 05) for all detection windows that will arrange in image data frame, the value of maximal correlation degree detecting and the location parameter of corresponding detection window are remained on to the regulation region of interim storage part 2 in steps A 06.
And, in steps A 07, if the degree of correlation is less than the judgment value of regulation, identification part 8 judges and specific shot body image do not detected, jump to steps A 09, as do not switched instruction (A09: no) and exiting (A11: no), get back to steps A 01, continue to show image and subject information, at this moment, user can adjust image capturing device 100, aiming at subject takes, as shown in Fig. 6 (b), owing to the shot object image of coupling not detected in surveyed area G1, do not notify instruction or the notice of mark.When the degree of correlation detecting in steps A 07 is greater than the judgment value of regulation, enter steps A 08.
Steps A 08, at this, the processing specifying, for example, carry out notifier processes, according to the position generating identification of the detection window of degree of correlation maximum, for example, directly according to the position of detection window and size generating identification B1.For example, the image of the mark of generation and the acquisition of this image data frame is synthesized as overlapping, then show, mark B1 as shown in Figure 6 (c) and mark BJ.
The processing of regulation can be in the various processing such as transmission processing of notifier processes, recording processing, analyzing and processing, diagnostic process, data more than one or one.
Steps A 09, has judged whether to switch instruction, and for example user, after above-mentioned finishing dealing with, is sent and switched instruction by operating portion 12; In addition, also can be completed after above-mentioned processing by image capturing device 100, send and switch instruction; Or, also can, after steps A 07 detects specific shot body image, before predetermined processing, automatically send and switch instruction, the processing then specifying again.
Instruction is switched in response, get back to steps A 01, instruction is switched in selection portion response, according to the clooating sequence based on subject information, switch selected subject information, as shown in Fig. 6 (d), display part 10 shows especially: transformer station's 1 battery limits 1 equipment I B phase, and the subject identifying information (template data 302) that feature register 11B is associated the 1 battery limits 1 equipment I B of transformer station, is registered as the subject identifying information of identifying processing.Then, repeat above-mentioned processing.
Steps A 11, as finished, exits.
Like this, the image data frame that continuous shooting is obtained, in the time specific shot body image being detected, for example, in the time detecting that the degree of correlation exceedes the image data frame of judgment value of regulation, can constantly notify user, according to the just essential morphological feature by artificial subjective judgement shot object image etc. of the user of the subject that detects, can reach and alleviate shooting workload, avoid taking the beneficial effect of error location, angle.
It is pointed out that the image data frame that identification part 8 obtains continuously based on acquisition unit, detect whether there is specific shot body image, and calculate the relevant provisioning information of specific shot body image; For example, can be that the image data frame to obtaining continuously all carries out Check processing successively, the image data frame that also can only read predetermined distance carries out Check processing; Or before being detected, the view data in the image data frame reading or detection window carries out dwindling processing; With this, can alleviate the processing load that is accompanied by detection.
And, generate the image that is arranged in the mark of the position of image with this specific shot body image of embodiment, be not limited to the image that this frame image data that detects shot object image is obtained and the mark generating thus and obtain, image and this mark that also the image data frame of the new acquisition of follow-up specified quantity can be obtained obtain.
And described customizing messages must not be subject information, can be also the information of clooating sequence.
Or, specific shot object image whether detected to taking, be not limited to the comparison between value and the judgment value of the degree of correlation, also variable more for example according to the comparative result that detects the provisioning information that obtains and/or evaluation of estimate and corresponding fiducial value, as the foundation that specific shot body image detected.The position of such as specific shot body image of described provisioning information, size, angle of inclination, assay value (the such as ratio of temperature value, character pixel etc.), with the value of the degree of correlation of subject identifying information in a kind of information of or combination in any.
And in the present embodiment, subject indication information shows jointly with image all the time, wherein also can overlap in image and show; Or jointly do not show all the time, but operation based on user just shows the subject indication information of specified quantity; Or do not show.
As mentioned above, in the present embodiment, due to the subject information by having added clooating sequence and associated subject identifying information thereof, can be convenient to user and select subject information according to field apparatus situation, thereby registration subject identifying information, is convenient to identifying processing.And in the time specific shot body image being detected, notify, for example position to shot object image wherein etc. is notified, and user observes this mark, just knows to have taken satisfactory shot object image, can carry out next step storage, analysis etc. to process and operation; Then, by the switching of sequence, can be easily take according to the special subject information showing, and the switching of subject identifying information, the subject identifying information of registration recognition processing easily; Can reach and significantly reduce the operation easier that vision is aimed at, significantly reduce the beneficial effect of the physical strength of taking, increase substantially shooting efficiency.Set the surveyed area of regulation, can be convenient to user and understand the scope of shooting, be convenient to take the image of high-quality; Common user easily grasps this shooting technical ability.
And upper embodiment is only example, the invention is not restricted to this.Structure in the above-described embodiments and operation can change as required.
And, to specific shot object image whether being detected, be not limited to the comparison between value and the judgment value of the degree of correlation, also variable more for example according to the comparative result that detects the provisioning information that obtains and/or evaluation of estimate and corresponding fiducial value, as the foundation that specific shot body image detected.The position of such as specific shot body image of described provisioning information, size, angle of inclination, assay value (the such as ratio of temperature value, character pixel etc.), with the value of the degree of correlation of subject identifying information in a kind of information of or combination in any.
And, can not only detect the overall region of whole subject, and detect the multiple detection windows that subject are divided into multiple parts formations, like this, can more accurately detect; Wherein, for each parts, identical with entirety, prepare corresponding subject identifying information (can be template or characteristic quantity).
Aspect of the present invention can also by stay alone and the program of executive logging on memory storage carried out the computing machine (or such as CPU, MPU etc. device) of the system or equipment of the function of above-described embodiment and by its step by the computing machine of system or equipment by for example reading with executive logging the program on memory storage and carrying out the function of above-described embodiment and the method for intellectual realizes.For this purpose, for example, via network or from for example, as in various types of recording mediums (, computer-readable medium) of memory storage program or subject information, subject identifying information etc. being provided to image capturing device 100.
Although, can realize the functional block in accompanying drawing by hardware, software or its combination, conventionally do not need to arrange the structure of carrying out practical function piece with man-to-man corresponded manner.Can realize by a software or hardware module the piece of multiple functions.
Claims (10)
1. image recognition control device, comprising:
Image acquiring unit, for obtaining continuously image data frame;
Information storage part, for pre-stored customizing messages and associated subject identifying information thereof;
Feature register, for registering subject identifying information;
Identification part, for according to the subject identifying information of feature register registration, carries out Check processing based on obtained image data frame;
Switch instruction unit, switch instruction for sending;
Described feature register, for responding the instruction of switching instruction unit, based on the clooating sequence of customizing messages, switches registered subject identifying information; And described identification part, for according to the subject identifying information after switching, carries out Check processing to obtained image data frame.
2. image recognition control device as claimed in claim 1, is characterized in that, described customizing messages is subject information.
3. image recognition control device as claimed in claim 1, is characterized in that, has sequence portion, for described customizing messages is sorted.
4. image recognition control device as claimed in claim 2, is characterized in that having
Selection portion, for selecting subject information;
Display part, for showing the subject indication information of subject information acquisition of specified quantity, wherein, in the mode showing especially, shows according to the subject indication information of the selected subject information acquisition of selection portion;
Wherein, described selection portion, for responding the instruction of switching instruction unit, according to the clooating sequence based on subject information, is switched selected subject information.
Feature register, registers subject identifying information for the subject indication information of selecting according to selection portion.
5. image recognition control device as claimed in claim 1, it is characterized in that, described identification part, obtained image data frame is carried out to Check processing, detect the provisioning information relevant with specific shot body image, described provisioning information at least comprises the information of a kind of or combination in any in the value of position, size, angle of inclination, similarity of specific shot body image.
6. image recognition control device as claimed in claim 1, is characterized in that, Check processing is carried out to obtained image data frame in described identification part, detects in described image data frame, whether to have specific shot body image.
7. image recognition control device as claimed in claim 6, is characterized in that, described identification part detects in described image data frame, whether to have specific shot body image according to the surveyed area specifying in image data frame.
8. image recognition control device as claimed in claim 5, is characterized in that, provisioning information relevant with specific shot body image in described image data frame is detected according to the surveyed area specifying in image data frame in described identification part.
9. the image recognition control device as described in claim 1-8, is characterized in that, has predetermined processing portion, the instruction of respective specified, in the processing that record, notify, analyze, diagnosis, data sends more than one or one.
10. image recognition control device, comprising:
Image acquisition step, for obtaining continuously image data frame;
Feature register step, for based on the pre-stored customizing messages of information storage part and associated subject identifying information thereof, registers subject identifying information;
Identification step, for according to the subject identifying information of feature register step registration, carries out Check processing based on obtained image data frame;
Switch instruction step, switch instruction for sending;
Described feature register step, for responding the instruction of switching instruction step, based on the clooating sequence of customizing messages, switches registered subject identifying information; And described identification step, for according to the subject identifying information after switching, carries out Check processing to obtained image data frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310742851.9A CN103902967A (en) | 2012-12-27 | 2013-12-27 | Image identification control device and image identification control method |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210583911.2 | 2012-12-27 | ||
| CN201210583911 | 2012-12-27 | ||
| CN201310742851.9A CN103902967A (en) | 2012-12-27 | 2013-12-27 | Image identification control device and image identification control method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103902967A true CN103902967A (en) | 2014-07-02 |
Family
ID=50994280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310742851.9A Pending CN103902967A (en) | 2012-12-27 | 2013-12-27 | Image identification control device and image identification control method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103902967A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113792737A (en) * | 2020-12-22 | 2021-12-14 | 华润水泥技术研发（广西）有限公司 | Method for testing retention time of materials in cement mill based on image recognition technology |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101505372A (en) * | 2008-02-06 | 2009-08-12 | 凹凸电子（武汉）有限公司 | System and method for optimizing camera settings |
| CN101867708A (en) * | 2009-04-15 | 2010-10-20 | 奥林巴斯映像株式会社 | Photography device, display device, reproduction device, photography method and display method |
| CN102147856A (en) * | 2010-02-10 | 2011-08-10 | 佳能株式会社 | Image recognition apparatus and its control method |
| CN102538980A (en) * | 2012-01-12 | 2012-07-04 | 杭州美盛红外光电技术有限公司 | Thermal image device and shooting method for thermal image |
-
2013
- 2013-12-27 CN CN201310742851.9A patent/CN103902967A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101505372A (en) * | 2008-02-06 | 2009-08-12 | 凹凸电子（武汉）有限公司 | System and method for optimizing camera settings |
| CN101867708A (en) * | 2009-04-15 | 2010-10-20 | 奥林巴斯映像株式会社 | Photography device, display device, reproduction device, photography method and display method |
| CN102147856A (en) * | 2010-02-10 | 2011-08-10 | 佳能株式会社 | Image recognition apparatus and its control method |
| CN102538980A (en) * | 2012-01-12 | 2012-07-04 | 杭州美盛红外光电技术有限公司 | Thermal image device and shooting method for thermal image |
Non-Patent Citations (1)
| Title |
|---|
| 徐晶 等: "《计算机视觉中的运动检测与跟踪》", 30 September 2012 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113792737A (en) * | 2020-12-22 | 2021-12-14 | 华润水泥技术研发（广西）有限公司 | Method for testing retention time of materials in cement mill based on image recognition technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103900715A (en) | Infrared selecting device and infrared selecting method | |
| CN104677504A (en) | Decision-making device and decision-making method | |
| CN104215336A (en) | Thermal-image device, thermal-image analyzing device, thermal-image shooting method and thermal-image analyzing method | |
| CN103949054A (en) | Infrared light gun positioning method and system | |
| CN104748862A (en) | Analyzing device and analyzing method | |
| CN103900714A (en) | Device and method for thermal image matching | |
| CN103900712A (en) | Device and method for selecting thermal image | |
| KR102386982B1 (en) | Method and apparatus for camera calibration using image analysis | |
| CN103900711A (en) | Infrared selecting device and infrared selecting method | |
| CN103902967A (en) | Image identification control device and image identification control method | |
| CN103900713A (en) | Device and method for detecting thermal image | |
| CN103428434B (en) | Infrared photographing apparatus and infrared photographing method | |
| CN103900716A (en) | Device and method for identifying and controlling thermal image | |
| CN103900703A (en) | Infrared matching updating device and infrared matching updating method | |
| CN105224896A (en) | Pen recorder, treating apparatus and recording method, disposal route | |
| CN103900705A (en) | Thermal image selection notification device and thermal image selection notification method | |
| CN105208299A (en) | Thermal image shooting device, thermal image processing device, thermal image shooting method and thermal image processing method | |
| CN104748863A (en) | Infrared analysis area setting device and infrared analysis area setting method | |
| CN103900698A (en) | Infrared identification control device and infrared identification control method | |
| CN104751445A (en) | Thermal image analysis configuration device and thermal image analysis configuration method | |
| CN104655638A (en) | Analytical comparison device and analytical comparison method | |
| CN105120165A (en) | Image acquisition control method and device | |
| CN103900706A (en) | Infrared selection notification device and infrared selection notification method | |
| CN103900717A (en) | Device and method for identifying thermal image | |
| CN103900709A (en) | Thermal image selection notification device and thermal image selection notification method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 310030 Building 1, qixianqiao village, Liangzhu street, Yuhang District, Hangzhou City, Zhejiang Province Applicant after: Mission Infrared Electro-optics Technology Co., Ltd. Address before: 310030 Zhejiang city of Hangzhou province Xihu District city Hongkong No. 386 thick Renlu 14 Building 3 floor Applicant before: Mission Infrared Electro-optics Technology Co., Ltd. |
|
| CB02 | Change of applicant information |