CN105391971B - Image processing apparatus, image processing system and image processing method - Google Patents

Image processing apparatus, image processing system and image processing method Download PDF

Info

Publication number
CN105391971B
CN105391971B CN201510494581.3A CN201510494581A CN105391971B CN 105391971 B CN105391971 B CN 105391971B CN 201510494581 A CN201510494581 A CN 201510494581A CN 105391971 B CN105391971 B CN 105391971B
Authority
CN
China
Prior art keywords
image
frame
detection zone
sudden inspiration
region
Prior art date
Application number
CN201510494581.3A
Other languages
Chinese (zh)
Other versions
CN105391971A (en
Inventor
大村庆二
长谷川健
Original Assignee
株式会社理光
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2014170735 priority Critical
Priority to JP2014-170735 priority
Priority to JP2015-041577 priority
Priority to JP2015041577A priority patent/JP6554825B2/en
Application filed by 株式会社理光 filed Critical 株式会社理光
Publication of CN105391971A publication Critical patent/CN105391971A/en
Application granted granted Critical
Publication of CN105391971B publication Critical patent/CN105391971B/en

Links

Abstract

The present invention relates to image processing apparatus and image processing system and image processing method, and its object is to freely generate to judge having a sudden inspiration opportunity for waiting time benchmark as image.Image processing apparatus of the invention includes have a sudden inspiration region specifying part (305), on display device (317) in the display area of video data, specified region of having a sudden inspiration, for determining the opportunity of having a sudden inspiration;Change point test section (306), for obtaining the frame before and after the time that the time point in specified region of having a sudden inspiration resets the frame of the video data of display in specified time limit, and the difference of pixel value between each frame and the previous frame of the frame is calculated, the change point in the image in region of being had a sudden inspiration according to the Differential Detection;And generating unit of having a sudden inspiration (313), in the region of having a sudden inspiration for showing on video display unit, compare the image in the region of having a sudden inspiration of the frame of difference image and video data, to have a sudden inspiration for opportunity, generation is had a sudden inspiration signal.

Description

Image processing apparatus, image processing system and image processing method

Technical field

The present invention relates to image processing apparatus, image processing system and image processing methods.

Background technique

Image processing system is used to analyze the video data that the photographic devices such as video recorder are recorded, and detects and analyzes The movement of object and exception or production video in target object or video image.In recent years, the image monitoring system of this purposes Development progress is significant.Such as image monitoring system record check disclosed in patent document 1 (JP Laid-Open 07-248214 bulletin) The video of object, the signal occurred with check device (such as inspection signal of proximity sensor or photoelectric sensor etc.) is touching Machine, when have a sudden inspiration occur when, judgement image is carried out according to the frame of the video data of recording.Technical solution disclosed in patent document 1 exists When needing to carry out image judgement, in the frame for the composition video data that recorded, inspection object is found from previous frame and is gone out Frame in the normal position of present image judgement, carries out image judgement to the frame found.

But the signal that the technical solution of the description of patent document 1 is occurred using check device is had a sudden inspiration as what image judged, thus It is fixed in the presence of the opportunity having a sudden inspiration, it is difficult to the problem of opportunity is adjusted flexibly.

Summary of the invention

It is an object of the present invention in view of the above problems, one kind is provided and can freely be generated judges waiting time as image Image processing apparatus, image processing system and the image processing method on the opportunity of having a sudden inspiration of benchmark.

In order to achieve the above object, the present invention provides a kind of image processing apparatus, wherein having with lower module: display mould Block;Playback module, the video data playback for shooting photographic device are shown to the display module;Region of having a sudden inspiration is specified Module, for specifying region of having a sudden inspiration in the first display area of the display module for showing the video data;Detect mould Block, on the basis of the time point that the module region of having a sudden inspiration is specified in the region of having a sudden inspiration, from the time point The first specified time limit in the video data in, the change point in the image in region of having a sudden inspiration described in detection, and extract the change The image having a sudden inspiration in region described in the frame for changing point, as the first image;And generation module, for that will show the camera shooting In second display area of the display module of the video data of device shooting, the image having a sudden inspiration in region and described the One image is compared, and is had a sudden inspiration according to comparison result generation.

Effect of the invention is that being capable of providing a kind of can freely generate judges having a sudden inspiration for waiting time benchmark as image Opportunity.

Detailed description of the invention

Fig. 1 is the overall structure schematic diagram of image processing system of the present embodiment.

Fig. 2 is an example hardware configuration module map of the information processing unit of first embodiment.

Fig. 3 is the functional block diagram of the information processing unit of present embodiment.

Fig. 4 is an example key frame shown in the display device of information processing unit of the present embodiment, wherein Show multiple live videos.

Fig. 5 is to show video data on the setting screen of display device in information processing unit that first embodiment is related to The schematic diagram of state.

Fig. 6 is the video in the information processing unit that first embodiment is related to, in the setting screen of display device An example schematic diagram in region of having a sudden inspiration is specified on display unit.

Fig. 7 is in the information processing unit that first embodiment is related to, on the setting screen that shows on the display apparatus The schematic diagram that an example label when finding the change point in region of having a sudden inspiration is shown.

Fig. 8 is the schematic diagram that first embodiment detects change point movement in region of having a sudden inspiration.

Fig. 9 is in the information processing unit that first embodiment is related to, on the setting screen that shows on the display apparatus The schematic diagram for an example display dialogue having a sudden inspiration when finding two o'clock change point in region.

Figure 10 is in the information processing unit that first embodiment is related to, on the setting screen that shows on the display apparatus The schematic diagram for an example display dialogue having a sudden inspiration when not finding change point in region.

Figure 11 is used in the setting screen that shows in the display device for the information processing unit that first embodiment is related to An example schematic diagram of detection zone is specified on video display unit.

Figure 12 is used in the setting screen that shows in the display device for the information processing unit that first embodiment is related to An example schematic diagram of second detection zone is specified on video display unit.

Figure 13 is choosing in the setting screen shown in the display device for the information processing unit that first embodiment is related to Select an example schematic diagram of the state in the region of having a sudden inspiration set with the different video data of the video data shown from video display unit.

Figure 14 is choosing in the setting screen shown in the display device for the information processing unit that first embodiment is related to An example of the state after the region of having a sudden inspiration set with the different video data of the video data shown from video display unit is selected Schematic diagram.

Figure 15 is referred in the setting screen shown in the display device for the information processing unit that first embodiment is related to An example schematic diagram of the state in the region of having a sudden inspiration of the fixed video data setting different with the video data shown from video display unit.

Figure 16 is in the setting screen shown in the display device for the information processing unit that first embodiment is related to, An example schematic diagram of the attribute information of appointed detection zone is set on video display unit.

Figure 17 is changed on the setting screen shown in the display device for the information processing unit that first embodiment is related to Become an example status diagram for the detection zone size specified on video display unit.

Figure 18 is changed on the setting screen shown in the display device for the information processing unit that first embodiment is related to Become an example status diagram for the area size of having a sudden inspiration specified on video display unit.

Figure 19 be shown in the display device for the information processing unit that first embodiment is related to, an example sensitivity determinating The schematic diagram of the state of video data is shown in preview screen.

Figure 20 be shown in the display device for the information processing unit that first embodiment is related to, sensitivity determinating preview Image is extracted on picture and detects the schematic diagram of an example judging result of difference between benchmark image.

Figure 21 be shown in the display device for the information processing unit that first embodiment is related to, it is pre- in sensitivity determinating It lookes on picture with different sensitivity to extracting image and detect showing for an example judging result that difference rejudges between benchmark image It is intended to.

Figure 22 be shown in the display device for the information processing unit that first embodiment is related to, it is pre- in sensitivity determinating The schematic diagram for the whether suitable an example dialog box of sensitivity look on picture after confirmation reorganization.

Figure 23 be shown in the display device for the information processing unit that first embodiment is related to, an example setting picture Reflect the schematic diagram of the sensitivity after changing in sensitivity determinating preview screen on face.

Figure 24 be in the display device for the information processing unit that first embodiment is related to an example for showing in setting screen The set action flow chart of upper specified have a sudden inspiration region and detection zone.

Figure 25 is on the key frame that shows of display device for the information processing unit that first embodiment is related to, by touching The schematic diagram of state after machine region and detection zone are specified.

Figure 26 is that an example image for the information processing unit that first embodiment is related to judges action flow chart.

Figure 27 is had a sudden inspiration on the key frame shown in the display device for the information processing unit that first embodiment is related to The signal of the display state and detection zone in the region of having a sudden inspiration the display state of machine when detecting when having a sudden inspiration in region Figure.

Figure 28 be in the setting screen shown in the display device for the information processing unit that first embodiment is related to not The schematic diagram of an example dialog box occurred when can detect benchmark image in specified region.

Figure 29 is the schematic diagram of the change point detection operation in the region of having a sudden inspiration for describe second embodiment.

Figure 30 is to specify touching in the display device of information processing unit of the second embodiment on the setting screen that shows The set action flow chart in machine region and detection zone.

Specific embodiment

Image processing apparatus of the invention, image processing system and image processing method are described below with reference to attached drawing Embodiment.It should be pointed out that following embodiments do not limit the invention.Comprising being led to the present invention in embodiment It is element that is obvious, substantially identical and belonging to so-called impartial scope for the technical staff in domain.In turn, allow It in the subject area for not departing from following embodiments, omits, the various elements in displacement, change and combination embodiment.

" first embodiment "

The overall structure > of < image processing system

Fig. 1 is the overall structure diagram for the image processing system that first embodiment is related to.This is described below with reference to Fig. 1 The overall structure for the image processing system 1 that embodiment is related to.

As shown in Figure 1, the image processing system 1 of present embodiment include photographic device 2a~2f, information processing unit 3, And network 4.

Photographic device 2a~2f is video recorder, and for the light from subject is converted to electric signal, shooting subject is raw At the animated video data for being constituted (such as 10FPS) with multiple image data.For example, photographic device 2a~2f shoots product manufacturing Production equipment, video data is generated, for the exception that occurs in testing product work.

Here, these photographic devices are commonly referred to as photographic device in the case where not needing to distinguish photographic device 2a~2f again 2.Image processing system 1 in Fig. 1 has six photographic devices, but the photographic device 2 that image processing system of the invention has Quantity be not limited thereto.

Information processing unit 3 is personal computer or work station etc., for the video data that is shot based on photographic device 2 come Judge image.Information processing unit 3 is connect with peripheral hardwares 10 such as manufacturing equipments, can be communicated according to such as Fieldbus specifications.It closes It will be described in detail below in the image judgement processing based on video data.

Network 4 uses Ethernet (registered trademark) specification, for connecting photographic device 2a~2f and information processing unit 3. Network 4 is counted according to agreements such as TCP (Transmission Control Protocol)/IP (Internet Protocol) According to communication.Photographic device 2a~2f and information processing unit 3 have the MAC Address for being used to be communicated according to ICP/IP protocol, But also it is endowed the IP address such as private ip address.Network 4 is specifically configured to for example star-like wiring mode, with LAN (Local Area Network) photographic device 2a~2f and information processing unit 3 be connected respectively to the switch with multiple ports by conducting wire On terminal

Network 4 shown in FIG. 1 is for according to TCP/IP communication, but the present invention is not limited thereto, such as can also be with Multiple GA (Video Graphics Array) terminal or USB (Universal are equipped with using 3 one side of information processing unit Serial Bus) port, image of multiple camera 2 is respectively by VGA conducting wire or USB conducting wire link information processing unit.

" hardware configuration of information processing unit "

Fig. 2 is an example hardware configuration module map of the information processing unit of first embodiment.This is described below with reference to Fig. 2 The hardware configuration of the information processing unit 3 of embodiment.

As shown in Fig. 2, information processing unit 3 has 101, ROM (Read CPU (Central Processing Unt) Only Memory) 102, RAM (Random Access Memory) 103, external memory 104, display 105, network connect Mouth 106, keyboard 107, mouse 108, DVD (Digital Versatile Disc) driver 109 and Peripheral Interface 111.

CPU101 is used to control information processing unit 3 on the whole and acts.ROM102 is for saving information processing unit 3 Program non-volatile memory device.RAM103 is intended for the volatile storage of the working region CPU101.

External memory 104 is the various data such as video data and set information for saving the shooting of photographic device 2 HDD (Hard Disk Drive) or the storage devices such as SSD (Solid State Drive).

Display 105 is used to the various information such as display highlighting, menu, window, text or image, is also used to show at information Manage the picture that device 3 executes image judgement processing application software.Such as CRT (Cathode Ray Tube) display, liquid can be used Crystal display, plasma display or organic EL (Electroluminesence) display etc. are used as display 105.It can use VGA line or HDMI (registered trademark, High-Definition Multimedia Interface) line etc. or Ethernet line Display 105 is connected on information processing unit 3.

Network interface 106 is the interface that information processing unit 3 connects that network 4 carries out data communication, for example, according to TCP/ The NIC (Network Interface Card) of the protocol communication of IP.Specially information processing unit 3 is via network 4 and network Interface 106 obtains video data from photographic device 2.

Keyboard 107 is the input unit for inputting text and number, selection various instructions and set information.Mouse 108 It is for selecting and executing various instructions, selection process object, mobile cursor and the input unit for selecting set information.

DVD drive 109 be used to control from can removable storage media such as DVD110 read or write-in data.

Peripheral Interface 111 connect with peripheral hardware 10 for image processing apparatus 3 and carries out data communication, for for example according to live total The interface card of line gauge lattice communication.Specifically, information processing unit 3 carries out data communication in peripheral hardware 10 via Peripheral Interface 111.

Above-mentioned CPU101, ROM102, RAM103, external memory 104, display 105, network interface 106, keyboard 107, mouse 108, DVD drive 109 and Peripheral Interface 111 mutually can with the connection of the buses such as address wire or data line 112 Communication.When display 105 is with the connection of Ethernet line, it is connected with network interface 106, it is logical to carry out data according to agreements such as TCP/IP Letter.

The modular structure > of < information processing unit

Fig. 3 is the functional block diagram of the information processing unit of present embodiment.Below with reference to Fig. 3 description information processing unit 3 modular structure.

As shown in figure 3, information processing unit 3 has video receiving part 301, storage unit 302, input unit 303, the first weight Put portion 304 (playback module), region specifying part 305 of having a sudden inspiration (specifying module in region of having a sudden inspiration), (the detection mould of change point test section 306 Block), detection zone specifying part 307 (detection zone specifies module), configuration part 308 (setting module), the second reproduction unit 309, figure As extraction unit 310, difference judging part 311, video distribution portion 312, generating unit of having a sudden inspiration 313 (generation module), detection zone judgement Portion 314 (detection zone judgment module), display control section 315, external output section 316 (external output module), display device 317 (display module).

Video receiving part 301 is to carry out data communication via network 4 and photographic device 2, receives video counts from photographic device 2 According to functional module.The video data received is saved in storage unit by video receiving part 301.With network interface 106 shown in Fig. 2 Realize the function of video receiving part 301.To put it more simply, the explanation of network 4 is omitted in Fig. 3.

Storage unit 302 is the storage device for saving video data and various set informations etc..Storage unit 302 can identify view The video data that frequency receiving part 301 receives is that the data which photographic device 2 generates save the data later.With such as Fig. 2 Shown in RAM103 or external memory 104 realize the function of storage unit 302.

The operation input that input unit 303 is used to that information processing unit 3 allow to carry out image procossing, by shown in Fig. 2 Keyboard 107 and mouse 108 realize.

First reproduction unit 304 is the view that will obtain from storage unit 302 according to the operation signal of the input unit of user's operation Frequency allows display control section 315 that video data is reset to the function being shown in display device 317 according to display control section 315 is sent to Energy portion.Specifically, the first reproduction unit 304 is set what the display device that video data playback is shown to the descriptions such as following figure 5 was shown Determine on the video display unit 502 of picture 500.Use-case CPU101 as shown in Figure 2 executes program to realize the first reproduction unit 304 Function.

Region specifying part 305 of having a sudden inspiration is the operation signal inputted according to user's operation input unit 303, in display device It is specified in the display area (the video display unit 502 described in Fig. 5 below) of 317 video data and is used to determine the opportunity of having a sudden inspiration Region of having a sudden inspiration functional module.Region specifying part 305 of having a sudden inspiration is by the information preservation in specified region of having a sudden inspiration to storage unit 302 In.The information in region in this of having a sudden inspiration refers to, for example, the regional location that indicates to have a sudden inspiration in the display area of video data coordinate and It has a sudden inspiration the information such as shape in region.Program is executed with CPU101 shown in Fig. 2 to realize the function for region specifying part 305 of having a sudden inspiration.

Change point test section 306 is the function part with following function, i.e., specifies and have a sudden inspiration in region specifying part 305 of having a sudden inspiration In the case where region, obtain before the time that the first reproduction unit 304 resets the frame of the video data of display at the specified time point Frame in specified time limit afterwards, and calculate the difference (first of the pixel value between each frame of acquirement and the previous frame of the frame Difference), and then according to the difference found out, detect the change point in region of having a sudden inspiration in image.It will be described in more detail below about change point. About the calculating of difference, such as compare the pixel value that two frames are had a sudden inspiration in region, finding out pixel value, to reach regulation sensitivity or more poor The Volume Composition of different pixel, this is total as difference.When frame is black white image, pixel value is consistent with gray value, thus The gray value in region of having a sudden inspiration between two frames can also be compared, find out the pixel number that gray value reaches the above difference of regulation sensitivity Amount adds up to, this is total as difference.And when frame is the image constituted with rgb pixel value, compare R (red), G (green), B The pixel value of any one color, then same as described above in (orchid), finds out the picture that pixel value reaches the above difference of regulation sensitivity The Volume Composition of element, this is total as difference.In turn, edge detection process is carried out to the image of frame, finds out marginal portion It is total, this is total as difference.Program is executed with CPU101 shown in Fig. 2 to realize the function of change point test section 306.

Detection zone specifying part 307 is the operation signal inputted according to user's operation input unit 303, specifies detection zone Functional module, the detection zone be the video data in display device 317 display area (video display area 502) in inspection It surveys abnormal image and judges process object.Detection zone specifying part 307 is by the information preservation of specified detection zone to storage unit In 302.The information of detection zone in this refers to, such as the coordinate of detection zone position is indicated in the display area of video data With the information such as the shape of detection zone.In addition, as will be described, detection zone specifying part 307 can be in video data Display area in specify multiple detection zones.Program is executed with CPU101 shown in Fig. 2 to realize detection zone specifying part 307 function.

Configuration part 308 is the operation signal inputted according to user's operation input unit 303, sets set information and will set Functional module of the information preservation to storage unit.Configuration part 308 will also need information to be shown in the set information in storage unit 302 It is sent to display control section 315, allows display control section 315 that set information to be shown in display device 317.With shown in Fig. 2 CPU101 executes program to realize the function of configuration part 304.

Second reproduction unit 309 is the view that will obtain from storage unit 302 according to the operation signal of the input unit of user's operation Frequency allows display control section 315 that video data is reset to the function being shown in display device 317 according to display control section 315 is sent to Energy portion.It is drawn specifically, the second reproduction unit 309 is used to the sensitivity determinating preview in the display device 317 shown in following figure 19 etc. On the video display unit 702 in face 700, display video data is reset.Program is executed with CPU101 shown in Fig. 2 to realize second The function of reproduction unit 309.

Image zooming-out portion 310 is display area (the video display unit that the video data of display is reset from the second reproduction unit 309 702) in, the function of the image (extracting image) of part corresponding with the detection zone that detection zone specifying part 307 is specified is extracted Module.Program is executed with CPU101 shown in Fig. 2 to realize the function in image zooming-out portion 310.

Difference judging part 311 is to detect benchmark for calculating the image in the detection zone of detection zone specified time Image, the functional module for extracting the difference between image extracted with image zooming-out portion 310.According to above-mentioned change point test section 306 calculation methods carry out Difference Calculation.Program is executed with CPU101 shown in Fig. 2 to realize the function of difference judging part 311 Energy.

Video distribution portion 312 is to receive video receiving part 301 according to the operation signal of the input unit of user's operation Live video data is sent to display control section 315, and display control section 315 is allowed to show the function of video data in display device 317 It can module.Specifically, video data is assigned to master in display device 317 shown in following figure 4 and Figure 25 by video distribution portion 312 It is shown on video display unit 401a to 401f in picture 400.Program is executed with CPU101 shown in Fig. 2 to realize video point Function with portion 312.

Generating unit of having a sudden inspiration 313 is that video display unit 401a to 401f has a sudden inspiration on the key frame 400 shown in following Figure 25 In region, by comparing the image in the specified region of the frame of difference image and video data, having a sudden inspiration, the time generates signal of having a sudden inspiration Functional module.Program is executed with CPU101 shown in Fig. 2 to realize the function for generating unit 313 of having a sudden inspiration.

Detection zone judging part 314 be receive have a sudden inspiration generating unit 313 generation have a sudden inspiration signal when setting time before Detection benchmark image (the second figure or after setting time, in the detection zone of more above-mentioned video display unit 401a to 401f Picture) and video data frame detection zone image, judge whether there is abnormal functional module.With shown in Fig. 2 CPU101 executes program to realize the function of detection zone judging part 314.

Display control section 315 is the functional module for controlling 317 display of display device movement.Display control section 311 has Video data that body obtains the first reproduction unit 304 and the second reproduction unit 309, the set information set of configuration part 308, area of having a sudden inspiration Domain specifying part 305 it is specified have a sudden inspiration region and the specified detection zone etc. of detection zone specifying part 307 is shown to video distribution In portion 312.The function of program (driver etc.) Lai Shixian display control section 315 is executed with CPU101 shown in Fig. 2.

External output section 316 is exported to peripheral hardware 10 different in the case where the judgement of detection zone judging part 314 is abnormal The functional module of regular signal.External output section 316 is Peripheral Interface 111 shown in Fig. 2.External output section 316 is set herein to export Abnormal signal, but the present invention is not limited thereto, can also send autoexec using portion 316 is output to the outside, to Exception is notified with lettergram mode, or notifies on key frame 400 abnormal to occur (such as to be flashed with emergency warning lamp icon come table Show) etc. measures.

Display device 317 is used to show various data according to the control of display control section 315.It shows in the present embodiment Device 312 program executed by CPU101 shown in Fig. 2 come show following application software pictures 400, setting screen 500, with And sensitivity determinating preview screen 70.Display device 317 is the display 105 of Fig. 2.

In addition to software, can also with ASIC (Application Specific Integrated Circuit) or The hardware circuits such as FPGA (Field-Programmable Gate Array) realize the first reproduction unit 304 shown in Fig. 3, touching Machine region specifying part 305, change point test section 306, detection zone specifying part 307, configuration part 308, the second reproduction unit 309, figure As extraction unit 310, difference judging part 311, video distribution portion 312, generating unit of having a sudden inspiration 313, detection zone judging part 314 and show Show part or all of function in control unit 315.

Present embodiment only illustrates the first reproduction unit 304, region specifying part 305 of having a sudden inspiration, change point test section 306, inspection Survey region specifying part 307, configuration part 308, the second reproduction unit 309, image zooming-out portion 310, difference judging part 311, video distribution Portion 312, generating unit of having a sudden inspiration 313, the concept of detection zone judging part 314 and display control section 315, the structure is not to this hair It is bright to be construed as limiting.

Below for convenience, 315 data received of display control section are shown in display device 317 simply indicates To be shown on display device 317 (or display picture of display device 317).For example, describing the first reproduction unit 304 for video Data are sent to display control section 315, allow display control section 315 when resetting display in display device 317, are simply expressed as the Video data is sent to display device 317 and resets display by one reproduction unit 304.

< key frame constitutes >

Fig. 4 is an example key frame shown in the display device of information processing unit of the present embodiment, wherein Show multiple live videos.Below with reference to Fig. 4, the composition of key frame 400 and the display movement of multiple live videos are described.

CPU101 executes program (application software), and key frame 400 shown in Fig. 4 is shown in display device 317.Key frame The video data that live display is received from multiple photographic devices 2 on 400, in the specified region of having a sudden inspiration of region specifying part 305 of having a sudden inspiration In, generating unit of having a sudden inspiration 313 generates signal of having a sudden inspiration at the time point having a sudden inspiration.Key frame 400 is also received in detection zone judging part 314 Have a sudden inspiration signal when setting time before or setting time after, judge whether be abnormal in detection zone specifying part 307. As shown in figure 4, key frame 400 be equipped with video display unit 401, camera selector 401a to 401f, monitoring start button 411, Monitor stop key 412 and monitoring setting key 413.

Video display unit 401a to 401f is respectively intended to display video distribution portion 312 according to user's operation input unit 303 The operation signal of input, the live video data obtained by video receiving part 301 from photographic device 2a to 2f.Area is not being needed Other video display unit 401a to 401f or be referred to as when, simply be referred to as video display unit 401.

User's operation input unit 303 is pressed after monitoring start button 411 (equally effective with 108 clicking operation of mouse), depending on Frequency dispenser 312 shows live video data on video display unit 401a to 401f respectively.Also, press monitoring start button 411, after showing video data on video display unit 401, in the specified region of having a sudden inspiration of region specifying part 305 of having a sudden inspiration, life of having a sudden inspiration Generate and have a sudden inspiration signal at time point of having a sudden inspiration at portion 313, detection zone judging part 314 receive setting time when having a sudden inspiration signal it After preceding or setting time, judge whether be abnormal in detection zone.

User's operation input unit 303, after pressing monitoring stop key 412, generating unit of having a sudden inspiration 313 stops at the time having a sudden inspiration Point generates the generation movement for signal of having a sudden inspiration, and the stopping of detection zone judging part 314 judges that is whether be abnormal in detection zone sentences Disconnected movement, video distribution portion 312 stop the display movement of live video data.

User's operation input unit 303, after pressing monitoring setting key 412, configuration part 308 is shown in display device 317 Following setting screens shown in fig. 5 500.

The composition > of < setting screen

Fig. 5 is to show video data on the setting screen of display device in information processing unit that first embodiment is related to The schematic diagram of state.The composition of setting screen 500 is described below with reference to Fig. 5.

Setting screen 500 is used to refer to have a sudden inspiration surely region and detection zone, and sets what image in detection zone judged Sensitivity, threshold value and the picture at time point.As shown in figure 5, on setting screen 500 there is camera selector 501, video to show Key 503a, Pause key 503b, fast forward button 503c, rewind key 503d, stop key 503e, dragging item 504, sliding block are reset by portion 502 505, time showing portion 506, area information portion 507 of having a sudden inspiration, reference pictures display unit 508a, difference picture display unit 508b, inspection It surveys area information portion 509, detection zone key portion 510, read setting key 511, write-in setting key 512, setting reflection key, close key 51。

Camera selector 501 is for allowing user to select some needs from the video data of photographic device 2a~2f The video data of specified have a sudden inspiration region and detection zone, the operation module being shown on video display unit 502.For example, camera shooting dress The data for setting 2a~2f shooting respectively correspond 1~6, and selection 6 is shown in example shown in Fig. 5, that is, selects the view of photographic device 2f Frequency evidence.

Video display unit 502 is the operation signal weight inputted for the first reproduction unit 304 according to user's operation input unit 303 Put the display module for the video data that display is obtained from storage unit 302.In example shown in Fig. 5, when the camera of selection " 6 " selects After selecting portion 501, the video data of photographic device 2f shooting is shown in display device 317.

User's operation input unit 303 is pressed after resetting key 503a, and the first reproduction unit 304 starts to reset video display unit The video data of 502 displays.And user's operation input unit 303, after pressing Pause key 503b, the first reproduction unit 304 pause view The video data that frequency display unit 502 is being reset.User's operation input unit 303, after pressing fast forward button 503c, the first reproduction unit 304 quickly broadcast the video data that video display unit 502 is being reset.User's operation input unit 303 presses rewind key 503d Afterwards, the first reproduction unit 304 quickly refunds the video data that video display unit 502 is being reset.User's operation input unit 303, After pressing stop key 503e, the first reproduction unit 304 stops the video data that display video display unit 502 is being reset.

Dragging item 504 is bar shape, indicates video display unit according to the position for the sliding block 405 being arranged on dragging item 504 502 resetting among the video data corresponding time.Sliding block 505 is slide mass, with the playback of video display unit 502 It slides into corresponding with shooting time (shooting time of the frame shown) of video data reset on dragging item 404 Position.And if user's operation input unit 303 slides sliding block 405, the first reproduction unit 304 is on video display unit 502 The frame of the video data of the corresponding camera time in display dragging 504 top shoe of item, 505 position.

Time showing portion 506 is to reset display on video display unit 502 by the first reproduction unit 304 for showing The shooting date of video data and the display module of shooting time.

Have a sudden inspiration area information portion 507 be for show by the specified region of having a sudden inspiration of region specifying part 305 of having a sudden inspiration title, with And the sensitivity of above-mentioned change point and the display module of threshold value are detected for change point test section 306.Benchmark image display unit 508a It is the display module for showing the benchmark image of the extraction of change point test section 306.Difference image display unit 508b is for showing Show the display module for the difference image (by being described below) that change point test section 306 extracts.

Detection zone information portion 509 is for showing the title for the detection zone specified by detection zone specifying part 307, sense Degree, threshold value, detection delay time (delay time is expressed as in Fig. 5), monitoring method (being expressed as monitoring in Fig. 5), movement The method (Fig. 5 is expressed as image judgement) judged whether there is or not (being expressed as acting in Fig. 5) and image (will test in region below These information be known as attribute information) display module and selection operation module.

Detection zone key portion 510 is for editing specified by detection zone specifying part and being shown by detection zone information portion 509 The key group of the attribute information for the related detection zone shown.Detection zone key portion 510 judges selection key comprising action key 510a, image 510b, delete key 510c, sensitivity judge key 510d, sensitivity increasing key 510e, sensitivity reducing key 510f, threshold value increasing key 510g, Threshold value reducing key 510h.The function of each key in detection zone key portion 510 will be described below.

User's operation input unit 303 is pressed after reading setting key 511, and configuration part 308 reads and is stored in storage unit 302 In the set informations such as the information of have a sudden inspiration region and detection zone, the setting screen 500 that these set informations are shown it is each On a display unit.User's operation input unit 303, after pressing write-in setting key 512, configuration part 308 will be set on setting screen 500 The set informations such as the fixed information of have a sudden inspiration region and detection zone are saved in storage unit 302 (external memory 104).User Operation input device 303, after pressing reflection setting key 513, configuration part 308 makes the region of having a sudden inspiration set on setting screen 500 Keep effective before the closing of the application software such as key frame 400 and setting screen 500 with set informations such as the information of detection zone (such as being stored temporarily in RAM103).

User's operation input unit 303, after pressing close key 514, setting screen 500 is closed in configuration part 308, fills in display It sets and shows key frame 400 on 317.

< have a sudden inspiration region specified and change point detection >

Fig. 6 is the video in the information processing unit that first embodiment is related to, in the setting screen of display device An example schematic diagram in region of having a sudden inspiration is specified on display unit.Fig. 7 is in the information processing unit that first embodiment is related to, aobvious The schematic diagram that an example label when finding the change point in region of having a sudden inspiration on the setting screen shown on showing device is shown.Fig. 8 is First embodiment detects the schematic diagram of change point movement in region of having a sudden inspiration.Fig. 9 is the information being related in first embodiment In processing unit, an example when finding two o'clock change point in region of having a sudden inspiration on the setting screen that shows on the display apparatus is shown pair The schematic diagram of words.Figure 10 is the setting picture that shows on the display apparatus in the information processing unit that first embodiment is related to The schematic diagram for an example display dialogue being had a sudden inspiration when not finding change point in region on face.Below with reference to Fig. 6 to Figure 10, description is had a sudden inspiration Specified and change point the detection in region.

Setting screen 500 shown in fig. 6 is shown in the video display unit that the first reproduction unit 304 resets display video data The state in region 530 of having a sudden inspiration is specified on 502.It is specific as follows.Firstly, resetting the display video data phase on video display unit 502 Between time point for occurring of the image section had a sudden inspiration, user's operation input unit 303, after pressing Pause key 503b, the first weight It puts portion 304 and stops at playback display video data on video display unit 502, and show the time point in time showing portion 506 Frame shooting date and shooting time.Then, after user's operation input unit 303 (such as clicking operation mouse 108), area of having a sudden inspiration Domain specifying part 305 specifies region 530 of having a sudden inspiration on video display unit 502 (the first display area).

Setting screen 500 shown in Fig. 7 shows that change point test section 306 is had a sudden inspiration what region specifying part 305 of having a sudden inspiration was specified The state of change point is detected in region 530.It is specific as follows, firstly, specifying region of having a sudden inspiration in region specifying part 305 of having a sudden inspiration In the case where 530, first reproduction unit 304 of the acquirement of change point test section 306 resets the video data of display at the specified time point Frame of the specified time limit (such as front and back is during 2 seconds) in (the first stipulated time) before and after the shooting time of frame, and extract area of having a sudden inspiration The image in the region 530 of having a sudden inspiration of domain specified time point, using the image as benchmark image.Change point in this refers in area of having a sudden inspiration The time point of predetermined variation takes place in image in domain 530, which is used as having a sudden inspiration with the generation of generating unit 313 of having a sudden inspiration The benchmark of the time of signal.Change point test section 306 described below detects the detection method of change point.

As shown in figure 8, setting 13 frames (frame (0) to frame (12)) in the acquirement stipulated time of change point test section 306.This When, change point test section 306 obtains the frame in the front and back specified time limit centered on frame (6).For conveniently, will be touched in each frame The image of part corresponding to machine region 530 is also referred to as frame (0) to frame (12).Then, change point test section 306 calculates acquirement The difference of pixel value between each frame and the previous frame of the frame.The calculation method of difference is as described above.Fig. 8 (a) display variation The frame that point test section extracts, Fig. 8 (b) is the schematic diagram that the difference of each frame found out is shown according to timing.Display in Fig. 8 (b) Difference be that such as the difference of frame (1) is difference between the frame (1) and frame (0) before.As change point IN point and OUT point is defined as follows.That is, IN point refers in continuous frame, the time point of variation takes place in image in region 530 of having a sudden inspiration. OUT point refers to that in continuous frame, image starts over the time point of variation in region 530 of having a sudden inspiration.In addition, change point test section 306 calculate obtain each frames and the frame previous frame between difference, but the invention is not limited to calculate with it is previous Difference between a frame, for example, can also calculate frame and it is several before frame between difference.

Change point test section 306 finds out the candidate of IN point and the candidate of OUT point according to the difference of each frame.It is specific as follows, I.e. when the difference of continuous more than two frames reaches defined threshold (first threshold) or more, by initial difference reach defined threshold with On candidate frame of the frame as IN point.In the example shown in Fig. 8 (b), the difference of frame (1) is not up to threshold value, and the difference of frame (2) is More than threshold value, the difference of frame (3) is also threshold value or more.That is the difference of (3) two frames of frame (2) and frame continuously reaches threshold value or more, Thus, the frame (2) that initial difference reaches threshold value or more is the candidate frame of IN point.Equally, frame (7) is also the candidate frame of IN point.Such as Fruit is not continuous more than two frames, and the difference of only one frame reaches threshold value or more, then there may be impurity, because without handle Candidate frame of the frame as IN point.

On the other hand, change point test section 306 is not up to defined threshold (the first threshold in the difference of continuous more than two frames Value) in the case where, the initial frame of defined threshold is not up to as the candidate frame of OUT point using difference.The example shown in Fig. 8 (b) In, the difference of frame (4) is threshold value or more, and the difference of frame (5) is not up to threshold value, and the difference of frame (6) is also not up to threshold value.That is frame (5) and the difference of continuous two frames of frame (6) is not up to threshold value, thus, the frame (5) that initial difference is not up to threshold value is OUT point Candidate frame.Although frame (13) thereafter is not mentioned in change point test section 306 here, the difference of frame (12) is not up to threshold value Within the frame taken, therefore, frame (12) cannot function as the frame candidate of OUT point.If not continuous more than two frames, and only one The difference of a frame is not up to threshold value, then since there are the possibility of impurity, because without using the frame as the candidate frame of OUT point.

As described above, change point test section 306 determines the candidate frame of IN point and the candidate frame of OUT point in the example of Fig. 8, Frame (2) and frame (7) are the candidate frame of IN point, and frame (5) is the candidate frame of OUT point.It, will and in the case where multiple IN point candidate frames Frame of the frame, that is, frame (7) of intermediate frame (6) in the frame of acquirement as IN point.In the example of Fig. 8, the candidate frame of OUT point Only one frame, that is, frame (5), but it is identical as the candidate of IN point, also have the candidate frame of multiple OUT points.In this case, Change point test section 306 is identical as the candidate frame of IN point, and the frame of OUT will be set near the frame of the intermediate frame of the frame of acquirement.And In the example of Fig. 8, the candidate frame of OUT point only has frame (5), thus frame (5) is just set to the frame of OUT point by change point test section 306. As described above, frame of the change point test section 306 by the frame of decision IN point and OUT point from the frame in the specified time limit of acquirement, To detect change point (IN point and OUT point).In addition, change point test section 306 when detecting change point, can also use change point Expression is acted object to detect the movement object having a sudden inspiration in region 530 by the previous frame or following frame of frame or the frame of front and back Vector Message from which direction is saved in storage unit 302.In this case, the storage unit 303 of generating unit of having a sudden inspiration 313 The Vector Message of middle preservation, whether the direction of action to confirm movement object is consistent with the direction that Vector Message indicates, and according to true Result is recognized to generate information of having a sudden inspiration.

It is not limited to the above method with the detection method that change point test section 306 detects change point in region 530 of having a sudden inspiration, As long as the change point for time of origin of having a sudden inspiration can be limited, does not need mud and arrest in how detecting change point.

In addition, as described above, change point test section 306 is detecting that continuously more than two frames reach defined threshold or more When, initial difference is reached into the frame of defined threshold or more as the candidate frame of IN point.But the present invention is not limited thereto.Change speech It, is also possible to the difference of the frame of other quantity or more, rather than the difference of more than two frames, continuously reach defined threshold with On.This is applied equally to the candidate frame for determining OUT point.

The example that Fig. 8 is shown is while finding the frame of IN point and OUT point both sides.In this regard, change point test section 306 can also be with Only find the frame of IN point or the frame of OUT point.At this point, these IN points or OUT point are detected as change point.Change point test section 306 extract the image in region 530 of having a sudden inspiration in the frame of change point detected, using the image as difference image (the first image), And the difference image of the benchmark image of extraction and the frame of change point is saved in storage unit 302, in benchmark image display unit Benchmark image is shown on 508a, and shows difference image on difference image display unit 508b.In turn, change point test section 306 Label 540 of having a sudden inspiration is shown on part corresponding to the time of the frame of the change point detected in dragging item 504.It is examined in change point When survey portion 306 detects change point, region specifying part 305 of having a sudden inspiration is by the information preservation in specified region 530 of having a sudden inspiration to storage unit 302.Configuration part shows the specified region 530 of having a sudden inspiration named by region specifying part 305 of having a sudden inspiration having a sudden inspiration in area information portion 507 Title and the regulation sensitivity (such as 50) and defined threshold (such as 20%) that change point is detected for change point test section 306 (default value).About the name for 530 title of region of having a sudden inspiration, as shown in fig. 7, such as configuration part 308 uses " TR6 " as in " 6 " The title in the region 530 of having a sudden inspiration specified in the video data of photographic device (photographic device 2f).

Setting screen 500 shown in Fig. 9 is change point test section 306 in the specified area of having a sudden inspiration of region specifying part 305 of having a sudden inspiration The state of the change point selection dialog box 600 shown when detecting above-mentioned two change point (IN point and OUT point) in domain 530. In this way, change point test section 306 when detecting the above change point of two o'clock, shows change point selection pair in display device 317 Window 600 is talked about, for choosing whether to utilize closest in two change points (IN point and OUT point) of benchmark image extraction time Any one point is had a sudden inspiration to generate.Change point selects have selection IN point key 601 and selection OUT point key 602 on dialog box 600 And close key 603.Close key 603 is used to close change point selection dialog box 600.

When user's operation input unit 303, when pressing selection IN point key 601, change point test section 306 detects IN point, will The IN point extracts the image of the frame of IN point having a sudden inspiration in region 530, as difference image as change point.Then, change point is examined Difference image in the frame of the benchmark image of extraction and IN point is saved in storage unit 302 by survey portion 306, and aobvious in benchmark image Show and show benchmark image on portion 508a, difference image is shown on difference image display unit 508b, and then examine in dragging item 504 Label 540 of having a sudden inspiration is shown on part corresponding to the time of the frame of the IN point measured.

On the contrary, working as user's operation input unit 303, when pressing selection OUT point key 602, change point test section 306 is detected OUT point extracts the image of the frame of OUT point having a sudden inspiration in region 530, as difference image using the OUT point as change point.And Afterwards, the difference image in the frame of the benchmark image of extraction and OUT point is saved in storage unit 302 by change point test section 306, and Benchmark image is shown on benchmark image display unit 508a, shows difference image, Jin Er on difference image display unit 508b Label 540 of having a sudden inspiration is shown on part corresponding to the time of the frame of the OUT point detected in dragging item 504.Other movements are in Fig. 7 institute The above-mentioned movement shown is identical.

In this way, IN point and OUT point that change point test section 306 is detected be as change point, by allowing in user's selection Any point among two o'clock is stated, user can select to really need specified change point.

Setting screen 500 shown in Fig. 10 is not find region specifying part 305 of having a sudden inspiration in change point test section 306 to specify Have a sudden inspiration change point in region when the state without change point notification dialog window 610 that shows.In the movement of above-mentioned Fig. 8 description In, the difference that can also find out is not up to defined threshold, and change point test section 306 fails the case where detecting change point.? In this case, change point test section 306 shows unchanged notification dialog window 610 in display device 317, and expression is not looked for To change point.

There is OK key 611 and close key 612 on unchanged dialog box 610.Close key 612 is used to close unchanged point Dialog box 610.User's operation input unit 303, when pressing OK key 611, change point test section 306 does not have because of storage unit 302 Any information is saved, any image is not shown on benchmark image reality portion 508a and difference image display unit 508b, closes nothing Change point notification dialog window 610.

The setting > of specified and detection zone the attribute information of < detection zone

Figure 11 is used in the setting screen that shows in the display device for the information processing unit that first embodiment is related to An example schematic diagram of detection zone is specified on video display unit.Figure 12 is the information processing unit that first embodiment is related to It is used to specify an example schematic diagram of second detection zone in display device in the setting screen shown on video display unit.Figure 13 be in the setting screen shown in the display device for the information processing unit that first embodiment is related to, and selection is used and video An example schematic diagram of the state in the region of having a sudden inspiration of the different video data setting of the video data that display unit is shown.Figure 14 is In the setting screen shown in the display device for the information processing unit that one embodiment is related to, selected with video display unit An example schematic diagram of state after the region of having a sudden inspiration of the different video data setting of the video data of display.Figure 15 is first It is specified to be shown with video display unit in the setting screen shown in the display device for the information processing unit that embodiment is related to Video data it is different video data setting region of having a sudden inspiration state an example schematic diagram.Figure 16 is in first embodiment In the setting screen shown in the display device for the information processing unit being related to, appointed detection is set on video display unit An example schematic diagram of the attribute information in region.Below with reference to Figure 11 to Figure 16, the specified and detection zone of detection zone is described Attribute information setting.

Setting screen 500 shown in Figure 11 is shown in the video display unit that the first reproduction unit 304 resets display video data 502 middle fingers determine the state of detection zone 535.It is specific as follows.Firstly, the playback of video data is shown on video display unit 502 When occurring the image section for needing to carry out image judgement in period, user's operation input unit 303, after pressing Pause key 503b, First reproduction unit 304, which pauses on video display unit 502, revisits video data, and the time is shown in time showing portion 506 The shooting date and shooting time of the frame of point.Then, after user's operation input unit 303 (such as pulling mouse 108), detection zone Domain specifying part 307 shows detection zone 535 on video display unit 502.However, it is desirable in area information portion 507 of having a sudden inspiration It is chosen that by the specified region of having a sudden inspiration of region specifying part 305 of having a sudden inspiration, (in the case where in Figure 11 for TR6), detection zone is specified Portion 307 can specify detection zone 535.In other words, the specified detection zone 535 of detection zone specifying part 307 and area of having a sudden inspiration The region of having a sudden inspiration being selected in domain information portion 507 is associated.

Configuration part 308 shows the attribute information of detection zone 535 in detection zone information portion 509, i.e., by detection zone Specifying part name appointed detection zone 535, as default value following images judgement used in regulation sensitivity (such as " 50 ") and defined threshold (such as " 20% "), monitoring method (such as " gray scale "), have attonity (such as "None"), Yi Jitu As judgment method (such as " consistent ").When naming 535 title of detection zone, configuration part 308 as shown in figure 11, such as name with Have a sudden inspiration entitled " K61 " in associated first region in region " TR6 ".Configuration part 308 also calculates detection zone specifying part 307 The time of the frame of the time of specified detection zone 535, the change point that detects relative to change point test section 306 time prolong The slow time (is " 2.14 ") (judging the time) in Figure 11, and is shown the delay time as attribute information in detection zone information In portion 509.That is, in this case, being named as in the detection zone 535 of " K61 ", being set in the time of having a sudden inspiration Image judgement is carried out after " 2.14 " second.Configuration part 308 will test the category of the detection zone 535 shown in area information portion 509 Property information preservation is into storage unit 302.

Detection zone specifying part 307 extracts the specified time in specified detection zone 535, and the image of detection zone 535 is made It to detect benchmark image, and is saved in storage unit 302, the information of specified detection zone 535 is saved in storage unit 302. The display of setting screen 500 shown in Figure 12, on the video display unit 502 for resetting display video data by the first reproduction unit 304 Specify second detection zone, the i.e. state of detection zone 536.It is specific as follows, firstly, being reset on video display unit 502 aobvious Show in during (pause) video data, user's operation input unit 303, pull the sliding block 505 on dragging item 504, adjustment needs Carry out the display time point of the image section of image judgement.First reproduction unit 304 shows that video is aobvious in time showing portion 506 Show the shooting date and shooting time of the frame for the video data being suspended in portion 502.

Then, after user's operation input unit 303 (such as pulling mouse 108), detection zone specifying part 307 is aobvious in video Show second detection zone of display, i.e. detection zone 536 in portion 502.But identical when with specified detection zone 535, detection zone The needs of domain specifying part 307 have selected for being had a sudden inspiration by what region specifying part 305 of having a sudden inspiration specified in area information portion 507 of having a sudden inspiration In the case where region (being TR6 in Figure 12), detection zone 536 can be specified.In other words, detection zone specifying part 307 refers to The region of having a sudden inspiration being selected in fixed detection zone 536 and area information portion 507 of having a sudden inspiration is associated.

Configuration part 308 shows the attribute information of detection zone 536 in detection zone information portion 509, i.e., by detection zone Specifying part name appointed detection zone 536, as default value following images judgement used in regulation sensitivity (such as " 50 ") and defined threshold (such as " 20% "), monitoring method (such as " gray scale "), have attonity (such as "None"), Yi Jitu As judgment method (such as " consistent ").When naming 536 title of detection zone, configuration part 308 is as shown in figure 12, such as will be with touching The name nominating in associated first region in machine region " TR6 " is " K62 ".Configuration part 308 also calculates detection zone specifying part The time of the frame of the time of 307 specified detection zones 536 detects the time of change point relative to change point test section 306 Delay time (is " -1.86 ") in Figure 12, and shows the delay time as attribute information in detection zone information portion 509 On.In other words, it is set at this time in the detection zone 536 for being named as " K62 ", carries out image before the 1.86 seconds time of having a sudden inspiration Judgement.The attribute information that configuration part 308 will test the detection zone 536 shown in area information portion 509 is saved in storage unit 302 In.

Detection zone specifying part 307 extracts the image in the detection zone 536 of the specified time of specified detection zone 536, And using the image as detection benchmark image, it is saved in storage unit 302, specified detection zone is saved in storage unit 302 536 information.

The display of setting screen 500 shown in Figure 13, it is aobvious in the video that the first reproduction unit 304 is resetting display video data Show in portion 502, selection and the video counts for shooting the photographic device 2 that reset the photographic device 2 of video data of display different The state in appointed region of having a sudden inspiration in.Specific as follows, user's operation input unit 303 first presses area information of having a sudden inspiration After the drop-down key 507a in portion 507, there is the drop-down menu 507b under " zone name of having a sudden inspiration " column.Configuration part 308 is taken the photograph multiple As device 2 camera data in appointed area arrangement of having a sudden inspiration be shown in drop-down menu 507b.

The display of setting screen 500 shown in Figure 14, user's operation input unit 303 select to show in drop-down menu 507b Region of having a sudden inspiration in " TR2 ".Here, it is, for example, the photographic device to " 2 " that zone name of having a sudden inspiration, which is the region of having a sudden inspiration of " TR2 ", The specified region of having a sudden inspiration of the video data of (photographic device 2b).

It is specific as follows.Firstly, user's operation input unit 303, selection is had a sudden inspiration the drop-down menu 507b in area information portion 507 Some region of having a sudden inspiration in the region of having a sudden inspiration (having " TR2 " and " TR6 " in the example of Figure 13) of middle arrangement display (is in the example of Figure 14 "TR2").Then, configuration part 308 obtains the sensitivity in the region of having a sudden inspiration " TR2 " selected by input unit 303 from storage unit 302 And threshold value, and be shown to and have a sudden inspiration in area information portion 507.Due to being not present and having a sudden inspiration in the video data of the photographic device of " 6 " Region " TR2 " associated detection zone, therefore, the detection zone that configuration part 308 is shown on deleting detection zone information portion 509 The display of the attribute information in domain 535 and 536.In turn, change point test section 306 obtains region " TR2 " of having a sudden inspiration from storage unit 302 Benchmark image and difference image, and benchmark image and difference image are respectively displayed on benchmark image display unit 508a and difference On image displaying part 508b.

Setting screen 500 shown in figure 15 is shown in be shown by the video that the first reproduction unit 304 resets display video data Third detection zone, the i.e. state of detection zone 537 are specified in portion 502.It is specific as follows.Firstly, on video display unit 502 It resets in during display (pause) video data, user's operation input unit 303 pulls the sliding block 505 on dragging item 504, Adjustment needs to carry out the display time point of the image section of image judgement.First reproduction unit 304 is shown in time showing portion 506 The shooting date and shooting time of the frame for the video data being suspended on video display unit 502

Then, after user's operation input unit 303 (such as pulling mouse 108), detection zone specifying part 307 is aobvious in video Show and show third detection zone in portion 502, is i.e. detection zone 537.At this point, the detection zone that detection zone specifying part 307 is specified Region of having a sudden inspiration " TR2 " selected in domain 537 and area information portion 507 of having a sudden inspiration is associated.

Configuration part 308 shows the attribute information of detection zone 537 in detection zone information portion 509, i.e., by detection zone Specifying part name appointed detection zone 537, as default value following images judgement used in regulation sensitivity (such as " 50 ") and defined threshold (such as " 20% "), monitoring method (such as " gray scale "), have attonity (such as "None"), Yi Jitu As judgment method (such as " consistent ").When naming 537 title of detection zone, configuration part 308 as shown in figure 15, such as name with Have a sudden inspiration entitled " K21 " in associated first region in region " TR2 ".Configuration part 308 is also determined change point test section 306 Specified time detect, that detection zone 537 is specified by detection zone specifying part 307 (takes the photograph relative to the photographic device of " 2 " As device 2b) video data region of having a sudden inspiration " TR2 " in change point time delay time (being in Figure 15 " 1.50 ") Default value is shown in detection zone information portion 509 as attribute information.Configuration part 308 will test and show in area information portion 509 The attribute information for the detection zone 537 shown is saved in storage unit 302.

Detection zone specifying part 307 extracts the image that the given time of detection zone 537 is specified in detection zone 537, and Using the image as detection benchmark image, it is saved in storage unit 302, and specified detection zone 537 is saved in storage unit 302 Information.

As described above, present embodiment can will be with being different from involved by the video data that is showing of video display unit 502 And the specified region of having a sudden inspiration of video data of other photographic devices 2 of photographic device 2 be associated and specify detection zone, in this way Just connection can be unfolded between multiple photographic devices 2, so that image judges that freedom degree leap improves.

Setting screen 500 shown in Figure 16 is shown in area information portion 507 of having a sudden inspiration the region " TR6 " that selects to have a sudden inspiration and (has a sudden inspiration Region 530) in the state of, from the detection zone " K61 " (detection zone 535) of 509 display attribute information of detection zone information portion The state of selection " K62 " in " K62 " (detection zone 536).The volume of the attribute information of detection zone is described below with reference to Figure 16 Volume.And judge about the sensitivity for pressing detection zone key portion 510 detection zone after key 510d sensitivity adjustment will Figure 19 extremely Figure 22 description.

First as shown in figure 16, user's input operating device 303, attribute information are displayed on selection detection zone information portion After any one detection zone on 509, the detection zone of the selected detection zone information portion 509 of 308 reverse display of configuration part The display portion of the attribute information in domain.In the following description, if as shown in figure 16, selecting (the detection zone domain name of detection zone 536 Referred to as " K62 ").

Then, for example, user's operation input unit 303, after clicking action key 510a, configuration part 308 switching is selected The movement of detection zone 536 whether there is or not setting value.Such as it in the case where the movement of detection zone 536 has inaction "None", presses After action key 510a, configuration part 308 will test the movement in region 536, and whether there is or not be set as " having ".On the contrary, in detection zone 536 In the case that movement has inaction " having ", after clicking action key 510a, configuration part 308 will test the movement in region 536, and whether there is or not settings For "None".As will be described, when movement has inaction " having ", in the image judgement in the detection zone, detection zone In the case that the judgement of domain judging part 314 is abnormal, external 316 output abnormality signal of output section.

For another example, user's operation input unit 303, after judging selection key 510b by motion video, the switching of configuration part 308 is chosen Detection zone 536 picture judgement method setting value.For example, when the method that the picture of detection zone 536 judges is " one Cause " when, after judging selection key 510b by motion video, the method that configuration part 308 will test the picture judgement in region 536 is set as " inconsistent ".On the contrary, judging selection key by motion video when the method that the picture of detection zone 536 judges is " inconsistent " After 510b, the method that configuration part 308 will test the picture judgement in region 536 is set as " consistent ".

Such as the following description that will be carried out, in the case where the method that picture judge is " consistent ", if the image of extraction Difference between detection benchmark image is the threshold value of attribute information or more, then detection zone judging part 314 judges exception.About The method that setting screen judges is " consistent ", such as by the equipment of part insertion work package, is inserted into work package with part State is detection benchmark image, carries out image judgement in the time that part terminates to work package shift action.At this point, being inserted in part Enter the baulk of work package, part fails in the state of being normally inserted into, and detection zone judging part 314 carries out image judgement, such as Difference between the image that fruit is extracted and detection benchmark image is more than the threshold value of attribute information, then judgement is abnormal.

On the contrary, in the case where the method that picture judges is " inconsistent ", if the image and detection benchmark image that extract Between difference be not up to the threshold value of attribute information, then the judgement of detection zone judging part 314 is abnormal.Sentence about setting screen Disconnected method is " inconsistent ", such as is had by the equipment of part insertion work package, and the state of work package is not inserted into part To detect benchmark image, image judgement is carried out in the time that part terminates to work package shift action.At this point, being inserted into work in part The baulk of workpiece, part fail in the state of being normally inserted into, and detection zone judging part 314 carries out image judgement, if with Difference between detection benchmark image is not up to the threshold value of attribute information, then judgement is abnormal.Such as it is being difficult to prepare conduct It can be to be inserted into the state of work package as detection reference map for part when the work package for inserting part of finished product Picture.

When user's operation input unit 303, after pressing delete key 510c, detection zone information portion 509 is deleted in configuration part 308 The attribute information of the detection zone 536 of upper display, and delete the attribute information of the detection zone 536 saved in storage unit 302.Inspection It surveys region specifying part 307 and deletes the detection zone 536 shown on video display unit 502, and delete the inspection saved in storage unit 302 Survey the information of benchmark image and detection zone 536.

When user's operation input unit 303, press after sensitivity judges key 510d, configuration part 308 is shown in display device 317 Show the sensitivity determinating preview screen 700 of the displays such as following Figure 19.

When user's operation input unit 303, after pressing sensitivity increasing key 510e, configuration part 308 increases to selected detection zone Domain 536 carries out the sensitivity used when image judgement.Equally, user's operation input unit 303, after pressing sensitivity reducing key 510f, Configuration part 308, which is reduced, carries out the sensitivity used when image judgement to selected detection zone 536.

When user's operation input unit 303, after pressing threshold value increasing key 510g, configuration part 308 is increased with specified value to quilt The threshold value for selecting detection zone 536 to use when carrying out image judgement.Equally, user's operation input unit 303 presses threshold value reducing key 510 with after, and configuration part 308 is reduced with specified value and carries out the threshold value used when image judgement to selected detection zone 536.

< changes detection zone and the area size > that has a sudden inspiration

Figure 17 is changed on the setting screen shown in the display device for the information processing unit that first embodiment is related to Become an example status diagram for the detection zone size specified on video display unit.Figure 18 is the letter being related in first embodiment It ceases and changes the one of the area size of having a sudden inspiration specified on video display unit on the setting screen shown in the display device of processing unit Example status diagram.Below with reference to movement of Figure 17 and Figure 18 description when changing detection zone and having a sudden inspiration region.

Setting screen 500 shown in Figure 17 is shown in the video display unit that the first reproduction unit 304 resets display video data On 502, change the state of specified 535 size of detection zone.It is specific as follows.Firstly, the video data on video display unit 502 Playback show (pause) during, user's operation input unit 303, the sliding block 505 on mobile dragging item 504, readjusting needs Carry out the display time of the part of the image of image judgement.First reproduction unit 304 shows in time showing portion 506 and is suspended Video data frame shooting date and shooting time.

Then, after user's operation input unit 303 (such as pulling mouse 108), detection zone specifying part 307 changes for example The size for the second detection zone, that is, detection zone 536 specified on video display unit 502, and the detection zone that size is changed Domain is set as detection zone 536a.At this point, detection zone specifying part 307 is recalculated in configuration part 308 changes detection zone 536a The time of frame when size, the change point detected relative to change point test section 306 delay time of time (be in Figure 17 " -0.86 "), and shown the delay time as attribute information in detection zone information portion 509.It configuration part 308 will also inspection It surveys in area information portion 509 and is saved in storage unit 302 by updating the attribute information of the detection zone 536a of display.

Detection zone specifying part 307 extracts the figure within the time for changing detection zone 536a size, detection zone 536a Picture as detection benchmark image, and is saved in storage unit 302, saves specified detection zone 536a's in storage unit 302 Information.

Setting screen 500 shown in Figure 18 is shown in the video display unit that the first reproduction unit 304 resets display video data On 502, change the state for 530 size of region of having a sudden inspiration.It is specific as follows.Firstly, on video display unit 502 video data playback It shows during (pause), user's operation input unit 303, the sliding block 505 on mobile dragging item 504, readjustment needs to carry out The display time of the part of the image of image judgement.First reproduction unit 304 shows the view being suspended in time showing portion 506 The shooting date and shooting time of the frame of frequency evidence.

Then, after user's operation input unit 303 (such as pulling mouse 108), region specifying part 305 of having a sudden inspiration changes video The size in appointed region 530 of having a sudden inspiration on display unit 502, and using the region of having a sudden inspiration after size changes as region of having a sudden inspiration 530a.In the case where changing the specified region 530 of having a sudden inspiration of size by region specifying part 305 of having a sudden inspiration and becoming the region 530a that has a sudden inspiration, Change point test section 306 obtains the camera time for resetting the frame of display video data by the first reproduction unit 304 when changing size Frame in front and back specified time limit (2 seconds before and after such as), and extract the figure for changing the region 530a that has a sudden inspiration when having a sudden inspiration area size Picture, using the image as new benchmark image.Then, change point test section 306 calculates the difference of the frame obtained, is changed a little Difference image is extracted in detection in turn, these movements are identical as the movement of Fig. 7 to Figure 10.

The difference image of the benchmark image newly extracted and the frame of change point is saved in storage unit by change point test section 306 In 302, and benchmark image is shown on benchmark image display unit 508a again, show difference on difference image display unit 508b Image.In turn, change point test section 306 eliminates the label 540 of having a sudden inspiration on dragging item 504, in the frame of the change point newly detected Time corresponding part on display have a sudden inspiration and mark 540a.

When change point test section 306 detects new change point, region specifying part 305 of having a sudden inspiration is by the letter for the region 530a that has a sudden inspiration Breath is saved in storage unit 302.

Configuration part 308 recalculate detection zone specifying part 307 specify detection zone 535 specified time frame when Between, delay time of time of the frame of change point for newly detecting relative to change point test section 306 (be in Figure 18 " 1.64 "), and be shown to the delay time as attribute information in detection zone information portion 509.It recalculates configuration part 308 The time of frame when the specified detection zone 535a size of detection zone specifying part 307 is changed, relative to change point test section The delay time (being in Figure 18 " -1.36 ") of the time of the frame of 306 change points newly detected, and the delay time is made It is shown in detection zone information portion 509 for attribute information.Configuration part 308, which will test, updates display in area information portion 509 The attribute information of detection zone 535 and 536a are saved in storage unit 302.

Sensitivity in < sensitivity determinating preview screen adjusts >

Figure 19 be shown in the display device for the information processing unit that first embodiment is related to, an example sensitivity determinating The schematic diagram of the state of video data is shown in preview screen.Figure 20 is the information processing unit being related in first embodiment It is being shown in display device, in sensitivity determinating preview screen extract image and detect benchmark image between difference an example judge tie The schematic diagram of fruit.Figure 21 shows in the display device for the information processing unit that first embodiment is related to, sets in sensitivity Determine in preview screen with different sensitivity to an example judging result that difference rejudges between extraction image and detection benchmark image Schematic diagram.Figure 22 be shown in the display device for the information processing unit that first embodiment is related to, in sensitivity determinating The schematic diagram of the whether suitable an example dialog box of sensitivity in preview screen after confirmation reorganization.Figure 23 is in first embodiment Show in the display device for the information processing unit being related to, an example reflects on setting screen by sensitivity determinating preview screen The schematic diagram of sensitivity after upper change.Below with reference to Figure 19 to Figure 23, the sensitivity tune in sensitivity determinating preview screen 700 is described It is whole.

Sensitivity determinating preview screen 700 is judged for adjusting the i.e. image of one of selected detection zone adjustment attribute information The picture of sensitivity.As shown in figure 19, sensitivity determinating preview screen 700 have detection zone information portion 701, video display unit 702, Detect benchmark image display unit 703, extract image displaying part 704, differential disply portion 705, color code amount detection display unit 706, Area pixel quantity display unit 707, Differential Detection quantity display unit 708, Differential Detection ratio display unit 709, sensitivity increasing key 710a, sensitivity reducing key 710b, judge key 711, OK key 712 and close key 713.

Detection zone information portion 701 be for show by configuration part 308 setting screen 500 detection zone information portion The display unit of the attribute information of the detection zone selected on 509.In Figure 19, camera is shown in detection zone information portion 701 Entitled " CAM6 ", detection zone entitled " K61 ", sensitivity are " 50 ", threshold value is " 20 ".

On video display unit 702, the operation signal that the second reproduction unit 309 is sent according to user's operation input unit 303, Reset the video data that display is obtained from storage unit 302.In Figure 19, user's operation input unit 303 selects the photograph of " 6 " Machine selector 501, thus the second reproduction unit 309 shows the video data of photographic device 2f shooting in display device 317.? This, the video data that display the second reproduction unit 309 playback display of setting video display unit 702 is obtained from storage unit 302, but this hair It is bright to be not limited by this, it can also show the live video data obtained from photographic device 2 via video receiving part 301.

Detection benchmark image display unit 703 is used to show that configuration part 308 is specified from what storage unit 302 obtained by detection zone The detection benchmark image that portion 307 extracts.Image displaying part 704 is extracted to be used to show the extraction image that image zooming-out portion 310 extracts. Differential disply portion 705 is used to show difference between the extraction image for indicating to be found out by difference judging part 311 and detection benchmark image Characteristic image (Differential Characteristics image).

Color code amount detection display unit 706 is used to show, in the detection benchmark image that difference judging part 311 is found out and extract Between image in the information (difference information) of difference, difference belongs to the pixel quantity detected in each difference prescribed limit. Detection zone pixel quantity display unit 707 is for showing, difference judging part 311 is found out when calculating difference, composition is as poor Divide the pixel quantity of the detection zone of the object of information.Differential Detection quantity display unit 708 is for showing, difference judging part 311 Pixel quantity being found out when calculating difference, reaching defined threshold or more as the difference of difference information.Differential Detection ratio Display unit 709 show, it is that difference judging part 311 is found out when calculating difference, become object detection zone in difference be advise Determine the pixel quantity of threshold value or more and constitutes the ratio of the pixel quantity of the detection zone.

User's operation input unit 303, after pressing sensitivity increasing key 710a, configuration part 308 will be to the detection as object Region carries out the sensitivity used when image judgement and increases specified value.The function of sensitivity increasing key 710a can be with above-mentioned sensitivity increasing key The function of 510e is identical.User's operation input unit 303, after pressing sensitivity reducing key 710b, configuration part 308 will be to as object Detection zone carry out the sensitivity that uses when image judgement and reduce specified value.The function of sensitivity reducing key 710b can be with above-mentioned sensitivity The function of increasing key 510f is identical.

User's operation input unit 303 is pressed after judging key 711, and image zooming-out portion 310 extracts image, and difference is sentenced Disconnected portion 11, which calculates, to extract image and detects the difference between benchmark image, finds out difference information.

User's operation input unit 303, after pressing OK key 712, configuration part 308 is by difference judging part 311 in Difference Calculation Used in sensitivity (sensitivity shown in detection zone information portion 701) reflection arrive setting screen 500 detection zone information portion On 509.

User's operation input unit 303, after pressing close key 713, sensitivity determinating preview screen is closed in configuration part 308, Setting screen 500 is shown in display device 317.

The sensitivity determinating preview screen 700 of Figure 19 is shown, when user's operation input unit 303, selects detection zone information In the state of detection zone 535 (detection zone is entitled " K61 ") in portion 509, press what sensitivity judged to show when key 510d Picture.It is specific as follows.The state of detection zone 535 (detection zone is entitled " K61 ") is selected in user's operation input unit 303 Under, it presses after sensitivity judges key 510d, configuration part 308 shows setting screen 500 on the display apparatus.Then, configuration part 308 exists Detection zone information portion 701 shows selected detection zone 535, extracts and the extraction of detection zone specifying part 307 from storage unit 302 The corresponding detection benchmark image of detection zone 535, and the detection benchmark image is shown on detection benchmark image display unit 703. The screw hole that the detection benchmark image shown on benchmark image display unit 703 is the work package of manufacturing object is detected in Figure 19, In the state for being not yet screwed into screw.

After user's operation input unit 303, the second reproduction unit 309 obtains and detection zone information portion 701 from storage unit 302 The video data of the corresponding photographic device 2 of the camera title of upper display resets display on video display unit 702.

The display of sensitivity determinating preview screen 700 shown in Figure 20, when user's operation input unit 303, presses and judges key 711 When, image zooming-out portion 310 extracts image, and difference judging part 311 calculates between the extraction image and detection benchmark image The result of difference.It is specific as follows.Firstly, user is needing to carry out difference in during video display unit 702 shows video data It when calculating, presses after judging key 711, image zooming-out portion 310 is shown in the video for resetting display video data by the second reproduction unit 309 Show in portion 702, extracts the image of part corresponding to the specified detection zone 535 of detection zone specifying part 307, which is made To extract image, it is shown to and extracts on image displaying part 704.In Figure 20, the detection base shown on image displaying part 704 is extracted Quasi- image is the screw hole of the work mechanism of manufacturing object, and screw is twisted such as state therein in.

Then, difference judging part 311 calculates between the extraction image that image zooming-out portion 310 extracts and detection benchmark image Difference, and be shown on color code amount detection display unit 706 belong to each difference prescribed limit (in Figure 20 for " 70 with On ", " 50~69 ", " 20~49 ", " 19 or less ") in the pixel quantity that detects.Difference judging part 311 is in area pixel quantity The pixel quantity for constituting the detection zone 535 of Difference Calculation object is shown on display unit 707.In turn, difference judging part 311 is also counted Pixel quantity of the difference extracted and found out in image more than defined threshold is calculated, and the quantity is shown to Differential Detection quantity and is shown Show in portion 708.Then, difference judging part 311 calculates pixel quantity of the difference more than defined threshold in extraction image and is constituting Proportion in the pixel quantity of the detection zone 535 of Difference Calculation object, and the ratio is shown to Differential Detection ratio On display unit 709.Here, the maximum value of difference is, for example, " 255 ".

Difference judging part 311 also shows Differential Characteristics image in differential disply portion 705, indicates the spy of difference found out Sign.As shown in figure 20, difference judging part 311 generate Differential Characteristics image, specially distinguished with different colours belong to it is each not It overlaps in the corresponding pixel of difference found out with the difference of prescribed limit, and by the point of color corresponding with the difference.

Sensitivity determinating preview screen 700 shown in Figure 21 shows that user on the basis of the difference result that Figure 20 is shown, uses Difference judging part 311 re-starts Difference Calculation, so that sensitivity is further decreased to the result below of sensitivity shown in Figure 20.Specifically It is as follows.Firstly, user's operation input unit 303, presses sensitivity and reduce key 710b, the sensitivity of Difference Calculation is reduced from " 50 " To " 40 ".Then, video display unit 702 show video data during in, user when needing to carry out Difference Calculation (herein If the opportunity with Figure 20 is identical), operation input device 303 is pressed and judges key 711.In this way, image zooming-out portion 311 is in the second weight It puts portion 309 to show on the video display unit 702 of video data, extracts specified 353 institute of detection zone of detection zone specifying part 307 The image of corresponding part, and be shown on extraction image displaying part 704 using the image as image is extracted.

Here, key 711 is judged since the opportunity for being set in Figure 20 presses, it is aobvious to extract image displaying part 704, difference Show the image shown on portion 705, color code amount detection display unit 706 and area pixel quantity display unit 707 or information with Figure 20 is identical.

Difference judging part 311 calculates the pixel quantity that the difference value for extracting and finding out in image is defined threshold or more, and will The pixel quantity is shown on Differential Detection quantity display unit 708.The Difference Calculation sensitivity of difference judging part 311 is lower than figure at this time Sensitivity when 20, thus pixel quantity that the difference value that finds out in image is defined threshold or more is extracted at this time when will be more than Figure 20 Pixel quantity (increasing to " 16 " from " 10 " of Figure 20).Then, it is regulation that difference judging part 311, which calculates and extracts difference in image, The more than threshold value pixel quantity proportion in the pixel quantity in the detection zone 535 of Difference Calculation object, and by the ratio Example is shown on Differential Detection ratio display unit 709.Sense when the Difference Calculation sensitivity of difference judging part 311 is lower than Figure 20 at this time When the difference value spent, thus found out in extraction image at this time is that the pixel quantity proportion of defined threshold or more is greater than Figure 20 Ratio (in Figure 21, " 7.1% " is become from " 4.4% ").

Sensitivity determinating preview screen 700 shown in Figure 22 is to use by sensitivity adjusted, user shown in Figure 21 OK key 712 is pressed, display sensitivity uses confirmation dialog box 800.The display of setting screen 500 shown in Figure 23, detection zone letter Breath portion 509 reflects the detection zone of the object after being adjusted in sensitivity determinating preview screen 700 (in Figure 22 and Figure 23 Detection zone) sensitivity state.

It is specific as follows.User's operation input unit 303, after pressing OK key 712, configuration part 308 is shown in display device 317 Show sensitivity using confirmation dialog box 800, for being confirmed whether to set using Figure 21 sensitivity adjusted (for " 40 ") is passed through Sensitivity adjusted whether is reflected in the detection zone information portion 509 of picture 500.Sensitivity is had using confirmation dialog box 800 There is acknowledgement key 801, without using key 802, cancel key 803 and close key 804.Close key 804 is used to close sensitivity and uses confirmation Dialog box 800.

User's operation input unit 303, after pressing acknowledgement key 801, difference judging part 311 is as shown in figure 23 in setting screen Reflection (shows sense by Figure 21 sensitivity adjusted in detection zone information portion 701 in 500 detection zone information portion 509 Degree).Then, sensitivity is closed using confirmation dialog box 800 and sensitivity determinating preview screen 700 in configuration part 308, fills in display It sets and shows setting screen 500 on 317.

When user's operation input unit 303, after pressing not acknowledgement key 802, difference judging part 311 will not be adjusted by Figure 21 In sensitivity reflection to the detection zone information portion 509 of setting screen 500 afterwards.Then, configuration part 308 closes sensitivity and uses confirmation Dialog box 800 and sensitivity determinating preview screen 700, show setting screen 500 in display device 317.

When user's operation input unit 303, after pressing cancel key 803, difference judging part 311 will not be after Figure 21 be adjusted Sensitivity reflection in the detection zone information portion 509 of setting screen 500.Then, configuration part 308 closes sensitivity and uses confirmation pair Window 800 is talked about, and retains display sensitivity determinating preview screen 700 in display device 317.

The set action process > of < specified have a sudden inspiration region and detection zone

Figure 24 be in the display device for the information processing unit that first embodiment is related to an example for showing in setting screen The set action flow chart of upper specified have a sudden inspiration region and detection zone.Below with reference to Figure 24, it is summarized on setting screen 500 and specifies The process of the set action for region and the detection zone of having a sudden inspiration.

Step S11

First reproduction unit 304 obtains video data from storage unit 302 according to the input of user's operation input unit 303, Display is reset on video display unit 502.Then it is moved to step S12.

Step S12

Video data is reset in during display on video display unit 502, and user is to occur becoming occurrence cause of having a sudden inspiration Required image section is opportunity, and operation input device 303, after pressing Pause key 503b, the first reproduction unit 304 pause video is shown Portion 502 is revisiting the video data of display.After user's operation input unit 303 (such as pulling mouse 108), region of having a sudden inspiration Specifying part 305 is specified on video display unit 502 has a sudden inspiration region and shows the region of having a sudden inspiration.Then it is moved to step S13.

Step S13

In the case where region specifying part 305 of having a sudden inspiration specifies and has a sudden inspiration region, change point test section 306, which obtains, to be designated Time point, the first reproduction unit 304 reset display video data frame shooting time before and after specified time limit in frame, and The difference of pixel value between each frame and the previous frame of the frame is calculated, and then according to the difference found out, detects region of having a sudden inspiration Image on change point.About the detection method of change point, it is detailed in the description of Fig. 7 to Fig. 9.Then it is moved to step S14.

Step S14

When change point test section 306 detects change point (step S14's be), it is moved to step S15, without detecting When to change point (step S14's is no), then return step S11.

Step S15

When change point test section 306 detects the IN point as change point, the figure in region 530 of having a sudden inspiration in IN point frame is extracted Picture, and using the image as extraction image.And when change point test section 306 detects the OUT point as change point, it extracts It has a sudden inspiration in OUT point frame the image in region 530, and using the image as extracting image.Then change point test section 306 is by extraction The difference image of benchmark image and variation point frame is saved in storage unit 302, and respectively in benchmark image display unit 508a and difference Benchmark image and difference image are shown on partial image display unit 508b.Region specifying part 305 of having a sudden inspiration is also by specified region of having a sudden inspiration Information preservation into storage unit 302.Then it is moved to step S16.

Step S16

During the playback of video data is shown on video display unit 502, user is in the image for needing to carry out image judgement At the time point that part occurs, operation input device 303, after pressing Pause key 503b, the first reproduction unit 304 suspends video display unit 502 are revisiting the video data of display.Then it is moved to step S17.

Step S17

After user's operation input unit 303 (such as pulling mouse 108), detection zone specifying part 307 is in video display unit It is specified on 502 and shows detection zone.Configuration part 308 shows the attribute letter of detection zone 535 in detection zone information portion 509 Breath, i.e. detection zone specifying part 307 are used for what image judged to the title of specified detection zone name and as default value Provide that whether there is or not the methods (such as " consistent ") of, image judgement for sensitivity and defined threshold, monitoring method, movement.Moreover, configuration part 308 also calculate detection zone specifying part 307 specify detection zone specified time frame time relative to change point test section 306 detect the delay time of the time of change point, and show the delay time as attribute information in detection zone information In portion 509.In turn, the attribute information that configuration part 308 will test the detection zone 535 shown in area information portion 509 is saved in In storage unit 302.Then, it is moved to step S18.

Step S18

User's operation input unit 303 selects attribute information to be displayed on the detection zone in detection zone information portion 509 After some detection zone among domain, configuration part 308 makes the attribute information that detection zone is chosen in detection zone information portion 509 Display portion highlight display.Then, user's operation input unit 303, after clicking action key 510a, configuration part 308 switches quilt Select the setting value for having attonity in detection zone.When user's operation input unit 303, after judging selection key 510b by motion video, Configuration part 308 switches the setting value of the method for the picture judgement of selected detection zone.

When user's operation input unit 303, after pressing sensitivity increasing key 510a, selected detection zone is improved in configuration part 308 Image judgement use sensitivity value, make the value increase specified value.And work as user's operation input unit 303, press sensitivity reducing key After 510a, the value of the image judgement sensitivity of selected detection zone is reduced specified value by configuration part 308.It can be set in above-mentioned sensitivity The sensitivity that setting judges for being chosen the image of detection zone on fixed for the emperor's inspection picture 700.

When user's operation input unit 303, after pressing threshold value increasing key 510a, selected detection zone is improved in configuration part 308 Image judgement threshold value, make the value increase specified value.And work as user's operation input unit 303, press sensitivity reducing key After 510a, the threshold value of the image judgement of selected detection zone is reduced specified value by configuration part 308.The attribute of selected detection zone After information setting, it is moved to step S19.

Step S19

If showing in the video display unit 502 of video data that all detection zones are specified finishes (step S19's be), Terminate the set action of specified have a sudden inspiration region and detection zone, and if not yet complete all detection zones it is specified (S19's It is no), then return step S16.

Image judgement on < key frame acts >

Figure 25 is on the key frame that shows of display device for the information processing unit that first embodiment is related to, by touching The schematic diagram of state after machine region and detection zone are specified.Figure 26 is an example for the information processing unit that first embodiment is related to Image judges action flow chart.Figure 27 is the master shown in the display device for the information processing unit that first embodiment is related to On picture, the display of the display state and detection zone in the region of having a sudden inspiration machine when detecting when having a sudden inspiration in region of having a sudden inspiration The schematic diagram of state.

First refering to fig. 25, the image judgement movement on key frame 400 is described.Key frame 400 shown in Figure 25 is live aobvious Show the video data received from multiple photographic devices 2, region of having a sudden inspiration on video display unit 401b is designated as " TR2 ", video is shown Show shape when region of having a sudden inspiration on portion 401f is designated as " TR6 " and detection zone is designated as " K61 ", " K62 " and " K21 " State.Image judgement movement on specific key frame 400 is as follows.Firstly, video distribution portion 312 will take from video receiving part 301 The video data of the live data obtained is assigned to video display unit 401a and is shown to 401.Generating unit of having a sudden inspiration 313 is from storage unit 302 Obtain the difference image of the frame for the change point that change point test section 306 detects.Then, generating unit of having a sudden inspiration 313 is respectively by video The difference in the region of having a sudden inspiration " TR2 " specified on display unit 401b and the region of having a sudden inspiration " TR6 " specified on video display unit 401f Image is compared with the image in the region of having a sudden inspiration of the frame of video data.In turn, video display unit 401b and 401f with " second is aobvious Show region " it is corresponding.Generating unit of having a sudden inspiration 313 compares the difference in the image in region of having a sudden inspiration and the frame of change point of the frame of video data Partial image, and threshold is provided not up to total i.e. difference (the second difference) that pixel value reaches the different pixels of regulation sensitivity or more Value is opportunity, generates signal of having a sudden inspiration.

Detection delay time is set to Figure 23 institute indicating value in the attribute information of detection zone " K61 " and " K62 ".Detection zone Detection delay time in the attribute information in domain " K21 " is set to Figure 15 institute indicating value.Detection zone judging part 314 is from storage unit 302 obtain the attribute information of specified detection zone.Detection zone judging part 314 is had a sudden inspiration letter receiving the generation of generating unit 313 of having a sudden inspiration Number when setting time before or setting time after, the detection zone of the frame of video data is compared in specified detection zone Image and detection benchmark image, judge whether to be abnormal.

It is specific as follows.Detection zone judging part 314 receives touching corresponding with region of having a sudden inspiration " TR6 " in generating unit 313 of having a sudden inspiration It, will be by the frame of the video data after detection " 1.5 " second delay time corresponding with detection zone " K61 " after machine signal The image of detection zone is compared with detection benchmark image, judges whether image is abnormal.At this point, detection zone judges Portion 314 carries out image judgement by comparing detection benchmark image and the image of detection zone, when pixel value reaches detection zone More than the sensitivity of the attribute information of " K61 " different pixels quantity it is total, i.e., the difference (third difference) of pixel value is the category When more than the threshold value (third threshold value) of property information, detection zone " K61 " image abnormity is judged.Here, can be set with pressing machine etc. Started in standby with indentation movement to have a sudden inspiration and carrying out image judgement to the indentation state after indentation, as utilization detection zone judging part 314 receive signal of having a sudden inspiration later opportunity to carry out the example of image judgement.Specifically, generating unit 313 of having a sudden inspiration will with pressing machine The movement of indentation element indentation work package starts to generate signal of having a sudden inspiration to have a sudden inspiration.Then, pressing machine will be pressed into element indentation work Part, after indentation acts, each execution unit of pressing machine returns to origin position.Detection zone judging part 314 is to work package Indentation state after indentation carries out image judgement.The detection zone judging part 314 is had a sudden inspiration with receiving from generating unit 313 of having a sudden inspiration Signal and the time after setting time i.e. detection delay time are the opportunity of image judgement.Since pressing machine moves automatically Make, thus since the indentation movement for generating signal of having a sudden inspiration, the time until the image judgement for being pressed into state after indentation is solid It fixes time, for this purpose, the detection delay time having a sudden inspiration until image judgement can be set as the set time.

Detection zone judging part 314 generating unit 313 of having a sudden inspiration receive it is corresponding with region of having a sudden inspiration " TR6 " have a sudden inspiration signal it Afterwards, will pass through after detection delay time " -0.86 " second corresponding with detection zone " K62 ", i.e., the video before " 0.86 " second The image of the detection zone of the frame of data is compared with detection benchmark image, judges whether image is abnormal.Here, can To be used in a manual manner in the equipment such as the pressing machine that will be pressed into element indentation work package, operator is the work package by indentation Vanning is carried out as having a sudden inspiration, is sentenced to image is carried out in the work package by indentation for being placed in state on injector before vanning It is disconnected, as detection zone judging part 314 to receive the example that the opportunity before having a sudden inspiration signal carries out image judgement.Specifically, first First, operator will be in the work package setting to pressing machine before being pressed into.Then, operator presses indentation start button, indentation Machine starts to press against movement, will be pressed into element indentation work package.After indentation, the work package that operator takes out by indentation is filled Case.Generating unit of having a sudden inspiration 313 is to have a sudden inspiration the work package vanning by indentation with operator, generates signal of having a sudden inspiration.Then, detection zone Before domain judging part 314 detects delay time to receive the setting time for signal of having a sudden inspiration, i.e., pressing machine is placed in front of vanning On time point, as to by indentation work package carry out image judgement opportunity.In this way, by the way that signal of having a sudden inspiration is generated it Preceding time point as the opportunity for carrying out image judgement to the work package being placed on pressing machine, can be avoided following failure hair It is raw, such as after operator's setting work package, forget that indentation acts because of the operation field away from keyboard such as lunch break, but after return, And the work package being not yet pressed into is cased.At this point, if with vanning to have a sudden inspiration, and detected with the stipulated time having a sudden inspiration when postponing Between before for image judgement opportunity, in this way, operator is just it can be found that the work package without indentation, avoids the work without indentation Workpiece is mixed into vanning.

Detection zone judging part 314 compares to be received to open for the signal of having a sudden inspiration in region " TR2 " of having a sudden inspiration from generating unit 313 of having a sudden inspiration The figure of beginning detection zone of the frame of video data after detection " 1.5 " second delay time corresponding with detection zone " K21 " Picture and detection benchmark image, judge whether there is exception.Then, external output section 316 judges in detection zone judging part 314 In the case where being abnormal, to 10 output abnormality signal of peripheral hardware.

Below with reference to Figure 26, the process that image judgement movement is carried out on key frame 400 is summarized.

Step S31

When video distribution portion 312 can from photographic device 2 via video receiving part 301 obtain video data when (S31's It is), it is moved to step S32, and if be in standby when cannot obtain video data (S31's is no).

Step S32

Video distribution portion 312 live video data obtained from video receiving part is distributed into each video display unit 401a It is shown to 401f, meanwhile, video data is saved in storage unit 302.Then, it is moved to step S33.

Step S33

If before the stipulated time at current time, existed as the previous of the video data being stored in storage unit 302 Frame (S33's be), then be moved to step S34, opposite (S33's is no) then returns to S31.

Step S34

Delete the previous frame being stored in storage unit 302 before the stipulated time at current time in video distribution portion 312 Video data.Then it is moved to step S35.

Step S35

Generating unit of having a sudden inspiration 313 obtains the difference diagram of the frame for the change point that change point test section 306 detects from storage unit 302 Picture.Then, it is had a sudden inspiration in region in the frame that generating unit of having a sudden inspiration 313 compares difference image and video image in specified region of having a sudden inspiration Image.Then it is moved to step S36.

Step S36

Generating unit of having a sudden inspiration 313 compares the difference diagram in the image in region of having a sudden inspiration in the frame of video data and the frame of change point Picture, and it is less than defined threshold (second in the total i.e. difference (the second difference) of pixel quantity that pixel value reaches regulation sensitivity or more Threshold value) time, generation has a sudden inspiration signal.Have a sudden inspiration generating unit 313 generate and export have a sudden inspiration signal in the case where (step S36's It is), it is moved to step S37, if not exporting (S36's is no), return step S31 on the contrary.Such as shown in Figure 27 (a), touching Machine generating unit 313 generates in the specified region of having a sudden inspiration " TR6 " (have a sudden inspiration region 530a) of region specifying part 305 of having a sudden inspiration and exports touching When machine signal, the color for showing region 530a frame side of having a sudden inspiration is highlighted.In this way, just can visually grasp generating unit 313 of having a sudden inspiration Have a sudden inspiration is to export at what time.

Step S37

If detection zone specifying part 307 specify detection zone in, exist have a sudden inspiration generating unit 313 output have a sudden inspiration before Some time is carried out the detection zone (S37's be) of image judgement (detection) by detection zone judging part, then is moved to step S38, on the contrary, being then moved to step S41 if there is no (S37's is no).

Step S38

Detection zone judging part 314 will receive signal of having a sudden inspiration corresponding with region of having a sudden inspiration from generating unit 313 of having a sudden inspiration before with The image of detection zone in the frame of the video data of detection zone corresponding stipulated time (detection delay time), with detection benchmark Image is compared, and judges whether there is exception.Then it is moved to step S39.

Step S39

Detect the method that the picture of the attribute information of detection zone judges as " consistent " in detection zone judging part 314 In the case of, if obtained pixel value is the category of detection zone through the image of detection zone compared with detecting benchmark image More than the sensitivity of property information different pixels Volume Composition, that is, difference, more than the threshold value of the attribute information, then detection zone Image judging result is abnormal (abnormality detection).At this time (step S39's be), it is moved to step S40.And if image is judged as Normally (S39's is no), then return step S37.And the picture of the attribute information of detection zone is detected in detection zone judging part 314 In the case that the method that face judges is " inconsistent ", if obtained compared with detecting benchmark image by the image of detection zone Different pixels Volume Composition, that is, the difference for being less than the sensitivity of the attribute information of detection zone to pixel value is the threshold of the attribute information More than value, then the image judging result of detection zone is abnormal (abnormality detection).

Step S40

External output section 316 is when detection zone judging part 314 judges abnormal, to 10 output abnormality signal of peripheral hardware.Then Return step S37.

Step S41

In the detection zone that detection zone specifying part 307 is specified, if deposited after the generation of generating unit 313 of having a sudden inspiration is had a sudden inspiration The detection zone of image judgement (detection) is carried out in detection zone judging part 314, and reaches image judgement (detection) at present When the time (step S41's be), it is moved to step S42.And if not reaching the time (S41's is no) of image judgement, it moves To step S45.

Step S42

Detection zone judging part 314 will have a sudden inspiration generating unit 313 receive after signal of having a sudden inspiration corresponding with region of having a sudden inspiration by with The image of detection zone and detection in the frame of video data after the detection zone corresponding stipulated time (detection delay time) Benchmark image is compared, and is carried out image judgement, is judged whether to be abnormal.Such as shown in figure 27b, detection zone judging part 314 when the image for the detection zone " K61 " (monitoring region 535) specified to detection zone specifying part 307 judges, so that detection The frame side color blast in region 535.Hereby it is possible to visually grasp detection zone judging part 314 is when to carry out image and sentence It is disconnected.Then it is moved to step S43.

Step S43

Detect the method that the picture of the attribute information of detection zone judges as " consistent " in detection zone judging part 314 In the case of, if obtained pixel value is the category of detection zone through the image of detection zone compared with detecting benchmark image More than the sensitivity of property information different pixels Volume Composition, that is, difference, more than the threshold value of the attribute information, then detection zone Image judging result is abnormal (abnormality detection).At this time (step S43's be), it is moved to step S44.And if image is judged as Normally (S43's is no), then return step S41.And the picture of the attribute information of detection zone is detected in detection zone judging part 314 In the case that the method that face judges is " inconsistent ", if obtained compared with detecting benchmark image by the image of detection zone Different pixels Volume Composition, that is, the difference for being less than the sensitivity of the attribute information of detection zone to pixel value is the threshold of the attribute information More than value, then the image judging result of detection zone is abnormal (abnormality detection).

Step S44

External output section 316 is when detection zone judging part 314 judges abnormal, to 10 output abnormality signal of peripheral hardware.Then Return step S41.

Step S45

In the detection zone that detection zone specifying part 307 is specified, after having a sudden inspiration if there is the generation of generating unit 313 of having a sudden inspiration Detection zone judging part 314 carries out the detection zone of image judgement (detection), and there is also the inspections for not yet carrying out image judgement When surveying region (step S45's be), return step S41.And if there is no (S45's is no), then terminate image judgement movement.

As described above, region specifying part 305 of having a sudden inspiration is specified on video display unit 502 after user's operation input unit 303 And showing region of having a sudden inspiration, change point test section 306 obtains the first reproduction unit 304 and is resetting in the video data of display, specifies Before and after the shooting time of the frame at time point during the stipulated time in frame, calculate time in specified region of having a sudden inspiration from region of having a sudden inspiration The difference of pixel value between the image of interior extraction, i.e. benchmark image, and the image of the frame of acquirement having a sudden inspiration in region.In turn, Change point test section 306 is in the figure of the difference found out with temporal representation, to having a sudden inspiration in region for frame initial in the frame of acquirement Image, by pixel value be provide sensitivity or more different pixels quantity it is total as difference, which reaches defined threshold More than, and the time point that there's almost no compared with benchmark image the state of difference is detected as change point (IN point).Variation Point test section 306 is also in the figure of the difference found out with temporal representation, and initial frame has a sudden inspiration in region in the frame of acquirement Image, and in the case where there's almost no compared with benchmark image the image of difference, the figure being had a sudden inspiration in region from initial frame As in, using pixel value be provide sensitivity more than different pixels quantity it is total as difference, which is reached into defined threshold Above time point is used as change point (OUT point) and detects.Then, generating unit of having a sudden inspiration 313 is examined in change point test section 306 Measure change point be OUT point in the case where, in view of region of having a sudden inspiration in the frame of video data image compared with benchmark image almost There is no the state of difference, the total i.e. difference for the pixel quantity that pixel value is regulation sensitivity or more is being reached into defined threshold or more Time point generate and have a sudden inspiration signal.On the other hand, detect that change point is in change point test section 306 when having a sudden inspiration generating unit 313 In the case where IN point, to the image (difference image) in region of having a sudden inspiration in the frame of video data, pixel value be regulation sensitivity with On the total and difference of different pixels quantity reach defined threshold or more, and almost without the shape of difference compared with benchmark image The time point of state generates signal of having a sudden inspiration.Sentence in this way, being just free to generate as the progress image of detection zone judging part 314 The time point of disconnected time point benchmark having a sudden inspiration.

Middle user is in the image for needing to carry out image judgement during the playback of video data is shown on video display unit 502 When part occurs, operation input device presses Pause key 503b, and the first reproduction unit 303 pause 502 quotient of video display unit is weighing Put the video data of display.Then, user's operation input unit 303, detection zone specifying part 307 is on video display unit 502 Specified display detection zone.Configuration part 308 calculates the time of the frame of the specified time of the specified detection zone of detection zone specifying part Detect the delay time of the time of change point relative to change point test section 306, and will delay time as attribute information.And Afterwards, the delay that detection zone judging part 314 will be set in the configuration part 308 for receiving the signal of having a sudden inspiration that generating unit 313 of having a sudden inspiration generates Before or after time, in specified detection zone in the frame of video data detection zone image, with detection benchmark image Be compared, carry out image judgement, judge whether exception.In this way, can not only be right on the basis of the opportunity of generation having a sudden inspiration The image of the detection zone of frame after stipulated time carries out image judgement, but also can be to previous before the stipulated time The image of detection zone carries out image judgement in frame, so that image judges that the design freedom on opportunity obtains tremendous mention It is high.

Present embodiment carries out the specified of have a sudden inspiration on video display unit 502 region and detection zone on setting screen 500 Deng on key frame 400, based on the image shown on video display unit 401, generation is had a sudden inspiration signal, and carries out image judgement.But It is that these do not form limitation to the present invention.That is, the function of 400 both sides of setting screen 500 and key frame can be unified, Such as regard video display unit 502 and video display unit 401 as the same display unit, carried out on the display unit have a sudden inspiration region and The implementation of specified equal and signal of having a sudden inspiration the generation and image judgement of detection zone.In this case, video display unit 502 It is used as the same display unit with video display unit 401, which is both " the first display unit " and " the second display unit ".

The signal of having a sudden inspiration of the generation of forming portion 313 of having a sudden inspiration in above embodiment is used to as detection zone judging part 314 carry out the opportunity benchmark of image judgement, but it does not generate limitation to the present invention.For example, signal of having a sudden inspiration can also be used to As the opportunity benchmark for carrying out predetermined processing in production equipment, in this case, the time point of signal generation is being touched to life It produces equipment and sends signal.

" second embodiment "

The difference of the information processing unit 3 of the information processing unit 3 and first embodiment of present embodiment described below Place.It especially will be described the difference between the two about the detection operation of change point in region of having a sudden inspiration.Here, present embodiment The overall structure of image processing system 1, the hardware configuration of information processing unit 3 and functional module composition, key frame 400 and setting Composition, set action, the sensitivity determinating preview screen of specified and detection zone the attribute information of detection zone of picture 500 In 700 sensitivity adjustment movement, and then key frame 400 on image judgement movement with the homomorphosis in first embodiment.

The functional module of < information processing unit constitutes >

As described above, the functional module structure of the information processing unit 3 of present embodiment and the first embodiment party shown in Fig. 3 The functional module structure of the information processing unit of formula 3 is identical, is described below and acts different functional modules.

In present embodiment, in the case where region specifying part 305 of having a sudden inspiration specifies and has a sudden inspiration region, change point test section 306 acquirement the first reproduction units 304 reset at the specified time point display video data frame shooting time before specified time limit Frame in (such as 3 seconds), then calculate the difference of the pixel value between the frame and frame before of each acquirement, and based on finding out Difference detects the benchmark image of image in region 530 of having a sudden inspiration.Change point test section 306 is also obtained from the benchmark image detected Frame (reference frame) time after frame in specified time limit (such as 6 seconds), calculate between the frame and reference frame of each acquirement The difference (the first difference) of pixel value detects the change point of image in region of having a sudden inspiration based on the difference found out.About this embodiment party The change point of formula will be described below.About the calculation method of above-mentioned difference, such as region of having a sudden inspiration between two frames can be compared Pixel value, the difference of pixel value reached into the total of the pixel quantity of regulation sensitivity or more, or the image in region of having a sudden inspiration The difference of pixel value reaches the quantity ratios (area ratio) of the pixel of regulation sensitivity or more as difference in pixel.When frame is black and white When image, pixel value is consistent with gray value, thus can also compare the gray value in region of having a sudden inspiration between two frames, finds out gray scale The difference of value reaches the total of the pixel quantity of regulation sensitivity or more, this is total as difference.And when frame is with rgb pixel value When the image of composition, compare R (red), G (green), in B (orchid) any one color pixel value, it is then same as described above, find out The difference of pixel value reaches the total of the pixel quantity of regulation sensitivity or more, this is total as difference.It in turn, can also be to frame Image carry out edge detection process, find out the total of marginal portion, total regard this as difference.With shown in Fig. 2 CPU101 executes program to realize the function of change point test section 306.

< have a sudden inspiration region specified and change point detection >

Figure 28 be in the setting screen shown in the display device for the information processing unit that first embodiment is related to not The schematic diagram of an example dialog box occurred when can detect benchmark image in specified region.Figure 29 is real for describing second Apply the schematic diagram of change point detection operation in the region of having a sudden inspiration of mode.Below with reference in Figure 28 and Figure 29 and first embodiment Attached drawing, description touches the specified of region, the detection of benchmark image and change point detection.

First as shown in fig. 6, during the playback of video data is shown on video display unit 502, occur to be found general The time point of image section as occurring source of having a sudden inspiration, user's operation input unit 303, after pressing Pause key 503b, the first weight It puts and resets the video data of display on the pause of portion 304 video display unit 502, and show the time point in time showing portion 506 Frame shooting date and shooting time.Then, user's operation input unit 303 (such as pulling mouse 108), so that area of having a sudden inspiration Domain specifying part 305 specifies on video display unit 502 (the first display area) and shows region 530 of having a sudden inspiration.

Then, after region specifying part 305 of having a sudden inspiration specifies and has a sudden inspiration region 530, change point test section 306 obtains the first weight Put portion 304 reset at the specified time point display video data frame shooting time before specified time limit (such as 3 seconds) (first Stipulated time) in frame.Then, change point test section 306 calculates pixel value between the frame and previous frame that each is obtained Difference, and based on the difference found out, detection is had a sudden inspiration the benchmark image of image in region 530.It is specific as follows.Change point test section 306 calculate in the frame of acquirement, and in the region 530 of having a sudden inspiration of object frame the area of having a sudden inspiration of the previous frame of the pixel value and frame of image Difference in domain 530 between the pixel value of image reaches the pixel quantity of regulation sensitivity (such as " 30 ") or moreIn region 530 of having a sudden inspiration Pixel quantity in it is sharedRatio (area ratio), and using the ratio as difference, for detect the difference defined threshold (such as 5%) image in the region 530 of having a sudden inspiration of object frame when below, using the image as benchmark image.

The specific value of stipulated time used in said reference image detection, regulation sensitivity and defined threshold are only It is example, other numerical value can also be used, or be stored in the setting file that can be edited in storage unit 302.Above-mentioned change point inspection Frame before the shooting time for the frame that the first reproduction unit 304 of acquirement of survey portion 306 resets the video data shown in specified time limit, but It is that the present invention is not limited thereto.Such as change point test section 306 can also obtain the video that the first reproduction unit 304 resets display The frame of specified time limit before and after the shooting time of the frame of data, or obtain the frame from specified time limit after shooting time.

Setting screen 500 shown in Figure 28 fails in change point test section 306 in the specified touching of region specifying part 305 of having a sudden inspiration When detecting benchmark image in machine region 530, it is displayed without 620 state of notification dialog window for detecting benchmark image.Variation For point test section 306 in the movement of said reference image detection, the difference found out is not up to defined threshold or more, thus fails to detect To benchmark image.At this point, change point test section 306 is shown in display device 317 notifies object window 620 without benchmark image, Expression does not detect benchmark image.

No benchmark image notification dialog window 620 has OK key 621 and close key 622.OK key 621 is used to close no benchmark Image notification dialog box 620.User's operation input unit 303, after pressing OK key 621, no benchmark image notification dialog window 620 close, at this point, change point test section 306 does not save any information in storage unit 302, benchmark image display unit 508a and Image is not also shown on difference image display unit 508b.

Secondly, change point test section 306 obtains frame, that is, reference frame of benchmark image in the case where detecting benchmark image Shooting time after frame in specified time limit (such as 6 seconds) (the second specified time limit).Then, change point test section 306 calculates The difference (the first difference) of pixel value detects region of having a sudden inspiration according to the difference found out between each frame and reference frame for obtaining Change point in interior image.About the calculation method of difference, such as in the frame that change point test section 306 obtains, by object frame Have a sudden inspiration region 530 image and reference frame have a sudden inspiration region 530 image between pixel value difference be regulation sensitivity (such as " 50 ") more than pixel quantityIt is shared in the pixel quantity of the detection zone 530Ratio (area ratio) is used as difference.Below The specifically used variation point detecting method of change point test section 306 is described.

As shown in (a) in Figure 29, if change point test section 306 obtains the specified time limit from the shooting time of reference frame It is interior to amount to 13 frames (frame (0) to (12)).At this point, change point test section 306 with frame (0) be benchmark frame, from the reference frame Frame in specified time limit.In addition, for convenience's sake, the image of the part corresponding to region 530 of having a sudden inspiration in each frame is also divided Also known as it is frame (0) to frame (12).Then, change point test section 306 calculates the difference of pixel value between each frame and reference frame. Difference Calculation method is as previously discussed.Change point test section 306 extracts the frame as shown in (a) of Figure 29, and each frame that will be found out Difference with temporal representation be (b) of Figure 29.As shown in (b) of Figure 29, such as it is that frame (2) is with reference frame that frame (2), which obtains difference, Difference between frame (0).Such as give a definition in this as the IN point and OUT point of the change point of present embodiment.That is IN point refers to, incites somebody to action Compared with the image in region 530 of having a sudden inspiration in reference frame, variation between the two reaches the image being had a sudden inspiration in region 530 in successive frame To the time point of specified degree.OUT point refers to, since IN point, reaching the image having a sudden inspiration in region 530 in successive frame becomes The time point similar with the image of reference frame having a sudden inspiration in region 530.

Change point test section 306 finds out IN point candidate and OUT point candidate according to the difference of each frame found out.Specifically such as Under.Change point test section 306, from defined threshold (such as 20%) (first threshold) state below, becomes in the difference found out It will be more than frame corresponding to the difference of the threshold value as IN point candidate frame when as being more than the threshold value.In (b) of Figure 29, frame (1) it is less than threshold value to the difference of frame (3), and the difference of frame (4) is more than threshold value, thus, frame (4) is the candidate frame of IN point.Equally, Frame (10) is also the candidate frame of IN point.

On the other hand, if the difference that change point test section 306 is found out is from the shape for being greater than defined threshold (first threshold) When state is turned into the threshold value or less, using frame corresponding to threshold value difference below as OUT point candidate frame.At (b) of Figure 29 In, the difference of frame (4) to frame (6) is greater than threshold value, and since frame (7) ing difference be threshold value hereinafter, thus, frame (7) is OUT point Candidate frame.Equally, frame (11) is also the candidate frame of OUT point.

As described above, change point test section 306 detects frame (4) in the example of Figure 29 and (10) are IN point candidate frame, Frame (7) and (11) are OUT point candidate frame.In this way, change point test section 306 will most connect when detecting multiple IN point candidate frames The frame that the frame of nearly reference frame, i.e. frame (4) are set to IN point.Equally, when detecting multiple OUT point candidate frames, change point test section 306 by closest to the frame of reference frame, i.e. frame (7) frame that is set to OUT point.As described above, change point test section 306 is by obtaining Specified time limit in frame in determine IN point frame and OUT point frame, to detect change point (IN point and OUT point).In addition, change point is examined Survey portion 306 can also use the previous frame or following frame of the frame of change point or the frame of front and back, come when detecting change point Expression is acted object to deposit since the Vector Message in which direction is saved in by the movement analyte detection for have a sudden inspiration in region 530 Storage portion 302.In this case, the Vector Message saved in storage unit 303 of generating unit of having a sudden inspiration 313, to confirm movement object Whether direction of action is consistent with the direction that Vector Message indicates, and generates information of having a sudden inspiration according to confirmation result.

The example that Figure 29 is shown is while finding the frame of IN point and OUT point both sides, however, change point test section 306 can also The frame of IN point or the frame of OUT point can only be found.At this point, these I N points or OUT point are detected as change point.Change point inspection Survey portion 306 extracts image of the frame of the change point detected in region 530 of having a sudden inspiration, using the image as difference image (first Image), and the difference image of the benchmark image of extraction and the frame of change point is saved in storage unit 302, it is aobvious in benchmark image Show and show benchmark image on portion 508a, and shows difference image on difference image display unit 508b.In turn, change point test section 306 detect corresponding to the time of the frame of change point on part that display is had a sudden inspiration label 540 in dragging item 504.In change point When test section 306 detects change point, region specifying part 305 of having a sudden inspiration by the information preservation in specified region 530 of having a sudden inspiration to storage Portion 302.Configuration part is in the specified region 530 of having a sudden inspiration that display is named by region specifying part 305 of having a sudden inspiration in area information portion 507 of having a sudden inspiration Title and for change point test section 306 detect change point regulation sensitivity (such as 50) and defined threshold (such as 20%) (default value).About the title in region 530 of having a sudden inspiration, as shown in fig. 7, configuration part 308 is by the photographic device (photographic device 2f) of " 6 " Video data in appointed region of having a sudden inspiration be named as " TR6 ".

The specific value of stipulated time used in said reference image detection, regulation sensitivity and defined threshold are only It is example, other numerical value can also be used, or be stored in the setting file that can be edited in storage unit 302.

Change point test section 306 in specified 530 kinds of the region of having a sudden inspiration of region specifying part 305 of having a sudden inspiration as described above, detect In the case where two change points (IN point and OUT point), 600 same action of dialog box is selected with above-mentioned change point shown in Fig. 9. In this way, change point test section 306 detects the IN point and OUT point as change point, user be can choose in two change points The change point that any point is specified as user.

On the contrary, if change point test section 306 is not examined in the specified region 530 of having a sudden inspiration of region specifying part 305 of having a sudden inspiration Change point is measured, then carries out the movement for the unchanged notification dialog window 610 that above-mentioned Figure 10 is shown.

The set action process > of < specified have a sudden inspiration region and detection zone

Figure 30 is to specify touching in the display device of information processing unit of the second embodiment on the setting screen that shows The set action flow chart in machine region and detection zone.Hereinafter, summarizing with reference to Figure 30 and specifying region of having a sudden inspiration on setting screen 500 With the set action process of detection zone.

Step S51

First reproduction unit 304 obtains the video data saved in storage unit 302, weight according to user's operation input unit 303 It puts and is shown on video display unit 502.Then it is moved to step S52.

Step S52

During video data on video display unit 502 resets display, when the portion for the image for becoming occurring source of having a sudden inspiration Current, user's operation input unit 303 is separated, after pressing Pause key 503b, display video counts are reset in the pause of the first reproduction unit 304 According to.User's operation input unit 303 (such as pulling mouse 108), so that region specifying part 305 of having a sudden inspiration is in video display unit 502 It is upper to specify and show region of having a sudden inspiration.Then it is moved to step S53.

Step S53

In the case where region specifying part of having a sudden inspiration specifies and has a sudden inspiration region 530, change point test section 306 obtains first and resets At the appointed time reset the frame in the specified time limit (such as 3 seconds) before the shooting time of the frame of the video data of display in portion 304. Then, change point test section 306 calculates the difference of pixel value between the frame before the frame and the frame that each is obtained, and based on asking Difference out detects the benchmark image of image in region 530 of having a sudden inspiration.Specific benchmark image detection method is same as described above.And After be moved to step S54.

Step S54

Change point test section 306 detects when benchmark image (S54's be), is moved to step S55, otherwise (S54's is no), Back to step S51.

Step S55

When detecting benchmark image, specified time limit (example after the shooting time of the acquirement reference frame of change point test section 306 Such as 6 seconds) in frame.Then, change point test section 306 calculates the difference of the pixel value between each frame and reference frame, and base In the difference, the change point in region of having a sudden inspiration in image is detected.Specific variation point detecting method is above-mentioned Figure 28 and Figure 29 etc. In description it is identical.Then it is moved to step S56.

Step S56

Change point test section 306 detects when change point (S56's be), is moved to step S57, otherwise (S56's is no), returns Return to step S51.

Step S57 to S61

Step S57's to S61 handles the processing phase with step S15 to S19 shown in first embodiment midway 24 respectively Together.

It is taken as described above, change point test section 306 detects benchmark image first in the case where detecting benchmark image Frame after reference frame shooting time in specified time limit, calculate the difference of pixel value between each frame and reference frame, and be based on The Differential Detection found out is had a sudden inspiration the change point of image in region.The change point detected according to the above method, generating unit of having a sudden inspiration 313 Generation is had a sudden inspiration signal.In this way, present embodiment, which is just free to generate, carries out image judgement by detection zone judging part 314 The opportunity of opportunity benchmark having a sudden inspiration.Effect same as the first embodiment can additionally be obtained.

If realizing that the first reproduction unit 304 in above-mentioned various embodiments, region of having a sudden inspiration are specified by executing calculation procedure Portion 305, change point test section 306, detection zone specifying part 307, configuration part 308, the second reproduction unit 309, image zooming-out portion 310, difference judging part 311, video distribution portion 312, generating unit of having a sudden inspiration 313, detection zone judging part 314 and display control section At least some function part function in 315, which can be pre-installed in ROM etc. and be provided.The letter of present embodiment The program for ceasing processing unit implementation can also be in the form of mountable or the file of practicable form is installed to CD-ROM, floppy disc (FD), it is provided in the computer-readable recording mediums such as CD-R, DVD.In turn, the journey that the information processing unit of present embodiment is carried out Sequence can also be installed in the computers of networks such as connection internet, be provided by network downloading.The information of present embodiment The program that processing unit is carried out can also be provided or be promulgated by networks such as internets.The information processing unit of present embodiment is real Capable program can also be to include the first reproduction unit 304, region specifying part 305 of having a sudden inspiration, change point test section 306, detection zone Specifying part 307, configuration part 308, the second reproduction unit 309, image zooming-out portion 310, difference judging part 311, video distribution portion 312, At least module composition of some function part in generating unit of having a sudden inspiration 313, detection zone judging part 314 and display control section 315, Program is read and executed from above-mentioned ROM by the CPU of actual hardware, is uploaded in main storage means and is generated above-mentioned each function Portion.

Claims (21)

1. a kind of image processing apparatus, wherein having with lower module:
Display module;
Playback module, the video data playback for shooting photographic device are shown to the display module;
Memory module, for saving the video data of photographic device shooting;
Module is specified in region of having a sudden inspiration, for referring in the first display area of the display module for showing the video data Surely it has a sudden inspiration region;
Detection module, for specify the specified time point in the module region of having a sudden inspiration by the region of having a sudden inspiration on the basis of In the video data in first specified time limit, change point in the image in region of having a sudden inspiration described in detection, and extract the variation The image having a sudden inspiration in region described in the frame of point, as the first image;And
Generation module, for will show the second display of the display module of the video data of the photographic device shooting The image having a sudden inspiration in region in region is compared with the first image, generates signal of having a sudden inspiration according to comparison result.
2. image processing apparatus according to claim 1, wherein
The detection module obtains the frame of the video data in the second specified time limit before the specified time point, and counts Calculate the difference between the frame of each acquirement and the previous frame of the frame, the reference map in region of having a sudden inspiration according to the Differential Detection Picture,
The frame from the video data in third specified time limit after the time point of the frame comprising the benchmark image is obtained, and The first difference between the frame of each acquirement and the frame comprising the benchmark image is calculated, according to first difference, detects institute State the change point in the image in region of having a sudden inspiration.
3. image processing apparatus according to claim 2, wherein
The detection module detect first difference more than first threshold frame time point, alternatively, first difference from The time point of frame when state more than the frame of first threshold is turned into the first threshold or less, using the time point as variation Point.
4. image processing apparatus according to claim 1, wherein
Institute before and after the specified time point in the specified region of having a sudden inspiration of specified regions module of having a sudden inspiration described in the detection module acquirement The frame of the video data in the first specified time limit is stated, and is calculated between the frame of each acquirement and the previous frame of the frame First difference, according to first difference, the change point in image had a sudden inspiration in region described in detection.
5. image processing apparatus according to claim 4, wherein
According to the comparison result between first difference and first threshold, the change point is detected.
6. image processing apparatus as claimed in any of claims 1 to 5, wherein
The generation module generates the letter of having a sudden inspiration for the benchmark for being used as that image judgement is carried out in second display area Number.
7. image processing apparatus as claimed in any of claims 1 to 5, wherein
The generation module calculates the image in region and between the first image of having a sudden inspiration described in second display area The second difference, and when second difference is less than second threshold, signal of having a sudden inspiration described in generation.
8. image processing apparatus as claimed in any of claims 1 to 5, wherein being further equipped with:
Detection zone specifies module, for referring to the detection zone for being set for the object judged for image in first display area Domain;
Detection zone judgment module is used to carry out described image judgement to the detection zone;And setting module, for setting The setting value of the attribute information of the fixed detection zone, the method that the attribute information includes at least picture judgement, according to described Attribute information judgement is abnormal, and in the detection zone, the time point for signal of having a sudden inspiration is generated with the generation module On the basis of, setting determines that the detection zone judgment module carries out the judgement time of described image judgement.
9. image processing apparatus according to claim 8, wherein
The judgement time is set as by the setting module, to the generation module generate described in have a sudden inspiration signal time point it The detection zone in the frame of preceding video data carries out described image judgement.
10. image processing apparatus according to claim 8, wherein
The judgement time is set as by the setting module, to the generation module generate described in have a sudden inspiration signal time point it The detection zone in the frame of video data afterwards carries out described image judgement.
11. image processing apparatus according to claim 8, wherein
The video data that the region of having a sudden inspiration specifies module to shoot other photographic devices for being different from the photographic device, in institute It states in the first display area, specified other regions of having a sudden inspiration for being different from the region of having a sudden inspiration,
The detection zone judgment module with the generation module generate described in time point having a sudden inspiration in other regions of having a sudden inspiration be Benchmark carries out described image judgement to the detection zone.
12. image processing apparatus according to claim 8, wherein
The detection zone specifies module to specify multiple detection zones in first display area.
13. image processing apparatus according to claim 8, wherein
When the method that picture judges is set as consistent by the setting module, the detection zone judgment module calculating is examined Survey the image of detection zone when region specifies module specified, i.e. the second image, described in the frame with the judgement time Third difference between the image of detection zone, when the third difference is more than third threshold value, judgement is abnormal.
14. image processing apparatus according to claim 8, wherein
When the method that picture judges is set as inconsistent by the setting module, the detection zone judgment module calculate by The image of detection zone when detection zone specifies module specified, i.e. institute in the second image, with the frame of the judgement time The third difference between the image of detection zone is stated, when the third difference is less than third threshold value, judgement is abnormal.
15. image processing apparatus described in 3 or 14 according to claim 1, wherein
The figure of detection zone judgment module detection zone according to second image and the frame of the judgement time The difference of pixel value reaches the pixel quantity of regulation sensitivity or more as between, to calculate the third difference,
The setting module sets the regulation sensitivity.
16. image processing apparatus according to claim 8, wherein
The video data that the detection zone specifies module to be shown according to the playback module, specifies the detection zone.
17. image processing apparatus according to claim 8, wherein
It is further equipped with external output module, for specifying module to be judged as different in described image judgement in the detection zone Chang Shi exports the notice for indicating abnormal to peripheral hardware.
18. image processing apparatus as claimed in any of claims 2 to 5, wherein
The detection module calculates the difference of the pixel value of gray value or pertinent regulations color, poor using the difference as described first Point.
19. image processing apparatus as claimed in any of claims 1 to 5, wherein
The video data that the region of having a sudden inspiration specifies module to reset display according to the playback module, the specified area of having a sudden inspiration Domain.
20. a kind of image processing system, wherein having one or more any one of photographic device and claim 1 to 5 institute The image processing apparatus stated.
21. a kind of image processing method, wherein comprising the steps of:
The video data playback of photographic device shooting is shown on display module by playback step;
Region specification step of having a sudden inspiration specifies touching in the first display area of the display module for showing the video data Machine region;
Detecting step, on the basis of by the specified time point in the region of having a sudden inspiration, before and after the specified time point first In the video data in specified time limit, change point in the image in region of having a sudden inspiration described in detection, and extract the change point The image being had a sudden inspiration in region described in frame, as the first image;And
Generation step will show the second display area of the display module of the video data of the photographic device shooting In the image having a sudden inspiration in region be compared with the first image, signal of having a sudden inspiration is generated according to comparison result.
CN201510494581.3A 2014-08-25 2015-08-12 Image processing apparatus, image processing system and image processing method CN105391971B (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2014170735 2014-08-25
JP2014-170735 2014-08-25
JP2015-041577 2015-03-03
JP2015041577A JP6554825B2 (en) 2014-08-25 2015-03-03 Image processing apparatus, image processing system, image processing method, and program

Publications (2)

Publication Number Publication Date
CN105391971A CN105391971A (en) 2016-03-09
CN105391971B true CN105391971B (en) 2019-07-12

Family

ID=55423751

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510494581.3A CN105391971B (en) 2014-08-25 2015-08-12 Image processing apparatus, image processing system and image processing method

Country Status (1)

Country Link
CN (1) CN105391971B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108540782B (en) * 2017-03-03 2020-09-22 株式会社理光 Method and device for acquiring difference image

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101378498A (en) * 2007-08-28 2009-03-04 微星科技股份有限公司 Image detection method
CN101320505B (en) * 2008-07-04 2010-09-22 浙江大学 Partition video monitoring method based on multipath network video stream parallel processing
US20130188044A1 (en) * 2012-01-19 2013-07-25 Utechzone Co., Ltd. Intelligent monitoring system with automatic notification and intelligent monitoring device thereof
TW201410014A (en) * 2012-08-22 2014-03-01 Triple Domain Vision Co Ltd A method for defining a monitored area for an image
CN103327306A (en) * 2013-06-14 2013-09-25 广东威创视讯科技股份有限公司 Method and device for storing video surveillance image

Also Published As

Publication number Publication date
CN105391971A (en) 2016-03-09

Similar Documents

Publication Publication Date Title
US9324171B2 (en) Image overlaying and comparison for inventory display auditing
US9436963B2 (en) Visualizing a custom product in situ
KR102135215B1 (en) Information processing method and terminal
US9693023B2 (en) Monitoring apparatus, monitoring system, and monitoring method
US10346686B2 (en) Image monitoring system and image monitoring program
US8577210B2 (en) Image editing apparatus, image editing method and program
US9094588B2 (en) Human machine-interface and method for manipulating data in a machine vision system
US8229210B2 (en) Mobile device with color detection capabilities
US20180032592A1 (en) Interactive Visualization of Multiple Data Sources Across Multiple Computers
TWI509409B (en) Methods and systems for viewing log data recorded during execution of a program
US9161238B2 (en) Mobile device monitoring and testing
US9003061B2 (en) Methods and apparatus for an embedded appliance
US5717468A (en) System and method for dynamically recording and displaying comments for a video movie
US9582902B2 (en) Managing raw and processed image file pairs
US20190235655A1 (en) System and method for objectively measuring user experience of touch screen based devices
JP5423183B2 (en) Display control apparatus and display control method
Chalidabhongse et al. A perturbation method for evaluating background subtraction algorithms
US10515143B2 (en) Web-based system for capturing and sharing instructional material for a software application
AU2007202102B2 (en) Function command system, function command device, function command analysis system, presentation system, and computer readable medium
US9318073B2 (en) Graphics processing unit based color management of output devices
EP3298509B1 (en) Prioritized display of visual content in computer presentations
US20180211205A1 (en) Goods monitoring device, goods monitoring system, and goods monitoring method
JP5866564B1 (en) Monitoring device, monitoring system, and monitoring method
JP2014116797A (en) Information processor, information processing method, information processing system and program
KR20170128501A (en) Segment detection of video programs

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
GR01 Patent grant