CN111258274A - System and method for judging monitoring area according to characteristic area to monitor - Google Patents
System and method for judging monitoring area according to characteristic area to monitor Download PDFInfo
- Publication number
- CN111258274A CN111258274A CN201811453224.2A CN201811453224A CN111258274A CN 111258274 A CN111258274 A CN 111258274A CN 201811453224 A CN201811453224 A CN 201811453224A CN 111258274 A CN111258274 A CN 111258274A
- Authority
- CN
- China
- Prior art keywords
- area
- feature
- monitoring
- data
- characteristic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
- G05B19/4184—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by fault tolerance, reliability of production system
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/31—From computer integrated manufacturing till monitoring
- G05B2219/31457—Factory remote control, monitoring through internet
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a system and a method for judging a monitoring area according to a characteristic area to monitor, which can automatically search monitored data on a display picture and achieve the technical effect of moving a window containing the monitored data after a monitoring system is started by determining the characteristic area on the same target window as the monitoring area and calculating the characteristic data of the characteristic area, searching the characteristic area in the display picture when the position of the characteristic area is judged to be changed according to the characteristic data, and judging the new position of the monitoring area according to the new position of the searched characteristic area.
Description
Technical Field
The present invention relates to a monitoring system and method, and more particularly, to a system and method for determining a monitoring area according to a characteristic area for monitoring.
Background
In order to save labor in an automatic production factory, most machines of each production line are controlled by computer processes, each worker or person on duty can monitor a plurality of production lines through a monitoring system, when the monitoring system or the person finds that a certain production line is in trouble or is stopped, real-time fault removal is needed, otherwise, productivity is affected, and loss caused by non-uniformity is caused.
Currently, most machines on the production line use a graphic interface, and the monitoring system can use a screen recognition technology to capture messages at specific positions on the screen and determine whether the production line has a problem according to the captured messages. Therefore, in order to avoid the monitoring system from retrieving the wrong message, the personnel need to restrict themselves and not move any window on the screen. However, the production line runs for 7 × 24 hours, which inevitably results in operations that require restarting or adjusting, and personnel may cause the position of the window to change during the operation, for example, the window is opened at a different position after restarting or dragged to the window during the adjustment, so that the monitoring system cannot retrieve the correct message.
In summary, it can be seen that there is a problem that a monitoring system can only monitor a specific position on a screen in the prior art for a long time, and therefore, an improved technical means is needed to solve the problem.
Disclosure of Invention
In view of the problem that the prior art cannot move the window containing the monitored data after the monitoring system is started, the invention discloses a system and a method for judging a monitoring area according to a characteristic area for monitoring, wherein:
the invention discloses a system for judging a monitoring area according to a characteristic area for monitoring, which at least comprises: the area setting module is used for determining a monitoring area of a target window in a display picture and determining a characteristic area of the target window; the characteristic generation module is used for generating characteristic data of the characteristic region; the change detection module is used for judging whether the position of the characteristic region changes or not according to the characteristic data; the characteristic searching module is used for searching the characteristic area in the display picture when the position of the characteristic area changes; the area positioning module is used for judging the monitoring position data of the monitoring area according to the searched characteristic position data of the characteristic area; and the picture monitoring module is used for capturing information contained in the monitoring area from the display picture according to the monitoring position data.
The invention discloses a method for judging a monitoring area according to a characteristic area for monitoring, which at least comprises the following steps: determining a monitoring area of a target window in a display picture; determining a characteristic region of the target window; generating feature data of the feature region; searching the characteristic area in the display picture when the position of the characteristic area is judged to be changed according to the characteristic data; judging monitoring position data of the monitoring area according to the searched characteristic position data of the characteristic area; and acquiring information contained in the monitoring area from the display picture according to the monitoring position data.
The system and the method disclosed by the invention are different from the prior art in that the invention solves the problems in the prior art by determining the characteristic area on the same target window with the monitoring area and calculating the characteristic data of the characteristic area, searching the characteristic area in the display picture when the position of the characteristic area is judged to be changed according to the characteristic data, and judging the new position of the monitoring area according to the new position of the searched characteristic area, and can achieve the technical effect of randomly moving the window containing the monitored data after the monitoring system is started.
Drawings
Fig. 1 is a system architecture diagram for determining a monitoring area according to a characteristic area for monitoring according to the present invention.
Fig. 2 is a flowchart of a method for determining a monitoring area according to a characteristic area for monitoring according to the present invention.
Fig. 3A and 3B are schematic views of display screens according to an embodiment of the invention.
Reference numerals:
110 region setting module
130 feature generation module
150 change detection module
160 characteristic searching module
170 area positioning module
180 picture monitoring module
300 display screen
310 target window
320 area of monitoring
330 characteristic region
Detailed Description
The features and embodiments of the present invention will be described in detail with reference to the drawings and examples, which are sufficient for those skilled in the art to easily understand the technical means for solving the technical problems and to implement the technical means, thereby achieving the effects achieved by the present invention.
The invention can search the characteristic area in the display picture when the position of the characteristic area in the monitoring area changes, and judge the new position of the monitoring area according to the new position of the searched characteristic area so as to correctly obtain the monitored information from the monitoring area. Generally, the display screen is a screen displayed by a display module such as a display screen of a device executing the present invention, but the present invention is not limited thereto, and for example, the display screen may be a range covered by a specific application program in the screen displayed by the display module.
The system operation of the present invention will be described with reference to the system architecture diagram of fig. 1 for determining the monitoring area according to the characteristic area for monitoring. As shown in fig. 1, the system of the present invention includes a region setting module 110, a feature generating module 130, a variation detecting module 150, a feature searching module 160, a region locating module 170, and a frame monitoring module 180.
The region setting module 110 is responsible for determining a monitoring region of a target window in a display screen. The area setting module 110 may define the monitoring area by directly inputting coordinates in the display screen or the target window, may also define the area selected by the frame in the display screen as the monitoring area by clicking and dragging, or may define the area surrounding the double-clicked position in the display screen as the monitoring area after providing the double click, but the present invention is not limited thereto, and any way that the user can select the monitoring area in the target window may be used in the present invention.
The region setting module 110 is also responsible for determining the feature region in the target window including the monitoring region. The region setting module 110 may provide the user to select the feature region in the same manner as the monitoring region, and the region setting module 110 may also randomly select a range in the target window as the feature region according to the lines, color distributions and/or color blocks in the target window, but the manner in which the region setting module 110 selects the feature region is not limited to the above.
The region setting module 110 may also reselect the feature region of the target window when the identification data representing the feature region generated by the feature generation module 130 is repeated, that is, when the feature generation module 130 has previously generated the same identification data, that is, the identification data generated by the feature generation module 130 is not unique.
The area setting module 110 may also obtain position data of the determined various areas (including the monitoring area and the feature area). For example, the area setting module 110 may acquire monitoring position data of the monitoring area, or may acquire feature position data of the feature area.
The position data obtained by the area setting module 110 may indicate the determined size and range of an area, for example, the position data may include coordinates of an area at the upper left corner and width and height of the display screen, or coordinates of an area at the upper left corner and lower right corner of the display screen, and the invention is not limited in particular.
The feature generation module 130 can capture an image according to the feature position data, generate corresponding identification data according to the captured image, and record the generated identification data. For example, the feature generation module 130 may continuously extract the frame image included in the feature region from the display frame after the region setting module 110 obtains the feature position data of the feature region, and use the obtained frame image as the identification data.
In most embodiments, in order to enable the feature generation module 130 to generate the same identification data when the captured image includes noise, the feature generation module 130 may also calculate an identification value according to the captured image after capturing the image included in the feature region from the display image, and use the calculated identification value as the identification data, for example, the feature generation module 130 may adjust the RGB filters (selecting one, two, or three colors of red, green, and blue) and/or the binarization threshold to calculate the identification value of the image.
It should be noted that the identification data generated by the feature generation module 130 is unique, that is, when the feature generation module 130 generates the same identification data, the identification data generated later needs to be discarded and the new feature position data is obtained by the region setting module 110 to generate the identification data again.
In the present invention, the identification data generated by the feature generation module 130 according to the first captured picture image is also referred to as "reference data", the picture image captured by the feature generation module 130 is also referred to as "reference image", and the identification value calculated by the feature generation module 130 according to the reference image is also referred to as "reference value"; the identification data generated by the feature generation module 130 according to the subsequently (second and subsequent) captured frame images is also referred to as "feature data", the frame images subsequently captured by the feature generation module 130 are also referred to as "feature images", and the identification values calculated according to the feature images are also referred to as "feature values".
It should be noted that the feature generation module 130 generates the identification data according to the frame image included in the feature position data acquired by the region setting module 110, that is, under the condition that the position of the feature region is not changed, the feature image captured by the feature generation module 130 is the same as the reference image, and therefore, the feature data generated by the feature generation module 130 is the same as the reference data. However, when the position of the feature area is changed due to the movement of the target window in the display screen, the feature position data is not changed correspondingly, so that the feature generation module 130 still captures the feature image from the unchanged feature position data, and does not capture the screen image included in the feature area after the position is changed. In other words, after the position of the feature region is changed, the frame image captured by the feature generation module 130 may only include a part of the feature region after the position is changed, or may not include the feature region at all, so that the feature image captured by the feature generation module 130 is different from the reference image, and the feature generation module 130 generates feature data different from the reference data.
The variation detecting module 150 is responsible for determining whether the position of the feature region determined by the region setting module 110 changes according to the feature data generated by the feature generating module 130. Generally, the variation detection module 150 compares whether the feature data calculated by the feature generation module 130 and the reference data are the same to determine whether the position of the feature region is changed.
The feature searching module 160 is responsible for searching the feature region in the display screen when the change detecting module 150 determines that the position of the feature region changes. The feature search module 160 may perform image analysis on the display frame to determine a plurality of blocks (different blocks may partially overlap in the display frame) having the same size as the feature area selected by the area setting module 110 from the display frame, generate detection data according to the image of the area covered by each block, and determine whether the detection data generated according to each block is the same as the reference data, where when the detection data generated by a block is the same as the reference data, the area covered by the block is the feature area; the feature search module 160 may also determine each vertex included in the display screen after performing image analysis on the display screen, and generate detection data according to the captured image after capturing an image having the same size as the feature area from the display screen according to each determined vertex, and determine whether the generated detection data is the same as the reference data, if the two are the same, the vertex is a vertex of the feature area. However, the manner of searching the feature region in the display screen by the feature searching module 160 is not limited to the above.
The feature searching module 160 may also obtain new feature position data of the searched feature region in the display screen when the feature region is searched, that is, position data of the moved feature region in the display screen. The manner of obtaining the feature location data is well known and not described in detail.
The area locating module 170 is responsible for determining the moving monitoring position data of the monitoring area determined by the area setting module 110 according to the feature position data of the feature area searched by the feature searching module 160. For example, the area locating module 170 may directly determine the monitoring position data of the monitoring area determined by the area setting module 110 in the display frame according to the feature position data obtained by the feature searching module 160. More specifically, when one side (e.g., the left side) of the monitored area determined by the area setting module 110 is adjacent to one side (e.g., the right side) of the feature area, the area positioning module 170 may determine the position of the right side of the feature area adjacent to the monitored area in the display screen according to the feature position data of the feature area, determine the position of the left side of the monitored area according to the determined position and the positions of the starting point and/or the ending point of the right side of the feature area in the display screen, and determine new monitoring position data of the monitored area according to the position of the left side of the monitored area and the monitoring position data obtained by the area setting module 110.
For another example, the area positioning module 170 may also calculate an offset value according to the characteristic position data obtained by the characteristic searching module 160 and the characteristic position data obtained by the area setting module 110, and determine new monitoring position data of the monitoring area in the display screen according to the monitoring position data obtained by the area setting module 110 and the calculated offset value. That is, if the offset value calculated by the area locator module 170 indicates that the characteristic area is shifted downward by 28 pixels and leftward by 413 pixels in the display screen, the area locator module 170 may determine that the monitoring area is also shifted downward by 28 pixels and leftward by 413 pixels in the display screen, that is, the position data of the lower 28 pixels and the left 413 pixels of the monitoring position data obtained by the area setting module 110 is calculated, and the calculated position data is the new monitoring position data of the monitoring area.
The frame monitoring module 180 is responsible for capturing the information contained in the monitoring area using the monitoring location data of the monitoring area. The position of the feature area in the display screen is the same as the position of the feature area determined by the area setting module 110, that is, the position of the feature area is not changed, the screen monitoring module 180 captures the information contained in the monitoring area using the monitoring position data of the monitoring area determined by the area setting module 110, and the screen monitoring module 180 captures the information contained in the monitoring area according to the monitoring position data of the monitoring area determined by the area positioning module 170 when the position of the feature area in the display screen is different from the position of the feature area determined by the area setting module 110, that is, the position of the feature area in the display screen is changed.
Next, a first embodiment of the operating system and method of the present invention is described, and referring to fig. 2, a flowchart of a method for determining a monitoring area according to a characteristic area for monitoring is provided. In the embodiment, it is assumed that the present invention is included in an application (that is, the modules of the present invention are included in the application), and the displayable area (display 300) of the application includes a target window 310 as shown in fig. 3A.
Before the monitoring script is executed, the region setting module 110 may determine a monitoring region 320 in the target window 310 (step 210). In this embodiment, it is assumed that the region setting module 110 can provide a mouse click and drag-and-drop mode for the user to select the monitoring region 320 in the display screen 300 and obtain the monitoring position data of the selected monitoring region 320, for example, obtain the coordinate of the upper left corner of the monitoring region 320 in the display screen 300 and the width and height of the monitoring region 320, and meanwhile, the region setting module 110 can also write the obtained monitoring position data of the monitoring region 320 into the monitoring script.
After the region setting module 110 determines the monitoring region 320 in the target window 310 (step 210), the region setting module 110 may determine the characteristic region in the target window 310 (step 220). In the present embodiment, it is assumed that the region setting module 110 also provides a way for the user to click and drag and drop on the display screen 300 by using a mouse to select the feature region 330 from the target window 310, and can write the obtained feature position data of the feature region 330 into the monitoring script.
After the region setting module 110 determines the feature region 330 in the target window 310 (step 220), the user can execute the monitoring script in the application program including the present invention. When the monitoring script is executed, script instructions in the monitoring script may call feature generation module 130 so that feature generation module 130 may continue to generate feature data for feature area 330 (step 230). In the embodiment, it is assumed that the feature generation module 130 can use the captured reference image as the reference data when capturing the frame image (reference image) included in the feature region 330 for the first time according to the feature position data of the feature region 330, and then the feature generation module 130 can capture the frame image (feature image) included in the feature region 330 at intervals and use the captured feature image as the feature data.
After the feature generation module 130 generates the feature data of the feature region 330 each time (step 230), the variation detection module 150 may determine whether the position of the feature region 330 in the display screen 300 changes according to the feature data generated by the feature generation module 130 (step 250). In the embodiment, it is assumed that the variation detecting module 150 can determine whether the position of the feature region 330 in the display screen 300 changes by comparing whether the reference data and the feature data generated by the feature generating module 130 are the same.
If the change detection module 150 determines that the position of the feature region 330 in the display 300 does not change, the frame monitoring module 180 may capture a message included in the monitoring region by using the monitoring position data of the monitoring region obtained when the region setting module 110 determines the monitoring region 320 (step 290).
If the variation detecting module 150 determines that the position of the feature area 330 in the display 300 is changed, the feature searching module 160 may search the feature area 330 in the display 300 (step 260). In this embodiment, the feature search module 160 can capture the display image of the current display screen 300, perform image analysis on the captured display image to find the vertices of the top left corners of all the frames included in the captured display image, and capture the screen images with the same size as the feature areas 330 from each vertex one by one according to the feature position data of the feature areas 330 obtained by the area setting module 110, and compare whether the captured screen images are the same as the reference images. If the two are different, the feature search module 160 may repeat the above process for the next vertex, and if the two are the same, the feature search module 160 may determine that the feature region 330 is found, and determine that the vertex capturing the same frame image as the reference image is the top left corner of the feature region 330.
After the feature searching module 160 searches the feature area 330, the area locating module 170 may determine new monitor location data of the monitor area 320 by using the feature location data of the feature area 330 after the location change (step 270). In the present embodiment, assuming that the target window 310 is moved from the lower left of the display 300 to the upper right of the display 300 as shown in fig. 3B, after the feature search module 160 searches the feature area 330, the area locating module 170 can calculate an offset value according to the feature location data obtained by the feature searching module 160 and the feature location data obtained when the area setting module 110 determines the feature area 330, that is, determine a horizontal displacement distance and a vertical displacement distance between the new feature location data and the original feature location data, the area positioning module 170 may calculate new monitoring position data of the monitoring area 320 according to the monitoring position data obtained by the area setting module 110 when determining the monitoring area 320 and the calculated offset value.
After the area positioning module 170 determines the monitored location data of the monitored area 320 using the feature location data of the feature area 330 with the changed location (step 270), the image monitoring module 180 may retrieve the information included in the monitored area 320 according to the monitored location data of the monitored area 320 determined by the area positioning module 170 (step 290). In this embodiment, the frame monitor module 180 may be called according to the script command in the monitoring script, and retrieve the information included in the monitoring area 320 from the display frame 300 according to the monitoring position data of the monitoring area 320 calculated by the area positioning module 170 after being called and executed.
In practical applications, after the feature searching module 160 searches the feature area 330, if the monitoring script does not include a script instruction for resetting the feature position data of the feature area 330, that is, the feature searching module 160 does not update the original feature position data obtained by the area setting module 110 into the new feature position data obtained by searching, after the feature generating module 130 again captures the image of the area covered by the feature area 330 before being moved according to the original feature position data determined by the area setting module 110 and generates the feature data according to the captured image (step 230), the change detecting module 150 can still determine that the position of the feature area 330 in the display screen 300 changes according to the difference between the feature data generated by the feature generating module 130 and the reference data (step 250), and thus, like the above-mentioned process, the feature searching module 160 may search the feature area 330 in the display screen 300 (step 260), the area locating module 170 may determine the monitored location data of the monitored area 320 by using the feature location data of the feature area 330 with the changed location searched by the feature searching module 160 (step 270), and the screen monitoring module 180 may retrieve the message included in the monitored area 320 according to the monitored location data of the monitored area 320 determined by the area locating module 170 (step 290).
If the monitoring script includes a script command for resetting the feature location data, i.e. the feature searching module 160 updates the feature location data of the feature area 330 obtained by the area setting module 110 to the searched feature location data, when the feature generation module 130 generates the feature data of the feature region 330 again (step 230), the feature generation module 130 may extract a feature image of an area currently covered by the feature area 330 according to the updated feature position data and generate feature data according to the extracted feature image (step 230), thus, the variation detecting module 150 can determine that the position of the feature region 330 in the display 300 has not changed according to the feature data generated by the feature generating module 130 being the same as the reference data (step 250), and the frame monitoring module 180 can capture the information included in the monitoring region 320 according to the monitoring position data of the monitoring region 320 (step 290).
Thus, even if the position of the target window 310 is moved by the user, the monitoring script can still correctly capture the message contained in the monitoring area through the present invention for correct monitoring.
Next, a second embodiment of the operating system and method of the present invention is described with reference to fig. 2. In the present embodiment, it is assumed that the present invention is implemented in an operating system, and the display screen 300 is all areas of the screen display.
After the present invention is performed, the region setting module 110 may determine the monitoring region 320 in the target window 310 (step 210). In the present embodiment, the assumed region setting module 110 may provide that after the user uses the mouse to double-click on the display screen 300, the monitoring region 320 surrounding the double-clicked position is determined according to the lines and/or color blocks in the display screen 300, and obtain the monitoring position data of the selected monitoring region 320, for example, the coordinates of the upper left corner of the monitoring region 320 in the display screen 300 and the width and height of the monitoring region 320.
After the region setting module 110 determines the monitoring region 320 in the target window 310 (step 210), the region setting module 110 may determine the characteristic region in the target window 310 (step 220). In the embodiment, it is assumed that the region setting module 110 automatically selects a field adjacent to the upper side of the monitored region 320 and the lower side of the target window 310 as the feature region 330, that is, the widths of the feature region 330 and the monitored region 320 are the same, and the difference between the positions of the upper side of the monitored region 330 and the lower side of the feature region 330 is only one pixel.
Particularly, in practical applications, the area setting module 110 determines that the monitoring area in the target window (step 210) and the area setting module 110 determines the feature area in the target window (step 220) have no difference in sequence, that is, the area setting module 110 may also determine the feature area in the target window first and then determine the monitoring area, at this time, the feature area determined by the area setting module 110 will not include a portion that can be edited by the user.
After the region setting module 110 determines the feature region 330 in the target window 310 (step 220), the feature generation module 130 may continuously generate the feature data of the feature region 330 (step 230). In this embodiment, it is assumed that after the feature generation module 130 captures the image information (reference image) included in the feature region 330 for the first time, the RGB filter may be used to calculate the captured reference image and perform binarization calculation on the reference image after the RGB filter is calculated, so as to generate an identification value (reference value) serving as reference data after the calculation, and then the feature generation module 130 may capture the image (feature image) included in the feature region 330 at intervals and perform the same calculation on the captured feature image, that is, perform RGB filter and binarization calculation in this embodiment, so as to generate the identification value (feature value) serving as feature data.
It should be noted that, after the feature generation module 130 calculates the reference data, the feature generation module 130 may determine whether another window uses the same reference data, if not, the feature generation module 130 may end the execution of this time, and if the calculated reference data is used, the area setting module 110 may select another portion in the target window 310 as the feature area again until the feature generation module 130 determines that the calculated reference data is not used by another window.
After the feature generation module 130 generates the feature data of the feature region 330 each time (step 230), the variation detection module 150 may determine whether the position of the feature region 330 in the display screen 300 changes according to the feature data generated by the feature generation module 130 (step 250). In this embodiment, it is assumed that the variation detecting module 150 can determine whether the position of the feature region is changed by comparing whether the reference data calculated by the feature generating module 130 is the same as the feature data.
If the variation detecting module 150 determines that the position of the feature area in the display 300 is changed, the feature searching module 160 may search the feature area 330 in the display 300 (step 260).
After the feature searching module 160 searches for the feature area 330 with a changed position, the feature searching module 160 may obtain new feature position data of the feature area 330, and the area locating module 170 may determine new monitor position data of the monitor area 320 by using the new feature position data of the feature area 330 (step 270). In the embodiment, it is assumed that the area locating module 170 can determine new monitoring location data of the monitoring area 320 according to the new feature location data obtained when the feature searching module 160 searches the feature area 330 and the original monitoring location data obtained when the area setting module 110 determines the monitoring area 320, that is, it is determined that the coordinate of the upper left corner of the monitoring area 320 is one pixel below the lower left corner of the feature area 330, and the width and height of the monitoring area 320 are unchanged.
After the area positioning module 170 determines the monitored location data of the monitored area 320 using the feature location data of the feature area 330 with the changed location (step 270), the image monitoring module 180 may retrieve the information included in the monitored area 320 according to the monitored location data of the monitored area 320 determined by the area positioning module 170 (step 290).
Thus, even if the position of the target window 310 is moved by the user, the information contained in the monitored area can still be correctly retrieved by the present invention, so as to perform effective monitoring.
In the second embodiment, after the area positioning module 170 determines the monitored position data of the monitored area 320 by using the feature position data of the feature area 330 after the position change (step 270), when the feature generation module 130 generates the feature data of the feature area 330 again (step 230), the feature image can be captured by using the feature position data of the feature area 330 after the position change (the new feature position data obtained by the feature search module 160) and the feature data is generated according to the feature image, at this time, the feature image captured by the feature generation module 130 is the image of the area covered by the feature area 330, so that the feature data generated by the feature generation module 130 is the same as the reference data again, so that the change detection module 150 can determine that the position of the feature area 330 in the display screen 300 does not change (step 250), the frame monitoring module 180 can use the monitored location data of the monitored area 320 to extract the information contained in the monitored area 320 (steps 280 and 290), i.e. the information contained in the monitored area 320 is extracted by using the monitored location data previously determined by the area positioning module 170.
In summary, it can be seen that the difference between the present invention and the prior art is that the present invention has a technical means of determining a feature area on the same target window as a monitoring area and generating feature data of the feature area, when the position of the feature area is determined to be changed according to the feature data, searching the feature area in a display screen, determining monitoring position data of the monitoring area according to the feature position data of the searched feature area, and then capturing information contained in the monitoring area according to the monitoring position data, so that the technical means can solve the problem that the monitoring system in the prior art can only monitor specific positions on a screen, thereby achieving the technical effect of moving a window containing monitored data arbitrarily after the monitoring system is started.
Furthermore, the method for determining the monitoring area according to the characteristic area for monitoring of the present invention can be implemented in hardware, software, or a combination of hardware and software, or can be implemented in a centralized manner in a computer system, or implemented in a distributed manner in which different components are distributed among a plurality of interconnected computer systems.
Although the embodiments of the present invention have been disclosed, the disclosure is not intended to limit the scope of the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. The scope of the present invention should be determined by the following claims.
Claims (10)
1. A method for determining a monitoring area for monitoring according to a characteristic area, the method comprising:
determining a monitoring area of a target window in a display picture;
determining a characteristic region of the target window;
generating feature data of the feature region;
searching the characteristic area in the display picture when the position of the characteristic area is judged to be changed according to the characteristic data;
judging the monitoring position data of the monitoring area according to the searched characteristic position data of the characteristic area; and
and acquiring information contained in the monitoring area from the display picture according to the monitoring position data.
2. The method as claimed in claim 1, further comprising the step of capturing the message included in the monitoring area by using the previously determined monitoring location data when the feature data indicates that the location of the feature area is unchanged.
3. The method as claimed in claim 1, wherein the step of determining the characteristic region of the target window further comprises capturing a reference image included in the characteristic region, generating reference data according to the reference image, and determining the characteristic region again when the reference data is used.
4. The method as claimed in claim 1, wherein the step of determining the change of the position of the feature region according to the feature data is comparing the feature data with reference data generated when determining the feature region to determine whether the position of the feature region changes.
5. The method as claimed in claim 1, wherein the step of determining the monitored location data of the monitored area according to the characteristic location data of the searched characteristic area comprises determining the monitored location data according to the characteristic location data, or calculating an offset value according to the characteristic location data, and determining the monitored location data according to the offset value.
6. A system for determining a monitoring area for monitoring according to a characteristic area, the system comprising:
the area setting module is used for determining a monitoring area of a target window in a display picture and determining a characteristic area of the target window;
the characteristic generation module is used for generating characteristic data of the characteristic region;
the change detection module is used for judging whether the position of the characteristic region changes or not according to the characteristic data;
the characteristic searching module is used for searching the characteristic area in the display picture when the position of the characteristic area changes;
the area positioning module is used for judging the monitoring position data of the monitoring area according to the searched characteristic position data of the characteristic area; and
and the picture monitoring module is used for capturing the information contained in the monitoring area from the display picture according to the monitoring position data.
7. The system as claimed in claim 6, wherein the image monitoring module is further configured to capture the information included in the monitoring area by using the monitoring position data previously determined by the area positioning module when the position of the feature area is not changed.
8. The system as claimed in claim 6, wherein the feature generation module is further configured to capture a reference image included in the feature area and calculate a reference value according to the reference image, and the area setting module is further configured to determine whether the reference value is used and to re-determine the feature area when the reference value is used.
9. The system as claimed in claim 6, wherein the feature generation module is further configured to capture a reference image included in the feature area to generate reference data, and the variation detection module compares the feature data with the reference data to determine whether the position of the feature area is changed.
10. The system as claimed in claim 6, wherein the feature search module is further configured to obtain feature location data when the feature area is searched, and the area location module determines the monitored location data according to the feature location data, or calculates an offset value according to the feature location data, and determines the monitored location data according to the offset value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811453224.2A CN111258274A (en) | 2018-11-30 | 2018-11-30 | System and method for judging monitoring area according to characteristic area to monitor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811453224.2A CN111258274A (en) | 2018-11-30 | 2018-11-30 | System and method for judging monitoring area according to characteristic area to monitor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111258274A true CN111258274A (en) | 2020-06-09 |
Family
ID=70946666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811453224.2A Withdrawn CN111258274A (en) | 2018-11-30 | 2018-11-30 | System and method for judging monitoring area according to characteristic area to monitor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111258274A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1031477A (en) * | 1996-07-15 | 1998-02-03 | Kobe Nippon Denki Software Kk | Method and device for image display |
| JP2001034331A (en) * | 1999-05-18 | 2001-02-09 | Japan Tobacco Inc | Process monitoring device and computer-readable recording medium recording process monitoring program |
| TW200623889A (en) * | 2004-12-27 | 2006-07-01 | Sunplus Technology Co Ltd | Method and device for detecting image movements |
| CN101860746A (en) * | 2009-04-08 | 2010-10-13 | 晨星软件研发(深圳)有限公司 | Motion estimation method |
| TW201427388A (en) * | 2012-12-22 | 2014-07-01 | Ind Tech Res Inst | Image interaction system, detecting method for detecting finger position, stereo display system and control method of stereo display |
| CN105630440A (en) * | 2014-11-25 | 2016-06-01 | 宏正自动科技股份有限公司 | Multi-screen identification method |
-
2018
- 2018-11-30 CN CN201811453224.2A patent/CN111258274A/en not_active Withdrawn
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1031477A (en) * | 1996-07-15 | 1998-02-03 | Kobe Nippon Denki Software Kk | Method and device for image display |
| JP2001034331A (en) * | 1999-05-18 | 2001-02-09 | Japan Tobacco Inc | Process monitoring device and computer-readable recording medium recording process monitoring program |
| TW200623889A (en) * | 2004-12-27 | 2006-07-01 | Sunplus Technology Co Ltd | Method and device for detecting image movements |
| CN101860746A (en) * | 2009-04-08 | 2010-10-13 | 晨星软件研发(深圳)有限公司 | Motion estimation method |
| TW201427388A (en) * | 2012-12-22 | 2014-07-01 | Ind Tech Res Inst | Image interaction system, detecting method for detecting finger position, stereo display system and control method of stereo display |
| CN105630440A (en) * | 2014-11-25 | 2016-06-01 | 宏正自动科技股份有限公司 | Multi-screen identification method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4616120B2 (en) | Image processing apparatus and inspection apparatus | |
| US9367734B2 (en) | Apparatus, control method, and storage medium for setting object detection region in an image | |
| DE112016002373T5 (en) | TRACKING SUPPORT DEVICE, TRACKING SUPPORT SYSTEM AND TRACKING SUPPORT PROCESS | |
| GB2566912A (en) | Tracking assistance device, tracking assistance system and tracking assitance method | |
| CN107209922A (en) | Image processing equipment, image processing system and image processing method | |
| JP2008009849A (en) | Person tracking device | |
| JP2008077424A (en) | Operation analysis system and method | |
| CN110047092B (en) | multi-target real-time tracking method in complex environment | |
| US9111346B2 (en) | Image processing apparatus, image processing method, and recording medium | |
| JP2018124441A (en) | System, information processing apparatus, information processing method, and program | |
| JP7058471B2 (en) | Image processing device, image processing method | |
| KR102470422B1 (en) | Method of automatically detecting sewing stitch based on CNN feature map and system for the same | |
| JPH0844874A (en) | Image change detector | |
| CN110858302A (en) | System and method for editing monitoring script in picture image | |
| CN113687601B (en) | Automatic adjustment method of equipment and intelligent adjustment device applying same | |
| KR20190026625A (en) | Image displaying method, Computer program and Recording medium storing computer program for the same | |
| JP5894707B2 (en) | Information processing apparatus, information processing method, and program for information processing apparatus | |
| CN111258274A (en) | System and method for judging monitoring area according to characteristic area to monitor | |
| JP6049052B2 (en) | Wafer visual inspection apparatus and sensitivity threshold setting method in wafer visual inspection apparatus | |
| US20130139080A1 (en) | Method and apparatus for visualizing a data set | |
| TWI682318B (en) | Monitor system for determining monitored location according to characteristic location and method thereof | |
| KR102161212B1 (en) | System and method for motion detecting | |
| US20100202688A1 (en) | Device for segmenting an object in an image, video surveillance system, method and computer program | |
| CN113938651A (en) | Monitoring method, monitoring system, monitoring device and storage medium for panoramic video interaction | |
| JP6948294B2 (en) | Work abnormality detection support device, work abnormality detection support method, and work abnormality detection support program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200609 |