JP2008107925A - Object detection processing circuit, image processing system and electronic information device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To minimize the scale of an arithmetic circuit and an image memory required for processing, and time required for processing and to carry out processing while making most of the resolution of an original image. <P>SOLUTION: This object detecting processing circuit 1 attains a considerable reduction in the amount of processing data by limiting an area for object detection processing to a part of a screen allowing object detection without using the whole screen like a conventional method by an image area determining circuit 11 when detecting at least one of an object, the movement of the object and the change of the object from image data. Further, the object detection result is held in a detection result holding memory 13, and an area for object detection processing is optimized every time using the detection result of a preceding frame image. Processing can thereby be carried out while making most of the resolution of the original image, and the displacement of the object in the whole screen can be coped with. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an object detection processing circuit used for detecting at least one of a target object, a movement of the target object, and a change in the target object from input image data, and a target object obtained by the object detection processing circuit. The present invention relates to an electronic information device such as an image processing system and a game device that can operate various devices using various detection information such as position information, movement amount, movement direction, and movement pattern.

  2. Description of the Related Art In recent years, mobile electronic devices such as mobile phones have been improved in functionality due to high integration such as LSI. In addition, many proposals have been made for man-machine interfaces in order to efficiently use functions in small electronic devices.

  In a device equipped with a camera or the like, it may be considered to operate the device using the captured image. For example, the device may be operated by a hand movement captured by a camera. Specifically, a method is conceivable in which a hand, its movement or its change is detected from the image data, and the device is operated using various information such as its movement amount, movement direction and movement pattern. Here, in order to detect the target object or its movement or change from the image data, it is necessary to store the image data and to perform arithmetic processing for detecting the target object.

  Conventionally, in a method for detecting a target, as disclosed in Patent Document 1, processing such as taking a difference between different images is required. This is a method for detecting the movement of an object.

In Patent Document 2, an image is divided into areas, the image data included in each area is integrated, and a determination process is performed to determine whether there is a change for each area using the integrated value. A method for reducing the processing time has been proposed.
JP-A-62-113279 JP 2006-79387 A

  However, the conventional object detection processing method has the following problems.

  For example, in the conventional object detection method disclosed in Patent Document 1, since the amount of image data processing is as large as the entire screen, a relatively large image memory is required to hold the image data. In addition, a considerable amount of processing time is required. In order to continuously perform detection processing on image data transmitted at a frame rate of 30 frames / second, it is necessary to perform high-speed processing. To increase the processing speed, methods such as increasing the driving frequency or performing parallel processing are conceivable. However, increasing the driving frequency increases current consumption, and the circuit scale is required to perform parallel processing. There is a problem of growing. In particular, in the case of portable electronic devices, it is battery-powered, and due to restrictions such as device miniaturization and low power consumption, arithmetic circuits and image memories that require such relatively large-scale and high-speed processing are installed. It was difficult to put the system used into practical use.

  Further, in the conventional object detection method disclosed in Patent Document 2, it is possible to recognize in which area the change has occurred, but cannot recognize in which coordinate the change has occurred, and the portable electronic device When it is considered to be used as a man-machine interface such as, it is difficult to discriminate delicate movements such as hands.

  Therefore, it is desirable to perform processing while maintaining the resolution of the original image, and if the amount of processing can be reduced on that basis, the time required for the execution will also be shortened. The time can be shortened, and a smooth operation can be performed on the input.

  The present invention solves the above-described conventional problems. When detecting at least one of a target object, a movement of the target object, and a change of the target object from input image data, an arithmetic circuit and an image memory necessary for the processing are provided. An object detection processing circuit capable of processing while keeping the resolution of the original image to a minimum, and an electronic information device such as an image processing system and a game device using the same The purpose is to provide.

  The object detection processing circuit according to the present invention includes a region limiting unit that optimizes a detection region in the next frame image based on detection information of the target object in the previous frame image, and a detection region optimized by the region limiting unit. The target object detection information includes object detection processing means for detecting at least one of the target object, the movement of the target object, and the change of the target object from the input image data. The above objective is achieved.

  Preferably, in the object detection processing circuit of the present invention, the detection area in the next frame image is optimized as a partial area of the output screen that enables detection of the target object.

  Further preferably, in the object detection processing circuit according to the present invention, the detection area in the next frame image moves from the position of the target object detected in the previous frame image during a time change of one frame. The region size is set so that the amount to be within the region.

  Further preferably, the detection information of the target object in the object detection processing circuit of the present invention is position information on the output screen of the target object.

  Further, preferably, the detection information of the target object in the object detection processing circuit of the present invention includes a moving direction and a moving speed of the target object in addition to the position information of the target object.

  Further preferably, the detection information of the target object in the object detection processing circuit of the present invention includes a change amount of the display area of the target object in addition to the position information of the target object.

  Further preferably, the position information of the target object in the object detection processing circuit of the present invention is detected coordinates (X0, Y0) indicating the center point or the point of interest of the target object.

  Further preferably, the region limiting means in the object detection processing circuit according to the present invention sets a region of a predetermined size that can detect the target object with the detection position information of the target object in the previous frame image as a center or a starting point. An image region determination circuit that determines a detection region in a frame image, and a region size setting unit that enables setting of a size parameter of the detection region.

  Further preferably, the area size setting means in the object detection processing circuit of the present invention is an area size setting register which enables setting of the size parameter from the outside.

  Further preferably, the region size setting means in the object detection processing circuit of the present invention is capable of changing the value of the size parameter.

  Further preferably, in the object detection processing circuit of the present invention, when the detection information of the target object includes a moving direction of the target object in addition to the position information of the target object, the region size setting means includes: The value of the size parameter can be automatically changed according to the moving direction.

  Further preferably, in the object detection processing circuit according to the present invention, when the detection information of the target object includes a moving speed of the target object in addition to the position information of the target object, the region size setting unit includes: The value of the size parameter can be automatically changed according to the moving speed.

  Further preferably, the image region determination circuit in the object detection processing circuit of the present invention receives the coordinates (X, Y) of the image data and determines whether the coordinates (X, Y) are within the detection region. A data determination circuit for determining;

  Further preferably, the data determination circuit in the object detection processing circuit according to the present invention performs an X direction area determination to determine the X direction and Y direction areas of the coordinates (X, Y) of the image data with respect to the detection position information of the target object. Each output of the determination circuit, the Y direction area determination circuit, the X direction area determination circuit, and the Y direction area determination circuit is input, and the coordinates (X, Y) of the image data are areas outside or within the determination area AND gate means for outputting determination information.

  Still preferably, in a data determination circuit in the object detection processing circuit of the present invention, whether a distance between two points of coordinates (X, Y) of the image data with respect to detection position information of the target object is equal to or less than a predetermined determination value. A two-point distance determination circuit that performs the region determination and outputs the region determination information in which the coordinates (X, Y) of the image data are outside or within the determination region.

  Still preferably, in a data determination circuit in the object detection processing circuit of the present invention, a distance between two points of coordinates (X, Y) of the image data with respect to detection position information of the target object is equal to or less than a predetermined first determination value. A first point-to-point distance determination circuit that determines whether or not there is an area, and a distance between the two points of the coordinates (X, Y) of the image data with respect to the detected position information of the target object is greater than the second determination value Outputs of a second point-to-point distance determining circuit for determining whether the area is large and the first and second point-to-point distance determining circuits are input, and the coordinates (X, Y) of the image data are input. And AND gate means for outputting area determination information outside or within the determination area.

  Further preferably, the area limiting means in the object detection processing circuit of the present invention sets a specific area in advance as a start area at the time of the first target object detection, and places or moves the target object in the start area in advance. To do.

  Further preferably, the area limiting means in the object detection processing circuit of the present invention sequentially detects the position of the detection area on the output screen for each frame image until the target object is detected during the first target object detection. Continue the target object detection process while changing.

  Further preferably, the area limiting unit in the object detection processing circuit of the present invention preferably includes a rectangular area that is separated from the detection position information of the target object in the previous frame image by each of the size parameter Δx and the size parameter Δy. The detection area is limited.

  Further preferably, the region limiting means in the object detection processing circuit of the present invention limits a circular region separated by a value of the size parameter Δr around the detection position information of the target object in the previous frame image as the detection region.

  Further preferably, the region limiting means in the object detection processing circuit according to the present invention provides a donut region separated from the size parameter Δr1 to the size parameter Δr0 (> Δr1) with the detection position information of the target object in the previous frame image as a center. The detection area is limited.

  Further preferably, in the object detection processing circuit of the present invention, an image data memory for storing image data in the detection area limited by the area limiting means, and a workpiece for arithmetic processing by the object detection processing means. It further includes a calculation memory used as a memory and a detection result holding memory for holding detection position information of the target object of the previous frame image.

  Further preferably, the image area determination circuit of the area limiting means in the object detection processing circuit of the present invention is such that the detection position information of the target object given from the detection result holding memory and the size given from the area size setting means. From the parameter value, it is determined whether or not the input image data is included in a detection area in which object detection is enabled, and when it is determined that the input image data is in the detection area, the image data memory Holds the input image data.

  Further preferably, the object detection processing means in the object detection processing circuit of the present invention detects the detection information of the target object using image data stored in the image data memory.

  Further preferably, the object detection processing means in the object detection processing circuit of the present invention detects a difference between two input image data groups arranged in time series, or processes the input image data group to perform the input. Data of a fixed pattern included in the image data group is extracted, a difference between the input image data group and the extracted data is extracted, and moving object data included in the input image data is detected as detection information of the target object.

  The image processing system of the present invention includes the object detection processing circuit of the present invention, a camera module that supplies image data including image information of the target object obtained by imaging to the object detection processing circuit, and the object detection processing And a central processing circuit for controlling object detection processing by the circuit, thereby achieving the above object.

  An electronic information device of the present invention includes the object detection processing circuit of the present invention, a camera module that supplies image data including image information of the target object obtained by imaging to the object detection processing circuit, and the object detection processing A central processing circuit for controlling object detection processing by the circuit, image output means for outputting the image data on an output screen, and a movement amount, a moving direction and a movement pattern of the target object obtained by the object detection processing circuit. And a device operation executing means for executing a device operation using at least one of the detection information, whereby the above object is achieved.

  The operation of the present invention will be described below with the above configuration.

  When detecting the target object, the movement of the target object, and the change of the target object from the input image data, if the object detection process for the entire screen is performed as in the conventional technology, the processing data becomes large, so it is necessary for the process. This increases the size of the arithmetic circuit and the image memory and the time required for processing. Therefore, in the present invention, the detection area for performing the object detection process is not limited to the entire screen as in the prior art, but is limited to a partial screen area where the target object can be detected in the next frame image. We are trying to reduce it.

  Here, if the detection area is limited, the detection area becomes only a part of the image, and it is not possible to cope with a case where the target object moves on the entire screen, and input (operation instruction to the device) becomes difficult. Problems arise. In addition, it is obvious that the convenience of the system is greater when an object can be detected on the entire screen. Therefore, in the present invention, by optimizing the detection processing area each time using the detection result (detection information) of the previous frame image, it is possible to process while maintaining the resolution of the original image. It is also possible to cope with the movement of the target object.

  The detection area is optimized as follows. Assume that when processing the current frame image, detection processing is performed in a detection region centered on coordinates (X1, Y1), and a target object centered on coordinates (X2, Y2) is detected. Before starting the processing of the next frame image, the center of the detection area is moved and changed to the coordinates (X2, Y2), and the object detection processing of the next frame image is performed. As described above, based on the detection result information of the image data input every frame, the detection area to be processed with the next frame image is determined.

  Since the target object moves starting from the detected coordinates (X0, Y0), the size of the detection area is set so that the amount of movement of the target object during the time change for one frame is within the area. If so, the next frame image can also be detected. As described above, efficient detection can be performed in the detection area limited to the partial screen area where the target object can be detected.

  As described above, according to the present invention, when detecting at least one of the target object, the movement of the target object, and the change of the target object from the image data, the entire screen is not processed as in the related art. The target object detection area is limited to a partial area of the display screen (output screen) where the object can be detected with the coordinates (X0, Y0) of the target object detected in the previous frame as the center point or start point (or start point). As a result, the amount of image data used for the detection process can be greatly reduced, the image memory, the arithmetic circuit and the processing time required for the process can be reduced, and the processing can be performed while taking advantage of the resolution of the original image. As a result, even in devices that require downsizing and low power consumption, such as portable electronic devices, the target object, the change of the target object, and the movement of the target object can be easily captured and detected smoothly from the image data. It is possible to construct a man-machine interface using images (detecting image movement and operating the device) without difficulty.

  Embodiments of an image processing system using an object detection processing circuit of the present invention will be described below in detail with reference to the drawings.

  FIG. 1 is a block diagram illustrating a configuration example of a main part of an image processing system according to an embodiment of the present invention.

  In FIG. 1, an image processing system 10 according to the present embodiment includes an object detection processing circuit 1 that detects and processes at least one of a target object, movement of the target object, and change of the target object from input image data, and the object detection processing. A system that includes a central processing unit 2 that controls the circuit 1 and a camera module 3 that supplies input image data obtained by imaging to the object detection processing circuit 1. Peripheral circuits having functions inherent to portable electronic devices are added to the system.

  The object detection processing circuit 1 limits the detection area of the target object to a partial area of the entire display screen (output screen), and based on the object detection result (detection information: detection coordinates of the target object) obtained from this detection area. The image area determination circuit 11 and the area size setting register 12 as area limiting means for optimizing the detection area in the next frame image, and image data for storing image data in the detection area limited by the area limiting means A detection processing arithmetic circuit 14 as an object detection processing means for detecting at least one of a target object, a movement of the target object, and a change of the target object from the input image data as detection information for the memory 13 and the limited detection area. A calculation memory 15 used as a work memory for calculation by the detection processing calculation circuit 14, and object detection of the previous frame image Fruit is a detection result memory 16 to be held. In the case of a general system, it is conceivable that the central processing unit 2 performs processing using software without providing the detection processing arithmetic circuit 14.

  The image area determination circuit 11 determines an area of a predetermined size that can detect the target object as a detection area in the next frame image with the detection coordinate (X, Y) of the target object in the previous frame image as the center. The image area determination circuit 11 recognizes the coordinates of the input image data according to the order in which the image data is input. Further, the image area determination circuit 11 is inputted from the detection coordinates (X, Y) of the target object given from the detection result holding memory 16 and the size parameter value of the detection area given from the area size setting register 12. It is determined whether or not the detected image data is included in the detection area in which object detection is enabled. If it is determined that the image data is in the detection area, the image data in the detection area is written in the image data memory 13. Saved.

  The area size setting register 12 is an area size setting means, and allows the size parameter value of the target object detection area to be set from the outside. The value of this size parameter is set in advance by the central processing unit 2 as a control means (CPU). It is also possible to change the value of the size parameter midway as necessary. Note that if the movement or change of the target object is larger than the value of the size parameter (detection region), the target object is not detected in the next frame image.

  The detection processing arithmetic circuit 14 uses the image data of the limited detection area stored in the image data memory 13 to detect at least one of the target object, the movement of the target object, and the change of the target object. Processing is performed. For example, a difference between two image data groups arranged in time series is detected, or the input image data group is processed to extract fixed pattern data included in the input image data group, and the input image data group A process of extracting a difference from the extracted data and obtaining moving object data included in the input image data group as detection information is performed.

  At this time, the detection processing arithmetic circuit 14 recognizes the correspondence between the image data and the coordinates based on the size parameters given from the region size setting register 12 and the detected coordinates of the target object given from the detection result holding memory 16. When the detection processing is completed, the detection processing arithmetic circuit 14 notifies the central processing unit 2 of the completion of processing by a detection interrupt request signal, and the detection result information (detection information) is written and stored in the detection result holding memory 16. Is done. Note that the amount of data processing is greatly increased when detecting the contour portion of the target object. Here, since the amount of data processing is to be reduced, only the center point information of the target object is written in the detection result holding memory 16 as the detection coordinates within the limited detection area.

  At this time, using the new detection coordinates stored in the detection result holding memory 16, the image area determination circuit 11 and the detection processing arithmetic circuit 14 process the next input image data. By repeating the above cycle, the detection area is optimized.

  With the above configuration, the operation of each component in the object detection processing circuit 1 of the present embodiment will be described in detail below.

  First, input image data from the camera module 3 is sequentially input to the image area determination circuit 11 of the object detection processing circuit 1, and the image area determination circuit 11 detects the detection coordinates (X, Y) of the target object in the previous frame image. A region of a predetermined size that can detect the target object is determined as a detection region in the next frame image.

  Next, the detection processing arithmetic circuit 14 of the object detection processing circuit 1 performs object detection processing for detecting at least one of the target object, the movement of the target object, and the change of the target object from the image data in the detection area.

  When performing such an object detection process, it is necessary to consider how to determine the first detection region where detection is started. This is because there is no data on the detection coordinates (X, Y) of the target object in the first previous frame image when trying to limit the detection area during the first object detection. In order to cope with this, the following method can be considered.

  FIG. 2 is a screen diagram for explaining a setting example of the detection area at the time of the first object detection. In the case of FIG. 2, a method of predetermining the detection process start area will be described.

  In FIG. 2, while waiting for input, a specific area (in this case, the central part) of the entire screen 20 is set in advance as a start area 21, and when it is desired to start input, it should be detected in this start area 21. The target 22 is arranged or moved in advance. As a result, when the target 22 is detected, the detection area is optimized from the next frame image as described above.

  In this way, the image area determination circuit 11 sets a specific area as the start area 21 in advance at the time of the first object detection, and arranges or moves the target object in the start area 21.

  FIG. 3 is a screen diagram for explaining another setting example of the detection area at the time of the first object detection. In the case of FIG. 3, a method of performing detection processing by scanning the entire screen by sequentially changing the area for each frame while waiting for input will be described.

  In FIG. 3, when an image of a certain frame is input, the upper left region (0) is detected as the processing region 31 in the entire screen 30. If the target 32 is not detected in this area (0), the area (1) immediately adjacent to the area (0) is detected and processed as the processing area 31 in the entire screen 30 in the next frame image.

  If the target 32 is not detected in the area (1), the area (2) on the right side of the area (1) is detected and processed as the processing area 31 in the entire screen 30 in the next frame image. The In this way, the detection process is sequentially performed while the processing area is scanned and sequentially changed from the area (0) to the area (15) for each frame, and the process is repeated until the target 32 is detected.

  In this way, the image area determination circuit 11 continues the object detection process while sequentially changing the detection area (processing area) for each frame image until the target object is detected during the first object detection.

  In the case of FIG. 3, the target 32 is detected in the region (7), and the detection region is optimized as described above from the point of detection.

  Next, a configuration example and a determination example of the image region determination circuit 11 will be described in detail with reference to FIGS.

  In the example of FIG. 4, the image area determination circuit 11A receives the coordinates (X, Y) of the image data, and the X and Y directions of the coordinates (X, Y) with respect to the detected coordinates (X0, Y0) of the target object. The X direction area determination circuit 111 and the Y direction area determination circuit 112 that perform the area determination of the X direction area, and the outputs of the X direction area determination circuit 111 and the Y direction area determination circuit 112 are input, and the coordinates (X, Y) are determined as the determination area. And an AND gate 113 as AND gate means for outputting area determination result information of “0” outside or “1” within the determination area. In this case, a coordinate (X, Y) of the image data is input, and a data determination circuit that determines whether or not the coordinate (X, Y) is within the detection region is provided.

  In this image area determination circuit 11A, the X direction area determination circuit 111 and the Y direction area determination circuit 112 use the size parameters ΔX and ΔY given from the area size setting register 12 to center the detection coordinates (X0, Y0). The coordinates up to the coordinates separated by ΔX in the X direction (horizontal direction in the figure) and ΔY in the Y direction (vertical direction in the figure) are determined as the detection area 41, and are validated by the area determination result output from the AND gate 113. The image area determination circuit 11A limits a rectangular area separated by a distance Δx and a distance Δy from the detection coordinates (X0, Y0) of the target object in the previous frame image as a detection area 41 in FIG.

  As shown in FIG. 5, the detection area 41 is a rectangular area that is separated by ΔX in the X direction and ΔY in the Y direction around the detection coordinates (X0, Y0) in the entire screen 40. Here, if information such as a change or movement of the object is large only in the horizontal direction is known in advance, the central processing unit 2 sets a large value for ΔX and a small value for ΔY in the region size setting register 12. It can also be set.

  In the example of FIG. 6, the image area determination circuit 11B receives the coordinates (X, Y) of the image data, and the distance between the two points of the coordinates (X, Y) with respect to the detected coordinates (X0, Y0) of the target object. A distance between two points at which the area is determined whether or not it is equal to or less than the determination distance (radius Δr) and the area determination result information with the coordinates (X, Y) “0” outside the determination area or “1” within the determination area is output. A determination circuit 114 is included.

  In this image region determination circuit 11B, the distance between the two points is determined by the distance determination circuit 114 using the size parameter Δr given from the region size setting register 12 to the coordinates separated by the radius Δr with the detected coordinate (X0, Y0) as the center. The detection area 51 is effective. In the image area determination circuit 11B, a circular area that is separated by a radius Δr around the detection coordinates (X0, Y0) of the target object in the previous frame image is limited as the detection area 51 in FIG.

  As shown in FIG. 7, the detection area 51 is a circular area that is separated from the detection coordinates (X0, Y0) by a radius Δr in the entire screen 50. In this way, by making the detection area 51 a circular area, it is possible to deal with changes and movements of the object to the same extent in all directions.

  In the example of FIG. 8, as an application example, the detection region is cut out to form a donut shape. As shown in FIG. 8, the image area determination circuit 11C receives the coordinates (X, Y) of the image data, and the distance between the two points of the coordinates (X, Y) with respect to the detected coordinates (X0, Y0) of the target object. The first two-point distance determination circuit 115 for determining whether or not is equal to or less than the first determination distance (radius Δr0) and the coordinates (X, Y) with respect to the detected coordinates (X0, Y0) of the target object A second point-to-point distance determination circuit 116 for determining whether the distance between the two points is greater than the second determination distance (radius Δr1), a first point-to-point distance determination circuit 115, and a second point 2 Each output of the point-to-point distance determination circuit 116 is inputted, and an AND gate 117 serving as an AND gate means for outputting region determination result information with the coordinates (X, Y) being “0” outside the determination region or “1” within the determination region. And have. Also in this case, a coordinate (X, Y) of the image data is input, and a data determination circuit for determining whether or not the coordinate (X, Y) is within the detection area is provided.

  In this image region determination circuit 11C, the size parameters Δr0 and Δr1 given from the region size setting register 12 by the two-point distance determination circuits 115 and 116 are used, and the detected coordinates (X0, Y0) are used as the center and more than Δr0. The coordinates close to and further away from Δr1 are determined as detection areas and are validated by the output from the AND gate 117. The image area determination circuit 11C limits the donut area that is separated from the radius Δr1 to the radius Δr0 (> Δr1) around the detection coordinates (X0, Y0) of the target object in the previous frame image as the detection area 61 in FIG.

  As shown in FIG. 9, the detection area 61 in this case is a donut-shaped area separated from Δr1 to Δr0 with the detection coordinates (X0, Y0) as the center. Thus, by making the detection area 61 a donut area, the change or movement of the object is not detected when it is within a range of Δr1. For example, when it is desired to suppress the load on the central processing unit 2, an interrupt request is generated only when a change or movement occurs in the object. The apparatus 2 can be devoted to other work, and the efficiency of the system can be improved.

  Next, an example of updating the rectangular detection region 41 in FIG. 5 will be described in detail with reference to FIGS.

  In FIG. 10, by using the size parameters ΔX and ΔY given from the region size setting register 12 around the detected coordinates (X0, Y0) in the entire screen 40 of the previous frame image, ΔX in the X direction (horizontal direction in the figure). The detection region 411 is defined by coordinates YY apart from each other in the Y direction (vertical direction in the figure). As a result of performing the target object detection process on the detection area 411, the target object is detected at the coordinates (X1, Y1).

  In the next frame image, the range shown in FIG. 11 with the detection coordinates (X1, Y1) in FIG. As a result of performing the target object detection process on the detection area 412, the target object is detected at the coordinates (X2, Y2).

  In the next frame image, the range shown in FIG. 12 with the detection coordinates (X2, Y2) in FIG. 11 as the center is the detection area 413 of the target object. As a result of performing the detection process on the detection area 413, the target object is detected at the coordinates (X3, Y3).

  In the next frame image, the range shown in FIG. 13 with the detection coordinates (X3, Y3) in FIG. As a result of performing the detection process on the detection region 414, the target object is detected at the coordinates (X4, Y4).

  As described above, by sequentially updating the target object according to the movement of the target object as in the detection areas 411 to 414 using the detection result of the target object in the previous frame image, the target object of only the limited detection area is detected. As a result, it is possible to perform the detection process on the entire screen 40 while performing the detection process.

  Next, an example of the update will be described taking the circular detection region 51 of FIG. 7 as an example.

  Centering on the detection coordinate (X0, Y0) of the target object in the entire screen 50 of the previous frame image, using the size parameter Δr given from the region size setting register 12, it is separated from the detection coordinate (X0, Y0) by the radius Δr. The coordinates up to the coordinates are the target object detection area 51. As a result of the target object detection process performed on the detection area 51, the target object is detected at the coordinates (X1, Y1).

  In the next frame image, the detection area extends from the detection coordinates (X1, Y1) of the target object to the coordinates separated by the radius Δr. As a result of performing the target object detection process on this detection area, the target object is detected at the coordinates (X2, Y2).

  In the next frame image, the detection area is a range up to the coordinates separated by the radius Δr with the detected coordinates (X2, Y2) of the target object as the center. As a result of the target object detection process performed on this detection area, the target object is detected at the coordinates (X3, Y3).

  In the next frame image, the detection area is a range up to the coordinates separated by the radius Δr with the detection coordinates (X3, Y3) of the target object as the center. As a result of performing the target object detection process on this detection area, the target object is detected at the coordinates (X4, Y4).

  As described above, the limited detection region is obtained by sequentially updating the detection region as a circular detection region from the detection coordinate of the target object in the previous frame image to the coordinate separated by the radius Δr. As a result, the detection process can be performed on the entire screen 50.

  Next, an update example will be described by taking the donut-shaped detection region 61 of FIG. 9 as an example.

  Using the size parameters Δr0 and Δr1 given from the region size setting register 12 with the detection coordinates (X0, Y0) of the target object in the entire screen 60 of the previous frame image as the center, it is closer to Δr0 and more than Δr1. A region up to the distance is the detection area 61. As a result of performing the target object detection process on the detection area 61, the target object is detected at the coordinates (X1, Y1).

  In the next frame image, the detection area is set to the coordinates closer to Δr0 and further away from Δr1 with the detected coordinates (X1, Y1) of the target object as the center. As a result of performing the target object detection process on this detection area, the target object is detected at the coordinates (X2, Y2).

  In the next frame image, the detection area is set to the coordinates closer to Δr0 and further away from Δr1 with the detected coordinates (X2, Y2) of the target object as the center. As a result of the target object detection process performed on this detection area, the target object is detected at the coordinates (X3, Y3).

  In the next frame image, the detection area is set to the coordinates closer to Δr0 and further away from Δr1 with the detected coordinates (X3, Y3) of the target object as the center. As a result of performing the target object detection process on this detection area, the target object is detected at the coordinates (X4, Y4).

  As described above, with the detection coordinates of the target object in the previous frame image as the center, coordinates closer to Δr0 and further away from Δr1 are set as detection areas, and the detection areas are sequentially updated. As a result, it is possible to perform the target object detection process on the entire screen 60 while performing the detection process of only the limited detection region.

  As described above, according to the present embodiment, the object detection processing circuit 1 performs the object detection processing by the image region determination circuit 11 when detecting at least one of the object, the movement of the object, and the change of the object from the image data. The amount of processing data is greatly reduced by limiting the area to be performed to a part of the screen that enables object detection rather than the entire screen as in the prior art. In addition, the object detection result is held in the detection result holding memory 13, and the region where the object detection process is performed is optimized every time using the detection result of the previous frame image, thereby processing the original image while taking advantage of the resolution of the original image. It is possible to cope with the movement of an object on the entire screen. In this way, an object detection processing circuit capable of processing while minimizing the scale of the arithmetic circuit and the image memory necessary for processing and the time required for processing and taking advantage of the resolution of the original image is obtained. Can do.

  Although not specifically described in the above embodiment, the image area determination circuit 11 and the area size setting register that optimize the detection area in the next frame image based on the object detection result information in which the detection area of the target object is limited. If there is a detection processing arithmetic circuit 14 that detects at least one of the target object, the movement of the target object, and the change of the target object from the input image data with respect to the detection area optimized according to FIG. Can be limited to a part of the screen where objects can be detected, and the amount of processing data can be greatly reduced, minimizing the scale of the arithmetic circuit and image memory required for processing, and the time required for processing, and the original image It is possible to achieve the object of the present invention in which processing can be performed while taking advantage of the resolution.

  Although not specifically described in the above embodiment, the detection information of the target object includes the movement amount, the movement direction, and the movement of the target object in addition to the detection coordinates (X0, Y0) as the detection position information of the target object. It may include speed. Further, the detection information of the target object may include a change amount of the display area (occupied area) of the target object in addition to the detection coordinates (X0, Y0) as the detection position information of the target object.

  Furthermore, in the above embodiment, an area of a predetermined size (size parameter value) that enables detection of the target object with the detection coordinates (X0, Y0) of the target object in the previous frame image as the center is set as the detection area in the next frame image. Although it is configured to include the image region determination circuit 11 to be determined, the present invention is not limited to this, and the target object can be detected from the detection coordinates (X0, Y0) as detection position information of the target object in the previous frame image. You may comprise so that it may have the image area | region determination circuit 11 which determines the area | region of a predetermined size (value of a size parameter) as a detection area | region in a next frame image. In this case, the detection area in the next frame image can be obtained from the detection coordinates (X0, Y0) according to at least one of the movement amount, movement direction, and movement speed of the detection target object.

  That is, the area size setting register 12 as the area size setting means can automatically change the value of the size parameter according to the moving direction of the target object. Also, the area size setting register 12 as the area size setting means can automatically change the value of the size parameter according to the moving speed of the target object. Further, the area size setting register 12 as the area size setting means can automatically change the value of the size parameter according to the movement amount of the target object. Therefore, the size of the detection area in the next frame image can be automatically changed to the minimum and optimized according to at least one of the movement amount, movement direction, and movement speed of the detection target object.

  Furthermore, a game capable of operating various devices using various detection information such as position information of the target object, its movement amount, its movement direction, and movement pattern obtained by the object detection processing circuit 1 of the above embodiment. An electronic information device such as a device can be obtained. The electronic information device may be a portable game device. Although not specifically described in the above embodiment, the object detection processing circuit 1 of the above embodiment and the target object obtained by imaging are used. A camera module 3 that supplies image data including image information (for example, an input pen of a pen tablet; in this case, the detected coordinates are at the tip of the input pen), and the object detection processing circuit 1 A central processing unit 2 that controls the object detection processing by the image processing unit, an image output unit such as a display unit or a printing unit (printer) that outputs image data including image information of the target object on an output screen (for example, a display screen or a paper surface); The operation (a) of the device is detected using the detection information of at least one of the movement amount, the movement direction, and the movement pattern of the target object obtained by the object detection processing circuit 1. Etc.) to appear the publication changes and another character may be provided with a device operation execution means for executing. Furthermore, you may further have a communication means to transmit / receive (communication) this output screen (for example, a display screen or a paper surface).

  As mentioned above, although this invention has been illustrated using preferable embodiment of this invention, this invention should not be limited and limited to this embodiment. It is understood that the scope of the present invention should be construed only by the claims. It is understood that those skilled in the art can implement an equivalent range based on the description of the present invention and the common general technical knowledge from the description of specific preferred embodiments of the present invention. Patents, patent applications, and documents cited herein should be incorporated by reference in their entirety, as if the contents themselves were specifically described herein. Understood.

  The present invention relates to an object detection processing circuit used for detecting at least one of a target object, a movement of the target object, and a change in the target object from input image data, and a target object obtained by the object detection processing circuit. In the field of electronic information devices such as image processing systems and game devices that can operate various devices using various detection information such as position information, movement amount, movement direction and movement pattern, from image data When detecting at least one of the target object, the movement of the target object, and the change of the target object, the detection area of the target object is detected in the previous frame instead of processing the entire screen as in the prior art. Display screen (output screen) that can detect the object with the coordinates (X0, Y0) of the target object as the center point or start point (or start point) By limiting to a part of the image area, the amount of image data used for detection processing can be greatly reduced, the image memory, arithmetic circuit and processing time required for processing can be reduced, and the resolution of the original image It can be processed while taking advantage of As a result, even in devices that require downsizing and low power consumption, such as portable electronic devices, the target object, the change of the target object, and the movement of the target object can be easily captured and detected smoothly from the image data. It is possible to construct a man-machine interface using images (detecting image movement and operating the device) without difficulty.

It is a block diagram which shows the principal part structural example of the image processing system using the object detection processing circuit which concerns on embodiment of this invention. In the image processing system of FIG. 1, it is a figure for demonstrating the example of a setting of the detection area at the time of the 1st detection. In the image processing system of FIG. 1, it is a figure for demonstrating the other example of a setting of the detection area at the time of the 1st detection. FIG. 2 is a block diagram illustrating a configuration example of an image region determination circuit in FIG. 1. FIG. 5 is a screen diagram illustrating a determination example by the image region determination circuit of FIG. 4. FIG. 6 is a block diagram illustrating another configuration example of the image region determination circuit in FIG. 1. It is a screen figure which shows the example of determination by the image area determination circuit of FIG. FIG. 6 is a block diagram illustrating another configuration example of the image region determination circuit in FIG. 1. It is a screen figure which shows the example of determination by the image area determination circuit of FIG. It is a screen figure of the first update which shows the example of an update of the detection area | region of FIG. FIG. 6 is a second update screen diagram illustrating an example of update of the detection region in FIG. 5. FIG. 6 is a third update screen view illustrating an example of detection area update in FIG. 5. FIG. 6 is a fourth update screen view illustrating an example of detection area update in FIG. 5.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Image processing system 1 Object detection processing circuit 11, 11A-11C Image area determination circuit 12 Area size setting register 13 Detection result holding memory 14 Detection processing operation circuit 15 Operation memory 16 Image data memory 2 Central processing unit 3 Camera module 20, 30, 40, 50, 60 Whole screen 21 Start area 22, 32 Target object 31 Processing area 41, 51, 61, 411-414 Detection area 111 X direction area determination circuit 112 Y direction area determination circuit 113, 117 AND gate 114-116 Distance determination circuit between two points

Claims (27)

An area limiting means for optimizing the detection area in the next frame image based on the detection information of the target object in the previous frame image;
Object detection for detecting at least one of a target object, movement of the target object, and change of the target object from input image data as detection information of the target object with respect to the detection area optimized by the area limiting unit An object detection processing circuit comprising processing means.   The object detection processing circuit according to claim 1, wherein the detection area in the next frame image is optimized as a partial area of an output screen that enables detection of the target object.   The detection area in the next frame image is set so that the amount of movement of the target object during the time change of one frame from the position of the target object detected in the previous frame image is within the area. The object detection processing circuit according to claim 1 or 2.   The object detection processing circuit according to claim 1, wherein the target object detection information is position information on an output screen of the target object.   The object detection processing circuit according to claim 1, wherein the detection information of the target object includes a moving direction and a moving speed of the target object in addition to the position information of the target object.   The object detection processing circuit according to claim 1, wherein the detection information of the target object includes a change amount of a display area of the target object in addition to the position information of the target object.   The object detection processing circuit according to claim 4, wherein the position information of the target object is detected coordinates (X0, Y0) indicating a center point or a point of interest of the target object.   The area limiting means determines an area of a predetermined size that can detect the target object as a detection area in the next frame image with the detection position information of the target object in the previous frame image as the center or starting point. The object detection processing circuit according to claim 1, further comprising: a region size setting unit configured to set a size parameter of the detection region.   The object detection processing circuit according to claim 8, wherein the area size setting means is an area size setting register that enables setting of the size parameter from the outside.   The object detection processing circuit according to claim 8, wherein the area size setting unit is capable of changing a value of the size parameter.   When the detection information of the target object includes the moving direction of the target object in addition to the position information of the target object, the area size setting unit automatically sets the value of the size parameter according to the moving direction. The object detection processing circuit according to claim 8, which can be changed to:   When the detection information of the target object includes the moving speed of the target object in addition to the position information of the target object, the area size setting unit automatically sets the size parameter value according to the moving speed. The object detection processing circuit according to claim 8, wherein the object detection processing circuit can be changed automatically.   The image area determination circuit includes a data determination circuit that receives image data coordinates (X, Y) and determines whether the coordinates (X, Y) are within the detection area. Object detection processing circuit.   The data determination circuit includes an X-direction region determination circuit and a Y-direction region determination circuit that perform region determination in the X direction and Y direction of the coordinates (X, Y) of the image data with respect to detection position information of the target object, AND gate means for inputting each output of the direction area determination circuit and the Y direction area determination circuit, and outputting the area determination information whose coordinates (X, Y) of the image data are outside or within the determination area. Item 14. The object detection processing circuit according to Item 13.   The data determination circuit determines a region whether or not a distance between two points of the coordinates (X, Y) of the image data with respect to detection position information of the target object is equal to or less than a predetermined determination value, and coordinates of the image data The object detection processing circuit according to claim 13, further comprising: a point-to-point distance determination circuit that outputs area determination information outside (X, Y) or within the determination area.   The data determination circuit performs a region determination as to whether or not a distance between two points of the coordinates (X, Y) of the image data with respect to the detection position information of the target object is equal to or less than a predetermined first determination value. A second distance determination circuit for determining a region whether or not the distance between the two points of the coordinates (X, Y) of the image data with respect to the detected position information of the target object is greater than a second determination value; Each of the outputs of the distance determination circuit between two points and the first and second distance determination circuits between the two points is input, and the coordinates (X, Y) of the image data are area determination information outside or within the determination area 14. An object detection processing circuit according to claim 13, further comprising AND gate means for outputting.   9. The object detection according to claim 1, wherein the area limiting unit sets a specific area as a start area in advance when the first target object is detected, and places or moves the target object in the start area. Processing circuit.   The area limiting means continues the target object detection process while sequentially changing the position of the detection area on the output screen for each frame image until the target object is detected during the first target object detection. The object detection processing circuit according to claim 8.   The area limiting means limits a rectangular area that is separated from the detection position information of the target object in the previous frame image by a value of a size parameter Δx and a size parameter Δy as the detection area. , 17 and 18 An object detection processing circuit.   19. The area limiting unit limits a circular area separated by a value of a size parameter Δr around the detection position information of the target object in the previous frame image as the detection area. An object detection processing circuit according to claim 1.   17. The region limiting means limits a donut region separated from a size parameter Δr1 to a size parameter Δr0 (> Δr1) with the detection position information of the target object in the previous frame image as a center, as the detection region. The object detection processing circuit according to any one of -18. An image data memory for storing image data in the detection area limited by the area limiting means;
An arithmetic memory used as a work memory for arithmetic processing by the object detection processing means;
The object detection processing circuit according to claim 8, further comprising a detection result holding memory that holds detection position information of the target object of the previous frame image.   The image area determination circuit of the area limiting means detects the input image data from the detection position information of the target object given from the detection result holding memory and the value of the size parameter given from the area size setting means. The input image data is held in the image data memory when it is determined whether the input image data is included in the detection region. The object detection processing circuit described.   The object detection processing circuit according to claim 22 or 23, wherein the object detection processing means detects detection information of the target object using image data stored in the image data memory.   The object detection processing unit detects a difference between two input image data groups arranged in time series, or processes the input image data group to obtain fixed pattern data included in the input image data group. 25. The object detection processing circuit according to claim 1, wherein the object detection processing circuit extracts the difference between the input image data group and the extracted data, and detects moving object data included in the input image data as detection information of the target object. The object detection processing circuit according to any one of claims 1 to 25;
A camera module that supplies image data including image information of the target object obtained by imaging to the object detection processing circuit;
An image processing system comprising: a central processing circuit that controls object detection processing by the object detection processing circuit. The object detection processing circuit according to any one of claims 1 to 25;
A camera module that supplies image data including image information of the target object obtained by imaging to the object detection processing circuit;
A central processing circuit for controlling object detection processing by the object detection processing circuit;
Image output means for outputting the image data on an output screen;
An electronic information device comprising device operation execution means for performing device operation using detection information of at least one of a movement amount, a movement direction, and a movement pattern of the target object obtained by the object detection processing circuit.

Images