TW201531961A - Image tracking system and image tracking method - Google Patents

Abstract

An image tracking system is used to track a predetermined object and continuously capture dynamic images containing a predetermined object, comprising an image capture unit, a storage unit, a control unit and a rotation device. The image capture unit is used for continuously capturing dynamic images; the storage unit temporarily stores the dynamic images; the control unit analyzes the dynamic images; the rotation device in communication link with the control unit. The image capture unit, the storage unit, the control unit are carried on the rotation device, wherein the rotation device receives a drive signal to change the direction of the image capture unit for capturing dynamic images. When the predetermined object is located in the dynamic images, and not in a preset region, the control unit calculates the current direction of the image capture unit for capturing dynamic images, as well as the angle difference of the predetermined object located in the preset region, and accordingly outputs a drive signal to drive the rotation device on the basis of the angle difference.

Description

Image tracking system and image tracking method

The invention relates to an image tracking system and an image tracking method, in particular to an image tracking system for automatically tracking a preset object and an image tracking method performed.

With the rapid development of electronic technology, electronic devices such as smart phones have become an indispensable part of people's daily lives. Smart phones have camera functions and photography functions.

However, the camera or camera device equipped with a smart phone is inconvenient for the user to take a self-portrait because the range of the photograph needs to be limited by the length of the person's hand and is limited by the length of the person's arm. Therefore, the person being photographed sometimes cannot fully enter the mirror. Moreover, while the consumer is taking a self-portrait, while pressing the shutter, the smart phone is also prone to sway, resulting in out of focus.

In view of the above problems, the present invention provides an image tracking system and an image tracking method performed to solve the problem faced by the self-photographing without requiring the user to hold the camera device.

The invention provides an image tracking system for tracking a preset object and continuously capturing a dynamic image including the preset object, including an image capturing unit, a storage unit, a control unit and a rotating device.

The image capturing unit is configured to continuously capture the dynamic image; the storage unit is electrically connected to the image capturing unit to temporarily store the dynamic image; the control unit is electrically connected to the storage unit, and the control unit analyzes the dynamic image to determine the Whether the preset object enters a preset area in the sampling screen of the image capturing unit; the rotating device is communicatively coupled with the control unit, and the image capturing unit, the storage unit, and the control unit are carried in the rotation Above the device; wherein the rotating device receives a driving signal to change the direction in which the image capturing unit captures the moving image.

When the preset object is located in the motion image and is not in the preset area, the control unit calculates an image capturing unit to capture a current direction of the motion image, and outputs an angle difference between the preset object in the preset area, and outputs The driving signal drives the rotating device to rotate according to the angle difference.

In a specific embodiment, when the preset object enters the preset area, the control unit continuously analyzes the motion image, and determines whether the preset object is still located in the preset area within a predetermined time; The setting unit drives the image capturing unit to perform a photographing operation when the object is continuously located in the preset area for the predetermined time.

In a specific embodiment, the control unit calculates a center point of the preset object as a reference point, and determines whether the preset object enters the pre-condition based on whether the reference point is located in the preset area. Set in the area.

In a specific embodiment, when there are a plurality of preset objects in the motion image, the control unit calculates a common center point of the plurality of preset objects as a reference point.

In a specific embodiment, when there are two preset objects in the motion image, the control unit calculates a common center point of the two preset objects as a reference point, and the control unit analyzes two presets. Whether the distance between objects is less than a threshold distance; if the control order The element determines the distance between the two preset objects, not less than the threshold distance, and the control unit sends a prompt message to prompt to shorten the distance between the two preset objects.

The present invention also provides an image tracking method, which is suitable for a camera device and a rotating device. The camera device has an image capturing unit, a storage unit and a control unit, and the image capturing unit, the storage unit, and the control unit The unit is carried on the rotating device, and the rotating device receives a driving signal to change the direction of the image capturing unit to capture the moving image; the method includes the following steps: using the image capturing unit to continuously capture dynamics Image, and temporarily storing the motion image in the storage unit; analyzing the motion image by the control unit to determine whether the preset object enters a preset area in the sampling screen of the image capturing unit; and when the preset The object is located in the motion image and is not in the preset area. The control unit calculates the current direction of the motion image capturing unit and the angle difference between the preset object in the preset area, and outputs the driving signal to The rotating device is driven to rotate according to the difference in angle.

In a specific embodiment, when the preset object enters the preset area, it is determined whether the preset object is still located in the preset area within a predetermined time; if the preset object is within the foregoing predetermined time, The image capturing unit is driven to perform a photographing operation continuously in the preset area.

In an embodiment, the image tracking method further includes: calculating a center point of the preset object as a reference point, and determining whether the preset object is based on whether the reference point is located in the preset area Enter the preset area.

In an embodiment, the image tracking method further includes: when the plurality of preset objects are included in the motion image, calculating a common center point of the plurality of preset objects as a reference point.

In a specific embodiment, the image tracking method further includes: when the motion image has two preset objects, calculating a common center point of the two preset objects as a reference point, and analyzing the two presets Whether the distance between the objects is less than a threshold distance; if the distance between the two preset objects is not less than the threshold distance, the element issues a prompt message to prompt to shorten the distance between the two preset objects.

The image capturing system for automatically tracking objects provided by the present invention can affect the photographing range when the user wants to perform self-photographing without being affected by the length of the arm. And the mobile application can track the face or any other object by itself, and calculate and analyze the focus, which can effectively achieve the self-timer effect.

100‧‧‧Image Tracking System

100a‧‧‧Photographing device

110‧‧‧Image capture unit

120‧‧‧ storage unit

130‧‧‧Control unit

140‧‧‧Rotating device

1 is a system block diagram of an image tracking system according to an embodiment of the present invention.

Fig. 2 is a flow chart showing the method of the image tracking method in the first embodiment of the present invention.

Figure 3 is a flow chart of a method in accordance with a first embodiment of the present invention.

Fig. 4 is a flow chart showing the method of the image tracking method in the second embodiment of the present invention.

Fig. 5 is a flow chart showing the method of the image tracking method in the third embodiment of the present invention.

Figure 6 is a flow chart showing the method of the image tracking method in the fourth embodiment of the present invention.

Figure 7 is a flow chart for automatically searching for a preset object in the present invention.

Specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The same symbols represent components or devices having the same or similar functions.

As shown in FIG. 1 , the image tracking system 100 of the first embodiment of the present invention includes an image capturing unit 110 , a storage unit 120 , a control unit 130 , and a rotating device 140 . The image capturing unit 110, the storage unit 120, and the control unit 130 are integrated into a camera device, such as a smart phone or tablet computer with a photographic function. The image capturing unit 110, the storage unit 120, and the control unit 130 are carried on the rotating device 140 along with the smart phone 100a. The rotating device 140 has a motor. The motor can be a stepping motor or other motor type for driving the platform of the portable smart phone 100a to change the image capturing direction by changing the image capturing direction according to one or more axial rotations. The storage unit 120 stores a mobile application for the control unit 130 to load and execute, and performs tracking of the preset object, analyzing the image, and calculating the reference point of the image, so that the image tracking system 100 executes an image tracking method. .

Referring to FIG. 1 and FIG. 2 , the image tracking system 100 is configured to perform an image tracking method for tracking a preset object so that the preset object can continuously appear in the dynamic image string captured by the image tracking system 100 . In the flow, the video recording operation or the photographing operation on the preset object is continuously performed.

The preset object may be a human face, but does not exclude other objects such as a human body, a car, or other recordable objects.

A human face or a specific object is analyzed in the image and regarded as a preset object according to the present invention, which is generally known to those skilled in the art and can be found in existing known technical documents (for example, Taiwan invention patent) I469063), so the technical details of the face or specific object are not described in the image below.

As shown in FIG. 2, the image tracking system 100 of the first embodiment performs the image tracking method as follows: First, the image tracking system 100 first establishes a communication link between the control unit 130 and the rotating device 140, as shown in step S110. . Communication links can be reached by wired communication or wireless communication. For example, taking the smart phone 100a as an example, the smart phone 100a and the rotating device 140 respectively set a Bluetooth module, and through a pairing procedure, establish a communication link between the control unit 130 and the rotating device 140 by using a Bluetooth communication protocol; The foregoing connection does not preclude the establishment of a communication link by other wireless communication protocols, USB wired connections, and IEEE 1394 wired links.

Then, the control unit 130 starts the preset object tracking mode, for example, the face tracking mode, as shown in step S110a, to activate the image capturing unit 110, so that the image capturing unit 110 continuously captures a moving image, but temporarily does not execute. Take a photo job.

The main difference between the motion picture and the camera operation is the difference in sampling resolution. The motion picture is performed by performing multiple still image captures per second and sorting according to time order to form a motion picture. The camera job only captures a single still image. The photographing operation is usually performed at a high resolution, while the moving image is performed at a relatively low resolution, and the video recording is to continuously record the stream of the moving image in a file. In addition, since the image capturing unit 110 may not be in focus, the photographing operation may not be performed temporarily, and the out-of-focus photograph may be avoided.

The storage unit 120 is electrically connected to the image capturing unit 110. The foregoing moving image is transmitted to the storage unit 120, and the moving image is temporarily stored. However, the streaming of the moving image is not continuously recorded in the file, and becomes a video recording operation.

The control unit 130 is electrically connected to the storage unit 120, and can receive the dynamic image for analysis, as shown in step S120.

As shown in step S130, the control unit 130 first analyzes whether the preset object is in the motion image.

As shown in step S140, next, if the preset object is located in the motion image, the control unit 130 further calculates a center point of the preset object as a reference point.

As shown in step S150, the control unit 130 analyzes whether the preset object enters a preset area in the sampling screen of the image capturing unit 110. The preset area is a custom area where you can change the position or shape arbitrarily. In a specific embodiment, determining whether the preset object enters a preset area in the sampling screen of the image capturing unit 110 determines whether the aforementioned reference point is located in the preset area.

As shown in step S160, if the preset object enters the preset area in the sampling screen of the image capturing unit 110, the control unit 130 completes the tracking operation to wait for the next triggering instruction.

As shown in step S170, if the preset object is located in the motion image but is not in the preset area in the sampling screen of the image capturing unit 110, the control unit 130 calculates the current direction of the motion image captured by the image capturing unit 110, and A driving signal is output by causing the preset object to be in a difference in angle in the preset area. At this time, the rotating device 140 receives the driving signal and rotates according to the difference of the angle, so as to change the direction in which the image capturing unit 110 captures the moving image, so that the preset object enters the preset area in the sampling screen of the image capturing unit 110.

In step S130, if the control unit 130 analyzes the motion image and determines that the preset object is not in the motion image, the control unit 130 determines whether the rotation device 140 is rotating, as in step S180.

In step S180, if the turning device 140 has stopped rotating, it returns to step S120. If the rotating device 140 is rotating, the control unit 130 continuously outputs the driving signal, and controls The rotation device 140 continues the forward rotation in the original rotation direction to continuously change the direction in which the image capturing unit 110 captures the motion image, as shown in step S190.

Referring to FIG. 3, a specific application manner of the first embodiment is an automatic tracking video, which mainly changes the step of opening the preset object tracking mode in step S110a, such as the step of the face tracking mode, to face tracking. The mode, and the video function step is started, as in step S110c. The preset object tracking mode may be tracking of a specific object or tracking of a face.

As shown in FIG. 4, which is the image tracking method of the second embodiment, the first step of the second embodiment is substantially the same as that of the first embodiment, with the difference being after step S150.

In step S150, if the preset object enters the preset area in the sampling screen of the image capturing unit 110, the control unit 130 completes the tracking operation and triggers the countdown mechanism to wait for a predetermined time, as shown in step S200. When the countdown mechanism is triggered, the control unit 130 can simultaneously output a display signal to drive a display unit to display the countdown time for the user to know to avoid moving the preset object (such as a human face) during the countdown time. Complete the photo job to ensure the tracking results.

As shown in step S210, the control unit 130 continuously analyzes the motion image to determine whether the preset object is still in the preset area within the predetermined time period.

As shown in step S220, if the preset object continues to be located in the preset area within the predetermined time period, the control unit 130 drives the image capturing unit 110 to perform a photographing operation to capture a still image with a relatively high resolution.

As shown in step S230, after the photographing operation is completed, the control unit 130 outputs a control signal, and controls the rotating device 140 to rotate a predetermined angle toward a rotating direction, and then returns to the step. S130.

In step S210, if the preset object leaves the preset area within the predetermined time period, the countdown mechanism is interrupted and reset, as in step S240, and the process returns to step S170 to change the image capturing unit 110 again. The direction of the motion image is taken such that the preset object enters a preset area in the sampling screen of the image capturing unit 110.

The image tracking method of the first embodiment and the second embodiment is used for tracking a single preset object. However, the image tracking method of the present invention can track a plurality of preset objects after a small adjustment.

As shown in FIG. 5, the image tracking method according to the third embodiment of the present invention is used for tracking a plurality of preset objects, and the steps are as follows.

First, the image tracking system 100 first establishes a communication link between the control unit 130 and the rotating device 140, as shown in step S110.

Then, the control unit 130 starts a multi-preset object tracking mode, such as the multi-person tracking mode, as shown in step S110b, to activate the image capturing unit 110, so that the image capturing unit 110 continuously captures a moving image.

The control unit 130 receives the motion image for analysis, as shown in step S120.

As shown in step S130, the control unit 130 first analyzes whether the preset object is in the motion image.

As shown in step S140a, next, if a plurality of preset objects are located in the motion image, the control unit 130 further calculates a common center point of the plurality of preset objects as a reference point.

As shown in step S150, the control unit 130 determines whether the aforementioned reference point is located. In the preset area.

In step S150, if the reference point is located in the preset area, the control unit 130 completes the tracking operation and triggers a countdown mechanism to wait for a predetermined time, as shown in step S200.

As shown in step S210, the control unit 130 continuously analyzes the motion image to determine whether the reference point is still in the preset area within the predetermined time period.

As shown in step S220, if the reference point continues to be located in the preset area within the predetermined time period, the control unit 130 drives the image capturing unit 110 to perform a photographing operation to capture a still image having a relatively high resolution.

As shown in step S230, after the photographing operation is completed, the control unit 130 outputs a control signal, and controls the rotating device 140 to rotate a predetermined angle toward a rotating direction, and then returns to step S130.

In step S210, if the reference point leaves the preset area within the predetermined time period, the countdown mechanism is interrupted and reset, as in step S240, and the process returns to step S170 to change the image capturing unit 110 again. The direction of the motion image is such that the reference point enters a preset area in the sampling picture of the image capturing unit 110.

As shown in FIG. 6, the image tracking method according to the fourth embodiment of the present invention is used for tracking two preset objects, such as two human faces, and performing tracking of two preset objects, and performing a photographing operation mode. As shown in step S110d. The main difference steps between the fourth embodiment and the third embodiment are as follows.

In step S130, if a preset object (human face) is detected, the control unit 130 further analyzes whether there are two preset objects (human faces), as shown in step S132. If there are no two In the face, the rotation of the rotating device 140 is stopped, as shown in step S134, and the process returns to step S120.

If two preset objects are tracked in step S132, step S140b is further performed to find the center points of the two preset objects as the reference points.

Next, the control unit 130 also analyzes whether the reference point enters the preset area, as shown in step S150.

As shown in step S152, if the reference point is located in the preset area, the control unit 130 further analyzes whether the distance between the two preset objects is less than a threshold distance.

If the control unit 130 determines that the distance between the two preset objects is not less than the threshold distance, the control unit 130 issues a prompt message, as shown in step S224, to prompt the distance between the two preset objects to be shortened. Then it returns to step S140b.

If the control unit 130 determines that the distance between the two preset objects is less than the threshold distance, the control unit 130 performs a S200 trigger countdown mechanism to wait for a predetermined time, as shown in step S200.

As shown in step S210, the control unit 130 continuously analyzes the motion image to determine whether the reference point is still in the preset area within the predetermined time period.

As shown in step S212, the control unit 130 continuously analyzes the motion image to determine whether the distance between the two preset objects is less than a threshold distance within the predetermined time period.

As shown in step S220, if the distance between the two preset objects is less than the threshold distance for the predetermined time period, the control unit 130 drives the image capturing unit 110 to perform the photographing operation, and the resolution is relatively high. Still image.

If the distance between the two preset objects is less than the threshold distance within the predetermined time period, that is, the distance is too far, the control unit 130 stops the countdown mechanism. As shown in step S222; the control unit 130 then issues a prompt message, as shown in step S224, to remind the two preset objects that they must be close, thereby ensuring that both preset objects are captured into the desired image. The control unit 130 then returns to step S140b.

In this way, according to the image tracking method of the fourth embodiment, it is possible to simultaneously take a picture of two preset objects while ensuring that the distance between the two preset objects is not too large.

Referring to FIG. 7, a flow for automatically searching for a preset object may be arranged after step S110a, S110b, S110c or S110d, and may also be used to replace step S180 and step S190. Alternatively, another independent determination loop is added to the control unit 130 to perform the process of automatically searching for the preset object after the predetermined time (for example, 8 seconds) in the moving image.

The trigger condition of this process is mainly that no preset object is detected in the motion image, as shown in step S310.

Next, the control unit 130 drives the rotating device 140 to rotate to a upper limit in a first rotational direction in a first axial direction, as shown in step S320.

Then, the control unit 130 drives the rotating device 140 to rotate 360 degrees clockwise or counterclockwise in the second axial direction, as shown in step S330.

The control unit 130 drives the rotating device 140 to rotate a predetermined angle in a second rotational direction opposite to the first rotational direction in the first axial direction, as by step S340.

The control unit 130 determines whether the rotating device 140 is rotated to the lower limit of the second rotational direction, as shown in step S350; if not, returns to step S330, and rotates 360 degrees clockwise or counterclockwise in the second axial direction.

If the rotation device 140 is rotated to the lower limit of the second rotation direction, the program of rotating 360 degrees clockwise or counterclockwise in the second axial direction is performed first, as shown in step S360; The predetermined angle is rotated in an axial direction toward the first rotational direction, as by step S370.

Finally, the control unit 130 determines whether the rotating device 140 has reached the upper limit of the first rotational direction of the first axial direction, as shown in step S380. If the upper limit has not been entered, the process returns to step S360. If it has entered the upper limit, the regression proceeds to step S330.

Before the at least one preset object is detected, the rotating device 140 moves between the upper limit and the lower limit of the rotating track until the preset object is detected.

The above is only a preferred embodiment of the present invention. The scope of the invention is not limited to the above embodiments. Equivalent modifications or variations made by persons skilled in the art in light of the spirit of the present invention are intended to be included in the scope of the following claims.

Claims (10)

An image tracking system for tracking a predetermined object and continuously capturing a moving image including the preset object, comprising: an image capturing unit for continuously capturing the moving image; a storage unit, electrical Connecting the image capturing unit to temporarily store the moving image; a control unit electrically connecting the storage unit, the control unit analyzing the moving image to determine whether the preset object enters the sampling screen of the image capturing unit a predetermined area; and a rotating device, communicatively coupled to the control unit, and the image capturing unit, the storage unit, and the control unit are carried on the rotating device; wherein the rotating device receives a driving signal The image capture unit captures the direction of the motion image; wherein, when the preset object is located in the motion image and is not in the preset area, the control unit calculates the current direction of the motion image captured by the image capturing unit, and The difference in angle of the preset object in the preset area is output, and the driving signal is output to drive the rotating device to rotate according to the angle difference. The image tracking system of claim 1, wherein the control unit continuously analyzes the motion image when the preset object enters the preset area, and determines whether the preset object is still preset in a predetermined time. In the area, if the preset object is continuously located in the preset area within the predetermined time period, the control unit drives the image capturing unit to perform a photographing operation. The image tracking system of claim 1, wherein the control unit calculates a center point of the preset object as a reference point, and whether the reference point is located in the preset area. Condition, determining whether the preset object enters the preset area. The image tracking system of claim 3, wherein when the motion image has a plurality of preset objects, the control unit calculates a common center point of the plurality of preset objects as a reference point. The image tracking system of claim 3, wherein when the motion image has two preset objects, the control unit calculates a common center point of the two preset objects as a reference point, and the control unit And analyzing whether the distance between the two preset objects is less than a threshold distance; if the control unit determines the distance between the two preset objects, not less than the threshold distance, the control unit issues a prompt message to prompt The distance between the two preset objects is shortened. An image tracking method is applicable to a camera device and a rotating device. The camera device has an image capturing unit, a storage unit and a control unit, and the image capturing unit, the storage unit, and the control unit are loaded. On the rotating device, the rotating device receives a driving signal to change the direction of the image capturing unit to capture the moving image; the method includes the following steps: using the image capturing unit to continuously capture the moving image, and The storage unit temporarily stores the motion image; the motion unit analyzes the motion image to determine whether the preset object enters a preset area in the sampling screen of the image capturing unit; and when the preset object is located in the dynamic In the image, and not in the preset area, the control unit calculates the current direction of the motion image by the image capturing unit, and places the preset object in the preset The angle difference in the area is set, and the driving signal is output to drive the rotating device to rotate according to the angle difference. The image tracking method of claim 6, wherein, when the preset object enters the preset area, determining whether the preset object is still located in the preset area within a predetermined time; if the preset object is During the foregoing predetermined time period, it is continuously located in the preset area, and the image capturing unit is driven to perform a photographing operation. The image tracking method of claim 6, further comprising: calculating a center point of the preset object as a reference point, and determining the preset object based on whether the reference point is located in the preset area Whether to enter the preset area. The image tracking method of claim 8, further comprising: when the plurality of preset objects are included in the motion image, calculating a common center point of the plurality of preset objects as a reference point. The image tracking method of claim 8, further comprising: when there are two preset objects in the motion image, calculating a common center point of the two preset objects as a reference point, and analyzing two presets The distance between the objects is less than a threshold distance; if the distance between the two preset objects is not less than the threshold distance, the element issues a prompt message to prompt to shorten the distance between the two preset objects.