TWI769471B - Automatic panning shot system and automatic panning shot method - Google Patents

Abstract

An automatic panning shot system for performing an automatic panning shot method. According to the method, a horizontal axis and a longitudinal axis perpendicular to each other are defined in the image capturing data captured by a handheld device. When a characteristic object is identified in the image capturing data, a sampling frame is defined to surround the characteristic object, and a reference point is defined within the sampling frame. And then a horizontal distance and a longitudinal distance from the reference point to a target point is calculated. When the horizontal distance is larger than a horizontal threshold, a panning command is issued to change the shot direction to move the target point for at least a horizontal unit along the horizontal axis. And when the longitudinal distance is larger than a longitudinal threshold, a panning command is issued to change the shot direction to move the target point for at least a longitudinal unit along the longitudinal axis. In case that plural characteristic objects are identified, the handheld device selects a proper characteristic object timely to perform the panning shot.

Description

Automatic video recording system and automatic video recording method

The present invention relates to video recording and tracking, in particular to an automatic video recording and tracking system and an automatic video recording and tracking method.

When a user uses a smartphone to take a selfie, the traditional way is to use a tripod or other form of fixing frame to fix the smartphone, just like a camera, and start time-lapse photography or video recording. At this time, the smartphone is completely stationary, and the user can only move in a small range to ensure that he is photographed. Another tool is the selfie stick, which replaces the tripod with a hand-held stick and provides a mechanism (wired or wireless) to actuate the shutter. The user takes a selfie by holding the stick, but the image taking distance is limited by the length of the stick, and can only take a close-up selfie.

Although several tracking techniques have been developed, the camera can be driven by the base to follow a specific target. However, the excessive tracking of such a base actually causes the smartphone to continuously oscillate to follow a specific target, which will cause the image data (especially dynamic video streaming) to shake significantly, so there is still a need to improve the tracking method.

In view of the above problems, the present invention provides an automatic video recording system and an automatic video recording and tracking method, so as to solve the problem of image data shaking caused by excessive tracking of a specific target.

The present invention provides an automatic video recording and tracking system, which includes a portable electronic device and a tracking device.

The portable electronic device includes: a processor for executing a follow-up mode; a camera lens, electrically connected to the processor, for capturing an image data along a shooting direction and transmitting the image data to the processor; and processing The device defines a horizontal coordinate axis and a vertical coordinate axis that are perpendicular to each other in the image data, the length of the image data along the horizontal coordinate axis is defined as a plurality of horizontal units, and the height of the image data along the horizontal coordinate axis is defined as a plurality of vertical units; a memory unit, electrically connected to the processor for storing image data; a touch display panel electrically connected to the processor for displaying image data, receiving a touch operation and feeding back the touch operation to the processor; and a The first communication interface is electrically connected to the processor.

The tracking device includes: a controller; a second communication interface, electrically connected to the controller, and establishing a communication connection with the first communication interface, so as to receive a steering control signal and transmit the steering control signal to the controller; and a steering The module is electrically connected to the controller, and the steering module carries the portable electronic device; wherein the controller drives the steering module to turn according to the steering control signal to change the shooting direction of the photographic lens.

Among them, in the follow-up mode, the processor identifies a feature object in the image data, sets a sampling frame around the feature object, makes the sampling frame surround the feature object, and moves the sampling frame with the movement of the feature object; A reference point is set in the frame, and when the processor identifies a plurality of characteristic objects in the image data, the processor sets a sampling frame for each characteristic object, and executes the tracking mode with the sampling frame with the largest area.

The processor calculates a horizontal distance and a vertical distance between the reference point and a target coordinate, and when the horizontal distance is greater than a horizontal threshold, the processor sends a steering control signal to drive the steering module to change the shooting direction, so that the reference point is horizontal to the target coordinate moving at least one horizontal unit; and when the vertical distance is greater than a vertical threshold, the processor sends a steering control signal to control the steering module to move the reference point in the image data vertically by at least one vertical unit toward the target coordinate.

The processor continuously determines whether the feature object is maintained in the image data; if the feature object is not in the image data, and the feature object is covered by another feature object, the processor selects another sampling frame corresponding to the other feature object to execute the tracking mode , and reset the reference point; if the feature object is not in the image data, and the feature object is not obscured by another feature object, the processor selects another sampling frame with the largest area in the image data to execute the tracking mode, and reset the reference point.

The present invention also provides an automatic video recording and tracking method, which is suitable for a portable electronic device and a tracking device that establish a communication connection with each other. To the tracking device, the tracking device carries a portable electronic device and receives a steering control signal to change the shooting direction; the method includes the following steps: triggering the portable electronic device to execute a tracking mode to detect a feature in the image data The object is in follow-up mode; a horizontal coordinate axis and a vertical coordinate axis that are perpendicular to each other are defined in the image data; wherein, the length of the image data along the horizontal coordinate axis is defined as a plurality of horizontal units, and the height of the image data along the horizontal coordinate axis is defined as a plurality of Vertical unit; when identifying characteristic objects in the image data, a sampling frame is set around the characteristic object, so that the sampling frame surrounds the characteristic object, and a reference point is set in the sampling frame, and when a plurality of characteristic objects are identified, respectively Set a sampling frame for each feature object, and use the sampling frame with the largest area in the image data to follow the shooting mode; calculate a horizontal distance and a vertical distance between the reference point and a target coordinate; wherein, when the horizontal distance is greater than a horizontal threshold, send out A steering control signal is used to change the shooting direction, so that the reference point is moved laterally toward the target coordinate by at least one horizontal unit; and when the vertical distance is greater than a vertical threshold, a steering control signal is sent to change the shooting direction, so that the reference point in the image data is moved to the vertical direction of the target coordinate moving at least one vertical unit; and continuously judging whether the feature object is maintained in the image data; if the feature object is not in the image data, and the feature object is covered by another feature object, select another sampling frame corresponding to the other feature object to perform follow-up shooting mode, and reset the reference point; if the feature object is not in the image data, and the feature object is not obscured by another feature object, select another sampling frame with the largest area in the image data to execute the follow-up mode, and reset the reference point .

In the present invention, the adjustment of the shooting direction is performed only after the displacement of the reference point exceeds the threshold value. Therefore, in the technical means provided by the present invention, the follow-up action of the photographic lens will not follow the human face excessively, resulting in excessive shaking of the captured image data, and the shooting direction will be gradually adjusted only when the moving distance is large. It can make the image data relatively stable, and the way to follow the shooting will be relatively smooth. At the same time, by updating the target of the above-mentioned tracking mode, it can be avoided that the tracking action of the photographic lens follows a single target excessively, and the range of the captured image data is greatly shaken.

As shown in FIG. 1 and FIG. 2 , an automatic video recording and tracking system disclosed in an embodiment of the present invention is used to execute an automatic video recording and tracking method. The automatic video recording and tracking system includes a portable electronic device 100 , a tracking device 200 and a remote control 300 . The portable electronic device 100 is carried on the tracking device 200 for shooting image data M along a shooting direction. The portable electronic device 100 controls the rotation of the tracking device 200 to change the shooting direction of the portable electronic device 100 , to follow the feature object A.

The portable electronic device 100 can be an electronic device such as a smart phone, a tablet computer, etc., which has a video recording function and can establish a communication link with the tracking device 200 .

As shown in FIG. 1 and FIG. 2 , the portable electronic device 100 includes a processor 110 , a camera lens 120 , a memory unit 130 , a touch display panel 140 and a first communication interface 150 .

As shown in FIG. 1 and FIG. 2 , the photographing lens 120 , the memory unit 130 and the touch display panel 140 are electrically connected to the processor 110 . The photographing lens 120 is used to capture the image data M and transmit the image data M to the processor 110 and to the memory unit 130 to store the image data M.

As shown in FIG. 2 , in addition to storing the image data M, the memory unit 130 also stores the operating system and the tracking application for the processor 110 to load and execute the tracking mode.

As shown in FIG. 1 and FIG. 2 , the touch display panel 140 is electrically connected to the processor 110 to display the image data M, and receives the touch operation and feeds back the touch operation to the processor 110 .

As shown in FIG. 1 and FIG. 2 , the first communication interface 150 is electrically connected to the processor 110 for establishing a communication connection. The first communication interface 150 can be a wired communication interface, such as a USB interface, or a wireless communication interface, such as Bluetooth, an RF communication interface, and a Wi-Fi interface (supporting Wi-Fi Direct).

As shown in FIG. 1 and FIG. 2 , the tracking device 200 includes a controller 210 , a second communication interface 220 , a steering module 230 and an optical code receiving unit 240 .

As shown in FIG. 1 and FIG. 2 , the second communication interface 220 is electrically connected to the controller 210 and establishes a communication connection with the first communication interface 150 , so that the controller 210 of the tracking device 200 and the portable electronic device 100 are established Communication link.

As shown in FIG. 1 and FIG. 2 , the steering module 230 is electrically connected to the controller 210 , and the steering module 230 is used to carry the portable electronic device 100 . The controller 210 drives the steering module 230 to turn according to the steering control signal, so that the steering module 230 rotates or tilts the portable electronic device 100 laterally and vertically to change the shooting direction.

The steering module 230 generally includes one or more motors, necessary gear boxes, and a clamp 232 . The clamp 232 is used to clamp the portable electronic device 100 to carry the portable electronic device 100 on the steering module 230 . A motor and gearbox combination is used to rotate the clamp 232 in one or more axial directions. The combination of the motor, the gear box and the clamp 232 is common knowledge in the technical field to which the present invention pertains, and the details of the technical means will not be repeated below.

As shown in FIG. 1 and FIG. 2 , the optical code receiving unit 240 is electrically connected to the controller 210 for receiving the optical code signal with the tracking activation code, and transmits the tracking activation code to the controller 210, so that the controller 210 triggers the processor 110 to start the tracking mode when receiving the tracking start code.

As shown in FIG. 1 and FIG. 3 , the remote controller 300 includes an encoding circuit 310 , a key group 320 and an optical encoding transmitting unit 330 .

The encoding circuit 310 stores at least one tracking activation code, and the tracking activation code corresponds to a dedicated tracking device 200 . The optical encoding transmitting unit 330 is electrically connected to the encoding circuit 310 . When the key group 320 is pressed to form a specified key combination (the keys are pressed simultaneously, or a single key is pressed rapidly for a certain number of times), the key group 320 triggers the encoding circuit 310 to drive the optical encoding transmitting unit 330 to send out the optical encoding with the tracking start code The signal is received by the optical encoding receiving unit 240 of the tracking device 200 .

As shown in FIG. 2 and FIG. 3 , when the optical encoding receiving unit 240 receives the tracking activation code, the controller 210 determines whether the tracking activation code is exclusive. When the tracking activation code is exclusive, the controller 210 triggers the processor 110 to start the tracking mode. If the tracking activation code is not exclusive, or the optical coded signal does not carry the tracking activation code, the controller 210 does not trigger the processor 110 to execute the tracking mode, or further triggers the processor 110 to stop the tracking mode.

As shown in FIG. 4 , it is a circuit block diagram of the light tracker 400 , the remote controller 300 , and the tracking device 200 in another embodiment of the present invention. In this embodiment, the function of transmitting the optically encoded signal is separated from the remote controller 300 to form a separate optical tracker 400 . Similarly, the encoding circuit 310 is also divided into a first encoding circuit 311 and a second encoding circuit 312 . The tracking activation code is not carried by the optical coded signal, and the tracking activation code is carried by the wireless signal instead.

As shown in FIG. 4 , the optical tracker 400 has an optical encoding transmitting unit 330 , a first encoding circuit 311 and at least one first button 321 . The optical encoding transmitting unit 330 is used for transmitting an optical positioning signal. The first encoding circuit 311 is used for generating a designated identification code, and according to the designated identification code, the optical encoding transmitting unit 330 is driven to emit an optical positioning signal, and the optical positioning signal carries the designated identification code. At least one first button 321 is electrically connected to the first encoding circuit 311 for being pressed to trigger the first encoding circuit 311 to drive the optical encoding transmitting unit 330 to emit an optical positioning signal. The optical positioning signal can be received by the optical code receiving unit 240 for analysis by the controller 210 of the tracking device 200, and the steering module 230 is driven to turn, so that the shooting direction tends to the light tracker 400, so as to facilitate the subsequent tracking mode execution.

As shown in FIG. 4 , in this embodiment, the tracking device 200 and the remote controller 300 are also slightly adjusted. In this embodiment, the camera-following device 200 further includes a third communication interface 250 electrically connected to the controller 210 . The remote controller 300 further includes a fourth communication interface 340 electrically connected to the second encoding circuit 312 . The third communication interface 250 and the fourth communication interface 340 are used for establishing a communication link. The third communication interface 250 and the fourth communication interface 340 are wireless communication interfaces, such as Bluetooth, RF communication interface, and Wi-Fi interface (supporting Wi-Fi Direct). Specifically, the communication link between the third communication interface 250 and the fourth communication interface 340 and the communication link between the first communication interface 150 and the second communication interface 220 use different communication protocols.

As shown in FIG. 4 , different keys of the key group 320 are used to trigger the second encoding circuit 312 to generate a follow-up start code, or other function command codes, such as the start and end of the shooting function, the shutter for capturing a single photo and so on, to be sent through the fourth communication interface 340 . The tracking activation code or the function command code is received by the third communication interface 250 of the tracking device 200 . Then, the tracking activation code, or other function command codes are then transmitted to the portable electronic device 100 through the first communication interface 150 and the second communication interface 220, so as to operate the relevant information of the portable electronic device 100 through the remote controller 300. Function.

As shown in FIG. 5 , after the tracking mode is started, the processor 110 defines in the image data M a horizontal coordinate axis X and a vertical coordinate axis Y that are perpendicular to each other. The length of the image data M along the horizontal coordinate axis X is defined as a plurality of horizontal units SX, and the height of the image data M along the horizontal coordinate axis X is defined as a plurality of vertical units SY.

After the portable electronic device 100 executes the tracking mode, the processor 110 identifies the characteristic object A in the image data M, such as a human face. If the characteristic object A is not identified in the image data M, the processor 110 sends a steering control signal to control the tracking device 200 to continuously change the shooting direction until the characteristic object A is identified in the image data M.

As shown in FIG. 5 , after identifying the feature object A, the processor 110 sets a sampling frame F around the feature object A, the sampling frame F surrounds the feature object A, and moves the sampling frame F with the movement of the feature object A, so that the feature Object A remains in sampling frame F. The processor 110 can adjust the imaging magnification of the photographic lens 120 in real time, so that the ratio of the sampling frame F in the captured image data M remains unchanged. The processor 110 also sets the reference point R in the sampling frame F.

As shown in FIG. 5 , if the processor 110 recognizes multiple feature objects A, A' at the same time, the processor 110 sets sampling frames F, F' for the multiple feature objects A, A' respectively, and uses the image data M in the sampling frame F, F'. The sampling frame F with the largest area executes the tracking mode. Or, the user can select the characteristic object A to be executed in the follow-up mode through the touch display panel 140 .

As shown in FIG. 5 , the processor 110 calculates the horizontal distance Dis X and the vertical distance Dis Y between the reference point R and the target coordinate T. The aforementioned target coordinate T may be stored in the memory unit 130 by default and loaded by the processor 110 . For example, the predetermined target coordinate T may be located at the center of the image data M. The target coordinate T can also be directly clicked by the user on the touch display panel 140 . In addition, the user can also manually generate a sampling frame F on the touch display panel 140 to change the feature object A to be followed, such as another human face.

The processor 110 loads the horizontal threshold and the vertical threshold from the memory unit 130 . The horizontal threshold is generally less than one horizontal unit SX, and the vertical threshold is less than one vertical unit SY.

As shown in FIG. 6 , when the lateral distance Dis X is greater than the lateral threshold, the processor 110 sends a steering control signal to control the steering module 230 through the controller 210 to change the shooting direction, so that the shooting direction rotates in the horizontal direction, so as to make the reference point R Move laterally towards the target coordinate T by at least one lateral unit SX. Actually, the rotation direction of the steering module 230 in the horizontal direction is opposite to the lateral movement direction of the reference point R in the image data M. As shown in FIG. Similarly, when the longitudinal distance Dis Y is greater than the longitudinal threshold, the processor 110 controls the steering module 230 to change the shooting direction, so that the shooting direction changes the up and down inclination angle, thereby moving the reference point R longitudinally toward the target coordinate T by at least one longitudinal unit SY. Actually, the direction in which the steering module 230 changes the inclination angle is opposite to the longitudinal movement direction of the reference point R in the image data M. As shown in FIG.

As shown in FIG. 5 , in an embodiment, when the horizontal threshold is 0.5 horizontal units SX and the vertical threshold is 0.5 vertical units SY. When the horizontal distance Dis X is less than 0.5 horizontal units SX, the processor 110 does not control the steering module 230 to act; and when the vertical distance Dis Y is less than 0.5 vertical units SY, the processor 110 does not control the steering module 230 to act.

As shown in FIG. 6 , when the lateral distance Dis X is greater than 0.5 lateral units SX, the processor 110 controls the steering module 230 through the controller 210 to move the reference point R laterally toward the target coordinate T by one lateral unit SX. The processor 110 may further load the advanced lateral threshold. For example, when the lateral distance Dis X is greater than 1.5 lateral units SX, the processor 110 controls the steering module 230 to move the reference point R laterally toward the target coordinate T by two lateral units SX .

As shown in FIG. 6 , when the longitudinal distance Dis Y is greater than 0.5 longitudinal units SY, the processor 110 controls the steering module 230 through the controller 210 to move the reference point R longitudinally toward the target coordinate T by one longitudinal unit SY. The processor 110 can further load the advanced vertical threshold. For example, when the vertical distance Dis Y is greater than 1.5 vertical units SY, the processor 110 controls the steering module 230 to move the reference point R laterally toward the target coordinate T in the image data M Two vertical units SY. The movement of the reference point R on the horizontal coordinate axis X and the vertical coordinate axis Y may be performed synchronously or sequentially.

As shown in FIG. 7 , in another tracking method of the present invention, when multiple feature objects A, A' are identified, the processor 110 sets sampling frames F, F' for the multiple feature objects A, A' respectively, and then , according to the number of follow-up shots to be followed, sequentially from the largest area to the smallest area, select the sampling frame F that matches the number of follow-up shots as the follow-up object, and set the auxiliary frame AF surrounding these selected sampling frames F, the auxiliary frame AF is A reference point R is set between the sampling frames F to execute the tracking mode. The number of follow-up shots can be two, or more than two, or all of them.

As shown in FIG. 8 and FIG. 9 , in another tracking method of the present invention, when a plurality of characteristic objects A, A' are identified, the processor 110 sets a sampling frame F for the plurality of characteristic objects A, A' respectively, and Take the sampling frame F with the largest area as the follow-up object. The processor 110 continuously compares the size changes between the sampling frames F, and instantly changes the tracking object to the sampling frame F with the largest area at present. When multiple people are captured into the image data M at the same time, the photographing lens 120 can change the follow-up object to the face closest to the photographing lens 120 at any time (the area of the sampling frame F is the largest).

As shown in FIG. 10 , it is an automatic video recording and tracking system proposed by another embodiment of the present invention. The automatic video recording and tracking system includes a plurality of groups of portable electronic devices 100a, 100b and tracking devices 200a, 200b that have established communication links in pairs, and each tracking device 200a, 200b stores a corresponding Follow the activation code. Here, according to the difference between the corresponding tracking devices 200a and 200b, there are a first tracking activation code and a second tracking activation code; wherein, the first tracking device 200a corresponds to the first tracking activation code, and the second tracking activation code The tracking device 200b corresponds to the second tracking activation code.

The button group 320 can respectively drive the first encoding circuit 311 or the second encoding circuit 312 to issue the first tracking start code, the second tracking start code and the stop code according to the different button combinations; A follow-up activation code, quickly press twice for the second follow-up activation code, long press or another key group 320 is a stop code. The aforementioned key combination is only an example, and may also be different pressing modes or a plurality of key combinations.

When the remote controller 300 sends an optically encoded signal or a wireless signal with the first tracking activation code and is received by the first tracking device 200a, the controller 210 of the remote control 300 can recognize that the optically encoded signal or wireless signal has the first tracking activation code. The capture activation code triggers the first portable electronic device 100a carried on the first capture device 200a. If the second tracking device 200b receives the optically encoded signal or wireless signal of the first tracking activation code, it will not operate because it does not match the second tracking activation code; or, the second tracking device 200b may, when receiving the first tracking start code, identify the first tracking start code as a stop code, and trigger to stop tracking.

On the contrary, when the remote controller 300 sends out an optically encoded signal or a wireless signal with a second tracking activation code and is received by the second tracking device 200b, the controller 210 of the remote controller 210 can recognize that the optically encoded signal or wireless signal has a The second tracking activation code triggers the second portable electronic device 100b carried on the second tracking device 200b. If the first tracking device 200a receives the optically encoded signal or wireless signal of the second tracking activation code, it will not operate because it does not match the first tracking activation code; or, the first tracking device 200a When the second tracking start code is received, the second tracking start code can be recognized as a stop code, and the stop of tracking can be triggered.

After the remote control 300 sends an optically encoded signal or a wireless signal with a stop code and is received by the first tracking device 200a and the second tracking device 200b, the first tracking device 200a and the second tracking device 200b can be triggered respectively The first and second portable electronic devices 100a, 100b stop following the recording.

Referring to FIGS. 11 and 12 , the present invention further provides an automatic video recording and tracking method, which is suitable for the portable electronic device 100 and the tracking device 200 that establish a communication connection with each other. The portable electronic device 100 uses a camera lens 120 shoots the image data M along the shooting direction, and generates a steering control signal to the tracking device 200 , the tracking device 200 is used for carrying the portable electronic device 100 and receives the steering control signal to change the shooting direction.

First, the tracking activation code is received by the tracking device 200 to trigger the portable electronic device 100 to execute the tracking mode, so as to perform a tracking mode for the characteristic object A in the image data M. As shown in Step 110 and Step 120.

In the aforementioned step Step 110, the tracking device 200 continuously waits for the optically encoded signal or the wireless signal sent by the remote controller 300, and compares whether the optically encoded signal or the wireless signal contains the tracking activation code. If the optically encoded signal or the wireless signal contains the tracking activation code, go to Step 120; if the optically encoded signal or the wireless signal does not contain the tracking activation code, wait for the next optically encoded signal or wireless signal to be received. The transmission and reception of optically encoded signals or wireless signals has been disclosed in the description of the implementation of the aforementioned automatic video recording and tracking system, and will not be repeated below.

The portable electronic device 100 defines a horizontal coordinate axis X and a vertical coordinate axis Y that are perpendicular to each other in the image data M; wherein, the length of the image data M along the horizontal coordinate axis X is defined as a plurality of horizontal units SX, and the image data M is along the horizontal coordinate axis X. The height of is defined as a plurality of vertical units SY, as shown in Step 130.

The portable electronic device 100 continuously identifies whether the image data M includes the characteristic object A, as shown in Step 140 .

When the feature object A is identified in the image data M, the portable electronic device 100 sets a sampling frame F around the feature object A, so that the sampling frame F surrounds the feature object A, and sets a reference point R in the sampling frame F, such as Step Step 150 is shown.

In Step 140, if the characteristic object A is not identified in the image data M, the processor 110 of the portable electronic device 100 sends a steering control signal to control the tracking device 200 to continuously change the shooting direction, as shown in Step 160 , and repeat the identification and change the shooting direction until the characteristic object A is identified in the image data M.

After Step 150 , the portable electronic device 100 calculates the horizontal distance Dis X and the vertical distance Dis Y between the reference point R and the target coordinate T, as shown in Step 170 .

When the lateral distance Dis X is greater than the lateral threshold, the portable electronic device 100 sends a steering control signal to change the shooting direction, so that the reference point R moves laterally toward the target coordinate T by at least one lateral unit SX, as shown in Step 180 and Step 190 . If the lateral distance Dis X is not greater than the lateral threshold, skip Step 190 and go directly to Step 200 .

When the vertical distance Dis Y is greater than the vertical threshold, the portable electronic device 100 sends a steering control signal to change the shooting direction, so that the reference point R in the image data M is moved longitudinally by at least one vertical unit SY toward the target coordinate T, as shown in Step 200 and As shown in Step 210, then return to Step 170. If the vertical distance Dis Y is not greater than the vertical threshold, step Step 210 is skipped, and the process returns to Step 170 directly.

As shown in FIG. 13 , the alignment adjustment order in the horizontal coordinate axis X and the vertical coordinate axis Y can be interchanged or parallel, and is not limited to the order in FIG. 12 .

If a plurality of characteristic objects A, A' are identified in Step 140, the portable electronic device 100 sets sampling frames F, F' for the characteristic objects A, A' respectively, and uses the sampling frame F with the largest area to perform the process. Follow mode.

Another way is, if a plurality of characteristic objects A, A' are identified in Step 140, the portable electronic device 100 sets sampling frames F, F' for each characteristic object A, A' respectively, and according to the required tracking For the number of shots, select the sampling frames F that meet the number of follow-up shots in sequence from the largest area to the smallest area, and set auxiliary frames AF surrounding the selected sampling frames F, with the auxiliary frame AF as the range, in these sampling frames Set the reference point R between the frames F for follow-up mode.

As shown in FIG. 12 , after Step 120 , the tracking device 200 continues to receive the optically encoded signal or the wireless signal, and compares whether the optically encoded signal or the wireless signal contains a stop code. When the optical coded signal or the wireless signal includes the stop code, the tracking device 200 triggers the portable electronic device 100 to stop the tracking mode.

Please refer to FIG. 14 and FIG. 15 , when the sampling frame F with the largest area is used in the tracking mode, regardless of whether the area of the sampling frame F and the corresponding feature object A in the image data M changes, the portable electronic device The processor 110 of 100 will lock the sampling frame F and the corresponding feature object A to execute the tracking mode. However, in some cases, because the feature object A in the sampling frame F with the largest area moves too fast or is blocked by another feature object A1, the portable electronic device 100 cannot continue to execute the tracking mode, and controls the tracking mode. The photographing device 200 continuously rotates to search for the characteristic object A, which causes the range of the image data M to rapidly change beyond the range expected by the user.

As shown in FIG. 14 and FIG. 16 , after step B, the processor 110 of the portable electronic device 100 continuously determines whether the feature object A is maintained in the image data M, as shown in step Step 220 .

As shown in FIG. 14 and FIG. 16 , if the feature object A is maintained in the image data M, the processor 110 continues to execute Step 170 . If the feature object A is not in the image data M, the processor 110 determines whether the feature object A is partially or completely obscured by another feature object A1 during the moving process, as shown in Step 230 .

If the feature object A is obscured by another feature object A1 during the movement, the processor 110 selects another sampling frame F1 corresponding to the other feature object A1 to execute the tracking mode, and resets the reference point R1, as in Step 240 shown. The processor 110 then proceeds to step Step 170 . At this time, another characteristic object A1 will become a new target of the follow-up mode.

As shown in FIGS. 15 and 16 , if the feature object A is not covered by another feature object A1, the feature object A may be out of the range of the image data M due to rapid movement, or the feature object A may be caused by turning (for example, a person The face is facing away from the camera lens 120 ), so that the processor 110 cannot identify it from the image data M. At this time, the processor 110 selects another sampling frame F2 with the largest area from the image data to execute the tracking mode, and resets the reference point R2, as shown in Step 250 . The processor 110 then proceeds to step Step 170 . At this time, another characteristic object A2 will become a new target of the follow-up mode. By updating the target of the above-mentioned tracking mode, it can be avoided that the tracking action of the photographic lens follows a single target excessively, and the range of the captured image data M is greatly shaken.

In the technical means provided by the present invention, the follow-up action of the photographic lens 120 will not follow the human face excessively, resulting in excessive shaking of the photographed image data M, and the photographing direction will be gradually adjusted only when the moving distance exceeds the threshold value. It makes the image data relatively stable, and the way to follow the photography will be relatively smooth.

100: Portable Electronic Devices 100a: The first portable electronic device 100b: Second portable electronic device 110: Processor 120: Photography Lens 130: Memory Unit 140: touch display panel 150: The first communication interface 200: Follow-up device 200a: The first tracking device 200b: The second tracking device 210: Controller 220: Second communication interface 230: Steering Module 232: Fixtures 240: Optical Encoding Receiver Unit 250: Third communication interface 300: Remote control 310: Encoding circuit 311: The first encoding circuit 312: Second encoding circuit 320:Key group 321: First button 330: Optically encoded transmitter unit 340: Fourth communication interface 400: Light Tracer A,A',A1,A2: Feature objects X: horizontal axis Y: vertical axis SX: horizontal unit SY: Vertical unit F,F',F1,F2: Sampling frame AF: Auxiliary frame M: video data T: target coordinates R: datum point Dis Y: vertical distance Dis X: Lateral distance Step110~Step250: Steps

FIG. 1 is a system schematic diagram of an automatic video recording system according to an embodiment of the present invention. FIG. 2 is a circuit block diagram of a portable electronic device and a tracking device according to an embodiment of the present invention. FIG. 3 is a circuit block diagram of a tracking device and a remote controller according to an embodiment of the present invention. FIG. 4 is a circuit block diagram of a light tracker, a remote control and a tracking base according to another embodiment of the present invention. FIG. 5 is a schematic diagram of generating a sampling frame and a reference point according to a feature object according to an embodiment of the present invention. FIG. 6 is a schematic diagram of changing the shooting direction according to the reference point and the target coordinates according to the embodiment of the present invention. FIG. 7 is a schematic diagram of selecting some marquee frames in a plurality of sampling frames and simultaneously executing a tracking mode according to an embodiment of the present invention. FIG. 8 and FIG. 9 are schematic diagrams of continuously performing a follow-up mode with a sampling frame with the largest area according to an embodiment of the present invention. FIG. 10 is a schematic diagram of using a remote controller to select one from a combination of a plurality of portable electronic devices and a tracking device to activate the tracking mode according to an embodiment of the present invention. FIG. 11 and FIG. 12 are flowcharts of the automatic video recording method of the present invention. FIG. 13 is another flow chart of the automatic video recording method of the present invention. FIG. 14 and FIG. 15 are schematic diagrams of the characteristic objects disappearing from the image data according to the embodiment of the present invention. FIG. 16 is another flow chart of the automatic video recording method of the present invention.

Step 110~Step 250: Steps

Claims (6)

An automatic video recording and tracking system, comprising: a portable electronic device, including: a processor for executing a tracking mode; a camera lens, electrically connected to the processor, for shooting along a Shooting an image data in the direction and sending the image data to the processor; and the processor defines a horizontal coordinate axis and a vertical coordinate axis that are perpendicular to each other in the image data, and the length of the image data along the horizontal coordinate axis is defined as a plurality of horizontal axes unit, and the height of the image data along the horizontal axis is defined as a plurality of vertical units; a memory unit is electrically connected to the processor for storing the image data; a touch display panel is electrically connected to the processor a device for displaying the image data, receiving a touch operation and feeding back the touch operation to the processor; and a first communication interface electrically connected to the processor; and a tracking device, comprising: a controller; a second communication interface electrically connected to the controller and establishing a communication link with the first communication interface to receive a steering control signal and transmit the steering control signal to the controller; a third communication an interface for receiving a wireless signal with a tracking activation code, and sending the tracking activation code to the controller, so that the controller can pass the first communication interface and the second communication interface when receiving the tracking activation code The communication interface triggers the processor to start executing the tracking mode; and A steering module is electrically connected to the controller, and the steering module carries the portable electronic device; wherein the controller drives the steering module to turn according to the steering control signal to change the shooting of the photographic lens direction; wherein, in the follow-up mode, the processor identifies a characteristic object in the image data, sets a sampling frame around the characteristic object, so that the sampling frame surrounds the characteristic object, and follows the movement of the characteristic object. moving the sampling frame; the processor sets a reference point in the sampling frame, and when the processor identifies a plurality of the characteristic objects in the image data, the processor sets the sampling for each of the characteristic objects respectively frame, and execute the tracking mode with the sampling frame with the largest area; wherein, the processor calculates a horizontal distance and a vertical distance between the reference point and a target coordinate, and when the horizontal distance is greater than a horizontal threshold, the processing The processor sends the steering control signal to drive the steering module to change the shooting direction, so that the reference point moves laterally toward the target coordinate by at least one of the lateral units; and when the longitudinal distance is greater than a longitudinal threshold, the processor sends the steering control signal Controlling the steering module to move the reference point in the image data longitudinally toward the target coordinate by at least one of the vertical units; and wherein the processor continuously determines whether the feature object is maintained in the image data; if the feature object is not present In the image data, and the feature object is covered by another feature object, the processor selects another sampling frame corresponding to the other feature object to execute the follow-up mode, and resets the reference point; if the feature If the object is not in the image data, and the feature object is not covered by another feature object, the processor selects another sampling frame with the largest area in the image data to execute the follow-up mode, and resets the reference point . The automatic video recording and tracking system according to claim 1, further comprising a remote controller having: a second encoding circuit for generating the tracking activation code; a fourth communication interface electrically connected to the first two encoding circuits; and a button group electrically connected to the second encoding circuit for being pressed to trigger the second encoding circuit to drive the fourth communication interface to send out the wireless signal with the tracking activation code, so as to received by the third communication interface of the tracking device. The automatic video recording and tracking system according to claim 2, wherein after the button group is pressed to form a button combination, the second encoding circuit drives the fourth communication interface to send out a message with the tracking button according to the button combination. Tap the wireless signal of the activation code. An automatic video recording and tracking method is suitable for a portable electronic device and a tracking device that establish communication links with each other. The portable electronic device shoots an image data along a shooting direction with a camera lens and generates a Steering control signal and transmitting the steering control signal to the tracking device, the tracking device is used for carrying the portable electronic device, and receives the steering control signal to change the shooting direction; the method includes the following steps: triggering the possible The portable electronic device executes a tracking mode to perform the tracking mode for a characteristic object in the image data; the tracking device receives a tracking activation code, and transmits the tracking activation code to the portable electronic device Electronic device; define a horizontal coordinate axis and a vertical coordinate axis that are perpendicular to each other in the image data; wherein, the length of the image data along the horizontal coordinate axis is defined as a plurality of horizontal units, and the height of the image data along the horizontal coordinate axis is defined as a plurality of vertical units; When the characteristic object is identified in the image data, a sampling frame is set around the characteristic object, so that the sampling frame surrounds the characteristic object, and a reference point is set in the sampling frame, and when a plurality of the characteristics are identified When the object is selected, set the sampling frame for each of the characteristic objects respectively, and use the sampling frame with the largest area to perform the tracking mode; and calculate a horizontal distance and a vertical distance between the reference point and a target coordinate; wherein, when the The lateral distance is greater than a lateral threshold, and the steering control signal is issued to change the shooting direction, so that the reference point is moved laterally toward the target coordinate by at least one of the lateral units; and when the longitudinal distance is greater than a longitudinal threshold, the steering control signal is issued to Changing the shooting direction to move the reference point in the image data longitudinally by at least one of the vertical units toward the target coordinate; and continuously judging whether the feature object is maintained in the image data; if the feature object is not in the image data, and the feature object is covered by another feature object, select another sampling frame corresponding to the other feature object to execute the follow-up mode, and reset the reference point; if the feature object is not in the image data, and The feature object is not covered by another feature object, another sampling frame with the largest area is selected from the image data to execute the follow-up mode, and the reference point is reset. The automatic video recording and tracking method according to claim 4, wherein the step of receiving the tracking activation code by the tracking device includes receiving a wireless signal and comparing whether the wireless signal contains the tracking activation code. The automatic video recording method according to claim 4, further comprising receiving a wireless signal, comparing whether the wireless signal includes a stop code, and triggering the portable electronic device to stop when the wireless signal includes the stop code The follow mode.

Images