EP4696032A1

EP4696032A1 - Tracking device for cameras

Info

Publication number: EP4696032A1
Application number: EP24725615.9A
Authority: EP
Inventors: Eva DALLOLIO
Original assignee: Individual
Current assignee: Individual
Priority date: 2023-04-14
Filing date: 2024-04-12
Publication date: 2026-02-18
Also published as: WO2024214127A1; JP2026513354A; IT202300007299A1

Abstract

The camera tracking device (1) comprises a sensor head (2), which can be detachably associated externally with a camera (3). The sensor head (2) includes means configured to detect a first rotational movement of said sensor head (2) around a first axis of rotation (X) and a second rotational movement of said sensor head (2) around a second axis of rotation (Y), orthogonal to said first axis of rotation (X), and to generate respective electronic signals indicative of such rotation movements; a data processing unit configured to receive and process said electronic signals; a wireless data transmission unit, configurable to establish a connection with a network or an external electronic device; means (4) for displaying a graphical user interface; fixing means (5) suitable for associating, in operation, said sensor head (2) with said camera (3); a wired connection interface (6), designed to connect, in operation, the device (1) to an external data processing system.

Description

TRACKING DEVICE FOR CAMERAS

Technical Field

[01] The present invention relates to a tracking device for cameras.

Prior art

[02] Use of virtual production techniques including virtual set, augmented reality and mixed reality or extended reality (VR, AR, XR) techniques, which involve the audiovisual filming of a real-world scene, and the overlay of one or more virtual levels, including sets, elements or characters on that scene is known in the field of entertainment or the production of audiovisual materials. Recent technological progress has made it possible to produce augmented reality materials or virtual scenes characterized by high realism, in which virtual levels blend with real images in a very fluid, natural and effective way.

[03] Currently, augmented reality audiovisual materials can be produced through applications that can be run on hardware supports such as smartphones, equipped with cameras and motion sensors. In particular, it is necessary to have one or more cameras, to shoot a real- world scene, a software application capable of producing one or more virtual images and overlaying it on the shot scene, and one or more sensors capable of detecting changes made to the framing (by zooming or moving the camera) in order to adapt the position of the virtual images accordingly.

[04] In the context of professional or amateur production of audiovisual materials, a need exists for adapting the use of professional or amateur cameras for making virtual production audiovisual materials.

[05] To this end, tracking devices have been proposed, which can be detachably associated externally with these cameras. Such devices are capable of detecting changes to the framing, encoding the detected information by electronic signals, and sending those electronic signals to a data processing system.

[06] One type of tracking device known in the art comprises a sensor head, equipped with one or more optical sensors adapted to detect the position of a plurality of markers arranged in the real environment that defines the field of framing. The tracking device comprises processing means configured to create a three-dimensional map of the surrounding environment, based on the position of the markers, and to detect in real time the position and the orientation of the sensor head with respect to said map. Examples of such devices are disclosed in patent application GB2602356A and patent application EP4020392A.

[07] It has been noted, however, that devices known in the art are not exempt from possible improvements.

[08] In particular, known devices often have a high cost, a complex structure and require a long and laborious preparation of the shooting environment, in particular with regard to the installation of markers. In addition, especially when the shooting environment is outdoors, such preparation is difficult to carry out.

Disclosure

[09] The task of the present invention is to solve or mitigate the aforementioned problems, by devising a tracking device for cameras that is compact and simple from a constructive point of view.

[10] Another object of the invention is to provide a tracking device for cameras that does not require a laborious preparation of the working environment.

[11] A further object of the invention is to provide a device, which is simple to maintain.

[12] A still further object of the invention is to provide a device that has low weight.

[13] A further object of the invention is to provide a device that is easy to use by the operator.

[14] A further object of the invention is to make a tracking device for cameras of simple constructive and functional design, which is reliable in operation, has versatile use, as well as relatively economical cost.

[15] The aforementioned objects are achieved, according to the present invention, by the tracking device for cameras according to the appended claims.

[16] The camera tracking device comprises a sensor head, which can be detachably associated externally with a video camera.

[17] The sensor head includes means configured to detect a first rotational movement of the sensor head around a first axis of rotation and a second rotational movement of the sensor head around a second axis of rotation, orthogonal to the first axis of rotation, and to generate respective electronic signals indicative of such rotational movements.

[18] Preferably, said means configured to detect a first rotational movement of the sensor head around a first axis of rotation and a second rotational movement of the sensor head around a second axis of rotation, orthogonal to the first axis of rotation, and for generating respective electronic signals indicative of such rotational movements comprise or consist of a first inertial sensor.

[19] Preferably, said first axis of rotation is a horizontal axis of rotation, therefore the first rotation movement is a swinging movement on a vertical plane.

[20] Preferably, said second axis of rotation is a vertical axis of rotation, therefore the second rotation movement is a swinging movement on a horizontal plane.

[21] The sensor head also includes a data processing unit, configured to receive said signals from the first inertial sensor and process them.

[22] Preferably, the data processing unit comprises or consists of an electronic card.

[23] The sensor head also includes a wireless data transmission assembly, configurable to establish a connection with a network or an external electronic device.

[24] Preferably, the wireless data transmission unit comprises or consists of a wi-fi card. [25] The sensor head also comprises a wired connection interface, adapted to connect, in operation, the device to an external data processing system.

[26] Preferably, the external data processing system comprises a computer configured to generate virtual scenarios.

[27] Preferably, the wired connection interface comprises a plurality of connection ports, adapted to transmit the signals processed by the internal data processing unit to the external data processing system.

[28] Preferably, the wired connection interface comprises one or more RS485 serial ports.

[29] Preferably, the wired connection interface comprises an input port for an electronic signal indicative of a zoom and/or focus movement of the camera lens.

[30] The sensor head also includes means for displaying a graphical user interface.

[31] Preferably, the means for displaying a graphical user interface comprises or consist of an electronic display.

[32] Preferably, the electronic display is configured to display operating parameters relating to the tracking device.

[33] The sensor head also includes fixing means adapted to associate, in operation, the sensor head to the camera.

[34] Preferably, the fixing means comprises a plurality of seats adapted to receive and retain respective fixing straps or ties, for fixing, in use, the device to the camera.

[35] Preferably, the device comprises means configured to detect translational movements of the sensor head and to generate respective electronic signals indicative of such movements.

[36] Preferably, the means configured to detect translational movements of the sensor head and to generate respective electronic signals indicative of such movements comprises or consists of a second inertial sensor.

[37] Preferably the second inertial sensor is housed in a wired accessory, connected to the sensor head.

[38] Preferably, the sensor head is formed by a box-shaped body, comprising a lower base and an upper base.

[39] Preferably, the lower and upper bases are connected to each other by a plurality of side walls.

[40] Preferably, the body comprises four side walls.

[41] Preferably, the electronic display is arranged at a side wall of said plurality of side walls.

[42] Preferably, the side wall housing the electronic display is inclined, so as to make it easier to an operator to see it.

[43] Preferably, the lower base of the body comprises said fixing means.

[44] According to the invention, the data processing unit is configured to send in real time, by means of the wireless data transmission unit or by means of the wired connection interface, said electronic signals to the external data processing system, so that the external data processing system uses said electronic signals to generate in real time virtual scenarios consistent with the movements made by the camera.

[45] It is also an object of the invention a method for tracking a camera by means of a tracking device for cameras according to the invention, comprising the following steps: a. associating a camera tracking device with a video camera; b. operating and configuring the device; c. while the camera is in operation, detecting, by means of the device, a first rotational movement of the camera around a first axis of rotation and a second rotational movement of the camera around a second axis of rotation, orthogonal to the first axis of rotation, and generating respective electronic signals indicative of such rotational movements; d. processing, by means of a processing unit internal to the device, said electronic signals and generating a camera tracking signal; e. sending in real time said camera tracking signal to an external data processing system via a wireless data transmission unit of said device or via a wired connection interface of the device; f. using, by means of said external data processing system, said tracking signal of said camera to generate in real time virtual scenarios consistent with the movements made by said camera.

[46] Preferably, the wireless transmission of said tracking signal is carried out using the OSC or FreeD protocol.

[47] It is also an object of the invention a computer program comprising instructions that require the device according to the invention to carry out the steps c. - e. of the described method.

[48] It is also an object of the invention a computer-readable data carrier having stored thereon the computer program according to the invention.

[49] It is still an object of the invention a system for generating virtual scenarios comprising at least one video camera, a tracking device associated with at least one camera, an external data processing system configured to receive and use a tracking signal of the at least one camera, generated by the tracking device, to generate virtual scenarios in real time consistent with the movements made by at least one video camera.

Description of drawings

[50] The details of the invention will be more evident from the detailed description of a preferred embodiment of the tracking device for video cameras according to the invention, illustrated by way of example in the attached drawings, in which:

Figure 1 shows a perspective view of the device according to the invention, associated with a camera in a first mounting configuration; Figure 2 shows a perspective view of the device according to the invention, associated with a camera in a second mounting configuration;

Figure 3 shows a perspective view of the device according to the invention, associated with a camera in a third mounting configuration;

Figures 4-5 show respective side views of the device according to the invention;

Figure 6 shows a bottom view of the device according to the invention;

Figure 7 shows a perspective view of the device according to the invention, associated with a camera installed on an swivel arm.

Description of embodiments of the invention

[51] With particular reference to Figures 1 - 7, the tracking device for cameras is indicated as a whole by the numeral 1 .

[52] The device 1 includes a sensor head 2, which can be associated externally, in a detachable manner, with a video camera 3.

[53] The sensor head 2 is shaped by a box-shaped body 20, comprising a lower base 21 and an upper base 22. The lower and upper bases 21 , 22 are connected to each other through a plurality of side walls 23.

[54] Preferably, the body 20 comprises four side walls 23.

[55] The sensor head 2 includes means 4 for displaying a graphical user interface, preferably an electronic display. The electronic display 4 is arranged at a side wall 24 of said plurality of side walls 23.

[56] Preferably, the side wall 24 that houses the electronic display 4 is inclined, so as to make it easier for an operator to see it.

[57] The lower base 21 of the body 20 includes fixing means 5 suitable for detachably associating, in operation, the body 2 with the structure of a video camera 3.

[58] Preferably, the fixing means 5 comprises a channel 51 , preferably T-shaped, suitable for receiving a corresponding bracket arranged on the structure of the camera 3. Preferably, the fixing means 5 also comprises a plurality of seats 52 suitable for receiving and retaining respective fixing straps or ties, to fix, in operation, the device 1 to the camera 3.

[59] The sensor head 2 includes, inside the box-shaped body 20, at least a first inertial sensor M1 , configured to detect a first rotation movement of the sensor head 2 around a first rotation axis X and a second rotation movement of the sensor head 2 around a second axis of rotation Y, orthogonal to the first axis of rotation X.

[60] Preferably, said first axis of rotation X is a horizontal axis of rotation, therefore the first rotation movement is a swinging movement on a vertical plane (i.e. a tilt-type movement).

[61] Preferably, said second axis of rotation Y is a vertical axis of rotation, therefore the second rotation movement is a swinging movement on a horizontal plane (i.e. a pan-type movement). [62] The first inertial sensor M1 is configured to generate respective electronic signals, indicative of the detected rotation movements.

[63] The sensor head 2 also includes, inside the box-shaped body 20, a data processing unit U1 , preferably an electronic card, configured to receive said signals from the first inertial sensor M1 and process them.

[64] The sensor head 2 also includes, inside the box-shaped body 20, a wireless data transmission unit U2, preferably a wi-fi card, configurable to establish a connection with a network or an external electronic device.

[65] The sensor head also comprises a wired connection interface, adapted to connect, in operation, the device to an external data processing system E.

[66] The external data processing system E preferably comprises a computer configured to generate virtual scenarios.

[67] The connection interface 6 preferably includes a plurality of connection ports, for example RS485 serial ports, suitable for conveying the signals processed by the internal data processing unit U1 to the external data processing system E.

[68] Preferably, the connection interface 6 is arranged at a side wall 25 of said plurality of side walls 23. Preferably, the side wall 25 is opposed to said side wall 24 on which the electronic display 4 is arranged.

[69] The wired connection interface 6 preferably includes an input port for an electronic signal indicative of a zoom and focus movement of the camera lens. This electronic signal can be acquired for example by means of a rotary encoder applied to the camera optical system.

[70] It should be noted that the device 1 may be associated with a camera 3 installed on a tripod (see Figures 1-3) or on a swivel arm (known as a crane, see in particular Figure 7). The device 1 may include a second inertial sensor M2 configured to detect the movements of the swivel arm in three-dimensional space (in particular translation movements along X, Y and Z directions) and to generate respective electronic signals indicative of such movements. Preferably the second inertial sensor M2 is housed in a wired accessory, connected to the sensor head.

[71] The inertial sensors, M1 , M2, the electronic display 4, the wireless card U2 and the wired connection interface 6 are conveniently connected to the internal data processing unit U1 of the device 1 .

[72] The operation of the tracking device 1 for cameras is easily understandable from the following description.

[73] Initially, an operator associates the device 1 with the structure of a video camera 3, using the fixing means 5. The device 1 may be installed with the display 4 facing behind the camera 3 (see Figure 1 ) or laterally with respect to the camera 3 (see Figures 1 and 2).

[74] The operator then connects the electrical power cable of the device 1 and makes the connections relating to the wired interface 6. For example, the operator can connect an input cable coming from the rotary encoder connected to the optical system of the camera 3 and can also connect an output cable, through a serial port, to the external data processing system E.

[75] The operator then activates the device 1 , connects a computer or other external electronic device to the wi-fi card of the device 1 and accesses, through a browser of said computer or external electronic device, the web interface for configuring the device 1. Through the configuration web interface of the device 1 it is possible to adjust settings such as the height of the tripod and the offset parameters. The set configuration parameters and other service information can be displayed on the display 4 of the device 1 .

[76] It should be noted that the display 4 is adapted to display the operating parameters of the device 1 ; in particular, the device 1 is configured to detect the movements of the camera 3, but is not configured to manage or control, through actuators, the movements of the camera 3.

[77] Once the configuration of the device 1 has been performed, the operator can start shooting with the camera 3. During filming, the device 1 detects the movements of the camera 3 associated therewith. In practice, the first inertial sensor M1 of the device 1 detects the rotational movements of the camera 3 around the X and Y axes and generates respective electronic signals indicative of such rotational movements. The internal processing unit U1 of the device 1 receives these electronic signals, together with the signals received from the external rotary encoder, if present, and processes and outputs, in real time, a tracking signal from the camera 3. The tracking signal is transmitted to the external data processing system E via the wi-fi card U2 (preferably using the UDP transmission protocol) using the OSC or FreeD protocol or via the wired interface 6, for example using the FreeD protocol via the serial port.

[78] The tracking signal of the camera 3 includes data, transmitted in real time, relating to the pan, tilt and zoom movements of the camera 3. Preferably, the tracking signal of the camera 3 also includes the data, transmitted in real time, relating to the focus and the roll of the camera 3.

[79] If the camera 3 is installed on a swivel arm and the device 1 is equipped with the second inertial sensor M2 (via a wired accessory containing the second inertial sensor), the tracking signal of the camera 3 also includes data relating to the movements of the swivel arm in three-dimensional space (along directions X, Y and Z).

[80] The external data processing system receives the tracking signal from the camera 3 and uses this signal to generate virtual scenarios in real time consistent with the movements made by the camera 3.

[81] The tracking device for cameras according to the invention achieves the purpose of carrying out tracking of a camera without requiring a long and laborious preparation of the shooting environment. In particular, this is achieved thanks to inertial sensors capable of detecting the camera's movements.

[82] In the practical embodiment of the invention, the materials used, as well as the shape and the dimensions, may be modified depending on needs without departing from the scope of the appended claims.

[83] Should the technical features mentioned in any claim be followed by reference signs, such reference signs were included strictly with the aim of enhancing the understanding of the claims and hence they shall not be deemed restrictive in any manner whatsoever on the scope of each element identified for exemplifying purposes by such reference signs.

Claims

1 . A camera tracking device (1 ), comprising a sensor head (2) associable externally with a video camera (3) in a detachable fashion; characterized in that said sensor head (2) comprises means (M1 ) configured to detect a first rotational movement of said sensor head (2) around a first axis of rotation (X) and a second rotational movement of said sensor head (2) around a second axis of rotation (Y), which is orthogonal to said first axis of rotation (X), and to generate respective electronic signals indicative of said rotational movements; a data processing unit (U1 ) configured to receive and process said electronic signals; a wireless data transmission unit (U2), configurable to establish a connection with an external network or electronic device; means for displaying (4) a graphical user interface; fixing means (5) adapted to associate, in operation, said sensor head (2) with said camera (3); a wired connection interface (6), adapted to connect, in operation, the device (1 ) to an external data processing system (E); said means (M1 ) configured to detect a first rotational movement of said sensor head (2) around a first axis of rotation (X) and a second rotational movement of said sensor head (2) around a second axis of rotation (Y), said wireless data transmission unit (U2), said means for displaying (4) a graphical user interface and said wired connection interface (6) being connected to said data processing unit (U1 ); said data processing unit (U1 ) being configured to transmit in real time, via said data transmission unit (U2) wirelessly or via said wired connection interface (6), said electronic signals to said external data processing system (E), so that said external data processing system (E) uses said electronic signals to generate virtual scenarios in real time consistent with the movements made by said camera (3).

2. The device of claim 1 , wherein it comprises means (M2) configured to detect translational movements of said sensor head (2) and to generate respective electronic signals indicative of said movements.

3. The device of claim 1 or 2, wherein said means (M1 ) configured to detect a first rotational movement of said sensor head (2) around a first axis of rotation (X) and a second rotational movement of said sensor head (2) around a second axis of rotation (Y) and to generate respective electronic signals indicative of said rotational movements comprises a first inertial sensor.

4. The device of claim 2 or 3, wherein said means (M2) configured to detect translational movements of said sensor head (2) and to generate respective electronic signals indicative of said movements comprises a second inertial sensor.

5. The device of any one of the preceding claims, wherein said sensor head is formed by a box-shaped body (20) comprising a lower base (21 ) and an upper base (22), said lower and upper bases (21 , 22) being connected by a plurality of side walls (23), wherein a side wall (24) of said plurality of side walls (23) is provided with said display means (3) of a graphical user interface.

6. The device of claim 5, wherein said side wall (24), provided with said display means (3) of a graphical user interface, is inclined.

7. The device according to any one of the preceding claims, wherein said fixing means (5) comprises a plurality of seats (52) adapted to receive and retain respective fastening straps or ties, for fastening, in operation, said device (1 ) to said camera (3).

8. A method for tracking a camera (3) by means of a camera tracking device (1 ) of any one of the preceding claims, comprising the following steps: a. associating a camera tracking device (1 ) with a video camera (3); b. operating and configuring said device (1 ); c. while said camera (3) is in operation, detecting, by means of said device (1 ), a first rotational movement of said camera (3) around a first axis of rotation (X) and a second rotational movement of said camera (3) around a second axis of rotation (Y), which is orthogonal to said first axis of rotaion (X), and generating respective electronic signals indicative of said rotational movements; d. processing, via a data processing unit (U1 ) internal to said device (1 ), said electronic signals and generating a tracking signal of said camera (3); e. sending in real time said tracking signal of said camera (3) to an external data processing system (E) via a wireless data transmission unit (U2) of said device (1 ) or via a wired connection interface (6) of said device (1 ). f. using, by means of said external data processing system (E), said tracking signal of said camera (3) to generate in real time virtual scenarios consistent with the movements made by said camera (3).

9. A computer program comprising instructions requiring the device of any one of claims 1 - 7 to carry out the steps c. - e. of the method of claim 8.

10. A computer-readable data carrier having stored thereon the computer program of claim 9.

11. A system for generating virtual scenarios including: at least one video camera (3); a tracking device (1 ) according to one of claims 1-7 associated with said at least one video camera (3); an external data processing system (E) configured to receive and use a tracking signal from said at least one video camera (3), generated by said tracking device (1 ), to generate virtual scenarios in real time consistent with the movements carried out by said at least one camera