WO2022062970A1

WO2022062970A1 - Image acquisition apparatus and image acquisition system

Info

Publication number: WO2022062970A1
Application number: PCT/CN2021/118303
Authority: WO
Inventors: 聂兰龙
Original assignee: 青岛千眼飞凤信息技术有限公司
Priority date: 2020-09-28
Filing date: 2021-09-14
Publication date: 2022-03-31
Also published as: CN114286016A

Abstract

Disclosed are an image acquisition apparatus and an image acquisition system. The image acquisition apparatus may comprise: a plurality of cameras, a first transmission module, a processor and a second transmission module, wherein the plurality of cameras are in a chain-shaped distribution; each of the plurality of cameras is configured with a unique identifier, the identifier being used for indicating the position of the camera in the chain-shaped distribution; the first transmission module is used for connecting the plurality of cameras to the processor, and for performing information transmission between the plurality of cameras and the processor; the processor is used for acquiring photographed multimedia data from the plurality of cameras, and/or sending a control command to the plurality of cameras; and the second transmission module is used for performing information transmission between the processor and an external system.

Description

Image acquisition device and image acquisition system

This application claims the priority of the Chinese patent application with the application number 202011044993.4 and the application title "Image Acquisition Device and Image Acquisition System" filed with the Chinese Patent Office on September 28, 2020, the entire contents of which are incorporated into this application by reference.

technical field

The present application relates to the technical field of image processing, and in particular, to an image acquisition device and an image acquisition system.

Background technique

At present, there are two main forms of video shooting, one is to shoot video with a fixed camera, and the video image area captured by this form is fixed; the other is to move the camera to shoot video, which requires a stable gimbal to shoot video. Solve problems such as screen shake.

It can be seen from the above that the reliability of the current video shooting equipment is low.

For the problem of low reliability of the video shooting device in the above-mentioned related art, no effective solution has been proposed yet.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an image acquisition device and an image acquisition system to at least solve the technical problem of low reliability of video shooting equipment in the related art.

According to an aspect of the embodiments of the present application, an image acquisition device is provided, including: a plurality of cameras, a first transmission module, a processor, and a second transmission module, wherein the plurality of cameras are distributed in a chain; the Each camera in the plurality of cameras is configured with a unique identification, and the identification is used to indicate the position of the camera in the chain distribution; the first transmission module is used to connect the plurality of cameras and all the cameras. The processor is used for information transmission between the plurality of cameras and the processor; the processor is used for acquiring the multimedia data obtained by shooting from the plurality of cameras, and/or, to the Multiple cameras send control commands; wherein, the multimedia data includes at least one of the following: images and videos; the control commands are used to control the multiple cameras to shoot according to predetermined parameters; the second transmission module is used for Information is transmitted between the processor and an external system, wherein the external system is a system other than the image acquisition device.

Optionally, the first transmission module is a bus, and the bus is used to connect the image sensor unit of each camera and the transceiver unit of the processor, wherein the bus includes one of the following: TTL, RS485 , IIC, High-speed IIC, SPI, 1-wire, m-lvds, b-lvds, CAN, FlexRay, 10BASE-T1S.

Optionally, the first transmission module is a cable, wherein the cable at least includes: a data transmission line and a power supply line, the data transmission line is used for information transmission, and the power supply line is used for connecting to the The cameras on the cables are powered on; the plurality of cameras are arranged on the cables at predetermined intervals, and the power supply lines are used for power supply and the data transmission lines are used for data transmission; and/or the first The transmission module is a bus, the plurality of cameras are connected to the processor through the bus, the image acquisition device is made as a whole, and the image acquisition device also includes a connection part, and the connection part is used for detachable connected to a connecting line, the second transmission module is used for information transmission with the external system through the connecting line, and the external system is detachably connected to at least one of the image acquisition devices, and the connecting line It is also used to supply power to the image acquisition device; and/or, the first transmission module is a bus, the plurality of cameras are connected to the processor through the bus, and the image acquisition device is made as one Overall, the second transmission module is a wireless network module and/or a wired network module, and in the case where the second transmission module includes a wired network module, the image acquisition device further includes a network interface, and the network interface is used for Connect the cables to the external system.

Optionally, the plurality of cameras are distributed on a plurality of chains, wherein each chain on the plurality of chains is provided with at least one camera, and the processor is one or more, wherein the When there is one processor, it is connected to the plurality of cameras, and when there are multiple processors, the processor is connected to the cameras on one or more chains, and is used to control the cameras of the chain.

Optionally, the multiple cameras are cameras of the same type or cameras of different types, and/or the orientations of the multiple cameras are the same or different.

Optionally, the processor is also used for at least one of the following: adding an address stamp and/or a time stamp on the media data, wherein the address stamp is an identifier of a camera that shoots the multimedia data, and the time stamp The stamp is the time information of shooting the multimedia data; in the case that the multimedia data is a video, the processor adds the address stamp and/or the time stamp on part or all of the frames of the video; The multimedia data is subjected to editing processing, wherein the editing processing is used to change the transmission bit rate of the multimedia data and/or change the resolution of the multimedia data; in the case that the multimedia data is a video, according to a predetermined The frames of the multimedia data are sequentially transmitted to the external system through the second transmission module, wherein the transmitted frames extract video data captured by different cameras.

Optionally, the control command is also used for at least one of the following: a focus control command, an ISO command, a fill light command, an activation command, a clock command, and a message command, wherein the focus control command is used to set the focus of the camera. Parameters, the ISO command is used to set the ISO value of the camera, the fill light command is used to turn on or off the fill light unit, the activation command is used to turn on or off the camera, the clock command is used to check the time information of the camera, and the message command is used to obtain all the parameters. state information of the camera.

Optionally, the focus control instruction is configured according to at least one of the following focal length control principles: a continuous focus control threshold interval is preset, and after the first camera completes focus shooting, the second camera adjacent to the first camera The camera obtains the focal length value of the first camera, and selects the focal length value to be used within the focal length control threshold interval according to the obtained focal length value, and so on; Determine the focal length value; configure the camera with a predetermined focal length value.

According to another aspect of the embodiments of the present application, there is also provided an image acquisition system, including the image acquisition apparatus described in any one of the above, and further comprising: a processing module, wherein the processing module is configured to: A plurality of multimedia data of the image acquisition device, wherein, each camera for shooting obtains a piece of multimedia data, and the plurality of multimedia data are obtained by different cameras; and/or, present the plurality of multimedia data to the operator, and the operator selects for sampling; and generates a video file according to the data obtained by sampling.

Optionally, performing data sampling from the plurality of multimedia data according to the sampling rule includes: acquiring the identification of the camera to which the plurality of multimedia data corresponds, and determining to be sampled according to the identification and the identification rule in the sampling rule. according to the time rule in the sampling rule, and perform data sampling from the plurality of multimedia data according to the sequence.

Optionally, the identification rule includes at least one of the following: determining the order of the multimedia data to be sampled according to the order of the marks, determining the order of the multimedia data to be sampled according to the reverse order of the marks, according to the predetermined interval order or the reverse order of marks. Determine the order of the multimedia to be sampled, and use the order of the identifiers determined by the first predetermined function as the order of the multimedia data to be sampled; the time rule includes at least one of the following: sampling at the same time node, at the time of jumping Sampling is performed on the node, sampling is performed in time sequence, sampling is performed in reverse time sequence, and sampling is performed in time sequence determined by using the second predetermined function.

Optionally, the processing module is further configured to configure a shooting rule, and send the shooting rule to the processor, wherein the shooting rule is to determine a camera for shooting and shooting parameters, and the shooting parameters include At least one of the following: shooting time, quality parameters of the captured image.

Optionally, the processing module is one of the following: a server, a controller.

According to another aspect of the embodiments of the present application, an image acquisition method is also provided, which is applied to the image acquisition apparatus described in any of the above, and/or the image acquisition system described in any of the above.

In the embodiment of the present application, a plurality of cameras are set in a chain-like distribution, and each camera in the plurality of cameras is configured with a unique identifier, and the identifier is used to indicate the position of the camera in the chain-like distribution; first The transmission module can be connected to multiple cameras and processors for information transmission between multiple cameras and processors; the processor can acquire multimedia data obtained from multiple cameras, and/or send to multiple cameras a control command; wherein the multimedia data includes at least one of the following: an image and a video; the control command is used to control multiple cameras to shoot according to predetermined parameters; a second transmission module is used to transmit information between the processor and an external system, Wherein, the external system is a system other than the image acquisition device for image acquisition. Through the image acquisition device of the embodiment of the present application, the purpose of using a plurality of fixed cameras to capture the moving picture of the framing lens by distributing a plurality of cameras in a chain is achieved, thereby improving the flexibility of the image acquisition device to acquire images. The technical effect also avoids the jitter generated in the image acquisition process, thereby solving the technical problem of low reliability of the video shooting equipment in the related art.

Description of drawings

The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The schematic embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation of the present application. In the attached image:

FIG. 1 is a schematic diagram of an image acquisition apparatus according to an embodiment of the present application;

FIG. 2 is a schematic diagram of an optional image acquisition apparatus according to an embodiment of the present application;

3 is a circuit diagram of an image acquisition device according to an embodiment of the present application;

4 is a schematic diagram of another image acquisition apparatus according to an embodiment of the present application;

5 is a circuit diagram of an optional image acquisition device according to an embodiment of the present application;

6 is a schematic sampling diagram of an image acquisition apparatus according to an embodiment of the present application;

7 is a schematic diagram of an image acquisition apparatus in a corridor scene according to an embodiment of the present application;

FIG. 8 is a schematic diagram of installation of an image acquisition device according to an embodiment of the present application;

9 is a structural diagram of an image acquisition apparatus according to an embodiment of the present application;

10 is a schematic diagram of an optional image acquisition apparatus according to an embodiment of the present application;

11 is a schematic diagram of a sampling manner of an image acquisition apparatus according to an embodiment of the present application;

12 is a schematic diagram of the distribution of cameras in an image acquisition device according to an embodiment of the present application;

13 is another structural diagram of an image acquisition apparatus according to an embodiment of the present application;

14 is a schematic diagram of an optional sampling manner of an image acquisition apparatus according to an embodiment of the present application;

15 is a schematic diagram of an image acquisition device arranged on a basketball court according to an embodiment of the present application;

16 is a schematic diagram of an application of an image acquisition device in a live broadcast according to an embodiment of the present application;

17 is a circuit diagram of an image acquisition device according to an embodiment of the present application when applied in a live broadcast;

18 is a schematic diagram of video sampling of an image acquisition apparatus according to an embodiment of the present application;

19 is a schematic diagram of a camera facing downwards in different directions in an image acquisition device according to an embodiment of the present application;

FIG. 20 is a schematic diagram of installation of an optional image acquisition apparatus according to an embodiment of the present application;

21 is a circuit diagram of an optional image acquisition device according to an embodiment of the present application;

22 is a schematic sampling diagram of an image acquisition apparatus according to an embodiment of the present application;

Fig. 23 is a schematic diagram of an image acquisition device disposed on a passenger car according to an embodiment of the present application;

24 is a schematic diagram of an image acquisition system according to an embodiment of the present application;

FIG. 25 is a schematic sampling diagram of an image acquisition system according to an embodiment of the present application.

detailed description

In order to make those skilled in the art better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only The embodiments are part of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the scope of protection of the present application.

It should be noted that the terms "first", "second", etc. in the description and claims of the present application and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that data so used may be interchanged under appropriate circumstances so that the embodiments of the application described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those expressly listed Rather, those steps or units may include other steps or units not expressly listed or inherent to these processes, methods, products or devices.

There are different problems with the video shooting devices used in the above-mentioned related technologies. For example, when shooting videos with a fixed camera, the captured video image area is fixed; when the camera moves to shoot videos, it is necessary to solve the problem of screen jitter. disadvantages to come.

In order to effectively overcome the above-mentioned defects, in the present application, a new image acquisition method is provided, which can realize the use of a fixed camera state to capture the moving picture of the framing lens, and make the shooting form more flexible and changeable. The image acquisition device and the image acquisition system provided in the present application will be described in detail below with reference to specific embodiments.

Example 1

According to an aspect of an embodiment of the present application, an image acquisition apparatus is provided. FIG. 1 is a schematic diagram of an image acquisition apparatus according to an embodiment of the present application. As shown in FIG. 1 , the image acquisition apparatus may include: a plurality of cameras 11 , The first transmission module 13, the processor 15 and the second transmission module 17,

The plurality of cameras 11 are distributed in a chain shape; each of the plurality of cameras 11 is configured with a unique identifier, and the identifier is used to indicate the position of the camera in the chain distribution.

The first transmission module 13 is used to connect the multiple cameras 11 and the processor 15, and is used to transmit information between the multiple cameras and the processor.

The processor 15 is configured to acquire multimedia data obtained by shooting from multiple cameras 11, and/or send control commands to the multiple cameras; wherein the multimedia data includes at least one of the following: images and videos; the control commands are used to control multiple cameras. Each camera shoots according to predetermined parameters.

The second transmission module 17 is used for information transmission between the processor 15 and an external system, wherein the external system is a system other than the image acquisition device.

As can be seen from the above, in the embodiment of the present application, an image acquisition device including a plurality of cameras, a first transmission module, a processor and a second transmission module is provided. In the image acquisition device, the plurality of cameras are chain-shaped distributed, and each camera in the multiple cameras is configured with a unique identifier, which is used to indicate the position of the camera in the chain distribution; the first transmission module can be connected to multiple cameras and processors for multiple cameras and processors. Information transmission is performed between the cameras and the processor; the processor can acquire multimedia data obtained by shooting from multiple cameras, and/or send control commands to the multiple cameras; wherein the multimedia data includes at least one of the following: image, video; the control command is used to control multiple cameras to shoot according to predetermined parameters; the second transmission module is used to transmit information between the processor and the external system, wherein the external system is a system other than the image acquisition device, which realizes the Distributing multiple cameras in a chain to use multiple fixed cameras to capture the moving pictures of the framing lens achieves the technical effect of improving the flexibility of image acquisition equipment to acquire images, and also avoids jitter during image acquisition. .

It is worth noting that, because in the embodiment of the present application, by continuously distributing a plurality of cameras in a chain,

Therefore, with the image acquisition apparatus of the embodiment of the present application, the problem of low reliability of the video shooting device in the related art can be solved.

In an optional embodiment, the first transmission module is a bus, and the bus is used to connect the image sensor unit of each camera and the transceiver unit of the processor, wherein the bus includes one of the following: TTL, RS485, IIC, high-speed IIC, SPI, 1-wire, m-lvds, b-lvds, CAN, FlexRay, 10BASE-T1S.

It can be seen from the above description that, in this embodiment of the present application, the first transmission module may be used to transmit information between multiple cameras and the processor. The type of the first transmission module is not specifically limited in this embodiment of the present application. The following description will be given by taking the first transmission module as a cable and a bus as an example.

In an optional embodiment, the first transmission module is a cable, wherein the cable at least includes: a data transmission line and a power supply line, the data transmission line is used for information transmission, and the power supply line is used for connecting the cable on the cable. The camera is powered on; a plurality of cameras are arranged on the cable at predetermined intervals, and the power supply line is used for power supply and the data transmission line is used for data transmission; and/or, the first transmission module is a bus, and the plurality of cameras are connected to the processor through the bus. , the image acquisition device is made as a whole, and the image acquisition device also includes a connection part, the connection part is used for detachable connection on the connection line, the second transmission module is used for information transmission with the external system through the connection line, and the external system At least one image acquisition device is connected in a detachable manner, and the connecting line is also used to supply power to the image acquisition device; and/or, the first transmission module is a bus, a plurality of cameras are connected to the processor through the bus, and the image acquisition device is made as one In general, the second transmission module is a wireless network module and/or a wired network module. In the case where the second transmission module includes a wired network module, the image acquisition device further includes a network interface, and the network interface is used to connect a cable connected to an external system.

It can be seen from the above embodiments that, on the one hand, when the first transmission module is a cable, the cable at least needs to include: a data transmission line and a power supply line, wherein the data transmission line is used for information transmission, and the power supply line is used for connecting the The camera on the cable is powered on; a plurality of cameras are arranged on the cable at predetermined intervals, and can use a power supply line for power supply and a data transmission line for data transmission.

FIG. 2 is a schematic diagram of an optional image acquisition apparatus according to an embodiment of the present application. As shown in FIG. 2 , the image acquisition apparatus may include: a cable and a sensor unit preset on the cable (ie, the camera 11 in the context) ); the cable may include a data transmission signal line (that is, a data transmission line) and a power supply line, and in order to improve safety, the cable may also include a common ground line; wherein, in this embodiment of the present application, multiple sensor units may follow 1.5 The separation distance of each meter is distributed, the prefabricated length is 305 meters of cable, and a total of 203 sensor units can be preset.

Wherein, the above-mentioned sensor unit may include one image sensor or multiple image sensors, and the image sensor unit and the processor unit perform data transmission through the bottom layer transmission unit; The data communication between the processor unit is used for the processor unit to control the sensor unit and to receive the frame image information collected by the sensor; usually the underlying transmission unit between the processor unit and the sensor unit is a TTL level bus, which directly transmits data through TTL level signals. Transmission; when the number of sensor units exceeds the maximum parallel transmission capability of the TTL level bus of the processor unit, the underlying transmission unit between the processor unit and the sensor unit includes the processor unit side transceiver and the sensor unit side transceiver. The sensor unit communicates with the processor unit through the underlying transmission bus.

In addition, the processor side transceiver and the sensor unit side transceiver are serial transceivers. The underlying transport bus is a bus topology transport bus. The transceiver on the processor side and the transceiver on the sensor unit side are connected on the same bus topology transmission bus. Bus-type topology transmission bus optional communication standards include RS485, IIC, high-speed IIC, SPI, 1-wire, m-lvds, b-lvds, CAN, FlexRay, 10BASE-T1S, and support for higher speed and easier expansion in the future. The serial bus standard of the node.

In addition, the upper-level transceiver unit of the image acquisition end is configured for data communication between the image acquisition device and the external control device, and the image acquisition device receives the control command of the external control device and sends the frame to the external control device through the upper-level communication transceiver. Image information, message data; external control devices are control devices or servers.

The upper-level transceiver unit at the image acquisition end is a serial transceiver, which is connected to the bus-type topology transmission bus.

FIG. 3 is a circuit diagram of an image acquisition device according to an embodiment of the present application. As shown in FIG. 3 , the image acquisition device includes: n sensor units, n LED lights, n+1 underlying transceivers (RS485 transceivers), and a processor unit, RS485 bus and 2 upper-level transceivers on the acquisition side (USB transceiver and WCDMA communication transceiver); each sensor unit is configured with a low-level transceiver and an LED light; the processor unit is configured with a low-level transceiver and 2 upper-level transceivers on the acquisition side.

It should be noted that, in the embodiment of the present application, when laying a cable, the cable can be cut according to the actual required laying length. As shown in FIG. 3 , two ends of the data transmission signal line of the cable can be connected to one 120Ω pull-up resistor, and connect with the processor unit at one end of the cable; the processor unit communicates with the cloud server through the WCDMA cellular network, and the cloud server contains the driver of the acquisition device, which can realize the control of the image acquisition device ; In addition, the processor can also communicate with the local server through the USB transceiver, and accept the control of the server.

Exemplarily, in a specific application scenario, on-site use can be achieved through the following steps: (1), power on and stand by; (2), the cloud server sends an acquisition instruction to the acquisition device through the WCDMA communication line; (3), the processor unit executes instruction, and receive the frame image information collected by each sensor unit one by one; (4), the processor unit forwards the received frame image information to the server.

In addition, it should be noted that, in this embodiment of the present application, the cloud server may be set to poll the sensor units on the cable to obtain frame image information at a predetermined frequency, for example, 10 minutes/time, 5 hours/time, 1 day/time, 1 week/time, 1 month/time, etc.

In addition, in order to improve the data bandwidth usage intensity, the RS485 bus can be replaced with a 1-wire transmission bus with a lower bandwidth to reduce the number of wires in the cable.

Because the cable structure is relatively simple and easy to lay, it can be used in non-full real-time monitoring scenarios such as elevator shafts, underground pipes, mines, and breeding ponds.

On the other hand, when the first transmission module is a bus, a plurality of cameras are connected to the processor through the bus, the image acquisition device is made as a whole, and the image acquisition device further includes a connection part, and the connection part is used for detachable connection to the processor. On the connection line, the second transmission module is used for information transmission with an external system through the connection line, the external system is detachably connected to at least one image acquisition device, and the connection line is also used for supplying power to the image acquisition device.

Specifically, the transmission bus may be a bus-type data communication rail, and the bus-type data communication rail may include two data transmission signal lines, a power supply line, a common ground line and a plug-in interface; in addition, the bus-type data communication rail also includes Includes mounting rails. Wherein, the base material of the bus-type data communication rail strip can be a flexible material, which is convenient for the arrangement of different on-site scenarios. The length of the bus-type data communication rail is set to 30 meters, and a plug interface is set at every 4cm interval, with a total of 750 plug interfaces, which are used for the plug connection of the sensor unit.

In this embodiment, the image acquisition device may be configured with 6 cameras, 3 LED fill lights, 1 TF card slot and 1 data communication connection plug; It is used for quick butt-joint installation and fixation with the guide rail; wherein, the length of the image acquisition device can be 0.12 meters, and the center distance of the six image sensors can be 0.02 meters.

In addition, in the embodiment of the present application, the control device is equipped with two WI-FI transceiver antennas, one data communication connection plug and one external power supply plug.

FIG. 4 is a schematic diagram of another image acquisition apparatus according to an embodiment of the present application, as shown in FIG. 4 . As shown in FIG. 4 , the image acquisition apparatus may include a sensor unit, a transmission bus, and a control apparatus. The image acquisition device is suitable for permanent fixed scenes.

FIG. 5 is a circuit diagram of an optional image acquisition device according to an embodiment of the present application. As shown in FIG. 5 , a control device, two 120Ω pull-up resistors and 250 acquisition devices with a length of 12 cm can be installed on the rail.

In addition, as shown in FIG. 5, the sensor unit may be a star topology image sensor node module, including 6 image sensors, an upper-level transceiver (RS485 transceiver) at the acquisition end, a bottom-level transmission unit (TTL level bus), A processor unit, a socket for inserting a MicroSD memory card, a plug for docking with a bus-type data communication rail, and three LED lights for supplementary light.

Among them, the processor unit in the image acquisition device is connected with 6 image sensors through a TTL level bus, and sends control information to the image sensors and receives frame image information collected by the image sensors.

In addition, after the image acquisition device receives the frame image acquisition instruction sent by the control device through the RS485 transceiver, the processor unit starts to receive the frame image information collected by the image sensor, and processes the frame image information. Add the address stamp information and timestamp information of the frame image. The processor unit transmits the processed frame image information to the MicroSD memory card for storage through the SPI interface. The processor unit edits the real-time frame image information into a low-resolution and low-quality image, and sends the low-resolution and low-quality image information to the control device in real time through the RS485 transceiver.

After the image acquisition device receives the frame image request instruction sent by the control device through the RS485 transceiver, the processor unit extracts the frame image information in the MicroSD memory card according to the request instruction, and sends it to the control device through the RS485 transceiver. After the frame image file in the MicroSD memory card is received by the control device, the processor unit deletes the extracted frame image file in the MicroSD to release the storage space of the MicroSD card.

As shown in Figure 5, the control device includes a lower-level transceiver (RS485 transceiver) at the control end, a controller unit, an upper-level transceiver (WI-FI transceiver) at the control end, and a control device for docking with the bus-type data communication rail. plug. The controller unit of the control device controls each acquisition device on the bus and receives frame image files through the RS485 serial communication transceiver. The control device performs data communication with the server in this embodiment through the WI-FI transceiver, receives control instructions from the server and sends stored frame image information to the server.

It should be noted that, in the process of on-site arrangement, the bus-type data communication rails can be fixed according to the actual shooting requirements, and the extra length of the rails can be cut out, and can be hidden and placed on site. After the guide rail is fixed, a control device is installed at one end of the guide rail, and the docking plug of the control device is docked with the socket of the rail strip; the sockets at both ends of the rail are respectively plugged with 120Ω pull-up resistors; multiple sensor units are installed on the rail strip in sequence, and the sensors The plugs of the unit are connected with the sockets on the guide rail in turn.

In addition, for the image acquisition device, after the control device receives the frame image acquisition instruction sent by the server through the WI-FI channel, the controller unit of the control device controls each acquisition device connected to the bus-type data communication rail through the RS485 transceiver to start Frame image acquisition and storage operations; the control device sequentially performs focus control, LED fill light, image sensor sleep and working state conversion, clock synchronization and other control operations on each image sensor through the bus-type data communication channel, so as to realize the predetermined frame image. Collection effect.

Further, after the control device receives the frame image stop acquisition instruction sent by the server through the WI-FI channel, the controller unit of the control device controls each acquisition device connected to the bus-type data communication rail through the RS485 transceiver to stop the frame image. acquisition and storage operations.

After the control device receives the frame image request instruction sent by the server through the WI-FI channel, the controller unit of the control device communicates with each acquisition device connected to the bus-type data communication rail through the RS485 transceiver in turn and requests the acquisition device Frame image information stored in the MicroSD memory card. After the frame image information stored in the MicroSD memory card is extracted by the processor unit in the image sensor, the processor unit in the acquisition device sends the extracted frame image information to the control device through the RS485 transceiver. After the control device receives the frame image information sent by the image acquisition device, the controller unit in the control device forwards the frame image information to the server through the WI-FI channel. After the frame image information in the MicroSD memory card is extracted, the frame image information in the memory card is deleted to release storage space.

It should be noted that the frame image information is added with address stamp information and time stamp information, and the frame image information cluster stored in the server can be virtually mapped to a two-dimensional mapping table as shown in the figure. FIG. 6 is a schematic sampling diagram of an image acquisition device according to an embodiment of the present application. As shown in FIG. 6 , the vertical direction is the address stamp order, followed by a1 sensor, a2 sensor, and a250 sensor; the horizontal direction is the time stamp order, followed by T1 frame time , T2 frame time...; Here Line1, Line2, Line3, Line4, Line5, and Line6 are the 6 video sampling lines in the 6 post-editing process. For example, set the video sampling frame rate to 30 frames per second, and the acquisition time frequency T of the image frame to be 30 frames per second; Line1 is the rule that the time stamp and the address stamp are synchronously progressive to sample the video, which can generate a lens that moves with each banknote. The rendering effect of 0.6m framing (the center distance of the image sensor is 0.02m*30 frames/second); Line2 is the video sampling according to the address stamp jump sampling rule, which can generate a rendering effect of the lens moving 1.2m per second; Line3 is the address Stamping the unchanging sampling rules for video sampling can generate the presentation effect of still shot framing; Line4 can generate the presentation effect of a slow-moving lens framing with the lens moving 0.2 meters per banknote; Line5 is based on timestamp jumping and moving sampling rules for video sampling , which can generate a 4x time fast-forward rendering effect; Line6 can generate a rendering effect that includes a reverse time sequence.

In addition, it should be noted that, in the embodiments of the present application, a modular splicing method is used for the on-site arrangement, and different shooting effects can be achieved by splicing different modules. The image acquisition device in this embodiment may be of a 6-mirror type. If a 3-mirror type of image acquisition device is installed, video sampling is performed according to the rule of synchronous progress of time stamps and address stamps, and a lens moving 1.2 meters per second can be generated. Viewing rendering effect (image sensor center distance is 0.04 meters * 30 frames per second); if a 2-mirror image acquisition device is installed, video sampling is performed according to the rule of time stamp and address stamp synchronous progression, which can generate a lens that moves 1.8 per second The framing effect of meters (the center distance of the sensor is 0.06 meters * 30 frames/second); if a 1-mirror acquisition device is installed, the video sampling is performed according to the rule of time stamp and address stamp synchronous progress, which can generate a lens that moves 3.6 per second. The framing effect of meters (the center distance of the sensor is 0.12 meters * 30 frames/second); Similarly, one or more vacancies are spaced out during the installation of the acquisition device, which can generate a faster lens movement framing effect. For example, install 6-mirror, 3-mirror, 2-mirror, 1-mirror, one-space-one-mirror, and two-space-one-mirror acquisition devices in sequence from one end of the transmission signal line to the other. The video sampling is performed according to the synchronous and progressive rule of the address stamp, which can generate a framing effect in which the lens moves gradually with increasing speed.

Exemplarily, in a specific application scenario, on-site use can be implemented through the following steps: (1), the control device is powered on and standby; (2), after receiving the frame image acquisition start instruction sent by the server through the WI-FI channel, the control device Each acquisition device connected to the bus is controlled by the RS485 transmission bus to start the acquisition and storage of the frame image; (3), after receiving the frame image acquisition end instruction sent by the server through the WI-FI channel, the control device is connected by the RS485 transmission bus control connection Each acquisition device on the bus ends the acquisition of the frame image; (4), after receiving the frame image extraction instruction sent by the server through the WI-FI channel, the control device controls each acquisition device connected to the bus through the RS485 transmission bus to start extracting The frame image information on the MicroSD memory card, the frame image information is sent to the control device through the RS485 transmission bus, and the control device forwards the extracted frame image information to the server through the WI-FI channel. After the frame image information transmission is completed, the acquisition device deletes the storage The frame image information, the server stores the received frame image information; (5), after receiving the frame image extraction end instruction sent by the server through the WI-FI channel, the control device stops extracting the frame image information in the acquisition device; (6), The control unit is de-energized.

In addition, in the embodiment of the present application, the process of later video editing may be the following steps: (1), obtaining frame image virtual mapping table information; (2), selecting a video frame image sampling rule; (3), according to the selected (4), synthesizing the extracted frame images into a video; (5), outputting a synthesized video file.

In this embodiment, the process of acquiring and real-time storage of frame image information is used in the early stage, and the transmission process of frame image information is performed in the later stage, and the process is stored in the TF memory card on the acquiring device in real time.

The application of the image acquisition device in this embodiment can effectively avoid shaking during the shooting process, and can realize shooting special effects such as "push-pull panning" in the early-stage shooting process in the later editing process, and can also easily realize "one mirror to the end" and other shooting effects. A highly technically difficult shooting technique.

It can be seen from the above that the image acquisition device in the embodiment of the present application can be widely used in various professional shooting scenes, such as wedding corridor scenes, and can be arranged according to any required trajectory on the shooting site, and can easily realize looking down, looking around, looking up, etc. Head-up, tracking and other video frame acquisition effects and fast switching of various effects, good site layout can also reproduce the drone shooting effect infinitely according to the predetermined trajectory. During the on-site layout process, the device of the embodiment of the present application can be wrapped with decorations to avoid affecting the beauty of the viewfinder, and the side and back of the device of the embodiment of the present application can also be set to green, which is convenient for the image keying operation in the post-production process. The device of this embodiment is cut out of the video of the user, so as to realize the special requirements of some video production. FIG. 7 is a schematic diagram of an image acquisition device in a corridor scene according to an embodiment of the present application, and decorations may be provided outside the image acquisition device to avoid affecting the beauty of the viewfinder.

In addition, the first transmission module is a bus, a plurality of cameras are connected to the processor through the bus, and the image acquisition device can also be made as a whole, the second transmission module is a wireless network module and/or a wired network module, in the second transmission module In the case of including a wired network module, the image acquisition apparatus further includes a network interface, and the network interface is used to connect a cable connected to an external system.

FIG. 8 is a schematic diagram of installation of an image acquisition apparatus according to an embodiment of the present application. As shown in FIG. 8 , it is a schematic diagram of simple installation, which is suitable for a small temporary scene. As shown in FIG. 8 , the image acquisition device also includes 6 image sensors (ie, sensor units), 2 upper-level transceivers at the acquisition end (WI-FI wireless transceiver and USB transceiver), and 2 foldable wireless transceiver antennas. , USB socket, battery module, NADN FLISH storage unit, processor unit, power switch key, 2 input keys, digital segment code screen and magnetic base; among them, the USB socket can be used for battery module charging and can be connected to USB HUB Form a chain of image acquisition shots in a star or tree topology. The above two input keys and digital segment code screen can be used to set and display the sequence code of the image capture device, the installation sequence of the image capture device during on-site arrangement, and the address stamp arrangement sequence during video sampling. In this embodiment, the server has a built-in driver program for the image acquisition device, which can directly drive the acquisition device, so no control device is provided.

Among them, the above-mentioned magnetic base can be used for quick installation during on-site layout, which is convenient for quick installation and disassembly on the temporary site, and other devices such as quick velcro or double-sided tape can also be used to replace the magnetic base to realize the function of quick disassembly.

9 is a structural diagram of an image acquisition device according to an embodiment of the present application. In this embodiment, the on-site use steps of the image acquisition device may be as follows: (1) The image acquisition device receives the power-on message sent by the mobile phone through the WI-FI channel. After the instruction, end the dormancy state and enter the standby state; (2), after the image acquisition device receives the frame image acquisition start instruction sent by the mobile phone through the WI-FI channel, the processor unit starts to receive the frame image information collected by the image sensor; (3), the processor unit processes the received frame image information, and adds the address stamp information and time stamp information of the frame image in the frame image information; (4), the processor unit sends the processed frame image information Store in the NADN FLISH storage unit; (5), after the image acquisition device receives the frame image acquisition stop instruction sent by the mobile phone through the WI-FI channel, the processor unit stops receiving and processing the frame image information collected by the image sensor; ( 6) After the image acquisition device receives the frame image extraction instruction sent by the mobile phone through the WI-FI channel, the processor unit starts to extract the frame image information on the NADN FLISH storage unit, and the frame image information is sent to the mobile phone through the WI-FI channel, and the mobile phone passes through the WI-FI channel. The cellular network uploads to the cloud storage server; (7), after receiving the frame image extraction end instruction sent by the mobile phone through the WI-FI channel, stop extracting the frame image information in the acquisition device; (8), the image acquisition device receives the mobile phone through After the shutdown command sent by the WI-FI channel, it enters the sleep state.

In addition, FIG. 10 is a schematic diagram of an optional image acquisition device according to an embodiment of the present application. In this embodiment, the on-site use of the image acquisition device can also be as follows: (1), USB and HUB are powered on, and each image acquisition device is powered on. Power on and stand by; (2), after the image acquisition device receives the frame image acquisition start instruction sent by the server through the USB channel, the processor unit starts to receive the frame image information collected by the image sensor; (3), the processor unit receives The frame image information is processed, and the address stamp information and time stamp information of the frame image are added in the frame image information; (4), the processor unit sends the processed frame image information to the NADN FLISH storage unit for storage; ( 5), after the image acquisition device receives the frame image acquisition stop instruction sent by the server through the USB channel, the processor unit stops receiving the frame image information collected by the image sensor; (6), the image acquisition device receives the server through the USB channel. After the frame image extraction instruction, the processor unit starts to extract the frame image information on the NADN FLISH storage unit, and the frame image information is sent to the server through the USB channel; (7), after receiving the frame image extraction end instruction sent by the server through the USB channel, stop Extract the frame image information in the acquisition device; (8), the USB and HUB are powered off, and each image acquisition device is powered off.

It should be noted that, in a temporary small scene, you can first use the WI-FI channel to control the acquisition device to perform the frame image acquisition process. After the temporary shooting task is over, remove the acquisition device and connect it to the USB HUB for charging. During the charging process , and use the USB channel to perform the extraction and transmission process of frame image information to the acquisition device.

In the embodiment of the present application, the process of acquiring and real-time storage of frame image information is performed in advance, and the transmission process of frame image information is performed in the later stage, which is stored in the NADN FLISH storage unit built in the acquiring device in real time.

FIG. 11 is a schematic diagram of a sampling method of an image acquisition device according to an embodiment of the present application. As shown in FIG. 11 , the video sampling adopts the same time stamp sampling rule and the skip time stamp sampling rule, and can present time-still look-around and ultra-slow-motion look around video effect.

12 is a schematic diagram of the distribution of cameras in an image acquisition device according to an embodiment of the present application, wherein an image acquisition lens chain with a length of 3 meters may have 100 lenses, and an image acquisition lens chain with a length of 1.5 cm may have 50 camera lenses. A lens chain can have 20 camera lenses for a 0.6 cm figure. Among them, one end of the image acquisition lens chain will contain an Ethernet port and a power socket.

FIG. 13 is another structural diagram of an image acquisition device according to an embodiment of the present application. As shown in FIG. 13 , each group of image acquisition lens chains includes multiple acquisition devices, a control device, and two sets of bus-type data communication cables (RS485 data transmission bus and CAN data transmission bus).

As shown in FIG. 13 , the image acquisition device may include an image sensor CMOS, a processor unit, a first upper-level transceiver (RS485 transceiver) at the acquisition end, and a second upper-level transceiver (CAN transceiver) at the acquisition end. The RS485 transceiver is configured to transmit frame image information with the control device, and the CAN transceiver is configured to transmit instruction data to the control device or other acquisition devices. The CAN data bus is a non-host transmission bus, each node can send data information to other nodes without forwarding through the bus host.

Among them, after the image acquisition device receives the frame image low-quality acquisition instruction sent by the control device through the RS485 transceiver, the processor unit processes the frame image information collected by the image sensor, reduces the image quality, and adds the frame image information to the frame image information. Address stamp information and time stamp information of the frame image. The processor unit sends the processed low-quality frame image information to the control device through the RS485 transceiver.

In addition, after the image acquisition device receives the frame image high-quality acquisition instruction sent by the control device through the RS485 transceiver, the processor unit processes the frame image information collected by the image sensor, and adds the frame image address to the frame image information. Stamp information and timestamp information. The processor unit sends the processed high-quality frame image information to the control device through the RS485 transceiver.

Further, the image acquisition device sends the focus control, ISO, frame pixel dynamic change message data of the image sensor to the control device through the CAN transceiver; the image acquisition device receives the focus control threshold instruction sent by the control device, ISO threshold command and clock command, trim the focus control value and ISO value of the image sensor according to the received command; the image acquisition device sends the message data of focus control and ISO to the adjacent image sensor through the CAN transceiver; the image acquisition device passes the The CAN transceiver receives the focus control and ISO messages sent by the adjacent acquisition device, trims the focus control value and ISO value of the image sensor according to the received focus control and ISO messages, and realizes the frame image acquired by the adjacent acquisition device Consistent focus control and ISO.

The above-mentioned control device may include a controller unit, two lower-level transceivers at the control end (RS485 transceiver and a CAN transceiver), and one upper-level transceiver (100Base-T Ethernet transceiver) at the control end.

In addition, the control device can poll the connected image acquisition devices through the RS485 transceiver and send low-quality frame image acquisition instructions. After receiving the low-quality frame image information sent by the acquisition device through the RS485 transceiver, the received low-quality frame image information Quality frame image information is sent to the server via a 100Base-T Ethernet transceiver.

The control device can also receive the high-quality frame image acquisition instruction of the server through the 100Base-T Ethernet transceiver, and send the high-quality frame image acquisition instruction to the acquisition device of the address corresponding to the instruction through the RS485 transceiver. The control device, after receiving the high-quality frame image information sent by the acquisition device through the RS485 transceiver, sends the received high-quality frame image information to the server through the 100Base-T Ethernet transceiver. The high-quality frame image acquisition instruction is generated by the server after intelligently analyzing the low-quality frame image information and the frame pixel dynamic change message, and determining the tracked target. The high-quality frame quality acquisition instruction may include multiple acquisition device addresses to achieve high-quality frame image information acquisition for multiple tracking targets.

In another example, the control device can send a clock instruction to each connected acquisition device through the CAN transceiver, so as to realize the clock consistency of each acquisition device and the consistency of the timestamps of the generated frame images. The control device receives the message of focus control and ISO of each acquisition device through the CAN transceiver, sets the focus control threshold and ISO threshold value of each image sensor in the adjacent area of the image sensor according to the message, and sends and receives through CAN sent to the corresponding acquisition device. The control device receives the frame pixel dynamically changing message of each acquisition device through the CAN transceiver, and sends the received frame pixel dynamically changing message to the server through the 100Base-T Ethernet transceiver.

Further, after the target tracking task is completed, the low-quality frame image information received by the server is cleared and overflowed, and is no longer stored.

As shown in FIG. 14 , the image information for which the target tracking task has been completed is invalid image information, the curve segment with arrows is the video sampling line, and the frame image is attached to the video sampling line.

Exemplarily, the high-quality frame image information received by the server in this embodiment of the present application is added with address stamp information and time stamp information, and the frame image information cluster stored in the server can be virtually mapped to the two-dimensional image shown in FIG. 14 . Mapping table. Most of the grids in the mapping table are missing frames because the frame image information is overflowed because they do not have corresponding high-quality frame image information. There can be multiple virtual mapping tables, such as corresponding images The mapping table a of the acquisition device corresponds to the mapping table b of the image acquisition system, and corresponds to the mapping table c of the image acquisition device. As shown in the two-dimensional mapping table a, the address stamps are sorted vertically, followed by a1 sensor, a2 sensor, and a250 sensor. The horizontal order is the timestamp, followed by T1 time, T2 time... . Due to the bandwidth limitation of the bus topology data bus, it is impossible to transmit and collect all the frame image information of all the image sensors in real time. Therefore, the two-dimensional mapping table contains a large number of missing frames that do not store the frame image information. The frame image information existing in the 2D mapping table is actively obtained according to the optimal tracking path obtained by the server through real-time intelligent analysis. As shown in the figure, the video sampling adopts the rule with the shortest moving distance of the camera lens, and try to avoid the camera lens of the video. Shake too much.

The on-site use steps in this embodiment are: (1), the image acquisition system is powered on and standby; (2), after receiving the low-quality frame image acquisition start instruction sent by the server through the 100Base-T Ethernet channel, the control device transmits the data through RS485 Each acquisition device in the bus control system starts the collection and transmission of low-quality frame images; (3), after the control device receives the low-quality frame image information containing address stamps and time stamps sent by each acquisition device through the RS485 transmission bus, it will The received low-quality frame image information is sent to the server through the 100Base-T Ethernet channel; (4) After the frame pixel dynamic change message sent by each acquisition device through the CAN transmission bus received by the control device, the received message The information is sent to the server through the 100Base-T Ethernet channel; (5) After the control device receives the high-quality frame image acquisition instruction sent by the control device, it sends the high-quality frame image acquisition instruction through the RS485 transmission bus to the address corresponding to the instruction. device, the high-quality frame image acquisition instruction is generated by the server after intelligently analyzing the low-quality frame image information and frame pixel dynamic change messages to determine the tracked target; (6), the control device receives the high-rate frame image After the acquisition device corresponding to the acquisition instruction transmits the high-quality frame image information sent by the RS485 bus, it sends the received high-quality frame image information to the server through the 100Base-T Ethernet channel; (7), the control device transmits the high-quality frame image information through the 100Base-T Ethernet channel. After the network channel receives the frame image acquisition end instruction sent by the server, the control device controls each acquisition device connected to the bus to complete the frame image acquisition and transmission through the RS485 transmission bus; h, the image acquisition device is powered off.

Another control step of the image sensor in this embodiment is: (1), adaptively configure the focal length and ISO parameters after the acquisition device is powered on; (2), the acquisition device sends the currently configured focus control and ISO parameters to the control device through the CAN transmission bus Parameter message; (3), the acquisition device sends the currently configured focus control and ISO parameter message to the adjacent acquisition device through the CAN transmission bus; (4), the acquisition device receives the focus sent by the adjacent acquisition device through the CAN transmission bus. control and ISO parameter messages; (5), the acquisition device trims the currently configured focus control and ISO parameters within a predetermined threshold range through the received focus control and ISO parameter messages of the adjacent image sensor; (6), Receive the focus control and ISO configuration instructions sent by the control device through the CAN transmission bus, and trim the currently configured focus control and ISO parameters through the received focus control and ISO configuration instructions. The focus control and ISO configuration instructions are provided by the server. Generated by determining the tracking target; (7) the acquisition device sends the modified focus control and ISO parameter messages to the control device and the adjacent acquisition device respectively through the CAN transmission bus.

The process of real-time video collection and editing in this embodiment may be: (1), obtaining frame image virtual mapping table information; (2), selecting the video frame image sampling rule with the shortest lens movement distance; (3), according to the selected video frame The frame image is extracted according to the image sampling rule; (4), the extracted frame image is synthesized into a video data stream; (5), the synthesized video data stream is output.

During the on-site layout process, select the appropriate length of the image acquisition lens chain according to the actual needs, fix it at the scene suitable for shooting, and connect the power cable and the Ethernet cable. Multiple image acquisition lens chains are connected to the server through the switch.

15 is a schematic diagram of an image acquisition device arranged on a basketball court according to an embodiment of the present application, through which the basketball game can be broadcast in real time; the image acquisition device can perform real-time tracking and focus shooting of each basketball player and basketball at any time, and The wonderful tracking shots of each athlete can be presented to the behind-the-scenes schedulers in real time for live broadcast shot switching.

In this embodiment, low-quality frame images are acquired and transmitted in real time, and only real-time transmission of high-quality frame images is performed on the tracked object, and the image acquisition device does not store frame image information; frame image data transmission and instruction transmission are respectively performed through two sets of transmission buses, Maximize the use of transmission channel bandwidth to avoid control command delay caused by full load congestion of a single transmission channel bandwidth, and to avoid the problem of poor coherence of captured images.

The image acquisition device in this embodiment can be widely used in various sports venues and play activity venues, and by tracking the target, tracking and shooting of multiple targets can be realized.

In addition, the image acquisition lens chain in this embodiment integrates the acquisition device, the control device and the transmission bus, which is convenient for installation in special application scenarios. For example, the waterproof sealing of the integrated device can be applied to shooting in water sports venues to realize continuous lens shooting on water and underwater. For example, a complete tracking video of a diver's diving process can be easily achieved, which is difficult to achieve with current shooting equipment.

In an optional embodiment, multiple cameras are distributed on multiple chains, wherein each of the multiple chains is provided with at least one camera, and there are one or more processors, wherein the processor In the case of one, it is connected to multiple cameras, and in the case of multiple processors, the processor is connected to the cameras on one or more chains, and is used to control the cameras of the chain.

16 is a schematic diagram of the application of an image acquisition device in a live broadcast according to an embodiment of the present application. Through the settings of the image acquisition device in the live broadcast, the live broadcast angle can be switched at a high speed to bring a better live presentation effect to the audience; from the appearance In the above, the image acquisition device can be a camera matrix composed of 300 cameras, and a curved surface with an arc length of 3 meters is distributed with 10 lines of camera chains, and each line of camera chains has 30 cameras.

Fig. 17 is a circuit diagram of an image acquisition device according to an embodiment of the present application when it is applied in a live broadcast. As shown in Fig. 17 , multiple groups of image acquisition devices and a server group are connected for data through a 1000BASE-T Gigabit Ethernet network. The server group drives and controls the image acquisition device through the built-in driver program of the image acquisition device.

Each group of image acquisition devices can include 30 sensor units, 1 processor unit, storage unit, acquisition-side upper-level transceiver (1000BASE-T Gigabit transceiver) and bottom-level transmission unit (31 M-LVDS quad transceivers) and M-LVDS high-speed bus backplane). The storage unit may be a volatile RAM memory, which is configured to coordinate to provide a temporary cache for frame image information waiting to be transmitted in the case of bandwidth congestion.

In addition, after the image acquisition device receives the frame image acquisition instruction sent by the server, the processor unit processes the frame image information collected by the image sensor unit, and adds the address stamp information and time stamp information of the frame image to the frame image information. ; The processor unit sends the processed frame image information to the server through the 1000BASE-T gigabit transceiver.

The on-site use steps of the image acquisition device of this embodiment are: (1), the image acquisition device is powered on and standby; (2), after receiving the frame image acquisition start instruction sent by the server group through the 1000Base-T Ethernet channel, the processor unit Receive the frame image information collected by each sensor unit through the M-LVDS four-way high-speed transmission bus; (3), the processor unit processes the received frame image information, and adds time stamp information and address stamp information of the corresponding acquisition device; ( 4), send the frame image information including time stamp information and address stamp information to the server group through the 1000Base-T Ethernet channel; (5), receive the frame image collection end command sent by the server group through the 1000Base-T Ethernet channel After that, the processor unit ends the acquisition and transmission of the frame image; (6), the image acquisition device is powered off.

Also, in this embodiment, the image acquisition means acquires the real-time transmission frame image information in real time, but, likewise, does not store the image information.

18 is a schematic diagram of video sampling of an image acquisition device according to an embodiment of the present application. In this embodiment, the server receives high-quality frame image information in real time, and the high-quality frame image information is added with address stamp information and time stamp information, The server group can receive a group of frame image information clusters on the same time frame, and the image information clusters on each time frame can be virtually mapped to the mapping table shown in Figure 18; according to different frame times, there can be multiple two-dimensional virtual mapping tables For example, T1, T2, and T3 correspond to the two-dimensional virtual mapping table of the first time frame, the two-dimensional virtual mapping table of the second time frame, and the two-dimensional virtual mapping table of the third time frame, respectively. The horizontal a, b, and c of each two-dimensional virtual mapping table represent the order of the acquisition device, and the

vertical direction

1, 2, and 3 correspond to the order of the lenses in the acquisition device. As shown in the figure, a, b, c, and d correspond to the acquisition device respectively. Device a, acquisition device b, acquisition device c, acquisition device d, etc., 1, 2, 3, and 4 correspond to the No. 1 lens, No. 2 lens, No. 3 lens, No. 4 lens, etc. on the sensor unit chain of the acquisition device, respectively. As shown in the figure, three different video sampling lines are used at the same time, which can achieve the presentation effect of three cameras on the same screen.

In an optional embodiment, the multiple cameras are cameras of the same type or cameras of different types, and/or the orientations of the multiple cameras are the same or different.

FIG. 19 is a schematic diagram showing different orientations of cameras in an image acquisition device according to an embodiment of the present application. As shown in FIG. 19 , the image acquisition device may include 12 forward-facing cameras, 6 left-facing cameras, and 6 right-facing cameras. , 3 left-facing wide-angle cameras, 3 right-facing wide-angle cameras, M-LVDS plug and power plug.

Based on the structural settings of the above image acquisition device, it can have five framing lens chains, namely forward framing chain, left framing chain, right framing chain, left wide-angle framing chain, and right wide-angle framing chain. In actual use During the process, a certain camera viewfinder chain can be selectively turned on and off, and the camera viewfinder chain can be disassembled and assembled according to the actual shooting needs.

FIG. 20 is a schematic diagram of the installation of an optional image acquisition device according to an embodiment of the present application. As shown in FIG. 20 , the image acquisition device can be installed on a hub backplane configured with an M-LVDS high-speed bus. Acquire the same type of lens of the device to splicing multiple camera viewfinder chains. There are M-LVDS high-speed bus wiring harnesses and auxiliary M-LVDS sockets and power sockets on each hub backplane, and 20 groups of image acquisition devices can be installed on each hub backplane.

FIG. 21 is a circuit diagram of an optional image acquisition device according to an embodiment of the present application. As shown in FIG. 21 , each group of image acquisition devices may include a control device, multiple acquisition devices, and a group of four-way M-LVDS high-speed bus .

Wherein, the image acquisition device may include: an image sensor, an upper-level transceiver (M-LVDS quad transceiver) at the acquisition end, a processor unit and a NADN FLISH storage unit. After the image acquisition device can receive the frame image acquisition instruction sent by the control device through the M-LVDS four-way transceiver, the processor unit processes the frame image information collected by the image sensor, and adds the address of the frame image to the frame image information. Stamp information and time stamp information, the processed frame image information is stored in the NADN FLISH storage unit.

In addition, after the image acquisition device can receive the frame image request instruction sent by the control device through the M-LVDS quad transceiver, the processor unit extracts the frame image information in the NADN FLISH storage unit according to the request instruction, and transmits the frame image information in the NADN FLISH storage unit through the M-LVDS quad The transceiver transmits to the control device.

The control device shown in FIG. 21 includes a lower-level transceiver at the control end (M-LVDS quad transceiver 1), an upper-level transceiver at the control end (M-LVDS transceiver 2), and a controller unit. The controller unit of the control device controls each connected image acquisition device through the M-LVDS quad transceiver 1 and receives the frame image file sent by the acquisition device; the control device communicates with the server through the M-LVDS quad transceiver 2 , receive the server's control instructions and send frame image information to the server.

In this embodiment, the acquisition and real-time storage process of frame image information is carried out in the early stage, and the transmission process of frame image information is carried out in the later stage. Send the acquisition start instruction of the frame image to each acquisition device connected to the bus through the M-LVDS four-way high-speed transmission bus; (2), the image acquisition device starts the acquisition and storage of the frame image after receiving the frame image acquisition start instruction; (3), after the control device receives the frame image acquisition end instruction sent by the server, the control device sends the frame image acquisition end instruction to each connected acquisition device; (4), the acquisition device ends the frame image acquisition end instruction after receiving the frame image acquisition end instruction Image acquisition and storage; (5), after the control device receives the frame image extraction instruction sent by the server, the control device sends the frame image extraction instruction to each connected acquisition device; (6), after the acquisition device receives the frame image extraction instruction , start the extraction of the frame image; (7), the processor unit of the acquisition device extracts the frame image information from the NADN FLISH storage unit, and forwards it to the control device; (8), after the control device receives the frame image information, it forwards and sends to the server.

FIG. 22 is a schematic sampling diagram of an image acquisition device according to an embodiment of the present application. As shown in FIG. 22 , the server in this embodiment receives frame image information after completing the acquisition task, and the frame image information is added with address stamp information and Timestamp information, each group of image acquisition devices has different types of camera framing chains. For example, in image acquisition device a, a1-a3 is a left-direction wide-angle viewfinder chain, a4-a6 is a right-direction wide-angle viewfinder chain, a7-12 is a left-direction viewfinder chain, a13-a18 is a right-direction viewfinder chain, and a19-a30 is a forward direction framing chain. In the process of editing video sampling, it is necessary to splicing the same type of framing chain to obtain a smooth video presentation effect. As shown in Figure 22, after acquiring the device d30 in the vertical framing chain, the splicing is e19, not e1 framing lens.

As shown in Figure 22, during the bi-line sampling process, different 3D VR video output effects can be achieved by locking different lens distances.

Fig. 23 is a schematic diagram of an image acquisition device installed on a passenger car according to an embodiment of the present application. As shown in Fig. 23, one side of the passenger car is transformed into four sets of camera backboards that can be folded and retracted; The centralized backplane is arranged in the studio of film and television for indoor shooting tasks in film and television shooting.

Through the image acquisition device, multi-angle real-time shooting can be achieved in the process of film and television shooting, the work of the cameraman can be transferred to the later video sampling and editing, and the difficulty of shooting tasks can be simplified, and the diversity of shooting and framing effects can be presented.

Operations that can be performed by the processor in the embodiment of the present application are described below.

In an optional embodiment, the processor may also be used for at least one of the following: adding an address stamp and/or a time stamp to the media data, wherein the address stamp is an identifier of a camera that shoots the multimedia data, and the time stamp In order to capture the time information of the multimedia data; in the case that the multimedia data is a video, the processor adds address stamps and/or time stamps to some or all of the frames of the video; Editing processing is performed on the multimedia data, wherein the editing processing is used to change The transmission code rate of the multimedia data and/or the resolution of the multimedia data is changed; when the multimedia data is a video, the frames of the multimedia data are transmitted to the external system through the second transmission module in a predetermined order, wherein the transmitted frames are extracted from different Video data captured by the camera.

In an optional embodiment, the control command is also used for at least one of the following: a focus control command, an ISO command, a fill light command, an activation command, a clock command, and a message command, wherein the focus control command is used to set the camera The ISO command is used to set the ISO value of the camera, the fill light command is used to turn on or off the fill light unit, the activation command is used to turn on or off the camera, the clock command is used to check the time information of the camera, and the message command is used to Get the status information of the camera.

In an optional embodiment, the focus control instruction is configured according to at least one of the following focal length control principles: a continuous focus control threshold interval is preset, and after the first camera completes the focus shooting, adjacent to the first camera The second camera obtains the focal length value of the first camera, and selects the focal length value to be used within the focal length control threshold interval according to the obtained focal length value, and so on; value; configures the camera with a predetermined focal length value.

In this embodiment, the upper-level transceiver unit at the image acquisition end may include a first upper-level communication transceiver at the acquisition end and a second upper-level communication transceiver at the acquisition end, and the first upper-level communication transceiver at the image acquisition side is configured for the acquisition device For frame image data transmission with the control device, the second upper-level communication transceiver at the acquisition end is configured for command data communication between the acquisition device and the control device or with other acquisition devices; the acquisition device transmits and receives through the second-level communication at the acquisition end The receiver receives or sends command data, wherein the command data is a focus control command, an ISO command, a fill light command, an activation command, a polling command, a clock command or message data. Described instruction data is clock instruction data, is used for each acquisition device to check clock; Described instruction data is focus control instruction data, is used for focus control unit to set focus parameter; Described instruction data is fill light instruction data, Used to open and close the supplementary light unit; the instruction data is activation instruction data, used to obtain the opening and closing of the device; the instruction data is polling instruction data, used for controlling the device to poll the focus control threshold, ISO value, frame pixel dynamic change value and memory state value, etc. The message data is the frame pixel dynamic change value, focus control threshold, ISO value and memory state value collected by the acquisition device.

In the embodiment of the present application, the first upper-level communication transceiver at the acquisition end and the second upper-level communication transceiver at the acquisition end are serial transceivers, which are respectively connected to two bus-type topology transmission buses.

In addition, the processor unit at least includes a stamping device, the stamping device performs stamping processing on the frame image information after the processor unit receives the frame image information collected by the sensor unit, and adds the address stamp of the frame image to the frame image information. information and timestamp information. In addition, the stamping processing can be adding a summary mark to the file header in the frame image information, adding a watermark mark to the frame image information, correspondingly naming the frame image or video file according to predetermined rules, or generating Packet data including frame image file name, address stamp, and timestamp, or packet data including video file name, address stamp, and video start timestamp. The stamping processing may be to add information such as the focus value, ISO value, and dynamic change value of the pixels of the frame before and after the frame image to the frame image information.

In addition, the above-mentioned processor unit further includes an editor, and the editor performs editing processing on the frame image after the processor unit receives the frame image information collected by the sensor unit. For example, reducing the resolution quality can reduce the transmission bit rate of the frame image information. , and for example, levels, tones, and filter processing can improve the presentation of frame images.

In the example of this application, the processor unit further includes a transponder, which can perform data forwarding control on the frame image information. The information is sent to the storage unit or the external control device according to predetermined rules; for another example, after receiving the frame image information extraction instruction, the acquisition device extracts the frame image information from the storage unit and sends it to the external control device.

Furthermore, the processor unit further includes a regulator, which can perform parameterized control of the sensor, such as a focal length parameter, an ISO parameter, and the like.

In this embodiment of the present application, the image acquisition device may further include a storage unit, the storage unit is a built-in memory, and the memory is used for storing frame image files generated by the image sensor. Described built-in memory can be non-volatile flash memory, can be volatile memory; Storage unit can be external memory interface, external memory interface can be the SPI interface that connects SD card slot, can be the SATA interface that connects hard disk device, M. 2 interface, used to send the frame image file generated by the image sensor to the external memory and extract the frame image file stored in the external memory.

It can be seen from the above that, in the embodiment of the present application, a plurality of cameras in the image acquisition device can be set to be distributed in a chain shape, that is, a plurality of cameras are continuously distributed in a chain shape, and are configured to work in the same clock system. Each of the cameras is configured with a unique address identifier, so that images can be captured through the framing scene of each of the multiple cameras, so as to ensure that each camera in the image acquisition device does not need to be moved to realize the framing site. acquisition of images.

In addition, in the embodiment of the present application, multiple cameras in the chain image acquisition device can be configured to work in the same clock system, and each image acquisition device can form a multi-image sensor chain that operates synchronously under the control of the same server. , not only can achieve the use of a fixed image shooting state to capture the moving picture of the framing lens, but also make the shooting form more flexible.

Example 2

According to another aspect of the embodiment of the present application, an image acquisition system is also provided. FIG. 24 is a schematic diagram of the image acquisition system according to the embodiment of the present application. As shown in FIG. 24 , the image acquisition system may include any one of the above The image acquisition device 2401 of item 2401 further includes: a processing module 2403, wherein the processing module 2403 can be used to: receive a plurality of multimedia data from the image acquisition device, wherein each camera used for shooting obtains a multimedia data by shooting , a plurality of multimedia data are captured by different cameras; data sampling is performed from a plurality of multimedia data according to sampling rules; and/or, a plurality of multimedia data are displayed to the operator, and the operator selects for sampling; data to generate video files.

It can be seen from the above that in the embodiment of the present application, the image acquisition system can be used to receive multiple media data from the image acquisition device through the processing module, wherein each camera used for shooting captures one piece of multimedia data, and multiple Multimedia data is captured by different cameras; and the processing module can be used to sample data from multiple media data according to sampling rules; multiple media data can also be displayed to the operator, and the operator can choose to sample, and based on the sampling The obtained data generates a video file, which realizes the purpose of using multiple fixed cameras to capture the moving picture of the framing lens by distributing multiple cameras in a chain, and achieves the technical effect of improving the flexibility of the image acquisition device to acquire images. It also avoids jitter during image acquisition.

Therefore, with the image acquisition system of the embodiment of the present application, the problem of low reliability of the video shooting device in the related art can be solved.

It should be noted that, in this embodiment of the present application, the server may be a palmtop computer, a personal computer, a notebook computer, a server, a server cluster or a cloud server; the server may at least include: an operating processing unit, a system software unit, and a storage service unit.

The above-mentioned system software unit may be a software system preset in the server that can implement the present application, or special software, or a plug-in module in video editing software; the operation processing unit may be the hardware of the server operation system software unit Entity; storage service unit, which can be a hard disk in a server, a hard disk matrix, a dedicated storage server, a cloud storage server, a writable CD, etc.

In addition, the above-mentioned storage server unit is configured to store the frame image information and the index data of the frame image information received by the storage server; the index data of the frame image may at least include the correspondence between the frame image file name, the frame image address stamp and the frame image time stamp. relation.

In an optional embodiment, performing data sampling from a plurality of multimedia data according to a sampling rule may include: acquiring the identifications of the cameras to which the plurality of multimedia data belongs, and determining the to-be-sampled according to identification rules in the identification and sampling rules. Multimedia data sequence; data sampling is performed from multiple multimedia data in sequence according to the time rule in the sampling rule.

The server in this embodiment of the present application may further include: a driver unit, where the driver unit is configured to be preset with an image acquisition device driver and control program; the control program may be dedicated software, may be a plug-in module of video editing software, may be is the driver for the acquisition device. The operation processing unit can drive and control the acquisition device to run predetermined control tasks by executing the preset program in the driver unit, and the control tasks include activation, driving and polling of the acquisition device, clock synchronization, state analysis in the system, target Tracking, fill light control, transmission control, focus control, ISO control, and execute preset acquisition rules, control rules and external commands.

Among them, the acquisition rule is to control each image acquisition device connected to the transmission device to acquire frame image information according to a predetermined rule; customize different acquisition rules, and different acquisition rules can be flexibly combined and mutually expanded; customized rules may include: (1 ), mirror-by-mirror acquisition rules, address each acquisition device one by one, and receive the frame image information collected by the acquisition device; (2), frame-by-frame acquisition rules, communicate with each acquisition device at a predetermined frame rate to receive the collected data. frame image information, complete a round of transmission communication with each acquisition device in each frame time period, the uncompleted transmission communication in this time period immediately terminates the subsequent transmission communication, and then starts the transmission communication task in the next frame time period; ( 3) Interval acquisition rules, each acquisition device is pre-divided into areas, the frame image information collected by the acquisition device in the first area is acquired in the first frame time period, and the second area is acquired in the second frame time period. The frame image information collected by the acquisition device is analogous to the next cycle; (4), the low-quality acquisition rule, when the acquisition device does not receive the high-definition frame image transmission instruction, the frame image information transmitted to the control device is low-resolution and low-resolution. High-quality image information, by reducing the transmission bit rate of a single image, reduces the occupancy rate of transmission bandwidth; (5), low frame rate acquisition rule, acquires frame image information collected by each acquisition device at a low frame rate, reducing transmission bandwidth occupancy (6) Temporary storage, queuing transmission rules, each acquisition device collects frame image information and stores it in the built-in storage unit in real time. The frame image information transmission tasks of the device are arranged in a queue, and the communication transmission and reception are carried out with the acquisition device respectively according to the order; if the storage utilization rate of the storage units in some acquisition devices reaches a high threshold, the transmission of the storage units in the acquisition device is given priority. frame image information; (7), frame pixel dynamic change detection and acquisition rules, after the frame pixel dynamic change value of the frame image collected in the acquisition device exceeds a predetermined threshold, start the frame image information transmission communication with the serial image transmitter It can be determined whether the dynamic change value of the frame image frame pixel exceeds a predetermined threshold by polling each acquisition device; (8), thread acquisition, set the number of threads, and carry out the predetermined definition frame image information according to the predetermined number of threads in the same time period For example, the predetermined number of threads is 3 threads, and only the real-time frame image information of 3 acquisition devices is acquired in each frame time period; (9), program-controlled acquisition, preset with a predetermined acquisition trajectory program, according to the predetermined program (10) Track acquisition, determine the tracked object through the acquired frame image information, and determine that the acquisition device of the corresponding address that can track the object needs to collect and acquire the frame image information; ( 11) Acquisition filtering, the control device filters the acquired frame image information through a predetermined filter, and only transmits and stores the frame image information that satisfies the filter conditions. For example, if the filter condition of the predetermined filter is registered customers, if there is no registered customer in the frame image, the frame image will not be transmitted and stored. For example, the filtering condition of the predetermined filter is the threshold of frame pixel dynamic change, and only frame image information whose frame pixel dynamic change exceeds the threshold value is transmitted and stored; (12), other acquisition rules can also be customized to achieve different image acquisition effects, here I won't go into details.

In an optional embodiment, the identification rule includes at least one of the following: determining the order of the multimedia data to be sampled according to the order of identification, determining the order of the multimedia data to be sampled according to the reverse order of the identification, according to the predetermined interval order or the reverse order The identifier determines the sequence of multimedia data to be sampled, and the sequence of identifiers determined by using the first predetermined function is used as the sequence of the multimedia data to be sampled; the time rule includes at least one of the following: sampling at the same time node, on the jumping time node Sampling is performed, sampling is performed in time sequence, sampling is performed in reverse time sequence, and sampling is performed in time sequence determined using the second predetermined function.

In this embodiment, the identification rule may be to control each image acquisition device to perform focal length control according to a predetermined rule. By performing focal length control on a plurality of different image sensors, the frame images continuously acquired by adjacent image sensors can be coherent and consistent, and the focus The control rules may include: (1), setting the coherence focal length control threshold interval rule, and predetermining the coherence focal length control threshold interval for the acquisition device, when the adjacent acquisition device finishes focusing and collects frame image information, acquire the focal length of the adjacent acquisition device value, according to the acquired focal length value, select the focal length value within the predetermined coherence focal length control threshold interval to focus and then collect the frame image information; (2), the tracking target coherence focal length control rule, according to the focal length value of the tracked target and the adjacent acquisition device Adjust the selection direction of the focus value; (3), the command-type focus control rule, the focus control is performed according to the focus control command to achieve the predetermined frame image information collection effect; (4) the mandatory focus control rule, the sensor lens chain on the chain. Mandatory focal length control for a specific lens, which defines that its focal length does not change under certain circumstances. For example, the focal length of the continuous lens on the sensor lens chain is defined as continuous increase or continuous decrease, the continuous frame image generated by the continuous lens can show the effect of forced push-pull zoom, and it can also easily generate the explosive special effects of fast push-pull zoom; if forced Zooming and changing the position of the frame-taking lens can easily generate a "Hitchcock-style zoom (sliding zoom)" effect, that is, the shooting effect in which the foreground remains unchanged and the background is always changing; (5), other focal lengths can also be customized Control rules to achieve different image acquisition effects, which are not repeated here.

In an optional embodiment, the server is further configured to configure a shooting rule, and send the shooting rule to the processor, wherein the shooting rule is to determine a camera for shooting and shooting parameters, and the shooting parameters include at least one of the following: Shooting time, quality parameters of the captured image.

It should be noted that, in the embodiment of the present application, each image sensor of the image acquisition system has a unique address, and the frame image information collected by each image sensor is marked with address stamp information; The time stamps set for the images collected by one image sensor are consistent with time, and the frame image information collected by all the image sensors is configured with time stamp information. Through the address stamp information and time stamp information, all frame image information collected by the image acquisition system can be mapped to a virtual frame image virtual mapping table. Fig. 25 is a schematic sampling diagram of an image acquisition system according to an embodiment of the present application. As shown in Fig. 25, the vertical a1, a2, a3, etc. correspond to the a1, a2, a3 image sensors arranged in sequence, respectively, and the horizontal T1, T2, T3, etc. correspond to the sequential arrangement of timestamps T1, T2, and T3, respectively.

The server in this embodiment of the present application may further include a video sampling unit, and the video sampling unit may be dedicated software, or may be a plug-in module in video editing software. The video sampling unit is configured to perform sampling in the frame image information cluster to extract the frame image according to the sampling rule, and generate a video file. By customizing different frame image sampling rules, different video rendering effects can be generated. The frame image sampling rules may include: (1) Single thread sampling rules, only one frame image in the frame image chain is sampled in each frame period; (2) Multi-thread sampling rules, each frame period Multiple frame images in the image chain are sampled. For example, sampling multiple frame images on the same time stamp can present the effect of multiple shots on the same screen or picture-in-picture in the output video; for another example, sampling multiple frame images at different time stamps at the same time, The effect of multiple time periods on the same screen can be presented in the output video; (3), the time stamp skipping sampling rule, the continuous frames of the output video use the skip sampling on the time stamp, and the effect of time fast-forwarding can be presented in the output video; (4) The same time stamp sampling rule, the continuous frames of the output video are sampled at a fixed time stamp, and the output video can present a static surround view effect; if it is combined with sampling on continuous address stamps, it can be displayed in the output video. (5) Time stamp difference compensation rule, subdivide multiple time nodes between two adjacent time stamps, and change the pixels of the frame image according to the two adjacent time stamps. In some cases, the intelligently generated virtual image information of slowly changing image pixels is used as the frame image information of the extra time node. Through the time stamp difference compensation rule, the effect of super slow motion can be presented in the output video; (6) Inverse time stamp sampling rule, the sampling direction of multiple consecutive frames of the output video is sampled in the opposite direction to the time stamp direction. , which can show the effect of time reverse order in the output video; (7), the address stamp jump sampling rule, the corresponding address stamps when the two adjacent frames are sampled are not continuous, but skip part of the address stamp sampling, which can be found in The output video shows the effect of rapid movement of the lens, and it can also easily realize the special effects of throwing the lens in professional film and television shooting; (8), the sampling rule of the same address stamp, the frame sampling before and after corresponds to the same address stamp, which can be in the The output video shows the still mode of the lens; (9), the address stamp difference complement rule, subdivide a plurality of address nodes in the middle of two adjacent address stamps, according to the pixel changes of the frame image corresponding to the two adjacent address stamps, The intelligently generated virtual image information of slowly changing image pixels is used as the frame image information of the extra address nodes. Through the address stamp difference complement rule, the speed of the lens movement can be slowed down in the output video; (10), the tracking sampling rule, according to the movement of the target object, the method of tracking the best sampling address stamp can be displayed in the output video. Showing effects such as one mirror to the end; (11), intelligent correction rules, according to the continuous frame image information after sampling, intelligently correct the focus area deviation, color level deviation, exposure deviation, etc. The frame image is coherent and consistent; (12), the function sampling rule, the method of sampling according to the sampling address stamp and the time stamp track determined by the predetermined function formula, can present infinitely diverse effects in the output video; (13), Equidistant two-line sampling rule, according to the predetermined sensor distance, forced equidistant two-line sampling can generate 3D video and VR video with parallax; (14), other frame image sampling rules for generating video can also be customized to achieve different The image acquisition effect will not be repeated here.

Through the above different frame image sampling rules, the previous shooting process can be restored in the later editing process, and the possibility of an infinite number of shooting trajectories can be presented, and the lack of information in the traditional manual shooting process can be compensated for through the diversity of grab sampling. The chain image acquisition system also includes a control device, the control device includes a lower-level transceiver unit at the control end, an upper-level transceiver unit at the control end and a controller unit.

Wherein, the controller unit also includes a program executor and a program memory; the program memory is configured as a memory preset with the obtaining device driving and control program, which can be an EEPROM or a NADN Flish memory. The program executor here is configured to execute the preset program to realize the driving and control of the image acquisition device. The above control tasks include activation, driving and polling of the acquisition device, clock synchronization, state analysis in the system, target tracking, fill light control, transmission control, focus control, ISO control, and execution of preset acquisition rules and external commands.

It should be noted that, in a chain image acquisition system including a control device, the server may not include a driver unit, and the control device directly drives and controls the acquisition device.

In the embodiment of the present application, the lower-level transceiver unit of the control end is configured to communicate with a plurality of acquisition devices through a transmission network, and the upper-level transceiver unit of the control end is configured to communicate with the server through the transmission network. After the controller unit receives the frame image acquisition start and end instructions sent by the server through the upper-level transceiver unit of the control end, the lower-level transceiver unit of the control end controls each acquisition device that is continuous with its network to start and stop the frame image acquisition and storage; control; After receiving the frame image extraction instruction sent by the server through the upper-level transceiver unit of the control terminal, the receiver unit can also extract the frame image information on each acquisition device connected to it through the lower-level transceiver unit of the control terminal, and the extracted frame image information is passed through the control terminal. The upper-level transceiver unit sends to the server.

In addition, in the embodiment of the present application, the lower-level transceiver unit of the control end is a serial transceiver, which is connected to a bus-type topology transmission bus.

Example 3

The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages or disadvantages of the embodiments.

In the above-mentioned embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are only illustrative, for example, the division of the units may be a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components may be combined or Integration into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of units or modules, and may be in electrical or other forms.

The units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes .

The above are only the preferred embodiments of the present application. It should be pointed out that for those skilled in the art, without departing from the principles of the present application, several improvements and modifications can also be made. It should be regarded as the protection scope of this application.

Claims

An image acquisition device, comprising: a plurality of cameras, a first transmission module, a processor and a second transmission module, wherein,

The plurality of cameras are distributed in a chain; each of the plurality of cameras is configured with a unique identifier, and the identifier is used to indicate the position of the camera in the chain distribution;

the first transmission module, configured to connect the plurality of cameras and the processor, and configured to transmit information between the plurality of cameras and the processor;

The processor is configured to acquire multimedia data obtained by shooting from the multiple cameras, and/or send a control command to the multiple cameras; wherein the multimedia data includes at least one of the following: image and video; The control command is used to control the plurality of cameras to shoot according to predetermined parameters;

The second transmission module is used for information transmission between the processor and an external system, wherein the external system is a system other than the image acquisition device.
The image acquisition device according to claim 1, wherein the first transmission module is a bus, and the bus is used to connect the image sensor unit of each camera and the transceiver unit of the processor, wherein the Buses include one of the following: TTL, RS485, IIC, High-speed IIC, SPI, 1-wire, m-lvds, b-lvds, CAN, FlexRay, 10BASE-T1S.
The image acquisition device according to claim 1, wherein,

The first transmission module is a cable, wherein the cable at least includes: a data transmission line and a power supply line, the data transmission line is used for information transmission, and the power supply line is used for connecting to the cable. The cameras are powered on; the plurality of cameras are arranged on the cable at predetermined intervals, and the power supply line is used for power supply and the data transmission line is used for data transmission; and/or,

The first transmission module is a bus, the plurality of cameras are connected to the processor through the bus, the image acquisition device is made as a whole, and the image acquisition device further includes a connection part, the connection part is detachably connected to the connecting line, the second transmission module is used for information transmission with the external system through the connecting line, and the external system is detachably connected to at least one of the image acquisition devices, The connection line is also used to supply power to the image acquisition device; and/or,

The first transmission module is a bus, the plurality of cameras are connected to the processor through the bus, the image acquisition device is made as a whole, and the second transmission module is a wireless network module and/or a wired A network module, when the second transmission module includes a wired network module, the image acquisition device further includes a network interface, where the network interface is used to connect a cable connected to the external system.
The image acquisition device according to claim 1, wherein the plurality of cameras are distributed on a plurality of chains, wherein each chain of the plurality of chains is provided with at least one camera, and the processor is One or more, wherein, in the case of one processor, it is connected to the plurality of cameras, and in the case of multiple processors, the processor is connected to the cameras on one or more chains , which controls the chain's camera.
The image acquisition device according to claim 1, wherein the multiple cameras are cameras of the same type or different types of cameras, and/or the orientations of the multiple cameras are the same or different.
The image acquisition device according to any one of claims 1 to 5, wherein the processor is further used for at least one of the following:

Add an address stamp and/or a time stamp to the media data, wherein the address stamp is an identification of a camera that shoots the multimedia data, and the time stamp is time information for shooting the multimedia data; In the case of a video, the processor adds the address stamp and/or the time stamp on some or all of the frames of the video;

Perform editing processing on the multimedia data, wherein the editing processing is used to change the transmission bit rate of the multimedia data and/or change the resolution of the multimedia data;

In the case where the multimedia data is a video, the frames of the multimedia data are transmitted to the external system through the second transmission module in a predetermined order, wherein the transmitted frames are extracted from video data captured by different cameras .
The image acquisition device according to any one of claims 1 to 5, wherein the control command is further used for at least one of the following: a focus control command, an ISO command, a fill light command, an activation command, a clock command, a message instruction, wherein the focus control instruction is used to set the focusing parameters of the camera, the ISO instruction is used to set the ISO value of the camera, the fill light instruction is used to turn on or off the fill light unit, the activation instruction is used to turn on or off the camera, and the clock instruction It is used to check the time information of the camera, and the message instruction is used to obtain the status information of the camera.
The image acquisition device according to claim 7, wherein the focus control instruction is configured according to at least one of the following focus control principles:

A continuous focal length control threshold interval is preset, and after the first camera completes the focus shooting, the second camera adjacent to the first camera obtains the focal length value of the first camera, and according to the obtained focal length value in the Select the focal length value used in the focal length control threshold interval, and so on;

Determine the focal length value according to the photographed target and with reference to the focal length value of the adjacent camera;

Configure the camera with a predetermined focal length value.
An image acquisition system, comprising the image acquisition device according to any one of the preceding claims 1 to 8, further comprising: a processing module, wherein the processing module is used for:

Receive a plurality of multimedia data from the image acquisition device, wherein, each camera used for shooting obtains a piece of multimedia data, and the plurality of multimedia data is obtained by shooting with different cameras;

Perform data sampling from the plurality of multimedia data according to the sampling rule; and/or, present the plurality of multimedia data to the operator, and the operator selects for sampling;

Generate a video file based on the sampled data.
The image acquisition system according to claim 9, wherein the data sampling from the plurality of multimedia data according to the sampling rule comprises:

Obtain the identification of the camera to which the plurality of multimedia data corresponds, and determine the order of the multimedia data to be sampled according to the identification and the identification rule in the sampling rule;

Data sampling is performed from the plurality of multimedia data in the order according to the time rule in the sampling rule.
The image acquisition system of claim 10, wherein,

The identification rules include at least one of the following: determining the order of multimedia data to be sampled according to the order of the marks, determining the order of multimedia data to be sampled according to the reverse order of the marks, determining the order of the multimedia data to be sampled according to the predetermined interval order or the reverse order The order of multimedia, the order of the identifiers determined by using the first predetermined function as the order of the multimedia data to be sampled;

The time rule includes at least one of the following: sampling at the same time node, sampling at skipped time nodes, sampling in time sequence, sampling in reverse time sequence, and sampling in time sequence determined by using the second predetermined function.
The image acquisition system according to claim 9, wherein the processing module is further configured to configure a shooting rule, and send the shooting rule to the processor, wherein the shooting rule is to determine a camera for shooting and shooting parameters, the shooting parameters include at least one of the following: shooting time and quality parameters of the captured images.
The image acquisition system according to any one of claims 9 to 12, wherein the processing module is one of the following: a server, a controller.
An image acquisition method, which is applied to the image acquisition device according to any one of the above claims 1 to 8, and/or the image acquisition system according to any one of the above claims 9 to 12.