KR20220167178A - Orthogonal array type ultra-high-resolution camera and real-time control system including the same - Google Patents

Abstract

The present invention relates to an ultra-high resolution camera including a plurality of lenses. The lens may include: a substrate; and a plurality of image sensors positioned on the surface of the substrate and arranged in a grid dividing an image collection area on the substrate into n x n. As a result, the camera can be compact and lightweight so as to be mounted on currently commercialized unmanned aerial vehicles, can be driven with low power which can overcome the limitations of the power supply source of unmanned aerial vehicles, and can be used for disaster and control purposes which can control a wide area of more than 1 km in real time at the same time.

Description

Orthogonal array type ultra-high resolution camera and real-time control system including the same

The present invention relates to an orthogonal arrangement type super-resolution camera and a real-time control system including the same, and more particularly, to an orthogonal arrangement type super-resolution camera capable of providing super-resolution images and a real-time control system including the same will be.

In order to protect the people from natural social disasters such as fires and marine accidents and public security, the government has developed full-scale unmanned aerial vehicles for disaster/police purposes, aiming for a market size of 70.4 billion won in 2016 to become the world's fifth largest unmanned aerial vehicle by 2026. It plans to expand the aircraft market to 4.1 trillion won and aims to commercialize 60,000 industrial unmanned aerial vehicles.

As such, the market for using unmanned aerial vehicles and aerial cameras, including drones, is developing rapidly, and accordingly, the need for low-power, ultra-high resolution cameras is also increasing to overcome the limitation of power supply capacity mounted on unmanned aerial vehicles.

However, ultra-high resolution cameras with 100 million pixels or more are expensive, and in the case of low-cost cameras, there is a problem that they are not suitable for disaster and control analysis in a wide area because of their low resolution. In particular, in order to increase the efficiency of search for real-time control, it is urgently needed to develop an ultra-high resolution camera that can be mounted on currently commercialized industrial unmanned aerial vehicles.

Therefore, it is necessary to develop an ultra-high resolution camera that provides high resolution for disaster and control analysis in a wide area and is economical.

Registered Utility Model Publication No. 20-0208699

The present invention has been made to solve the above problems, and an object of the present invention is to provide a compact and lightweight orthogonal array type ultra-high resolution camera and a real-time control system including the same to be mounted on a currently commercialized unmanned aerial vehicle. will be.

Another object of the present invention is to provide a low-power, orthogonal arrangement super-resolution camera capable of overcoming the limitations of a power supply source of an unmanned aerial vehicle and a real-time control system including the same.

Another object of the present invention is an orthogonal array type super-resolution camera that can be used for disaster and control purposes that can simultaneously control a wide area of 1 km or more in real time by arranging low-cost high-resolution sensors and increasing the degree of integration, and real-time control including the same to provide the system.

In the ultra-high resolution camera including a plurality of lenses according to an embodiment of the present invention for achieving the above object, the lens comprises: a substrate; and a plurality of image sensors located on the surface of the substrate and arranged in a grid dividing an image collection area on the substrate into nxn.

Here, the grating dividing the image collection area on the substrate into nxn may be provided with the same size for each of the plurality of lenses.

The plurality of image sensors may be arranged at specific positions within the nxn grid, so that the sum of areas projected by each of the plurality of image sensors may fill the grid.

In addition, when the plurality of lenses are provided in four pieces, the specific position where the plurality of image sensors are arranged is such that the plurality of image sensors provided on the lenses adjacent to each other along the horizontal axis are located in the same row within the grid. However, the positions where the columns cross each other, and the plurality of image sensors provided on the lenses adjacent to each other in the vertical axis may be located on the same column but the positions where the rows cross each other.

A real-time control system according to an embodiment of the present invention for achieving the other object is located on a substrate and a surface of the substrate, but a plurality of arrays arranged in a grid dividing the image collection area on the substrate into nxn. An ultra-high resolution camera including a plurality of lenses including an image sensor and transmitting collected image data to a server; And a multi-streaming server that receives the image data from the ultra-high resolution camera and provides the image data corresponding to the control condition to the receiving terminal when a control condition is received from a receiving terminal of a service user using a streaming service. .

According to one aspect of the present invention described above, by providing an ultra-high resolution camera of an orthogonal array method and a real-time control system including the same, the ultra-high resolution camera can be compact and lightweight so that it can be mounted on a currently commercialized unmanned aerial vehicle, and the unmanned aerial vehicle It can be driven with low power that can overcome the limitations of power supply sources, and can be used for disaster and control purposes that can simultaneously control a wide area of more than 1 km in real time.

In addition, by providing the ultra-high resolution camera of the orthogonal array method of the present invention and a real-time control system including the same, by increasing the degree of integration of the image sensor, it is possible to provide an ultra-high resolution image using a general image sensor.

1 is a schematic diagram for explaining a configuration of a conventional image sensor;
Figure 2 is a schematic diagram showing the appearance of an IP-based mobile body equipped with a super-resolution camera of the present invention;
3 is a view for explaining how an image sensor is arranged according to an embodiment in an ultra-high resolution camera of the present invention;
4 is a view for explaining how image sensors are arranged according to another embodiment in the ultra-high resolution camera of the present invention;
5 is a view for explaining how an image sensor is arranged according to another embodiment in an ultra-high resolution camera of the present invention;
6 is a diagram for explaining an image taken by a conventional camera;
7 is a diagram for explaining an image taken by an ultra-high resolution camera of the present invention, and
8 is a schematic diagram of a real-time control system including an ultra-high resolution camera of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The detailed description of the present invention which follows refers to the accompanying drawings which illustrate, by way of illustration, specific embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable one skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different from each other but are not necessarily mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be implemented in another embodiment without departing from the spirit and scope of the invention in connection with one embodiment. Additionally, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the invention. Accordingly, the detailed description set forth below is not to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all equivalents as claimed by those claims. Like reference numbers in the drawings indicate the same or similar function throughout the various aspects.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the drawings.

1 is a schematic diagram for explaining the configuration of a conventional image sensor, and FIG. 2 is a schematic diagram showing an IP-based mobile body 1 equipped with an ultra-high resolution camera 10 according to the present invention.

1 is a view of a conventional lens provided with 9 image sensors of 2M pixels and providing a resolution of 18M pixels. There is a difficult problem.

The ultra-high resolution camera 10 of the present invention is provided to solve the problem of low integration and difficult mass production. matching can be made easier.

To this end, the ultra-high resolution camera 10 may include a plurality of lenses 11 and may be provided.

These lenses 11 are preferably one of 4, 6, and 9 in consideration of image matching to one camera 10, but are not limited thereto, and may be provided in various numbers by changing as needed. may be

And, in this embodiment, the plurality of lenses 11 constituting the ultra-high resolution camera 10 may be provided including a substrate 111 and a plurality of image sensors 113, respectively.

The substrate 111 includes a surface and may be electrically connected to the image sensor 113 through bonding wires or pins.

At least one or more image sensors 113 may be located on the surface of the substrate 111 and may be located within a grid 111 ′ formed by dividing the surface of the substrate 111 into nxn. At this time, the position of each grating 111' is an area for collecting images, that is, the position of the grating 111' may be an area for collecting light passing through the lens 11.

The size of the partitioned grid 111' can be selected from 4x4 to 10x10, which can be set based on the number of lenses 11 provided in the super-resolution camera 10 according to this embodiment.

Also, all substrates 111 included in the plurality of lenses 11 have grids 111' partitioned with the same size. Specifically, when the image collection area of the substrate 111 is partitioned into a 6X6 grid 111′ as shown in FIG. 2 and the lens 11 is provided with four lenses 11-1 to 11-4, The image collection areas of the substrate 111 respectively provided on the first lens 11-1, the second lens 11-2, the third lens 11-3, and the fourth lens 11-4 are all 6x6 Partitioned by size, the image sensor 113 is arranged in the corresponding grid 111'.

Meanwhile, the plurality of image sensors 113 may be positioned on the surface of the substrate 111 within the image collection area, and as described above, the image collection area on the substrate 111 is divided into nxn grids 111'. can be arranged in a specific position in

In addition, a plurality of image sensors 113 may be arranged according to a certain standard within the grid 111' divided into n x n within the grid 111' partitioned on one substrate 111. According to this predetermined criterion, another image sensor 113 is not located on a grid 111' adjacent to the top, bottom, left, and right sides of the grid 111' on which one image sensor 113 is located on one substrate 111. .

Further, a specific position where the plurality of image sensors 113 are arranged within the grid 111' may be different for each of the plurality of lenses 11.

In addition, the sum of the areas projected by the plurality of image sensors 113 arranged at specific positions on the substrate 111 of the lens 11 having the same size grating 111' can fill all of the grating 111'. will be provided

In addition, looking at a specific position where the plurality of image sensors 113 are arranged when four lenses 11 are provided, the plurality of image sensors 113 provided on the lenses 11 adjacent to each other in the horizontal axis are , may be located in the same row within the lattice 111', but at a position where columns cross each other.

Meanwhile, the plurality of image sensors 113 provided on the lenses 11 adjacent to each other along the vertical axis may be located in the same column but at positions where rows cross each other.

A configuration in which the plurality of image sensors 113 are arranged at specific locations on a substrate will be described later in detail with reference to FIGS. 3 to 5 .

The plurality of image sensors 113 may be provided as 5M Pixel CMOS image sensors, but are not limited thereto.

And the ultra-high resolution camera 10 composed of a plurality of lenses 11 including such a substrate 111 and a plurality of image sensors 113 is provided with a power circuit DDR (double data rate) for low power and low noise , A field programmable gate array (FPGA) may be applied as a sensor reception interface to simultaneously receive data from 16 image sensors 113 at a time.

Meanwhile, FIG. 3 is a view for explaining how the image sensor 113 is arranged in a grid 111' divided into predetermined sizes according to an embodiment in the ultra-high resolution camera 10 of the present invention. The ultra-high resolution camera 10 shown in FIG. 3 has four lenses 11, and images of each substrate 111-1 to 111-4 provided on each lens 11-1 to 11-4. It is a figure in which a plurality of image sensors 113-1 to 113-4 are arranged in a grid 111' formed by partitioning the collection area into a size of 7x7.

As shown, each of the substrates 111-1 to 111-4 provided on the four lenses 11-1 to 11-4 may all have the same 7x7 grid 111'.

In addition, the plurality of image sensors 113-1 to 113-4 are arranged at different positions within the grid 111' of the same size formed on each of the substrates 111-1 to 111-4, and one substrate ( 111), they may be arranged at positions that are not adjacent to each other within the lattice 111' formed.

As described above, since the number of lenses 11 shown in FIG. 3 is four, a specific position where the plurality of image sensors 113 are arranged is a plurality of image sensors 113 provided on the lenses 11 adjacent to each other in the horizontal axis. are located in the same row within the grating 111', but the columns are crossed with each other, and the plurality of image sensors 113 provided on the lenses 11 adjacent to each other in the vertical axis are located in the same column, It may be a position where rows intersect each other.

More specifically, as shown in FIG. 3, when four lenses 11-1 to 11-4 are provided and partitioned by a 7x7 grid 111', a first lens 11-1 is provided. On the substrate 111-1, the plurality of first image sensors 113-1 are positioned in odd-numbered rows of 1st row, 3rd row, 5th row and 7th row, but in the corresponding row, the 1st, 3rd, 5th and 7th columns, respectively. It can be arranged to be located in the odd-numbered rows of the 7th row.

In addition, the plurality of second image sensors 113-2 are formed on the second substrate 111-2 provided on the second lens 11-2 adjacent to the first lens 11-1 in a horizontal axis, and the first image sensor ( 113-1) may be located in the same odd-numbered row, but may be arranged in even-numbered columns of the second, fourth, and sixth columns, respectively, at positions where the first image sensor 113-1 and the column intersect in the odd-numbered row. .

Meanwhile, the plurality of third image sensors 113-3 are formed on the third substrate 111-3 provided on the third lens 11-3 adjacent to the first lens 11-1 in a vertical axis. It may be located in an even row that intersects the odd row where the 113-1s are located, but may be arranged to be located in the same odd column as the same column where the first image sensors 113-1 are located in the corresponding even row.

And a plurality of lenses on the fourth substrate 111-4 provided on the fourth lens 11-4 adjacent to the second lens 11-2 in a vertical axis and adjacent to the third lens 11-3 in a horizontal axis. The fourth image sensors 113-4 are located in the same even row as the row in which the third image sensors 113-1 of the third lens 11-3 adjacent in the horizontal axis are located, but are adjacent in the vertical axis in the corresponding row. The second image sensors 113-2 of the second lens 11-2 may be arranged in even-numbered columns and columns.

In addition, when the plurality of image sensors 113-1 to 113-4 arranged at specific positions according to the above rules are combined, the 7x7 grid 111' can be filled as shown in the lower portion of FIG. That is, the sum of areas projected by the plurality of image sensors 113 may be an area for collecting images.

Through this, as shown in FIG. 3, the plurality of image sensors 113 are orthogonally arranged in the grid 111', so that the degree of integration is high, as well as image matching when collecting images to implement ultra-high resolution images. can make this easier.

Therefore, in the ultra-high resolution camera 10 according to the present embodiment, when a plurality of image sensors are located on a conventional substrate, the space between the image sensors is increased due to a bonding wire or a fixing pin to which the image sensors are attached to the substrate. It is possible to increase the degree of integration by solving the problem that there is no high-resolution image sensor, and to provide the effect of collecting high-resolution images using only a general image sensor of 5M pixels instead of a high-resolution image sensor.

Meanwhile, FIG. 4 is a view for explaining how the image sensor 113 is arranged in a grid 111' divided into predetermined sizes according to another embodiment in the ultra-high resolution camera 10 of the present invention. The high-resolution camera 10 includes four lenses 11-1 to 11-4, and a plurality of image sensors 113-1 to 113-4 are arranged in a 6x6 grid 111'. appearance to be

According to another embodiment of the present invention, a plurality of image sensors 113-1 to 113-4 are arranged in a grid 111' partitioned by four lenses 11-1 to 11-4 in a 6x6 size. When provided, the first image sensors 113-1, like the plurality of image sensors 113-1 to 113-4 according to the embodiment of FIG. 3, are the first, third, fifth, and seventh rows. It is located in odd rows, but may be arranged to be located in odd columns of 1st, 3rd, 5th and 7th columns, respectively, in that row.

In addition, the plurality of second image sensors 113-2 are formed on the second substrate 111-2 provided on the second lens 11-2 adjacent to the first lens 11-1 in a horizontal axis. 113-1), but may be arranged to be located in even-numbered columns of second, fourth, and sixth columns that cross the first image sensor 113-1, respectively, in the corresponding row.

Through this, a total of 36 image sensors 113 can be located in the partitioned grid 111' on the substrates 111-1 to 111-4 provided on the four lenses 11-1 to 11-4, nine each, , Through this configuration, it is possible to perform image matching based on the images collected from the four lenses 11-1 to 11-4. The diagram shown on the right side in FIG. 4 schematically shows the position of the projected image for each sensor during real-time monitoring. As shown on the left side of FIG. ) can be filled in.

FIG. 5 is a view for explaining how image sensors 113 are arranged in a grid 111' divided into predetermined sizes according to another embodiment in the ultra-high resolution camera 10 of the present invention. As shown in the ultra-high resolution camera 10 according to another embodiment, the lens 11 is provided with six lenses 11-1 to 11-6, and a substrate of each lens 11-1 to 11-6. The image collection area of (111-1 to 111-6) is divided into a 7x7 grid 111', and a plurality of image sensors 113-1 to 113-6 are arranged in the grid 111'.

As described above, the plurality of image sensors 113-1 to 113-6 in this embodiment are arranged so as not to be adjacent to each other within the grid 111' formed on one substrate 111, and the plurality of substrates ( Arrangements in which the image sensors 113-1 to 113-6 are positioned for each of 111-1 to 111-6 may be different.

Unlike in FIGS. 3 and 4 in which a plurality of image sensors 114 are arranged in a grid 111' according to an embodiment, the ultra-high resolution camera 10 shown in FIG. 5 has six lenses ( 11-1 to 11-6), and a plurality of image sensors 113-1 provided in each lens 11-1 to 11-6 based on a specific position according to an embodiment. ~ 113-6) may be arranged in the lattice 111' by adding a condition that the number is arranged in a similar number to each other.

As shown in FIG. 5, when six lenses 11 are provided and the image collection area is divided into a 7x7 grid 111' on the substrates 111-1 to 111-6, the grid 111' If the number is divided by the number of lenses 11-1 to 11-6, the remaining lenses 11-1, 11-2, 11-3, 11-5, and 11-6 except for one lens 11-4 are respectively Eight image sensors 113 may be arranged.

Accordingly, the first image sensor 113-1, the second image sensor 113-2, and the third image sensor 113-3 provided on the plurality of lenses 11-1 to 11-3 adjacent to each other in the horizontal axis are , within the grids 111' formed on the first substrate 111-1, the second substrate 111-2, and the third substrate 111-3, all are arranged in non-overlapping columns crossing each other in the same row. However, it is arranged so that only eight image sensors 113 are provided.

If the image sensors 113 are arranged based on the above criteria, 12 first image sensors 113-1 provided in the first lens 11-1 are provided in the grid 111', so as shown, 1 The four first image sensors 113 - 1 located in row 1 column, 1 row 7 column, 7 row 1 column, and 7 row 7 column may be omitted so that a total of eight are provided. In the drawing, the first image sensor 113-1 located at each corner is illustrated as being omitted, but is not limited thereto.

Meanwhile, the fourth lens 11-4, the fifth lens 11-5 adjacent to the first lens 11-1, the second lens 11-2, and the third lens 11-3 in a vertical axis, respectively, and The plurality of fourth image sensors 113-4, the fifth image sensor 113-5, and the sixth image sensor 113-6 provided on the sixth lens 11-6 include a fourth substrate to a fourth image sensor 113-6. 6 The first image sensor 113-1, the second image sensor 113-2, and the third image sensor 113-3 are formed within the grid 111' formed on the substrates 111-4 to 111-6. Arranged to be located in the same column as the one in which the first image sensor 113-1, 2nd image sensor 113-2, and 3rd image sensor 113-3 are located, but located in a different row crossing the row where the first image sensor 113-1, the second image sensor 113-2, and the third image sensor 113-3 are located. can

If the plurality of image sensors 113 are arranged according to the criteria above, nine fourth image sensors 113-4 are arranged in the grid 111', and the fifth image sensor 113-5 and the sixth image sensor are arranged. (113-6) is arranged six.

Therefore, as described above, in the grid 111' by the eight first image sensors 113-1, 1 row 1 column, 1 row 7 column, 7 row 1 column, and 7 row 7 column are emptied. . Accordingly, the fifth image sensor 113-5 and the sixth image sensor 113-6 are arranged at the corresponding positions, so that the fifth image sensor 113-5 and the sixth image sensor 113 are arranged in the grid 111'. -6) can also be arranged in eight.

In the drawings, it is shown that the fifth image sensor 113-5 is arranged in 1 row and 7 columns and 7 rows and 7 columns, and the 6th image sensor 113-6 is arranged in 1 row and 1 column and 7 rows and 1 column, however, it is limited thereto. It does not have to be, but it is only a position where the sum of the areas projected by all the image sensors 113 fills the grid 111'.

As described above, when the image sensor 113 according to the present embodiment is provided as a CMOS sensor of 5M pixels, it is possible to collect super-resolution images of 180M pixels (5M x 36). Therefore, since it is possible to implement a light weight of less than 4 kg, a miniaturization that can be mounted on a gimbal, and a low-power ultra-high resolution camera 10, it can be mounted on an IP-based mobile body 1 including drones, kite balloons, and the like.

6 is a diagram for explaining an image taken by a conventional camera, and FIG. 7 is a diagram for explaining an image taken by the ultra-high resolution camera 10 of the present invention.

6 is a diagram for comparison of resolving power taken through an existing 8M (UHD) pixel camera, in which a space with a horizontal size of 500m is photographed, 1 pixel is 13.8cm, and as shown, a vehicle in the form of a parking lot. It cannot distinguish colors, and can only distinguish colors of people and vehicles within 100m, but it can be seen that the resolution is low for analysis of disasters and control over a wide area.

On the other hand, FIG. 7 is a picture of a space of the same horizontal size of 500 m taken through the ultra-high resolution camera 10 in which the image sensor 113 is arranged according to another embodiment of the present invention of FIG. 4, 1 pixel is 2.3 cm, In the video taken by the ultra-high resolution camera 10 of the present invention including 36 5M pixel image sensors 113, it can be seen that the type of a specific vehicle in the parking lot and the color of a person can be distinguished. Therefore, when the ultra-high resolution camera 10 according to the present invention is applied to the IP-based moving object 1, the current status and movement of the entire parking lot can be grasped in real time. In addition, since the IP-based moving object 1 such as a drone takes pictures in a hovering state, it is possible to discriminate and track a moving object by utilizing an image analysis function, and through this, it is possible to simultaneously control an area of 1 km or more in real time.

8 is a schematic diagram of a real-time control system including an ultra-high resolution camera 10 of the present invention.

The real-time control system may include an ultra-high resolution camera 10 provided in an IP-based mobile body 1 and a multi-streaming server 3 that receives image data transmitted from the ultra-high resolution camera 10.

As described above, the ultra-high resolution camera 10 is provided including a plurality of lenses 11 including a substrate 111 and a plurality of image sensors 1130, and image data collected from the image sensor 113 is described above. It can be transmitted to the server 3 as described above.

And, as shown, a plurality of IP-based mobile bodies 1 equipped with the ultra-high resolution camera 10 of the present invention may be provided and interlocked with one multi-streaming server 3 to transmit and receive various data.

To this end, software (application) for video transmission and streaming may be installed and executed in the ultra-high resolution camera 10 or the IP-based mobile body 1 equipped with the ultra-high resolution camera 10 and the multi-streaming server 3.

Although not shown in the drawing, the ultra-high resolution camera 10 may include an image processing unit for encoding collected image data or image improvement processing, and a network module for transmitting the encoded image data to the outside, but is limited thereto. Image data may be transmitted through the IP-based mobile unit 1 without separately preparing a network module.

Here, the image data may mean data collected from a plurality of lenses 11 including the image sensor 113 of the ultra-high resolution camera 10, and such image data includes identification information of the ultra-high resolution camera 10, GPS information, photographing time information, a link address, and the like, and the link address may be a URL or an IP address.

Also, the ultra-high resolution camera 10 may encode image data input through the image sensor 113 in one of H.264, H.265, MJPEG, and RGB codec formats.

And when video data is encoded, the resolution of video encoding may be one of UHD, 5M, Full-HD (1080p), HD (720p), and D1, and the resolution of still image encoding may be Max8M resolution JPEG, ISP and image improvement processing for image quality improvement may be performed.

At this time, a hardware configuration such as a board for image processing may be provided in plurality based on the number of lenses 11, but is not limited thereto.

And the network module for transmitting the encoded video data to the outside is configured to communicate simultaneously using a wireless network including 5G, 4G, 3G, LTE, and Wi-Fi (2.4GHz or 5.8GHz) with different bandwidths. can do.

The ultra-high resolution camera 10 transmits video data encoded to the outside, that is, to the multi-streaming server 3 through the network module configured as described above, and when 5G connection fails, it automatically switches to 4G, 3G, or LTE and attempts transmission or Wi-Fi You can also try sending through it.

In addition, the ultra-high resolution camera 10 may include a function of RTSP (Real-Time Streaming Protocol) or RTP (Real-Time Protocol) for image transmission.

On the other hand, when the multi-streaming server 3 receives image data from at least one ultra-high resolution camera 10, it can monitor it multiple times and transmit and receive real-time images and data through the RTSP or RTP communication connection of the ultra-high resolution camera 10. In addition, the image data received from the ultra-high resolution camera 10 can be transmitted to the receiving terminal 5 possessed by the service user using the streaming service.

To this end, the multi-streaming server 3 may store image data transmitted by each of the ultra-high resolution cameras 10 provided in at least one or more IP-based mobile bodies 1 into a database.

And when the multi-streaming server 3 receives information requesting the provision of video data, including at least one control condition among the control location, control radius, and control time, from the receiving terminal 5 of the service user, the control condition corresponds to the control condition. It is possible to transmit the video data to the receiving terminal 5 that has requested the provision of the video data.

Here, the control time may be the start and end time of the video or real time, and the multi-streaming server 3 transmits recorded video data stored in advance for recording relay to the receiving terminal 5 based on this control time. or select and transmit image data to be transmitted in real time for real-time streaming.

That is, when the control time received from the receiving terminal 5 is the start and end time of the video, the multi-streaming server 3 performs a recording relay for transmitting video data corresponding to the corresponding time among stored video data, When the control time received from the receiving terminal 5 is in real time, real-time streaming is performed in which video data corresponding to the control position and the control radius are selected and transmitted.

This multi-streaming server 5 may include real-time decoding and screen output functions of images compressed with H.264 and MJPEG.

In addition, the multi-streaming server 3 may perform functions of outputting, controlling, and recording real-time video by configuring a screen through a graphical user interface (GUI).

And when the above super-resolution camera 10 is provided with 36 image sensors 113 as shown in FIG. 5, the multi-streaming server 3 displays the monitoring of the images collected from the 36 image sensors 113. And at the same time, streaming of images collected from 16 image sensors 113 may be received.

In addition, the multi-streaming server 3 can perform real-time transmission/control/recording of 64 channels (CH) of the monitoring software, and can also perform a streaming relay function of a total of 256 channels.

In addition, the multi-streaming server 3 is a cloud platform that provides a cloud-based simultaneous multi-transmission platform (5G, LTE, Wifi, etc.), a redundant relay server, a data request receiving daemon, simultaneous access management for each camera/client, and each camera It may further include image sensor reception/relay interworking, DDNS server, OS (operating system) such as Linux or Windows.

Although various embodiments of the present invention have been shown and described above, the present invention is not limited to the specific embodiments described above, and is commonly used in the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. Of course, various modifications are possible by those with knowledge of, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

1: IP-based moving object 10: Ultra-high resolution camera
11: lens 111: substrate
111 ': grid 113: image sensor
3: multi-streaming server 5: receiving terminal

Claims (5)

In the ultra-high resolution camera including a plurality of lenses,
the lens,
Board; and
An ultra-high resolution camera comprising a plurality of image sensors located on the surface of the substrate and arranged in a grid dividing an image collection area on the substrate into nxn.
According to claim 1,
An ultra-high resolution camera, characterized in that the grating dividing the image collection area on the substrate into nxn is provided in the same size for each of the plurality of lenses.
According to claim 2,
The plurality of image sensors,
The ultra-high resolution camera, characterized in that it is arranged at a specific position within the grid partitioned by nxn, so that the sum of the areas projected by each of the plurality of image sensors can fill the entire grid.
According to claim 3,
When the plurality of lenses are provided in four, the specific position where the plurality of image sensors are arranged,
A plurality of image sensors provided on lenses adjacent to each other along the horizontal axis are positioned in the same row in the grid, but at positions where columns cross each other, and a plurality of image sensors provided on lenses adjacent to each other along the vertical axis are located on the same row as each other. An ultra-high resolution camera, characterized in that it is located in a column, but a position where rows intersect with each other.
It includes a substrate and a plurality of lenses including a plurality of image sensors located on the surface of the substrate and arranged in a grid in which an image collection area on the substrate is divided into nxn, and the collected image data is transmitted to a server. ultra-high resolution camera; and
A multi-streaming server that receives the image data from the ultra-high resolution camera and provides the image data corresponding to the control condition to the receiving terminal when a control condition is received from a receiving terminal of a service user using a streaming service, Real-time control system.

Images