CN105684415A - Spherical omnidirectional video-shooting system - Google Patents

Abstract

A system is described for 360-degree spherical and stereoscopic video recordings, also adapted to view and send data wirelessly to other devices, said system comprising: a structure (3, 5, 6) supporting an electronic board (16) where a microprocessor (1) and other electronic components are houses; at least two electronic high-definition wide-angle cameras (2), with an upper angle of 100 -degree, inserted in the structure (3) and arranged radially from the center of the apparatus designed to create spherical photos and videos, wherein said system is suitable for recording at the same time also in stereoscopic mode, producing already merged images, stitching in real time signals from different optics, and transferring them to remote devices through a wireless module present therein, eliminating the distortion of images.

Description

Spherical panoramic video camera system

Background of invention

The present invention relates to spherical panoramic video camera system. The innovative function of native system is in that real-time recording, making spherical video are also transmitted to remote equipment by wireless signal. Especially, it is an object of the invention to 360 ° of comprehensive record images and video; This mini system has two or more wide-angle lens, and the geometric arrangement in framework is combined.

The visual angle being limited in that recorded video of modern photographic head is extremely narrow and small, thus cannot record many important details. For operator, more difficult is in order to record photographic head behind or outside frame elsewhere, it is necessary to rotates camera lens, and can miss a lot of details.

Native system and integrated software thereof provide unlimited potentiality: have two or more photographic head and the integrated live signal from each photographic head internal inside it, make panorama short-movie. Therefore, it is thus achieved that film can be trimmed into required video section, it is allowed to user can set up the timeline of oneself by continuous shooting, is uploaded to network subsequently, or sends the spherical video part recorded to remote equipment. This system also above can use and/or integrated at portable phone (smart mobile phone), therefore, many people intrasystem camera lens can be utilized to record panorama content simultaneously, and use modern telephone, namely the front camera and rear camera of the smart mobile phone of this kind equipment it is suitable for, specifically as shown in figure 16.

Classics are made video recording and are usually incident upon on semicircle IMAX screen, and the latter can allow spectators be in scene center, on the spot in person, just as in full empty open air at starlit night. Optimizing wide-angle lens even if using, the classical video of current photographic head recording also can reach 30 frames per second, and its pick-up lens is circular, and picture peripheral point exists distortion and higher loss of resolution, because its distance seizure picture center is distant. According to the tradition of theater scene and picture shape, picture is generally cut into square. So, the effective area major part of production is all wasted. Rectangle ratio is the picture of 1:1.85, during for dynamic image, is merely able to record the 53% of circular area.

Vital document previously with respect to the present invention has: US-A-7.710.463, US-A1-2009/0.278.917AleUS-A-7.003.136.

Present invention aim to address above-mentioned foregoing problem. Proposed mechanism is very small, sealing is good, can bear more than 20 atmospheric pressure, can be used for film, monitor video, advertisement, safety check, can not enter or video detection impurely, on unmanned plane and submarine, parachute, or as human body endoscopic probe, or it is integrated on battery, smart mobile phone. Native system is specifically designed to setting screen and video, especially can 360 ° record digital pictures; Special release also can carry out solid and make video recording; It it is the camera system of one the 360 ° digital 3D Radix Rumicis pictures of recording. System is made up of multiple photographic head, stereoscopic version at least has four photographic head, each ken has two photographic head, often shooting quadrant is equipped with a pair photographic head, contribute to allowing user obtain stereo vision: the picture that the photographic head of system catches can cover whole 360 ° of kens, thus building a series of 3D pictures on the spot in person and video, 3D stereoscopic motion picture or 360 ° of short-movies.

The camera lens of new digital camera head has high-resolution, and the picture of top quality 5,10 or higher million pixels can to reach 30-60,100 frames per second, add the electronic processors of powerful speed, sustainable development, this multi-cam, high-resolution invention is all enable to capture video data and picture, the picture of record three-dimensional panorama and video, thus producing film on the spot in person.

Especially, camera lens is suitable for USB3 interface, but system can accept ratio thunderbolt2 video stream faster, without any restrictions, becomes the open system that can receive new element. Video stream from different camera lenses is integrated in a unique panorama by system processor, and is recorded in the photography data base of internal system and/or is sent to remote equipment by the high-speed radio module of the system integration. Utilize the film that this advanced technology shoots can project on flat screen, it is possible to project the semi-circular vault of theater. If using classical camera shooting, for the video of flat screen when being shown to such as the cambered surface of dome, IMAX screen, distortion can be produced, the video using 360 ° of panoramic technique productions does not then have distortion, both can project on flat screen, it is possible to be projected on spherical screen, operating room display, traffic display or monitoring screen, telescreen. By three-dimensional camera lens, film can become fascinating and " 360 ° without dead angle ", and equipment also can be recorded, thus bringing the visual experience that spectators have reality sense, they are just at the center of scene seemingly.

In order to create the whole semicircular continuous image of filling, it is necessary to rotate image by covering the camera system of the whole ken, or adopt the image that this type of arc, cylindricality equipment or circular screen be suitable for, adopt the image under this patent camera lens. The present invention in technological innovation it is important that by containing (two or more) photographic head, be arranged on sphere, system on the module frame of hexahedron, dodecahedron or any shape (without size and dimension restriction), generate sphere 3D panoramic video, record whole surrounding pictures from shooting angle 360 ° without dead angle. Other one big innovation is that by shooting on the spot in person, uses the front camera and rear camera of modern cell phones, intelligent machine, panel computer. This patent can be additionally used on classical camera; May be installed recording different angles on mast, in conjunction with from each photographic head, including the video signal of classical photographic head, thus building panorama.

Different from existing other system, in this video recording system, merge Mathematic calculation method by the picture in device microprocessor, on machine, video signal can be combined by software in real time. HD video projects, produced result is that a series of picture can cover the whole ken (being 180 ° of x180 ° of sphericals in this situation), and it is absent from any visual distortion, sense on the spot in person in diameter of Spherical Volume is provided for spectators, spectators are as observer, by integrated video, place oneself in the midst of in virtual video seemingly, have no to discover to camera lens distortion. This is because system has the camera lens of two or more at least 2 million pixels, from 360 ° of whole kens of real-time recording of shooting angle.

Relative to currently existing scheme, being particular in that of present system supply source mini, autonomous, portable, enable in particular to directly produce panorama in inside, auxiliary without other equipment, thus make the camera system containing wide-angle lens seem unique and have new meaning, it can carry out three-dimensional recording, the live signal from different camera lenses being combined, being converted thus creating full-view image, and available wireless system sends in real time to other equipment.

Video and the photo recorded all are stored in the storage card on machine. Additionally, system further provided with can follow shot, formulate the GPS locating module of path analysis and obtain the diastimeter of other article distance parameter data, these information all can be aggregated as metadata and store in systems.

The aspect that other are highly innovated describes as follows.

In recent years, people often can talk interactive TV, although the latter rarely has effect at present. Native system introduces new important innovations theory. Nowadays the progress of Utopia's formula, idea is rarely had to be capable of, barely satisfactory in other words, it is impossible to bring enough achievements to terminal client. Existing system on the market is both needed to by the manual acoustic control of TV or touch-screen equipment or management, but lack with TV " object ", network, user concrete real-time interactive.

The conceptual design of network is fallen behind, and spectators are completely in passively: they can only watch the picture that director to present, without any type of interaction: unique interaction is likely to be exactly zapping.

Additionally, all video systems, all there is including video monitoring system very big limitation: can only use and preset camera lens, it is desirable to be only > wide-angle lens of 90 ° records picture; This recording mode being confined to photographic head periphery square frame is obviously very unfavorable, and causes insurmountable barrier.

It is capable of the real-time interactive between photographic head and user currently without any system, the panoramic video content with user interaction, picture can be propagated without any TV network.

Although user can be allowed to upload content as networks such as Youtube, but interaction cannot be produced with the video uploaded, especially in real time.

Here it is one of maximum innovation of native system: the design of new system is from four brand new ideas, and these theories also become the basis of present patent application system:

1. according to our definition, native system is available for TV network, precisely it is able to send in real time used by the photographic head of data, 360 ° × 180 ° of panoramic videos of production, it is equipped with multiple optical lens, can remotely control, also introduce the new ideas made video recording: relative to high definition " standard " equipment or pal mode, native system equipment has lot of advantages, such as:

360 ° of x180 ° of visuals field;

The resolution of 10 times is gone out than standard camera head height; 100,000,000 pixels or higher can be reached;

Real-time audio-video crossfire: spectators can become the director of real-time video, can indiscriminately ad. as one wishes watch the individual program of uniqueness, appear the instructor in broadcasting's point at full-view camera seemingly, can make a choice according to individual's preference angle, without by the choice with regard to event instructor in broadcasting, thus spanning the limitation that conventional video is impassable;

Unique: spectators can place oneself in the midst of different location viewing, or watch multiple event simultaneously.

2. the sharing and upload of content: user not only can select required video section from this patent panoramic shooting, additionally it is possible to by real-time uploaded videos streaming server, the content uploading recorded by full-view camera. Also may be viewed by the content created with " browsing " other connection clients, in shared video conference (such as teleconference), carry out interaction and participation. It is the new forward position of interactive TV: each user becomes TV producer, the short-movie can uploaded by its people's unit, phone or flat board synchronous browsing different user, participates in panorama teleconference.

3. combine the video management software (real-time video splicing) in different video source in real time. Equally, this software can also pass through single camera lens, merges the video signal of classical photographic head, thus setting up 3 D video and human biological's feature identification analysis.

4., by flat board, mobile phone and intelligent television, user can select inside 360 ° of spherical panoramic video and cutting creates the part needed for new scene. It makes user will not miss any details in space near this patent full-view camera, is different from classical camera, and the latter would generally be fully contemplated by all details, thus produces certain limitation, and when being used for monitoring, also there is a crack to squeeze through.

Based on these innovations, revolutionary new concept, it can be appreciated that even for being ignorant of multimedia people, this patent system also provides unlimited potential quality, it is suitable for multiple different application.

Give the credit to many optional options, present system provides the innovation mode of different photographic head, the video signal combination of different resolution, shearing.

Otherwise, in this theory, after the video signal in unidirectional different optical lens is combined, it is possible to make the 3 D video of single object, it is possible to use the data of living things feature recognition and/or long-distance ranging carry out shape, dimension analysis.

Once and require that the system described in 1 combines, this feature and above-mentioned advantage can realize, and specifically can see below proof. What the present invention did not follow the beaten track choose the easy way out, and shape has catered to concrete requirement.

Should be appreciated that clear being required is all that this describes inalienable part.

Description of the invention can referring to end product example, and these examples (containing figure) include but not limited to as follows:

Fig. 1 shows the shape of system and printed circuit board (PCB), which includes each element, the digital miniature photographic head containing the 2000000 above optical lens of pixel.

One of Fig. 2 shape showing invention system, framework 3 therein is spherical shape, employs in two optics of solar energy camera lenses 2, figure and also show display 9 and function button.

Fig. 3 shows a kind of form of combined system, employs the form of the corresponding frame 3 of three optical lens 2, also show the state of LED10, memory card slot 13, any spider or installation and pedal the USB3 interface 12 of the screw thread 11 of frame, data exchange in figure.

Fig. 4 shows a kind of form side of combined system, and framework 5 therein is hemisphere face, containing also show applicable spider 4 in six optical lens 2, figure.

Fig. 5 shows a kind of form side of combined system, and framework 6 therein is equipped with in spherical optics camera lens 2, figure and also show applicable spider 4.

Fig. 6 show part dismantled system shape perspective view, coquille head-room 2 framework 17, additionally show the electronic component on printed circuit board (PCB) 16 and microprocessor 1.

Fig. 7 a, 7b show that each is repaired the radial direction of the cone 19 and installs front view, and these cones are 15-20 degree superposition, the whole hemisphere face of coverage rate.

Fig. 8, by using lens barrel frame 6 machine parts, screen is integrated with different video signal, defines sphere image video.

Fig. 9 shows a screen being integrated with different optical lens recorded video, and integrated is realized by the arithmetic of the video-splicing software in microprocessor.

Figure 10 shows the communication interface between electrofax optical lens, microprocessor, battery and USB3 video frequency output, wireless module, other system integrated equipment.

Figure 11 shows that various video signal, metadata are after combination, are sent to the method for remote equipment, flow process example in real time, are specifically shown in Figure 16.

Figure 12 shows that device interior two closes on picture example and the process segment that optical lens is recorded.

Figure 13 and 14 then shows the 15-20% Overlay 19 of this two frames picture.

Figure 15 shows that how equipment is by wireless module, sends picture, video, metadata to remote equipment in real time, and produces interaction with the latter.

Figure 16 a, 16b, 16c show, on equipment, the software of highly innovation can be applicable on the classical camera of the purposes such as modern smart mobile phone, flat board, mobile phone and monitoring, can pass through unrestrictedly to use front camera and rear camera, reach the recording purpose of 360 °: Figure 16 shows two. Digital camera head and recording angle: Figure 16 a is front view, and Figure 16 b is rearview, and Figure 16 c is side view.

Figure 17 shows device version and handle 18, travelling support 4.

The present invention is mainly constituted by with lower component:

-one framework, aluminium or composite are preferred, and comprise electronic component and at least two optical lens;

-one processor and other electronic components, available new software and hardware and miscellaneous part update together;

-a series of 2,000,000 pixels, containing the photographic head of wide-angle lens recording angle at least 90 °;

-one frame structure, is made up of aluminium or composite and is preferred, and comprises electronic component and multiple optical lens, and the latter often records a pair of quadrant (stereoscopic version);

-extensible tube, is used for installing, and 5-25 centimetre is preferred;

-for the structure base slab installed;

-input/output interface, can install certain types of USB3 or data line faster;

-battery charger;

-wireless module;

-GPS module;

-LED state (at least two);

-the pop one's head in parachute or spider that are suitable for;

-display screen (at least one);

-gyroscope;

-gsm module;

-storage card;-remote measuring laser diastimeter;

The motor of the mobile system on-wheel or propeller, it is possible to move on ground, aerial, liquid surface, conduit;

-stereophony microphone (at least one).

The present invention relates to the system containing at least two number optical lens, the latter is recorded by solid, produces panorama type picture and video, builds the 3D environment of on the spot in person 360 °. System at least uses two photographic head, if using six or 11 photographic head, better; In stereoscopic version, the photographic head number of each shooting quadrant to double, and optical lens is at least up to 2,000,000 pixels, shooting angle > 100 °, producing superposition by visual structure, thus producing 360 ° of scene cover type picture datas, shooting angle overlap to be at least 15-20 °.

The data collected are the process through each photographic head data recording device, can pass through wave point or USB3 wiring, more excellent technology is sent to remote equipment in real time. The triangle polyester fibre affecting data of the available overlapping framework of camera system, thus createing the real scene 3D model of 360 °.

Its internal optional parachute also having a stereophony microphone, wireless module position finder (GPS), diastimeter, bluetooth module, battery GSM-4G module, storage card and accelerometer to drive.

It addition, the present invention is also a convertible component models camera system, its configuration is enough to shoot the whole hemisphere face space of the ken; Additionally, this system has only to a bit manipulation person, a photographic head when photography, owing to its size is little, lightweight, it is possible to shoulder piggyback, or be placed on automobile, aircraft, unmanned plane, helicopter or other move in equipment mobile.

Especially the microprocessor of device interior has the blending algorithm of executable instruction and data recording, comprises the steps of

-obtain image;

-arrange the image data of multiple thecamera head;-obtained by mike and picture data almost voice data simultaneously;

Process in the shooting picture ken, superposition angle is approximately the data of multiple photographic head of 15-20 °;

-to the process of telemetry gathered;

-by the numbering video of each optical lens of microprocessor editor and audio frequency, form spherical picture by merging;

360 ° of spherical video files recorded of-generation device systems storage inside;

-by wireless module, image is sent to remote system (cloud/the Internet).

Native system is water-fast, maximum bears 20 atmospheric pressure and the corrosion of resistance to air, chemical mediator. Can be connected to, on flexible pipe, move at inside of human body as endoscope probe, or be connected on pipeline and video, thus being used for monitoring. The built-in microprocessor of photographic head, by arithmetic method, processes the data of different optical lens: the data of first, second, third digital pick-up lens sheared, the data of three photographic head of convergent-divergent, rotates the image data produced; Therefore can adjusting the visual characteristic of one or more picture, thus changing exposure, color, brightness and contrast, subsequently each picture being carried out the superposition of about 20%, thus generating a unique video. The image that these microprocessors produce is at least up to 30 frames per second, the final smooth video produced can be presented by external system, system also has the detector of a video ranging data, and by physical interface or wireless module, carries out data transmission with the speed of 1GB at least per second.

System also has the slot of an image store card; One wireless module for microprocessor, its function includes spherical video transmission to remote equipment, unit, flat board, network, mobile phone.

System also contains a drogue-parachute guided by accelerometer: parachute system enables to render to soil, can not arrive region, remotely monitors region.

This system also has a special release, is equipped with tiny engine, Automatic Propulsion System, such that it is able to shuttle back and forth on high, liquid, soil, pipeline, or as endoscope probe.

May be equipped with gyroscope and accelerometer, thus determining the quickening rotated. These data store as the rotation metadata of system.

This system also comprises a global positioning system (" GPS "), so that it is determined that the alliance change during cam movement: these data will, in the GPS that be stored as metadata in system, be used for analyzing and generate image or model.

In ROM storage version, system also has spherical video browsing file arithmetic method, a video record direction audio frequency: obtains video and can be sent to spherical video display wirelessly. This display screen is controlled by computer, is used for can passing through in the system that processes, virtual environment the 3 D video of mouse or touch screen " browsing ".

System additionally also has a virtual module, and this module transmits GSM data by the technology of 4GLTE or more high-end.

In a preferred approach, this system weighs about 180 grams, contains framework, optical lens and electronic component, battery, and its size is as follows: the diameter of endoscope's version is 10cm and 2cm, if using modern nanotechnology, it is possible to be low to moderate below 1mm.

In brief, the uniqueness of the present invention is just able to the All Around The World near captured in real-time equipment, the video of different photographic head is assembled, eliminates the distortion of picture, and form stereoscopic picture plane (suitable in stereo vision) by two pictures in each shooting quadrant. The data obtained can be also used for setting up the sound of various two-dimensional arrangement and draw squeezed: contribute to allowing operator browse whole visuals field framework, but operator cannot discover in a time, a picture or a video its behind, above and below things, it is different from and occurs at human eye, the visual field of human eye is about 90 °, equipment can be located to use for Control Room or security personnel, greatly reduces the quantity of the photographic head in monitoring room, related display.

The sequence that image and video produce can pass through wireless module or software sends, it is adaptable to standard individual's unit, touch screen or network, and this application contributes to 360 ° and browses whole scene, or builds the three-dimensional visual field.

Photographic head is radially distributed on the framework of plastics, aluminum or synthetic material. The ken of each photographic head is at least > 90 °, it is possible to overlapping with the ken of neighbouring digital optical lens. In order to build stereo vision. Each quadrant arranges two DV.

Claims (10)

1.360 ° of three-dimensional spherical video recording systems, are suitable for browsing data, and wirelessly send to other equipment, and this system includes:

One framework (3,5,6), has an electronic cards (16), a microprocessor (1) and other electronic components inside it; In at least two at least 100 °, built-in frame, (3), radial distribution are in high definition Radix Rumicis electro-photographic head (2) of equipment center, can be used for shooting sphere photo and video,

System can shoot by radial direction real-time volume wherein, and the live signal of different optical lens is merged and spliced, and by its wireless module by picture transmission to other remote equipments, eliminates picture distortion.

2., according to requiring 1, system needs configuration:

The touch screen (9) of-at least one function of browse, data and picture; The color LED (10) of-at least one display device state;

-electronic cards (16), GPS, accelerator, 3d rebuild the laser range finder of object, one can pass through wireless module, the synchronizer (7) transmitting data can be disconnected.

3. according to requiring 1 or 2, system may be used for air or liquid, on ground, or by electromotor, propulsion system drives, for natural disaster, earthquake, volcanic eruption region or Geographical Study, pothole region, video monitoring regional, it is also used as human body endoscope probe, or it is placed in amphibious aircraft and observes biological cycle system, the place that human eye is untouchable, this system is also able to record that audio signal, GPS location, ranging data, carry out the laser containing transmission image and data to follow the tracks of, and sent to other remote equipments by wireless conduit or bluetooth.

4., according to requiring 1 or 3, system needs apolegamy:

-one parachute, can automatically open up when it is declined by accelerometer, can be removed when system land and after being supported on spider 4 subsequently;

-for long-range two function keys (14,15) controlled.

5., according to previous any one requirement, native system needs apolegamy:

-one rechargeable battery;

The GSM of-one 4GLTE type or more highest version;

-accelerometer;

-gyroscope;

-one spider (4) or bracing frame special pedal frame (11), for placing helmet, equipment or additional support flange;

-replaceable flexible pipe (8), may be used in the endoscope probe pedaling frame (11);

-one wireless module, provides the use of access for other equipment;

-one bluetooth module;

-one ranging data detector;-one interface (13) for video, the additional memory card sheet of image detail;

The data I/O port (12) of-USB3 or more highest version

-at least one is for catching the stereoscopic full views mike of picture synchronization audio frequency;

-one data storage card;

-one microprocessor carrying out the integrated arithmetic of picture, its function includes image store, GPS, diastimeter, the data acquisition of accelerator and being wirelessly transferred and/or internal reservoir of data.

6., according to requiring 5, this microprocessor in system allows for implementing function such as:

-obtain the picture (19) of different camera lens, it is wherein each that to adjoin the ken having about 15-20 ° between camera lens overlapping;

-once obtain picture, it is possible to by data from each thecamera head to microprocessor; Process the data of GPS module, accelerometer, diastimeter; The data that-combination obtains, produce spherical picture effect after being combined by the picture of each optical lens;-generate spherical video file,

-after system sends data to remote equipment by integrated radio modules, it is also possible to it is recorded in internal memory card.

7., according to requiring 5 or 6, system can be also used for following operation :-from first, second, third so that more multi-cam obtain picture and shear;

The preliminary shearing picture of-convergent-divergent first, second, third or even more multi-cam;

-rotate the view data generated by video camera;

-on each picture, intercept the similitude (19) of overlapping region;-check similitude;

One place of-adjustment picture or many places visual characteristic, rotate, and changes exposure, color, brightness and contrast, is adjusted to 30 frames per second subsequently, and produces to be available for the smooth video that remote equipment uses.

8. according to previous any one requirement, system will configure: determines and rotates the accelerometer and gyroscope accelerated, and these data all will store as rotating metadata.

9. according to previous any one requirement, system has been required for GPS position finder such that it is able to determining that system moves the change in location of period, these data all will store as GPS global location metadata.

10. according to previous any one requirement, in the system of ROM storage therein, this patent system all should configure the arithmetic method of video file combination, including the audio frequency being created by photographic head, wirelessly sending to spherical video display; This display is managed by remote equipment, mobile phone, flat board, unit or similar devices, it is adaptable in process system, the 3 D video that can be browsed by mouse or touch screen, tridimensional virtual environment.