CN103595996B - A kind of multiview data transmission method that is applicable to real three-dimensional display system - Google Patents
A kind of multiview data transmission method that is applicable to real three-dimensional display system Download PDFInfo
- Publication number
- CN103595996B CN103595996B CN201310636446.9A CN201310636446A CN103595996B CN 103595996 B CN103595996 B CN 103595996B CN 201310636446 A CN201310636446 A CN 201310636446A CN 103595996 B CN103595996 B CN 103595996B
- Authority
- CN
- China
- Prior art keywords
- data
- display control
- computer
- array
- collecting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
The invention discloses a kind of multiview data transmission method that is applicable to real three-dimensional display system, described real three-dimensional display system comprises camera array, collecting computer group, Display control computer group and array of rear-projectors, comprise the step of determining every collecting computer and the LAN IP address of Display control computer and the step of corresponding relation thereof, carrying out image information collecting, calibration and coding, and the step such as data decode and output. The present invention proposes the data processing method of new real three-dimensional display system, in traditional transmission means, simplified protocol package design, reduce data volume; Between camera array and displaying projector array, use multicast to transmit, fit applications layer algorithm, has simplified redundant data from various visual angles, has the more display effect of high-quality.
Description
Technical field
The present invention relates to a kind of data transmission method for display system, relate in particular to one and be applicable to very three-dimensionalThe data transmission method of display system.
Background technology
Along with scientific and technical development, true dimension display technologies makes that the object in physical world is carried out to three-dimensional and showsBe shown as for possibility. The 3-D view of shown object is life-like, provides complete psychology and life to spectatorsReason three-dimensional perception information, for understand 3-D view and wherein the spatial relationship between object unique hand is providedSection, thereby there is high science, society and commercial value.
In true dimension display technologies, because the data that comprise multiple visual angles of 3 d image data are conventional two-dimensionalTens times of view data, its feature is that data volume is large, data redudancy is high, traditional coding, transmissionMode can not effectively adapt to the transmission requirement of multi-view image.
Summary of the invention
Technical problem
The technical problem to be solved in the present invention is to provide a kind of transmission side data that is applicable to real three-dimensional display systemMethod, the view data that can produce multiple viewpoints is processed, and transfers to display device demonstration realtime graphic.
Technical scheme
In order to solve above-mentioned technical problem, the transmission of the multiview data for real three-dimensional display system of the present inventionMethod arranges based on real three-dimensional display system, and described real three-dimensional display system comprises camera array, collectionCalculate unit, Display control computer group and array of rear-projectors, wherein, every at least two of collecting computer correspondence is aobviousShow computer, camera array is connected with collecting computer, and array of rear-projectors is connected with Display control computer, the methodComprise the following steps:
Step 1: determine that camera number in the camera array that every collecting computer supports, every show meterProjecting apparatus number in the array of rear-projectors that calculation machine is supported, and definite every collecting computer and Display control computerLAN IP address and corresponding relation thereof; The view data collecting is sent to actual will locating by collecting computerOn the Display control computer of reason view data, carry out corresponding transmission IP according to actual content;
Step 2: every collecting computer gathers the image information of each camera in camera array, and to adoptingThe image information of collection is carried out the calibration of many viewpoints and coding; The object that the image gathering is encoded is to solve formerThe problem that beginning view data is very large, makes view data reduce to be convenient to computer by coding and processes;
Step 3: after the end-of-encode of collecting computer, immediately send data to Display control computer, according toMulti-view point video Data Transport Protocol sends at least two demonstrations corresponding with collecting computer by data simultaneouslyComputer;
Step 4: every Display control computer receives after data, docks according to multi-view point video Data Transport ProtocolReceive data and resolve, obtain video data, and video data is decoded, obtain multichannel visual angle original numberAccording to, then isolate the multichannel perspective data that belongs to every Display control computer;
Step 5: every Display control computer is according to the Data Update timestamp in transmission protocol package, by step 4The multichannel perspective data obtaining is from corresponding projecting apparatus output.
The gatherer process in each cycle is realized by synch command. One in collecting computer group to all the other everyCollecting computer user datagram protocol mode is sent synch command, and all the other every collecting computer is (followingBe called for short " PC ") receive synch command, start new gatherer process once.
The multi-view point video Data Transport Protocol that the present invention proposes, fully takes into account every frame data of multiview dataLength is larger, is conventionally greater than the single view video data of homogenous quantities, thus directly in agreement with less fieldRealize a point package operation, in the time of large transfer of data, had better transmission performance. Its message structure comprises following eightIndividual field:
Packet header indicates SOF: for indicating the beginning of a packet, length is 2 bytes, and content is ' S ', ' T 'Ascii value;
Sequence number SEQ_NO: for indicating the number that sends packet, length is 2 bytes, every transmission oneIndividual packet, its value adds 1;
Time stamp T IMESTAMP: for indicating the time of this packet capture, length is 4 bytes, this wordThe content of section is using the basis of time upgrading as display end;
Whole bag total length TOTAL_LEN: indicate the total data length comprising when last frame data, length is 4Byte;
Current bag plot BASE_LEN: indicate the initial address of current bag data in current frame data, longDegree is 4 bytes;
Current packet length BUF_LEN: indicate the payload length of current bag data, length is 2 bytes;
Packet header verification HEADER_CRC16: for the above extremely current packet length of SOF that indicates from packet header of verificationAll fields of BUF_LEN, length is 2 bytes, its value is used CRC16 algorithm to obtain;
Data packet payload BUF: the payload data of current bag, its length is by current packet lengthBUF_LEN field determines.
Above-mentioned host-host protocol also can represent by following table:
Above-mentioned host-host protocol, it uses system environments to determine that N gathers PC simultaneously to 2N demonstrationPC sends protocol data, and the conflict in LAN can aggravate, and its isotonicity that arrives data will reduce. CauseThis protocol definition receive strategy, to ensure overall transmission performance.
Beneficial effect
The present invention proposes the data processing method of new real three-dimensional display system, in traditional transmission means,Simplify protocol package design, reduced data volume; Between camera array and displaying projector array, use multicast to carry outTransmission, fit applications layer algorithm, has simplified redundant data from various visual angles, has the more display effect of high-quality.
Brief description of the drawings
Fig. 1 is real three-dimensional display system of the present invention and multiview data transmission principle figure;
Fig. 2 is the reception schematic flow sheet of host-host protocol of the present invention.
Detailed description of the invention
Below in conjunction with accompanying drawing, technical scheme of the present invention is further described.
As shown in Figure 1, the multiview data transmission method institute base that is applicable to real three-dimensional display system of the present embodimentIn real three-dimensional display system arrange as follows: every gathers the camera number supported of PC is 8, and every is aobviousShow that the projecting apparatus number that PC supports is 4; The image source number that the number of units of collection PC is processed as requiredAmount is definite, and every gathers corresponding 2 the demonstration PC of PC, determines and be wherein numbered the collection PC couple of No. 1 simultaneouslyRemaining gathers PC and uses UDP multicast mode to send synch command, and every collection PC receives synch command,Start new gatherer process once.
The method of the present embodiment comprises the following steps:
Step 1: determine that camera number in the camera array that every collecting computer supports, every show meterProjecting apparatus number in the array of rear-projectors that calculation machine is supported, and definite every collecting computer and Display control computerLAN IP address and corresponding relation thereof;
Step 2: every collection PC gathers No. 8 cameras, and carries out calibration and the volume of multiview dataCode;
Step 3: after gathering the end-of-encode of PC, immediately send data to and show PC; When transmission,The host-host protocol that uses the present invention to propose sends to 2 corresponding demonstration PC by data simultaneously;
Step 4: every shows that PC receives after data, utilizes host-host protocol that the present invention proposes to receiving numberAccording to resolving, obtain video data, and video data is decoded, obtain 8 visual angle, tunnel initial data,Then isolate the 4 tunnel perspective data that belong to this demonstration PC;
Step 5: every shows that PC is according to the Data Update timestamp in protocol package, by step 5) middle acquisition4 tunnel perspective data are from No. 4 projecting apparatus outputs of correspondence.
The host-host protocol that the present embodiment uses, it uses system environments to determine that N gathers PC simultaneously to 2NIndividual demonstration PC sends protocol data, and the conflict in LAN can aggravate, and its isotonicity that arrives data will be fallenLow. Therefore protocol definition receive strategy, to ensure overall transmission performance, as shown in Figure 2, receiving stepAs follows:
1) bottom UDP message receiving thread is constantly monitored udp port, if can receive data, continues to detectListen; If the data of receiving, proceed to step 2);
2), according to current subdata bag accepting state machine, by the UDP initial data and the length thereof that receive, insertSubdata bag buffering, if also do not receive completely, exits current check and returns to step 1) continue intoRow receives; If reception data integrity, proceeds to step 3);
3) reception of group packet data is complete, carries out verification operation, if verification is not passed through, enters step4); If verification is passed through, enter step 5);
4) verification of subdata bag is not passed through, and empties the accepting state machine of subdata bag, exits and return step 1)Continue to receive data;
5) verification of subdata bag is passed through, by the sequence number SEQ_NO in subdata bag, timestampTIMESTAMP field and local frame data buffer queue, judge whether this subdata bag belongs to brand-newOne frame, if not new frame, enters step 6); If new frame enters step 9)
6) the corresponding frame of this subdata bag exists, so find out corresponding from local frame buffer queue the insideFrame buffering, and enter step 7);
7) according to the current bag plot BASE_LEN of subdata bag and current packet length BUF_LEN field, willIts payload data is inserted the correspondence position of frame buffering, and enters step 8);
8) after subdata bag data are inserted, check whether frame number receives complete, enter step 13 if complete);If imperfect, upgrade the time-out time of present frame, and enter step 12);
9) if the corresponding frame of subdata bag is not also present in frame buffer queue, create so a new frame numberAccording to buffering, initially some state parameters of this frame, comprise the frame timeout time; Then by this frame bufferingAdd buffer queue, and enter step 10);
10) according to the current bag plot BASE_LEN of subdata bag and current packet length BUF_LEN field, willIts payload data is inserted the correspondence position of frame buffering, and enters step 11);
11) after subdata bag data are inserted, check whether frame number receives complete, enter step 13 if complete);If imperfect, enter step 12);
12) start the time-out check of frame buffer queue, overtime frame buffering is removed and buffer release from queue;
13) frame data reception is complete, and data are passed to upper strata, and buffer release.
Wherein, UDP (UserDatagramProtocol) is UDP, is that open system is mutualThe connectionless transport layer protocol of one in gang mould type.
Claims (1)
1. be applicable to a multiview data transmission method for real three-dimensional display system, described real three-dimensional display systemComprise camera array, collecting computer group, Display control computer group and array of rear-projectors, wherein, every gathers meterAt least two Display control computers of calculation machine correspondence, camera array is connected with collecting computer, array of rear-projectors and demonstrationComputer connects, and it is characterized in that, the method comprises the following steps;
Step 1: determine that camera number in the camera array that every collecting computer supports, every show meterProjecting apparatus number in the array of rear-projectors that calculation machine is supported, and definite every collecting computer and Display control computerLAN IP address and corresponding relation thereof;
Step 2: every collecting computer gathers the image information of camera in camera array, and to gatheringImage information carry out the calibration of many viewpoints and coding;
Step 3: after the end-of-encode of collecting computer, immediately send data to Display control computer, according toMulti-view point video Data Transport Protocol sends at least two demonstrations corresponding with collecting computer by data simultaneouslyComputer, wherein, described multi-view point video Data Transport Protocol represents by following table:
Step 4: every Display control computer receives after data, resolves receiving data according to host-host protocol,Obtain video data, and video data is decoded, obtain multichannel visual angle initial data, then isolate genusIn the multichannel perspective data of every Display control computer;
Step 5: every Display control computer is according to the Data Update timestamp in transmission protocol package, by step 4The multichannel perspective data obtaining is from corresponding projecting apparatus output; One in collecting computer group all the other every is adoptedCollection computer user datagram protocol mode is sent synch command, and all the other every collecting computer receives sameStep command, starts new gatherer process once.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310636446.9A CN103595996B (en) | 2013-12-02 | 2013-12-02 | A kind of multiview data transmission method that is applicable to real three-dimensional display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310636446.9A CN103595996B (en) | 2013-12-02 | 2013-12-02 | A kind of multiview data transmission method that is applicable to real three-dimensional display system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103595996A CN103595996A (en) | 2014-02-19 |
| CN103595996B true CN103595996B (en) | 2016-05-04 |
Family
ID=50085956
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310636446.9A Expired - Fee Related CN103595996B (en) | 2013-12-02 | 2013-12-02 | A kind of multiview data transmission method that is applicable to real three-dimensional display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103595996B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105474638A (en) * | 2014-05-27 | 2016-04-06 | 联发科技股份有限公司 | Systems for providing image or video to be displayed by projective display system and for displaying or projecting image or video by projective display system |
| CN104735438B (en) * | 2015-03-09 | 2017-04-05 | 南京航空航天大学 | A kind of multiview data acquisition method based on compression sensing |
| CN104717482A (en) * | 2015-03-12 | 2015-06-17 | 天津大学 | Multi-spectral multi-depth-of-field array shooting method and shooting camera |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4571212B2 (en) * | 2008-09-26 | 2010-10-27 | 藤倉ゴム工業株式会社 | Golf club shaft and golf club using the same |
| CN101527865B (en) * | 2009-01-05 | 2010-09-01 | 清华大学 | Projection type high-resolution multi-view auto-stereo display system |
| CN102945564A (en) * | 2012-10-16 | 2013-02-27 | 上海大学 | True 3D modeling system and method based on video perspective type augmented reality |
| CN103260041A (en) * | 2013-04-25 | 2013-08-21 | 南京航空航天大学 | Multi-viewpoint automatic light-splitting three-dimensional display device of scene |
-
2013
- 2013-12-02 CN CN201310636446.9A patent/CN103595996B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN103595996A (en) | 2014-02-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104375789B (en) | The synchronous display method and system of mosaic screen | |
| US11024092B2 (en) | System and method for augmented reality content delivery in pre-captured environments | |
| CN103268209B (en) | Television wall | |
| PH12018502093A1 (en) | Information display method, device and system | |
| CN104243920B (en) | A kind of image split-joint method and device encapsulated based on basic flow video data | |
| CN103595996B (en) | A kind of multiview data transmission method that is applicable to real three-dimensional display system | |
| KR20050014893A (en) | Image data delivery system, image data transmitting device thereof, and image data receiving device thereof | |
| CN103986960A (en) | Method for single-video picture division route teletransmission precise synchronization tiled display | |
| CN103677701B (en) | The method and system of large-size screen monitors simultaneous display | |
| CN104639994A (en) | Video abstraction generating method, system and network storage equipment based on moving objects | |
| CN102857703A (en) | High-definition video character superimposing system and control method | |
| WO2022022501A1 (en) | Video processing method, apparatus, electronic device, and storage medium | |
| WO2018121699A1 (en) | Video communication method, device and terminal | |
| CN104125461B (en) | A kind of large-sized image compression processing system and method | |
| CN107147465A (en) | A kind of exchange clock isochronous controller and control method towards time-triggered network | |
| CN105516542A (en) | Multichannel video synchronization system based on hardware encoders and synchronization method thereof | |
| RU2013143046A (en) | SYSTEM AND METHOD FOR TRANSFER OF IMAGES IN REAL TIME | |
| CN110463212A (en) | The low latency pipeline being packaged for media to Ethernet frame | |
| WO2018095003A1 (en) | Method and apparatus for real-time transmission of multimedia data | |
| CN113382365B (en) | Pose tracking method and device of mobile terminal | |
| CN106454152B (en) | Video image joining method, device and system | |
| CN102625125A (en) | Method for transmitting high-resolution and multi-view stereoscopic video in real time | |
| CN104394229A (en) | Large file uploading method based on concurrent transmission mode | |
| CN103313073B (en) | The method and apparatus send for 3 d image data, receive, transmitted | |
| CN103956177A (en) | Board level extendible type video-on-demand system based on Internet of Things |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160504 Termination date: 20181202 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |