CN102377745A - Interactive collaboration system based on large spliced screen and interactive collaboration method - Google Patents
Interactive collaboration system based on large spliced screen and interactive collaboration method Download PDFInfo
- Publication number
- CN102377745A CN102377745A CN 201010256909 CN201010256909A CN102377745A CN 102377745 A CN102377745 A CN 102377745A CN 201010256909 CN201010256909 CN 201010256909 CN 201010256909 A CN201010256909 A CN 201010256909A CN 102377745 A CN102377745 A CN 102377745A
- Authority
- CN
- China
- Prior art keywords
- server
- circulation
- control end
- interactive
- streaming server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to an interactive collaboration system based on a large spliced screen, which comprises a streaming server and a steam forwarding server, wherein the streaming server is used for capturing the multipath display output of a remote high-performance system and respectively compresses the captured signal into multiple pixel streams; the steam forwarding server is positioned on the rear end of the streaming server and is used for collecting the pixel streams from each streaming server, and then, the pixel streams are forwarded to a client side system by a local area network or a private network; the client side system comprises one large-screen control end and one set of large spliced screen display system, wherein the large-screen control end receives a bit stream from the stream forwarding server; and meanwhile, the large-screen control end sends a message, feedback information and an interaction command for regulating a visual pixel area to the stream forwarding server. The invention also provides an interactive collaboration method based on the system. The interactive collaboration system has the advantages that the interactive collaboration system not only can display local information resource but also can remotely access the remote high-performance system.
Description
Technical field
The present invention relates to a kind of interactive cooperative system and interactive Synergistic method based on splicing large screen.
Background technology
No matter be that in order to increase work efficiency and quality, the user needs information sharing, needs the support of cooperative working environment under education, scientific research field or enterprise work environment.To the 3D graphing, the user thirsts for exchanging number of complex information in time, thereby helps them in the keen competition environment, to make correct analysis and judgement from simple text, video.Magnanimity information obtains, handles and show all and need build high performance storage, calculating and display system in such as army's alarm system, aerospace system, electric power water project operation, emergency commading system, finance, medical treatment, meteorology and even fields such as biological study and industrial manufacturing industry.
Multichannel, high-resolution splice displaying system can be assisted local information stores, treatment system usually, present high precision data information to the user.Export picture and huge screen clearly and greatly widened user's the visual field, enable to hold the core of information comprehensively and exactly.But the user still can not be satisfied with the information resources that on large-screen, only show this locality, and they also hope the high performance system in the strange land of remote access simultaneously.But also there is not a kind of such system can satisfy user's demand so far.
Summary of the invention
The purpose of this invention is to provide a kind of interactive cooperative system based on splicing large screen that can show that local information resources simultaneously can also remote access strange land high performance system.
In order to achieve the above object, a technical scheme of the present invention has provided a kind of interactive cooperative system based on splicing large screen, it is characterized in that, comprising:
Streaming server, the multichannel that is used to catch the strange land high performance system shows output, and the signal of catching is compressed into many pixel stream respectively;
Server is sent out in circulation; This server is positioned at the rear end of streaming server; In order to collect from the pixel stream of each streaming server, based on synchronized timestamp each hardwood is repacked and form a new bit stream, then it is forwarded to FTP client FTP through LAN or private network; Simultaneously; Circulation is sent out server and is accepted and handle the message from the adjustment visible pixel zone of FTP client FTP; Area size and scaling that this message semantic definition active client system is shown; Circulation is sent out server and is adjusted in real time the image processing process of front end streaming server with this message, and sends data to FTP client FTP; Circulation send out server also the feedback information through accepting FTP client FTP dynamically to the front end streaming server catch speed with compression quality is regulated and control, be responsible for interactive command to the strange land high performance system of forwarding FTP client FTP;
FTP client FTP comprises a large-screen control end and a cover splicing large screen display system, and the large-screen control end receives the bit stream of sending out server from circulation; Simultaneously, the large-screen control end is sent out message, feedback information and the interactive command that server sends adjustment visible pixel zone to circulation.
Another technical scheme of the present invention has provided a kind of interactive Synergistic method based on said system, it is characterized in that step is:
Behind the Streaming Media of the long-range demonstration output of the multichannel that step 1, one group of streaming server are caught the strange land high performance system it is compressed into many pixel stream respectively;
Advantage of the present invention is: the sharing of system's medium-long range rendered frame based on pixel stream, and adopted multi-channel synchronous to catch the operation with asynchronous coding, increased substantially the service end calculated performance.According to the demand that as required data processing and transmission means have reduced the network bandwidth, the large-screen of client can be presented to user's more information source.Software systems are flexibly disposed in design, adopt the host hardware configuration of current main-stream.Another beneficial effect of the present invention is for the direct acquisition stream media signal of splicing large screen display system method and foundation to be provided.
Description of drawings
Fig. 1 is the framework of a kind of interactive cooperative system based on splicing large screen provided by the invention;
Fig. 2 is the frame per second comparison diagram;
Fig. 3 is a network occupancy comparison diagram.
Embodiment
Specify the present invention below in conjunction with embodiment.
Embodiment
As shown in Figure 1; Be a kind of interactive cooperative system provided by the invention based on splicing large screen; System is that a kind of typical C/S framework is disposed, and system is made up of service end and client, and service end is sent out server by graphic plotting system, streaming server, circulation and formed; Client is made up of splicing large screen display system, large-screen Control Server and large-screen control client.Long-range multichannel graphic plotting system is driven by one group of cluster machine usually, and by a Control Node operation monitoring program, through the mode of sending order whole system is controlled.
Concrete, system provided by the invention comprises
Streaming server, the multichannel that is used to catch the strange land high performance system shows output, and the signal of catching is compressed into many pixel stream respectively;
Server is sent out in circulation; This server is positioned at the rear end of streaming server; In order to collect from the pixel stream of each streaming server, based on synchronized timestamp each hardwood is repacked and form a new bit stream, then it is forwarded to FTP client FTP through LAN or private network; Simultaneously; Circulation is sent out server and is accepted and handle the message from the adjustment visible pixel zone of FTP client FTP; Area size and scaling that this message semantic definition active client system is shown; Circulation is sent out server and is adjusted in real time the image processing process of front end streaming server with this message, and sends data to FTP client FTP; Circulation send out server also the feedback information through accepting FTP client FTP dynamically to the front end streaming server catch speed with compression quality is regulated and control, be responsible for interactive command to the strange land high performance system of forwarding FTP client FTP;
FTP client FTP comprises a large-screen control end and a cover splicing large screen display system, and the large-screen control end receives the bit stream of sending out server from circulation; Simultaneously, the large-screen control end is sent out message, feedback information and the interactive command that server sends adjustment visible pixel zone to circulation.
The user sends interactive command through the mouse and the keyboard operation of said large-screen control end; Comprise layout management with the mutual and large-screen of remote application; The large-screen control end is sent out server and said streaming server through said circulation and is sent simple interaction message to said strange land high performance system the display of strange land high performance system and the drafting behavior of said splicing large screen display system are consistent, and can also close the preview remote content simultaneously to reduce unnecessary decoding burden.
The present invention also provides a kind of interactive Synergistic method based on said system, and step is:
The multichannel long-range demonstration output of step 1, strange land high performance system is sent out server by one group of circulation and is caught and be compressed into respectively many pixel stream; These Streaming Medias comprise various common images, video encoder video, MPEG2, JPEG etc., server even can directly catch the pixel stream of uncompressed;
Step 4, client are made up of splicing large screen and its control end; It bears the decoding and the large-screen drawing system task of bit stream; It can connect simultaneously a plurality of remote graphics system, and the control end of large-screen is responsible for setting up, these Streaming Media link resources of maintenance and management, through the large-screen splicing management software of special use; Can realize plurality of display modes or write pattern, and to these patterns prestore the management etc.Control end and service end superpose arbitrarily, make things convenient for, synchronous display effect;
After client receives a circulation server bitstream data; Send adjustment visible pixel region R VP (Region of Visible Pixels) message (area size, the pantograph ratio of this message semantic definition active client reality) backflow forwarding server; Circulation is sent out server and is accepted this message and processing, and the result that will finish dealing with simultaneously feeds back to streaming server and is optimized.So back and forth, form alternately, circulation is sent out server and also is responsible for transmitting client's the extremely mutual server parses of interactive command and carrying out interactive instruction.Therefore, circulation is sent out server and between client splicing large screen system and streaming server end, is played intermediary's transmission process and mutual effect; Reach the interactive function of user's Long-distance Control and management;
Following several steps specifically specifies the several Key Points that the present invention realizes:
(1) as required image processing and transfer of data realizes:
On local splicing large screen, only need in fact to observe zone local or that dwindle, client is sent the operational efficiency that RVP message is improved server, the RVP message that the variation of the size of client window or scroll bar state all can be set out new; And a circulation server decomposes RVP message automatically according to the configuration of service end inside and require corresponding streaming server adjustment image processing process;
Circulation is sent out server and at first from catch image, is cut out effective zone according to RVP message; Carrying out linearity then resamples; Carry out encoding operation at last; Because the scaling in length and breadth among the RVP generally is no more than 1.0, server is sent out in circulation can ignore the request of amplifying original image, does not influence the precision of images when reducing the coding expense; Therefore improve the output frame rate of streaming server effectively, reduced the network bandwidth occupancy of video flowing;
(2) software architecture of multithreading realizes:
The splicing large screen Control Server is mainly carried out tasks such as the reception, video decode, large-screen drafting of network data; Application program inside has comprised this three main threads, carries out collaborative work through signal or message between the thread.To reduce the influence that Data Receiving receives the network bandwidth and transmission rate, the cpu resource and the drawing process GPU resource of decode procedure are separated; Visible by Fig. 4 is the multithreading workflow that example has been explained the multithreading mode of operation with the large-screen server program;
The control client of splicing large screen also comprises the message response thread of window application except three same threads;
Streaming server mainly designs and has comprised Video Capture, image processing and data transmission line journey;
Forwarding server mainly designs and has comprised Data Receiving, forwarding thread, Client command acceptance, processing threads etc.
(3) adaptive rate controlled and system function optimization design:
Streaming server is sent out a server with circulation and is regulated video processing speed automatically according to client-requested, and they will ask service end suitably to reduce the transmission frame per second when client does not have the enough cpu idle times or the network bandwidth to handle high frame per second real-time pictures; Otherwise request suitably improves frame per second when the idle perhaps bandwidth of client abundance;
The inner execution efficient that adopts adaptive performance optimization mechanism to coordinate to catch thread and coding thread of streaming server; The form of similar " producer-consumer " that designed is shared an image buffer storage formation to promote the treatment effeciency of streaming server, and its concrete work is implemented as follows:
According to the spill-over degree of image buffer storage formation and the occupancy of current C PU, streaming server dynamically improves or reduces the execution speed of thread, avoids buffer memory to overflow and causes frame losing;
In the streaming server of one group of collaborative work, host node will be monitored other child node ruuning situations termly, dynamically make adjustment;
The speed of service of the streaming server of design can not surpass the maximum of client appointment.
Provide one group of test data of the present invention below:
Frame per second is to weigh the leading indicator of interactive performance, and the network bandwidth is the important indicator of measurement system retractility.We test around these two indexs; Test macro adopts JPEG and mpeg 2 encoder respectively and has used Intel performance optimization storehouse (IPP) to optimize, and we compare these data and the mode that adopts transmission original pixels stream (RAW pixel stream).Visible by Fig. 2:
Compression and the mode of processing by demand pixel stream have better interactive performance than directly transmitting initial data, can support more long-range connection;
Simultaneously, we are that the RVP of client when showing complete remote image tests to extreme case, and the burden that this moment, client was moved with service end is the heaviest:
MPEG2 and jpeg coder make whole system can reach the real-time, interactive performance; Both can both operate in more than the 15fps under the worst situation; And the original pixels of RAW form stream seriously receives the restriction of the network bandwidth, can only stable operation in about 7.5fps, by the visible huge spread that has shown the network occupation rate of Fig. 3; Original pixels flow to the network-wide that few needs surpass 40 times in theory, has also shown the huge advantage of the present invention aspect network bandwidth limitations simultaneously.
Claims (4)
1. the interactive cooperative system based on splicing large screen is characterized in that, comprising:
Streaming server, the multichannel that is used to catch the strange land high performance system shows output, and the signal of catching is compressed into many pixel stream respectively;
Server is sent out in circulation; This server is positioned at the rear end of streaming server; In order to collect from the pixel stream of each streaming server, based on synchronized timestamp each hardwood is repacked and form a new bit stream, then it is forwarded to FTP client FTP through LAN or private network; Simultaneously; Circulation is sent out server and is accepted and handle the message from the adjustment visible pixel zone of FTP client FTP; Area size and scaling that this message semantic definition active client system is shown; Circulation is sent out server and is adjusted in real time the image processing process of front end streaming server with this message, and sends data to FTP client FTP; Circulation send out server also the feedback information through accepting FTP client FTP dynamically to the front end streaming server catch speed with compression quality is regulated and control, be responsible for interactive command to the strange land high performance system of forwarding FTP client FTP;
FTP client FTP comprises a large-screen control end and a cover splicing large screen display system, and the large-screen control end receives the bit stream of sending out server from circulation; Simultaneously, the large-screen control end is sent out message, feedback information and the interactive command that server sends adjustment visible pixel zone to circulation.
2. a kind of interactive cooperative system as claimed in claim 1 based on splicing large screen; It is characterized in that; The user sends interactive command through the mouse and the keyboard operation of said large-screen control end; Comprise layout management with the mutual and large-screen of remote application; The large-screen control end is sent out server and said streaming server through said circulation and is sent simple interaction message to said strange land high performance system the display of strange land high performance system and the drafting behavior of said splicing large screen display system are consistent, and can also close the preview remote content simultaneously to reduce unnecessary decoding burden.
3. interactive Synergistic method based on the said system of claim 1 is characterized in that step is:
Behind the Streaming Media of the long-range demonstration output of the multichannel that step 1, one group of streaming server are caught the strange land high performance system it is compressed into many pixel stream respectively;
Step 2, circulation are sent out a server and are collected from the packed data of streaming server, and synchronous must each frame of data being repacked forms a new bit stream and be forwarded to the large-screen control end;
Step 3, large-screen control end receive and after the server bitstream data is sent out in circulation bitstream data are presented on the splicing large screen display system with image format; If the user has imported interactive instruction on the large-screen control end; Then the large-screen control end is forwarded to the strange land high performance system through a circulation server and a server that circulates with this interactive instruction, if the image demonstration of large screen display system needs adjustment, then visible pixel region R VP message backflow forwarding server is adjusted in the transmission of large-screen control end; Circulation is sent out server and is accepted this message and processing; The result that will finish dealing with simultaneously feeds back to streaming server and is optimized, and so back and forth, forms mutual.
4. a kind of interactive Synergistic method as claimed in claim 3 is characterized in that, the acquisition mode of streaming server described in the step 1 is hardware in acquisition mode or software acquisition mode, and when adopting hardware in acquisition, catching synchronizing signal can be by hardware trigger; When adopting software to catch, use message passing interface to come the triggering synchronous signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010256909 CN102377745A (en) | 2010-08-19 | 2010-08-19 | Interactive collaboration system based on large spliced screen and interactive collaboration method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010256909 CN102377745A (en) | 2010-08-19 | 2010-08-19 | Interactive collaboration system based on large spliced screen and interactive collaboration method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102377745A true CN102377745A (en) | 2012-03-14 |
Family
ID=45795723
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010256909 Pending CN102377745A (en) | 2010-08-19 | 2010-08-19 | Interactive collaboration system based on large spliced screen and interactive collaboration method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102377745A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102902502A (en) * | 2012-09-28 | 2013-01-30 | 威盛电子股份有限公司 | Display system and display method suitable for display wall |
| CN102945143A (en) * | 2012-09-29 | 2013-02-27 | 浙江省电力公司 | Central control method for electric power information communication |
| CN102946550A (en) * | 2012-11-20 | 2013-02-27 | 广东威创视讯科技股份有限公司 | Splicing wall image display method and system and splicing wall display terminal |
| CN105094289A (en) * | 2014-04-18 | 2015-11-25 | 浙江大华技术股份有限公司 | Method, device, and system for realizing graphical user interface |
| CN105242970A (en) * | 2015-09-17 | 2016-01-13 | Tcl移动通信科技（宁波）有限公司 | Memory remaining capacity based method and system for adjusting camera frequency |
| CN105657321A (en) * | 2015-11-09 | 2016-06-08 | 乐视致新电子科技（天津）有限公司 | Adaptive video definition adjusting method, apparatus and terminal |
| CN106302676A (en) * | 2016-08-05 | 2017-01-04 | 南京仁光电子科技有限公司 | Client and big screen intelligent interactive system |
| CN107426276A (en) * | 2017-04-22 | 2017-12-01 | 高新兴科技集团股份有限公司 | A kind of Urban Operation center large-size screen monitors control system |
| CN107959887A (en) * | 2017-12-04 | 2018-04-24 | 神州租屏(厦门)网络技术有限公司 | A kind of screen shows interaction systems and implementation method |
| CN108200446A (en) * | 2018-01-12 | 2018-06-22 | 北京蜜枝科技有限公司 | Multimedia interactive system and method on the line of virtual image |
-
2010
- 2010-08-19 CN CN 201010256909 patent/CN102377745A/en active Pending
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102902502B (en) * | 2012-09-28 | 2015-06-17 | 威盛电子股份有限公司 | Display system and display method suitable for display wall |
| CN102902502A (en) * | 2012-09-28 | 2013-01-30 | 威盛电子股份有限公司 | Display system and display method suitable for display wall |
| CN102945143A (en) * | 2012-09-29 | 2013-02-27 | 浙江省电力公司 | Central control method for electric power information communication |
| CN102946550B (en) * | 2012-11-20 | 2016-04-13 | 广东威创视讯科技股份有限公司 | Combination method for displaying image and system, combination display terminal |
| CN102946550A (en) * | 2012-11-20 | 2013-02-27 | 广东威创视讯科技股份有限公司 | Splicing wall image display method and system and splicing wall display terminal |
| CN105094289A (en) * | 2014-04-18 | 2015-11-25 | 浙江大华技术股份有限公司 | Method, device, and system for realizing graphical user interface |
| CN105094289B (en) * | 2014-04-18 | 2018-07-06 | 浙江大华技术股份有限公司 | A kind of method, equipment and system for realizing graphical user's interactive interface |
| CN105242970A (en) * | 2015-09-17 | 2016-01-13 | Tcl移动通信科技（宁波）有限公司 | Memory remaining capacity based method and system for adjusting camera frequency |
| CN105657321A (en) * | 2015-11-09 | 2016-06-08 | 乐视致新电子科技（天津）有限公司 | Adaptive video definition adjusting method, apparatus and terminal |
| CN106302676A (en) * | 2016-08-05 | 2017-01-04 | 南京仁光电子科技有限公司 | Client and big screen intelligent interactive system |
| CN107426276A (en) * | 2017-04-22 | 2017-12-01 | 高新兴科技集团股份有限公司 | A kind of Urban Operation center large-size screen monitors control system |
| CN107959887A (en) * | 2017-12-04 | 2018-04-24 | 神州租屏(厦门)网络技术有限公司 | A kind of screen shows interaction systems and implementation method |
| CN107959887B (en) * | 2017-12-04 | 2019-12-10 | 神州租屏(武汉)网络技术有限公司 | screen display interactive system and implementation method |
| CN108200446A (en) * | 2018-01-12 | 2018-06-22 | 北京蜜枝科技有限公司 | Multimedia interactive system and method on the line of virtual image |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102377745A (en) | Interactive collaboration system based on large spliced screen and interactive collaboration method | |
| CN103414751B (en) | A kind of PC screen content sharing/interaction control method | |
| US9741316B2 (en) | Method and system for displaying pixels on display devices | |
| CN105637886B (en) | Server from graphic user interface to client and client for providing | |
| TWI428020B (en) | Image transmitting apparatus, image transmitting method, receiving apparatus, and image transmitting system | |
| CN101494547A (en) | Method and system for implementing conference combining local conference and network conference equipment | |
| KR101698951B1 (en) | System, apparatus and method for sharing a screen having multiple visual components | |
| CN102611869A (en) | Output-oriented network transmission technique of multi-screen splicing system | |
| CN102541501A (en) | Multi-screen parallel massive information display system | |
| CN105577819A (en) | Sharing system, sharing method and sharing device for virtual desktop | |
| DE102016006539A1 (en) | Systems and methods for smooth switching between compressed video streams | |
| CN103209204A (en) | Computer screen remote control method for medical image teaching system | |
| CN202422104U (en) | Multi-screen parallel massive information display system | |
| CN212660227U (en) | Multi-screen processing equipment | |
| Han et al. | A virtual frame buffer abstraction for parallel rendering of large tiled display walls | |
| CN201976139U (en) | Interactive collaboration system based on assembled large screen | |
| US20100049832A1 (en) | Computer program product, a system and a method for providing video content to a target system | |
| Kimball et al. | Low bandwidth desktop and video streaming for collaborative tiled display environments | |
| Audsley et al. | Realistic analysis of limited parallel software/hardware implementations | |
| CN201974795U (en) | Image mosaic processing device based on field programmable gate array (FPGA) | |
| Repplinger et al. | DRONE: A flexible framework for distributed rendering and display | |
| CN205081880U (en) | Visual distributed task of network cooperation device | |
| US20140055471A1 (en) | Method for providing scalable remote screen image and apparatus thereof | |
| Gao et al. | Design of UAV high resolution image transmission system | |
| KR101231009B1 (en) | Network video server and video control method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| DD01 | Delivery of document by public notice |
Addressee: Shanghai Genius Information Technology Co., Ltd. Document name: Notification that Application Deemed to be Withdrawn |
|
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120314 |