CN102143347B - Multi-party remote interaction system - Google Patents

Multi-party remote interaction system Download PDF

Info

Publication number
CN102143347B
CN102143347B CN 201010106011 CN201010106011A CN102143347B CN 102143347 B CN102143347 B CN 102143347B CN 201010106011 CN201010106011 CN 201010106011 CN 201010106011 A CN201010106011 A CN 201010106011A CN 102143347 B CN102143347 B CN 102143347B
Authority
CN
China
Prior art keywords
audio
signal
unit
video
compressed encoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN 201010106011
Other languages
Chinese (zh)
Other versions
CN102143347A (en
Inventor
吴锦青
宁广民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Qitian Technology Co., Ltd.
Original Assignee
GUANGZHOU QITIAN TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GUANGZHOU QITIAN TECHNOLOGY Co Ltd filed Critical GUANGZHOU QITIAN TECHNOLOGY Co Ltd
Priority to CN 201010106011 priority Critical patent/CN102143347B/en
Publication of CN102143347A publication Critical patent/CN102143347A/en
Application granted granted Critical
Publication of CN102143347B publication Critical patent/CN102143347B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention relates to a real-time interaction technology for an interaction system, in particular to a multi-party remote interaction system. The system comprises a plurality of remote terminals used for acquiring, processing, transmitting and receiving audio/video signals; each terminal comprises a switch used for being in network connection with each terminal to perform data exchange; and a microprocessor unit is connected in series in front of the switch and is used for compressing the audio/video signals. The microprocessor unit is arranged before the switch of the current each terminal, compresses the audio/video signals acquired by other equipment and transmits the audio/video signals to other remote terminals, the microprocessor unit performs high compression processing on the audio/video signals by adopting a Kalman algorithm, and exchange data quantity among remote terminals is reduced; therefore, real-time interactive efficiency among the plurality of terminals is improved.

Description

A kind of remote interaction in many ways system
Technical field
The present invention relates to the real-time interactive technology of interaction systems, be specifically related to a kind of remote interaction in many ways system.
Background technology
Along with science and technology development, the remote interaction system has appearred in recent years, be applied to fields such as Internet chat, Web education, videoconference.
As shown in Figure 1, a plurality of remote terminals that existing interaction systems comprises, be used for gathering, handle, transmit and receive audio-video signal, described remote terminal includes a switch, be used for each remote terminal of network connection and carry out exchanges data, the audio-video signal data that each terminal collects often all directly are transferred to another remote terminal by switch, because data volume is bigger, the delay of transmission is long, make each terminal watch that the vision signal of other-end can not be synchronous, can not satisfy the requirement of each remote system real-time interactive.
Summary of the invention
The objective of the invention is to overcome the shortcoming of prior art, provide a kind of Real time Efficiency higher the system of remote interaction in many ways.
In order to reach above goal of the invention, the technical solution adopted in the present invention is:
A kind of remote interaction in many ways system comprises at least two terminals, is used for input audio signal and vision signal; Described each terminal is connected with a switch jointly, and described switch is connected with the Internet and carries out data interaction; Between described each terminal and described switch, also be in series with microprocessor unit, described microprocessor unit comprises signal synthon unit, compressed encoding subelement, wherein, described signal synthon unit is used for described audio signal, vision signal are synthesized one road audio-video signal, and described compressed encoding subelement is used for described audio-video signal is carried out compressed encoding; Described switch is used for the signal behind the described compressed encoding is sent by described the Internet.
Preferably, in described microprocessor, also comprise the buffer sublayer unit, described buffer sublayer unit is electrically connected with described signal synthon unit, compressed encoding subelement, and described buffer sublayer unit is used for buffer memory by the audio-video signal of described signal synthon unit to the compressed encoding subelement.
Preferably, described compressed encoding subelement specifically is used for carrying out compressed encoding according to the described audio-video signal of Kalman's algorithm,
Preferably, described each terminal also comprises: camera head is used for photographic images and produces picture signal; Graphics processing unit is for deblurring and the noise processed of described picture signal; Microphone is used for gathering the sound generating voice signal; Sound processing unit, the denoising and the impurity elimination ripple that are used for described voice signal are handled; Audio/video server is used for collection, storage, the live and program request of audio-video signal; Display is used for the decoding audio frequency and video with display image signals and the signal that plays sound; Described camera head gives image signal transmission at graphics processing unit, and described graphics processing unit is transferred to audio/video server again with the processed images signal; Described microphone is given sound processing unit with transmission of sound signals, and the voice signal that described sound processing unit will be handled is transferred to audio/video server again; Described display is connected on the described audio/video server, and described audio/video server and microprocessor unit carry out exchanges data.
Preferably, described microprocessor unit also is integrated with modulation subunit, demodulation subelement; Wherein, described modulation subunit is used for the audio-video signal of audio/video server input is carried out analog-to-digital conversion; The audio-video signal that the demodulation subelement is used for switch is received carries out digital-to-analogue conversion.
The present invention is before the switch of present remote terminal, add a microprocessor unit, the audio-video signal that other equipment are collected compresses the back and is being transferred to other remote terminals, this microprocessor unit adopts Kalman's algorithm that audio-video signal is carried out the high power compression and handles, reduce the data volume that exchanges mutually between each remote terminal, thereby improved real-time interactive efficient between a plurality of terminals.
Description of drawings
Accompanying drawing described herein is used to provide further understanding of the present invention, constitutes the application's a part, does not constitute to improper restriction of the present invention, in the accompanying drawings:
Fig. 1 is the structural representation of existing interaction systems;
Fig. 2 is structural representation of the present invention;
Fig. 3 flows to schematic diagram for structured flowchart and the signal of microprocessing unit of the present invention.
Embodiment
Describe the present invention in detail below in conjunction with accompanying drawing and specific embodiment, be used for explaining the present invention in this illustrative examples of the present invention and explanation, but not as a limitation of the invention.
As shown in Figure 2, the present invention includes remote terminal 1, remote terminal 2,,, remote terminal N.Be provided with microphone in described each terminal, be used for gathering the sound generating voice signal; Be provided with camera head in described each terminal, be used for photographic images and produce picture signal; Described each terminal is connected with a switch jointly, and described switch is connected with the internet and carries out data interaction; Also be in series with a microprocessor unit between described each terminal and described switch, described microprocessor unit is mainly used in the compressed encoding of audio-video signal; Described switch is used for the signal behind the described compressed encoding is sent by described the Internet.
As shown in Figure 3, described microprocessor unit comprises signal synthon unit, compressed encoding subelement, wherein, described signal synthon unit is used for described audio signal, vision signal are synthesized one road audio-video signal, described compressed encoding subelement is used for described audio-video signal is carried out compressed encoding, and described compressed encoding subelement specifically is used for carrying out compressed encoding according to the described audio-video signal of Kalman's algorithm.
As shown in Figure 3, in described microprocessor, also comprise the buffer sublayer unit, described buffer sublayer unit is electrically connected with described signal synthon unit, compressed encoding subelement, and described buffer sublayer unit is used for buffer memory by the audio-video signal of described signal synthon unit to the compressed encoding subelement.
As shown in Figure 3, also be integrated with modulation subunit, demodulation subelement, decoding subelement at described microprocessor unit; Wherein, described modulation subunit is used for the audio-video signal of audio/video server input is carried out analog-to-digital conversion; The audio-video signal that the demodulation subelement is used for switch is received carries out digital-to-analogue conversion; Described decoding subelement is used for the decoding of the audio/video information after the digital-to-analogue conversion of demodulation subelement, and difference output image signal and voice signal.
As shown in Figure 2, described each terminal also comprises: graphics processing unit, for deblurring and the noise processed of described picture signal; Sound processing unit, the denoising and the impurity elimination ripple that are used for described voice signal are handled; Audio/video server is used for collection, storage, the live and program request of audio-video signal; Display is used for the decoding audio frequency and video with display image signals and the signal that plays sound; Described camera head gives image signal transmission at graphics processing unit, and described graphics processing unit is transferred to audio/video server again with the processed images signal; Described microphone is given sound processing unit with transmission of sound signals, and the voice signal that described sound processing unit will be handled is transferred to audio/video server again; Described display is connected on the described audio/video server, and described audio/video server and microprocessor unit carry out exchanges data.
The present invention is before the switch of present remote terminal, add a microprocessor unit, the audio-video signal that other equipment are collected compresses the back and is being transferred to other remote terminals, this microprocessor unit adopts Kalman's algorithm that audio-video signal is carried out the high power compression and handles, reduce the data volume that exchanges mutually between each remote terminal, thereby improved real-time interactive efficient between a plurality of terminals.
More than technical scheme that the embodiment of the invention is provided be described in detail, used specific case herein principle and the execution mode of the embodiment of the invention are set forth, the explanation of above embodiment only is applicable to the principle that helps to understand the embodiment of the invention; Simultaneously, for one of ordinary skill in the art, according to the embodiment of the invention, the part that on embodiment and range of application, all can change, in sum, this description should not be construed as limitation of the present invention.

Claims (3)

1. remote interaction system in many ways comprises:
At least two terminals are used for input audio signal and vision signal;
Described each terminal is connected with a switch jointly, and described switch is connected with the Internet and carries out data interaction;
It is characterized in that:
Between described each terminal and described switch, also be in series with microprocessor unit,
Described microprocessor unit comprises signal synthon unit, compressed encoding subelement, wherein,
Described signal synthon unit is used for described audio signal, vision signal are synthesized one road audio-video signal,
Described compressed encoding subelement is used for described audio-video signal is carried out compressed encoding;
Described switch is used for the signal behind the described compressed encoding is sent by described the Internet,
In described microprocessor, also comprise the buffer sublayer unit,
Described buffer sublayer unit is electrically connected with described signal synthon unit, compressed encoding subelement, and described buffer sublayer unit is used for buffer memory by the audio-video signal of described signal synthon unit to the compressed encoding subelement,
Described compressed encoding subelement specifically is used for carrying out compressed encoding according to the described audio-video signal of Kalman's algorithm.
2. remote interaction in many ways according to claim 1 system is characterized in that:
Described each terminal also comprises:
Camera head is used for photographic images and produces picture signal;
Graphics processing unit is for deblurring and the noise processed of described picture signal;
Microphone is used for gathering the sound generating voice signal;
Sound processing unit, the denoising and the impurity elimination ripple that are used for described voice signal are handled;
Audio/video server is used for collection, storage, the live and program request of audio-video signal;
Display is used for the decoding audio frequency and video with display image signals and the signal that plays sound;
Described camera head gives image signal transmission at graphics processing unit, and described graphics processing unit is transferred to audio/video server again with the processed images signal;
Described microphone is given sound processing unit with transmission of sound signals, and the voice signal that described sound processing unit will be handled is transferred to audio/video server again;
Described display is connected on the described audio/video server, and described audio/video server and microprocessor unit carry out exchanges data.
3. according to the described remote interaction in many ways of claim 2 system, it is characterized in that:
Described microprocessor unit also is integrated with modulation subunit, demodulation subelement; Wherein,
Described modulation subunit is used for the audio-video signal of audio/video server input is carried out analog-to-digital conversion;
The audio-video signal that the demodulation subelement is used for switch is received carries out digital-to-analogue conversion.
CN 201010106011 2010-02-01 2010-02-01 Multi-party remote interaction system Active CN102143347B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010106011 CN102143347B (en) 2010-02-01 2010-02-01 Multi-party remote interaction system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010106011 CN102143347B (en) 2010-02-01 2010-02-01 Multi-party remote interaction system

Publications (2)

Publication Number Publication Date
CN102143347A CN102143347A (en) 2011-08-03
CN102143347B true CN102143347B (en) 2013-09-11

Family

ID=44410537

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010106011 Active CN102143347B (en) 2010-02-01 2010-02-01 Multi-party remote interaction system

Country Status (1)

Country Link
CN (1) CN102143347B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104363545B (en) * 2014-10-17 2015-06-03 深圳市时尚德源文化传播有限公司 Audio denoising circuit, smart terminal adopting same and teaching system
CN104333731A (en) * 2014-11-19 2015-02-04 成都实景信息技术有限公司 Enterprise video conference system
CN105872451A (en) * 2016-04-14 2016-08-17 广州市昇博电子科技有限公司 High-definition remote video conference communication method
CN110868620A (en) * 2018-08-28 2020-03-06 陈旭 Remote interaction system and method based on television
CN111918079A (en) * 2020-07-30 2020-11-10 广州世祥教育科技有限公司 Multi-mode live broadcast and automatic editing teaching system and method and electronic equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1596404A (en) * 2001-11-28 2005-03-16 交互式内容引擎有限责任公司 Interactive broadband server system
CN1598858A (en) * 2004-05-13 2005-03-23 郑州市疾病预防控制中心 Integral management system for digital information of hospital
CN1874502A (en) * 2006-06-22 2006-12-06 孙强 Embedded type network video monitor and control system
CN201035635Y (en) * 2007-06-07 2008-03-12 广州超越数码科技有限公司 Network monitoring type face identification gate inhabitation system
CN101350140A (en) * 2008-08-27 2009-01-21 宁波宁大教育设备有限公司 Digital network interactive teaching system and teaching interactive method
CN201341189Y (en) * 2008-12-22 2009-11-04 赵照 New generation HD web camera, audio/video monitoring system and video conference system
CN201393090Y (en) * 2009-01-09 2010-01-27 许益民 Electric power remote digital centralized control integrated management system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7634533B2 (en) * 2004-04-30 2009-12-15 Microsoft Corporation Systems and methods for real-time audio-visual communication and data collaboration in a network conference environment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1596404A (en) * 2001-11-28 2005-03-16 交互式内容引擎有限责任公司 Interactive broadband server system
CN1598858A (en) * 2004-05-13 2005-03-23 郑州市疾病预防控制中心 Integral management system for digital information of hospital
CN1874502A (en) * 2006-06-22 2006-12-06 孙强 Embedded type network video monitor and control system
CN201035635Y (en) * 2007-06-07 2008-03-12 广州超越数码科技有限公司 Network monitoring type face identification gate inhabitation system
CN101350140A (en) * 2008-08-27 2009-01-21 宁波宁大教育设备有限公司 Digital network interactive teaching system and teaching interactive method
CN201341189Y (en) * 2008-12-22 2009-11-04 赵照 New generation HD web camera, audio/video monitoring system and video conference system
CN201393090Y (en) * 2009-01-09 2010-01-27 许益民 Electric power remote digital centralized control integrated management system

Also Published As

Publication number Publication date
CN102143347A (en) 2011-08-03

Similar Documents

Publication Publication Date Title
CN102143347B (en) Multi-party remote interaction system
CN205139596U (en) Unmanned aerial vehicle speech control system and remote control unit
CN101945096A (en) Video live broadcast system facing to set-top box and PC of mobile phone and working method thereof
CN102209232A (en) Remote audio and video monitor system and method thereof
CN102325246B (en) Video conference system as well as video conference server and mobile communication terminal
CN102158690A (en) Remote multichannel real-time video monitoring system
US20150208036A1 (en) Video conference display method and device
WO2012109956A1 (en) Method and device for processing conference information in video conference
CN112770212B (en) Wireless earphone, video recording system and method, and storage medium
CN102244765A (en) Multi-protocol-supported conference terminal interaction system and method
CN201398221Y (en) Cell phone shooting live broadcasting system
CN102123268A (en) Video conference terminal and system
CN101083752A (en) Method for displaying meeting place name of video conference and video terminal
CN104469259A (en) Cloud terminal video synthesis method and system
CN103826084A (en) Audio encoding method
CN200990664Y (en) Television set capable of realizing long-distance video frequency conversational function
CN114827647B (en) Live broadcast data generation method, device, equipment, medium and program product
CN104754261A (en) Projection equipment and projection method
CN103905777A (en) Meeting minute obtaining method and providing method, device and system
CN209419734U (en) A kind of audio-video peripheral expansion device of video conferencing system
CN115514989A (en) Data transmission method, system and storage medium
CN101742220B (en) System and method for realizing multi-picture based on serial differential switch
CN110798700B (en) Video processing method, video processing device, storage medium and electronic equipment
CN210807506U (en) Camera device and video live broadcast system
CN110691218B (en) Audio data transmission method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: GUANGZHOU QITIAN SCIENCE AND TECHNOLOGY CO., LTD.

Free format text: FORMER OWNER: GUANGDONG WENXUN TECHNOLOGY CO., LTD.

Effective date: 20111013

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 510620 GUANGZHOU, GUANGDONG PROVINCE TO: 510163 GUANGZHOU, GUANGDONG PROVINCE

TA01 Transfer of patent application right

Effective date of registration: 20111013

Address after: 510163, No. 223-227 Middle Road, Liwan District bridge, Guangzhou, Guangdong, 13, five of the third floor

Applicant after: Guangzhou Qitian Technology Co., Ltd.

Address before: 510620 Guangdong city of Guangzhou province Tianhe District Tao Yuk Road No. 2 Hongkou street room 103

Applicant before: Guangdong Wenxun Technology Co., Ltd.

C14 Grant of patent or utility model
GR01 Patent grant