CN2410710Y - Image/voice front-end processing device - Google Patents
Image/voice front-end processing device Download PDFInfo
- Publication number
- CN2410710Y CN2410710Y CN00204487U CN00204487U CN2410710Y CN 2410710 Y CN2410710 Y CN 2410710Y CN 00204487 U CN00204487 U CN 00204487U CN 00204487 U CN00204487 U CN 00204487U CN 2410710 Y CN2410710 Y CN 2410710Y
- Authority
- CN
- China
- Prior art keywords
- image
- data
- voice
- processing device
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000012545 processing Methods 0.000 title claims abstract description 109
- 230000006835 compression Effects 0.000 claims abstract description 22
- 238000007906 compression Methods 0.000 claims abstract description 22
- 238000012856 packing Methods 0.000 claims abstract description 18
- 238000006243 chemical reaction Methods 0.000 claims abstract description 12
- 238000000034 method Methods 0.000 claims description 17
- 230000008569 process Effects 0.000 claims description 15
- 238000013500 data storage Methods 0.000 claims description 8
- 238000003860 storage Methods 0.000 claims description 7
- 230000000694 effects Effects 0.000 claims description 3
- 238000007726 management method Methods 0.000 claims description 3
- 230000003068 static effect Effects 0.000 claims description 3
- 230000001960 triggered effect Effects 0.000 claims description 3
- 241001269238 Data Species 0.000 claims description 2
- 230000003321 amplification Effects 0.000 claims description 2
- 239000004744 fabric Substances 0.000 claims description 2
- 238000002955 isolation Methods 0.000 claims description 2
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 2
- 230000002093 peripheral effect Effects 0.000 claims description 2
- 230000005622 photoelectricity Effects 0.000 claims description 2
- 238000013501 data transformation Methods 0.000 claims 1
- 238000012544 monitoring process Methods 0.000 description 10
- 230000005540 biological transmission Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 7
- 239000013078 crystal Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000012384 transportation and delivery Methods 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- 239000000523 sample Substances 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 238000013481 data capture Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 229910052500 inorganic mineral Inorganic materials 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000011707 mineral Substances 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000007789 sealing Methods 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Landscapes
- Telephonic Communication Services (AREA)
Abstract
A front-end image/speech processing device is prepared as carrying out A/D conversion on image signal and speech signal, carrying out compression coding according to H.324 protocol of international telecommunication union ITU-T, packing data, transmitting data from telephone line of telephone exchange network to specific user of telephone exchange network by modulation-demodulation circuit, carrying out code stream grouping on packed and compressed image/speech information according to H.324 protocol of international telecommunication union ITU-T after signal sent from front-end image/speech processing device is received by specific user device, decoding and decompressing to make field image signal and speech signal collected by camera and microphone connected to front-end image/speech processing device be reproduced.
Description
The utility model relates to a kind of image/voice front end processing device, particularly the camera that connects and the picture signal and the voice signal of microphone collection are carried out analog to digital conversion, and carry out compressed encoding, the treating apparatus of packing data by the H.324 agreement of the ITU-T of International Telecommunications Union (ITU).
Present each outlet of financial institution and some important units, use camera head mostly and triggered warning device, but not outwards transmission of the image that its camera is taken the photograph, only in the storage of carrying out image on the spot, and warning device links to each other with the department of receiving a crime report mostly, forms the safety precaution network.In case report to the police, the personnel that receive a crime report just must arrive in alarm set point under the condition of not understanding field condition, and this just is unfavorable for dealing carefully with accident.At industrial sectors such as oil, electric power, chemical industry, mines, a lot of posies or hazardous environment station need solve round-the-clock remote measurement, remote control, remote viewing and remote signalling.Therefore, in these industries or similar department, the transmission of anxious image voice to be solved or data simple and fast promptly realizes multimedia communication.
Domestic existing minority area and department begin to adopt multimedia communication technology to be applied to the public safety technological prevention, but the equipment of selecting for use adopts personal computer to add the data handling system of plug-in card form more, or select for use and introduce external stand-alone device.But these equipment dependabilities are stable inadequately, and computing machine needs personnel operation to safeguard, and or channel had special requirement, or because of price factor etc., make multimedia remote communication be difficult to popularize and application.
Domestic also have unit to adopt " PC is embedded " to add the mode of data capture card, by the telephone wire of telephone-switching network, carries out the remote transmission of picture signal.It utilizes no dish personal computer, with the mode pilot operationp system of electric board, the automatic operation of implement device.Be characterized in having selected for use commercial electric board,, simplified the hardware design of device in interior hardened operating system and application software.Its weak point is that hardware is still simplified inadequately, and incompatible international standards such as the picture format of using, host-host protocol, is the system of a sealing basically.
The international standard of the multimedia terminal of switched telephone network agreement H.324 towards the public, make and carry out multimedia communication by ordinary telephone line and become a kind of new communication mode, the both sides of communication can be transmitted live image, voice and relevant data, file and chart mutually, make the plain old telephone switching network this occur the earliest, effect that the performance of the communication network of capacity maximum is bigger.
In China, public telephone switching network, it is the post and telecommunications net, and the professional net of all departments all has considerable scale and numerous users, but also constantly obtain stability and development, therefore, exploitation and improve and to meet H.324 that the video and the audio coder of agreement are very significant can make the long-range live image that above-mentioned industry, department are required and the acquisition process of voice that a kind of novel easy device is arranged.
The purpose of this utility model is exactly based on the most advanced technology of the time, with the hardware configuration of simplifying most, forms the utility unit of best price/performance ratio.This image/voice front end processing device that the utility model is related, follow the H.324 consensus standard of International Telecommunications Union (ITU) (ITU-T), adopt digital signal processor (DSP) technology to realize the compressed encoding of image video signal and voice audio signals, utilize switched telephone network, image voice messaging behind the compressed encoding is sent to the online specific user of telephone exchange, the specific user is after receiving the image voice messaging of compressed encoding, can carry out uncompressed encoding to it according to agreement H.324, reproduce original image and voice.This image/voice front end processing device that the utility model relates to, the hardware configuration that has broken away from personal computer, make hardware obtain simplifying, the reliability of its work is improved, cost is reduced, the multimedia terminal of this simple form can make collection, processing and the transmission of live image and on-the-spot voice realize freedom from repairs and unmanned, can be widely used in fields such as public safety technological prevention, electric power, post and telecommunications, industrial and mineral, medical treatment, traffic.
H.263 be the H.324 coding and decoding video suggestion of protocol terminal use of conduct that International Telecommunications Union (ITU) proposes, it is based on the hybrid coding of the DPCM of motion compensation, on the basis of motion search, carry out motion compensation, use dct transform and " it " font scanning Run-Length Coding then, thereby obtain output code flow.H.263 agreement also has four Advanced Options such as unrestricted motion vector, the arithmetic coding based on grammer, advanced forecasting techniques and PB frame coding, thereby reaches the purpose of further reduction bit rate and raising coding quality.G723.1 is the H.324 compression coding and decoding algorithm suggestion of the sound signal of protocol terminal use of conduct that International Telecommunications Union (ITU) proposes, and it has 5.27kBPS and two kinds of encoding and decoding speed of 6.3kBPS, all has very high voice quality and lower time delay.Audio coding as voice comprises linear predictor coefficient extraction and line spectrum pair analysis, the estimation of open-loop pitch value, the formation of associated filters, the closed loop pitch value is estimated and five parts of excitation codebook search.
By above-mentioned introduction to H.324 relevant video/audio coding suggestion, as seen H.324 image/video in the agreement and speech audio encryption algorithm are very complicated, operand is big, non-general singlechip chip can be competent at, and this just need utilize the arithmetic capability of high speed digital signal processor (DSP) chip.According to the purpose of this utility model, the coding of image/video and speech audio is finished by two digital signal processors respectively, and according to the operand of digital processing, the image/video coding is independently finished by first digital signal processor (1DSP), and second digital signal processor (2DSP) is finished the operation master control and the computing of speech audio coding of the related device of the utility model.First digital signal processor (1DSP) is selected floating-point signal processor, second digital signal processor (2DSP) is selected fixed-point dsp.Under the circuit structure of two DSP chip, be equipped with suitable peripheral chip circuit, finish the capturing and coding of image/video and speech audio and handle functions such as data transmission.
Introduce the related this image/voice front end processing device of the utility model below in conjunction with accompanying drawing.
Fig. 1 is the formation block scheme of image/voice front end processing device.
Fig. 2 is the image code processing device circuit diagram of the utility model device embodiment.
Fig. 3 is master control and the voice coding treating apparatus circuit diagram of the utility model device embodiment.
Fig. 4 is the enforcement synoptic diagram of a kind of far-end image acquisition and processing website of being made of the utility model device.
1 formation of introducing image/voice front end processing device in conjunction with the accompanying drawings.The utility model is made of following array apparatus:
Multi-channel video selecting arrangement 11: select circuit and video switch commutation circuit to form by multichannel decoding.Its outside connects a plurality of cameras, receive the video input of camera, its control end links to each other with sound encoding device 16 with master control, accept multichannel and select control signal, multichannel according to second digital signal processor (2DSP) in master control and the sound encoding device 16 is selected control signal, finish switching by multi-channel video selecting arrangement 11 to multichannel camera video signal, make road vision signal in many camera signals that only allow to insert multi-channel video selecting arrangement 11 in a certain amount of time, its output terminal is received video signal collective treating apparatus 14, through the vision signal of the switching of multi-channel video selecting arrangement 11, send into video signal collective treating apparatus 14.
Video signal collective treating apparatus 14: form by video image processing circuit, its video inputs connects multi-channel video selecting arrangement 11, video signal to the input of multi-channel video selecting arrangement 11 gatings is handled, analog video image signals is converted to the data image signal of YUV4:2:2, its data output end links to each other with image data storage apparatus 15, data image signal data after the acquisition process are stored in the view data storing apparatus 15, its signal controlling end links to each other with image code processing device 17, behind the analog video image signals EOC, first digital signal processor (1DSP) in the notice image code processing device 17 is further processed the data image signal data that are stored in the view data storing apparatus 15; 14 pairs of analog video signals of video signal collective treating apparatus carry out signal format, the data layout picture size of data image signal conversion, according to its with I2C bus that first digital signal processor (1DSP) in the image code processing device 17 links to each other on first digital signal processor (1DSP) received control command and carry out; After 14 pairs one road video signals of video signal collective treating apparatus are handled storage, prepare the vision signal of next road gating input is carried out acquisition process.
An image code processing device 17: with first digital signal processor (1DSP) is core.Its data terminal links to each other with view data storing apparatus 15, the data image signal data that will be stored in after video signal collective treating apparatus 14 acquisition process in the view data storing apparatus 15 are taken out, H.263 agreement according to ITU-T, data are compressed, generate the image compression data of the H.263 CIF form of piece image signal, again this image compression data is sent in the view data storing apparatus 15 temporary; Its signal control line links to each other with apparatus for processing of video signals 14, the I2C bus of first digital signal processor (1DSP) by linking to each other with video signal collective treating apparatus 14 in the image code processing device 17 will be carried out the conversion such as signal format, data layout and picture size that data image signal handles to analog video signal and be required to send into video signal collective treating apparatus 14; Its interruption and serial port link to each other with sound encoding device 16 with master control, first digital signal processor (1DSP) in the image code processing device 17 links to each other with second digital signal processor (2DSP) in the sound encoding device 16 by serial port and master control, after finishing the H.263 CIF format-pattern packed data of piece image signal, notify second digital signal processor (2DSP), and according to the steering order of second digital signal processor (2DSP), transmit (DMA) mode with immediate data, the image compression data of multiple image signal is sent to second digital signal processor (2DSP) carries out packing data.
Live image and rest image and be treated to the CIF form, live image is the QCIF form, on algorithm process to the image of QCIF form adopt aforesaid H.263 in more senior algorithm.
A view data storing apparatus 15: (SRAM) forms by static random memory, its data line links to each other with video signal collective treating apparatus 14 and picture coding device 17 respectively, its address wire, read-write control and sheet selected control system link to each other with first digital signal processor (1DSP) in the image code processing device 17, by first digital signal processor (1DSP) control through the YUV4:2:2 data image signal data of video signal collective treating apparatus 14 acquisition process and through the H.263 CIF of image code processing device 17 encoding compression image compression data to the storage of view data storing apparatus 15 and read.
Flip flop equipment 12: form by photoelectricity coupled circuit and signal isolation circuit.Its input end can receive the input of multichannel trigger pip, its output terminal links to each other with master control voice coding treating apparatus 16, trigger output signal is sent into master control and sound encoding device 16, carry out judgment processing by second digital signal processor (2DSP) in master control and the sound encoding device 16.
Voice collecting analog-digital commutator 13: form by voice amplification and voice analog to digital conversion circuit.Its input end can receive the external microphone voice signal, amplify and analog to digital conversion by the voice signal that amplifies and analog to digital conversion circuit is imported external microphone, its output terminal links to each other with master control voice processing apparatus 16, and pulse-code modulation (PCM) digital voice data to the master control and sound encoding device 16 of exporting 16 bits is further processed.
Line interface unit 18: form by common interface circuit (UART) and modulation-demodulation circuit (MODEM).Its signal controlling end links to each other with sound encoding device 16, and the modulation port links to each other with telephone wire.In master control and sound encoding device 16 under the management of second digital signal processor (2DSP), the Digital Image Data that second digital signal processor (2DSP) is sent here and the packing data of digital voice data are sent into the telephone wire that is connected with switched telephone network through modulation-demodulation circuit (MODEM); Second digital signal processor (2DSP) that the control command of the specific user's that will transmit via telephone wire equipment is sent in master control and the sound encoding device 16 is carried out.
Master control and sound encoding device 16: with second digital signal processor (2DSP) is core.Its signal controlling end links to each other with voice collecting analog-digital commutator 13, flip flop equipment 12, multi-channel video selecting arrangement 11, image code processing device 17 and line interface unit 18 respectively, and the co-ordination of entire image/voice front end processing device is played topmost effect.It is connected with flip flop equipment 12, judges that the n trigger circuit in the flip flop equipment 12 are triggered; It is connected with voice collecting analog-digital commutator 13, the work of control voice collecting analog-digital commutator 13, accept pulse-code modulation (PCM) digital voice data of voice collecting analog-digital commutator 13 output, and to its according to ITU-T G.732.1 the requirement of agreement compress processing; It links to each other with image code processing device 17, accept the signal of the H.263 CIF format-pattern packed data processing end of 17 pairs one width of cloth video images of image code processing device, and carve notice image code processing device 17 in due course and will finish the data of the multiple image that CIF format-pattern packed data H.263 handles and send into second digital signal processor (2DSP), with finish G.723 the processing of together packing of the data of compress speech, send into line interface unit 18; It links to each other with multi-channel video selecting arrangement 11, according to the judgement that flip flop equipment 12 n roads are touched, and the identification of image code processing device 17 image compression datas being handled end signal, send multichannel to multi-channel video selecting arrangement 11 and select control signal, by multi-channel video selecting arrangement 11 this control signal is deciphered, finished switching vision signal; It links to each other with line interface unit 18, will finish on image that packing handles and the telephone wire that speech data is delivered to switched telephone network links to each other, and the control command sent here by telephone wire of acceptance.
In the block scheme shown in Fig. 1, the method that big multi-functional square frame device can be achieved a solution by prior art, further introduce the work of first digital signal processor (1DSP) among the utility model embodiment, second digital signal processor (2DSP) below in conjunction with Fig. 2, Fig. 3, and the course of work of the utility model device embodiment, to more clearly understand conception of the present utility model.
First digital signal processor (1DSP) in the image code processing device 17 adopts floating number signal processing chip ADSP21061, this chip has the arithmetic element of three independences and energy parallel work-flow, can make its executed in parallel arithmetic logical operation and multiply operation in a machine cycle, be fit to handle high speed voice signal and high speed image signal, has the ability of supporting multiprocessors parallel processing, sheet contains bigger random memory (RAM) space, can carry out immediate data with external circuit at a high speed and transmit (DMA), during with its composing images code processing apparatus, the simple and stable performance of hardware design.
With reference to Fig. 2, first digital signal processor (1DSP) 201 has constituted image code processing device 17 with read-only storage (ROM) 202 and 40MHz crystal 2 03.The serial port of first digital signal processor (1DSP) 201 and control line link to each other with voice coding treating apparatus 16 with master control; Its address wire links to each other with ROM (read-only memory) (ROM) 201 and view data storing apparatus 15 respectively with data line, and data line links to each other with video signal collective treating apparatus 14; The control lines such as sheet choosing of ROM (read-only memory) (ROM) 202 and image data storage apparatus 15 also link to each other with the respective end of first digital signal processor 201, first digital signal processor (1DSP) 201 and video signal collective treating apparatus 14 also are connected promising its necessary control line of operate as normal, as I
2C bus and clock, interrupt, reset or the like.
After the utility model image/the voice front end processing device powers up, send the reset terminal of reset signal to the first digital signal processor (1DSP) 201 here by master control and sound encoding device 16, first digital signal processor (1DSP) 201 resets and load service data automatically from ROM (read-only memory) (ROM) 202, and the various control commands and the signal of video signal collective treating apparatus 14 operate as normal sent into video signal collective treating apparatus 14, wait for that video signal collective treating apparatus 14 finishes the interrupt request singal after video image acquisition is handled;
After video signal collective treating apparatus 14 collects a two field picture, just send interrupt request to first digital signal processor (1DSP) 201, first digital signal processor (1DSP) 201 is after the interrupt request singal of receiving video signal collective treating apparatus 14, turn-on data directly transmits (DMA) mode, and the start address of the transmission quantity of specified data and image data storage apparatus 15, the view data of video signal collective treating apparatus 14 passed in the image data storage apparatus 15 once store;
After one two field picture digital signal of 14 pairs of collections of video signal collective treating apparatus reaches image data storage apparatus 15 storages, read the view data that deposits in by first digital signal processor (1DSP) 201, carry out compressed encoding by agreement H.263, finishing coding and digital image compression data sends in the image data storage apparatus 15 again and stores, and send to master control and sound encoding device 16 and to interrupt application, the collection and the processing of request next frame video signal;
Multi-channel video selecting arrangement 11 is after the coding of receiving master control and sound encoding device 16 is selected signal, the video signal that switches corresponding camera enters video signal collective treating apparatus 14, carry out a new frame and look the step image signal's collection, taken the photograph the collection that the image that absorbed of head is all finished a frame video image until what multi-channel video selecting arrangement 11 connected;
After all cameras that connect are all finished the acquisition process of a two field picture, master control and sound encoding device 16 are by the serial port of first digital signal processor (1DSP) 201, notify first digital signal processor (1DSP) 201 to transmit the mode of (DMA) with immediate data, data layout in accordance with regulations, from view data storing apparatus 15, take out the digital image compression data after multiframe has been finished the image acquisition and processing compression, and be sent to master control and carry out the packing data processing with sound encoding device 16.40MHz crystal 2 03 is that first digital signal processor (1DSP) 201 provides clock reference.
Second digital signal processor (2DSP) in master control and the sound encoding device 16 adopts fixed-point dsp ADSP2181, this chip is to aim at digital signal processing and the chip microprocessor optimized, and it has arithmetic logical unit, data address generator, program queue management device.The byte data that the internal data of 16 bits directly transmits (IDAM) port, 8 bits directly transmits (DAM) port, dual serial mouth, programmable timer, sign I/O pin etc.
With reference to Fig. 3, second digital signal processor (2DSP) 301, ROM (read-only memory) (ROM) 302, reset circuit 303,, electrically-erasable storer (EEPROM) 304, and 16.67MHz crystal 3 05 constitutes master control and sound encoding device 16.Second digital signal processor (2DSP) 301 selects control line to insert multi-channel video selecting arrangement 11 by multi-channel video, its address wire is connected with ROM (read-only memory) (ROM) 302 and line interface unit 18 respectively with data line, and connect control line separately respectively, its data line is connected with flip flop equipment 12, second digital signal processor (2DSP) 301 also links to each other with voice collecting analog-digital commutator 13 and image code processing device 17 with serial ports 1 through serial ports 0 respectively, reset in addition control line and the interruption application line that link to each other with image code processing device 17, reset circuit 303,16.67MHz crystal 3 05 and electrically-erasable storer (EEPROM) 304 also link to each other with second digital signal processor (2DSP) respectively.
After the utility model image/the voice front end processing device powers up, reset circuit 203 is that second digital signal processor (2DSP) 301 provides reset signal, second digital signal processor (2DSP) 301 loads service data from ROM (read-only memory) (ROM) 302 automatically, and bring into operation, at first provide reset signal for image code processing device 17, make first digital signal processor (1DSP) enter running status, simultaneously, also provide reset signal for line interface unit 18, announcement trunk interface arrangement 18 enters work and prepares, so just finished the initial work of whole device, enter waiting status, prepare to accept control command that via line interface arrangement 18 transmits or the trigger pip of sending here by flip flop equipment 12;
In case line interface unit 18 is found to transmit the control command of specific user to the utility model image/voice front end processing device from telephone wire, propose to interrupt application to second digital signal processor (2DSP) immediately;
Secondary signal processor (2DSP) 301 is after detecting the interruption application signal of line interface unit 18, the control line that links to each other through both sends control command to line interface unit 18 immediately, making line interface unit 18 set up circuit with the specific user's who links to each other through switched telephone network equipment is connected, and the purpose of judgement control command, in the time of need checking video image that this image/the voice front end processing device is gathered and voice signal as control command, transmit just carry out next step image/speech data;
Second digital signal processor (2DSP) 301 reads the various parameters of this device from electrically-erasable storer (EEPROM) 304, as the form of the identification code of this device, image acquisition and camera transfer sequence etc., video input by the selection control pair camera that is connected with multi-channel video selecting arrangement 11 is switched, and start image code processing device 17 by serial port and carry out acquisition process, simultaneously, also read voice collecting analog-digital commutator 13 and gather pulse-code modulation (PCM) digital voice data of sending here after the speech processes by another serial port;
Image code processing device 17 is behind the intact every frame video image of acquisition process, all notify second digital signal processor (2DSP) 301 in the mode of interrupting, send multi-channel video by second digital signal processor (2DSP) 301 and select control, make multi-channel video selecting arrangement 11 switch to the video input of another road camera, carry out next road vision signal next frame treatment of picture by image code processing device 17;
The pulse code modulation digital voice signal that second digital signal processor (2DSP) 301 will read from voice collecting analog-digital commutator 13, according to ITU-T G.723.1 agreement compress, the digital speech packed data after compression is handled leaves in waits for packing data in the output buffer;
Second digital signal processor (2DSP) 301 is judged when the number of image frames of the transmission of packing has reached, be connected by serial port with image code processing device 17, transmit the mode of (DMA) with immediate data, receive the digital image compression data that image code processing device 17 is sent, carry out packing data simultaneously with the speech data behind the compressed encoding, give line interface unit 18, send to the ISSUER;
Via line interface unit 18 when the ISSUER constantly sends packing data, in case sending, the ISSUER stops the order that data transmit, via line interface arrangement 18 is sent to second digital signal processor (2DSP) 301, after second digital signal processor (2DSP) 301 is judged, notify image code processing device 17 to stop view data immediately and handle, close multi-channel video selecting arrangement 11, and operation circuit interface arrangement 18, make the circuit connection termination, get back to waiting status.
If ISSUER's control command is this device to be carried out parameter transmit, second digital signal processor (2DSP) then with the deposit data received in electrically-erasable storer (EEPROM) 304, by this device next time power up initialization the time call.
Under waiting status, receive the triggering input signal of external triggering probe as a road in the flip flop equipment 12, because 8 tunnel area triggering signals and 1 tunnel non-area triggering signal are the different ports that inserts second digital signal processor (2DSP), and 8 tunnel area triggering signals insert respectively, therefore, in case trigger pip occurs, second digital signal processor (2DSP) just this trigger pip of decidable is area triggering or non-area triggering, is which road in the area triggering.If the input of non-area triggering, second digital signal processor (2DSP) be then by multi-channel video control line control multi-channel video selecting arrangement 11, with the video input of camera from the first via, treat that a two field picture is handled after, order Switch Video input again; If area triggering input, second digital signal processing (2DSP) is then controlled multi-channel video selecting arrangement 11, earlier the video input is switched in the pairing video input of the corresponding camera that connects of this triggerings probe, treat that a two field picture is handled after, Switch Video is imported successively again;
When the video signal of video camera input is handled, second digital signal processor (2DSP) 301 begins to read the pulse-code modulation speech data of voice collecting analog-digital commutator 13, and call the telephone contact number that is stored in the specific user in the electrically-erasable storer (EEPROM) 304, via line interface arrangement 18 carries out dial-up connection to the specific user, in case circuit successful connection, first digital signal processor (1DSP) in second digital signal processor (2DSP), the 301 notice image code processing devices 17, transmit the mode of (DMA) with immediate data between the two, image compression data and speech data that image code processing device 17 is sent are packed, send to and set up the specific user that circuit connects;
Constantly sending in the process of image, voice packing data, in case the telephone wire of receiving end specific user through connecting transmits the order that stops to transmit, via line interface arrangement 18 is sent to second digital signal processor (2DSP) 301, after second digital signal processor (2DSP), 301 judgements, stop immediately handling, get back to waiting status.
The specific user's that can be connected equipment with the utility model, should possess image display device, the multiplying arrangement of raising one's voice, command input device, modulation-demodulation device, and have telephone wire concatenation ability, manmachine command recognition capability, meet H.324 uncompressed encoding ability of ITU-T, image shows and voice amplifying power etc., also can have functions such as data storage, forwarding, printing.Usually available personal computer is used as the continuous specific user's of the utility model equipment, and mixes corresponding application for this computing machine, just can be connected cooperation with the utility model.
Fig. 4 is the embodiment synoptic diagram that is made of far-end image acquisition and processing website the utility model device, wherein, remote monitoring website 401 is by the utility model image/voice front end processing device 450, and 8 tunnel area triggering devices that connect, 8 video cameras, 1 tunnel non-area triggering device 423,1 road microphone 424, the telephone wire 406 that connects switched telephone network constitute, flip flop equipment 1 and camera 1 are responsible for guarded region 1, and other zones also can be equipped with flip flop equipment and video camera by this.
The remote monitoring website 402,403 of a plurality of and the 401 identical outfits of remote monitoring website links to each other with Surveillance center's 405 control center's devices 460 (and 461) through telephone-switching network respectively, constitutes the multi-point remote image, sound is monitored the website.
Control center's device 460, can constitute by the personal computer that possesses modulator-demodular unit, display device, audio devices, manmachine command input media, and has H.324 decompress(ion) ability, website data management ability, also can increase subcontrol center device 461, to improve the ability of receiving a crime report of Surveillance center 405.
In conjunction with Fig. 4, introduce the process that constitutes the work of multi-point remote image/voice monitoring website by the utility model image/voice front end processing device:
Be example now with remote monitoring website 401.During operate as normal, control center's device 460 and distal view picture/voice processing apparatus 450 all are in armed state, in case guarded region 421 or guarded region 422 have abnormal conditions, trigger input 423 and receive the triggering alarm signal, make image/voice front end processing device 450 enter the triggering state immediately, start the video camera head unit and the microphone device 424 of guarded region 421 or guarded region 422, the image that guarded region is gathered and the voice of monitoring station carry out encoding compression processing, and by the telephone number that pre-deposits the control center's device 460 in image/voice front end processing device 450, dial to telephony switching gear 404 through telephone wire 406, application is connected with the circuit of control center device 460;
Control center's device 460 of Surveillance center 405 is receiving that telephony switching gear 404 is behind the ringdown that telephone wire 409 is sent here, enter circuit connection state immediately, setting up circuit with remote image/language treating apparatus 450 is connected, and be that the image/voice front end processing device 450 of remote monitoring website 401 is checked its identity to the calling party, call the customer data base that control center's device 460 is stored, User Profile information with monitoring station 401, as organization, the address, take precautions against object and time of fire alarming etc. and be presented on the display screen of control center's device 460, and remind the operator on duty of Surveillance center with alarm sound;
Image/voice front end processing device 450 is being determined with after Surveillance center 405 sets up circuit and is connected and checks identity, enter delivery status, with multi-channel video image after the compression processing and voice data packing, circuit through telephone wire 406 and telephone wire 409 foundation connects, constantly send to control center's device 460, receive the halt instruction that control center's device 460 of Surveillance center 405 sends until image/voice front end processing device 450, finish delivery status, get back to armed state;
After control center's device 460 is received image/speech data that image/voice front end processing device 450 sends, enter treatment state, code stream is divided into groups, view data is decoded, on image display window, show static or live image, carry out on-the-spot voice restoration by the sound card in control center's device 460 behind the audio decoder, control center's device 460 carries out hard-disc storage with image/speech data simultaneously.Under treatment state, the operator on duty of Surveillance center can send halt instruction to image/voice front end processing device 450 at any time, finishes the delivery status of image/voice front end processing device 450, and the circuit that two ends are set up connects disconnection, all gets back to armed state.
Under armed state, the operator on duty of Surveillance center also can send link order through switched telephone network to image/voice front end processing device 450 from control center's device 460, start image/voice front end processing device 450 and enter delivery status, the image and the sound of inquiry remote monitoring website 401.If the personnel of Surveillance center confirm that to the image of receiving situation is unusual, also remote-controlled distal view picture/voice processing apparatus 450 transmits the view data of specifying camera to gather.
Also can set up subcontrol center device 461 in the present embodiment, meet when busy at the number of the control center's device 460 of transfering when remote monitoring website 401~403, the number of the subcontrol center device 461 of can transfering automatically improves the ability of receiving a crime report of Surveillance center 405.
Claims (10)
1, a kind of image/voice front end processing device, the camera that connects and the picture signal and the voice signal of microphone collection are carried out analog to digital conversion, and carry out compressed encoding by the H.324 agreement of the ITU-T of International Telecommunications Union (ITU), packing data, it is characterized in that the coding of image/video and speech audio is finished by two digital signal processors respectively, and according to the operand of digital processing, the image/video coding is independently finished by first digital signal processor (1DSP), second digital signal processor (2DSP) is finished the operation master control and the computing of speech audio coding of this device, first digital signal processor (1DSP) is selected floating-point signal processor, second digital signal processor (2DSP) is selected fixed-point dsp, under the circuit structure of two DSP chip, be equipped with suitable peripheral chip circuit, finish the capturing and coding of image/video and speech audio and handle data-transformation facility.
2, a kind of image according to claim 1/voice front end processing device is characterized in that it comprises
Multi-channel video selecting arrangement 11: select circuit and video switch commutation circuit to form by multichannel decoding, its outside connects multi-cam, receive the video input of camera, its control end links to each other with sound encoding device 16 with master control, accept multichannel and select control signal, multichannel according to second digital signal processor (2DSP) in master control and the sound encoding device 16 is selected control signal, finish switching by multi-channel video selecting arrangement 11 to multichannel camera video signal, its output terminal is received video signal collective treating apparatus 14, through the vision signal of the switching of multi-channel video selecting arrangement 11, send into video signal collective treating apparatus 14.
3, a kind of image according to claim 1 and 2/voice front end processing device is characterized in that it comprises
Video signal collective treating apparatus 14: form by video image processing circuit, its video inputs connects multi-channel video selecting arrangement 11, video signal to the input of multi-channel video selecting arrangement 11 gatings is handled, analog video image signals is converted to the data image signal of YUV4:2:2, its data output end links to each other with image data storage apparatus 15, data image signal data after the acquisition process are stored in the view data storing apparatus 15, its signal controlling end links to each other with image code processing device 17, behind the analog video image signals EOC, first digital signal processor (1DSP) in the notice image code processing device 17 is handled further to the data image signal data that are stored in the view data storing apparatus 15.
4, a kind of image according to claim 1/voice front end processing device is characterized in that it comprises
An image code processing device 17: with first digital signal processor (1DSP) is core, its data terminal links to each other with view data storing apparatus 15, the data image signal data that will be stored in after video signal collective treating apparatus 14 acquisition process in the view data storing apparatus 15 are taken out, H.263 agreement according to ITU-T, data are compressed, generate the image compression data of the H.263 CIF form of piece image signal, again this image compression data is sent in the view data storing apparatus 15 temporary; Its signal control line links to each other with apparatus for processing of video signals 14, the I2C bus of first digital signal processor (1DSP) by linking to each other with video signal collective treating apparatus 14 in the image code processing device 17 will be carried out the conversion such as signal format, data layout and picture size that data image signal handles to analog video signal and be required to send into video signal collective treating apparatus 14; Its interruption and serial port link to each other with sound encoding device 16 with master control, first digital signal processor (1DSP) in the image code processing device 17 links to each other with second digital signal processor (2DSP) in the sound encoding device 16 by serial port and master control, after finishing the H.263 CIF format-pattern packed data of piece image signal, notify second digital signal processor (2DSP), and according to the steering order of second digital signal processor (2DSP), transmit (DMA) mode with immediate data, the image compression data of multiple image signal is sent to second digital signal processor (2DSP) carries out packing data.
5, a kind of image according to claim 1/voice front end processing device is characterized in that it comprises
A view data storing apparatus 15: (SRAM) forms by static random memory, its data line links to each other with video signal collective treating apparatus 14 and picture coding device 17 respectively, its address wire, read-write control and sheet selected control system link to each other with first digital signal processor (1DSP) in the image code processing device 17, by first digital signal processor (1DSP) control through the YUV4:2:2 data image signal data of video signal collective treating apparatus 14 acquisition process and through the H.263 CIF of image code processing device 17 encoding compression image compression data to the storage of view data storing apparatus 15 and read.
6, a kind of image according to claim 1 and 2/voice front end processing device is characterized in that it comprises
Flip flop equipment 12: form by photoelectricity coupled circuit and signal isolation circuit, its input end can receive the input of multichannel trigger pip, its output terminal links to each other with master control voice coding treating apparatus 16, trigger output signal is sent into master control and sound encoding device 16, carry out judgment processing by second digital signal processor (2DSP) in master control and the sound encoding device 16.
7, a kind of image according to claim 1/voice front end processing device is characterized in that it comprises
Voice collecting analog-digital commutator 13: form by voice amplification and voice analog to digital conversion circuit, its input end can receive the external microphone voice signal, amplify and analog to digital conversion by the voice signal that amplifies and analog to digital conversion circuit is imported external microphone, its output terminal links to each other with master control voice processing apparatus 16, and pulse-code modulation (PCM) digital voice data to the master control and sound encoding device 16 of exporting 16 bits is further processed.
8, a kind of image according to claim 1/voice front end processing device is characterized in that it comprises
A line interface unit 18: be made up of common interface circuit (UART) and modulation-demodulation circuit (MODEM), its signal controlling end links to each other with sound encoding device 16, and the modulation port links to each other with telephone wire.In master control and sound encoding device 16 under the management of second digital signal processor (2DSP), the Digital Image Data that second digital signal processor (2DSP) is sent here and the packing data of digital voice data are sent into the telephone wire that is connected with switched telephone network through modulation-demodulation circuit (MODEM); Second digital signal processor (2DSP) that the control command of the specific user's that will transmit via telephone wire equipment is sent in master control and the sound encoding device 16 is carried out.
9, a kind of image according to claim 1/voice front end processing device is characterized in that it comprises
Master control and sound encoding device 16: with second digital signal processor (2DSP) is core, its signal controlling end links to each other with voice collecting analog-digital commutator 13, flip flop equipment 12, multi-channel video selecting arrangement 11, image code processing device 17 and line interface unit 18 respectively, and the co-ordination of entire image/voice front end processing device is played topmost effect; It is connected with flip flop equipment 12, judges that the n trigger circuit in the flip flop equipment 12 are triggered; It is connected with voice collecting analog-digital commutator 13, the work of control voice collecting analog-digital commutator 13, accept pulse-code modulation (PCM) digital voice data of voice collecting analog-digital commutator 13 output, and to its according to ITU-T G.732.1 the requirement of agreement compress processing; It links to each other with image code processing device 17, accept the signal of the H.263 CIF format-pattern packed data processing end of 17 pairs one width of cloth video images of image code processing device, and carve notice image code processing device 17 in due course and will finish the data of the multiple image that CIF format-pattern packed data H.263 handles and send into second digital signal processor (2DSP), with finish G.723 the processing of together packing of the data of compress speech, send into line interface unit 18; It links to each other with multi-channel video selecting arrangement 11, according to the judgement that flip flop equipment 12 n roads are touched, and the identification of image code processing device 17 image compression datas being handled end signal, send multichannel to multi-channel video selecting arrangement 11 and select control signal, by multi-channel video selecting arrangement 11 this control signal is deciphered, finished switching vision signal; It links to each other with line interface unit 18, will finish on image that packing handles and the telephone wire that speech data is delivered to switched telephone network links to each other, and the control command sent here by telephone wire of acceptance.
10, a kind of image according to claim 1/voice front end processing device is characterized in that it not only can handle rest image, and can handle and transmit live image.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN00204487U CN2410710Y (en) | 2000-03-10 | 2000-03-10 | Image/voice front-end processing device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN00204487U CN2410710Y (en) | 2000-03-10 | 2000-03-10 | Image/voice front-end processing device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN2410710Y true CN2410710Y (en) | 2000-12-13 |
Family
ID=33572829
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN00204487U Expired - Fee Related CN2410710Y (en) | 2000-03-10 | 2000-03-10 | Image/voice front-end processing device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN2410710Y (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102339603A (en) * | 2010-07-23 | 2012-02-01 | 张文 | General digital voice direct exchanging machine |
CN101827109B (en) * | 2001-05-29 | 2012-07-04 | 索尼公司 | Transmission apparatus, reception apparatus, and transmission/reception apparatus |
CN102932379A (en) * | 2012-11-29 | 2013-02-13 | 中国人民解放军军事医学科学院卫生装备研究所 | Multimedia digital terminal for mobile hospital information system |
CN104080031A (en) * | 2013-03-28 | 2014-10-01 | 联想(北京)有限公司 | Signal processing method and electronic equipment |
-
2000
- 2000-03-10 CN CN00204487U patent/CN2410710Y/en not_active Expired - Fee Related
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101827109B (en) * | 2001-05-29 | 2012-07-04 | 索尼公司 | Transmission apparatus, reception apparatus, and transmission/reception apparatus |
CN102339603A (en) * | 2010-07-23 | 2012-02-01 | 张文 | General digital voice direct exchanging machine |
CN102932379A (en) * | 2012-11-29 | 2013-02-13 | 中国人民解放军军事医学科学院卫生装备研究所 | Multimedia digital terminal for mobile hospital information system |
CN104080031A (en) * | 2013-03-28 | 2014-10-01 | 联想(北京)有限公司 | Signal processing method and electronic equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102196243A (en) | Video data processing method, device and system | |
CN102301730A (en) | Method, device and system for transmitting and processing multichannel AV | |
CN100370752C (en) | Log information storage method | |
CN1777284B (en) | Image encoding method, image decoding method, and apparatus thereof | |
CN1077373C (en) | TV communication monitor system | |
CN100352246C (en) | Monitoring method and equipment for short-messages | |
CN101827209B (en) | High-definition video-circulating memory IP camera | |
CN101562729A (en) | Home video monitoring system based on mobile phone interaction and method thereof | |
CN100446561C (en) | VIsible telephone device and visible telephone system for checking picture validity | |
CN2410710Y (en) | Image/voice front-end processing device | |
CN101710981B (en) | Method and system for acquiring monitoring and surveying result in real time | |
CN1116766C (en) | Automatic remote image/language transfer monitoring system | |
CN104394420B (en) | A kind of video process apparatus, method and terminal device | |
CN108650489A (en) | A kind of acquiring and processing method and system of audio and video | |
CN102025980A (en) | Mobile terminal video monitoring system | |
CN212660229U (en) | Matrix switching device and audio and video matrix intercommunication system | |
KR100392193B1 (en) | Multiple web camera server system | |
CN106454276A (en) | Audio and video integration device and integrated video monitoring system | |
CN201726460U (en) | Set top box with voice call function | |
CN2542010Y (en) | Multifunctional video monitoring signal processor | |
EP1038389B1 (en) | Video data transmission | |
CN207706324U (en) | A kind of network video processing system of dsp processor | |
CN109095310A (en) | A kind of terminal for elevator rescue | |
CN1108060C (en) | Fully digitalized video communication and video switching method | |
CN2749182Y (en) | User identity monitor for radio station or handheld interphone communication network |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
C19 | Lapse of patent right due to non-payment of the annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |