CN103561189B - Embedded equipment for multimedia capture - Google Patents

Abstract

The present invention relates to the embedded equipment for multimedia capture.Disclose a kind of multimedia equipment, including being exclusively used in the input port (210) receiving real-time media signal and being exclusively used in the processor system (250) of capture real-time media signal.Described processor system defines embedded environment.Input port (210) and processor system (250) are integrated in multimedia capture equipment.Input port include audio input port (202) and in optically-captured input port (204) or digital-image input port (208) at least one.

Description

Embedded equipment for multimedia capture

The application be Application No. 200780030452.2, filing date on June 22nd, 2007, The division of the application for a patent for invention of invention entitled " for the embedded equipment of multimedia capture " Application.

Technical field

The present invention relates to a kind of apparatus and method for for media signal capture, more specifically, this Invention relates to a kind of apparatus and method for for using embedded equipment capture media signal.

Background technology

For the mechanism of such as university and enterprise, capture the most on-demand available and record The office coaching watched after system and the ability of the live media record of meeting are increasingly important.Although certain A little commercial protocol for capturing and issue document recording are known, but these schemes are led to It is often to realize on the common apparatus of such as personal computer (PC).Because these based on The Acquisition Scheme of PC employs universal component and software, thus they costly, be difficult to tie up Protect, and effect is low, be vulnerable to security threat when capture and storage signal, so they are wanted Ask special technical support, and, such as it is difficult to be integrated in smart classroom environment them. Accordingly, there are the demand for special multimedia capture equipment.

Summary of the invention

Provide a kind of multimedia equipment, including being exclusively used in the input receiving real-time media signal Mouth and the processor system being exclusively used in capture real-time media signal.The definition of described processor system is embedding Enter formula environment.Input port and processor system are integrated in multimedia capture equipment.Input Port includes audio input port and at optically-captured input port or digital picture input At least one in Kou.

Accompanying drawing explanation

Fig. 1 is a system block diagram, illustrates to be coupled according to an embodiment of the invention network On control server embedded equipment.

Fig. 2 is a system block diagram, illustrates embedded equipment according to an embodiment of the invention, This embedded equipment has some input ports, processor system, memorizer and alarm module.

Fig. 3 is a block diagram, describes and flows through control server according to an embodiment of the invention In the media signal stream of each module.

Fig. 4 be an example embodiment of the embedded equipment according to embodiments of the invention be System block diagram, this embedded equipment has some input ports, some output ports, processor system System and memorizer.

Fig. 5 is a flow chart, illustrates to use embedded dress according to an embodiment of the invention Put media signal is carried out capture, process, store and/or send.

Detailed description of the invention

Embedded equipment (also referred to as " embedded equipment ") for multimedia capture is one Kind be exclusively used in capture, process, store and/or send real-time media signal (such as, audio signal, Video signal, optically-captured (visual-capture) signal, data image signal) equipment. Embedded equipment can capture one or more real-time media signal, and such as, described real-time media is believed The data image signal that number can include showing in the classroom among carrying out, visual-capture signal, sound Frequently signal and/or video signal.After having captured one or more media signal, such as, Embedded equipment can by the compression of content, index (indexing), encode, decode, Synchronize and/or format, process one or more signal described.For example, it is possible to be distributed on network Embedded equipment, and capture according to these embedded equipments of certain dispatch coordination, process, deposit Storage and transmission real-time media signal, such as user from being configured to such as course management system Control server and/or one or more server finally retrieve.It is distributed it carrying out Before, alternatively it is also possible to by controlling the server media to capturing on embedded equipment Stream is monitored and/or is processed further.

As a kind of special (that is, for specific purpose) equipment with embedded environment, (such as, embedded equipment employs (hardened) operating system (OS) of reinforcing and processor Processor system) capture, process, store and/or send real-time media signal.Reinforce OS is configured to resist security attack and (such as, prevents unauthorized user or program Access), and contribute to those only with the capture of real-time media signal, process, store and/ Or send relevant function.In other words, hardware and software is integrated in embedded equipment, And it is designed specifically for capturing, process, store and/or sending in real time to them Media signal.Due to for capturing, process, store and/or send the hard of real-time media signal Part and Integrated Simulation are in the embedded environment of embedded equipment, so compared with general-purpose system, Reduce and install, regulate, design, dispose and cost that technical support is relevant and complexity.

Real-time media signal represent the moment essentially identical with the moment that a certain event occurs by Acquired in sensor and do not have can in the case of perceived delay sensor when obtaining and The image of this event transmitted between embedded equipment and/or sound.Can perform at any time Embedded equipment to the capture of real-time media signal, process, store and/or send.In whole theory In bright book, also real-time media signal is called media signal.

Fig. 1 is a block diagram, illustrate on network 110 distribution and be connected to control Several embedded equipments 100 of server 120.In this embodiment, controlling service Device 120 is connected with server 130, wherein, configures described server 130, example As, it is configured to course management system (such as, runs Blackboard^TMOr WebCT Server).Network 110 can be any kind of network, including as wired or nothing The LAN that gauze network is realized in various environment such as such as office or campus etc. Or wide area network (WAN) (LAN).Embedded equipment 100 can capture by such as passing The electronics of sound device, web camera, video camera, still camera and video machines Real-time media signal acquired in capture device or sensor, it includes audio signal, vision Capture signal, data image signal and video signal.Embedded equipment 100 can also be joined It is set to process, store and/or send captured real-time media signal.Can also process, Store and/or send the data relevant to the content that real-time media signal is captured；Such as, so Data can include capture time, capture place and/or the name of talker.

The beginning that such as control server 120 or embedded equipment 100 are generated can be responded With stopping designator, prompting embedded equipment 100 starts and stops to catch real-time media signal Obtain.Can according to control server 120 and/or each embedded equipment 100 is determined and/or The scheduling stored, generates and starts and stop designator.Such as, if in university campus environment In realized, then embedded equipment 100 can be arranged in the classroom of university, and lead to Cross university communications network to be connected.For example, it is possible in a certain concrete moment, according to being stored in Scheduling on embedded equipment 100, prompting embedded equipment 100 is from a certain concrete university's religion Room capture media signal.

Can process, store the media signal that each embedded equipment 100 is captured, and can So that media signal is sent to control server 120.Control server 120 and receive media signal, And sending them to server 130, the content making media signal in server 130 can For being distributed.In certain embodiments, the content making media signal can be used for being distributed to control clothes User 140 at business device 120.In certain embodiments, can use in the content making media signal Before distribution, server 120 and/or other processing equipment (not shown) can controlled The upper execution further process to media signal.Such as, embedded equipment 100 and/or control Server 120 can be by being compressed media signal, index, encode, decode, synchronizing And/or format, process media signal.

The beginning that such as control server 120 or embedded equipment 100 are generated can be responded And/or stopping designator, prompting embedded equipment 100 starts and stops handled real-time matchmaker The transmission of body signal.Can the condition generation according to scheduling or according to definition start to refer to stopping Show symbol.In certain embodiments, starting and/or stop designator can be to control in server Trigger the triggering signal that maker is generated, and added by the triggering receptor in embedded equipment To receive.Serial number 10/076,872, Publication No. US2002/0175991A1, entitled " GPI Trigger Over TCP/IP for Video Acquisition " co-pending application in, just regard Frequently the capture of signal, elaborates the more details about triggering signal, and wherein this application is by drawing With being herein incorporated.

Embedded equipment 100 can also be configured to send after any stage of processing Media signal.For example, it is possible to embedded equipment 100 is configured to carrying out signal After compression, according to network traffic conditions, the most synchronize with data image signal and the non-lattice of audio frequency Formula part, sends media signal to controlling server 120.Can be controlling server 120 It is configured to synchronize and format the audio frequency and digital picture received from embedded equipment 100 Signal.

For example, it is also possible to by confidence monitoring signal, monitored embedding by controlling server 120 The capture of the media signal on formula device 100.Controlling server 120 can use confidence level to supervise Depending on signal according to such as dispatching, determine concrete embedded equipment 100 the most correctly Capture media signal.Confidence monitoring signal can include embedded equipment 100 captured and/ Or some parts (such as, the segmentation letter of detected media signal or any media signal Number) any combination.Such as, confidence monitoring signal can be for from video interval property institute Frame/the image obtained.Confidence monitoring signal can be compression, it is also possible to for unpressed matchmaker Body signal.Confidence monitoring signal can also by that generated according to media signal, instruction Capture the single signal/designator of this media signal.Such as, confidence monitoring signal can be Instruction embedded equipment 100 is capturing or is not capturing the binary system instruction of concrete media signal Symbol.

Although Fig. 1 only describes and is connected with multiple embedded equipments 100 in some embodiment Single control server 120, but in other embodiments, it is also possible to more than one control Control server 120 is connected with any combination of embedded equipment 100.For example, it is possible to two Individual control server 120 is configured to coordinate the media signal that embedded equipment 100 is captured Capture, process, store and/or send.Embedded equipment 100 can be programmed to know The most multiple control servers 120, and can be programmed to for instance, it is possible to handled matchmaker A part for body signal is sent to control one of server 120.

Fig. 2 is a system block diagram, illustrates have some input ports 210, processor system System 250, memorizer 260 and the embedded equipment 200 of alarm module 280.Embedded equipment The beginning that scheduler 258 in 200 answer processor systems 250 is generated and stopping designator, Via input port 210, capture real-time media signal from various electronic equipments.Processor system 250 receive media signal, and use compression module 254 compresses media signals.Processor system System 250 can use memorizer 260 to perform any function relevant to embedded equipment 200, Such as store the media signal compressed.When it is pointed out by scheduler 258, embedded The media signal of device 200 capture compression, and the media signal of compression is transferred to control clothes Business device 220.For example, it is possible to exist via the output port (not shown) of embedded equipment 200 In network connection, the media signal captured is sent to control service as the signal of multiplexing Device 220.

Input port 210 includes one or more audio input port 202, one or more regards Feel capture input port 204, one or more video input port 206 and one or more Digital-image input port 208.Using each input port 210 as embedded equipment 200 The part of embedded environment the most integrated.The media that input port 210 can be captured Signal is received as analogue signal or as digital signal.If added as analogue signal To receive, then processor system 250 can be converted into digital signal analogue signal, otherwise also So.

One or more audio input ports 202 are used for capturing audio signal.Such as, described One or more audio input ports 202 can be that one or more RCA stereo audio is defeated Inbound port, one or more 1/4 ' ' jack stereo audio input port, one or more XLR Input port and/or one or more USB (universal serial bus) (USB) port.Can be by such as single Solely microphone or be connected to video camera microphone, any kind of can produce sound Frequently the equipment of signal produces audio signal.

Such as, one or more optically-captured input ports 204 are by one or more VGA Input port, one or more Digital Visual Interface (Digital Visual Interface, DVI) Input port, graphic array (XGA) input port of one or more extension, one or many Individual HD-15 input port and/or one or more bnc connector port, receive numeral or Analog video graphic array (VGA) signal.Optically-captured input port 204 captures such as to be counted Image produced by calculation machine or microscope.Can also use and be connected to optically-captured input port The electronic equipment of 204, such as from such as being captured by the electronic whiteboard of VGA signal transmission image Image.

One or more video input port 206 via one or more input ports from such as regarding Frequently the equipment of video camera receives mobile video signal, and described input port includes, but are not limited to One or more s-video input port, one or more synthetic video input port and/or one Or multiple component video input port.

One or more digital-image input port 208 are via the most one or more ethernet sides One or more input ports capture digital picture of mouth and/or one or more USB port. It is, for example possible to use digital camera or web camera obtain digital picture.

The hardware component in processor system 250 (for example, it is possible to include that special-purpose is integrated Circuit (ASIC), central processing unit (CPU), module, digital signal processor (DPS), Processor and/or coprocessor) be configured to perform special with capture, process, store and / or send the function that media signal is relevant.

Embedded equipment 200 is used processor system 250 to capture and is connect by input port 210 Any combination of the real-time media signal received.Embedded equipment 200 synchronizes to obtain each media letter Number, although these media signals are via collected by different input ports 210.Such as, to the greatest extent Pipe can receive the chalk of shock classroom blackboard by audio input port 202 via microphone Sound but it also may use the video camera being connected to video input port 206 to synchronize to receive Wave the action of the hands of the professor of chalk.Embedded equipment 200 is synchronously received and processes these Media signal.

In some embodiments it is possible to embedded equipment 200 is configured to only capture media signal Some part.For example, it is possible to embedded equipment 200 is configured to capture and storage warp The sound received by microphone, and ignore static noise and/or intermittent silence.Such as, it is possible to So that embedded equipment 200 is configured to only when movement or the substantial variations of scenery being detected, Just capture video signal or data image signal.In many examples, can be being included in Each input port 210 in embedded equipment 200 is configured to by different and/or can The speed become captures one or more media signals.For example, it is possible to video input port 206 It is configured to by the frame per second of the digital picture received than digital-image input port 208 high Frame per second receives video signal.

When receiving media signal, processor system 250 can use compression module 254 to it Be compressed.Such as, compression module 254 can be audio signal and the numeral synchronizing reception VGA signal pressure shortens the multiple of such as the 2nd layer of form of moving image expert group (MPEG) etc. into Compressed format.Compression module 254 can also be compressed into media signal more than one lattice simultaneously Formula.Such as, if receiving data image signal and relevant audio signal, then can be number Word picture signal is compressed into JPEG (JPEG) form, audio frequency can be believed simultaneously Number it is compressed into mpeg audio the 3rd floor (MP3) form.In certain embodiments, compression mould Block 254 can be compressed into multiple format single media signal simultaneously.Analogously, permissible One or more media signals are compressed into single compression stream (such as, MPEG-4).

Compression module 254 can be configured to use those to use one or more encoding and decoding Device damage or lossless format any combination to include the frame per second of input signal, bit rate, Multiple variablees of frequency, resolution, color and stability are adjusted.Codec is one Plant equipment, the hardware being configured to the media signal such as captured is encoded and/or decoded Module and/or software module.Compression module 254 can also be configured to media be believed simultaneously Number any combination compress, decompress, encode and/or be decoded as the combination of any form.Described Form need not be compatible.

In certain embodiments, for example, it is possible to processor system 250 and compression module 254 It is configured to the type according to the input equipment being connected to input port 210, uses different Codec.Such as, if using web camera via digital-image input port 208 Capture digital picture, then can become tiff form compression of images, but, if using numeral Still camera capture data image signal, then can be processor system 250 and compression module 254 are programmed for or are configured to detect this difference and be used instead JPEG compression encoding and decoding Device.

After the processor system 254 compresses media signals, the media signal compressed is deposited Store up in memory 260, such as, in order to send to controlling server 220, to carry out later Further process.Memorizer 260 can be the fixing and/or detachable of any suitable type Storage device.Memorizer can be, but be not limited to tape, digital video disc (DVD), Digital video tape (DVC), random-access memory (ram), flash memory and/or hard disk drive Dynamic device.The size of memorizer 260 can be different with the difference of the amount of storage needed for concrete application. Such as, if embedded equipment 200 is intended to capture by the substantial amounts of media letter of lossless format compression Number, then can increase the size of memorizer 260.Such as, if embedded equipment 200 is intended to (such as, during network failure) media signal is captured within the relatively long time period, and Such as do not controlled in the case of server 220, be the most also loaded on the media signal captured The size of memorizer 260 can be increased.Memorizer 260 can be used for preventing because network interrupts not Can be sent to such as control the loss of the media signal captured of server.Implement at some In example, if necessary, before the compression, processor system 250 can use memorizer 260 cache the information received via input port 210.

It is embedding that processor system 250 also includes that scheduler 258, scheduler 258 can generate prompting Enter formula device 200 such as to start and stop capture and/or start and stop sending opening of media signal Begin and stop designator.Scheduler 258 can access a kind of scheduling, and this scheduling is locally stored On embedded equipment 200 or control server 220.Described scheduling can include the most special Beginning and dwell time for input port 210.Such as, if certain position professor will be at 4 The middle of the month, the class of a hour was lectured in sky on every Mondays, then scheduler 258 can use scheduling embedding to point out Enter one of that day that formula device 200 is taught weekly this professor of time IT of 4 months Hour teaching.Scheduler 258 can be configured to according to being stored in the most embedded dress Put more than one the scheduling capture on 200 or send media signal.

Scheduler 258 can generate a kind of scheduling, or receives one from controlling server 220 Scheduling.Such as, scheduler 258 can according to the instruction preferably transmission time, from controlling clothes The input of business device 220, generates the scheduling for sending the media signal captured.Real at some Executing in example, scheduler 258 can access and perform one and such as be sent out from control server 220 That send and be stored in the scheduling in the memorizer 260 of embedded equipment 200.Real at some Executing in example, scheduler 258 cannot be only used for starting and stopping embedded equipment 200 to media letter Number capture and/or transmission, and may also begin to stop the process to media signal and/or Storage.

Replace and use scheduling to point out the capture to media signal and/or transmission, scheduler 258 Some function to be performed can also be pointed out according to defined criterion.Such as, when a certain quantity Bandwidth can be embedded equipment 200 when using, scheduler 258 can be configured to carry Show and send media signal from embedded equipment 200.In certain embodiments, scheduler 258 Included as hardware and/or the software module independent of processor system 250.

In certain embodiments, replace the processor system 250 with multiple processor, embed Formula device include can for be configured to defined in embedded environment and/or operation any class The single processor of the processor (such as, flush bonding processor or general processor) of type. Described single processor can be configured to perform to be performed by processor system 250 Function and/or embedded equipment 200 in other function.In certain embodiments, except pressure Outside contracting module 254, processor system 250 can also include being configured at embedded equipment Other the processor operated in the embedded environment of 200 and/or coprocessor.

In some alternative embodiment, the function of the scheduler in embedded equipment can be by controlling Server is performed.In more such embodiments, if the repertoire of scheduler by Control server to be performed, then can design embedded equipment in the case of without scheduler. Such as, control server and can store the tune relevant to each embedded equipment of distribution on network Degree, and can to each embedded equipment send start with stop designator, with capture and/ Or transmission media signal.

In certain embodiments, permissible with stopping designator from the beginning controlling server 220 Storage based on the most each embedded equipment 200 and/or the variable of transmission capacity.Control service Each embedded equipment 200 can be inquired by device 220, such as, to determine each embedding Formula device 200 can use how many memorizeies 260 capacity.Such as, server 220 is controlled also Receive from each embedded equipment 200 that to indicate each embedded equipment 200 to have how many available The signal of memorizer 260 capacity.Then, controlling server 220 can be according to memory span Designator is prioritized and points out and sends information from embedded equipment 200.

As in figure 2 it is shown, embedded equipment 200 can include that it is hardware and/or software module Alarm module 280.Alarm module 280 can both include the output port for sending signal (not shown), also includes the input port for receiving signal.Destroyed in physical security In the case of, it is possible to use alarm module 280 sends a signal to control server 220.As Fruit the position of embedded equipment 200 from such as its fixed position in meeting room between floors Be changed, then alarm module 280 can send instruction and occur in that the signal of physical damage.Example As, alarm module 280 can send the designator relevant to embedded equipment 200 so that can The embedded equipment 200 destroyed is labelled by such as controlling server 220.Remove Outside this, such as, control server 220 and can also send ping letter to alarm module 280 Number, to determine that embedded equipment 200 is the most properly functioning and/or has suffered physical damage (such as, removing).

Fig. 2 it also illustrates and can use the direct control signal 230 from such as user, controls Embedded equipment 200.Embedded equipment 200 can include such as graphic user interface (GUI) The interface of (not shown), physical display (not shown) or button (not shown), with Produce the direct control controlling some or the repertoire that can be performed by embedded equipment 200 Signal 230 processed.Such as, direct control signal 230 can be used for amendment and is stored in embedded equipment Scheduling on 200, the process of amendment media signal, the mistake got rid of on embedded equipment 200 Or control embedded equipment, such as when control server 220 delays machine.Such as, directly control Signal 230 processed can be also used for starting and stopping the capture to media signal and/or transmission.Such as, Accepting via interface (not shown) before the direct control signal 230 that user sends, can With embedded equipment 200 is configured to require such as user checking (such as, user name/ Password).Non-immediate it is coupled in the interface of embedded equipment 200 (not for example, it is also possible to use Display) generate direct control signal 230.Clothes are controlled in some embodiments it is possible to use Business device 220 directly controls embedded equipment.

In certain embodiments, processor system 250 can include performing such as media signal Encode, decode, index, format and/or other of synchronization etc. process function other software and / or hardware module.In some embodiments it is possible to embedded equipment 200 is configured to do not have Compression module 245, and unpressed media signal can be sent to controlling server 220.

Fig. 3 is a block diagram, describes and flows through control server 390 from embedded equipment The media signal stream of each module.Control server 390 receive include compression audio signal 300, The visual-capture signal 310 of compression, the video signal 320 of compression and the digital picture of compression The individually compression real-time media signal 305 of signal 330.Although what this figure described is independently Receive each media signal 305, however, it is also possible to as when being received by control service Device 390 removes the multiplex signal of multiplexing, connects at such as Internet protocol (IP) network On by control server 390 receive media signal 305.In some embodiments it is possible to matchmaker Body signal 305 is combined into and one or more is encoded to one or more forms by embedded equipment Signal, when 330 receiving, controlling server 390 can be decoded this signal and be separated. For example, it is possible to embedded equipment by audio and video frequency signal send to control server 390 it Before, combine them as single MPEG-2 signal.Can also it addition, control server 390 Media signal 305 is received from more than one embedded equipment, and, it is, for example possible to use Multiple threads processes each media signal 305 concurrently.

The analogously media signal of each compression that processing controls server 390 is received 305.Can be processed by one of decoding module 315, index module 325 and coding module 335 Each media signal 305.In the most treated (such as, single process, by group process) After each media signal 305, these signals are synchronized by synchronizer/formatter 350 And/or format.

Processing of video signal 320 to compression will be used as the media signal 305 compressed The representative example processed.According to this representative example, it is well understood that remaining is believed The process of numbers 305.

When controlling the video signal 320 that server 390 receives compression, decoding module 322 Signal is condensed to the video signal of decoding from its compressed format decompression.Can be decoding module 322 It is configured to when receiving the video signal 320 of compression to detect its form, with to signal 320 Correctly carry out decoding/decompressing.When the video video signal 320 of compression being converted into decoding During signal, its unprocessed form can be decoded as, or be decoded as to be taken by control Business device 390 is in order to continue with other form any of this signal.In certain embodiments, may be used With in the case of not decoding, by controlling the reception of beacons pressure that server 390 can process The video signal 320 of contracting.In this case, video signal 320 can be made to walk around decoding mould Block 322.

It follows that the video signal decoded is processed by index module 324, with by all As to the determination of scene change and labelling, the video signal decoded being indexed.Carry out rope Regarding it as synchronizer/formatter 350 after just can be the video signal decoded and other media Signal 305 is correctly synchronized, and provides by such as end user's (not shown) in addition The relevant index point used.Index module 304 is used to examine from the audio signal 300 of compression Survey fragment rather than detection scenery so that can compression audio signal 300 and other Media signal 305 is correctly synchronized, and provides by such as end user's (not shown) The relative index point used.Then, coding module 326 has index (such as, scape Thing change labelling) the video signal decoded be encoded to pass through synchronizer/formatter 350 codings being synchronized and formatting.

Return to the general discussion to Fig. 3, by decoding module 315, index module 325 And after coding module 335 has carried out processing, synchronizer/formatter 350 receives media letter Numbers 305.Media signal is indexed, synchronizes and formats by synchronizer/formatter 350, They can be conducted interviews via user interface 340 by user.In synchronizing process, Scenery in each media signal is the most synchronize with audio fragment, in order to the pen such as fallen The sound clashing into floor can match with the video on pen shock floor.Synchronizer/formatter 350 can turn to, the media signal format synchronized, any form that can be used by user.

Synchronizer/formatter 350 can receive auxiliary information 370, and can be auxiliary money Material (collateral material) 370 media signal the most treated with each module 305 is in addition Combination.Such as, auxiliary information 370 can be can be combined with the media signal after processing, Additional marking information with assist in synchronization process.In certain embodiments, auxiliary information can be That to be combined with the media signal 305 having been described above, by other multimedia capture equipment (not Display) the additional media signal that captured.Although not shown, but control Control server 390 can also include that the auxiliary information 370 being received control server 390 enters Row decoding, index (such as, scenery/fragment detection or optical character identification) and/or coding Individually module.

Although fig. 3 illustrate that be single module perform decoding, index, encode, synchronize and Format, but the function of each module can also be refined further and/or be combined into One or more processors or module.These functions can also be refined and/or be combined to one On above control server.It addition, control server 390 could be included for store from Information that one or more embedded equipments are received and/or cache the memorizer of this information and (do not show Show) or single data base's (not shown).

Can on embedded equipment alternately perform control server 390 any module and/ Or any combination of the function performed by other parts.Such as, media signal is being compressed And before transmitting it to control server 390, embedded equipment can perform index.

Control server 390 and can also receive input signal via user interface 340 from user. Such as, user interface 340 can be to connect via network to carry out interface with control server 390 Remote computer and/or can be to be integrated in the interface controlled in server 390.User interface 340 can be used for controlling any module and the correlation function of these modules and/or for controlling server Process information on 390 specifies parameter.Such as, user input signal can be for controlling clothes The specific collection of media signal 305 received at business device 390, it is intended that should by lock unit/ The type of the form that formatter 350 is used.User interface 340 can be configured to make User can manually handle any media letter that the embedded equipment of distribution is received on network Numbers 305.

User interface 340 can be additionally used in access, monitors and/or control to be connectable to control clothes Business device 390 and such as any embedded equipment (not shown) of distribution on network.Such as, Via user interface 340 to embedded equipment and/or control server 390 access can be logical Cross what password was protected by.Such as, user interface 340 can be used for define embedded equipment made Scheduling or by controlling the scheduling that used of server, above-mentioned scheduling makes distribution in order to send Embedded equipment capture, process, store and/or send start with stop signal.User connects Mouth 340 can be additionally used in be observed and can be given birth to by the embedded equipment being connected to control server 390 The confidence monitoring signal become.

User interface 340 can be additionally used in and accesses by controlling the final synchronization that server 390 is generated / formatting component.More than one user interface 340 can be distributed on network, and permissible It is configured to be able to access that control server 390(such as, at access control server 390 Universal network on distribution personal computer) produced by content.In certain embodiments, Control server 390 to send the content to wherein make content can be used for one by user interface 340 Individual or the server (not shown) of multiple user.

As it is shown on figure 3, control server 390 to include alarm module 380, alarm module 380 The safety to any embedded equipment that may be relevant to controlling server 390 for detection is broken Bad.Such as, in the case of embedded equipment suffers physical damage (not shown), warning mould Block 380 can be used for sending a signal to user via user interface 340.In certain embodiments, Alarm module 380 can be programmed to via such as Email a certain for instruction concrete Embedded equipment suffers from the designator of a specific degrees destruction and is sent to user.

Fig. 4 is the system block diagram of the example embodiment of embedded equipment 400, this embedded equipment There is some input ports 410, some output ports 420, processor system 450 and storage Device 460.The beginning that embedded equipment 400 response scheduling device 456 is generated and stopping designator, Real-time matchmaker is captured from electronic equipment (such as, microphone, video camera) via input port 410 Body signal.Processor system 450 accesses memorizer 460, to perform and embedded equipment 400 Relevant function, such as, store handled media signal.Embedded equipment 400 is via output 420 handled media signals of port are transferred to control server 440.

Input port 410 includes one or more audio input port 412, one or more regards Feel capture input port 414, one or more video input port 416 and one or more Digital-image input port 418.Each output port 410 is configured to output with defeated Go out the media signal of port 420 communication.Output port 420 includes that one or more audio frequency exports Port 422, one or more optically-captured output port 424, one or more video output terminals Mouth 426 and one or more digital-image output port 428.Output port 420 can be used for Media signal handled by being stored in such as memorizer 460 is transferred to control server 440.Such as, output port 420 can be additionally used in and the signal of such as confidence monitoring signal is exported To controlling server 440 or other electronic equipment 480.

Processor system 450 includes flush bonding processor 452, coprocessor 454 and adjusts Degree device 456.Such as, flush bonding processor 452 and/or coprocessor 454 can be special In by media signal being captured, compresses, encode, decode, index, synchronize and/or lattice Formulaization processes the digital signal processor (DSP) of media signal.Such as, coprocessor 454 Can be the processor of such as field programmable gate array (FPGA), can to its be programmed with Control the function performed by flush bonding processor 452.Such as, coprocessor 454 and/or embedding Enter formula processor 452 and can include that scheduler 456 is as a module.In certain embodiments, Including scheduler 456 as a module being separated with processor system 450.

In certain embodiments, it not to make processor system 450 have multiple processor, but Make embedded equipment include can for be configured to defined in embedded environment and/or behaviour The list of any kind of processor (such as, flush bonding processor or general processor) made Individual processor.Single processor can be configured to perform by processor system 450 Other function in performed function and/or embedded equipment 400.In certain embodiments, In addition to flush bonding processor 452 and coprocessor 456, processor system 450 also may be used To include other processor being configured in the embedded environment of embedded equipment 400 operation And/or coprocessor.

Can processor system 450 and/or be not included in processor system 450 other Processor (not shown) is configured to perform the additional function of embedded equipment 400.Example As, processor system 450 can be configured to support the segmentation to captured media signal. In such a scenario, processor system 450 can be configured to include such as optically-captured Distributed amplifier (such as, VGA distributed amplifier on plate), visual-capture signal dispenser And/or the hardware of optically-captured synchronizing amplifier etc. and/or software module.Such as, these hardware And/or some combination of software module can make embedded equipment 400 via optically-captured input port 414 capture VGA signals, and via optically-captured output port 424 to electronic equipment 480 (such as, classroom projector) returns the copy (also referred to as splitting signal) of described signal. Use these hardware and/or software module, it is also possible to processor system 450 is configured to Before segmentation media signal is transferred to electronic equipment 480, synchronizes and stablize this signal.

In certain embodiments, such as can processor system 450 be programmed to support with Too network switch (not shown) (such as, multiport fast ethernet switch, gigabit Ethernet switch) and/or POE (PoE) port (not shown).Embedded dress Put some embodiment of 400 can be included in the case of power failure by embedded dress The integrated trunking putting 400 shunting signals (such as, optically-captured input signal) (does not shows Show).Such as, if the power interruptions of embedded equipment 400, then this integrated trunking can Media signal is sent to classroom throwing by the output of embedded equipment and output port 420 Shadow instrument.

Fig. 5 is a flow chart, illustrates to use embedded dress according to an embodiment of the invention Put the capture to media signal, process, store and/or send.This flow chart describes at 500 Be embedded equipment receive start acquisition indicator.The instruction of described beginning acquisition indicator embeds When formula device captures real-time media signal.Beginning acquisition indicator at 500 may indicate that: Embedded equipment will begin to capture this media when the establishment of media signal immediately according to scheduling Signal, or start to capture media signal in the time that user subsequently specifies.Beginning at 500 Acquisition indicator can also indicate that embedded equipment will capture media signal subset, such as, Only capture audio signal and visual-capture signal.

As shown in Figure 5, at 510,512,514 and 516, embedded equipment response is opened Beginning acquisition indicator, is captured and compressed media signal.More particularly, at 510, embed Formula device is captured and compressed audio signal；At 512, embedded equipment is captured and compressed vision Capture signal；At 514, embedded equipment is captured and compressed data image signal；And At 516, embedded equipment is captured and compressed video signal.Although described in Fig. 5 is respectively Media signal each of in the media signal of these types is captured, process etc., but Will refer only to all media signals rather than each single media signal discussion is relevant to Fig. 5 Remainder.It is it addition, although described flow chart describes all of media signal, but embedding Enter formula device and can also capture, process, store and send any combination of media signal.Example As, embedded equipment can capture more than one audio signal and single visual-capture signal, And do not capture data image signal or video signal.

After being captured and compressed media signal at 510-516, each at 520-526 Individual captured media signal is stored on embedded equipment.In this embodiment, media Signal is locally stored on embedded equipment, and in certain embodiments, such as can be media Signal is stored on the remote data base that can be accessed by embedded equipment.Described flow chart Describe is to be captured and compressed media signal and right at 520-526 at 510-516 Media as discrete step, and are believed at 510-516 by the storage of media signal continuously Number carry out being captured and compressed and continuously media signal being stored at 520-526, directly At 530, stopping acquisition indicator is received to embedded equipment.At 530, stop capture Designator instruction embedded equipment will stop the capture to media signal, compresses and store.

Can be by embedded equipment or by controlling server according to scheduling or according to being defined Criterion, generate starting acquisition indicator and generating the stopping capture at 530 and refer at 500 Show symbol.Individually stop in some embodiments it is possible to sending and start designator, with capture Different media signals.Although be not been described by this flow chart, but can essentially Suspend and recover the capture to media signal at any time, compress and store.Can use The stopping acquisition indicator prompting that such as control server or embedded equipment are generated is described temporarily Stop, and its beginning acquisition indicator generated points out described recovery.

At 540, embedded equipment receives the media that transmission is stored by instruction embedded equipment The transmission designator of signal.For example, it is possible to according to dispatching by embedded equipment or being taken by control Business device generates the transmission designator at 540.Transmission designator at 540 may indicate that: embeds Immediately or the afterwards specified a certain moment is sent the media signal stored by formula device. Transmission designator at 540 can also indicate that embedded equipment will only send one or more institute A part for the media signal of storage, the most only transmission are captured, compressed and are stored A part for data image signal.

The transmission designator that response is received at 540, from embedded equipment at 550-556 Send signal.Then the process at 560-566, media signal is decoded, being indexed And encode, and at 570, media signal synchronized and format.Can be On embedded equipment or control to perform on server the decoding at 560-556, index and Synchronization at coding and 570 and any part of formatting.For example, it is possible at embedded dress Put and video signal is sent to before such as controlling server, perform this at embedded equipment The index (such as, scene detection) of video signal.

After media signal is synchronized and formats at 570, media are made to believe at 580 Number can be used for the user conducted interviews.According to the labelling created during index at 560-566, Media signal is synchronized.Media signal format can be turned to the lattice of one or more type Formula.Such as, user can use the user name and password to connect visit from personal computer via network Ask that control server and/or one or more server (such as, are configured to course management system Server) the described signal at place.

In a word, describe use embedded equipment to capture, process, store and/or send media The apparatus and method for of signal.While various embodiments of the invention have been described above, but It should be appreciated that describe these embodiments herein purely by way of example, and can be In form and details, these embodiments are carried out many changes.For example, it is possible to embedded The processor of device and/or module are included in the single electron plate in one or more building On.

Claims (39)

1. for a method for multimedia capture, including:

Receiving and be configured to trigger being captured and compressed and the scheduling being captured and compressed of at least one in visual-capture signal or data image signal of audio signal, described scheduling is to receive from the control equipment being separated with the equipment with processor system；

Based on described scheduling, capture in described audio signal and capture visual-capture signal or data image signal described at least one；

Based on the compression variable being associated with described scheduling, compress in described audio signal and compression visual-capture signal or data image signal described at least one, to produce compressed signal；And

After producing described compressed signal, send described compressed signal.

Method the most according to claim 1, wherein:

The described compression variable being associated with described scheduling comprises and at least one at least one frame per second being associated, bit rate, frequency, resolution, color or the stability in described audio signal, visual-capture signal or data image signal.

Method the most according to claim 1, wherein:

Described compressed package containing based on described scheduling by least one is compressed into and damages form described in visual-capture signal or data image signal.

Method the most according to claim 1, wherein:

Described compressed package containing based on described scheduling by least one is compressed into the first form and the second form described in visual-capture signal or data image signal simultaneously.

Method the most according to claim 1, wherein:

Described compressed package containing based on described scheduling by least one is compressed into the first form in the very first time and becomes the second form in the second Time Compression described in visual-capture signal or data image signal, described second time is different from the described very first time.

6., for an equipment for multimedia capture, comprise:

Multiple input ports, the plurality of input port include (1) be configured to receive the audio input port of audio signal and (2) be configured to receive the optically-captured input port of visual-capture signal or be configured to receive the digital-image input port of data image signal at least one, the plurality of input port is configured to receive multiple media signals of at least one comprised in visual-capture signal or data image signal and audio signal；And

Processor system, described processor system is positioned in embedded environment and is coupled to the plurality of input port, the plurality of input port and described processor system are co-located in multimedia capture equipment, described processor system is configured to from the control equipment reception scheduling being separated with described multimedia capture equipment

Described processor system is configured to capture the plurality of media signal based on described scheduling, described processor system is configured to based on the plurality of media signal of compression variable compression being associated with described scheduling to produce multiple compressed signals, and described processor system is configured to after producing compressed signal send the plurality of compressed signal.

Equipment the most according to claim 6, wherein:

The described compression variable being associated with described scheduling comprises at least one in frame per second, bit rate, frequency, resolution, color or the stability being associated with the plurality of media signal.

Equipment the most according to claim 6, wherein:

Described processor system is configured to be compressed into by the plurality of media signal based on described scheduling damage form.

Equipment the most according to claim 6, wherein:

Described processor system is configured to receive described scheduling from described control equipment,

Described processor system is configured to compressed signal is sent to described control equipment.

Equipment the most according to claim 6, wherein:

Described processor system is configured to receive described scheduling from described control equipment,

Described processor system is configured to the equipment that compressed signal is sent to separate with described control equipment and described multimedia capture equipment.

11. 1 kinds of methods for multimedia capture, including:

Receiving the first direct control signal representing that start designator and user in response to the embedded equipment comprising processor system the first selection, described beginning designator is configured at least one in triggering visual-capture signal or data image signal and the capture of audio signal；

The schedule information being associated with the capture of at least one visual-capture signal or data image signal and audio signal is received from the control equipment separated with described embedded equipment；

Signal is captured to produce based at least one in described beginning designator capture visual-capture signal or data image signal and audio signal；

Receive represent send designator and in response to user second selection the second direct control signal, described transmission designator be configured to trigger transmission described capture signal；And

Capture signal be generated so that described capture signal according to described schedule information form format after send described capture signal.

12. methods according to claim 11, wherein, the described second direct control signal is received in response to the selection of the user of the embedded equipment comprising processor system.

13. methods according to claim 11, wherein, the described second direct control signal is received in response to the selection of the button of the embedded equipment comprising processor system.

14. methods according to claim 11, wherein, the described second direct control signal is received when the condition limited is satisfied.

15. methods according to claim 11, wherein, the described second direct control signal is received when described control equipment not operation can use, and when the operation of described control equipment is available, described capture signal is sent to described control equipment.

16. methods according to claim 11, wherein:

Described first direct control signal is received in response to first selection of the user of the embedded equipment comprising processor system；And

Described second direct control signal is received in response to second selection of user.

17. methods according to claim 11, wherein:

Described first direct control signal is received in response to the selection of the first button of the embedded equipment comprising processor system；And

Described second direct control signal is received in response to the selection of the second button of embedded equipment.

18. methods according to claim 11, wherein:

Described first direct control signal is received when the first condition limited is satisfied,

Described second direct control signal is received when the second condition limited is satisfied.

19. methods according to claim 11, wherein:

Described beginning designator is the first beginning designator received in the very first time, and described transmission designator is the first transmission designator received the second time after the first time,

Described schedule information comprises the second beginning designator or second and sends at least one in designator, described schedule information before the first time and the second time before the 3rd time received,

Described second at least one started in designator or described second transmission designator is started designator by described first respectively or described first transmission designator is replaced.

20. 1 kinds, for the method for multimedia capture, comprise:

Receiving and start designator, described beginning designator is configured to trigger the visual-capture signal on the capture of the audio signal on processor system and described processor system or the capture of at least one in data image signal；

On described processor system, audio signal is captured in response to described beginning designator；

In response at least one in described beginning designator capture visual-capture signal or data image signal, described processor system is positioned in specific purpose embedded equipment, described specific purpose embedded equipment is exclusively used in capture, processes, stores and send multiple live signal, and the plurality of live signal comprises at least one in visual-capture signal or data image signal and audio signal；And

Send as follows: (1) is captured to send afterwards audio signal in audio signal, (2) at least one in visual-capture signal or data image signal is captured to send afterwards at least one described in visual-capture signal or data image signal, and (3) send the data being associated with described at least one and the audio signal in visual-capture signal or data image signal, described packet is containing capture time and catch position.

21. methods according to claim 20, wherein said packet title Han speaker.

22. methods according to claim 20, wherein, the Part I of at least one and audio signal in described data, visual-capture signal or data image signal is sent to the first control equipment in the multiple control equipment coupled with the operation of described processor system, and the second control equipment being not delivered in the plurality of control equipment.

23. methods according to claim 20, wherein:

The Part I of at least one and audio signal in described data, visual-capture signal or data image signal is sent to the first control equipment in the multiple control equipment coupled with the operation of described processor system, and the second control equipment being not delivered in the plurality of control equipment；And

The Part II of at least one and audio signal in visual-capture signal or data image signal is sent to described second control equipment and is not delivered to described first control equipment.

24. methods according to claim 20, wherein:

The Part I of at least one and audio signal in described data, visual-capture signal or data image signal is sent to the first control equipment in the multiple control equipment coupled with the operation of described processor system, and the second control equipment being not delivered in the plurality of control equipment；

Each control equipment in the plurality of control equipment is operatively coupled to remaining the control equipment in the plurality of control equipment；And

Described processor system is first processor system, and described first control equipment is operatively coupled to the second processor system separated physically with first processor system.

25. 1 kinds, for the method for multimedia capture, comprise:

The processor system of specific purpose embedded equipment captures audio signal；

The processor system of specific purpose embedded equipment captures at least one in visual-capture signal or data image signal, described specific purpose embedded equipment is exclusively used in capture, processes, stores and send multiple live signal, and the plurality of live signal comprises at least one in visual-capture signal or data image signal and audio signal；And

The Part I of at least one in visual-capture signal or data image signal and audio signal is sent to and the first control equipment in described processor system multiple control equipment of coupling of operation, and the second control equipment not being sent in the plurality of control equipment.

26. methods according to claim 25, comprise further:

Before the Part I of audio signal is sent to the first control equipment, identify the plurality of control equipment,

Identified in response to the plurality of control equipment, the Part I of audio signal is sent to the first control equipment.

27. methods according to claim 25, comprise further:

The Part II of at least one in visual-capture signal or data image signal and audio signal is sent to described second control equipment and is not sent to described first control equipment.

28. methods according to claim 25, wherein, each control equipment in the plurality of control equipment is operatively coupled to remaining the control equipment in the plurality of control equipment.

29. methods according to claim 25, wherein, described processor system is first processor system, and described first control equipment is operatively coupled to the second processor system separated physically with first processor system.

30. methods according to claim 25, comprise further:

The data being associated with at least one in visual-capture signal or data image signal and audio signal are sent to described first control equipment, and described packet contains capture time and catch position.

31. methods according to claim 25, comprise further:

The Part II of at least one in visual-capture signal or data image signal and audio signal is sent to described second control equipment and is not sent to described first control equipment；

The data being associated with the Part I of at least one in visual-capture signal or data image signal and audio signal are sent to described first control equipment, and described packet contains capture time and catch position；And

The data being associated with the Part II of at least one in visual-capture signal or data image signal and audio signal are sent to described second control equipment, and described packet contains capture time and catch position.

32. 1 kinds, for the method for multimedia capture, comprise:

Receiving and be configured to trigger being captured and compressed and the scheduling being captured and compressed of at least one in visual-capture signal or data image signal of audio signal, described scheduling is to receive from the control equipment being separated with the equipment with processor system；

Based on described scheduling by first input port capture audio signal to produce the first capture signal；

Based on described scheduling by least one in the second input port capture visual-capture signal or data image signal to produce the second capture signal；

The device type of the capture device of described first input port is coupled in detection；

The device type of the capture device of described second input port is coupled in detection；

It is compressed producing the first compressed signal to the first capture signal based on the first compression variable being associated with described scheduling and device type based on the capture device being coupled to described first input port；

It is compressed producing the second compressed signal to the second capture signal based on the second compression variable being associated with described scheduling and device type based on the capture device being coupled to described second input port；And

The first compressed signal and the second compressed signal is sent after producing the first compressed signal and the second compressed signal.

33. methods according to claim 32, comprise further:

Before the first capture signal is compressed, device type based on the capture device being coupled to described first input port selects the first codec from multiple codecs；And

Before the second capture signal is compressed, device type based on the capture device being coupled to described second input port selects the second codec from multiple codecs.

34. methods according to claim 32, comprise further:

Device type based on the capture device being coupled to described first input port selects the first codec from multiple codecs；And

Device type based on the capture device being coupled to described second input port selects the second codec from multiple codecs,

First capture signal by by use the first compressed with codecs to produce the first compressed signal,

Second capture signal is by by using the second compressed with codecs to produce the second compressed signal.

35. methods according to claim 32, wherein:

Being coupled to the capture device of described second input port the second time after the first time is coupled to described second input port,

The device type of the capture device that described second input port is coupled in detection includes that detection is coupled to the capture device of described second input port in the very first time and is coupled to the difference between the capture device of described second input port in the second time.

36. methods according to claim 32, wherein:

Being coupled to the capture device of described second input port the second time after the first time is coupled to described second input port,

The device type of the capture device that described second input port is coupled in detection includes that detection is coupled to the capture device of described second input port in the very first time and is coupled to the difference between the capture device of described second input port in the second time,

Described method comprises further:

Device type based on the capture device being coupled to described second input port in the second time selects codec from multiple codecs, and the second capture signal is by by using described compressed with codecs to produce the second compressed signal.

37. methods according to claim 32, wherein:

Described capture signal is data image signal,

Being coupled to the capture device of described second input port the second time after the first time is coupled to described second input port,

The device type of the capture device that described second input port is coupled in detection includes that detection is coupled to the capture device of described second input port in the very first time and is coupled to the difference between the capture device of described second input port in the second time,

Described method comprises further:

Select when being coupled to the device type of capture device of described second input port in the second time and being network camera the first codec, described first codec to be configured to tiff form from multiple codecs and produce compressed signal；And

The second codec, described second codec is selected to be configured to produce in the jpeg-format compressed signal from multiple codecs when being coupled to the device type of capture device of described second input port in the second time and being digital camera.

38. methods according to claim 32, wherein:

The the first compression variable being associated with described scheduling comprises and at least one in frame per second, bit rate, frequency, resolution, color or the stability of described first capture signal correction connection,

The the second compression variable being associated with described scheduling comprises and at least one in frame per second, bit rate, frequency, resolution, color or the stability of described second capture signal correction connection.

39. methods according to claim 32, wherein:

First capture signal pressure is shortened into and damages form to produce the first compressed signal containing based on the first compression variable being associated with described scheduling by compression the first capture signal packet；

Second capture signal pressure is shortened into and damages form to produce the second compressed signal containing based on the second compression variable being associated with described scheduling by compression the second capture signal packet.