USRE48325E1 - Embedded audio routing switcher - Google Patents

Embedded audio routing switcher Download PDF

Info

Publication number
USRE48325E1
USRE48325E1 US16/169,141 US201816169141A USRE48325E US RE48325 E1 USRE48325 E1 US RE48325E1 US 201816169141 A US201816169141 A US 201816169141A US RE48325 E USRE48325 E US RE48325E
Authority
US
United States
Prior art keywords
audio
output
signals
input
stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/169,141
Inventor
John Edward Liron
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Grass Valley Canada ULC
Original Assignee
Grass Valley Canada ULC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Grass Valley Canada ULC filed Critical Grass Valley Canada ULC
Priority to US16/169,141 priority Critical patent/USRE48325E1/en
Assigned to GVBB HOLDINGS S.A.R.L. reassignment GVBB HOLDINGS S.A.R.L. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: THOMSON LICENSING
Assigned to GRASS VALLEY CANADA reassignment GRASS VALLEY CANADA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GVBB HOLDINGS S.A.R.L.
Assigned to THOMSON LICENSING reassignment THOMSON LICENSING ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LIRON, JOHN EDWARD
Application granted granted Critical
Publication of USRE48325E1 publication Critical patent/USRE48325E1/en
Assigned to MS PRIVATE CREDIT ADMINISTRATIVE SERVICES LLC reassignment MS PRIVATE CREDIT ADMINISTRATIVE SERVICES LLC SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GRASS VALLEY CANADA, GRASS VALLEY LIMITED
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268Signal distribution or switching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/04Systems for the transmission of one television signal, i.e. both picture and sound, by a single carrier

Definitions

  • the present invention generally relates to switching systems and more particularly to systems and methods including a serial digital video router switching matrix with full embedded audio switching capability, which is independent from the video switching.
  • Routing switchers may also be called signal selectors, audio/video (AV) selectors or simply routers.
  • a standard routing switcher may have multiple video and audio signals from a number of sources, such as Videotape Recorders, Media Servers, Satellite Receivers, etc. connected to the routers inputs.
  • the router's output or outputs can go to one or more destinations, such as Videotape Recorders, Video/Audio Mixers, Video/Audio Monitors, etc. Which input connects to which output(s) may be selected by a user with the push of a button, without disconnecting/reconnecting audio and video cables.
  • a single program may require switching to a plurality of different channels or stations.
  • the audio that is embedded may not be appropriate for each channel. For example, a different language may be needed or a dubbed version of the audio track may be required. In these situations, the audio output must be switched independently from the video.
  • a routing switcher may be employed to perform this task.
  • a principal disadvantage is that conventional serial digital video switching matrices do not permit independent switching of the embedded audio streams within the video signal. This makes it difficult to combine, e.g., the video from input #1 with the audio from input #2 at an output of the switching matrix. In many facilities, especially production/post production, or where multi-channel and/or multilingual audio must be considered, this limitation has dictated the use of a separate audio switching infrastructure.
  • an apparatus in an aspect of the invention, includes a separator for selectively separating audio from input signals including video with audio, a switcher for selectively transferring the input signals to at least one output, a multiplexed path for sending the separated audio signal to the at least one output, the at least one output being configured for selectively directing the input signals and separated audio signals.
  • an apparatus in another aspect of the invention, includes at least one input board configured to receive digital input signals, the digital input signals including video with embedded audio, the at least one input board including: a de-embed module configured to d-embed audio from each of the digital input signals, a time division multiplexer configured to multiplex all of the de-embedded audio to at least one output board, a crosspoint matrix configured to receive the digital input signals and transfer the digital input signals to the at least one output board, a time division multiplexed path configured to transport the de-embedded audio signals to the at least one output board separately from the digital input signals, and the at least one output board configured to route one of the digital input signals and selected de-embedded audio signals in accordance with a routing control setting.
  • a de-embed module configured to d-embed audio from each of the digital input signals
  • a time division multiplexer configured to multiplex all of the de-embedded audio to at least one output board
  • a crosspoint matrix configured to
  • a method in a further aspect of the invention, includes separating audio from input signals including video with audio, transferring selectively the input signals to at least one output, sending the separated audio signal to the at least one output, and selectively directing the input signals and separated audio signals with the at least one output.
  • a method for routing video signals with embedded audio through a routing switcher includes receiving digital input video signals with embedded audio, de-embedding an audio portion from the digital input signals while separately maintaining the digital input signals, and time division multiplexing the audio portion of all of the digital input signals for transfer to an output stage on a time division multiplexed path.
  • the digital input signals are transferred to the output stage separately from time division multiplexed audio signals. At least one of the digital input signals and the time division multiplexed audio signals are routed to a destination.
  • FIG. 1 is a diagram showing an exemplary routing switcher for routing audio embedded signals in accordance with one embodiment
  • FIG. 2 is a block diagram showing an output stage in greater detail
  • FIGS. 3A and 3B are diagrams showing an exemplary routing switcher for routing audio embedded signals where a crosspoint matrix has been adapted to provide a time division multiplexed path for separately transferred audio signals in accordance with another embodiment
  • FIGS. 4A and 4B are diagrams showing another exemplary routing switcher for routing audio embedded signals where a crosspoint matrix has been adapted to provide a time division multiplexed path for separately transferred audio signals in accordance with another embodiment
  • FIG. 5 is a flow diagram showing an exemplary method for routing audio embedded signals in accordance with one embodiment.
  • the present invention provides systems and methods for fully embedded audio switching capability for a serial digital video router.
  • the serial digital video router switching matrix can provide the fully embedded audio switching independently from the video switching.
  • the router can be employed in high definition and/or standard definition applications.
  • the present invention is described in terms of a television facility; however, the present invention is much broader and may include any audio/video system, which receives a plurality of audio and visual signals from one or more sources to be routed to one or more destinations.
  • Content may be received by any method for example, delivered over a network, e.g., telephone, cable, computer, satellite, etc.
  • the present invention is described in terms of a television network application; however, the concepts of the present invention may be extended to other applications, e.g., cable, satellite network, wireless and wired network types.
  • FIGS may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented in a combination of hardware and software on one or more appropriately programmed general-purpose devices, which may include a processor, memory and input/output interfaces.
  • processor or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage.
  • DSP digital signal processor
  • ROM read-only memory
  • RAM random access memory
  • any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function.
  • the invention as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. It is thus regarded that any means that can provide those functionalities are equivalent to those shown herein.
  • an illustrative system 10 shows a portion of the internal circuitry for a serial digital routing switcher for a television facility.
  • System 10 includes a plurality of input boards 12 and a plurality of output boards 14 .
  • Each input board 12 includes one or more video inputs 16 .
  • all inputs include embedded audio.
  • Inputs 16 preferably include serial digital video (SDV) with an embedded digital audio stream 15 , e.g., a stream conforming to the Audio Engineering Society/European Broadcasting Union (AES/EBU) Standard or AES for short.
  • SDV serial digital video
  • AES/EBU Audio Engineering Society/European Broadcasting Union
  • each input board provides several functions. These functions include SDV signal processing by a processor 19 .
  • Signal processing may include many different processes. For example, signal detection, equalization of the stream, data re-clocking, etc.
  • Integrated audio de-embedding is employed for each serial digital video (SDV) input 16 .
  • Each input board 12 de-embeds the audio (AES/EBU or simply AES) from the SDV input signal by employing a de-embed module 20 .
  • All the de-embedded audio signals are then combined together on one or more time division multiplexed (TDM) bit-stream(s) 24 by a time division multiplexer (TDM) 22 .
  • TDM bitstream(s) 24 are connected directly to video switching matrix output circuits 26 on output boards 14 .
  • the serial digital video signals with their embedded audio 15 are also connected to inputs of a video switching matrix 30 .
  • the output of the video switching matrix 30 (e.g., a serial digital video crosspoint matrix) is connected directly to a given output (output board 14 ) and the original embedded audio is simply passed through with the video 15 ′.
  • the audio is selected from the TDM stream(s) 24 by a router control system and a time division demultiplexer 32 demuxes the signals and combines the video using audio embedding circuitry 34 associated with the given output.
  • the desired signal may be selected using the time division demultiplexer 32 on the output board 14 .
  • Audio is preferably embedded in the digital video bitstream 15 in the Horizontal Ancillary Data space in accordance with the signal format standards defined by the Society of Motion Picture and Television Engineers (SMPTE). Audio is de-embedded by module 20 by selecting the desired audio channel ancillary data from the serial digital video bit stream 15 , buffering the data, and reformatting as an AES/EBU digital audio bit stream. Video and audio signal selection is controlled by a routing switcher control system 52 . Video and audio are usually presented to the operators as separate signal levels on the routing control panels and graphical user interfaces (e.g., control 52 ).
  • a routing selection may be made by an operator, by a program or by hardware based on operating conditions or presettings.
  • a first SDV signal is received with embedded audio and a second SDV signal is received from a different source.
  • the first and second signals have their audio deembedded and provided to output boards.
  • the output boards can embed the audio from the first signal into the second signal and vice versa.
  • the outputted first and second signals may both be able to use the audio of the original first signal, or the outputted first and second signals may both be able to use the audio of the original second signal. Since all audio streams are available any audio or combination of audio channels can be selected and output including the SDV with fully embedded audio streams. This has many advantages and provides great flexibility in selecting output hardware for optimizing the outputs of the system for entertainment value or other reasons.
  • output board or stage 14 includes a TDM audio demultiplexer 32 , an audio embedding circuit 34 , and a serial digital video (SDV) re-clocking circuit 36 .
  • the SDV signal is fed from an output of the crosspoint matrix ( 30 , FIG. 1 ) to the video input of the audio embedding circuit 34 .
  • the TDM audio demultiplexer 32 receives the TDM audio stream and, under the control of the routing control system 52 ( FIG. 1 ), can decode selected audio signals from the TDM audio stream and apply the audio to the audio inputs of the audio embedding circuit 34 .
  • the audio embedding circuit 34 is directed by the router control system 52 to pass one or more channels of the audio already embedded in the SDV signal (in cases where the audio originally associated with the video is needed), or to embed one or more audio signals from the TDM audio demultiplexer 32 (in cases where different audio signals are needed).
  • the output of the audio embedding circuit 34 includes both video and one or more channels of embedded audio; this output is applied to the SDV re-clocker module 36 which extracts a clock signal from the SDV signal and uses the clock signal to re-clock the SDV signal thereby removing jitter.
  • TDM time division multiplex
  • the TDM bit rate is preferably compatible with the video switching matrix, in practice either the standard definition component serial digital bit rate 270 Mb/s (64 audio channels) or the high definition component serial digital bit rate of 1.48 Gb/s (up to 352 audio channels) should be employed. Since this scheme uses some of the video routing paths for the TDM busses, the effective matrix size may be reduced.
  • FIGS. 3 and 4 show illustrative examples of modified router switch designs in accordance with the present principles.
  • FIGS. 3A, 3B, 4A, and 4B a Grass Valley TrinixTM 128 ⁇ 128 matrix ( FIGS. 3A AND 3B ) and a Grass Valley TrinixTM 256 ⁇ 256 matrix ( FIGS. 4A and 4B ) are illustratively shown.
  • These example devices show the possibility of including audio only inputs and outputs in the system, which can provide additional audio tracks to be combined with audio. Separate audio inputs/outputs may be employed with the embodiment shown in FIG. 1 as well.
  • Devices 200 and 220 can include single AES/EBU (Audio Engineering Society/European Broadcasting Union) digital audio streams or they could include TDM streams including multiple audio channels such as the 270 Mb/s and 1.485 Gb/s streams described previously or the industry standard Multichannel Audio Digital Interface (MADI) format.
  • AES/EBU Audio Engineering Society/European Broadcasting Union
  • TDM streams including multiple audio channels such as the 270 Mb/s and 1.485 Gb/s streams described previously or the industry standard Multichannel Audio Digital Interface (MADI) format.
  • MADI Multichannel Audio Digital Interface
  • a router 200 includes a 128 ⁇ 128 wideband digital crosspoint matrix 130 that is reduced to a 124 ⁇ 112 matrix.
  • the reduced matrix size is employed to provide TDM paths 111 through the matrix 130 .
  • SDV with embedded audio inputs 15 include thirty-one inputs per input board 14 . Since this design includes four input boards, there are one hundred and twenty four inputs in total.
  • audio only inputs or a TDM input stream 110 may be provided, e.g., one per board (4 total).
  • the input 110 may include multiple audio channels such as the 270 Mb/s and 1.485 Gb/s streams for television.
  • Time division multiplexing 22
  • the audio outputs 110 ′ may include four per board (16 total).
  • the routing ( 32 ), embedding ( 34 ) and reclocking ( 36 ) are also performed as previously described.
  • a router 220 includes a 256 ⁇ 256 wideband digital crosspoint matrix 132 that is reduced to a 248 ⁇ 192 matrix.
  • the reduced matrix size is employed to provide TDM paths 111 through the matrix 132 .
  • SDV with embedded audio inputs 15 includes thirty-one inputs per input board 14 . Since this design includes eight input boards, there are two hundred and forty eight inputs in total.
  • audio only inputs or a TDM input 110 may be provided, e.g., one per board (8 total).
  • the input 110 may include multiple audio channels such as the 270 Mb/s and 1.485 Gb/s streams for television.
  • Time division multiplexing 22
  • the audio outputs 110 ′ may include eight per board (64 total).
  • the routing ( 32 ), embedding ( 34 ) and reclocking ( 36 ) are also performed as previously described. In FIGS.
  • the audio inputs 110 may include audio streams from any source and may be employed to provide a desired audio stream for selection by a routing control system (not shown).
  • Matrixes 130 and 132 may be reduced by other amounts, as needed.
  • an illustrative method for routing video signals with embedded audio through a routing switcher is depicted in accordance with one embodiment.
  • digital input video signals with embedded audio (or audio only signals) are received. These signals are preferably received using an input board having a de-embed module.
  • an audio portion is de-embedded from the digital input signals while separately maintaining the digital input signals (the audio only signals are maintained as well). The audio portion is time division multiplexed for alt of the digital input signals for transfer to an output stage on a time division multiplexed path in block 306 .
  • the time division multiplexed path may include a separate bus or a path through a crosspoint matrix, where at least a portion of a crosspoint matrix is used to implement the path.
  • a reduction in the matrix size may be employed to permit the time division multiplexed path through the matrix.
  • the digital input signals are transferred to the output stage separately from time division multiplexed audio signals.
  • the digital input signals are preferably transferred using the crosspoint matrix, and are transferred with the original embedded audio.
  • the time division multiplexed audio signals are demultiplexed to provide the signal to particular destinations or to simply reproduce the audio to be re-embedded with a same or different video signal In accordance with particular requirements, if needed.
  • embedding a time division multiplexed audio signal into to a digital input signal or video signal may be performed to reconstitute a video signal with new embedded audio.
  • reclocking may be performed, if needed, by extracting a clock signal from the SDV signal to re-clock the SDV signal thereby removing jitter.
  • an audio only input may be provided and configured to receive an audio signal or a time division multiplexed audio signal for transfer to the output stage.
  • the audio only signals are available for mixing with video signals as with de-embedded audio signals.
  • the audio only input may be received and employed at any point in the operation.
  • at least one of the digital input signals and the time division multiplexed audio signals are routed to a destination from the output stage.
  • the destination is usually selected by a routing control system, by a user, by a program, in accordance with preselected conditions, etc. For example, if an original audio stream is sent with English audio and the film is sent to a Spanish station, the Spanish audio may be preselected for a given destination from a particular output board or stage.
  • the signals are routed to destinations based on a router control system or programmed selections (e.g., routing settings).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Circuits (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

An apparatus includes a separator for selectively separating audio from input signals including video with audio, a switcher for selectively transferring the input signals to at least one output, a multiplexed path for sending the separated audio signal to the at least one output, the at least one output being configured for selectively directing the input signals and separated audio signals.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a continuation of U.S. patent application Ser. No. 12/448,498 titled “EMBEDDED AUDIO ROUTING SWITCHER” and filed Jun. 22, 2009, which is based upon and claims the benefit of priority, under 35 U.S.C. §365 of International Application No. PCT/US2006/48697 filed on Dec. 20, 2006, which was published in accordance with PCT Article 21(2) on Jul. 3, 2008, in English, the entire contents of which are incorporated herein by reference.
TECHNICAL FIELD
The present invention generally relates to switching systems and more particularly to systems and methods including a serial digital video router switching matrix with full embedded audio switching capability, which is independent from the video switching.
BACKGROUND
Routing switchers may also be called signal selectors, audio/video (AV) selectors or simply routers. A standard routing switcher may have multiple video and audio signals from a number of sources, such as Videotape Recorders, Media Servers, Satellite Receivers, etc. connected to the routers inputs. The router's output or outputs can go to one or more destinations, such as Videotape Recorders, Video/Audio Mixers, Video/Audio Monitors, etc. Which input connects to which output(s) may be selected by a user with the push of a button, without disconnecting/reconnecting audio and video cables.
In a television facility, a single program may require switching to a plurality of different channels or stations. In some situations, the audio that is embedded may not be appropriate for each channel. For example, a different language may be needed or a dubbed version of the audio track may be required. In these situations, the audio output must be switched independently from the video. A routing switcher may be employed to perform this task.
When constructing a signal switching infrastructure for a television facility, a choice needs to be made to use video with embedded audio as a single switching level or to use independent audio routing matrices to switch audio separately from video. The advantages of switching video with embedded audio include a substantial reduction of switching hardware and system cabling when compared with separate audio switching matrices. Many modern devices such as video tape recorders, media servers and master control switchers support video inputs and outputs with embedded audio.
A principal disadvantage is that conventional serial digital video switching matrices do not permit independent switching of the embedded audio streams within the video signal. This makes it difficult to combine, e.g., the video from input #1 with the audio from input #2 at an output of the switching matrix. In many facilities, especially production/post production, or where multi-channel and/or multilingual audio must be considered, this limitation has dictated the use of a separate audio switching infrastructure.
In the past, separate audio switching infrastructures have been employed (with the attendant increase in cost, space needed, cabling and power consumption). Hybrid systems using outboard audio embedding and de-embedding devices in conjunction with serial digital video switching matrices have also been employed. This alternative is also costly and complex to implement.
SUMMARY
In an aspect of the invention, an apparatus includes a separator for selectively separating audio from input signals including video with audio, a switcher for selectively transferring the input signals to at least one output, a multiplexed path for sending the separated audio signal to the at least one output, the at least one output being configured for selectively directing the input signals and separated audio signals.
In another aspect of the invention, an apparatus includes at least one input board configured to receive digital input signals, the digital input signals including video with embedded audio, the at least one input board including: a de-embed module configured to d-embed audio from each of the digital input signals, a time division multiplexer configured to multiplex all of the de-embedded audio to at least one output board, a crosspoint matrix configured to receive the digital input signals and transfer the digital input signals to the at least one output board, a time division multiplexed path configured to transport the de-embedded audio signals to the at least one output board separately from the digital input signals, and the at least one output board configured to route one of the digital input signals and selected de-embedded audio signals in accordance with a routing control setting.
In a further aspect of the invention, a method includes separating audio from input signals including video with audio, transferring selectively the input signals to at least one output, sending the separated audio signal to the at least one output, and selectively directing the input signals and separated audio signals with the at least one output.
In a yet further aspect of the invention, a method for routing video signals with embedded audio through a routing switcher includes receiving digital input video signals with embedded audio, de-embedding an audio portion from the digital input signals while separately maintaining the digital input signals, and time division multiplexing the audio portion of all of the digital input signals for transfer to an output stage on a time division multiplexed path. The digital input signals are transferred to the output stage separately from time division multiplexed audio signals. At least one of the digital input signals and the time division multiplexed audio signals are routed to a destination.
BRIEF DESCRIPTION OF THE DRAWINGS
The advantages, nature, and various additional features of the invention will appear more fully upon consideration of the illustrative embodiments now to be described in detail in connection with accompanying drawings wherein:
FIG. 1 is a diagram showing an exemplary routing switcher for routing audio embedded signals in accordance with one embodiment;
FIG. 2 is a block diagram showing an output stage in greater detail;
FIGS. 3A and 3B are diagrams showing an exemplary routing switcher for routing audio embedded signals where a crosspoint matrix has been adapted to provide a time division multiplexed path for separately transferred audio signals in accordance with another embodiment;
FIGS. 4A and 4B are diagrams showing another exemplary routing switcher for routing audio embedded signals where a crosspoint matrix has been adapted to provide a time division multiplexed path for separately transferred audio signals in accordance with another embodiment; and
FIG. 5 is a flow diagram showing an exemplary method for routing audio embedded signals in accordance with one embodiment.
It should be understood that the drawings are for purposes of illustrating the concepts of the invention and are not necessarily the only possible configuration for illustrating the invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
The present invention provides systems and methods for fully embedded audio switching capability for a serial digital video router. The serial digital video router switching matrix can provide the fully embedded audio switching independently from the video switching. The router can be employed in high definition and/or standard definition applications. By providing full independent switching of the audio signals included in the serial digital video bit-streams, reduction in cost and complexity is provided and greater flexibility is achieved in selecting input and outputs for the system.
It is to be understood that the present invention is described in terms of a television facility; however, the present invention is much broader and may include any audio/video system, which receives a plurality of audio and visual signals from one or more sources to be routed to one or more destinations. Content may be received by any method for example, delivered over a network, e.g., telephone, cable, computer, satellite, etc. The present invention is described in terms of a television network application; however, the concepts of the present invention may be extended to other applications, e.g., cable, satellite network, wireless and wired network types.
It should be understood that the elements shown in the FIGS, may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented in a combination of hardware and software on one or more appropriately programmed general-purpose devices, which may include a processor, memory and input/output interfaces.
The present description illustrates the principles of the present invention. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the invention and are included within its spirit and scope.
Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein represent conceptual views of illustrative circuitry embodying the principles of the invention. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudocode, and the like represent various processes which may be substantially represented in computer readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
The functions of the various elements shown in the figures may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage.
In the claims hereof, any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function. The invention as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. It is thus regarded that any means that can provide those functionalities are equivalent to those shown herein.
Referring now in specific detail to the drawings in which like reference numerals identify similar or identical elements throughout the several views, and initially to FIG. 1, an illustrative system 10 shows a portion of the internal circuitry for a serial digital routing switcher for a television facility. System 10 includes a plurality of input boards 12 and a plurality of output boards 14. Each input board 12 includes one or more video inputs 16. In this example, all inputs include embedded audio. Inputs 16 preferably include serial digital video (SDV) with an embedded digital audio stream 15, e.g., a stream conforming to the Audio Engineering Society/European Broadcasting Union (AES/EBU) Standard or AES for short. In this example, each input board provides several functions. These functions include SDV signal processing by a processor 19. Signal processing may include many different processes. For example, signal detection, equalization of the stream, data re-clocking, etc.
Integrated audio de-embedding is employed for each serial digital video (SDV) input 16. Each input board 12 de-embeds the audio (AES/EBU or simply AES) from the SDV input signal by employing a de-embed module 20. All the de-embedded audio signals are then combined together on one or more time division multiplexed (TDM) bit-stream(s) 24 by a time division multiplexer (TDM) 22. The TDM bitstream(s) 24 are connected directly to video switching matrix output circuits 26 on output boards 14. The serial digital video signals with their embedded audio 15 are also connected to inputs of a video switching matrix 30.
In cases where a given output needs the video with its original embedded audio signal 15, the output of the video switching matrix 30 (e.g., a serial digital video crosspoint matrix) is connected directly to a given output (output board 14) and the original embedded audio is simply passed through with the video 15′. In cases where a given output (output board 14) needs different audio signals which are embedded in the video signal, the audio is selected from the TDM stream(s) 24 by a router control system and a time division demultiplexer 32 demuxes the signals and combines the video using audio embedding circuitry 34 associated with the given output. The desired signal may be selected using the time division demultiplexer 32 on the output board 14.
Audio is preferably embedded in the digital video bitstream 15 in the Horizontal Ancillary Data space in accordance with the signal format standards defined by the Society of Motion Picture and Television Engineers (SMPTE). Audio is de-embedded by module 20 by selecting the desired audio channel ancillary data from the serial digital video bit stream 15, buffering the data, and reformatting as an AES/EBU digital audio bit stream. Video and audio signal selection is controlled by a routing switcher control system 52. Video and audio are usually presented to the operators as separate signal levels on the routing control panels and graphical user interfaces (e.g., control 52). This enables the operator to either select both video and audio from the same input (in which case the audio already embedded with the video is used), or the operator may select video from one input and audio from one or more alternate inputs (in which case the desired audio signals are selected from the audio TDM stream 24 and applied to an audio embedding circuit 34 of the appropriate output. A routing selection may be made by an operator, by a program or by hardware based on operating conditions or presettings.
In one embodiment, a first SDV signal is received with embedded audio and a second SDV signal is received from a different source. In accordance with this embodiment, the first and second signals have their audio deembedded and provided to output boards. The output boards can embed the audio from the first signal into the second signal and vice versa. Alternately, the outputted first and second signals may both be able to use the audio of the original first signal, or the outputted first and second signals may both be able to use the audio of the original second signal. Since all audio streams are available any audio or combination of audio channels can be selected and output including the SDV with fully embedded audio streams. This has many advantages and provides great flexibility in selecting output hardware for optimizing the outputs of the system for entertainment value or other reasons.
Referring to FIG. 2, output board or stage 14 includes a TDM audio demultiplexer 32, an audio embedding circuit 34, and a serial digital video (SDV) re-clocking circuit 36. The SDV signal is fed from an output of the crosspoint matrix (30, FIG. 1) to the video input of the audio embedding circuit 34. The TDM audio demultiplexer 32 receives the TDM audio stream and, under the control of the routing control system 52 (FIG. 1), can decode selected audio signals from the TDM audio stream and apply the audio to the audio inputs of the audio embedding circuit 34. The audio embedding circuit 34 is directed by the router control system 52 to pass one or more channels of the audio already embedded in the SDV signal (in cases where the audio originally associated with the video is needed), or to embed one or more audio signals from the TDM audio demultiplexer 32 (in cases where different audio signals are needed). The output of the audio embedding circuit 34 includes both video and one or more channels of embedded audio; this output is applied to the SDV re-clocker module 36 which extracts a clock signal from the SDV signal and uses the clock signal to re-clock the SDV signal thereby removing jitter.
In another embodiment, in addition to or instead of constructing a new system with purpose-built TDM paths from inputs to outputs, it is also possible to implement the present principles in existing serial digital video switching matrices. One way of doing this may include replacing conventional input and output circuits with those including audio de-embedding, embedding and time division multiplex (TDM) bussing. The TDM busses would be distributed from the input circuits to the output circuits by dedicating existing paths in a video switching matrix for the use of TDM. This results in an equivalent system to the one schematically represented in FIG. 1.
For the approach using existing hardware, the TDM bit rate is preferably compatible with the video switching matrix, in practice either the standard definition component serial digital bit rate 270 Mb/s (64 audio channels) or the high definition component serial digital bit rate of 1.48 Gb/s (up to 352 audio channels) should be employed. Since this scheme uses some of the video routing paths for the TDM busses, the effective matrix size may be reduced. FIGS. 3 and 4 show illustrative examples of modified router switch designs in accordance with the present principles.
Referring to FIGS. 3A, 3B, 4A, and 4B, a Grass Valley Trinix™ 128×128 matrix (FIGS. 3A AND 3B) and a Grass Valley Trinix™ 256×256 matrix (FIGS. 4A and 4B) are illustratively shown. These example devices show the possibility of including audio only inputs and outputs in the system, which can provide additional audio tracks to be combined with audio. Separate audio inputs/outputs may be employed with the embodiment shown in FIG. 1 as well. Devices 200 and 220 can include single AES/EBU (Audio Engineering Society/European Broadcasting Union) digital audio streams or they could include TDM streams including multiple audio channels such as the 270 Mb/s and 1.485 Gb/s streams described previously or the industry standard Multichannel Audio Digital Interface (MADI) format.
Referring to FIGS. 3A AND 3B, a router 200 includes a 128×128 wideband digital crosspoint matrix 130 that is reduced to a 124×112 matrix. The reduced matrix size is employed to provide TDM paths 111 through the matrix 130. In this embodiment, SDV with embedded audio inputs 15 include thirty-one inputs per input board 14. Since this design includes four input boards, there are one hundred and twenty four inputs in total. In addition, audio only inputs or a TDM input stream 110 may be provided, e.g., one per board (4 total). The input 110 may include multiple audio channels such as the 270 Mb/s and 1.485 Gb/s streams for television.
As described above, signal processing by a processor 19 is performed and the audio is de-embedded (20). Time division multiplexing (22) is performed and may include the TDM input 110 as well as all of the de-embedded audio from signals 15, which is placed on paths 111 and transported through the matrix 130. The video with embedded audio signals 15′ are also transported to the output boards 16. In this example, four output boards 16 are available. Each output board 16 includes twenty eight outputs (total 112 outputs). The audio outputs 110′ (AES or TDM) for this system may include four per board (16 total). The routing (32), embedding (34) and reclocking (36) are also performed as previously described.
Referring to FIG. 4, a router 220 includes a 256×256 wideband digital crosspoint matrix 132 that is reduced to a 248×192 matrix. The reduced matrix size is employed to provide TDM paths 111 through the matrix 132. In this embodiment, SDV with embedded audio inputs 15 includes thirty-one inputs per input board 14. Since this design includes eight input boards, there are two hundred and forty eight inputs in total. In addition, audio only inputs or a TDM input 110 may be provided, e.g., one per board (8 total). The input 110 may include multiple audio channels such as the 270 Mb/s and 1.485 Gb/s streams for television.
As described above, signal processing by a processor 19 is performed and the audio is de-embedded (20). Time division multiplexing (22) is performed and may include the TDM input 110 as well as all of the de-embedded audio from signals 15, which is placed on paths 111 and transported through the matrix 132. The video with embedded audio signals 15 are also transported to the output boards 16. In this example, eight output boards 16 are available. Each output board 16 includes twenty four outputs (total 192 outputs). The audio outputs 110′ (AES or TDM) for this system may include eight per board (64 total). The routing (32), embedding (34) and reclocking (36) are also performed as previously described. In FIGS. 3A, 3B, 4A, and 4B, the audio inputs 110 may include audio streams from any source and may be employed to provide a desired audio stream for selection by a routing control system (not shown). Matrixes 130 and 132 may be reduced by other amounts, as needed.
Referring to FIG. 5, an illustrative method for routing video signals with embedded audio through a routing switcher is depicted in accordance with one embodiment. In block 302, digital input video signals with embedded audio (or audio only signals) are received. These signals are preferably received using an input board having a de-embed module. In block 304, an audio portion is de-embedded from the digital input signals while separately maintaining the digital input signals (the audio only signals are maintained as well). The audio portion is time division multiplexed for alt of the digital input signals for transfer to an output stage on a time division multiplexed path in block 306. The time division multiplexed path may include a separate bus or a path through a crosspoint matrix, where at least a portion of a crosspoint matrix is used to implement the path. A reduction in the matrix size may be employed to permit the time division multiplexed path through the matrix.
In block 310, the digital input signals are transferred to the output stage separately from time division multiplexed audio signals. The digital input signals are preferably transferred using the crosspoint matrix, and are transferred with the original embedded audio. In block 312, the time division multiplexed audio signals are demultiplexed to provide the signal to particular destinations or to simply reproduce the audio to be re-embedded with a same or different video signal In accordance with particular requirements, if needed. In block 314, embedding a time division multiplexed audio signal into to a digital input signal or video signal may be performed to reconstitute a video signal with new embedded audio. In block 316, reclocking may be performed, if needed, by extracting a clock signal from the SDV signal to re-clock the SDV signal thereby removing jitter.
In block 320, an audio only input may be provided and configured to receive an audio signal or a time division multiplexed audio signal for transfer to the output stage. The audio only signals are available for mixing with video signals as with de-embedded audio signals. The audio only input may be received and employed at any point in the operation. In block 322, at least one of the digital input signals and the time division multiplexed audio signals are routed to a destination from the output stage. The destination is usually selected by a routing control system, by a user, by a program, in accordance with preselected conditions, etc. For example, if an original audio stream is sent with English audio and the film is sent to a Spanish station, the Spanish audio may be preselected for a given destination from a particular output board or stage. The signals are routed to destinations based on a router control system or programmed selections (e.g., routing settings).
Having described preferred embodiments for an embedded audio routing switcher (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the invention disclosed which are within the scope and spirit of the invention as outlined by the appended claims.

Claims (38)

The invention claimed is:
1. An apparatus comprising:
a separator for receiving input signals, each input signal including video with embedded audio and separating the audio from input signals to generate separated audio signals;
a switcher for transferring the input signals to an output;
a multiplexer for multiplexing the separated audio signals together and transmitting the multiplexed separated audio signals over a multiplexed path to the output, the being configured for selectively outputting the input signals and the separated audio signals,
wherein the output includes a demultiplexer to provide selective outputting of one of the separated audio signals to a designated output.
2. The apparatus of claim 1, further comprising at least one input coupled to the switcher and for receiving the input signals, the input signals comprising digital input signals, the at least one input being connected to a processor configured to equalize the digital input signals.
3. The apparatus of claim 2, wherein the at least one input is coupled to a multiplexer to multiplex the separated audio signals.
4. The apparatus of claim 1, wherein the switcher is a serial digital switcher configured to route television signals.
5. The apparatus of claim 4, wherein the television signals include at least one of a standard definition signals and a high definition signal.
6. The apparatus of claim 1, wherein multiplexed path includes a time division multiplexed bus.
7. The apparatus of claim 1, wherein the multiplexed path includes a path through the switcher.
8. The apparatus of claim 1, wherein the output comprises an audio only input configured to receive one of an audio signal and a time division multiplexed audio signal for outputting.
9. An apparatus, comprising:
at least one input board configured to receive digital input signals, the digital input signals including video with embedded audio, the at least one input board including:
a de-embed module configured to de-embed audio from each of the digital input signals; and
a time division multiplexer configured to multiplex all of the de-embedded audio;
a crosspoint matrix configured to receive the digital input signals and transfer the digital input signals to at least one output board; and
an output board,
wherein the time-division multiplexer is configured to transmit the de-embedded audio signals to the output board separately from the digital input signals via a time division multiplexed path, and wherein the output board is configured to output one of the digital input signals or one of the de-embedded audio signals to a destination in accordance with a routing control setting.
10. The apparatus of claim 9, wherein the at least one input board includes a processor configured to equalize the digital input signals.
11. The apparatus of claim 9, wherein the output board includes an embed module to embed at least one de-embedded audio signal in one or more of the digital input signals to provide an output signal having video and embedded audio.
12. The apparatus of claim 9, wherein the output board includes a demultiplexer to provide routing of the de-embedded audio signals to a designated output.
13. The apparatus of claim 9, wherein the crosspoint matrix includes a serial digital switcher configured to route television signals.
14. The apparatus of claim 13, wherein the television signals include at least one of a standard definition signals and a high definition signal.
15. The apparatus of claim 9, wherein the time division multiplexed path includes a time division multiplexed bus.
16. The apparatus of claim 9, wherein the time division multiplexed path includes a path through the crosspoint matrix.
17. The apparatus of claim 9, further comprising an audio only input configured to receive one of an audio signal and a time division multiplexed audio signal for transfer to the output board.
18. A method comprising the steps of:
receiving input signals, each input signal including video with embedded audio components;
separating the audio components from input signals to generate a separated audio signals;
transferring selectively the input signals to an output;
multiplexing the separated audio signals;
sending the multiplexed separated audio signals over a multiplexed path to the output, wherein the a least one output selectively directs the input signals and the separated audio signals to a destination, wherein the output demultiplexes the multiplexed separated audio signals to direct the separated audio signals to the destination.
19. The method of claim 18, further comprising equalizing the input signals.
20. The method of claim 18, wherein the input signals comprise television signals that are transferred via a serial digital switcher.
21. The method of claim 20, wherein the television signals include at least one of a standard definition signals and a high definition signal.
22. The method of claim 18, wherein multiplexed path includes a time division multiplexed bus.
23. The method of claim 18, wherein the multiplexed path includes a path through a switcher.
24. The method of claim 18, wherein the output comprises an audio only input configured to receive one of an audio signal and a time division multiplexed audio signal for outputting.
25. An audio stream routing switcher comprising:
at least one input configured to receive a combined input stream that includes a video stream and a plurality of audio streams and to separate the plurality of audio streams from the combined input stream to generate a plurality of separated audio signals;
a router configured to route the video stream to an output; and
a multiplexer configured to multiplex at least a portion of the plurality of separated audio signals and transmit the multiplexed and separated audio signals to the output as at least one audio bit-stream transmitted separately from the video stream,
wherein the output is configured to selectively output the received video stream and at least one of the separated audio signals to a designated output,
wherein the output includes an audio signal selector configured to selectively output the at least one separated audio signal to the designated output.
26. The audio stream routing switcher according to claim 25, wherein the router is a crosspoint matrix coupled between the at least one input and the output.
27. The audio stream routing switcher according to claim 26, wherein the multiplexer is configured to transmit the portion of the plurality of separated audio signals via a path in the crosspoint matrix separately from the video stream to the output.
28. The audio stream routing switcher according to claim 25, wherein the audio signal selector is a transcode multiplexer configured to select the at least one separated audio signal from the portion of the plurality of separated and multiplexed audio signals.
29. The audio stream routing switcher according to claim 28, wherein the output further comprises an audio embedding module configured to embed the selected at least one separated audio signal in the video stream to generate a combined output stream having video and embedded audio to be outputted to the designated output.
30. The audio stream routing switcher according to claim 25, wherein each combined input stream is a digital video bit-stream with at least one of the plurality of audio streams embedded as audio data in a horizontal ancillary data space of the video stream.
31. The audio stream routing switcher according to claim 30, wherein the at least one input comprises a digital signal processor configured to de-embed the audio data from the horizontal ancillary data space to generate the at least one separated audio signal, respectively.
32. An audio stream routing switcher comprising:
at least one input board configured to receive a combined input stream that includes a video stream and a plurality of audio streams, the at least one input board including a digital signal processor configured to separate the plurality of audio streams from the combined input stream to generate a plurality of separated audio signals;
a router configured to route the video stream to an output; and
a multiplexer configured to multiplex at least a portion of the plurality of separated audio signals and transmit the multiplexed and separated audio signals to the output as at least one audio bit-stream transmitted separately from the video stream,
wherein the output is configured to selectively output the received video stream and at least one of the separated audio signals to a designated output,
wherein the output includes an audio signal selector configured to selectively output the at least one separated audio signal to the designated output.
33. The audio stream routing switcher according to claim 32, wherein the router is a crosspoint matrix coupled between the at least one input and the output.
34. The audio stream routing switcher according to claim 33, wherein the multiplexer is configured to transmit the portion of the plurality of separated audio signals via a path in the crosspoint matrix separately from the video stream to the output.
35. The audio stream routing switcher according to claim 32, wherein the audio signal selector is a transcode multiplexer configured to select the at least one separated audio signal from the portion of the plurality of separated and multiplexed audio signals.
36. The audio stream routing switcher according to claim 35, wherein the output further comprises an audio embedding module configured to embed the selected at least one separated audio signal in the video stream to generate a combined output stream having video and embedded audio to be outputted to the designated output.
37. The audio stream routing switcher according to claim 32, wherein each combined input stream is a digital video bit-stream with at least one of the plurality of audio streams embedded as audio data in a horizontal ancillary data space of the video stream.
38. The audio stream routing switcher according to claim 37, wherein the digital signal processor is further configured to de-embed the audio data from the horizontal ancillary data space to generate the at least one separated audio signal, respectively.
US16/169,141 2006-12-20 2018-10-24 Embedded audio routing switcher Active 2027-01-13 USRE48325E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/169,141 USRE48325E1 (en) 2006-12-20 2018-10-24 Embedded audio routing switcher

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
PCT/US2006/048697 WO2008079112A1 (en) 2006-12-20 2006-12-20 Embedded audio routing switcher
US12/448,498 US8750295B2 (en) 2006-12-20 2006-12-20 Embedded audio routing switcher
US14/247,068 US9479711B2 (en) 2006-12-20 2014-04-07 Embedded audio routing switcher
US16/169,141 USRE48325E1 (en) 2006-12-20 2018-10-24 Embedded audio routing switcher

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/247,068 Reissue US9479711B2 (en) 2006-12-20 2014-04-07 Embedded audio routing switcher

Publications (1)

Publication Number Publication Date
USRE48325E1 true USRE48325E1 (en) 2020-11-24

Family

ID=39562787

Family Applications (3)

Application Number Title Priority Date Filing Date
US12/448,498 Active 2027-12-09 US8750295B2 (en) 2006-12-20 2006-12-20 Embedded audio routing switcher
US14/247,068 Ceased US9479711B2 (en) 2006-12-20 2014-04-07 Embedded audio routing switcher
US16/169,141 Active 2027-01-13 USRE48325E1 (en) 2006-12-20 2018-10-24 Embedded audio routing switcher

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US12/448,498 Active 2027-12-09 US8750295B2 (en) 2006-12-20 2006-12-20 Embedded audio routing switcher
US14/247,068 Ceased US9479711B2 (en) 2006-12-20 2014-04-07 Embedded audio routing switcher

Country Status (6)

Country Link
US (3) US8750295B2 (en)
EP (2) EP2744193B1 (en)
JP (1) JP4886041B2 (en)
CN (1) CN101563915B (en)
CA (1) CA2672418C (en)
WO (1) WO2008079112A1 (en)

Families Citing this family (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2463228C (en) 2003-04-04 2012-06-26 Evertz Microsystems Ltd. Apparatus, systems and methods for packet based transmission of multiple data signals
EP2033489B1 (en) 2006-06-14 2015-10-28 Personics Holdings, LLC. Earguard monitoring system
WO2008008730A2 (en) 2006-07-08 2008-01-17 Personics Holdings Inc. Personal audio assistant device and method
US11450331B2 (en) 2006-07-08 2022-09-20 Staton Techiya, Llc Personal audio assistant device and method
JP4886041B2 (en) 2006-12-20 2012-02-29 ジーブイビービー ホールディングス エス.エイ.アール.エル. Embedded audio routing selector
WO2008091874A2 (en) 2007-01-22 2008-07-31 Personics Holdings Inc. Method and device for acute sound detection and reproduction
WO2008095167A2 (en) 2007-02-01 2008-08-07 Personics Holdings Inc. Method and device for audio recording
US11750965B2 (en) 2007-03-07 2023-09-05 Staton Techiya, Llc Acoustic dampening compensation system
US8111839B2 (en) 2007-04-09 2012-02-07 Personics Holdings Inc. Always on headwear recording system
US11317202B2 (en) 2007-04-13 2022-04-26 Staton Techiya, Llc Method and device for voice operated control
US10194032B2 (en) 2007-05-04 2019-01-29 Staton Techiya, Llc Method and apparatus for in-ear canal sound suppression
US11856375B2 (en) 2007-05-04 2023-12-26 Staton Techiya Llc Method and device for in-ear echo suppression
US11683643B2 (en) 2007-05-04 2023-06-20 Staton Techiya Llc Method and device for in ear canal echo suppression
US10009677B2 (en) 2007-07-09 2018-06-26 Staton Techiya, Llc Methods and mechanisms for inflation
US8488799B2 (en) 2008-09-11 2013-07-16 Personics Holdings Inc. Method and system for sound monitoring over a network
US8600067B2 (en) 2008-09-19 2013-12-03 Personics Holdings Inc. Acoustic sealing analysis system
US9129291B2 (en) 2008-09-22 2015-09-08 Personics Holdings, Llc Personalized sound management and method
US8554350B2 (en) 2008-10-15 2013-10-08 Personics Holdings Inc. Device and method to reduce ear wax clogging of acoustic ports, hearing aid sealing system, and feedback reduction system
WO2010094033A2 (en) 2009-02-13 2010-08-19 Personics Holdings Inc. Earplug and pumping systems
WO2011163565A1 (en) 2010-06-26 2011-12-29 Personics Holdings, Inc. Method and devices for occluding an ear canal having a predetermined filter characteristic
EP2659366A1 (en) 2010-12-30 2013-11-06 Ambientz Information processing using a population of data acquisition devices
US10356532B2 (en) 2011-03-18 2019-07-16 Staton Techiya, Llc Earpiece and method for forming an earpiece
US10362381B2 (en) 2011-06-01 2019-07-23 Staton Techiya, Llc Methods and devices for radio frequency (RF) mitigation proximate the ear
WO2014039026A1 (en) 2012-09-04 2014-03-13 Personics Holdings, Inc. Occlusion device capable of occluding an ear canal
CN103812842A (en) * 2012-11-14 2014-05-21 中国科学院沈阳计算技术研究所有限公司 Streaming media switching matrix and broadcasting control method thereof for network broadcast
US10043535B2 (en) 2013-01-15 2018-08-07 Staton Techiya, Llc Method and device for spectral expansion for an audio signal
US11170089B2 (en) 2013-08-22 2021-11-09 Staton Techiya, Llc Methods and systems for a voice ID verification database and service in social networking and commercial business transactions
US9167082B2 (en) 2013-09-22 2015-10-20 Steven Wayne Goldstein Methods and systems for voice augmented caller ID / ring tone alias
CA2866073C (en) 2013-10-02 2021-11-30 Evertz Microsystems Ltd. Video router
US10405163B2 (en) * 2013-10-06 2019-09-03 Staton Techiya, Llc Methods and systems for establishing and maintaining presence information of neighboring bluetooth devices
US10045135B2 (en) 2013-10-24 2018-08-07 Staton Techiya, Llc Method and device for recognition and arbitration of an input connection
US10043534B2 (en) 2013-12-23 2018-08-07 Staton Techiya, Llc Method and device for spectral expansion for an audio signal
JP6256060B2 (en) * 2014-02-03 2018-01-10 株式会社リコー Data transfer apparatus, image forming apparatus, and data transfer method
US10163453B2 (en) 2014-10-24 2018-12-25 Staton Techiya, Llc Robust voice activity detector system for use with an earphone
US10413240B2 (en) 2014-12-10 2019-09-17 Staton Techiya, Llc Membrane and balloon systems and designs for conduits
US10709388B2 (en) 2015-05-08 2020-07-14 Staton Techiya, Llc Biometric, physiological or environmental monitoring using a closed chamber
US10418016B2 (en) 2015-05-29 2019-09-17 Staton Techiya, Llc Methods and devices for attenuating sound in a conduit or chamber
US10616693B2 (en) 2016-01-22 2020-04-07 Staton Techiya Llc System and method for efficiency among devices
US10405082B2 (en) 2017-10-23 2019-09-03 Staton Techiya, Llc Automatic keyword pass-through system
BR112020018415A2 (en) 2018-03-09 2020-12-22 Staton Techiya, Llc HEADSET AND EARPHONE DEVICES, AND ASSOCIATED SYSTEMS AND METHODS
US10817252B2 (en) 2018-03-10 2020-10-27 Staton Techiya, Llc Earphone software and hardware
US11607155B2 (en) 2018-03-10 2023-03-21 Staton Techiya, Llc Method to estimate hearing impairment compensation function
CN108419179A (en) * 2018-03-24 2018-08-17 宁波尚金光能科技有限公司 Rail audio transmission system when a kind of digital more
US10951994B2 (en) 2018-04-04 2021-03-16 Staton Techiya, Llc Method to acquire preferred dynamic range function for speech enhancement
US11488590B2 (en) 2018-05-09 2022-11-01 Staton Techiya Llc Methods and systems for processing, storing, and publishing data collected by an in-ear device
US11122354B2 (en) 2018-05-22 2021-09-14 Staton Techiya, Llc Hearing sensitivity acquisition methods and devices
US11032664B2 (en) 2018-05-29 2021-06-08 Staton Techiya, Llc Location based audio signal message processing
WO2021164043A1 (en) * 2020-02-20 2021-08-26 深圳市昊一源科技有限公司 Audio and video transmission apparatus and audio and video transmission system

Citations (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5144548A (en) 1988-07-15 1992-09-01 Iris Technologies, Inc. Routing switcher
US5483538A (en) 1994-05-25 1996-01-09 The Grass Valley Group, Inc. Audio frame synchronization for embedded audio demultiplexers
GB2291574A (en) 1994-07-19 1996-01-24 Tektronix Inc Displaying embedded digital audio data
US5625461A (en) 1991-11-22 1997-04-29 Matsushita Electric Industrial Co., Ltd. Recording and reproducing apparatus
US5751707A (en) * 1995-06-19 1998-05-12 Bell Atlantic Network Services, Inc. AIN interaction through wireless digital video network
US5754254A (en) * 1995-01-10 1998-05-19 Sony Corporation Digital video audio processing apparatus
JPH10290207A (en) 1997-04-17 1998-10-27 Hitachi Ltd Multiplexed data separating device
US5861881A (en) * 1991-11-25 1999-01-19 Actv, Inc. Interactive computer system for providing an interactive presentation with personalized video, audio and graphics responses for multiple viewers
GB2330475A (en) 1997-10-15 1999-04-21 Videotek Inc Interlaced to non-interlaced video signal converter and multi-format display
JPH11112482A (en) 1997-09-30 1999-04-23 Jisedai Digital Television Hoso System Kenkyusho Multiplexing system and device
CA2323564A1 (en) 1998-03-13 1999-09-16 Dolby Laboratories Licensing Corporation Method and apparatus for processing audio information using time-aligned blocks of encoded audio in video/audio applications to facilitate audio switching
JPH11328852A (en) 1998-04-22 1999-11-30 Tektronix Inc Digital audio receiver with multichannel swapping function and swapping method
EP1041756A2 (en) 1999-03-29 2000-10-04 Lucent Technologies Inc. Multistream-in-band-on-channel transmission system
JP2001060383A (en) 2000-01-01 2001-03-06 Sony Corp Device and method for reproduction
US20020083441A1 (en) * 2000-08-31 2002-06-27 Flickinger Gregory C. Advertisement filtering and storage for targeted advertisement systems
US20020104083A1 (en) * 1992-12-09 2002-08-01 Hendricks John S. Internally targeted advertisements using television delivery systems
US6463585B1 (en) * 1992-12-09 2002-10-08 Discovery Communications, Inc. Targeted advertisement using television delivery systems
US20020167608A1 (en) 2001-04-20 2002-11-14 Semko Szybiak Circuit and method for live switching of digital video programs containing embedded audio data
US20030090590A1 (en) * 2001-11-09 2003-05-15 Kazuhiko Yoshizawa Video processing device
US20030122954A1 (en) * 1998-01-01 2003-07-03 Kassatly L. Samuel Anthony Video camera and method and device for capturing video, audio and data signals
JP2003199045A (en) 2001-12-26 2003-07-11 Victor Co Of Japan Ltd Information-recording-signal generating method and apparatus, information-signal reproducing method and apparatus, information-signal transmitting method, apparatus and program, and information-signal recording medium
US20030142233A1 (en) 2002-01-30 2003-07-31 Ryan Eckhardt Video serializer/deserializer with embedded audio support
US20030147010A1 (en) * 2002-02-01 2003-08-07 Joung Chul Yong Interfacing system for stream source apparatus and display apparatus and interfacing method thereof
US6680939B1 (en) * 2000-09-14 2004-01-20 Nvision, Inc Expandable router
US6690428B1 (en) 1999-09-13 2004-02-10 Nvision, Inc. Method and apparatus for embedding digital audio data in a serial digital video data stream
US20040028231A1 (en) * 2001-09-21 2004-02-12 Yoichiro Sako Data outputting method, recording method and apparatus, reproducing method and apparatus, and data transmitting method and receiving method
US20040073916A1 (en) 2002-10-15 2004-04-15 Verance Corporation Media monitoring, management and information system
US6744971B1 (en) * 1999-09-14 2004-06-01 Pioneer Corporation Information signal recording/reproducing apparatus and method thereof
WO2004064277A2 (en) 2003-01-16 2004-07-29 Sony United Kingdom Limited Video network
JP2004266866A (en) 2004-06-07 2004-09-24 Matsushita Electric Ind Co Ltd Data receiver, data reception method, and data transmission system
KR20040083601A (en) 2003-03-24 2004-10-06 김규완 A television set with a built-in audio and video clock
US6842485B2 (en) 2000-03-29 2005-01-11 Matsushita Electric Industrial Co., Ltd. Method and apparatus for reproducing compressively coded data
US6859579B2 (en) 2001-09-28 2005-02-22 Nec Corporation Optical switcher used for broadcast station
US20050083216A1 (en) 2003-10-20 2005-04-21 Microsoft Corporation System and method for a media codec employing a reversible transform obtained via matrix lifting
KR20050037663A (en) 2003-10-20 2005-04-25 엘지전자 주식회사 Method and apparatus for changing (a) voice of digital tv
US6889385B1 (en) * 2000-01-14 2005-05-03 Terayon Communication Systems, Inc Home network for receiving video-on-demand and other requested programs and services
US7013361B2 (en) 2001-01-24 2006-03-14 Grass Valley Group Inc. Routing switcher with variable input/output architecture
WO2006042207A1 (en) 2004-10-07 2006-04-20 Thomson Licensing Audio/video router
US20060206618A1 (en) 2005-03-11 2006-09-14 Zimmer Vincent J Method and apparatus for providing remote audio
US20060271980A1 (en) * 1997-04-21 2006-11-30 Mankovitz Roy J Method and apparatus for time-shifting video and text in a text-enhanced television program
US20070199043A1 (en) 2006-02-06 2007-08-23 Morris Richard M Multi-channel high-bandwidth media network
US7283965B1 (en) 1999-06-30 2007-10-16 The Directv Group, Inc. Delivery and transmission of dolby digital AC-3 over television broadcast
US20080013562A1 (en) * 2004-12-02 2008-01-17 Sony Corporation Apparatus And Method For Demultiplication
US20100026905A1 (en) 2006-12-20 2010-02-04 Thomson Licensing Embedded Audio Routing Switcher
USRE49111E1 (en) 2014-06-06 2022-06-21 Astellas Pharma Inc. 2-acylaminothiazole derivative or salt thereof

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB491111A (en) 1936-07-20 1938-08-26 Du Pont Improvements in and relating to artificial filaments, films and like materials
JP2937156B2 (en) 1997-01-08 1999-08-23 日本電気株式会社 Manufacturing method of semiconductor laser
US7162335B2 (en) 2003-12-19 2007-01-09 Honeywell International, Inc. Graphic airways displays for flight management systems
CN100352270C (en) * 2005-10-21 2007-11-28 西安交通大学 Synchronous broadcast controlling method capable of supporting multi-source stream media

Patent Citations (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5144548A (en) 1988-07-15 1992-09-01 Iris Technologies, Inc. Routing switcher
US5625461A (en) 1991-11-22 1997-04-29 Matsushita Electric Industrial Co., Ltd. Recording and reproducing apparatus
US5861881A (en) * 1991-11-25 1999-01-19 Actv, Inc. Interactive computer system for providing an interactive presentation with personalized video, audio and graphics responses for multiple viewers
US20020104083A1 (en) * 1992-12-09 2002-08-01 Hendricks John S. Internally targeted advertisements using television delivery systems
US6463585B1 (en) * 1992-12-09 2002-10-08 Discovery Communications, Inc. Targeted advertisement using television delivery systems
US5483538A (en) 1994-05-25 1996-01-09 The Grass Valley Group, Inc. Audio frame synchronization for embedded audio demultiplexers
GB2291574A (en) 1994-07-19 1996-01-24 Tektronix Inc Displaying embedded digital audio data
US5754254A (en) * 1995-01-10 1998-05-19 Sony Corporation Digital video audio processing apparatus
US5751707A (en) * 1995-06-19 1998-05-12 Bell Atlantic Network Services, Inc. AIN interaction through wireless digital video network
JPH10290207A (en) 1997-04-17 1998-10-27 Hitachi Ltd Multiplexed data separating device
US20060271980A1 (en) * 1997-04-21 2006-11-30 Mankovitz Roy J Method and apparatus for time-shifting video and text in a text-enhanced television program
JPH11112482A (en) 1997-09-30 1999-04-23 Jisedai Digital Television Hoso System Kenkyusho Multiplexing system and device
GB2330475A (en) 1997-10-15 1999-04-21 Videotek Inc Interlaced to non-interlaced video signal converter and multi-format display
US6069607A (en) 1997-10-15 2000-05-30 Videotek, Inc. Multi-format on-screen monitor
US20030122954A1 (en) * 1998-01-01 2003-07-03 Kassatly L. Samuel Anthony Video camera and method and device for capturing video, audio and data signals
CA2323564A1 (en) 1998-03-13 1999-09-16 Dolby Laboratories Licensing Corporation Method and apparatus for processing audio information using time-aligned blocks of encoded audio in video/audio applications to facilitate audio switching
US6085163A (en) 1998-03-13 2000-07-04 Todd; Craig Campbell Using time-aligned blocks of encoded audio in video/audio applications to facilitate audio switching
US6104997A (en) 1998-04-22 2000-08-15 Grass Valley Group Digital audio receiver with multi-channel swapping
JPH11328852A (en) 1998-04-22 1999-11-30 Tektronix Inc Digital audio receiver with multichannel swapping function and swapping method
EP1041756A2 (en) 1999-03-29 2000-10-04 Lucent Technologies Inc. Multistream-in-band-on-channel transmission system
US7283965B1 (en) 1999-06-30 2007-10-16 The Directv Group, Inc. Delivery and transmission of dolby digital AC-3 over television broadcast
US6690428B1 (en) 1999-09-13 2004-02-10 Nvision, Inc. Method and apparatus for embedding digital audio data in a serial digital video data stream
US6744971B1 (en) * 1999-09-14 2004-06-01 Pioneer Corporation Information signal recording/reproducing apparatus and method thereof
JP2001060383A (en) 2000-01-01 2001-03-06 Sony Corp Device and method for reproduction
US6889385B1 (en) * 2000-01-14 2005-05-03 Terayon Communication Systems, Inc Home network for receiving video-on-demand and other requested programs and services
US6842485B2 (en) 2000-03-29 2005-01-11 Matsushita Electric Industrial Co., Ltd. Method and apparatus for reproducing compressively coded data
US20020083441A1 (en) * 2000-08-31 2002-06-27 Flickinger Gregory C. Advertisement filtering and storage for targeted advertisement systems
US6680939B1 (en) * 2000-09-14 2004-01-20 Nvision, Inc Expandable router
US7013361B2 (en) 2001-01-24 2006-03-14 Grass Valley Group Inc. Routing switcher with variable input/output architecture
US20020167608A1 (en) 2001-04-20 2002-11-14 Semko Szybiak Circuit and method for live switching of digital video programs containing embedded audio data
US20040028231A1 (en) * 2001-09-21 2004-02-12 Yoichiro Sako Data outputting method, recording method and apparatus, reproducing method and apparatus, and data transmitting method and receiving method
US6859579B2 (en) 2001-09-28 2005-02-22 Nec Corporation Optical switcher used for broadcast station
US20030090590A1 (en) * 2001-11-09 2003-05-15 Kazuhiko Yoshizawa Video processing device
JP2003199045A (en) 2001-12-26 2003-07-11 Victor Co Of Japan Ltd Information-recording-signal generating method and apparatus, information-signal reproducing method and apparatus, information-signal transmitting method, apparatus and program, and information-signal recording medium
US20030142233A1 (en) 2002-01-30 2003-07-31 Ryan Eckhardt Video serializer/deserializer with embedded audio support
US20030147010A1 (en) * 2002-02-01 2003-08-07 Joung Chul Yong Interfacing system for stream source apparatus and display apparatus and interfacing method thereof
US20040073916A1 (en) 2002-10-15 2004-04-15 Verance Corporation Media monitoring, management and information system
WO2004064277A2 (en) 2003-01-16 2004-07-29 Sony United Kingdom Limited Video network
KR20040083601A (en) 2003-03-24 2004-10-06 김규완 A television set with a built-in audio and video clock
US20050083216A1 (en) 2003-10-20 2005-04-21 Microsoft Corporation System and method for a media codec employing a reversible transform obtained via matrix lifting
KR20050037663A (en) 2003-10-20 2005-04-25 엘지전자 주식회사 Method and apparatus for changing (a) voice of digital tv
JP2004266866A (en) 2004-06-07 2004-09-24 Matsushita Electric Ind Co Ltd Data receiver, data reception method, and data transmission system
US7774494B2 (en) * 2004-10-07 2010-08-10 Thomson Licensing Audio/video router
WO2006042207A1 (en) 2004-10-07 2006-04-20 Thomson Licensing Audio/video router
US20090121740A1 (en) 2004-10-07 2009-05-14 Michael Thomas Hauke Audio/Video Router
US20080013562A1 (en) * 2004-12-02 2008-01-17 Sony Corporation Apparatus And Method For Demultiplication
US20060206618A1 (en) 2005-03-11 2006-09-14 Zimmer Vincent J Method and apparatus for providing remote audio
US20070199043A1 (en) 2006-02-06 2007-08-23 Morris Richard M Multi-channel high-bandwidth media network
US20100026905A1 (en) 2006-12-20 2010-02-04 Thomson Licensing Embedded Audio Routing Switcher
US8750295B2 (en) * 2006-12-20 2014-06-10 Gvbb Holdings S.A.R.L. Embedded audio routing switcher
USRE49111E1 (en) 2014-06-06 2022-06-21 Astellas Pharma Inc. 2-acylaminothiazole derivative or salt thereof

Non-Patent Citations (17)

* Cited by examiner, † Cited by third party
Title
Canadian Office Action dated Nov. 6, 2015, regarding Canadian Application No. 2672418.
Communication Pursuant to 94(3) dated Aug. 5, 2016 in corresponding EP Application No. 14160139.3.
EP Examination Report dated Oct. 22, 2012 regarding European Application No. 06847871.8.
European Search Report dated Mar. 8, 2012 in European Application No. 06847871.8.
Extended EP Search Report and Search Opinion dated May 21, 2014, regarding EP 141601393.
Extended EP Search Report and Search Opinion dated May 31, 2014, regarding EP 141601393.
International Preliminary Report on Patentability dated Jun. 23, 2009 and Written Opinion dated Sep. 18, 2007 regarding PCT/US2006/048697.
International Search Report dated Sep. 18, 2007 regarding PCT/US2006/048697.
Meert et al., "Use of packet switching for the transport of real-time video," Journal of Institution of British Telecommunications Engineers, vol. 1, pt. 3, pp. 94-97, Jul.-Sep. 2000.
Notification Concerning Transmittal of International Preliminary Report on Patentability regarding PCT Application No. PCT/US2006/048697, dated Jun. 23, 2009, Sep. 18, 2007 Written Opinion.
Notification of Reasons for Rejection from the Japanese Patent Office in Japanese Patent Application No. 2009-542739, dated Apr. 12, 2011.
Office Action from Canadian Patent Office regarding Canadian Application No. 2,672,418, dated Dec. 4, 2013.
Office Action from Chinese Patent Office regarding Chinese Patent Application No. 200680056681.7, dated Aug. 9, 2010.
Oral Proceedings scheduled for Nov. 21, 2013 regarding EP Patent Application No. 06847871.8.
Summons to Attend Oral Proceedings, including annex, dated Mar. 15, 2013 regarding European Application No. 06847871.8.
Supplementary European Search Report dated Mar. 1, 2012 regarding European Application No. 06847871.8.
Warth, "Implementation of a large digital routing system at the CBC broadcast center," SMPTE Journal, vol. 103, No. 2, pp. 105-109, Feb. 1994.

Also Published As

Publication number Publication date
CN101563915B (en) 2012-09-19
US20140300820A1 (en) 2014-10-09
EP2103110A4 (en) 2012-04-11
US9479711B2 (en) 2016-10-25
CN101563915A (en) 2009-10-21
US8750295B2 (en) 2014-06-10
CA2672418C (en) 2018-06-12
JP4886041B2 (en) 2012-02-29
US20100026905A1 (en) 2010-02-04
EP2103110B1 (en) 2014-03-26
WO2008079112A1 (en) 2008-07-03
EP2744193B1 (en) 2018-07-04
EP2103110A1 (en) 2009-09-23
EP2744193A1 (en) 2014-06-18
CA2672418A1 (en) 2008-07-03
JP2010514347A (en) 2010-04-30

Similar Documents

Publication Publication Date Title
USRE48325E1 (en) Embedded audio routing switcher
CA2621442C (en) An apparatus and method for soft media processing within a routing switcher
US20090257360A1 (en) Method and system for monitoring and controlling a video signal network
US5754254A (en) Digital video audio processing apparatus
JP2010514347A5 (en)
US20090097496A1 (en) Video Signal Switching System
KR100689474B1 (en) Transport Stream Receiving Apparatus For Multi-Screen and Its Control Method
KR100416871B1 (en) Multi format video transmission apparatus
KR100720297B1 (en) Transmission system and method, signal adjusting apparatus and method, and routing apparatus
US20180198737A1 (en) Compact router with redundancy
US5774457A (en) Multi-point video conference control apparatus
US20070248087A1 (en) System and method for signal processing
KR101852596B1 (en) Multi-channel video switching device with multiple video mixer outputs
EP1217838A1 (en) Packet identifier (PID) aliasing for a broadband audio, video and data router
JP4258778B2 (en) Video signal switching system
WO2005029855A1 (en) Video signal processor
EP1202499A2 (en) Routing of broadband packetized data
JP2002290833A (en) Video switching network system
JP2005277465A (en) Video image distributor

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: THOMSON LICENSING, FRANCE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LIRON, JOHN EDWARD;REEL/FRAME:053042/0894

Effective date: 20070307

Owner name: GRASS VALLEY CANADA, CANADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GVBB HOLDINGS S.A.R.L.;REEL/FRAME:053043/0036

Effective date: 20200624

Owner name: GVBB HOLDINGS S.A.R.L., LUXEMBOURG

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:THOMSON LICENSING;REEL/FRAME:053066/0530

Effective date: 20101231

AS Assignment

Owner name: MS PRIVATE CREDIT ADMINISTRATIVE SERVICES LLC, NEW YORK

Free format text: SECURITY INTEREST;ASSIGNORS:GRASS VALLEY CANADA;GRASS VALLEY LIMITED;REEL/FRAME:066850/0869

Effective date: 20240320

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8