CN114115787A - Signal transmission method and device for data transmission on audio transmission interface - Google Patents

Signal transmission method and device for data transmission on audio transmission interface Download PDF

Info

Publication number
CN114115787A
CN114115787A CN202010903264.3A CN202010903264A CN114115787A CN 114115787 A CN114115787 A CN 114115787A CN 202010903264 A CN202010903264 A CN 202010903264A CN 114115787 A CN114115787 A CN 114115787A
Authority
CN
China
Prior art keywords
data
audio
unit
transmission
data unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010903264.3A
Other languages
Chinese (zh)
Inventor
廖峻谷
吴佳哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Realtek Semiconductor Corp
Original Assignee
Realtek Semiconductor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Realtek Semiconductor Corp filed Critical Realtek Semiconductor Corp
Priority to CN202010903264.3A priority Critical patent/CN114115787A/en
Publication of CN114115787A publication Critical patent/CN114115787A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/165Management of the audio stream, e.g. setting of volume, audio stream path
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Communication Control (AREA)

Abstract

The invention provides a signal transmission method for data transmission through an audio transmission interface, which comprises the following steps: receiving audio data and first control data generated based on at least a first human-machine interaction behavior; adding the audio data to at least the first data unit; adding the first control data to at least a second data unit; and transmitting a bitstream comprising the first data unit and the second data unit at a transmission rate higher than a sampling rate of the audio data.

Description

Signal transmission method and device for data transmission on audio transmission interface
Technical Field
The present invention relates to communication transmission, and more particularly, to a signal transmission method and apparatus for data transmission on an audio transmission interface.
Background
Human Machine Interface (HMI) refers to the Interface between a user and a system, such as: computer/electronic systems or mechanical systems, software/hardware providing an interactive approach. With the development and breakthrough of technology, many different types of human-computer interaction devices are often integrated on electronic devices today, such as: key input, voice input, touch input, etc., but this also means diversification of the related signal transmission interface and increase of the complexity of signal transmission.
Disclosure of Invention
Therefore, different signal transmission specifications are brought by different types of human-computer interaction devices, and the transmission interface of the system is more complex and tedious in design from the connector, the transmission line and the data format. Therefore, the present invention provides a signal transmission device and a related method, which can transmit signals generated by different types of human-computer interaction behaviors in the form of digital audio signals. Information generated by keyboard/button presses, mouse controls, microphone voice inputs, and/or touch operations, for example, may be packaged into a data unit for digital audio transmission for transmission via a digital audio transmission interface. Therefore, the invention effectively reduces the complexity of the transmission interface. In addition, the invention also effectively controls the data sampling rate and the transmission rate of the bit stream, and simultaneously transmits audio information and control information with different sampling rates, thereby ensuring the transmission efficiency and the reliability thereof.
The embodiment of the invention provides a signal transmission method for data transmission through an audio transmission interface, which comprises the following steps: receiving audio data and first control data generated based on at least a first human-machine interaction behavior; adding the audio data to at least the first data unit; adding the first control data to at least a second data unit; and transmitting a bitstream comprising the first data unit and the second data unit at a transmission rate higher than a sampling rate of the audio data.
The embodiment of the invention provides a signal transmission device for data transmission through an audio transmission interface. The signal transmission device comprises: a receiving unit, a data unit generator and a transmitting unit. The receiving unit is used for receiving audio data and first control data generated based on at least a first human-computer interaction behavior. The data unit generator is coupled to the receiving unit and configured to add the audio data to at least a first data unit and to add the first control data to at least a second data unit. The transmission unit is coupled to the data unit generator and is configured to transmit a bitstream comprising the first data unit and the second data unit at a transmission rate higher than a sampling rate of the audio data.
Drawings
Fig. 1 is a schematic application diagram of a signal transmission apparatus according to an embodiment of the present invention.
Fig. 2 is a schematic diagram of a data unit for signal transmission according to an embodiment of the present invention.
FIG. 3 is a schematic diagram of a bitstream generated by a data unit generator according to an embodiment of the present invention.
Fig. 4 is a flowchart of a signal transmission method according to an embodiment of the present invention.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of embodiments of the invention to the reader. However, those skilled in the art will understand how to implement the invention without one or more of the specific details, or with other methods or elements or materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring the core concepts of the invention.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the invention. Thus, the appearances of the phrase "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics described above may be combined in any suitable manner in one or more embodiments.
Fig. 1 is a schematic diagram illustrating an application of a signal transmission apparatus for data transmission on an audio transmission interface according to an embodiment of the present invention. As shown, the control device 10 is wired to the electronic system 20 through the audio transmission interface 200, and transmits a plurality of different types of information on the audio transmission interface 200, thereby controlling the electronic system 20. In embodiments, the control device 10 may be a personal computer, a notebook computer, or various types of user controls, such as: a remote control operative to provide one or more human-computer interaction means to enable user control of the electronic system 20. In various embodiments of the present invention, the control device 10 may include various human interaction hardware 12, such as a keyboard, buttons, a mouse, a microphone, and a touch panel, for sensing control actions of a user. Furthermore, the electronic system 20 may be a set-up box (set-up box), a smart television, and/or a multimedia player device. The electronic system 20 further includes a receiver 21, a controller 22, and a hardware element 23. Wherein, the receiver 21 receives the signal transmitted by the control device 10 through the audio transmission interface 200, and performs corresponding demodulation/decoding operations to obtain the control information sent by the control device 10, and delivers it to the controller 22 to control the hardware element 23. In an embodiment, the audio transport Interface 200 is a Sony/Philips Digital Interface Format (S/PDIF) Interface.
The signal transmission apparatus 100 of the present invention is used to convert the control information generated by the control device 10 into a data format conforming to the communication protocol of the audio transmission interface 200 and transmit the converted control information to the electronic system 20. As shown, the signal transmission apparatus 100 includes: a receiving unit 110, a data unit generator 120, and a transmitting unit 130. The control device 10 may comprise a control information generating unit 15 for generating, according to human-computer interaction behavior performed by a user with respect to the human-computer interaction hardware 12, for example: pressing keyboard/keys, operating mouse, touching touch panel, sending voice indication through microphone, etc. to generate corresponding information. These man-machine interaction behaviors are detected by the control information generating unit 15 and converted into digital signals to be transmitted to the receiving unit 110 of the signal transmission device 100 of the present invention. The receiving unit 110, after receiving the control information provided by the control information generating unit 15, will transmit it to the data unit generator 120.
The data unit generator 120 is used to generate data units conforming to the communication protocol corresponding to the audio transmission interface 200, such as: a frame (frame) or a sub-frame (sub-frame). The data unit may contain various fields such as an audio data field for transmitting audio information and an auxiliary data field for transmitting auxiliary information. The information of the auxiliary data field may contain metadata (metadata) for indicating a sampling rate and a compression state of the audio information. In various embodiments of the present invention, the data unit generator 120 may pack the control information received by the receiving unit 110 and generated based on the man-machine interaction behavior into the audio data field or the auxiliary data field of the data unit.
In the following description, the specific operation and operation principle of the signal transmission apparatus 100 and the related signal transmission method of the present invention will be further explained by taking an S/PDIF interface and its related communication protocol as an example. However, those skilled in the art should understand the essence of the present disclosure that the present inventive concept can be further applied to other types of audio transmission interfaces, and such derived concepts shall fall within the scope of the present invention. Please refer to the S/PDIF data transmission format shown in fig. 2. In the S/PDIF communication protocol, each audio block (block) comprises 192 frames, and each frame comprises two sub-frames corresponding to different audio channels (channels). Furthermore, each subframe contains 32 bits of data. The first four bits are used to record the information required for synchronization, and include B, M, W, which are three different types, respectively indicating the beginning of an audio block and different audio channels. Furthermore, the next 24 bits are an audio data field for recording an audio sample word (audio sample word). In the last 4 bits, the U/V/C field is used to record metadata (metadata) related to audio data, and the P field is used to record parity information. When the signal transmission apparatus 100 of the present invention is applied to the S/PDIF interface, the data unit generator 120 may selectively pack the control information to be transmitted into the audio sample word field and/or the U/V/C field based on the characteristics of the control information to be transmitted, such as the data amount and the sampling rate.
The data unit generator 120 transmits the generated data units (e.g., sub-frames) to the transmission unit 130. The transmission unit 130 transmits the data units to the electronic system 20 in the form of a bit stream through the audio transmission interface 200. In order to allow the fields in the data unit to be left empty, the human-computer interaction information is packaged into the data unit. The transmission unit 130 may transmit the bit stream at a rate higher than the sampling rate of the audio data. In an embodiment, when the sampling rate of the audio data is 16kHz, the transmission unit 130 may transmit the bitstream at a rate of 48 kHz. Thus, during each transmission, a free field in the data unit may be used to transmit information related to human-computer interaction.
FIG. 3 shows an embodiment of a plurality of consecutive data units generated by the data unit generator 120. As shown, the Data unit generator 120 packs audio Data in the audio Data fields Data 1-Data 4 of the Data units SF 1-SF 4. Furthermore, the Data unit generator 120 packs the first control Data CNT1 in the audio Data fields Data 5-Data 6 of the Data units SF 5-SF 6, and packs the second control Data CNT2 in the auxiliary Data field X1 of the Data units SF 1-SF 6. In an embodiment, the sampling rate of the first control data CNT1 is lower than the transfer rate of the bit stream transmitted by the transmission unit 130, and the sampling rate of the second control data CNT2 is higher than the transfer rate of the bit stream transmitted by the transmission unit 130. In an embodiment, the first control data CNT1 may be control information generated by the control information generating unit 15 based on a touch behavior performed by a user on a touch panel (not shown) in the human interaction hardware 12. Furthermore, the second control data CNT2 can be control information generated by the control information generating unit 15 based on the operation behavior of the keyboard, the button or the mouse of the control device 10 by the user, for controlling the hardware element 23 of the electronic system 20, such as an infrared ray signal (IrDA) or a Pulse Width Modulation (Pulse Width Modulation) signal for controlling a Light-emitting diode (not shown) in the hardware element 23 of the electronic system 20.
It is noted that in various embodiments of the present invention, there may be more than one type of first control data CNT1 packed into audio data fields in different data units and more than one type of second control data CNT2 packed into auxiliary data fields in different data units. Among them, the first control data CNT1 may have a relatively low sampling rate and a relatively high data amount with respect to the second control data CNT 2. It is further noted that in different embodiments of the present invention, the data unit generator 120 may only add one kind of control data to consecutive data units, for example, only the first control data CNT1 or the second control data CNT2, depending on the control information that the control device 10 needs to transmit.
FIG. 4 is a flowchart illustrating a method for data transmission on an audio transmission interface according to an embodiment of the invention. As shown in the figure, the method of the present invention comprises the following steps:
step 410: receiving audio data and first control data generated based on at least a first human-machine interaction behavior
Step 420: adding the audio data to at least a first data unit
Step 430: adding the first control data to at least a second data unit
Step 440: transmitting a bitstream comprising the first data unit and the second data unit at a transmission rate higher than a sampling rate of the audio data
Since the principle and the specific details of the above steps have been described in detail in the foregoing embodiments of the signal transmission apparatus 100, the description is not repeated here. It should be noted that the above-described flow may also be better implemented by adding other additional steps to the signal transmission method of the present invention.
To summarize, the present invention packages control information generated by different types of human-computer interaction devices, such as keyboard/button presses, mouse controls, microphone voice inputs, and/or touch operations, into a data unit for digital audio transmission, and transmits the data unit through a digital audio transmission interface. Therefore, the invention effectively reduces the complexity of the transmission interface. In addition, the invention also effectively controls the data sampling rate and the transmission rate of the bit stream, and simultaneously transmits audio information and control information with different sampling rates, thereby ensuring the transmission efficiency and the reliability thereof.
Embodiments of the invention may be implemented using hardware, software, firmware, and combinations thereof. Embodiments of the invention may be implemented using software or firmware stored in memory with an appropriate instruction execution system. In terms of hardware, any of the following techniques, or a combination thereof, may be used to implement the method: individual arithmetic logic devices having logic gates that perform logic functions in accordance with data signals, Application Specific Integrated Circuits (ASICs) having suitable combinational logic gates, Programmable Gate Arrays (PGAs), Field Programmable Gate Arrays (FPGAs), or the like.
The flowcharts and blocks in the flowcharts within this specification illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer software products according to various embodiments of the present invention. In this regard, each block in the flowchart or functional block diagrams may represent a module, segment, or portion of program code, which comprises one or more executable instructions for implementing the specified logical function(s). In addition, each block, and combinations of blocks, in the functional block diagrams and/or flowchart illustrations, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer program instructions. These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium implement the function/act specified in the flowchart and/or block diagram block or blocks.
The above description is only a preferred embodiment of the present invention, and all equivalent changes and modifications made in accordance with the claims of the present invention should be covered by the present invention.
[ notation ] to show
10 control device
12 human-computer interaction hardware
15 control information generating unit
20 electronic system
21 receiver
22 controller
23 hardware elements
100 signal transmission device
110 receiving unit
120 data unit generator
130 transmission unit
200 audio transmission interface.

Claims (10)

1. A method for data transmission through an audio transmission interface, comprising:
receiving audio data and first control data generated based on at least a first human-machine interaction behavior;
adding the audio data to at least the first data unit;
adding the first control data to at least a second data unit; and
a bitstream comprising the first data unit and the second data unit is transmitted at a transmission rate higher than a sampling rate of the audio data.
2. The method of claim 1, wherein the step of adding the first control data to the second data unit comprises:
and adding the first control data to an audio data field in the second data unit, wherein the sampling rate of the first control data is the same as the sampling rate of the audio data.
3. The method of claim 1, wherein the step of adding the first control data to the second data unit comprises:
adding the first control data to an auxiliary data field in the second data unit, wherein a sampling rate of the first control data is higher than a sampling rate of the audio data.
4. The method of claim 1, further comprising:
receiving second control data generated based on the second human-computer interaction behavior;
the second control data is added to one of the first data unit or the second data unit.
5. The method of claim 1, wherein the first human-machine interaction behavior comprises at least one of pressing a button of a controller, using a microphone for voice input, and using a touch panel for touch operation.
6. The method of claim 1, wherein the audio transmission Interface is a Sony/Philips Digital Interface Format (S/PDIF) Interface.
7. A signal transmission device for data transmission in an audio transmission interface, comprising:
a receiving unit to receive first data for controlling a first device and second data for controlling at least a second device;
a data unit generator, coupled to the receiving unit, for adding control data to at least a first data unit and adding control data to at least a second data unit; and
a transmission unit, coupled to the data unit generator, for transmitting a bitstream comprising the first data unit and the second data unit at a transmission rate higher than a sampling rate of the audio data.
8. The signal transmission device according to claim 7, wherein the data unit generator adds the first control data to an audio data field in the second data unit, and a sampling rate of the first control data is the same as a sampling rate of the audio data.
9. The signal transmission device according to claim 7, wherein the data unit generator adds the first control data to an auxiliary data field in the second data unit, and a sampling rate of the first control data is higher than a sampling rate of the audio data.
10. The signal transmission apparatus according to claim 7, wherein the receiving unit further receives second control data generated based on a second human-computer interaction behavior; and the data unit generator adds the second control data to one of the first data unit or the second data unit.
CN202010903264.3A 2020-09-01 2020-09-01 Signal transmission method and device for data transmission on audio transmission interface Pending CN114115787A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010903264.3A CN114115787A (en) 2020-09-01 2020-09-01 Signal transmission method and device for data transmission on audio transmission interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010903264.3A CN114115787A (en) 2020-09-01 2020-09-01 Signal transmission method and device for data transmission on audio transmission interface

Publications (1)

Publication Number Publication Date
CN114115787A true CN114115787A (en) 2022-03-01

Family

ID=80360686

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010903264.3A Pending CN114115787A (en) 2020-09-01 2020-09-01 Signal transmission method and device for data transmission on audio transmission interface

Country Status (1)

Country Link
CN (1) CN114115787A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030059057A1 (en) * 2000-02-02 2003-03-27 Eric Cheng Control system for digital sound effect and the method of the same
CN1976478A (en) * 2005-12-02 2007-06-06 三星电子株式会社 Digital signal receiving apparatus and digital signal transmitting apparatus and method of using the same
CN101350190A (en) * 2007-07-20 2009-01-21 三星电子株式会社 Method and apparatus for transmitting and processing audio in inter-IC sound format
CN106537929A (en) * 2014-05-28 2017-03-22 弗劳恩霍夫应用研究促进协会 Data processor and transport of user control data to audio decoders and renderers

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030059057A1 (en) * 2000-02-02 2003-03-27 Eric Cheng Control system for digital sound effect and the method of the same
CN1976478A (en) * 2005-12-02 2007-06-06 三星电子株式会社 Digital signal receiving apparatus and digital signal transmitting apparatus and method of using the same
CN101350190A (en) * 2007-07-20 2009-01-21 三星电子株式会社 Method and apparatus for transmitting and processing audio in inter-IC sound format
CN106537929A (en) * 2014-05-28 2017-03-22 弗劳恩霍夫应用研究促进协会 Data processor and transport of user control data to audio decoders and renderers

Similar Documents

Publication Publication Date Title
US20090189860A1 (en) Method for reducing power consumption of wireless mouse
US20090309831A1 (en) Wireless control device and multi-cursor control method
WO2017107427A1 (en) Terminal equipment control method, device, and equipment, and non-volatile computer storage medium
WO2017107428A1 (en) Terminal device control method, apparatus and equipment, and non-volatile computer storage medium
EP4275981A1 (en) Multi-gesture interaction touch steering wheel control system having vibration feedback
CN103168466A (en) Virtual video capture device
CN107861657A (en) Touch signal processing method, system and device and electronic equipment
CN108319441B (en) Audio playing control method, device, system, processor and storage medium
WO2017107430A1 (en) Method, apparatus and device for controlling terminal device, and non-volatile computer storage medium
CN107844220A (en) Touch signal processing method, system and device and electronic equipment
CN114115787A (en) Signal transmission method and device for data transmission on audio transmission interface
TWI768446B (en) Signal transmission method and apparatus for transmission of data over audio transmission interface
CN106504759A (en) A kind of mixed audio processing method and terminal device
US7702005B2 (en) Method for transmitting and/or receiving audio data of a plurality of audio sources through a single SPDIF link, and related apparatus
CN101364417B (en) Audio fast playing method and apparatus
CN102411921B (en) Encoding and decoding device and execution and driving method thereof
CN103312718A (en) Device control method and device and multimedia equipment
KR20190106661A (en) Method for transmitting continuous data and data transmission system
CN101071345A (en) Multifunctional wireless mouse
US20200126541A1 (en) Phonetic Representor, System, and Method
CN107220190A (en) It is a kind of to realize the self-defined USB mouse of two-way information interaction and the system and method for keyboard with host driven
CN113035246B (en) Audio data synchronous processing method and device, computer equipment and storage medium
JP3111812B2 (en) Data communication device
GB2396234A (en) Transmitting and receiving wireless keyboard data
CN117851297A (en) Control system core single machine virtual prototype interface, design method and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination