CN1152843A - Image/audio coding and decoding device - Google Patents
Image/audio coding and decoding device Download PDFInfo
- Publication number
- CN1152843A CN1152843A CN96112856A CN96112856A CN1152843A CN 1152843 A CN1152843 A CN 1152843A CN 96112856 A CN96112856 A CN 96112856A CN 96112856 A CN96112856 A CN 96112856A CN 1152843 A CN1152843 A CN 1152843A
- Authority
- CN
- China
- Prior art keywords
- data
- coding
- image
- audio
- character
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
A graphic/audio compression and encoding device comprises an image coding unit, an audio coding unit, a character coding unit, a the first multiplexing unit and the second multiplexing unit. A graphic / audio decoding device is used for the receiving of the multiplexing image and audio data of the graphic / audio coding device, in which the data is decoded to a combined image signal and an audio signal provided with character signals and suitable to display on a TV screen.
Description
The present invention relates to a kind of image/audio coding device and decoding device, particularly a kind of being used for carries out character data and the image/audio data that are compressed and encode multiplexed, with character display information, device and a kind of being used for that for example on video screen, comprise the text and the sound of mobile visual song with above-mentioned device through multiplexed image/audio/character data regeneration such as Caraok device.
As a kind of standard of the Code And Decode world of image/audio data, known by people already by MPEG1 and two standards of MPEG2 that MPEG (mobile picture experts group) recommends.The present invention will be explained by example for the purpose of understanding, this example for character data with carry out according to the image/audio data of MPEG1 or MPEG2 standard compression and coding multiplexed, though the present invention and not only be confined to this.
About mpeg standard, referring to editing by multimedia seminar, and " the Newest MPEG Textbook by pointIllustration " that published on August 1st, 1994 by ASCII publishing house.
The present invention is specially adapted to Caraok device.Caraok device herein refers to a kind of device, and it shows the melody of playing this song in respective background image and the song text on video screen, and with melody synchronizing sequence change videotex in the color of respective symbols.Each song in a large amount of songs of being broadcasted by Caraok device stores corresponding background images among recording medium such as the CD-ROM, song text and the melody data of celebrating mutually, and the user utilizes Caraok device to select it to wish the song of playing from CD-ROM.
The character data of representing the image/audio data that are compressed and encode of background images and melody and song text is in the multiplexed CD-ROM of writing.In the past, compression and coding are applied on the generated data that comprises image/audio data and character data and no matter whether this compression and coding adopts the coding techniques that meets mpeg standard.
Adopt in the device of prior art, the character data of song text is converted into image pattern, and combined and be compressed with the background images signal, as the part of picture intelligence.Compressed pictorial data is written into CD-ROM or sends into connection.In the receiver or CD-ROM delivery device of compressed pictorial data, compressed pictorial data by decoding and decompress(ion) (expand) simply with the reproduced picture signal.
But in the system that adopts the prior art that character data is carried out compressed encoding as the part of picture intelligence, may around the character that adds, produce tangible character distortion and colour deficient and make that character is difficult to read.
In other words because seldom coloured unexpected variation in background images, owing to the decline of picture intelligence being compressed the image quality that causes not clearly.On the other hand, because the text character of Kara OK songs must show very clearly on background images, therefore the monochrome (as white) that is not included in the background images often is used.As a result, very unexpected in edge's change in color of background images and text, and if deform at boundary, whole text just seems and fades.
Moreover, in order to indicate that the color of text character changes synchronously with melody corresponding to the position of the videotex of the melody of current broadcast.At this moment, just there is a problem in prior art, and promptly the defective of color becomes obviously and makes character reading very difficult.
In order to reduce character distortion, once the someone advised the compressibility factor that text filed employing is different with other zones.Being that text filed employing is low compresses the factor and other zone employing high compression factors.But adopt the image quality of this way in the zone except the character neighboring area to degenerate.
Also the exclusive data that defines in the multiplex system that suggestion once utilizes MPEG to recommend respectively picture intelligence and character information encodes.But in Caraok device, importantly the text character change in color is synchronous fully with melody, and exclusive data is synchronous with the pictorial data that is encoded.As a result, in utilizing the exclusive data Methods for Coding, the audio signal of the song melody that representative is play is too complicated with becoming synchronously of the character of representing song text, is difficult in practice use.
An object of the present invention is to provide a kind of image/audio compression and decoding device, be used for carrying out the image/audio data behind character data and compression and the coding multiplexed, with a kind of decoding device is provided, wherein when when multiplexed image/audio/character data is reproduced and show on video screen, the character of regeneration and sound are synchronous fully each other, and the quality that character shows is very high.
Image/audio compression of the present invention and code device comprise: image coding device, carry out compression and coding in order to the pictorial data that will represent the image that will show, and the pictorial data behind output compression and the coding, audio coding apparatus, the voice data that is used for representative is desired the sound of regenerating with pictorial data carries out compression and coding, the character data code device, be used for representative with the sound of regeneration synchronously and the character data of the character that shows of image is encoded and output encoder after character data, first multiplex machine, be used for when character data that keeps coding and sound are synchronous carrying out itself and the voice data of encoding multiplexed, and the voice data of output after multiplexed, with second multiplex machine, be used for the pictorial data behind the coding and multiplexed after voice data carry out multiplexedly, and export multiplexed pictorial data.
In the most preferred embodiment of the present invention, in first multiplex machine, the character data of coding with the voice data of coding by multiplexed, the auxiliary data as the voice data that is encoded that meets mpeg standard in auspicious.
Image/audio decoding device of the present invention comprises: the multichannel decomposer, the pictorial data of the coding that the voice data that is used to receive and encodes is multiplexed, the voice data and the character data of this coding are multiplexed, and be separated into the pictorial data of coding and the voice data of multiplexed coding, image decoding apparatus, be used for the pictorial data of isolated coding is decoded and decompress(ion), and export a picture intelligence, separator, be used for the voice data of isolated multiplexed coding is separated into the voice data and the character data of coding, the combination image device, be used for isolated character data and picture intelligence are made up, and audio decoding apparatus, be used for the isolated audio signal that is encoded is decoded and decompress(ion), and output audio signal.
According to image/audio compression-encoding device of the present invention, because character data with the voice data of coding by multiplexed to export a multiplexed voice data, and multiplexed voice data with the pictorial data of coding by multiplexed, character data and pictorial data are compressed independently of each other, even if thereby the compressibility factor of pictorial data is very high, character data can not produce big distortion yet.Further because character data with the voice data of coding by multiplexed, when regeneration, will keep correctly synchronous between the character of demonstration and sound (melody in Karaoke).
Fig. 1 is the block diagram of image/audio compression of the present invention and code device and image/audio decoding device; And
Fig. 2 is the structure according to the audio data frame of the coding of mpeg standard.
Referring to Fig. 1, code device 7 comprises that 1, one of a picture coding unit comprises the audio coding unit 2 of compressed/encoded part 3 and data multiplex part 4, and character/colouring information generation part 5 and a multiplexed unit 6 are described below.
Below each square is explained.
In code device 7, picture coding unit 1 is according to a kind of known coding rule, and mpeg encoded rule is for example compressed and encoded picture intelligence.Audio coding unit 2 carries out compression and coding according to same coding rule to audio signal.After this 2 pairs of audio coding units carry out the character/color data that is illustrated multiplexed.In the following explanation, suppose and adopt the mpeg encoded rule as coding rule, though the present invention is not limited to adopt this.
The compressed/encoded part 3 that is included in the audio coding unit 2 is carried out compression and coding to audio signal as mentioned above, and 4 pairs of character/color data by the coding of character/colouring information generation part 5 outputs of data multiplex part are carried out multiplexed with the voice data of being encoded by compressed encoding part 3.When adopting the mpeg encoded rule, by the ancillary data area in the Frame that character/colouring information is write the voice data of representing mpeg encoded, the voice data of multiplexed coding and character/colouring information.
Colouring information as used herein refers to the information that the part of certain in character display character color need change on indicator screen.
Character/colouring information generation part 5 generates the character/color data of coding from the text message of the Karaoke of input.Multiplexed unit 6 will be undertaken multiplexed by the pictorial data of the coding of picture coding unit 1 output and the character/color data of audio coding unit 2 outputs according to the mpeg encoded rule.
On the other hand, in decoding device 15, demultiplex unit 8 will by output in the code device 7 through multichannel multiple and data separating be the pictorial data of coding and the voice data of coding.The 9 pairs of pictorial data by demultiplex unit 8 isolated codings in image decoding unit are decoded and decompress(ion).10 of audio decoding units are to being decoded and decompress(ion) by the audio signal of demultiplex unit 8 isolated codings.
Be provided at the data separating part 11 on the audio decoding unit 10, will be separated into the character/color data of coding and the voice data of coding from the multiplexed character/color data of the voice data of the coding of demultiplex unit 8 output.12 pairs of voice datas by data separating part 11 isolated codings of decoding/decompress(ion) part are decoded and decompress(ion).
Character/13 pairs of characters of colouring information regenerating section/color data regeneration character/color data through data separating part 11 isolated codings.14 of the synthetic parts of group of picture will be made up by the picture intelligence of image decoding unit 9 outputs and the character/color data of character/colouring information regenerating section 13 outputs.
Then, will make specific description to the operation of said system.
Picture intelligence, audio signal and text message be input coding device 7 respectively.Picture intelligence input imagery coding unit 1.This signal by predetermined coding rule for example the mpeg encoded rule carry out compression and coding, and deliver to multiplexed unit 6, as the pictorial data of coding.
Audio signal is transfused to audio coding unit 2.It in audio coding unit 2 according to the mpeg encoded rule be compressed/coded portion 3 carries out compression and coding, and outputs to the data multiplex part 4 of next stage.
In addition, text message is transfused to character/colouring information generation part 5, and is converted into the character/color data behind the coding, and outputs to data multiplex part 4.
As shown in Figure 2, the information that data multiplex part 4 produces is when adopting the mpeg encoded rule, be written into the stem of mpeg audio Frame, also have, in data multiplex part 4, by the voice data of the coding of compressed/encoded part 3 output be written into frame in subsequently audio data region, and the character/color data of the coding of character/colouring information generation part 5 outputs is written into ancillary data area subsequently.
Character/the color data that writes the coding of ancillary data area comprises the color data of the character code and the text position that the expression character color changes of expression Kara OK songs text.The audio signal of the coding of expression text melody and corresponding to the data of the text position of this melody, its change color is utilized they are write in the same frame, is carried out multiplexed.
The voice data of the coding that is produced by data multiplex part 4 is admitted to multiplexed unit 6 as shown in Figure 2.In multiplexed unit 6,,, carry out multiplexed according to the mpeg encoded rule by the pictorial data of the coding of picture coding unit 1 output with by the voice data of the coding of audio coding unit 2 outputs.
The multiplexed image of code device 7 output and voice data are by communication line or be transfused to decoding device 15 as the CD-ROM recording medium.In decoding device 15, the data by multiplexed of input are separated into the pictorial data of coding, the character/color data of coding and the voice data of coding.
Pictorial data through demultiplex unit 8 isolated codings is input to image decoding unit 9, and the voice data of isolated coding is input to audio decoding unit 10.In image decoding unit 9, the decoded and decompress(ion) of the pictorial data of the coding of input is reduced to picture intelligence.
In audio decoding unit 10, the character/color data that is separated into the voice data and the coding of coding by the voice data of multiplexed coding by data separating part 11 of input.The voice data of separated coding is decoded and decompress(ion) through decoding/decompress(ion) part, is reduced to audio signal.And the character/color data of coding is reduced to the song text synchronous with melody through character/colouring information regenerating section 13 decodings.
Character/color image regenerating section 13 produces based on the character pattern of regeneration character code and controls this character pattern, thereby determines the position that character color changes according to colouring information.This change in color is synchronous with the sound of the song melody of expression regeneration.
Be combined in combination image part 14 by the picture intelligence of image decoding apparatus 9 outputs with by the text message that character/colouring information regenerating section 13 is exported, and be output, as the picture intelligence of Karaoke screen display.
According to the present invention, because picture intelligence and character information are encoded respectively, and they are to regenerate respectively and make up, and issuable character distortion and character color defective have been avoided when pictorial information is compressed with character information, thus the character that demonstration is easy to read.Also have and since the character/colouring information of coding is a voice data with coding carry out multiplexed, very easy obtain that sound and character color change fully synchronously.
Claims (8)
1. an image/audio compresses and code device, comprising:
Image coding device is used to compress the pictorial data of wanting displayed image with coded representation, and exports this compression and coding image data;
Audio coding apparatus is used to compress the voice data of the sound that will play with pictorial data with coded representation;
The character data code device is used to encode with the character data of the synchronous character that shows with image of indicating of sound, and exports the character data of this coding;
First multiplex machine, when maintenance and sound are synchronous, the character data of multiplexed coding and the voice data of coding, and export this multiplexed voice data; And
Second multiplex machine, the pictorial data of multiplexed coding with by multiplexed voice data, and export this multiplexed pictorial data.
2. image/audio compression according to claim 1 and code device is characterized in that above-mentioned pictorial data and above-mentioned voice data are encoded by mpeg standard.
3. image/audio compression according to claim 1 and code device, it is characterized in that, the character data of coding in above-mentioned first multiplex machine and the voice data of coding together, by multiplexed, as the auxiliary data in the audio frame of the coding of mpeg standard definition.
4. image/audio compression according to claim 1 and code device, it is characterized in that, it is used with a Caraok device with display and loud speaker, thereby when the voice data of above-mentioned coding when loud speaker is exported, the pictorial data of above-mentioned coding and the character data of above-mentioned coding are presented on the screen.
5. image/audio decoding device comprises:
The multichannel decomposer is used to the multiplexed coding image data of voice data that receive and encode, and its multichannel is decomposed into the pictorial data of coding and multiplexed coding audio data, and wherein Bian Ma voice data is multiplexed with character data;
Image decoding apparatus with the coding image data of decoding and this multichannel decomposition of decompress(ion), and is exported a picture intelligence;
Separator is used for multiplexed coding audio data is separated into the voice data and the character data of coding;
The combination image device is used to make up the character data and the picture intelligence of separation; And
Audio decoding apparatus is used to decode and coding audio data that this multichannel of decompress(ion) is decomposed, and exports an audio signal.
6. image/audio decoding device according to claim 5, it is characterized in that, voice data in the voice data of the coding after multiplexed and character data are undertaken multiplexed by the ancillary data area in the audio data frame of encoding of mpeg standard definition.
7. image/audio decoding device according to claim 5 is characterized in that, the pictorial data of above-mentioned coding and the voice data of above-mentioned coding are decoded according to mpeg standard.
8. image/audio decoding device according to claim 5, it is characterized in that, it and have display and use with the Caraok device of loud speaker, thereby, above-mentioned picture intelligence and above-mentioned character data that above-mentioned combination image device is made up are presented on the display, export the above-mentioned audio signal that above-mentioned separator separates from loud speaker simultaneously.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP7264813A JPH0984008A (en) | 1995-09-19 | 1995-09-19 | Coder and decoder for image and sound signal |
| JP264813/95 | 1995-09-19 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1152843A true CN1152843A (en) | 1997-06-25 |
Family
ID=17408576
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN96112856A Pending CN1152843A (en) | 1995-09-19 | 1996-09-19 | Image/audio coding and decoding device |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JPH0984008A (en) |
| CN (1) | CN1152843A (en) |
| TW (1) | TW310517B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102123297B (en) * | 2003-08-20 | 2013-01-02 | 韩国电子通信研究院 | System and method for digital multimedia broadcasting |
| CN103268763A (en) * | 2013-06-05 | 2013-08-28 | 广州市花都区中山大学国光电子与通信研究院 | Wireless media system based on synchronous audio extraction and real-time transmission |
| CN104681033A (en) * | 2013-12-02 | 2015-06-03 | 联想(北京)有限公司 | Information encoding and decoding methods and electronic equipment |
| CN111913593A (en) * | 2020-08-06 | 2020-11-10 | 聚好看科技股份有限公司 | Media data searching method and display equipment |
-
1995
- 1995-09-19 JP JP7264813A patent/JPH0984008A/en not_active Withdrawn
-
1996
- 1996-09-14 TW TW085111259A patent/TW310517B/zh not_active IP Right Cessation
- 1996-09-19 CN CN96112856A patent/CN1152843A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102123297B (en) * | 2003-08-20 | 2013-01-02 | 韩国电子通信研究院 | System and method for digital multimedia broadcasting |
| CN103268763A (en) * | 2013-06-05 | 2013-08-28 | 广州市花都区中山大学国光电子与通信研究院 | Wireless media system based on synchronous audio extraction and real-time transmission |
| CN103268763B (en) * | 2013-06-05 | 2016-03-02 | 中山大学花都产业科技研究院 | A kind ofly to extract and the wireless image-sound system of real-time Transmission based on isochronous audio |
| CN104681033A (en) * | 2013-12-02 | 2015-06-03 | 联想(北京)有限公司 | Information encoding and decoding methods and electronic equipment |
| CN111913593A (en) * | 2020-08-06 | 2020-11-10 | 聚好看科技股份有限公司 | Media data searching method and display equipment |
| CN111913593B (en) * | 2020-08-06 | 2023-07-18 | 聚好看科技股份有限公司 | Media data searching method and display device |
Also Published As
| Publication number | Publication date |
|---|---|
| TW310517B (en) | 1997-07-11 |
| JPH0984008A (en) | 1997-03-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1326449B1 (en) | Data decoding method and decoding system | |
| USRE40829E1 (en) | Method for encoding and decoding moving picture signals | |
| KR950002453A (en) | Digital high definition television receiver | |
| MY121290A (en) | Image decoding method and apparatus. | |
| KR100284613B1 (en) | How to create and transmit extended interactive multimedia information | |
| WO2006137425A1 (en) | Audio encoding apparatus, audio decoding apparatus and audio encoding information transmitting apparatus | |
| CN1167281C (en) | Secondary picture coding device and method thereof | |
| EP0989563A3 (en) | Multimedia information coding apparatus, coding method of multimedia information, and recording media storing data coded by the same method | |
| JPH06314092A (en) | Recording and reproducing device for character image | |
| JP3132184B2 (en) | Image data recording / reproducing device | |
| CN1152843A (en) | Image/audio coding and decoding device | |
| US6577256B2 (en) | Image-coding apparatus and image-coding method, data-coding apparatus and data-coding method, data-recording apparatus and data-recording medium | |
| EP0949819A1 (en) | Method of encoding image information, its encoder, its decoding/synthesizing method, its decoder/synthesizer and recording medium on which those methods are recorded | |
| JPH08241068A (en) | Information recording medium, device and method for decoding bit map data | |
| JPH0946630A (en) | Image information recorder, image information reproducing device and optical disk | |
| CN1310238C (en) | Transmission of a digital information signal having M bit PCM samples | |
| CN1148975C (en) | MPEG start code compatible overlay graphics encoding | |
| JPH11262009A (en) | Device for reproducing video signal | |
| JPH10294943A (en) | Video signal encoding system, video signal encoder, video signal decoding system and video signal decoder | |
| CN1531818A (en) | System and method for encodnig information into video signal | |
| KR100215447B1 (en) | Wide screen image selective encoding method and apparatus | |
| JP3222876B2 (en) | Image encoding method, image encoding device, and recording medium recording image encoding program | |
| JPH05250813A (en) | Recording medium and system for recording and reproducing its information | |
| US20030081146A1 (en) | Optical encoding of audio data | |
| KR960038737A (en) | General paper recording / playback method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C06 | Publication | ||
| PB01 | Publication | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |