JP2002300434A - Program transmission system and device thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a new program transmission system, which can reduce production cost of broadcast programs and corresponds to a shortage of performer, such as qualified announcer or the like. SOLUTION: Image and acoustic data are outputted from an acoustic conversion means for converting a news script data into voice and a character image- compositing means for CG compositing character images, and are used to create a broadcast program while an announcer on virtual space is allowed to appear. The character image data is outputted, after adjusting the impression on his/her lips according to the outputted voice, so that a sense of natural audio-visual can be given to TV viewers. In addition, the news script data is prepared, by editing a reporter data (script) sent from a site reporter through a station editing system, and the kind of character or voice can be selected, according to the contents of news or as TV viewers desired.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an automated news program production, and more particularly, to a production cost reduced by using a voice synthesized by a text-to-speech conversion system and a character image synthesized by a CG technology. The present invention relates to a program transmission system and a program transmission device used for the system.

[0002]

2. Description of the Related Art Conventionally, a news program is composed of a news manuscript prepared in advance by an editor belonging to a broadcasting station,
An announcer sitting on the caster seat of the news studio reads it out, shoots it with a TV camera, creates a video with audio, and combines it with the news material video created in advance and keying it as necessary, producing it It had been.

[0003]

However, an announcer is required to have a skill to read a news manuscript at a proper speed and with a clear pronunciation, and in order to train an announcer having such a skill, a broadcaster must provide the announcer. Not only do you have to pay a considerable amount of time and money, but the news content spans a wide variety of genres,
In order to communicate the news with appropriate expressions such as expressions and inflections according to the news content, the announcer must
It is necessary to have a certain level of knowledge and culture, such as a proper understanding of each news content in charge. Furthermore, since the audience rating of a news program depends in part on the viewer's preference for the announcer, the announcer must have the appearance and tone that can be highly favored by the general audience. From the broadcasting station and news program production side, it is not always easy to adopt and train announcers with the above qualities, and to establish a system that can always be assigned to each news program. .

Further, it is expected that the number of news programs will increase in the future due to an increase in the number of channels and diversification of news programs such as community-based programs, and the necessary number of announcers with sufficient qualities will be secured. It is predicted that this will be more difficult than at present, and that the cost of producing each news program will need to be further reduced.

Therefore, there is a need for a new news program production system that can reduce the production cost of news programs and can cope with the shortage of announcer personnel with sufficient qualities and the like.

The present invention has been made in view of the above-mentioned conventional problems or problems, and has an object to reduce the production cost of a broadcast program and to cope with a shortage of human resources of performers such as announcers having sufficient qualities. An object of the present invention is to provide a new program transmission system and a program transmission device used for the same.

[0007]

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and has as a program transmission system an audio synthesizing means for generating audio based on manuscript data of a broadcast program;
Character image generating means for generating an image of a cast of a program; and control means for synchronizing and outputting the sound output from the voice synthesizing means and the movement of the character image output from the character image generating means. The character image output and the sound output are converted into a television signal and broadcast. This broadcasting system includes lip expression data and character image data for adjusting the lip expression of the character image in accordance with the output audio, and the character image data is modified based on the lip expression data in accordance with the original data. Character image synthesizing means for synthesizing the character image to which the application is added, and image sound synthesizing means for synthesizing the sound output from the sound converting means and the character image output from the character image synthesizing means in synchronization, A program transmission system characterized in that a sound and a character image output from the image and sound synthesizing means are converted into a television signal and broadcast. The present invention also provides, as a program transmission device, a receiving unit for receiving article data transmitted by a local reporter, a video data storage unit for storing video data transmitted from the local site, and a news manuscript data by editing the article data. An in-station editing system, a character image generating means for generating a character image of an announcer based on news manuscript data by computer graphic operation, a voice synthesizing means for generating a voice of a CG announcer based on news manuscript data, Control means for synchronizing and outputting the sound output from the sound synthesizing means and the movement of the character image output from the character image generating means; Radio wave oscillating means.

The manuscript data according to the present invention is composed of text data such as text format constituting news content read out by a character which plays the role of an announcer in the present invention, and voices such as tone, pitch, speed, etc. outputted as necessary. Control data for designating a type or an expression type such as emotions and sorrows indicated by a character image is added. The document data that constitutes the manuscript data is created by editing article data created from information obtained by a news reporter contacting a news source, etc., in a form suitable for broadcasting as a news program. The control data is added at the time of editing according to the content of the news.

The voice synthesizing means is for synthesizing a voice uttered by a person from the document data constituting the original data. Preferably, the voice synthesizing means includes:
It has functions to adjust tone, pitch, speed, etc.

The character image synthesizing means, for example, generates character image data created based on a photographed image of a real person, an animation, and the like, and a mouth portion of the character image for each sound to be pronounced based on CG technology. A character image having lip expression data for modifying the character image, adding a modification for each voice to the character image, or further adding a modification corresponding to the expression type such as the above-mentioned emotions and sorrows if necessary. Output function.

[0011] The sound output from the sound converting means and the character image output from the character image synthesizing means are synchronously synthesized by the image sound synthesizing means, converted into a television signal and broadcast to a general audience.

According to the present invention, the manuscript data is converted into voice by the voice synthesizing means and outputted, and at the same time, a CG synthesized character image is provided as an image, so that a news manuscript is read out by an actual announcer. It can give viewers the same viewing experience as a news program, which makes it necessary for broadcasters to always have announcers who require a certain level of skill and qualities for each program. This can be eliminated or reduced, and costs such as labor costs and human resource education costs can be reduced.

The document data according to the present invention can also be created by editing an article data transmitted from a local personal computer carried by a reporter via a communication network by an in-house editing system.

[0014] The article data is usually created by a reporter going to a location in Japan or overseas where the content of the article such as a news source exists. By inputting the article data collected on a portable local PC and transmitting it to a broadcasting station via a communication network, it is possible to improve the efficiency of news article transmission, and also installed in the station, For example, an in-station editing system that has the function of converting textual article data into spoken language suitable for the broadcast of the program can further reduce costs such as labor costs by mechanically creating manuscript data from article data. It is also possible.

Further, the program transmission system of the present invention comprises a video / audio storage means such as a VTR or a CD for storing video data, and a video switcher for synthesizing a plurality of images.
And providing a news program with a high sense of reality by keying and synthesizing the news video from the VTR means to the voice and character image synthesized by the image and voice synthesizing means by the video switcher and converting it into a television signal. Becomes possible.

Further, the character image synthesizing means of the present invention includes a plurality of character images, and can be configured to select a character image according to news content and output the character image. A character image having an image corresponding to the content can be selected, and the favorable impression received by the viewer can be further improved.

Further, in the case of a program transmission system based on the two-way communication function, a character selection signal desired by the viewer is received from a receiver having the two-way communication function, and a character corresponding to the viewer's request is received. It is also possible to compose a broadcast program using images, and thereby, it is possible to realize a broadcast program provided by a character image having an image adapted to the sensibility of each viewer.

[0018]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing an example of a news broadcast system which is an embodiment of a program transmission system according to the present invention.

In FIG. 1, reference numeral 1 denotes a local personal computer carried by a local reporter who reports at a news site, and a word processor function for writing and recording the contents of articles collected by the local reporter, mobile communication, a public telephone line, and the Internet. And has a modem function for connecting to a communication network 2 such as a personal computer. Article data created by a reporter on a local PC at a news source or the like is directly connected to the local PC 1 or to a communication device such as a mobile phone 3. Thereby, it is transmitted to a broadcasting station via the communication network 2.

A broadcasting device in a broadcasting station includes a communication control unit 4 for controlling a communication operation with the communication network 2 and an in-station for receiving article data transmitted from the local PC 1 and editing a broadcast manuscript such as news. An editing system 5, a CG announcer generator 6 as a character image generating means for generating an image of a program performer such as an announcer by a computer graphic function,
A background video generating device 7 for generating a background video corresponding to the news program, a video synthesizing unit 8 for synthesizing the CG announcer video and the background video, and a voice synthesizing unit 9 for generating a sound of the CG announcer. Have. The broadcasting device includes a video / audio storage unit 10 for storing video data and audio data transmitted from the local personal computer 1, a telop generation unit 11 for generating a telop inserted in a video being broadcast, and a video synthesis unit. 8, a video switcher 12 that switches video data and audio data from a video / audio storage unit 10 or a telop from a telop generation unit 11 with respect to the video synthesized with the video / audio storage unit 10, An audio mixer 13 for inserting the audio data from the audio storage unit 10 and a master system 14 for synchronizing the video output from the video switcher 12 and the audio output from the audio mixer 13 and transmitting them as television broadcast radio waves. ing. In FIG. 1, reference numeral 15 denotes a television camera, which performs an imaging operation for a normal television broadcast, and the captured image can be synthesized by the image synthesizing unit 8. Reference numeral 18 denotes a system control unit that controls the overall operation of the broadcasting device in the broadcasting station.

The in-station editing system 5 is provided after an editor in charge of the station or a computer having an editing function sorts and sorts article data transmitted from the local personal computer 1 as appropriate and classifies data. , The style and the amount of text (the number of characters) are edited into a format suitable for reading out a news program. The in-station editing system 5 preferably further includes base voice selection data for specifying the base voice of the voice output from the voice synthesis unit 9 and voice for selecting and specifying the voice tone, high / low, and speed according to the type of news. It has a modification program as software, and has character selection data for specifying the type of character image output by the CG announcer generator 6;
The software has a character modification program for selecting and specifying hand gestures. The control data generated or processed by each modification program is added to video data and audio data to create news manuscript data. It is sent to the synthesizing unit 8 and the voice synthesizing unit 9.

The CG announcer generator 6 and the background generator 7 have an image database 6a for storing image data necessary for each operation. This image database 6a adjusts the facial expression of the mouth of the character image according to the video of a model person or the character image data created based on the animation and the output sound for the CG announcer generator 6. For the background generator 7 and image data for generating various background images. Here, the lip expression data includes parameters for modifying the character image data so as to reproduce, on the character image, typical lip movements at the time of pronouncing each voice constituting Japanese by CG technology. It is composed of

The CG announcer generator 6 includes an in-station editing system 5 in addition to the basic character image data.
In accordance with the text information of the news manuscript data received from the user, the lip expression data necessary at any time is stored in the image database 5.
a, and adjusts and outputs the character image data based on the lip expression data, thereby outputting a character image in which the voice output from the voice synthesizer 9 appears as if the character sounds naturally. Things.

Also, the CG announcer generator 6 operates based on the character modification program received from the in-station editing system 5 so that the character performs more natural facial expressions, gestures, and hand gestures.
Further, it may be configured to output modified character image data.

Furthermore, the image database 6a can include a plurality of character image data and lip expression data corresponding to each character image data.
The CG announcer generator 6 uses the character image data selected based on the character selection data received from the in-station editing system 5 or, in the case of a bidirectional reception system, from a receiver having a bidirectional communication function. It is also possible to output character image data obtained by modifying this.

The speech synthesizer 9 applies a plurality of base sounds sampled from a plurality of men and women, respectively.
It has a voice database 9a in which all the voices constituting Japanese, which are the 50 sounds of "Aioe ..." plus a muddy sound, are filed and stored for each base voice. Then, based on the text information of the news manuscript data, the voice synthesizing unit 9 sequentially extracts necessary voices from a file in the voice database 9a in which the base voice specified by the base voice designation data is stored, and synthesizes a voice signal. By doing so, it has a function of converting news manuscript data into audio. At this time, by adjusting the tone, height, speed, etc. of the synthesized voice signal on a computer based on the voice modification program, a more natural and expressive news voice can be obtained.

The video / audio storage unit 10 functions as an external auxiliary storage device for storing video data and audio data,
It has a role and is constituted by a storage medium such as a VTR 16 or a CD 17. In addition, a storage medium with a larger capacity such as a hard disk or a DVD can be used.

The operation of broadcasting a news program in a broadcasting system having such a configuration will be described.

First, article data created by a reporter on a local PC 1 at a news source or the like is broadcast via a communication network 2 by the local PC 1 directly or by connecting to a communication device such as a mobile phone 3. Sent to the station. In addition, the video of the site photographed by the reporter or the cameraman is also transmitted to the broadcasting station via the communication network 2. In the broadcasting station, under the control of the system control unit 18, the received article data is taken into the in-station editing system 5, while the video is stored in the VTR 16 or the CD 17 of the video / audio storage unit 10.

Thereafter, the program creator of the broadcasting station edits the article data using the in-station editing system 5 to create news manuscript data. At this time, the news manuscript data and the video (photographed video) stored in the video / audio storage unit 10 and corresponding to (or related to) the news manuscript are linked. In this editing work, a decision is made as to whether a person who reads a news manuscript in a news program is a real announcer or a CG announcer, and if it is a CG announcer, a selection is made as to which CG announcer to use, CG
When an announcer is used, character image and voice data relating to the CG announcer are also incorporated in the news manuscript data.

When a CG announcer is used and a broadcast of a news program starts, the system control unit 1
8, various control signals for performing the broadcast are output,
Also, news manuscript data is transmitted from the in-station editing system 5. Then, the CG announcer data is sent to the CG announcer generator 6, and the audio data is sent to the audio synthesizer 9. Further, a control signal for generating a background image is sent to the background generation device 7.

The CG announcer generator 6 is a person (CG announcer) designated from the image database 6a.
Or the CG announcer's lip expression data for adjusting the lip expression of the CG announcer in accordance with the output audio, and performs predetermined processing to output video data. Here, the predetermined processing is C
With G technology, the typical movement of the mouth when pronouncing each of the sounds that compose the Japanese language is reproduced on the character image, as if the CG announcer was reading the manuscript or commenting on the news, This is a process for modifying character image data. In addition, the CG announcer generating device 6 performs, as part of the processing, based on the character modification program received from the in-station editing system 5 such that the character performs an operation such as a more natural expression, gesture, or hand gesture. Further, modified character image data can be output.
The background generation device 7 generates a background image suitable for the background of the CG announcer as the image of the news program.

The voice synthesizing section 9 reads out the specified voice data from the voice database 9a, performs a predetermined voice synthesis process to generate voice of the CG announcer, and outputs the voice data. Then, the speech synthesizing unit 9 converts the news manuscript data into speech based on the text information of the news manuscript data in the speech synthesis processing. At this time, by adjusting the tone, height, speed, etc. of the synthesized voice signal on a computer based on the voice modification program, a more natural and expressive news voice is obtained. The output from the voice synthesizing unit 9 is sent to the voice mixer 13 and mixed with another voice, for example, a sound effect or background music, and is output as overall voice data.

The output from the video synthesizing unit 8 is sent to a video switcher 12. In the video switcher 12, should the video of the CG announcer be transmitted as the video to be broadcast, the video of the news site from the video / audio storage unit 10, or the telop video from the telop generator 11? Is determined by a control signal from the system control unit, and a process of selecting an output video signal is performed.

After performing these processing operations, output signals from the speech synthesizer 9, the CG announcer generator 6 and the background generator 7 are sent to the master system 14,
The broadcast master system 14 transmits the broadcast radio wave.

[0036] Thus, when it is difficult to always deploy the program in a station or when it is desired to reduce the cost of producing a program, it is possible to use an actual announcer without using an actual announcer.
A virtual announcer created by the voice synthesizing unit 9 and the CG announcer generator 6 is displayed as a video, and the virtual announcer distributes news with a natural tone and operation expression that does not differ from a real announcer. A broadcast system for programs can be constructed.

It should be noted that the present program transmission system uses a VTR 16 or CD 1 for storing news video data shot in advance.
7 and a video switcher 12 for switching a plurality of images, the video signal synthesized by the video synthesizing unit 8 and the news video stored in the VTR 16 or the like are
By appropriately switching and outputting using the video switcher 7, it is possible to broadcast an actual news video, and it is possible to provide a program transmission system with a higher sense of reality.

Further, in the above-mentioned image database 6a,
Further, it is also possible to store studio image data obtained by reproducing a set in the studio, and to output the character image data obtained by superimposing the studio image data as the background of the character image by the video synthesizing unit 8. Thereby, it is possible to convey the atmosphere peculiar to the news program to the viewer.

In this embodiment, when the CG announcer is not used, a real announcer appears in front of the television camera 15 to take a picture of the announcer reading a manuscript or explaining the news. While broadcasting a news program.

In the above embodiment, a news program is described as a broadcast program. However, the present invention can be applied to various broadcast programs such as a news commentary program, a document program, a talk-type program, and a political broadcast. it can. In particular, the program transmission system according to the present invention has an advantage that the cost can be reduced by reducing the number of people who appear in the program. However, the present invention is not limited to this. C equivalent to the above CG announcer about people
G performers can be generated and broadcast, and problems and problems in a busy society like today can be solved.

The CG announcer generator 6 has a plurality of CG announcers, and the audio in the audio synthesizer 7 can also generate a plurality of types of audio data. Can be bidirectionally communicated so that the viewer can select the CG announcer and the voice according to his / her preference.

[0042]

As described above, according to the present invention, all or a part of a program such as news using a real performer who is difficult to always deploy in a station is converted into a voice synthesizing unit and a character image synthesizing unit. Means for delivering a program with a natural motion expression that does not differ from a real performer in the virtual person image created by the means, thereby reducing the production cost of the broadcast program and increasing the viewing / listening Broadcasting using characters and sounds that can give a favorable impression to the user becomes possible.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing one embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 1 local PC 2 communication network 3 mobile phone (communication device) 4 communication control unit 5 local editing system 6 CG announcer generator 6a audio database 7 background generator 8 video synthesizing unit 9 audio synthesizing unit 9a audio database 10 video / audio storage unit DESCRIPTION OF SYMBOLS 11 Telop generator 12 Video switcher 13 Audio mixer 14 Master system 15 Television camera 16 VTR 17 CD 18 System control part

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 7/173 610 G10L 3/00 QS F term (Reference) 5C022 CA03 5C023 AA11 AA34 AA37 BA11 CA01 5C064 BB10 BC16 BC20 BD07 BD08 5D045 AB26

Claims (8)

[Claims] 1. A voice synthesizing unit that generates audio based on manuscript data of a broadcast program, a character image generating unit that generates a video of a cast of the program, a voice output from the voice synthesizing unit, and the character image. A program transmission system comprising: control means for synchronously outputting the movement of a character image output from a generation means; and converting the character image output and the audio output into a television signal for broadcasting. 2. The in-station editing system further includes an in-station editing system, wherein the manuscript data of the broadcast program is composed of article data transmitted from a local personal computer carried by a local reporter to the in-station editing system via a communication network. 2. The program transmission system according to claim 1, wherein the original data of the broadcast program is created by editing. 3. A video data storage means for storing video data collected, and a video switching means for switching the output of video data, wherein the character image output by the character image generation means and the video data from the video data storage means are provided. The program transmission system according to claim 1, wherein a video signal is selectively switched by a video switching unit and converted into a television signal. 4. The character image generating means comprising a plurality of character image data, and outputting a character image obtained by adding a modification to character image data selected according to a program content.
4. The program transmission system according to any one of claims 1 to 3. 5. A receiving apparatus for receiving a character selection signal from a receiver having a two-way communication function, wherein the character image generating means includes a character selected based on the character selection data received by the receiving means. The program transmission system according to claim 4, wherein a character image obtained by adding a modification to the image data is output. 6. The article data according to claim 2, wherein the article data is an article created by news gathering, and wherein the in-station editing system creates news manuscript data by editing the news article data. Program transmission system. 7. The character image generating means includes a plurality of character image data, and outputs a character image obtained by adding a modification to character image data selected according to news content. 3. The program transmission system according to 1. 8. A receiving means for receiving article data transmitted by a local reporter, a video data storage means for storing video data transmitted from the site, and an in-office editor for editing the article data to create news manuscript data. System, character image generating means for generating a character image of an announcer based on news manuscript data by computer graphic operation, voice synthesizing means for generating a voice of a CG announcer based on news manuscript data, and output from the voice synthesizing means Control means for synchronizing and outputting the sound to be output and the movement of the character image output from the character image generation means; and broadcast radio oscillation means for converting the character image output and the audio output into a television signal for broadcasting. A program transmission device, comprising: