JP2003199076A - Method and system for providing user assistant service for content distribution - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method for providing user assistant service for content distribution for distributing the inexpensive processed content obtained by processing content such as a movie, etc., to a user who needs assistance because of impaired sight or hearing. <P>SOLUTION: The method comprises a step of registering the name of a specified content transmitted from a user's terminal and the details of assistance according to the content in a management server 31, a step of requesting a content distribution server to distribute the content by the server 31, a step of distributing the content distributed from the content distribution server and the details of assistance to a processing server 32, a step of processing the content into the details of assistance by the server 32, and a step of distributing the processed content to the user's terminal via the server 31. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a content distribution system for performing various information distribution services such as content distribution services for movies, music, dramas, news and sports and live distribution services for distributing live broadcasts, and particularly A method and system for providing a user assistant service for content distribution, in which the content desired by a user who is deaf or hard of hearing and the user who wants to support another language is processed into a desired assist level and the processed content after processing is delivered to the user. Related to the technical field of.

[0002]

2. Description of the Related Art When a user who has a physical disability and needs assistance receives a content distribution service, at present, only a limited number of contents can be provided. People with visual impairments request audio information or Braille information, and people who are deaf or the elderly want to watch video dramas on video screens with subtitles. People want to support the provision of information in other languages.

[0003] In order to respond positively to such a demand, for the currently deaf and hearing impaired, the eyes provide information such as voice in Braille, and the ears provide image information by sign language or subtitles. It is well known that foreigners are provided with specific information such as information support in other languages.

[0004]

However, there are people who are blind or deaf and need assistance, elderly people who are hard of hearing, and foreigners who need support in other languages. However, most of the distribution services cannot be received except for a limited number of contents such as contents distribution services for movies, music, news, etc. using the recent Internet or live distribution services for live broadcasting.

[0005] However, there is a strong desire to use the content distribution service from users who need assistance with Braille or subtitles and users who want support for other languages, but it is difficult to realize because the production cost is high because the demand is small. there were.

The present invention has been made in view of the above circumstances. In a content distribution system for distributing various media information, an existing content distribution is provided by a content assistant center and various servers provided in the content assistant center. Process the content distributed from the server or live broadcasting service of live broadcasting, and distribute the processed low-cost processed content to the user who needs the assistance due to the sight or hearing loss and the user who needs other language support. The present invention aims to provide a method and system for providing a user assistant service for content distribution.

[0007]

In order to achieve the above object, a method for providing a user assistant service for content distribution according to the present invention is to provide a name of a specific content and an assist content corresponding to the specific content sent from a user terminal to a management server. To the processing server, the management server requests distribution of specific content corresponding to the registered specific content name to the content distribution server, and the management server sends the specific content distributed from the content distribution server and the assist content to the processing server. Distributing step, the processing server processing the specific content distributed from the management server into assist content, and the processing server distributing the processed specific content to the user terminal via the management server. And

The user assistant service providing method for content distribution of the present invention uses a network based on an IP network and / or a dedicated network for content distribution to distribute content such as movies, music, dramas, news and sports, and live relay. In a content distribution system for performing various information distribution services such as a live distribution service for distributing content, a content assistant center has a management server and a processing server, and the management server receives the content distribution service. For the user who has accessed for this purpose, the process of obtaining and registering the name of the desired specific content and the assist content for the specific content from the user and registering the content are provided to the content distribution center that provides various information distribution services. For the process of accessing and requesting the distribution of the specific content desired by the user, and for the processing server processing the specific content obtained by the distribution request, the processing of the assist content desired by the user for the specific content to be sent is performed for the processing server. The process includes a step of issuing a processing command to process the condition, and a step of delivering the processed content processed by the processing server to the registered user. The processing server is instructed by the management server to process the specific content received from the management server. It is characterized in that it comprises a step of processing under the modified processing conditions and a step of sending the processed content after processing to the management server.

Further, in the present invention, in the method for providing a user assistant service for content distribution, the processed content is extracted by the processing server from the video information of the distributed content, and the extracted audio signal is extracted. It is characterized by comprising a step of converting a text signal by voice recognition software and a step of subjecting the converted text signal to captioning on a video, and delivering the captioned video information after processing to the user.

The present invention also provides the method of providing a user assistant service for content distribution, wherein the processed content is extracted by the processing server from a video information of the distributed content, and the extracted audio signal is extracted. It consists of a step of processing into a headset hearing aid audio signal and a step of processing into video information containing the processed headset hearing aid audio signal, and the processed headset hearing aid audio signal functional video information is delivered to the user. It is characterized by

Further, in the method for providing a user assistant service for content distribution according to the present invention, the processed content includes a step of extracting an audio signal from audio information of the distributed content by the processing server, and the extracted audio signal. It is characterized in that the converted voice information with Braille signal function is delivered to the user from the step of converting into the Braille signal by the voice recognition braille translation software.

Further, in the present invention, in the method for providing a user assistant service for content distribution, the processing server extracts the foreign language audio signal from the distributed video information by the processing server, and the extracted foreign language. The process of converting a voice signal into a foreign language text signal using voice recognition software, the process of converting the converted foreign language text signal into a native language text signal, and the conversion of the translated native language text signal into video subtitles It is characterized in that the processed video with subtitles in its own language is distributed to the user.

In the method for providing a user assistant service for content distribution according to the present invention, a step of extracting, as the processed content, only a sound signal of a specific artist from the image information of the live distribution service distributed by the processing server. And a step of converting the extracted voice signal into a text signal by voice recognition software, and a step of converting the converted text signal into a caption on a video, and delivering the processed captioned video information to the user. And

[0014] With such a method and system for providing a user assistant service for content distribution, the visually impaired and the elderly who are in need of assistance and the elderly who are in need of assistance and those in foreign countries who need other language support The person can receive the desired content distribution service.

[0015]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described in detail below with reference to the drawings.

FIG. 1 is a structural explanatory diagram showing a user assistant service providing system for content distribution according to an embodiment of the present invention, and FIGS. 2 and 3 are outlines of a service providing method according to an embodiment of the present invention. 5 is a conceptual diagram of a service for explaining the above, FIG. 4 is a content distribution flowchart according to the subtitling processing step according to the embodiment of the present invention, and FIG.
FIG. 6 is a content distribution flowchart by a headset hearing aid signal processing process according to the embodiment of the present invention, FIG. 6 is a content distribution flowchart by a Braille signal conversion process according to the embodiment of the present invention, and FIG. FIG. 8 is a content distribution flowchart according to another language translation subtitling processing step according to the embodiment of the present invention, and FIG. 8 is a content distribution flowchart according to live specific artist audio subtitling processing according to the embodiment of the present invention. Figure 9
10 and 10 are processing process diagrams in the processing server according to the embodiment of the present invention. (A) is a processing process diagram for extracting audio from video and converting it to subtitles, and (b) is audio processing for extracting audio from video. Processing process diagram for processing into a headset hearing aid signal, (c) is a processing process diagram for recognizing voice and converting it into Braille signal, and (d) is processing for extracting audio from foreign video and subtitling in its own language The processing processing diagram to be performed, and the item (e) is a processing processing diagram for extracting the specific sound from the video and converting it to the caption.

1 to 3, 1 is a user and 2 is an I.
P (Internet Protocol) network, 3 content assistant center, 4 content management center, 5 live distribution service subcenter, 6 TV distribution service subcenter, 7 movie distribution service subcenter, 8 content distribution dedicated network, 9 is a mobile communication base station,
11 is an A personal computer, 12 is a B personal computer, 13 is a C personal computer, 14 is a set top box, 15 is a mobile terminal, 3
1 is a management server, 32 is a processing server, 33 is a charging server, 41 is a content distribution server, 42 is a TV station, 51
Is a live distribution server, 52 is a concert hall, 61 is T
V distribution server, 71 is a movie distribution server, and 72 is a movie theater.

First, the service concept of the service providing method and system according to the embodiment of the present invention will be described with reference to FIGS. 2 and 3.

(A) When information directly received from the TV station 42 is processed into subtitles and distributed to the user 1. The TV information transmitted from the TV station 42 via the IP network 2 is received by the content assistant center 3. , The processing server 32 provided in the content assistant center 3
To the set-top box 14 of the home communication terminal device having the TV receiving function installed in the user 1 by extracting the audio signal from the TV information received by After being transmitted, the user 1 can watch the TV information with subtitles on the TV screen.

(B) When the relayed TV station information is processed into data from the content management center 4 and distributed to the user 1, the TV information transmitted from the TV station 42 via the IP network 2 is the content management center 4 Is received by the content assistant center 3 and is delivered to the content assistant center 3 for which the delivery request has been made.
An audio signal is extracted from the TV information received by, the extracted audio signal is processed into data, for example, translated into another language, the image is discarded, and the processed audio signal is transmitted from the mobile communication base station 9 to the user 1 Is transmitted to the mobile terminal 15 possessed by, for example, a mobile phone, etc., and the user 1 can watch the TV image from the existing TV screen and the processed voice received in real time from the mobile terminal 15.

(C) When the movie information relayed from the content management center 4 is processed by voice and distributed to the user 1, the content management center 4 transmits the screening information transmitted from the movie theater 72 via the IP network 2. The processing server 32 which is received and delivered to the content assistant center 3 for which the delivery request has been made, and which is provided in the content assistant center 3.
An audio signal is extracted from the screening information received by the user, the extracted audio signal is processed into data, for example, translated into another language, the image is discarded, and the data-processed audio signal is transmitted from the mobile communication base station 9 to the user 1 The user 1 who is transmitted to the mobile terminal 15 possessed by, for example, a mobile phone, and is watching a movie in the movie theater 72, sees the image on the screen of the movie theater 72.
The processed voice received in real time can be viewed from the mobile terminal 15.

(D) When the relayed concert information is processed by voice from the content management center 4 and delivered to the user: The content management center 4 receives the concert information transmitted from the concert venue 52 via the IP network 2. Then
A voice signal is extracted from the concert information that is delivered to the content assistant center 3 that has made a delivery request and received by the processing server 32 included in the content assistant center 3, and the extracted voice signal is processed into data, for example, only the voice of a specific artist. The processed, video is discarded, and the processed voice signal of the data is transmitted from the mobile communication base station 9 to the mobile terminal 15 such as a mobile phone owned by the user 1,
User 1 watching the concert at the concert venue 52
Can watch the people in the concert from the stage of the concert hall 52, and the voice of a specific artist who receives the voice in real time from the mobile terminal 15.

Next, referring to FIG. 1, a system configuration according to an embodiment of the present invention will be described. The user A in the user 1 is a user who is deaf and needs a voice assist using a headset hearing aid, the user B is a user who is blind and needs braille assistance, and the user C is a deaf user. It is a user who is not free and needs the assistance of characters by subtitles, and each user A, B, C in the user 1 can connect to the IP network 2. IP
When receiving content distribution via the network 2, a headset Hearing Aid is connected to the user A's A personal computer 11, and a user B's B personal computer 12 can be connected to a braille interface compatible personal computer or a normal personal computer (not shown) for braille display. Then, user C's C personal computer 1
In No. 3, required information can be obtained by subtitles on the screen.

The content assistant center 3 includes a management server 31, a processing server 32, and a billing server 33, and can connect to the IP network 2 and the content distribution dedicated network 8.

The management server 31 carries out the following items.

(1) Acquisition and registration of a desired content service from the user 1 and assist contents for the content service (2) Content distribution request of the content distribution service after acquisition (3) Content processing instruction (4) of content to be distributed ) Delivery of processed content to user 1 The processing server 32 obtains the content distributed by the content distribution request, and performs the following items according to the processing command from the management server 31.

(1) Extract audio from video and process audio → voice recognition → text conversion → captioning to video (2) Extract audio from video and process audio → signal for headset hearing aid (3) Speech recognition and conversion to Braille signal (4) Extracting other language's sound from the video, other language speech → voice recognition → other language text conversion → native language text conversion → native language subtitling processing (5) Selective Extraction of Specific Audio from Multiple Audio of Video The charging server 33 performs the following items.

(1) User billing for the processing fee collected from the user 1 who has received the content distribution from the management server 31.

The content management center 4 is connected to the content assistant center 3 via the content distribution network 8.
It is equipped with a plurality of content distribution servers 41 for storing movies, music, sports information, and other various Internet information to be connected to and distributed to the live distribution service sub-center 5 via the IP network 2 and a content assistant. The TV distribution service sub-center 6 includes a live distribution server 51 for storing live music video information of a live broadcast which is connected to the center 3 and distributed.
Delivered to the content assistant center 3 via T
It has a TV distribution server 61 storing V information,
The movie distribution service subcenter 7 includes a movie distribution server 71 that stores movie information to be distributed to the content assistant center 3 via the IP network 2.

Next, referring to FIG. 1, a specific example will be described from the user requesting the content distribution service to the acquisition.

The user A in the user 1 asks the A personal computer (user terminal) 11 to process the name of a specific video drama, which is the desired content, and the audio of the video drama into a headset hearing aid audio signal for distribution. The content of the assistance to be sent is sent to the management server 31 in the content assistant center 3 via the IP network 2. The management server 3
When the content distribution request from the user A is obtained and registered, the content distribution server 41 provided in the content management center 4 via the content distribution dedicated network 8 capable of distributing the content desired by the user A or the IP network 2
TV provided in the TV distribution service sub-center 6 via
The distribution server 61 is accessed to request the distribution of the specific video drama, and the processing server 32 in the content assistant center 3 is instructed to process the audio of the specific video drama to be processed into a headset hearing aid signal. do.

The specific video drama information distributed to the management server 31 in response to the content distribution request from the management server 31 is sent to the processing server 32 for processing into the assist content desired by the user A.

The processing server 32 extracts an audio signal from the obtained video information of the specific video drama according to the processing condition command for processing the audio of the specific video drama sent from the management server 31 into a signal for a headset hearing aid. The processed audio signal is processed into a headset hearing aid audio signal by level conversion, the processed headset audio signal is embedded in the video, and processed into video information that includes the headset hearing aid audio signal, and the processed head is processed. Headset hearing aid audio signal function-equipped video information, which is specific video drama information based on the set hearing aid audio signal, is sent to the management server 31, and is distributed from the management server 31 to the user A who has made a content distribution request for registration.

Further, the assist content that the user B in the user 1 wants the B personal computer (user terminal) 12 to process the content of the specific news, which is the desired content, and the voice of the news into a braille signal for distribution. To the management server 31 in the content assistant center 3 IP network 2
To send via. When the management server 31 acquires and registers a content distribution request from the user B, the content distribution server 41 provided in the content management center 4 is accessed through the content distribution dedicated network 8 capable of distributing the content desired by the user B. Then, the user B requests the delivery of the specific news desired, and at the same time, the processing server 32 in the content assistant center 3 is instructed of the processing conditions so as to process the delivered voice of the news into a Braille signal.

The news information distributed to the management server 31 in response to the content distribution request from the management server 31 is sent to the processing server 32 for processing into the assist content desired by the user B.

The processing server 32 extracts a voice signal from the obtained voice information of the news in accordance with a processing condition command for converting the news voice sent from the management server 31 into a Braille signal, and outputs the extracted voice signal as a voice. It is converted to a braille signal by the recognition braille software, the converted braille signal is processed as news voice information, and the braille signal function voice information, which is the news information by the braille signal after processing, is sent to the management server 31. The content is distributed from the management server 31 to the user B who has made a content distribution request for registration.

Further, the user C in the user 1 gives a specific movie name, which is the desired content, from the C personal computer (user terminal) 13 and an assist content for substituting it on the video of the movie and delivering it. It is sent to the management server 31 in the content assistant center 3 via the IP network 2. When the management server 31 acquires and registers the content distribution request from the user C, the content distribution server 41 provided in the content management center 4 via the content distribution dedicated network 8 capable of distributing the content desired by the user C, or The movie distribution server 71 provided in the movie distribution service sub-center 7 is accessed via the IP network 2 to request the distribution of the movie desired by the user C, and the movie is distributed to the processing server 32 in the content assistant center 3. The processing conditions are instructed so that the subtitles are processed on the movie image.

The movie information distributed to the management server 31 in response to the content distribution request from the management server 31 is
It is sent to the processing server 32 for processing into the assist content desired by the user C.

The processing server 32 extracts an audio signal from the obtained video information of the movie in accordance with the processing condition command sent from the management server 31 to process the subtitle into the video of the movie, and outputs the extracted audio signal as a voice. The text information is converted by the recognition software, the converted text signal is converted into a caption signal for video, the converted caption signal is embedded in the video, and the video information with the caption after the processing is managed by the management server 31.
And is delivered to the user C who has made a content delivery request for registration from the management server 31.

Assist content that the user C in the user 1 wants the contents of the specific foreign movie, which is the desired content, from the C personal computer 13 and the subtitles of the foreign movie to be delivered in the native language. Is sent to the management server 31 in the content assistant center 3 via the IP network 2, and the management server 31 obtains and registers the content distribution request from the user C, and the content that the user C desires can be distributed. The foreign movie desired by the user C is accessed by accessing the content delivery server 41 provided in the content management center 4 through the delivery network 8 or the movie delivery server 71 provided in the movie delivery service sub-center 7 through the IP network 2. Of the foreign movie distributed to the processing server 32 in the content assistant center 3 The instruction of the processing conditions to be processed into the native language subtitles of.

The foreign movie information distributed to the management server 31 in response to the content distribution request from the management server 31 is sent to the processing server 32 for processing into the assist content desired by the user C.

The processing server 32 extracts a foreign language audio signal from the obtained foreign movie video information in accordance with the processing condition command for processing the foreign movie video into the native language subtitle sent from the management server 31. , Convert the extracted foreign language voice signal into a foreign language text signal using voice recognition software,
Convert the converted foreign language text signal into a native language text signal using translation software, convert the converted native language text signal into a native language subtitled signal to video, and embed the converted native language subtitled signal on the video Then, the processed movie information with subtitles in its own language is sent to the management server 31, and the management server 31 distributes the movie information to the user C who has made a content distribution request for registration.

Further, the user C of the user 1 distributes the live content, which is the desired content, from the C personal computer 13 and the audio of the specific artist in the live distribution by subtitling it on the video. Management server 3 in the content assistant center 3
1 via IP network 2. When the management server 31 obtains and registers the content distribution request from the user C, the management server 31 accesses the live distribution server 51 provided in the live distribution service sub-center 5 capable of distributing the content desired by the user C, and the user C makes a request. Content distribution center 3
The processing server 32 therein is instructed of processing conditions so that the audio of the particular artist in the live distribution delivered is captioned into video.

The live distribution information distributed to the management server 31 in response to the content distribution request from the management server 31 is sent to the processing server 32 for processing the assist contents desired by the user C.

The processing server 32 produces an audio signal from the obtained video information of the live distribution service in accordance with a processing condition command for subtitling the sound of the specific artist in the live distribution sent from the management server 31 into a video. Extracted, extracted only the audio signal of a specific artist through the filter from the extracted audio signal, converted the extracted audio signal into a text signal with voice recognition software, and processed the converted text signal into subtitles for live distribution video. The processed subtitles are embedded and processed in the live distribution video, and the processed live distribution video information with subtitles is sent to the management server 31 and is distributed from the management server 3 to the user C who has made a content distribution request for registration.

Further, the content processing fee distributed by processing the content in response to a request for distribution of various desired contents from the user is billed separately from the content assistant center 3 to the user according to the charging information accumulated in the charging server 33. .

Next, the flowchart of FIG. 4 will be described with reference to FIG.

The user C in the user 1 indicates from the C personal computer 13 via the IP network 2 that the specific content name of the drama desired to be watched and the assist level is a video drama with subtitles in the management server 31 in the content assistant center 3. Request (step S1). In the content assistant center 3, the management server 31 receives and registers a distribution request from the user C in which the specific content name and the assist level is a video drama with subtitles (step S2), and the management server 31 is provided in the content management center 4. The content distribution server 41 or the movie distribution server 71 provided in the movie distribution service sub-center 7 is accessed to request the distribution of the specific content of the video drama requested by the user C (S3 step), and the management server. 31 commands the processing server 32 to process the distributed specific content in a processing condition in which the assist level is a video drama with subtitles (S4 step). The content distribution server 41 distributes the requested video drama to the management server 31 in the content assistant center 3 (step S5), and the management server 31 sends it to the processing server 32 for processing the acquired video drama.

The processing server 32 extracts the audio signal from the video signal of the drama so that the video drama sent from the management server 31 satisfies the processing conditions for the video drama in which the assist level has the subtitles. Is converted into a subtitle and converted into a subtitle and sent to the management server 31 (S6 step). The management server 31 distributes the processed content processed into the video drama with subtitles to the user C who has requested it, and the charging server 33 charges the usage fee (S7).
Process). User C can watch the subtitled video drama distributed from the management server 31 in the content assistant center 3 via the IP network 2 on the screen of the C personal computer 13 (step S8).

Next, the flowchart of FIG. 5 will be described with reference to FIG.

User A in User 1 indicates that the specific content name and assist level of the drama he / she wants to watch is a video drama of audio output for headset hearing aid A PC 1
1 requests the management server 31 in the content assistant center 3 via the IP network 2 (step S1). In the content assistant center 3, the management server 31 receives and registers the distribution request for the video drama in which the specific content name and the assist level from the user A are the audio output for the headset hearing aid (S2 step), and at the same time, the management server 31.
Requests access to the content distribution server 41 included in the content management center 4 or the TV distribution server 61 included in the TV distribution service sub-center 6 to distribute the specific content of the video drama requested by the user A ( (Step S3), and further, the management server 31 commands the processing server 32 to process the distributed specific content with a processing condition in which the assist level is a video drama of audio output for headset hearing aid (step S4). The content distribution server 41 distributes the requested video drama information to the management server 31 in the content assistant center 3 (step S5), and the management server 31 sends it to the processing server 32 for processing the acquired video drama.

The processing server 32 extracts the audio signal from the video signal of the drama because the assist level satisfies the processing conditions for the video drama which is the audio output for the headset hearing aid, and the audio drama information sent from the management server 31 is extracted. The level of the voice signal is converted into a voice output for the headset hearing aid and sent to the management server 31 (step S6).
The management server 31 distributes the processed content processed into the video output drama of the audio output for the headset to the user A who has requested it, and the charging server 33 charges the usage fee (step S7). User A is a video drama of the audio output for the headset hearing aid requested by the distribution, which is distributed from the management server 31 in the content assistant center 3 via the IP network 2. You can watch using (S8 step).

Next, the flowchart of FIG. 6 will be described with reference to FIG.

The user B in the user 1 manages in the content assistant center 3 from the B personal computer 12 via the IP network 2 that the specific content name of the drama desired to be watched and the assist level are the video drama of the Braille signal output. Request to the server 31 (S1 step). At the content assistant center 3, the management server 31 receives and registers a distribution request for a video drama whose specific content name and assist level are Braille signal output from the user B (step S2). User B accesses the content distribution server 41 provided in
Request to distribute the specific content of the video drama requested by the distribution server (step S3), and further the management server 3
1 is a processing server 3 that processes the distributed specific content as a processing condition in which the assist level is a video drama of Braille signal output.
2 is ordered (step S4). Content distribution server 41
Distributes the requested video drama information to the management server 31 in the content assistant center 3 (step S5), and the management server 31 sends it to the processing server 32 for processing the acquired video drama. The processing server 32 extracts a voice signal from the video signal of the drama because the assist level of the video drama sent from the management server 31 satisfies the processing conditions for the video drama whose assist level is Braille signal output, and recognizes the extracted voice signal. It is converted into braille signal output by braille translation software and sent to the management server 31 (step S6). Management server 3
Reference numeral 1 distributes the processed content converted into the video drama of the Braille signal output to the user B who has requested it, and also the charging server 3
In 3, the usage fee is charged (step S7). User B
The video drama of the Braille signal output requested for distribution, which is distributed from the management server 31 in the content assistant center 3 via the P network 2, can be viewed on the screen of the B personal computer 12 or the Braille display (step S8). However, although the video can be discarded after processing, it is distributed as a helper for people who are blind.

Next, the flowchart of FIG. 7 will be described with reference to FIG.

The user C in the user 1 informs the management server 31 in the content assistant center 3 from the C personal computer 13 via the IP network 2 that the name of the foreign movie to be watched and the assist level is the video of the subtitle of the native language. Request (S1 step). At the content assistant center 3, the management server 31 receives and registers a distribution request from the user C in which the name of the specific foreign movie and the assist level are subtitled videos in its own language (step S2), and the management server 31 also receives the request. 4 to access the movie distribution server 71 provided in the movie distribution service sub-center 7 connected to the content distribution server 41 or the IP network 2 to request distribution of the specific foreign movie requested by the user C ( S
(3 step), further, the management server 31 commands the processing server 32 to process conditions that are the video in which the assist level of the delivered specific foreign movie is converted into subtitles in the native language (step S4). Content distribution server 41 or movie distribution server 7
1 delivers the requested specific foreign movie information to the management server 31 in the content assistant center 3 (step S5), and the management server 31 sends the obtained specific foreign movie to the processing server 32 for processing.

The processing server 32 extracts a sound signal from the video signal of the movie because the assist level of the specific foreign movie sent from the management server 31 satisfies the processing conditions for the movie whose assist level is a subtitle in its own language, and the speech recognition software uses another voice recognition software. It is converted into a national language text signal, and the converted foreign language text signal is converted into a native language text signal by translation software, processed into subtitles, and sent to the management server 31 (step S6). The management server 31 distributes the movie processed into the subtitles in the native language to the user C who has requested the movie, and the charging server 33 charges the usage fee (step S7). The user C receives the movie of the subtitle converted into the native language requested to be delivered and delivered from the management server 31 in the content assistant center 3 via the IP network 2 to the C personal computer 1
You can watch it on screen 3 (S8 step).

Next, the flowchart of FIG. 8 will be described with reference to FIG.

The user C in the user 1 indicates from the C personal computer 13 via the IP network 2 that the live distribution he / she wants to watch and the assist level are the subtitled video by the voice of the particular artist in the management server 31 in the content assistant center 3. Request (step S1). In the content assistant center 3, the management server 31 receives and registers a live distribution of live broadcast from the user C and a distribution request in which the assist level is a subtitled video with audio of a specific artist (step S2).
At the same time, the management server 31 accesses the live distribution server 51 provided in the live distribution service sub-center 5,
A request is made to deliver the live distribution of the live relay requested by the user C (step S3), and the management server 3
Reference numeral 1 instructs the processing server 32 on the processing conditions for the live distribution of the delivered live broadcast to be the subtitled video with the audio of the particular artist as the assist level (step S4). The live distribution server 51 distributes the requested live distribution information to the management server 31 in the content assistant center 3 (S5).
Process), the management server 31 sends the obtained live distribution to the processing server 32 for processing.

Since the processing level of the live distribution information sent from the management server 31 satisfies the processing condition for the assist level to process the subtitled video by the sound of the specific artist, the processing server 32 filters the audio signal of the specific artist from the video signal of the live distribution. Is extracted, the extracted voice signal is converted into a text signal by voice recognition software, the converted text signal is processed into a caption into a video, and the caption is sent to the management server 31 (step S6). The management server 31 distributes the live distribution information processed into the subtitled video by the voice of the specific artist to the requesting user C, and the charging server 33 charges the usage fee (step S7). The user C can watch the live distribution service of the captioned video by the sound of the specific artist requested to be distributed, which is distributed from the management server 31 in the content assistant center 3 via the IP network 2 on the screen of the C personal computer 13 (S8). Process).

Further, the steps of content processing processing in the processing server of FIGS. 9 and 10 will be described with reference to FIG.

FIG. 9A is a processing diagram for extracting audio from video and subtitling it. Content A1 sent from the management server 31 is separated into video A3 and audio A4 by a splitter A2, and audio A4 is It is composed of the steps of converting the text A6 by the voice recognition A5, processing the converted text A6 and the video A3 into a subtitled content A8 and sending the content A8 to the management server 31.

FIG. 9B is a processing diagram for extracting audio from video and processing the signal for the headset hearing aid. The content B1 sent from the management server 31 is the splitter B2.
, The video B3 and the audio B4 are separated, the audio B4 is level-converted into a headset hearing aid signal B5, and the composite B6 of the converted headset hearing aid signal B5 and the video B3 is added to the content B7 with the headset hearing aid function.
Each process is processed into a package and sent to the management server 31.

FIG. 9C is a processing diagram for recognizing voice and processing a Braille signal. The content C1 sent from the management server 31 is separated into a video C3 and a voice C4 by a splitter C2, and a voice C4 is The voice recognition C5 converts the Braille signal C6 into a Braille signal C6, and the combined C7 of the converted Braille signal C6 and the video C3 is processed into a Braille function content C8 and sent to the management server 31.

FIG. 10 (d) is a processing diagram for extracting audio from a foreign video and subtitling it in its own language. The management server 31
The content D1 sent from is separated into a video D3 and a sound D4 by a splitter D2, the sound D4 is converted into a text D6 by a voice recognition D5, and the converted text D6 is converted into a native language text D8 by a translation D7. , A process D9 of the converted native language text D8 and the video D3 into a content D10 with native language subtitles and sending it to the management server 31.

FIG. 10 (e) is a processing diagram for extracting specific audio from video and subtitling it. The content E1 sent from the management server 31 is separated into video E3 and audio E4 by the splitter E2, and audio E4. Is converted into a text E7 by a voice recognition E6 through a filter E5, processed into a subtitled content E9 of a specific voice by a combination E8 of the converted text E7 and the video E3, and sent to the management server 31. .

[0067]

As described above, according to the present invention, even if there is a strong desire to use the content distribution service of various information that has recently been provided on the Internet, the eyes and ears are deaf. Various users such as those who could only use a limited number of contents, those who were hearing impaired and needed subtitle support for video, and those who wanted other language support for information By using the content assistant center, the server provided in the content assistant center processes the specific content delivery service desired by the user into the processing condition of the assist content desired by the user and delivers the service, so that the user to use is inexpensive. It is possible to receive most content distribution services existing on the network for the usage fee It made.

In other words, the content assistant center delivers braille-compatible content distribution converted from voice of voice information to people who are blind, and to people who are deaf and the elderly. It provides content distribution corresponding to subtitle conversion and signal for hearing aids converted from audio of video information, and content distribution compatible with other languages in which foreign language is converted from audio of video information etc. to foreigners.

In addition, in the content assistant center that processes the content and assists the content distribution service, the content information existing in the world is used to perform information conversion and processing such as voice processing, subtitle processing, and software processing. Since the contents are processed, the media distribution cost will be low, and the labor cost will be reduced, so that various contents assisted distributions will be possible at a low total cost.

[Brief description of drawings]

FIG. 1 is a configuration explanatory diagram showing a user assistant service providing system for content distribution according to an exemplary embodiment of the present invention.

FIG. 2 is an explanatory diagram showing a service outline according to an embodiment of the present invention.

FIG. 3 is an explanatory diagram showing a service outline according to an embodiment of the present invention.

FIG. 4 is a content distribution flowchart according to a caption processing step according to the embodiment of the present invention.

FIG. 5 is a content distribution flowchart according to a signal processing step for a headset hearing aid according to an embodiment of the present invention.

FIG. 6 is a content distribution flowchart according to the Braille signal conversion process according to the embodiment of the present invention.

FIG. 7 is a content distribution flowchart according to another language translation subtitle processing step according to the embodiment of the present invention.

FIG. 8 is a content distribution flowchart of a live specific artist audio caption processing step according to the embodiment of the present invention.

FIG. 9 is a processing step diagram in the processing server according to the embodiment of the present invention.

FIG. 10 is a processing step diagram in the processing server according to the embodiment of the present invention.

[Explanation of symbols]

1 user 2 IP network 3 Content Assistant Center 4 Content management center 5 Live distribution service sub-center 6 TV distribution service sub-center 7 Movie distribution service sub-center 8 Content distribution network 9 Mobile communication base stations 11 A personal computer 12 B personal computer 13 C personal computer 14 set-top boxes 15 mobile terminals 31 Management server 32 Processing server 33 Billing server 41 Content distribution server 42 TV stations 51 Live distribution server 52 Concert venue 61 TV distribution server 71 Movie distribution server 72 movie theater

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Jun Nishikido             2-3-1, Otemachi, Chiyoda-ku, Tokyo             Inside Telegraph and Telephone Corporation (72) Inventor Senji Kawamura             2-3-1, Otemachi, Chiyoda-ku, Tokyo             Inside Telegraph and Telephone Corporation F-term (reference) 5C064 BA01 BB10 BC23 BD02 BD13                 5D015 KK02

Claims (14)

[Claims] 1. A step of registering, in a management server, a name of a specific content sent from a user terminal and an assist content corresponding to the specific content, the management server causing a specific content corresponding to the registered specific content name to a content distribution server. A request for delivery, a management server delivering the specific content and the assist content delivered from the content delivery server to the processing server, and a processing server processing the specific content delivered from the management server into the assist content. A method of providing a user assistant service for content delivery, comprising: a processing server delivering the processed specific content to a user terminal via a management server. 2. Various information distribution services such as a content distribution service for distributing movies, music, dramas, news, sports, etc. and a live distribution service for distributing live relays, using a network based on an IP network and / or a network dedicated to content distribution. In the content distribution system for performing the above, a content assistant center is provided, and the content assistant center is provided with a management server and a processing server. A step of obtaining and registering the name of the desired specific content and the assistance content for the specific content from the user and registering, and a request for delivering the specific content desired by the user by accessing the content distribution center that provides various information distribution services. Work For the processing server that processes the specific content obtained by the distribution request, a step of issuing a processing instruction to process the specific content to be sent to the processing conditions of the assist content desired by the user, and the processing processed by the processing server The processing server distributes the content to the registered user, and the processing server processes the specific content received from the management server into a processing condition instructed by the management server, and the processed content after processing to the management server. A method for providing a user assistant service for content distribution, which comprises the step of sending the content to a user assistant service. 3. The processed content is converted by the processing server into a step of extracting an audio signal from video information of the distributed content, and a step of converting the extracted audio signal into a text signal by voice recognition software. 3. The method for providing a user assistant service for content distribution according to claim 2, comprising the step of subjecting the text signal to subtitles on the video, and delivering the subtitled video information after the processing to the above-mentioned user. 4. The processed content is processed by the processing server to extract an audio signal from video information of the distributed content, a step of processing the extracted audio signal into a headset hearing aid audio signal, and The user for content distribution according to claim 2, comprising a step of processing into video information including a headset hearing aid audio signal, and delivering the processed video information with a headset hearing aid audio signal function to the user. How to provide assistant services. 5. The processed content comprises a step of extracting an audio signal from the audio information of the distributed content by the processing server, and a step of converting the extracted audio signal into a braille signal by a voice recognition braille translation software. 3. The method for providing a user assistant service for content distribution according to claim 2, wherein the converted voice information with Braille signal function is distributed to the user. 6. The processing content, wherein the processing server extracts a foreign language voice signal from the delivered video information, and converts the extracted foreign language voice signal into a foreign language text signal by voice recognition software. It consists of a process, a process of converting the converted foreign language text signal into a native language text signal with a translation software, and a process of converting the converted native language text signal into subtitles on the image, and the processed video with native language subtitles 3. The method for providing a user assistant service for content distribution according to claim 2, characterized in that the content is distributed to the user. 7. The processing content, wherein the processing server extracts only the audio signal of a specific artist from the video information of the live distribution service distributed by the processing server, and converts the extracted audio signal into a text signal by voice recognition software. 3. The user assistant service for content distribution according to claim 2, further comprising: a step of converting the converted text signal into subtitles on a video, and delivering the processed subtitled video information to the user. Method. 8. The name of the specific content sent from the user terminal and the assist content corresponding to the specific content are registered, and the specific content corresponding to the registered specific content name is requested to be distributed to the content distribution server. A management server that distributes the delivered specific content and the registered assist content to the processing server, and delivers the specific content processed by the processing server to the user terminal, and a processing server that processes the specific content delivered from the management server into the assist content. A user assistant service providing system for content distribution, comprising: 9. An information distribution service such as a content distribution service for distributing movies, music, dramas, news, sports, etc., and a live distribution service for distributing live broadcasts, using a network based on an IP network and / or a network dedicated to content distribution. In the content distribution system for performing various information distribution services, the user who has accessed to receive the content distribution service registers the name of the specific content desired by the user and the assist content for the specific content, and registers the content. The user requests the delivery of the specific content desired by the user by accessing the content delivery center that performs the request, and the user requests the specific content to be sent to the processing server that processes the specific content obtained by the delivery request. Assist content processing rules A management server that sends a processing command to process to the user, and distributes the processed content processed by the processing server to the registered user, and the specific content received from the management server to the processing condition instructed by the management server. A user assistant service system for content distribution, comprising a content assistant center having a processing server for sending the processed content to the management server. 10. The processing server extracts an audio signal from the video information of the distributed content, converts the extracted audio signal into a text signal by using voice recognition software, and processes the converted text signal into a caption on the video. 10. The user assistant service providing system for content distribution according to claim 9. 11. The processing server extracts an audio signal from the video information of the distributed content, processes the extracted audio signal into an audio signal for a headset hearing aid, and video information including the processed audio signal for a headset hearing aid. The user assistant service providing system for content distribution according to claim 9, wherein the system is processed into 12. The content processing apparatus according to claim 9, wherein the processing server extracts a voice signal from the voice information of the distributed content and converts the extracted voice signal into a Braille signal by using voice recognition braille translation software. User assistant service providing system for distribution. 13. The processing server extracts a foreign language voice signal from the distributed video information, converts the extracted foreign language voice signal into a foreign language text signal using voice recognition software,
The user assistant service providing system for content distribution according to claim 9, wherein the converted foreign language text signal is converted into a native language text signal by a translation software, and the converted native language text signal is captioned on a video. . 14. The processing server extracts only the audio signal of a specific artist from the video information of the distributed live distribution service, converts the extracted audio signal into a text signal by using voice recognition software, and converts the converted text signal into an image. The user assistant service providing system for content delivery according to claim 9, wherein the subtitle processing is performed upward.