JP2006180230A - Portable mobile terminal device and television display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a portable mobile terminal device enabling a user to obtain information brought by voice and sound even in a silent mode. <P>SOLUTION: The portable mobile terminal device is provided with a television receiver/demodulator 2 for receiving television broadcast, a sound output 4 for outputting voice information during the television broadcast, an image/video display unit 5 for displaying video information during the television broadcast, a mode setting part 12 for setting the propriety of output of the voice information to the sound output 4, and a signal processor 7 which generates composite video information for displaying captions by synthesizing the video information during the television broadcast with caption information corresponding to the voice information when inhibition of voice information output is set in the sound output 4, and also, controls so that the composite video information is displayed by the image/video display unit 5. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a portable mobile terminal device and a television display method capable of holding audio display functions of a television or the like and transmitting audio information accompanying an image even when output of audio or the like is stopped.

  A user of a portable mobile terminal device, for example, a mobile phone, is socially required to refrain from or prohibit the output of sound or the like in a theater, a movie theater, a train or the like. Some portable mobile terminal devices including cellular phones have a function of displaying and outputting various image and audio data by television broadcasting and satellite communication in addition to the function as a telephone. In addition to the functions of the portable mobile terminal device as a telephone, the functions such as the display / output of various images and audio data by television broadcasting and satellite communication as described above are similarly required.

  In order to respond to the social demands as described above, when a state that requires the manner mode is detected in Patent Document 1, a function that prohibits pronunciation from all the functions of the portable mobile terminal device A portable mobile terminal device providing a manner mode function and a state in which the function is operating is hereinafter referred to as a manner mode is disclosed.

  In the prior art, the output of sound and so on in all functions is stopped only by switching to the manner mode, so in the situation where it is required to stop or prohibit the output of sound or the like, It is possible to prevent mistakes such as inconvenience for the user by playing the video, and the convenience of the portable mobile terminal device is improved.

Japanese Patent Laid-Open No. 2001-267954

  As described above, in the manner mode in the portable mobile terminal device having a function other than the telephone as described in Patent Document 1, sound generation is prohibited even in the function other than the telephone. Therefore, when this conventional technology is applied to a portable mobile terminal device equipped with an image viewing function accompanied by sound such as television broadcasting, since sound is not output when viewing in the manner mode, the manner mode may be used. In a necessary scene, there is a problem that information provided by television broadcasting or the like cannot be acquired sufficiently.

  The present invention has been made to solve the above-described problems, and is to obtain a portable mobile terminal device and a television display method capable of obtaining information brought about by voice or sound even in the manner mode. Objective.

  A portable mobile terminal device according to the present invention includes a television receiving means for receiving a television broadcast, a sounding means for outputting audio information during the television broadcast, a video display means for displaying the video information during the television broadcast, and a sounding means. On the other hand, when the audio information output prohibition is set in the mode setting means for setting whether or not the sound information can be output, and the sound information means, the subtitle information is synthesized by combining the video information in the TV broadcast and the subtitle information corresponding to the sound information. And a process control means for controlling the composite video information to be displayed by the video display means.

  According to the present invention, the mobile mobile terminal device includes a television receiving means for receiving a television broadcast, a sounding means for outputting audio information during the television broadcast, a video display means for displaying the video information during the television broadcast, If the prohibition of audio information output is set in the sound generation means, the mode setting means for setting whether to output the audio information for the means, and the subtitle information corresponding to the audio information are synthesized with the prohibition of audio information output in the sound generation means. Generating the composite video information for displaying the subtitles and processing control means for controlling the composite video information to be displayed by the video display means. The effect of being able to obtain the information that has been brought is obtained.

Embodiment 1 FIG.
FIG. 1 is a block diagram of a portable mobile terminal device according to Embodiment 1 of the present invention. As shown in the figure, the portable mobile terminal device includes a control unit 1, a television reception / demodulation unit (television reception means) 2, a telephone transmission / reception / modulation / demodulation unit 3, an acoustic output unit (sound generation means) 4, an image / video display unit ( Video display means) 5, operation section 6, and signal processing section (processing control means) 7.

  The control unit 1 includes an operation control unit (processing control unit) 11 and a mode setting unit (mode setting unit) 12 and controls each component according to an input from the operation unit 6 by a user, a program, and the like. The operation unit 6 allows the user of the mobile mobile terminal device to input a telephone number to make a call, to select a TV function to watch TV, or to set the mobile mobile terminal device to manner mode. It is an input device such as a keyboard and a dial that are used in order to perform such operations.

  For example, when the user inputs a telephone number to make a call from the operation unit 6 by the user, the operation control unit 11 instructs the telephone transmission / reception / modulation / demodulation unit 3 to realize the telephone function. When the television function is selected for viewing the television, the television reception / demodulation unit 2 starts reception and demodulation of the television broadcast.

  When the mode setting unit 12 is set to the manner mode by the user from the operation unit 6 or by a program or the like, the mode setting unit 12 sets the sound output unit 4 not to emit sound. Further, when the manner mode is canceled, the sound output unit 4 is allowed to emit a sound.

  The television receiver / demodulator 2 receives and demodulates the television broadcast in response to the control signal from the operation controller 11. It is assumed that caption information is multiplexed in the television broadcast here. The demodulation result includes video information, audio information, and caption information. For example, when the television system supported by the television receiving / demodulating unit 2 is a terrestrial digital television, the television receiving / demodulating unit 2 outputs video, audio, and subtitle digital signals. Further, in the first embodiment, caption information is extracted from the television broadcast received by the television receiver / demodulator 2 and displayed on the image / video display unit 5. The subtitle information is such that the contents of the audio information can be read as characters at an appropriate timing.

  The telephone transmission / reception / modulation / demodulation unit 3 implements the telephone function of the portable mobile terminal device in response to a control signal from the operation control unit 11. The telephone transmission / reception / modulation / demodulation unit 3 is connected to a system to which a portable mobile terminal device is to be connected, such as a W-CDMA (Wideband-Code Division Multiple Access) system, a PDC (Personal Digital Cellular) system, etc. Exchanges etc.

  The signal processing unit 7 converts the video information, audio information, and subtitle information output from the television receiving / demodulating unit 2 into audio signals, video signals, and subtitle signals that can be output by the audio output unit 4 and the image / video display unit 5. To do. At this time, the mode setting unit 12 checks whether or not the manner mode is set. If the mode setting unit 12 is set, the video signal and the caption signal are synthesized to generate a synthesized video signal. The synthesized video signal is displayed on the image / video display unit 5 as one video.

  Further, when the operation control unit 11 receives a voice signal such as voice, sound effect, and ringing sound from the signal processing unit 7, the operation control unit 11 outputs it to the sound output unit 4, and receives the video signal or the synthesized video signal to the image / video display unit 5. Output. The sound output unit 4 is a speaker or the like that outputs a sound, a sound effect, a ringing sound, or the like when receiving a sound signal. The image / video display unit 5 is a liquid crystal display or the like that displays a television image, a standby screen, and the like when receiving a video signal.

FIG. 2 is a flowchart for explaining the operation of the control unit 1 when viewing a television in the portable mobile terminal device according to Embodiment 1 of the present invention.
First, when the user performs an operation for setting the manner mode from the operation unit 6 (step ST101), the mode setting unit 12 stops the sound output of the sound output unit 4 in response to the operation (step ST102). Subsequently, when the user selects a television function from the operation unit 6, the operation control unit 11 controls the television reception / demodulation unit 2 to start reception of the television broadcast (step ST103), and the mode setting unit 12 is silent. It is confirmed whether or not the mode is set (step ST104).

  When the manner mode is set, the operation control unit 11 instructs the signal processing unit 7 to synthesize the video signal and the caption signal (step ST105). The signal processing unit 7 synthesizes the video signal and the subtitle signal so that the subtitle information is inserted at an appropriate position of the video in accordance with the instruction, and outputs the synthesized video signal to the operation control unit 11. The operation control unit 11 supplies the acquired composite video signal to the image / video display unit 5. The image / video display unit 5 displays the video according to the composite video signal (step ST106). On the other hand, when the manner mode is not set, the signal processing unit 7 supplies the video signal and the audio signal to the operation control unit 11 without synthesizing the caption information, and the operation control unit 11 receives the video signal and the audio signal, respectively. It outputs to the image / video display unit 5 and the sound output unit 4, and outputs video and audio (step ST107).

  As described above, according to the first embodiment, if the user sets the manner mode before selecting the television function, he / she has to refrain from sounding or to sound at a prohibited place. Since the information transmitted by voice can be acquired by displaying subtitles, the user can enjoy watching TV on the train without hesitation.

  In the above description, the signal processing unit 7 combines the video signal and the caption signal, but the operation control unit 11 of the control unit 1 may combine the video signal and the caption signal.

Embodiment 2. FIG.
FIG. 3 is a block diagram of a portable mobile terminal device according to Embodiment 2 of the present invention. Elements common to those in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted.
The second embodiment shows a configuration for realizing the object of the present invention even when caption information is not multiplexed in a television broadcast. As shown in FIG. 3, in the second embodiment, a caption generation unit (caption generation means) 8 is added to the portable mobile terminal device shown in the first embodiment. The caption generation unit 8 holds in advance speech recognition software that conforms to a speech recognition algorithm that recognizes speech information and converts it into caption information, and the speech information generated by the television reception / demodulation unit 2 according to the speech recognition algorithm. It is converted into subtitle information and supplied to the signal processing unit 7. The signal processing unit 7 synthesizes the video information from the television reception / demodulation unit 2 and the subtitle information from the subtitle generation unit 8 to generate a composite video signal and supplies it to the operation control unit 11. Other operations are the same as those in the first embodiment.

  As described above, according to the second embodiment, since the subtitle generation unit 8 that converts audio information into subtitle information is provided according to the audio recognition algorithm, a television broadcast in which no subtitle information is multiplexed is used. The subtitles can be displayed even in the manner mode, and the information conveyed by voice when viewing the television can be obtained even in the manner mode.

  In the above description, the signal processing unit 7 combines the video signal and the caption signal, but the operation control unit 11 of the control unit 1 may combine the video signal and the caption signal.

Embodiment 3 FIG.
4 is a block diagram of a portable mobile terminal device according to Embodiment 3 of the present invention. In addition to the configuration of the first embodiment, the portable mobile terminal device according to the third embodiment includes a television reproduction unit (television reproduction means) 9. Constituent elements common to those in FIG.

  The TV playback unit 9 stores video information, audio information, and subtitle information during the TV broadcast received and demodulated by the TV receiving / demodulating unit 2, and the operation from the operation control unit 11 based on the operation from the operating unit 6. Outputs information to be accumulated in response to the control signal. For example, if the stored video information, audio information, and subtitle information are recorded digital terrestrial television broadcast data, video, audio, and subtitle digital signals are output. Other operations are the same as those in the first embodiment.

FIG. 5 is a flowchart for explaining the operation of the control unit 1 when reproducing stored information in the portable mobile terminal device according to Embodiment 3 of the present invention.
First, when the user performs an operation for setting the manner mode from the operation unit 6 (step ST201), the mode setting unit 12 stops the sound output of the sound output unit 4 in response to the operation (step ST202). Subsequently, when the user issues a television playback disclosure instruction from the operation unit 6, the operation control unit 11 controls the television playback unit 9 to start outputting the stored video information, audio information, and subtitle information ( In addition to step ST203), it is confirmed whether or not the mode setting unit 12 is set to the manner mode (step ST204).

  When the manner mode is set, the operation control unit 11 instructs the signal processing unit 7 to synthesize the video signal and the caption signal (step ST205). The signal processing unit 7 synthesizes the video signal and the subtitle signal so as to insert the subtitle information at an appropriate position of the video in accordance with the above instruction, and outputs the synthesized video signal to the operation control unit 11. The operation control unit 11 supplies the acquired composite video signal to the image / video display unit 5. The image / video display unit 5 displays the video according to the composite video signal (step ST206). On the other hand, when the manner mode is not set, the signal processing unit 7 supplies the video signal and the audio signal to the operation control unit 11 without synthesizing the caption information, and the operation control unit 11 receives the video signal and the audio signal, respectively. Output to the image / video display unit 5 and the sound output unit 4 to output video and audio (step ST207).

  As described above, according to the third embodiment, if the manner mode is set before the user issues a television playback instruction, the user must refrain from sounding or may sound at a prohibited place. Since the information transmitted by voice can be acquired by displaying the subtitles, the user can view the recorded information without hesitation in the train or the like.

  In the above description, the signal processing unit 7 combines the video signal and the caption signal, but the operation control unit 11 of the control unit 1 may combine the video signal and the caption signal.

Embodiment 4 FIG.
FIG. 6 is a diagram showing a configuration of a portable mobile terminal apparatus according to Embodiment 4 of the present invention. As shown in the figure, the control unit 1 of the portable mobile terminal device includes a download unit (download unit) 13. In the fourth embodiment, a configuration will be described in which the mobile mobile terminal device acquires parameters for optimizing the processing by the speech recognition algorithm from the external data server (server device) 20. Components that are the same as those in FIG. 3 are given the same reference numerals, and descriptions thereof are omitted.

  The telephone transmission / reception / modulation / demodulation unit 3 realizing the telephone function is connected to the telephone base station 10 via wireless communication. The telephone base station 10 is connected to the data server 20 via wired communication such as the Internet. The data server 20 holds optimum parameters for each channel for the speech recognition algorithm for the caption generation unit 8 to recognize the speech information and convert it to the caption information. This parameter is, for example, a reference level of audio to be subtitled by the audio algorithm.

  The caption generation unit 8 has parameters that can be changed by the speech recognition algorithm. The parameter has an optimum value for each television channel, and by setting the optimum value in the caption generation unit 8, more comfortable caption information can be provided to the television viewer. This parameter is constantly updated depending on the type of program and the like, and needs to be updated also in the portable mobile terminal device.

An operation for updating this parameter will be described.
The user designates a television channel to be viewed from the operation unit 6. The download unit 13 of the control unit 1 issues an instruction to connect to the telephone base station 10 to the telephone transmission / reception / modulation / demodulation unit 3 in response to the designation of the television channel. The telephone transmission / reception / modulation / demodulation unit 3 specifies the channel and connects to the telephone base station 10. The telephone base station 10 selects and acquires parameters of a speech recognition algorithm that is optimal for the channel designated from the data server 20 capable of wired communication. The download unit 13 downloads parameters selected from the telephone base station 10 via the telephone transmission / reception / modulation / demodulation unit 3.

  The download unit 13 sets the downloaded parameter in the caption generation unit 8. The caption generation unit 8 converts the voice information into the caption information according to the voice recognition algorithm using the set parameters.

  In addition to the above, the download unit 13 is connected to the telephone base station 10 via the telephone transmission / reception / modulation / demodulation unit 3 when a change in the environment is detected by constantly detecting the surrounding environment of the portable mobile terminal device. Alternatively, they may be connected at a constant cycle. When connected to the telephone base station 10, the download unit 13 selects and downloads parameters optimal for the environment from the data server 20. The download unit 13 stores the downloaded parameters. Thereafter, when the user receives designation of the channel received from the operation unit 6, the download unit 13 selects an appropriate parameter from the stored parameters and sets it in the caption generation unit 8.

  As described above, according to the fourth embodiment, the optimum parameters of the speech recognition algorithm operating in the caption generation unit 8 are downloaded from the data server 20 via the telephone transmission / reception / modem unit 3. Therefore, it is possible to follow even if the parameter value is changed, and it is possible to display subtitles more comfortably when the user views the television.

  Note that the voice recognition software itself according to the optimum voice recognition algorithm may be stored in the data server 20, and the download unit 13 may download the optimum voice recognition software and set it in the caption generation unit 8. As a result, even if the optimum speech recognition algorithm to be operated by the caption generation unit 8 is changed, it is possible to follow, and it is possible to display subtitles more comfortably when the user watches the television. It is done.

It is a block diagram of the portable mobile terminal device by Embodiment 1 of this invention. 6 is a flowchart for explaining the operation of the control unit of the mobile mobile terminal device according to the first embodiment. It is a block diagram of the portable mobile terminal device by Embodiment 2 of this invention. It is a block diagram of the portable mobile terminal device by Embodiment 3 of this invention. 12 is a flowchart for explaining the operation of the control unit of the mobile mobile terminal device according to the third embodiment. It is a block diagram of the portable mobile terminal device by Embodiment 4 of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Control part, 2 TV receiving / demodulating part (TV receiving means), 3 Telephone transmission / reception / modulating / demodulating part, 4 Sound output part (sounding means), 5 Image / video display part (video display means), 6 Operation part, 7 Signal Processing unit (processing control unit), 9 TV playback unit (TV playback unit), 10 telephone base station, 11 operation control unit (processing control unit), 12 mode setting unit (mode setting unit), 13 download unit (downloading unit) 20 Data server (server device).

Claims (6)

TV receiving means for receiving TV broadcasts;
Sound generating means for outputting audio information during the television broadcast;
Video display means for displaying video information during the television broadcast;
Mode setting means for setting whether to output sound information to the sound generation means;
When prohibition of audio information output is set in the sound generation means, synthesized video information for displaying subtitles is generated by synthesizing the video information in the television broadcast and the subtitle information corresponding to the audio information, and the synthesis A portable mobile terminal device comprising processing control means for controlling the video information to be displayed by the video display means. TV receiving means for receiving TV broadcasts;
TV playback means for storing the received TV broadcast information;
Sound generation means for outputting audio information in the TV broadcast information;
Video display means for displaying video information in the television broadcast information;
Mode setting means for setting whether to output sound information to the sound generation means;
When prohibition of audio information output is set in the sound generation means, the video information and subtitle information corresponding to the audio information are combined to generate composite video information for displaying subtitles, and the composite video information is A portable mobile terminal device comprising processing control means for controlling the video display means to display.   3. The portable mobile terminal device according to claim 1, further comprising subtitle generating means for converting audio information into subtitle information.   Wirelessly communicating with a speech recognition software set in the caption generation means and following a speech recognition algorithm that recognizes speech information and converts it to caption information and / or a server device that stores parameters for optimizing the processing in the speech recognition algorithm 4. The portable mobile terminal device according to claim 3, further comprising a download unit configured to download the voice recognition algorithm and / or the parameter and set the subtitle generation unit in the subtitle generation unit. Television receiving means for receiving television broadcast, sound generation means for outputting audio information during the television broadcast, video display means for displaying the video information during the television broadcast, and whether audio information can be output to the sound generation means In a television display method in a portable mobile terminal device comprising mode setting means for setting
Confirming whether or not prohibition of voice information output is set in the sound generation means;
When prohibition of audio information output is set, the video information in the television broadcast and the subtitle information corresponding to the audio information are combined to generate composite video information for displaying subtitles, and the composite video information is And a step of controlling the video display means to display. TV reception means for receiving TV broadcast, TV playback means for storing the received TV broadcast information, sound generation means for outputting audio information in the TV broadcast information, and video information in the TV broadcast information are displayed. In a television display method in a portable mobile terminal device comprising video display means and mode setting means for setting whether or not sound information can be output to the sounding means,
Confirming whether or not prohibition of voice information output is set in the sound generation means;
When prohibition of audio information output is set, the video information and the subtitle information corresponding to the audio information are combined to generate composite video information for displaying the subtitle, and the video display means displays the composite video information. And a step of controlling to display the television display method.

Images