JP2012134931A - Receiving device, portable communication terminal, caption display control program, and caption display control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a caption when desired by a user in either case that the sound is output via a second loudspeaker 26b or an earphone 30.SOLUTION: A portable telephone 10 has a decoder 50, and a TV tuner 52, and etc. Television broadcast is received by the TV tuner 52. The decoder 50 extracts caption data, sound data and etc., from the television broadcast. The sound data is converted into an analog sound signal, and the volume is adjusted. The volume-adjusted sound is output from the second loudspeaker 26b or the earphone 30. In addition, a caption is displayed based on the caption data on a display 38. In the case that the sound is output from the second loudspeaker 26b, when the volume is equal to or more than a threshold Ta, the displaying of the caption is turned off. In the case that the sound is output from the earphone 30, when the volume is equal to or more than a threshold Tb, the displaying of the caption is turned off.

Description

  The present invention relates to a receiving device, a portable communication terminal, a caption display control program, and a caption display control method, and more particularly, a receiving device, a portable communication terminal, a caption display control program, and a caption display that can output sound from a speaker or a mounting unit. It relates to a control method.

Conventionally, a receiving device that can output sound from a mounting unit such as a speaker or an earphone is widely known, and an example of this type of device is disclosed in Patent Document 1. This background art broadcast receiver is an in-vehicle digital broadcast receiver to which a television monitor, a speaker, a hands-free control device, and the like are connected. The television monitor can display a video in which subtitles representing the contents of broadcast audio are combined, and the user can arbitrarily set whether or not to display subtitles. In addition, when the mobile phone is connected to the hands-free control device and the communication state is established, the broadcast sound is muted. When the broadcast audio is muted by a call, even if the caption display setting is turned off, the caption is temporarily displayed on the television monitor. In addition, even when the output volume of broadcast audio is set to a threshold value or less by a user operation in a state where the caption display setting is off, the caption is temporarily displayed on the television monitor.
JP 2006-279582 A [H04N 5/60, H04B 1/16, H04N 5/445, H04N 7/173]

  It is conceivable that an earphone is used when viewing a broadcast. However, the broadcast receiver of Patent Document 1 does not take into account any convenience when viewing the broadcast using an earphone.

  Therefore, a main object of the present invention is to provide a novel receiving device, portable communication terminal, caption display control program, and caption display control method.

  Another object of the present invention is to provide a receiving device, a mobile communication terminal, a caption display control program, and a caption display control method, which can improve convenience when viewing a television broadcast.

  The present invention employs the following configuration in order to solve the above problems. The reference numerals in parentheses, supplementary explanations, and the like indicate the corresponding relationship with the embodiments described in order to help understanding of the present invention, and do not limit the present invention.

  1st invention is the receiving part which receives information, the extraction part which extracts the audio | voice information and subtitle information contained in information, and the adjustment part which adjusts the sound volume when outputting the audio | voice based on the audio | voice information extracted by the extraction part A receiving device that outputs sound at a volume adjusted by the adjusting unit at the speaker or the mounting unit, a display unit that displays subtitles based on subtitle information extracted by the extracting unit, and audio is output from the speakers If the sound volume is greater than or equal to the first threshold, the sound volume is smaller than the first threshold when sound is output from the first subtitle off section that turns off the display of subtitles by the display section and the mounting section. If it is more than a 2nd threshold value, it is a receiver provided with the 2nd caption off part which turns off the display of a caption by a display part.

  In the first invention, the receiving device (10: reference numerals exemplifying corresponding portions in the embodiment, hereinafter the same) receives information (digital television broadcast) by the receiving unit (52). The extraction unit (50) extracts video information, audio information, and caption information by decoding a demodulated signal obtained from the received information. The extracted audio information is converted into an analog audio signal through a predetermined process, and then the volume of the audio based on the analog audio signal is adjusted by the adjusting unit (22b). The sound whose volume is adjusted is output from the speaker (26b) or the mounting portion (30, 48).

  The subtitle based on the extracted subtitle information is displayed by the display unit (38) together with the video based on the extracted video information. And when audio | voice is output from the speaker, a 1st caption off part (32, S17, S57) will turn off the display of a caption, if the adjusted volume is more than a 1st threshold value (Ta). In addition, when audio is output from the mounting unit, the second subtitle off unit (32, S9, S43) displays subtitles if the volume is equal to or higher than the second threshold (Tb) smaller than the first threshold. Turn off.

  According to the first aspect, subtitles are displayed when the user needs, regardless of whether the sound is output from the speaker or the mounting unit. Therefore, it is possible to improve convenience when the user views information.

  The second invention is dependent on the first invention, and when the sound is output from the speaker, if the volume is lower than the first threshold, the first subtitle on section that turns on the display of the subtitle on the display section; and When the sound is output from the mounting unit, a second subtitle on unit that turns on display of subtitles by the display unit is further provided if the volume is lower than the second threshold.

  In the second invention, the first caption on section (32, S19, S59) turns on the display of the caption when the adjusted sound volume is smaller than the first threshold value while the sound is being output from the speaker. . If the adjusted sound volume is smaller than the second threshold value with the sound being output from the mounting unit, the second subtitle-on unit (32, S11, S44) turns on the subtitle display.

  According to the second invention, when it is necessary to display subtitles due to changes in the surrounding situation, the user can easily subtitle by lowering the volume below the threshold corresponding to the audio output state. Can be displayed.

  The third invention is dependent on either the first invention or the second invention, and the volume is equal to or higher than the second threshold when the wearing unit is inserted in a state where the display unit displays captions. For example, it further includes an invalidation unit that invalidates the second caption off unit until a predetermined time elapses.

  In the third invention, if the volume is equal to or higher than the second threshold when the mounting unit is inserted while the subtitle is displayed on the display unit, the invalidation unit (32, S39, S41) The second subtitle off part is invalidated until the time elapses. Then, when a predetermined time elapses, the caption is turned off.

  According to the third aspect, by turning off the subtitle after a predetermined time has elapsed, the subtitle does not disappear suddenly, so that the user does not feel uncomfortable.

  A fourth invention is according to any one of the first to third inventions, and the information received by the receiving unit includes television broadcasting.

  According to the fourth invention, the convenience of the user who views a television broadcast including subtitles is enhanced.

  A fifth invention is dependent on any one of the first to fourth inventions, and the mounting portion is detachable from the receiving device.

  According to the fifth invention, the user can arbitrarily attach / detach the attaching / detaching portion, so that convenience is enhanced.

  A sixth invention is dependent on any one of the first to fifth inventions, and the mounting portion includes a headset (48) having a microphone, an earphone (30), and a stereophone.

  According to the sixth aspect, various things can be used as the mounting portion for outputting sound.

  7th invention is a portable communication terminal provided with the receiver in any one of 1st invention thru | or 6th invention.

  According to the seventh aspect, it is possible to appropriately display subtitles in a mobile communication terminal, in which the audio output format is often switched according to the usage situation.

  The eighth invention is a receiving unit (52) for receiving information (television broadcast), an extracting unit (50) for extracting audio information and subtitle information included in the information, and audio based on the audio information extracted by the extracting unit. An adjustment unit (22b) that adjusts the volume when outputting and a display unit (38) that displays subtitles based on the subtitle information extracted by the extraction unit are provided and adjusted by the speaker (26b) or the mounting unit (30, 48). The processor (32) of the receiving device (10) that outputs the sound with the volume adjusted by the unit, when the sound is output from the speaker, if the volume is equal to or higher than the first threshold (Ta), the display unit When audio is output from the first subtitle off section (S17, S57) for turning off the subtitle display and the mounting section, if the volume is equal to or higher than the second threshold (Tb) smaller than the first threshold, Second subtitle off portion for turning off the display of subtitles by parts (S9, S43) to function as a subtitle display control program.

  In the eighth invention, as in the first invention, subtitles are displayed when the user needs, regardless of whether the sound is output from the speaker or the mounting portion. Therefore, it is possible to improve convenience when the user views information.

  A ninth aspect of the invention is a receiving unit (52) that receives information (television broadcast), an extraction unit (50) that extracts audio information and subtitle information included in the information, and audio based on the audio information extracted by the extraction unit. An adjustment unit (22b) for adjusting the volume when outputting and a display unit (38, 48) for displaying subtitles based on the subtitle information extracted by the extraction unit are provided and adjusted by the speaker (26b) or the mounting unit (30). A subtitle display control method for a receiving apparatus (10) that outputs sound at a volume adjusted by a unit, and when sound is output from a speaker, if the volume is equal to or higher than a first threshold (Ta), display When the display of subtitles is turned off (S17, S57), and the sound is output from the attachment unit, if the volume is equal to or higher than the second threshold (Tb) smaller than the first threshold, the characters by the display To turn off the display of (S9, S43), a subtitle display control method.

  In the ninth invention, as in the first invention, subtitles are displayed when the user needs, regardless of whether the sound is output from the speaker or the mounting portion. Therefore, it is possible to improve convenience when the user views information.

  According to the present invention, subtitles can be displayed when the user needs, regardless of whether the sound is output from the speaker or the mounting portion.

  The above object, other objects, features, and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

FIG. 1 is an illustrative view showing an electrical configuration of a mobile phone according to an embodiment of the present invention. FIG. 2 is an illustrative view showing an example of television broadcast video and GUI displayed on the display shown in FIG. FIG. 3 is an illustrative view showing one example of a configuration of a threshold table stored in the RAM shown in FIG. FIG. 4 is an illustrative view showing the relationship between the threshold and the volume shown in FIG. FIG. 5 is an illustrative view showing one example of a memory map of the RAM shown in FIG. FIG. 6 is a flowchart showing an example of the caption display control processing of the processor shown in FIG. FIG. 7 is a flowchart showing another example of subtitle display control processing of the processor shown in FIG. FIG. 8 is a flowchart showing another example of the caption display control processing of the processor shown in FIG.

  Referring to FIG. 1, a mobile phone 10 of this embodiment is a type of mobile communication terminal, and includes a processor 32 called a CPU. The processor 32 includes a wireless communication circuit 14, an A / D 16, a first D / A 20 a, a second D / A 20 b, a key input device 34, a display driver 36, a flash memory 40, a RAM 42, a short-range wireless communication circuit 44, and a decoder 50. And a TV (television) tuner 52 is connected. An antenna 12 is connected to the wireless communication circuit 14, and a microphone 18 is connected to the A / D 16. A first speaker 26a is connected to the first D / A 20a via a first amplifier 22a. The second speaker 26b and the insertion port 28 are connected to the second D / A 20b via the second amplifier 22b and the switch 24. Further, an earphone 30 that can be pulled out is inserted into the insertion port 28. A display 38 is connected to the display driver 36, and a short-range wireless communication antenna 46 is connected to the short-range wireless communication circuit 44. The decoder 50 and the TV tuner 52 are connected, and the TV antenna 52 is connected to the TV tuner 52. Since the mobile phone 10 includes the decoder 50, the TV tuner 52, and the TV antenna 54, it may be referred to as a receiving device.

  The processor 32 controls the entire mobile phone 10. The RAM 42 is used as a work area (including a drawing area) or a buffer area of the processor 32. The flash memory 40 stores content data such as characters, images, sounds, sounds, and videos of the mobile phone 10.

  The A / D 16 converts an analog audio signal for audio or sound input through the microphone 18 connected to the A / D 16 into a digital audio signal. The first D / A 20a converts (decodes) the digital audio signal into an analog audio signal, and supplies the analog audio signal to the first speaker 26a via the first amplifier 22a. Therefore, sound or sound corresponding to the analog sound signal is output from the second speaker 26b.

  In addition, the second D / A 20b converts the digital audio signal into an analog audio signal, like the first D / A 20a. The analog audio signal output from the second D / A 20b is applied to the second speaker 26b or the insertion port 28 according to the state of the switch 24. The switch 24 is in a state where the second amplifier 22b and the second speaker 26b are connected in a state where the earphone 28 is not inserted into the insertion port 28. When the earphone 28 is inserted into the insertion port 28, the switch 24 is mechanically operated, so that the connection between the second amplifier 22b and the second speaker 26b is released. Further, when the switch 24 is operated, the insertion port 28 is connected to the second amplifier 22b instead of the second speaker 26b. That is, when the earphone 30 is inserted, no sound is output from the second speaker 26b, and instead, the sound is output from the earphone 30. An insertion signal is input to the processor 32 from between the switch 24 and the insertion port 28. When the earphone 30 is inserted into the insertion port 28, the insertion signal changes, so that the processor 32 can detect that the earphone 30 has been inserted into the insertion port 28.

  The processor 32 can adjust the volume of the sound output from the first speaker 26a and the second speaker 26b (earphone 30) by controlling the amplification factors of the first amplifier 22a and the second amplifier 22b. . For this reason, the first amplifier 22a and the second amplifier 22b are sometimes referred to as adjustment units.

  The key input device 34 as an operation unit includes a cursor key, a call key, an end call key, and the like. Then, information (key data) on keys operated by the user is input to the processor 32. Further, when each key included in the key input device 34 is operated, a click sound is generated. Therefore, the user can obtain an operational feeling for the key operation by listening to the click sound.

  If the volume can be adjusted, the processor 32 outputs a signal for adjusting the volume to the first amplifier 22a and the second amplifier 22b in accordance with a key operation performed on the cursor key. To do. That is, the user can adjust the volume of the sound output from the first speaker 26a and the second speaker 26b (the earphone 30, the headset 48) by operating the cursor key. If the end call key is operated in a state where a predetermined function is being executed, the function being executed is terminated, and the mobile phone 10 enters a standby state.

  The display driver 36 controls display on the display 38 connected to the display driver 36 under the instruction of the processor 32. The display driver 36 includes a video memory (not shown) that temporarily stores image data to be displayed.

  The wireless communication circuit 14 is a circuit for performing wireless communication in the CDMA system. For example, when the user instructs a telephone call (calling) using the key input device 34, the wireless communication circuit 14 executes a telephone call process under the instruction of the processor 32, and sends a telephone call signal via the antenna 12. Is output. The telephone call signal is transmitted to the other party's telephone through a base station and a communication network (not shown). When an incoming call process is performed at the other party's telephone, a communicable state is established, and the processor 32 executes a call process.

  The normal call processing will be described in detail. The modulated audio signal transmitted from the other party's telephone is received by the antenna 12. The received modulated audio signal is demodulated and decoded by the wireless communication circuit 14. The received voice signal obtained by these processes is converted into an analog voice signal by the first D / A 20a and then output from the first speaker 26a via the first amplifier 22a. On the other hand, the transmission voice signal captured through the microphone 18 is converted into a digital voice signal by the A / D 16 and then supplied to the processor 32. The transmission signal converted into the digital audio signal is subjected to encoding processing and modulation processing by the wireless communication circuit 14 under the instruction of the processor 32, and is output via the antenna 12. Therefore, the modulated voice signal is transmitted to the other party's telephone through the base station and the communication network.

  When a telephone call signal from the other party's telephone is received by the antenna 12, the wireless communication circuit 14 notifies the processor 32 of an incoming call (incoming call). In response to this, the processor 32 controls the display driver 36 to display the caller information (telephone number and the like) described in the incoming call notification on the display 38. At substantially the same time, the processor 32 causes the second speaker 26b to output a ringtone (sometimes called a ringing melody or a ringing voice).

  Then, when the user performs a response operation using the call key, the wireless communication circuit 14 executes an incoming call process under the instruction of the processor 32. Further, a communicable state is established, and the processor 32 executes the normal call process described above.

  In addition, when a call end operation is performed with the call end key after shifting to the call ready state, the processor 32 controls the wireless communication circuit 14 to transmit a call end signal to the other party. After transmitting the call end signal, the processor 32 ends the call process. The processor 32 also terminates the call process when a call end signal is received from the other party first. Furthermore, the processor 32 also ends the call process when a call end signal is received from the mobile communication network regardless of the call partner.

  The short-range wireless communication circuit 44 establishes short-range wireless communication such as a Bluetooth (registered trademark) format with the headset 48. For example, when the user inputs a personal identification number set in the headset 48, short-range wireless communication between the short-range wireless communication circuit 44 and the headset 48 is established. In this state, when the function of outputting sound is executed, the processor 32 outputs the digital sound signal to the short-range wireless communication circuit 44 without outputting the digital sound signal to the second D / A 20b. The short-range wireless communication circuit 44 provides a digital audio signal to the headset 48 via the short-range wireless communication antenna 46. In the headset 48, the received digital audio signal is converted (composited) into an analog audio signal, and audio is output from the earphone of the headset 48. For this reason, when short-range wireless communication with the headset 48 is established in a state where sound is output from the second speaker 26b, sound is not output from the second speaker 26b, and sound is output from the headset 48. Become so.

  Further, when the headset 48 in which the short-range wireless communication is established receives data from the short-range wireless communication circuit 44, it returns an ACK signal (acknowledgment signal). Therefore, the processor 32 determines that the short-range wireless communication with the headset 48 has been disconnected if the ACK signal is not returned within a certain time after transmitting the data to the headset 48. In this case, the digital audio signal output to the short-range wireless communication circuit 44 is output to the second D / A 20b. That is, when the short-range wireless communication with the headset 48 is disconnected, the sound is output from the second speaker or the earphone 30.

  Note that in short-range wireless communication such as Bluetooth format, an operation of inputting a personal identification number and establishing short-range wireless communication of the headset 48 is referred to as “pairing”. If pairing has been performed in the past, short-range wireless communication between the short-range wireless communication circuit 44 and the headset 48 can be established without inputting a personal identification number from the next time.

  Here, in the present embodiment, outputting sound from the second speaker 26 b is referred to as “speaker output”, and outputting sound from the earphone 30 or the earphone of the headset 48 is referred to as “earphone output”.

  Further, the headset 48 has the earphone and the microphone, but may have only the earphone. In addition, the earphone 30 and the headset 48 may be collectively referred to as a mounting portion.

  The TV tuner 52 is a digital tuner and may be called a receiving unit. The TV tuner 52 extracts a television broadcast signal corresponding to the selected channel from the television broadcast signal (information) received by the TV antenna 54. Further, the TV tuner 52 performs a process such as demodulation on the extracted television broadcast signal, and generates a demodulated signal (also referred to as an MPEG2 transport stream). Further, the TV tuner 52 outputs a demodulated signal to the decoder 50. The decoder 50 includes an MPEG-TS decoder, a video decoder, a caption decoder, and an audio decoder. The demodulated signal input to the decoder 50 is first decoded by the MPEG-TS decoder based on the MPEG system to form a video signal, a caption signal, and an audio signal. Further, the video signal is decoded by the video decoder, the subtitle signal is decoded by the subtitle decoder, and the audio signal is decoded by the audio decoder.

  Each data decoded as described above is input to the processor 32. The processor 32 stores the decoded video data in the video memory, and outputs the decoded audio data (digital audio signal) to the second D / A 20b. Therefore, the video according to the received television broadcast is displayed on the display 38, and broadcast audio (broadcast audio) is output from the second speaker 26b or the earphone 30.

  If the setting for displaying subtitles is made, the processor 32 stores the decoded character data in the video memory together with the video data. This subtitle is for displaying the contents of broadcast audio such as lines spoken by an announcer or a talent accompanying a broadcast program. Therefore, the user can understand the content of the broadcast only by watching the subtitle and the video without listening to the sound.

  When a channel is selected by the key input device 34, the processor 32 outputs a channel selection command to the TV tuner 52.

  FIG. 2 is an illustrative view showing a state in which video corresponding to television broadcasting is displayed on the display 38. The display area of the display 38 includes a status display area 60 and a function display area 62. In the status display area 60, an icon (sometimes referred to as a pictograph) indicating a radio wave reception state by the antenna 12, a remaining battery capacity of the secondary battery, and the current date and time are displayed.

  The function display area 62 includes a video display area 70 for displaying TV broadcast video and a key display area 72 for displaying soft keys. For example, in the video display area 70, the video decoded by the decoder 50 is displayed. In the key display area 72, a menu key 74 for displaying a TV function operation GUI or the like is displayed. When a menu for displaying the current volume is selected by operating the menu 74, a volume icon 76 is displayed in the video display area 70 together with the video.

  When the volume adjustment operation is performed by the key input device 34 in a state where the volume icon 76 is displayed, the gauge in the volume icon 76 goes up and down. For example, when the gauge in the volume icon 76 is lowered to a predetermined position, that is, when the volume value is lower than the threshold value, the caption display area 78 is displayed in the function display area 62. The subtitle display area 78 displays the subtitle decoded by the subtitle decoder. For example, if a sports game is displayed in the video display area 70, the subtitle display area 78 displays the words spoken by the live announcer as subtitles.

  Here, in the present embodiment, the threshold value of the volume for displaying the caption is changed according to the speaker output or the earphone output. Referring to the threshold value table of FIG. 3, the sound volume threshold value is a threshold value Tb for the earphone output, and a threshold value Ta that is larger than the threshold value Tb for the speaker output. Generally, the speaker output is easily affected by ambient noise because the distance between the second speaker 26b and the user's ear is long. On the other hand, the earphone output is not easily affected by ambient noise because the earphone is attached to the user's ear. For this reason, threshold values Ta and Tb are set so that subtitles are more easily displayed on the speaker output than on the earphone output.

  When the two thresholds have the above magnitude relationship, the subtitles displayed on the display 38 are as shown in FIG. Referring to FIG. 4, the left axis indicates the volume level, the lower level is the minimum volume level, and the upper level is the maximum volume level. The threshold value Ta is illustrated above the threshold value Tb. For example, when the volume value is greater than or equal to the threshold value Ta, no caption is displayed regardless of the audio output format. When the volume value is smaller than the threshold value Tb, the caption is displayed regardless of the audio output format. When the volume value is equal to or higher than the threshold value Ta and lower than the threshold value Tb, subtitles are not displayed for the earphone output, but subtitles are displayed for the speaker output.

  Accordingly, it is possible to appropriately display subtitles on the mobile phone 10 in which the audio output format is often switched according to the usage situation. In addition, when the user needs to display subtitles due to changes in the surrounding situation, the user can easily display subtitles by lowering the volume below the threshold corresponding to the output format.

  Referring to FIG. 4, if the sound output is a speaker output when the volume value is less than threshold Ta and greater than or equal to threshold Tb, the sound is output from second speaker 26 b and the subtitle is displayed on display 38. When the earphone 30 is inserted into the insertion port 28 in this state, the audio output format is switched from the speaker output to the earphone output. At this time, the volume value is equal to or higher than the threshold value Tb, but the subtitle is not turned off (erased) until a predetermined time (for example, 3 seconds) has elapsed after the earphone 30 is inserted. For example, when the user inserts the earphone 30 and the subtitles are suddenly turned off, the user feels uncomfortable. However, as in the present embodiment, by turning off the subtitle after a predetermined time has elapsed, the subtitle does not disappear suddenly, so that the user can be prevented from feeling uncomfortable.

  FIG. 5 is a diagram showing a memory map 300 of the RAM 42. The memory map 300 of the RAM 42 includes a program storage area 302 and a data storage area 304. A part of the program and data is read from the flash memory 40 all at once or partly and sequentially as necessary, stored in the RAM 42, and then processed by the processor 32.

  The program storage area 302 stores a program for operating the mobile phone 10. For example, a program for operating the mobile phone 10 includes a caption display control program 310 and the like. The caption display control program 310 is a program for controlling on / off of captions displayed on the display 38. The subtitle display control program 310 includes a program that executes the processes shown in FIGS.

  Although illustration is omitted, the program for operating the mobile phone 10 includes a program for notifying the incoming call state and a program for communicating with the outside.

  Subsequently, in the data storage area 304, a subtitle buffer 330, a volume buffer 332, and the like are provided, and threshold table data 334 and the like are stored. The data storage area 304 is provided with an insertion flag 336, a headset flag 338, a speaker flag 340, a caption counter 342, and the like.

  The subtitle buffer 330 temporarily stores subtitle data output from the subtitle decoder. In the volume buffer 332, for example, a volume value adjusted by the user is temporarily stored. The threshold table data 334 is table data configured as shown in FIG.

  The insertion flag 336 is a flag for determining whether or not the earphone 30 is inserted into the insertion port 28, and is turned on / off based on an insertion signal obtained between the switch 24 and the insertion port 28. For example, the insertion flag 336 is composed of a 1-bit register. When the insertion flag 336 is turned on (established), a data value “1” is set in the register. On the other hand, when the insertion flag 336 is turned off (not established), a data value “0” is set in the register. If the insertion flag 336 is on, the earphone 30 is inserted into the insertion slot 28, and if the insertion flag 336 is off, the earphone 30 is not inserted into the insertion slot 28.

  The headset flag 338 is a flag for determining whether short-range wireless communication with the headset 48 is established. The headset flag 338 is switched from on to off when an ACK signal cannot be acquired from the headset 48.

  The speaker flag 340 is a flag for determining whether the output is a speaker. The speaker flag 340 is turned on when both the insertion flag 338 and the headset flag 340 are off. That is, if either the insertion flag 338 or the headset flag 340 is on, the speaker flag 340 is off.

  The caption counter 342 is a counter that counts a predetermined time for maintaining the display of captions. The subtitle counter 342 starts counting when it is initialized. Furthermore, the caption counter 342 is also called a caption timer, and when the caption timer is executed, the caption counter 342 is initialized.

  Although illustration is omitted, the data storage area 304 stores images, character string data, and the like displayed on the display 38, and is provided with counters and flags necessary for the operation of the mobile phone 10.

  The processor 32 performs a plurality of tasks including the processes shown in FIGS. 6, 7, and 8 under the control of a Linux (registered trademark) OS such as Android (registered trademark) and REX, and other OSs. Process in parallel.

  FIG. 6 is a flowchart of subtitle display control processing. For example, when the volume value is changed by an operation of adjusting the volume, the processor 32 acquires the volume value in step S1. For example, the volume value adjusted by the user is acquired from the volume buffer 332. Subsequently, in step S3, it is determined whether the earphone is in an output state in which sound is output from the earphone 30 or the headset 48. That is, it is determined whether either the insertion flag 336 or the headset flag 338 is on.

  If “YES” in the step S3, for example, if the insertion flag 336 is turned on and the sound is output from the earphone 30, the threshold value Tb is acquired in a step S5. That is, the threshold value Tb is read from the threshold value table data 334. Subsequently, in step S7, it is determined whether or not the volume value is greater than or equal to a threshold value Tb. That is, it is determined whether or not the adjusted volume value is equal to or greater than the speaker output threshold value Tb. If “YES” in the step S7, that is, if the volume value is equal to or greater than the threshold value Tb, the caption is turned off in a step S9, and the caption display control process shown in FIG. 6 is ended. That is, subtitles are not displayed on the display 38. Further, when the subtitle is not displayed, the subtitle display area 78 is not displayed. For example, when the caption is turned off in step S9, the display on the display 38 changes from FIG. 2 (B) to FIG. 2 (A).

  On the other hand, if “NO” in the step S7, that is, if the volume value is less than the threshold value Tb, the caption is turned on in a step S11, and the caption display control process is ended. That is, the caption based on the caption data stored in the caption buffer 330 is displayed on the display 38. In addition, subtitles are displayed and a subtitle display area 78 is also displayed on the display 38. That is, when the caption is turned on in step S11, the display on the display 38 changes from FIG. 2 (A) to FIG. 2 (B).

  If “NO” in the step S3, that is, if the speaker flag 340 is on and sound is output from the second speaker 26b, the threshold value Ta is acquired in a step S13. That is, the threshold Ta of the speaker output is read from the threshold table data 334. Subsequently, in step S15, it is determined whether or not the volume value is greater than or equal to a threshold value Ta. That is, it is determined whether or not the volume value at the speaker output is equal to or greater than the threshold value Ta. If “YES” in the step S15, that is, if the volume value is equal to or greater than the threshold value Ta, the subtitle is turned on in a step S17, and the subtitle display control process is ended. On the other hand, if “NO” in the step S15, that is, if the volume value is less than the threshold value Ta, the subtitle is turned off in a step S15, and the subtitle display control process is ended. That is, in the case of speaker output, on / off of subtitles is controlled based on a threshold Ta that is greater than the earphone output threshold Tb.

  Note that some processes included in the flowchart illustrated in FIG. 6 are used in the same manner in other flowcharts, and thus detailed description thereof is omitted in the other flowcharts.

  FIG. 7 is another flowchart of subtitle display control processing. For example, when the earphone 30 is inserted into the insertion port 28 by the user, the processor 32 acquires a volume value in step S31 and acquires a threshold value Tb in step S33. That is, when the earphone 30 is inserted, the earphone output is obtained, and thus the threshold value Tb is acquired.

  Subsequently, in step S35, it is determined whether or not the volume value is greater than or equal to a threshold value Tb. If “NO” in the step S35, that is, if the volume value is less than the threshold value Tb, the subtitle is turned on in a step S45, and the subtitle display control process shown in FIG. 7 is ended.

  If “YES” in the step S35, that is, if the volume value is equal to or greater than the threshold value Tb, it is determined whether or not a subtitle is displayed on the display 38 in a step S37. That is, it is determined whether the caption data is read from the caption buffer 330 and stored in the video memory. If “NO” in the step S37, that is, if no caption is displayed, the process proceeds to a step S43. If “YES” in the step S37, that is, if a caption is displayed, a caption timer is executed in a step S39. That is, a caption timer that measures a predetermined time is executed in order to prevent the caption from suddenly disappearing when the output changes from the speaker output to the earphone output. Specifically, when the process of step S39 is performed, the value of the caption counter 342 is repeatedly added. Subsequently, in step S41, it is determined whether or not the timer has expired. That is, the caption timer measures a predetermined time (for example, 3 seconds) and determines whether or not it has expired. As a specific process, it is determined whether or not the caption counter 342 has reached a value corresponding to a predetermined time. Note that the processor 32 that executes the processes of steps S39 and S41 functions as an invalidating unit.

  If “NO” in the step S41, that is, if the caption timer has not expired, the process of the step S41 is repeated. On the other hand, if “YES” in the step S41, that is, if the caption timer expires, the caption is turned off in a step S43, and the caption display control process shown in FIG. 7 is ended. That is, even if the volume value when the earphone 30 is inserted is equal to or greater than the threshold value Tb, the subtitle is not abruptly deleted.

  FIG. 8 is another flowchart of subtitle display control processing. For example, when the earphone 30 is pulled out from the insertion port 28 by the user, the processor 32 acquires a volume value in step S51 and acquires a threshold value Ta in step S53. That is, when the earphone 30 is pulled out, a speaker output is obtained, and thus the threshold value Ta is read out. Subsequently, in step S55, it is determined whether or not the volume value is greater than or equal to a threshold value Ta. If “YES” in the step S55, that is, if the volume value is not less than the threshold value Ta, the subtitle is turned off in a step S57. On the other hand, if “NO” in the step S55, that is, if the volume value is less than the threshold value Tb, the subtitle is turned on in a step S59. Then, when the process of step S57 or step S59 ends, the caption display control process shown in FIG. 8 ends. For example, when the earphone 30 is pulled out in a state where the volume value is less than the threshold value Ta and is equal to or more than the threshold value Tb, the caption is displayed without leaving time.

  In another embodiment, when the short-range wireless communication with the headset 48 is established, the caption display control process shown in FIG. 7 may be executed. Further, when the short-range wireless communication with the headset 48 is disconnected, the caption display control process shown in FIG. 8 may be executed.

  Further, the processor 32 that executes the processes of steps S17 and S57 functions as a first subtitle off unit. Further, the processor 32 that executes the processes of steps S9 and S43 functions as a second subtitle off unit. In addition, the processor 32 that executes the processes of steps S19 and S59 functions as a first subtitle-on unit. And the processor 32 which performs the process of step S11, S44 functions as a 2nd caption ON part.

  As can be seen from the above description, the mobile phone 10 receives a television broadcast by the TV tuner 52. The decoder 50 extracts video data, caption data, and audio data corresponding to the received television broadcast. The audio data is converted into an analog audio signal, and the volume is adjusted by the second amplifier 22b. The sound whose volume is adjusted is output by the second speaker 26b, the earphone 30 or the headset 48. Further, the decoded video data and subtitle data are displayed on the display 38. When sound is output from the second speaker 26b, if the adjusted volume is equal to or higher than the threshold Ta, the caption display is turned off. When sound is output from the earphone 30, if the adjusted volume is equal to or higher than the threshold value Tb, the caption display is turned off.

  Therefore, regardless of whether the audio output is the second speaker 26b or the earphone 30 (the earphone of the headset 48), the caption is displayed when the user needs it. Therefore, it is possible to improve convenience when the user views the television broadcast.

  In addition, it is possible to improve the convenience of the user who views a television broadcast including subtitles.

  Further, since the user can arbitrarily attach and detach the earphone 30 when storing the mobile phone 10 in a bag or carrying it, the convenience of the user is enhanced.

  Note that the threshold value Ta and the threshold value Tb may be changed by software update of the mobile phone 10, a change operation of the user, or the like.

  In another embodiment, captions may be displayed without displaying the caption display area 78. In this case, subtitles are displayed over the broadcast video.

  In addition, information including television broadcast may further include program data distributed using a network.

  In addition, the mounting unit that outputs sound may further include a stereophone. That is, various things can be used as a mounting part that outputs sound.

  The communication system of the mobile phone 10 is a CDMA system, but an LTE (Long Term Evolution) system, a W-CDMA system, a GSM system, a TDMA system, an FDMA system, a PHS system, or the like may be adopted.

  The caption display control program 310 may be stored in the HDD of the data distribution server and distributed to the mobile phone 10 via the network. In addition, the storage medium may be sold or distributed in a state where these programs are stored in an optical disk such as a CD, DVD, or BD (Blu-ray Disc), a USB memory, or a memory card. When the subtitle display control program 310 downloaded through the above-described server or storage medium is installed in a mobile phone having the same configuration as that of this embodiment, the same effect as that of this embodiment can be obtained.

  Furthermore, the present embodiment is not limited to the mobile phone 10 but may be applied to smartphones and PDAs (Personal Digital Assistants).

  The specific numerical values such as the predetermined time given in the present specification are merely examples, and can be appropriately changed according to the needs of the product specifications and the like.

DESCRIPTION OF SYMBOLS 10 ... Mobile phone 12 ... Antenna 14 ... Wireless communication circuit 20a, 20b ... 1st D / A, 2nd D / A
22a, 22b ... 1st amplifier, 2nd amplifier 24 ... Switch 26a, 26b ... 1st speaker, 2nd speaker 28 ... Insert port 30 ... Earphone 32 ... Processor 38 ... Display 44 ... Short-range wireless communication circuit 46 ... Short-range wireless communication circuit Communication antenna 48 ... Headset 50 ... Decoder 52 ... TV tuner 54 ... TV antenna

Claims (9)

A speaker comprising: a reception unit that receives information; an extraction unit that extracts audio information and subtitle information included in the information; and an adjustment unit that adjusts a volume when outputting audio based on the audio information extracted by the extraction unit, Or a receiving device that outputs sound at a volume adjusted by the adjusting unit at the mounting unit;
A display unit for displaying subtitles based on the subtitle information extracted by the extraction unit;
When audio is output from the speaker, if the volume is equal to or higher than a first threshold, audio is output from the first subtitle off unit that turns off display of subtitles by the display unit, and the mounting unit When the volume is equal to or greater than a second threshold value that is smaller than the first threshold value, the receiving device includes a second caption off unit that turns off display of captions by the display unit. When audio is output from the speaker, if the volume is lower than the first threshold, audio is output from the first subtitle on unit that turns on display of subtitles by the display unit, and the mounting unit 2. The receiving device according to claim 1, further comprising: a second subtitle on unit that turns on display of subtitles by the display unit if the volume is smaller than the second threshold.   When subtitles are displayed on the display unit and the mounting unit is inserted, the second subtitle off unit is invalidated until a predetermined time elapses if the volume is equal to or higher than the second threshold. The receiving device according to claim 1, further comprising an invalidating unit.   The receiving apparatus according to claim 1, wherein the information received by the receiving unit includes a television broadcast.   The receiving apparatus according to claim 1, wherein the mounting unit is detachable from the receiving apparatus.   The receiving device according to claim 1, wherein the mounting unit includes a headset having a microphone, an earphone, and a stereophone.   A mobile communication terminal comprising the receiving device according to claim 1. A receiving unit for receiving information, an extracting unit for extracting audio information and subtitle information included in the information, an adjusting unit for adjusting a volume when outputting audio based on the audio information extracted by the extracting unit, and the extracting unit A processor of the receiving device, which includes a display unit that displays subtitles based on the subtitle information extracted by, and outputs sound at a volume adjusted by the adjustment unit by a speaker or a mounting unit;
When audio is output from the speaker, if the volume is equal to or higher than a first threshold, audio is output from the first subtitle off unit that turns off display of subtitles by the display unit, and the mounting unit When the volume is equal to or greater than a second threshold value that is smaller than the first threshold value, a subtitle display control program that functions as a second subtitle off unit that turns off display of subtitles by the display unit. A receiving unit for receiving information, an extracting unit for extracting audio information and subtitle information included in the information, an adjusting unit for adjusting a volume when outputting audio based on the audio information extracted by the extracting unit, and the extracting unit A subtitle display control method for a receiving apparatus, comprising: a display unit that displays subtitles based on subtitle information extracted by the step, and outputting sound at a volume adjusted by the adjustment unit at a speaker or a mounting unit;
When sound is output from the speaker, if the volume is equal to or higher than a first threshold, display of subtitles by the display unit is turned off, and when sound is output from the mounting unit, the volume is A subtitle display control method for turning off display of subtitles by the display unit if the second threshold is smaller than a first threshold.

Images