JP4438433B2 - Videophone-compatible mobile terminal and communication system - Google Patents

Description

  The present invention relates to a mobile phone-compatible mobile terminal and a communication system.

  In recent years, there are mobile phones or other mobile terminals having a TV phone function (for example, see Patent Document 1). As a result of the addition of the TV phone function to the portable terminal in this way, a call using not only voice but also video is possible.

  In the case of videophone communication, since it is necessary to process video information in addition to audio information, the amount of communication data per unit time is much larger than conventional audio-only communication.

  Note that a moving image in the videophone communication is realized by transmitting video data of a difference in motion from the previous video. Therefore, the data amount of the difference data is large when the movement is large and small when the movement is small.

For this reason, the amount of data communicated during a TV phone is not always constant, and the amount of data constantly changes depending on the movement of the subject and the presence of sound.
JP 2003-125451 A (page 2)

  By the way, in the current videophone communication in a portable terminal, a line (for example, a radio line using a UDI bearer) for each user is used as a radio line.

  A user-specific radio channel such as a UDI bearer is assigned uniquely to each user, so that the channel quality is stable, but the radio resource decreases in proportion to the number of users.

  Therefore, as the demand for TV telephone communication that requires a large line capacity increases in the future, it is expected that the radio system capacity will be saturated and the radio resources will be exhausted.

  Further, in the TV telephone communication using the user individual radio line such as the above-mentioned UDI bearer, normally, in order to ensure the communication quality, transmission at a fixed rate is performed regardless of the change in the communication data amount.

  However, as described above, the amount of communication data in a videophone constantly changes, so when the amount of communication data is small, wireless resources are wasted and inefficient.

  In addition, even when the communication rate of the wireless line is variable, communication (particularly voice) is interrupted due to data loss or delay when the communication rate is changed, which affects the user experience communication quality. The problem is concerned.

  In other words, in the past, each user could not use a common line in TV phone communication, and because each user used a line with an individual and constant communication rate, radio resources could not be used efficiently, and user experience communication The quality was also unfavorable.

  The present invention has been made to solve the above-described problems, and provides a TV phone compatible communication terminal and a TV phone compatible communication system that can efficiently use radio resources and have good user experience communication quality. The purpose is to do.

In order to solve the above-described problem, the TV phone-compatible mobile terminal according to the present invention is a TV phone-compatible mobile terminal including a transmitter that transmits video data and a receiver that receives video data. Dividing means capable of dividing data into first and second video data, first transmission means for transmitting the first video data via a first communication line having a constant communication rate, and the second video data A second transmission means for transmitting via a second communication line whose communication rate is variable in accordance with the amount of data to be transmitted, while the receiving unit transmits the first communication line First receiving means for receiving the first video data via the second communication means, second receiving means for receiving the second video data via the second communication line, and first video received by the first receiving means. Data and the second receiving means And a coupling means capable of coupling with the second video data further received, and said dividing means, when the amount of video data exceeds a predetermined threshold value, the data amount of the video data corresponding to a threshold value The video data is divided so that becomes the first video data and the remaining video data becomes the second video data .

  In the videophone-compatible mobile terminal of the present invention, it is preferable that the first communication line is a line assigned to each user, and the second communication line is a line shared by a plurality of users.

  In the videophone-compatible mobile terminal of the present invention, the dividing unit divides the video data into the first and second video data, and for the verification used for both of the first and second video data. While adding data, the combining means determines the corresponding first and second video data using the verification data and combines the corresponding first and second video data with each other. preferable.

  In this case, the verification data is a time stamp, the dividing unit adds the same time stamp to the first and second video data to be divided, and the combining unit has the same time stamp. It is preferable to combine the added first and second video data.

  In the mobile phone-compatible mobile terminal according to the present invention, the transmission unit further includes transmission video processing means for encoding video data, and the dividing means outputs the video data encoded by the transmission video processing means to the first and second video data. It is preferable that the reception unit further includes reception video processing means for decoding the video data combined by the combining means while dividing into second video data.

  In the mobile phone-compatible mobile terminal of the present invention, the transmission unit further includes a multiplexing processing unit that multiplexes audio data with the first video data to obtain audio video multiplexed data, and the first transmission unit includes: While transmitting the audio / video multiplexed data multiplexed by the multiplexing processing unit, the first receiving unit receives the audio / video multiplexed data, and the receiving unit receives the audio / video multiplexed data. It is preferable to further include a demultiplexing processing means for demultiplexing the audio / video multiplexed data to be divided into audio data and the first video data.

  In the mobile phone-compatible mobile terminal of the present invention, the transmission unit further includes transmission audio processing means for encoding audio data and transmission video processing means for encoding video data, and the dividing means includes the transmission video. The video data encoded by the processing unit is divided into the first and second video data, and the multiplexing processing unit multiplexes the first video data and the audio data encoded by the transmission audio processing unit. The audio data is multiplexed into the audio / video multiplexed data, and the receiving unit is coupled by the coupling unit with reception audio processing unit that decodes audio data divided by the demultiplexing by the demultiplexing unit. It is preferable to further comprise received video processing means for decoding the video data.

  In the videophone-compatible mobile terminal of the present invention, there is further provided a communication rate increasing means for performing a process of increasing the communication rate of the second communication line when the data amount of the second video data exceeds a predetermined first threshold value. It is preferable to provide.

  In the mobile phone-compatible mobile terminal of the present invention, there is provided communication rate reduction means for performing a process of reducing the communication rate of the second communication line when the amount of the second video data is less than a predetermined second threshold. It is preferable to further provide.

In the videophone-compatible portable terminal of the present invention, the transmission video processing means divides the video data to be transmitted into data for each object included in the video, and assigns a display priority to each of the data for each object. The dividing means sets the data for each object having a high display priority among the data for each object included in the first video data, and the data for each object having a low display priority is included in the second video data. As described above, it is preferable to divide the video data.

  The videophone-compatible communication system of the present invention is a communication system that enables communication by the TVphone-compatible mobile terminal of the present invention, and is characterized by comprising the first communication line and the second communication line.

  According to the present invention, video data is divided into first and second video data, of which the first video data is communicated via a first communication line having a constant communication rate, while the second video data is Since communication is performed via the second communication line whose communication rate is variable in accordance with the amount of data to be transmitted, communication according to need is performed by the second communication line while maintaining a certain level of videophone communication quality by the first communication line. Rate changes can be made.

  As a result, a certain level of user experience communication quality can be ensured, radio resources can be used efficiently, and expansion of radio system capacity can be prevented.

  Embodiments according to the present invention will be described below with reference to the drawings.

  In the present embodiment, a mobile phone as a preferred example of the mobile terminal device according to the present invention will be described.

[First Embodiment]
FIG. 1 is a diagram showing a main block configuration of a mobile phone (mobile terminal) 100 according to the first embodiment.

The mobile phone 100 has a TV phone function, and as shown in FIG. 1, a transmission unit 110 that performs processing related to data transmission, a reception unit 120 that performs processing related to data reception, and the transmission unit 110 and reception unit 120 And the antenna unit 2 and the antenna 3 that are used in both the transmission process by the transmission unit 110 and the reception process by the reception unit 120.

  First, the transmission unit 110 will be described.

  As shown in FIG. 1, the transmission unit 110 includes a microphone 4 as a sound collection unit, a transmission audio processing unit (transmission audio processing unit) 11, a camera 5 as an imaging unit, and a transmission video processing unit (transmission video processing unit) 12. A dividing unit (dividing unit) 13, a multiplexing processing unit (multiplexing processing unit) 14, a first line transmitting unit (first transmitting unit) 15, a second line transmitting unit (second transmitting unit) 16, and a transmission processing unit. 17.

  Among these, the microphone 4 A / D converts the input voice into voice data, and transmits the voice data to the transmission voice processing unit 11.

  The transmission audio processing unit (Audio codec) 11 encodes the audio data input from the microphone 4 and transmits the encoded audio data to the multiplexing processing unit 14.

  The camera 5 A / D converts the input video (image) into video data and transmits the video data to the transmission video processing unit 12.

  A transmission video processing unit (Video codec) 12 encodes video data input from the camera 5 and transmits the encoded video data to the dividing unit 13. Here, the video data encoded and transmitted to the dividing unit 13 is, for example, video data of a difference in motion from the previous video. For example, when the video is still, the video data is stored in the dividing unit 13. Not sent.

  The dividing unit 13 divides the encoded video data transmitted from the transmission video processing unit 12 into two video data, and applies the same label (time stamp; verification data) to both of the divided video data. wear. Further, the dividing unit 13 transmits one of the video data (hereinafter referred to as first video data) to the multiplexing processing unit 14, and the other video data (hereinafter referred to as second video data) is transmitted to the second line transmission unit 16. Send to.

  As will be described later, when the data amount of the video data input to the dividing unit 13 does not exceed a predetermined threshold TH, the dividing unit 13 transmits the video data to the multiplexing processing unit 14 without dividing the video data. . Therefore, in this case, the second video data does not exist.

The multiplexing processing unit 14 performs multiplexing processing of the encoded video data and audio data, and transmits the processed data to the first line transmission unit 15. That is, the multiplexing processing unit 14
A process of multiplexing the first video data transmitted from the dividing unit 13 (or video data when the division is not performed) and the audio data transmitted from the transmission audio processing unit 11 is performed. Data (hereinafter, audio / video multiplexed data) is transmitted to the first line transmission unit 15.

  The first line transmission unit 15 uses the audio / video multiplexed data transmitted from the multiplexing processing unit 14 for transmission processing via a first line bearer (first communication line) which is a main line (main line).

  Here, the first line bearer is a radio line (for example, a UDI bearer) that is individually assigned to each user and has a fixed communication rate (fixed rate) regardless of the amount of data to be transmitted.

  The second line transmission unit 16 provides the second video data transmitted from the dividing unit 13 to a transmission process via a second line bearer (second communication line) that is a sub line.

  Here, the second line bearer is a radio line (for example, a Packet bearer) shared by a plurality of users and having a variable communication rate according to the amount of data to be transmitted. That is, as will be described in detail later, when the amount of data to be transmitted is large and there is a free capacity on the line, the processing for increasing the communication rate is performed while the amount of data to be transmitted is small, or When the line is congested, processing for reducing the communication rate is performed.

  The transmission processing unit 17 multiplexes and modulates two different types of transmission data input from the first line transmission unit 15 and the second line transmission unit 16, that is, audio / video multiplexed data and second video data. Then, it is converted to a transmission frequency and transmitted to the antenna unit 2.

  The antenna unit 2 transmits the transmission data input from the transmission processing unit 17 via the antenna 3.

  Thereby, the audio / video multiplexed data is transmitted to the mobile terminal of the communication partner (for example, the same type of mobile phone as the mobile phone 100) via the second communication line of the communication network (network), while the second video data is The data is transmitted to the communication partner mobile terminal via the second communication line of the communication network.

  Next, the receiving unit 120 will be described.

  As shown in FIG. 1, the receiving unit 120 includes a reception processing unit 27, a first line receiving unit (first receiving unit) 25, a second line receiving unit (second receiving unit) 26, and a demultiplexing processing unit (inverse demultiplexing unit). Multiplexing processing means) 24, combining section (combining means) 23, received video processing section (received video processing means) 22, received audio processing section (received audio processing means) 21, display 6 as display means, and sounding means A speaker 7 is provided.

  Among them, the reception processing unit 27 amplifies the received radio waves received by the antenna 3 and the antenna unit 2, performs frequency tuning detection and demodulation processing of the amplified radio waves, and receives the demodulated reception data as the first line. The data is transmitted to the receiving unit 25 and the second line receiving unit 26.

  The second line reception unit 26 performs processing for extracting second video data from the reception data transmitted from the reception processing unit 27, and transmits the extracted second video data to the combining unit 23.

  The first line receiving unit 25 performs a process of extracting the audio / video multiplexed data from the reception data transmitted from the reception processing unit 27 and transmits the extracted audio / video multiplexed data to the demultiplexing processing unit 24. .

  The demultiplexing processing unit 24 demultiplexes the audio / video multiplexed data from the first line receiving unit 25 by demultiplexing the first video data (or video data when it is not divided). And voice data. Further, the demultiplexing processing unit 24 transmits the audio data to the received audio processing unit 21, and transmits the first video data (or video data) to the combining unit 23.

  The combining unit 23 discriminates the first video data and the second video data to be combined using a label, and combines the first and second video data determined to be combined with each other as the original video data. And transmitted to the received video processing unit 22. Alternatively, if there is no second video data to be combined, the first video data (or video data) is transmitted to the received video processing unit 22 as it is.

  The received video processing unit 22 decodes the video data transmitted from the combining unit 23 and transmits the decoded video data to the display 6.

  The display 6 D / A converts the video data transmitted from the received video processing unit 22 and performs video output.

  The reception audio processing unit 21 decodes the audio data transmitted from the demultiplexing processing unit 24 and transmits the audio data after the decoding process to the speaker 7.

  The speaker D / A converts the audio data input from the received audio processing unit 21 and outputs it as audio.

  The control unit 1 includes, for example, a CPU, a ROM, a RAM, and the like, and includes a transmission audio processing unit 11, a transmission video processing unit 12, a division unit 13, a first line transmission unit 15, a second line transmission unit 16, and reception. The audio processing unit 21, the received video processing unit 22, the combining unit 23, the first receiving unit 25, and the second line receiving unit 26 are connected to and respectively controlled.

  The antenna unit 2 performs switching between transmission waves and reception waves, and the antenna 3 performs transmission / reception.

  The mobile phone 100 according to the first embodiment is configured as described above.

  Next, the operation will be described.

  First, the operation flow of the transmission unit 110 will be described.

  The audio input to the microphone 4 is A / D converted by the microphone 4 and then transmitted to the transmission audio processing unit 11 as digital data (audio data).

  The transmission voice processing unit 11 encodes the voice data from the microphone 4 and transmits the processed voice data to the multiplexing processing unit 14.

  The video input to the camera 5 is A / D converted by the camera 5 and then transmitted to the transmission video processing unit 12 as digital data (video data).

  The transmission video processing unit 12 performs encoding processing on the video data from the camera 5 and transmits the processed video data to the division unit 13.

  The dividing unit 13 operates under the control of the control unit 1 and performs division processing and labeling processing of video data (after encoding processing) transmitted from the transmission video processing unit 12.

  That is, the dividing unit 13 divides the video data into first and second video data, and adds, for example, the same label, specifically, for example, a time stamp to both the first and second video data. .

  In the present embodiment, the audio data is not divided. One reason is that audio data in videophone data has a lower rate than video data in both cases where the rate is fixed and variable, and the other is that the audio data is divided. This is because, when one of the divided data is lost, unlike in the case of video data, there is a possibility that information transmission between communication parties may be fatally impaired. For this reason, the audio data is communicated via the first communication line that is preferentially communicated.

  Here, a more specific operation of the dividing unit 13 will be described with reference to FIG. The process of FIG. 2 is a process executed by the dividing unit 13 when the video data after the encoding process is input to the dividing unit 13.

  When the encoded video data is input to the dividing unit 13, the dividing unit 13 first determines whether or not the data amount of the video data exceeds the threshold value TH (step S1).

  Here, the data of the threshold TH is calculated by the control unit 1 by subtracting the audio data rate and the time stamp data amount from the communication rate of the first communication line, and is given to the dividing unit 13. That is, if the communication rate of the first communication line is TR1, the rate of audio data is OR, and the amount of time stamp data is TS, the threshold TH = TR1-OR-TS.

  When it is determined that the video data does not exceed the threshold TH (NO in step S1), the video data is transmitted to the multiplexing processing unit 14 without being divided (step S2).

  On the other hand, when it is determined that the video data exceeds the threshold value TH (YES in step S2), a division process is performed.

  That is, the video data is divided into first video data that does not exceed the threshold TH and second video data that exceeds the threshold TH (step S3). That is, the data amount of the first video data is TH, and the remaining video data is the second video data.

  Furthermore, the same time stamp (label) for linking both is added to the first video data and the second video data (step S4).

  Next, the first video data that does not exceed the threshold TH is transmitted to the multiplexing processing unit 14, while the second video data that exceeds the threshold TH is transmitted to the second line transmission unit 16.

  At this time, the dividing unit 13 notifies the control unit 1 of information on the data amount of the second video data.

  Further, the video data transmitted from the division unit 13 to the multiplexing processing unit 14, that is, the first video data when the division process is performed, or the video data when the division process is not performed (that is, which Also in this case, the video data for which the threshold value is not exceeded is multiplexed with the audio data by the multiplexing processing unit 14 and transmitted to the first line transmission unit 15.

  The first line transmission unit 15 performs data transmission processing via the first line bearer on the audio / video multiplexed data transmitted from the multiplexing processing unit 14. The setting of the first line bearer and its communication rate is controlled by the control unit 1.

  In addition, the second line transmission unit 16 performs data transmission processing via the second line bearer on the second video data (that is, video data for which the threshold value is exceeded) transmitted from the division unit 13. The setting of the second line bearer and the setting / change of the communication rate are controlled by the control unit 1.

  Here, with reference to FIG. 3, an example of changing the communication rate when the second line bearer is a Packet bearer (Packet line) will be described. Note that the process of FIG. 3 is a process executed by the control unit 1 at the time of data transmission.

  First, the control unit 1 determines whether or not the data amount exceeds the first threshold (> second threshold) based on the data amount information of the second video data notified from the dividing unit 13 (Step 2). S11).

  If it is determined that the data amount of the second video data exceeds the first threshold value (YES in step S11), the communication data amount information necessary for transmission and a communication rate change request (shift up request) are notified to the network (step) S12) Wait for a response from the network.

  Subsequently, it is determined whether or not a response indicating that the communication rate can be shifted up is received from the network (step S13). If there is a response indicating that the communication rate can be increased (YES in step S13), communication is performed. Processing for increasing the rate (upshift processing) is performed (step S14), and the communication rate after the upshifting is set in the second line transmitter 16.

  That is, in steps S11 to S14, the control unit 1 functions as a communication rate increasing unit.

  On the other hand, when there is a response indicating that the upshifting is impossible (NO in step S13), the communication rate up to that point is maintained (step S15).

  If it is determined that the data amount of the second video data does not exceed the first threshold value (NO in step S11), it is determined whether the data amount is equal to or less than the second threshold value (<first threshold value) ( Step S16).

  When it is determined that the data amount of the second video data is equal to or smaller than the second threshold value (YES in step S16), the network is notified that information on the communication data amount necessary for transmission and the communication rate are to be changed (shifted down). (Step S17). Here, the case where it is determined that the data amount of the second video data is equal to or smaller than the second threshold includes the case where the second video data does not exist.

  Subsequent to step S17, a communication rate reduction process (shift down process) is performed (step S18), and the communication rate after the shift down is set in the second line transmission unit 16.

  That is, in steps S16 to S18, the control unit 1 functions as a communication rate reducing unit.

  If it is determined that the data amount of the second video data is not equal to or smaller than the second threshold value (NO in step S16), it is determined whether or not there is a notification that a network-driven shift down process is performed (step S19). If it is performed, a process for reducing the communication rate (shift down process) is performed (step S18), and if not, the communication rate is maintained (step S20).

  Note that the packet line communication rate change as shown in FIG. 3 can be easily realized by the current wireless communication system.

  As described above, when there is no second video data (video data exceeding the threshold) or when the amount of the second video data is equal to or smaller than the second threshold (YES in step S16), the second video data is the most. It is transmitted at a low communication rate.

  Here, the lowest communication rate refers to the lowest communication rate of the individual user wireless packet line. For example, in the W-CDMA system, each user uses a common channel, and each user's data is identified by a scramble code. If a wireless packet line called a common channel is available, it is used as the minimum communication rate.

  If the second video data exceeds the first threshold value (YES in step S11), the control unit 1 notifies the network of the transmission data amount (communication rate change), so that the communication rate shift-up process is initiated by the network. Alternatively, a shift-up process from the common channel packet line to each user-specific PACKET line is performed, and the communication rate after the shift-up is set in the second line transmission unit 16.

  When the second video data is equal to or less than the second threshold (YES in step S16), the control unit 1 notifies the network of the transmission data amount (communication rate change), thereby performing a communication rate shift down process led by the network. Or a downshift process from the individual PACKET line to the common channel packet line is performed, and the communication rate after the downshift process is set in the second line transmitter 16.

  As for the downshift process, the second video data is an intermediate value between the second threshold value and the first threshold value (NO in step S16), and even when there is no transmission data amount notification from the control unit 1 to the network, It may be done by initiative. In that case, the control unit 1 sets the communication rate designated by the network in the second line transmission unit 16.

  After the communication rate is set by the control unit 1, the second line transmission unit 16 performs transmission processing at the set communication rate until the communication rate is changed again thereafter.

  Thus, in addition to the individual channel (first communication line) having each communication rate, the channel (second communication line) shared by each user is set to an appropriate communication rate and used as necessary. As a result, communication with a variable rate can be realized on the PACKET line.

  After the above processing, the transmission processing unit 17 receives two different types of transmission data from the first line transmission unit 15 and the second line transmission unit 16, that is, audio / video multiplexed data and second video data. Multiplexing and modulation processing are performed, converted to a transmission frequency, and transmitted to the antenna unit 2.

  The antenna unit 2 transmits the transmission data transmitted from the transmission processing unit 17 via the antenna 3.

  Thereby, the audio / video multiplexed data is transmitted to the mobile terminal of the communication partner (for example, the same type of mobile phone as the mobile phone 100) via the first communication line of the network. Also, the second video data is transmitted to the communication partner mobile terminal via the second communication line of the communication network.

  Next, the operation flow of the receiving unit 120 will be described.

  First, the received radio wave received by the antenna 3 is sent to the reception processing unit 27 via the antenna unit 2.

  The reception processing unit 27 performs amplification, frequency tuned detection, and demodulation processing of the received radio wave from the antenna unit 2, and transmits the data received through the first communication line (hereinafter referred to as first line data) and the second communication line. The data received via the network (hereinafter referred to as second line data) is transmitted to the first line receiver 25 and the second line receiver 26, respectively.

  Here, demodulation and distribution of line data in the reception processing unit 27 are set by the control unit 1 via the first line reception unit 25 and the second line reception unit 26. At that time, the control unit 1 sets the respective communication bearers and communication rates in the first line receiving unit 25 and the second line receiving unit 26.

  The first line receiving unit 25 performs a process of extracting audio / video multiplexed data from the first line data transmitted from the reception processing unit 27, and demultiplexes the audio / video multiplexed data after the extraction process. To the unit 24.

  The second line receiving unit 26 performs a process of extracting the second video data (still encoded state) from the second line data transmitted from the reception processing unit 27, and combines the second video data after the extraction process. It transmits to the part 23. The second video data is extracted by the second line receiver 26 only when the second video data exists.

  The audio / video multiplexed data from the first line receiving unit 25 is subjected to demultiplexing processing in the demultiplexing processing unit 24, and the audio data and the first video data (or video data when no division is performed). It is divided into. Note that these audio data and video data are still encoded. Among these, the audio data is transmitted to the reception audio processing unit 21 and decoded, and the audio data after the decoding process is transmitted from the reception audio processing unit 21 to the speaker 7.

  The speaker 7 performs D / A conversion processing on the audio data from the received audio processing unit 21 and outputs audio.

  Further, the first video data after the demultiplexing process is combined with the second video data whose time stamps match each other in the combining unit 23 (only when the matching second video data exists), and the received video It is transmitted to the processing unit 22.

  If there is no second video data having the same time stamp, the first video data after demultiplexing processing (or video data when not divided) is directly sent from the combining unit 23 to the received video processing unit 22. Sent.

  The received video processing unit 22 decodes the video data transmitted from the combining unit 23 and transmits the decoded video data to the display 6.

  The display 6 D / A converts the video data from the received video processing unit 22 and outputs the video.

  Next, a more specific operation of the coupling unit 23 will be described with reference to FIG. 4 is a process executed by the combining unit 23 when the video data after the demultiplexing process is input to the combining unit 23.

  The combining unit 23 first determines whether or not to perform the combining process by determining whether or not there is a time stamp of the video data after the demultiplexing process (the first video data or the video data when the dividing process is not performed). Is determined (step S31).

If the video data after the demultiplexing process has no time stamp (not added) (NO in step S31), there is no second video data to be combined with the video data in the first place. The video data is transmitted to the received video processing unit 22 without performing the combining process (step S32).

  On the other hand, when the video data after the demultiplexing process has a time stamp (added) (YES in step S31), it is determined whether or not there is second video data having the same time stamp (step S33).

  Here, when the second video data is input to the combining unit 23 before the corresponding (combined) first video data, the second video data is stored (stored) in the buffer in the combining unit 23 and is in a standby state. It is supposed to be.

  Therefore, if the second video data has been input to the combining unit 23 first, the result of the determination in step S33 is YES, and the process proceeds to step S37.

  In step S37, the first and second video data corresponding to each other, that is, the first and second video data having the same time stamp are combined with each other (combination processing is performed) to obtain video data before division. Further, the combined video data is transmitted to the received video processing unit 22.

  When the second video data having a time stamp added in the past than the video data to be determined is stored in the buffer at the time of the determination in step S33, the second video data is buffered. Erase from within.

  If it is determined in step S33 that there is no second video data having the same time stamp (NO in step S33), a timer T that counts the elapse of a predetermined time is started (step S34). During the period until the timer T expires, the input of the second video data having the same time stamp is monitored (steps S35 to S36).

  Thereafter, when the second video data having the same time stamp is input before the timer T expires (YES in step S35), the process proceeds to step S37 to perform the above-described combination processing, and the video data after the combination processing Is transmitted to the received video processing unit 22.

  On the other hand, when the timer T has expired without the second video data having the same time stamp being input (YES in step S36), the video data after the demultiplexing process is processed as a received video process without performing the combining process. It transmits to the part 22 (step S32). Further, at this time, if the second video data having a time stamp added in the past than the video data to be determined in step S35 is stored in the buffer of the combining unit 23, the second video data is stored. 2 Delete the video data from the buffer.

  Further, the combining unit 23 notifies the control unit 1 of the status of the combining process. The control unit 1 receives the notification from the combining unit 23 and controls the timing of audio data and video data output from the reception audio processing unit 21 and the reception video processing unit 22.

  As a result, a voice and video call can be performed in real time.

  As described above, according to the first embodiment, video data is divided into first and second video data, of which the first video data is transmitted through the first communication line (for example, UDI bearer) having a constant communication rate. On the other hand, the second video data is communicated via a second communication line (for example, a PACKET line) whose communication rate is variable according to the amount of data to be transmitted.

  Since a conventional fixed-rate line is used for the first communication line, a certain level of TV phone communication quality without any interruption of audio or video loss can be maintained, so that a certain level of user experience communication quality can be ensured. In addition, the communication rate can be changed according to the situation (data amount or wireless environment) using the second communication line.

  In this way, by using the second communication line in addition to the first communication line, the communication rate of the fixed-rate first communication line can be set lower than the conventional communication rate. This makes it possible to efficiently use radio resources and prevent an increase in radio system capacity.

[Second Embodiment]
The mobile phone 100 according to the second embodiment differs from the mobile phone 100 according to the first embodiment described above only in the points described below, and is the same in other points. Are denoted by the same reference numerals, and the description thereof is omitted.

  In the case of the second embodiment, when the transmission video processing unit 12 performs encoding processing on video data, the transmission video processing unit 12 converts the video data into data (object data) for each object included in the video (display video using the video data). (Each data).

  Further, the transmission video processing unit 12 sets a display priority order for each object data. Specifically, for example, the video data is divided into data for each first object that is display data of a person video, and data for each second object that is display data of a background video, and data for each first object (person ) Is “1”, and the second object data (background) is “2”.

  Then, the control unit 1 is notified of the display priority order set in this way.

  The control unit 1 determines the optimum division mode of the video data by the division unit 13 using the display priority order and the division threshold TH notified from the transmission video processing unit 12, and divides in the determined division mode. Processing is instructed to the dividing unit 13 (a control command is transmitted).

  Specifically, for example, when the data amount of the data for each first object whose display priority is “1” does not exceed the threshold value TH, the data for each first object can be transmitted via the first communication line. is there. Therefore, in this case, the dividing unit 13 distributes the data for each first object to the first communication line (that is, the first video data).

  Furthermore, if the total data amount of the first and second object data does not exceed the threshold value TH, both can be transmitted via the first communication line. The data for every two objects is distributed to the first communication line.

  On the other hand, when the total data amount of the first and second object data exceeds the threshold value TH, only the second object data is distributed to the second communication line (that is, the second video data).

  As described above, the dividing unit 13 controls video data (for example, a person) with a high display priority to the first communication line and video data (for example, a background) with a low display priority to the second communication line under the control of the control unit 1. Sort out.

  When the threshold TH is exceeded only by the data amount of the first object data, the first object data is further divided. In this case, the first object data is preferentially first. Sent over a communication line.

  According to the second embodiment as described above, the transmission video processing unit 1 divides the transmitted video data into data for each object included in the video, and display priority is given to each of the data for each object. The order is set, and the dividing unit 13 includes data for each object having a high display priority among the data for each object included in the first video data, and data for each object having a low display priority included in the second video data. As described above, since the video data is divided, it is possible to preferentially transmit data for each object with high display priority (for example, human video data), and based on the data for each object with high display priority on the receiving side. Video output can be performed preferentially.

  In each of the above embodiments, only a mobile phone has been described as a suitable example of the mobile phone-compatible mobile terminal according to the present invention. However, the present invention is not limited to this example. For example, PHS (Personal Handy Phone System) It is also applicable to PDA (Personal Digital Assistant) or other portable information terminal devices.

  In each of the above-described embodiments, the configuration in which both video data and audio data are transmitted and received is exemplified. However, for example, only video data may be transmitted and received.

It is a figure which shows the main block structures of the mobile telephone which concerns on embodiment of this invention. It is a flowchart which shows the process which the division | segmentation part of the mobile telephone of FIG. 1 performs. It is a flowchart which shows the communication rate change process which the control part of the mobile telephone of FIG. 1 performs. It is a flowchart which shows the process which the coupling | bond part of the mobile telephone of FIG. 1 performs.

100 Mobile phone (mobile phone compatible mobile phone)
110 Transmission Unit 11 Transmission Audio Processing Unit (Transmission Audio Processing Means)
12 Transmission video processing unit (transmission video processing means)
13 Dividing part (dividing means)
14 Multiplexing processing unit (multiplexing processing means)
15 1st line transmission part (1st transmission means)
16 Second line transmission unit (second transmission means)
120 Receiving Unit 21 Received Video Processing Unit (Received Video Processing Means)
22 Received voice processing unit (received voice processing means)
23 coupling part (coupling means)
24 Demultiplexer (Demultiplexer)
26 First line receiver (first receiving means)
25 Second line receiver (second receiver)
1 control unit (communication rate increasing means, communication rate decreasing means)

Claims (11)

In a mobile phone-compatible mobile terminal comprising: a transmission unit that transmits video data; and a reception unit that receives video data.
The transmitter is
Dividing means capable of dividing the video data into first and second video data;
First transmission means for transmitting the first video data via a first communication line having a constant communication rate;
Second transmission means for transmitting the second video data via a second communication line whose communication rate is variable according to the amount of data to be transmitted;
While being configured with
The receiver is
First receiving means for receiving the first video data via the first communication line;
Second receiving means for receiving the second video data via the second communication line;
Combining means capable of combining the first video data received by the first receiving means and the second video data received by the second receiving means ;
When the data amount of the video data exceeds a predetermined threshold, the dividing means is configured so that video data having a data amount corresponding to the threshold becomes the first video data and the remaining video data becomes the second video data. To split the video data,
A mobile phone-compatible mobile terminal. The first communication line is a line assigned to each user;
2. The TV phone-compatible mobile terminal according to claim 1, wherein the second communication line is a line shared by a plurality of users. The dividing means, when dividing the video data into first and second video data, adds verification data used for both verification to the first and second video data,
2. The combination unit according to claim 1, wherein the combining unit discriminates corresponding first and second video data using the verification data, and combines the corresponding first and second video data with each other. 2. A mobile phone-compatible mobile terminal according to 2. The verification data is a time stamp,
The dividing means adds the same time stamp to the first and second video data to be divided,
4. The videophone-compatible mobile terminal according to claim 3, wherein the combining unit combines the first and second video data to which the same time stamp is added. The transmission unit further includes transmission video processing means for encoding video data, and the dividing means divides the video data encoded by the transmission video processing means into the first and second video data,
5. The videophone-compatible mobile terminal according to claim 1, wherein the receiving unit further includes a received video processing unit that decodes the video data combined by the combining unit. 6. The transmission unit further includes multiplexing processing means for multiplexing audio data with the first video data to obtain audio video multiplexed data, and the first transmission means is the audio multiplexed by the multiplexing processing means. While sending video multiplexed data,
The first receiving unit receives the audio / video multiplexed data, and the receiving unit demultiplexes the audio / video multiplexed data received by the first receiving unit into audio data and the first video data. 5. The TV phone-compatible portable terminal according to claim 1, further comprising a demultiplexing processing unit for dividing. The transmission unit further includes transmission audio processing means for encoding audio data, and transmission video processing means for encoding video data,
The dividing means divides the video data encoded by the transmission video processing means into the first and second video data,
The multiplexing processing means multiplexes the first video data and the audio data encoded by the transmission audio processing means to obtain the audio / video multiplexed data,
The reception unit is a reception voice processing means for decoding voice data divided by the demultiplexing by the demultiplexing processing means,
The mobile phone compatible mobile terminal according to claim 6, further comprising: received video processing means for decoding video data combined by said combining means.   8. A communication rate increasing unit for performing a process of increasing a communication rate of the second communication line when the data amount of the second video data exceeds a predetermined first threshold value. The mobile phone-compatible mobile terminal according to any one of the above.   The communication rate reducing means for performing a process of reducing the communication rate of the second communication line when the data amount of the second video data is less than a predetermined second threshold value. The mobile phone-compatible mobile terminal according to claim 8.   The transmission video processing means divides the video data to be transmitted into data for each object included in the video, and sets a display priority for each of the data for each object,
  The dividing unit is configured such that, among the data for each object, the data for each object having a high display priority is included in the first video data, and the data for each object having a low display priority is included in the second video data. The videophone-compatible mobile terminal according to any one of claims 5 to 9, wherein video data is divided.   A communication system that enables communication by the mobile phone-compatible mobile terminal according to any one of claims 1 to 10,
  A videophone-compatible communication system comprising the first communication line and the second communication line.

Images