JP2006180345A - Video display device, and video data processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video display device which can easily respond to changes or addition of functions. <P>SOLUTION: The device can display a video being photographed by a camera, or an image broadcasted on TV by selecting and outputting in an output control unit 7 either video data outputted from a camera 2, or video data for broadcasting on television which is received by a tuner 3 and an OFDM demodulator 4, processed and outputted by an expanding arithmetic unit 6 and inputting to a display part 10 via a main processing part 8. Since the tuner 3, the OFDM demodulation part 4, and a data processor 5 are configured separately from the main processor 8, it is possible to respond to different broadcasting by changing the modules. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technique for displaying a video selected from a plurality of input videos.

  In recent years, mobile terminals such as mobile phones and mobile game machines are increasingly used as video display devices.

  For example, the mobile phone 11 shown in FIG. 2 includes a main processing unit 13 that realizes basic functions of the mobile phone, such as a call function for operating as a telephone, and a main processing unit 13 connected to the main processing unit 13. The display unit 14 includes a liquid crystal display or the like for displaying processing contents and the like, and the camera unit 12 that inputs video data obtained by capturing an image of an object to the main processing unit 13. The camera unit 12, the main processing unit 13, and the display unit 14 are separately modularized. And each part is connected centering on the main process part 13, and various functions are implement | achieved by transmitting / receiving data and a command command.

  Video data captured by the camera unit 12 is output in the YUV format, and is input to the display unit 14 via the main processing unit 13 and displayed.

  At this time, the main processing unit 13 simply converts the YUV format video data input from the camera unit 12 into RGB format data that can be displayed on a liquid crystal display or the like as the display unit 14, and displays the video data in the display unit. 14 can realize a so-called live view function. Alternatively, if the display unit 10 itself has a function of converting YUV signals into RGB signals, the main processing unit 13 outputs the data input from the camera unit 12 to the display unit 10 as it is, as shown in FIG. Just do it.

  Recent cellular phones 11 have become multifunctional, and the main processing unit 13 has not only such a display function of captured images but also various functions.

  For example, not only the function of recording and saving video data input from the camera unit 12 as a still image or a moving image, but also a function of realizing use of e-mail and the Internet, a function of document creation and schedule management, etc. The main function of the mobile phone 11 is often realized by the main processing unit 13.

  Currently, mobile phones 11 to which various functions are added are being developed in response to user requests.

  It is sufficient that the function change or addition to the conventional mobile phone 11 can be dealt with only by addition change of a software program or the like that operates in the main processing unit 13, but depending on the function, various hardware such as semiconductor parts need to be added. There is.

  For example, in recent years, terrestrial digital television broadcasting has been started, and an environment in which a television broadcasting can be satisfactorily received and viewed by a moving body such as a vehicle or a portable terminal is being prepared. In these broadcasts, data compressed and encoded in the AVC / H.264 (ISO / IEC 14496-10 MPEG-4 Part 10 Advanced Video Coding / ITU-T Rec. H.264: hereinafter referred to as H.264) format is used. It is transmitted by OFDM.

  The data received by terrestrial digital television broadcasting includes video data in the same manner as being captured by the camera unit 12, but is compressed and encoded in the H.264 format, so that a process for expanding the data is necessary. Become. Therefore, when a function for displaying a video received by digital terrestrial television broadcasting is newly added to the mobile phone 11 shown in FIG. 2, not only channel selection from received radio waves and OFDM demodulation, but also H.264 format is supported. It is also necessary to add hardware that realizes the decompression processing.

  In order to add such hardware to the main processing unit 13, for example, it is necessary to change, add, review the arrangement of components on the board, and change the design from the basic structure of the main processing unit 13. May be required.

  When the conventional main processing unit 13 cannot be diverted as described above, there is a problem that a great deal of cost and labor are required for the development and manufacture of a new main processing unit 13.

  In addition, the main processing unit 13 specially designed with emphasis on a specific function does not have versatility. Therefore, when a change or addition of a function is required in the future, the basic processing unit 13 is similarly configured. It may be necessary to review from the structure.

  Accordingly, an object of the present invention is to provide a technique that can display a video selected from a plurality of input videos and can easily cope with future changes and additions of the input video. .

  In order to solve the above-mentioned problem, the invention of claim 1 is a portable video display device for displaying video data, an imaging means for outputting first video data obtained by imaging an object, and a video of a predetermined format. Data output means for outputting data; the first video data input from the imaging means; and second video data obtained by performing arithmetic processing on the video data in the predetermined format input from the data output means; The data processing means for selecting and outputting any one of the above, the main processing means for outputting the video data input from the data processing means, having a function of controlling the operation of the entire video display device, Display means for displaying the video data output from the main processing means, wherein the data processing means and the main processing means are separate modules.

  According to a second aspect of the present invention, there is provided the video display device according to the first aspect of the invention, wherein the data processing means selects data to be output in accordance with control by the main processing means.

  The invention of claim 3 is the video display device according to claim 1 or 2, wherein the video data of the predetermined format output by the data output means receives and demodulates a radio wave of a television broadcast. Data.

  According to a fourth aspect of the present invention, there is provided the video display device according to any one of the first to third aspects, wherein the predetermined format video data output by the data output means is a predetermined compression encoding format. The arithmetic processing performed by the data processing means is decompression decoding processing corresponding to the predetermined compression encoding format.

  According to a fifth aspect of the present invention, there is provided a video display apparatus according to the fourth aspect of the invention, wherein the predetermined compression encoding format is an MPEG4 format.

  The invention of claim 6 is the video display device according to any one of claims 3 to 5, wherein the television broadcast is a terrestrial digital television broadcast, and the predetermined compression encoding format is H. It is characterized by being in .264 format.

  A seventh aspect of the invention is a video display device according to any one of the first to sixth aspects of the invention, wherein the video display device is a mobile phone.

  The invention according to claim 8 is a means for performing predetermined arithmetic processing on at least one of the plurality of video data input from outside, and performing the predetermined arithmetic processing on the plurality of video data. Means for outputting one piece of video data selected from the video data in accordance with a control signal input from the outside.

  The invention of claim 9 is the video data processing apparatus according to the invention of claim 8, wherein the plurality of video data input from the outside is video data that has been compression-encoded in a predetermined compression-encoding format. And the predetermined calculation process is a decompression decoding process corresponding to the predetermined compression encoding method.

  The invention of claim 10 is the video data processing apparatus according to the invention of claim 8 or claim 9, wherein the plurality of video data input from the outside includes video data obtained by imaging an object, television Video data demodulated by receiving a broadcast.

  An eleventh aspect of the invention is a video data processing apparatus according to the eighth or ninth aspect of the invention, wherein the predetermined compression encoding method is an MPEG4 format.

  A twelfth aspect of the present invention is the video data processing apparatus according to the tenth or eleventh aspect of the present invention, wherein the television broadcast is a terrestrial digital television broadcast, and the predetermined compression encoding format is H.264. It is characterized by the form.

  According to the first aspect of the present invention, it is possible to select and display either imaging data or data obtained by performing arithmetic processing on video data in a predetermined format. In addition, arithmetic processing and display of video data of different formats can be easily realized simply by changing the functions and operations of the data output means and data processing means.

  According to the second aspect of the invention, the user can control the selection of the video data performed by the data processing unit by giving an instruction to the main processing unit that controls the entire display device.

  According to the third aspect of the present invention, it is possible to display either video data captured by a camera or the like and video data broadcast on a television.

  According to the fourth aspect of the present invention, even when video data compressed and encoded in a predetermined compression encoding format is input, it can be decompressed and displayed.

  According to the fifth aspect of the present invention, even when video data compressed and encoded in the MPEG4 format is input, it can be decompressed and displayed.

  According to the sixth aspect of the present invention, either one of video data captured by a camera or the like and video data of terrestrial digital television broadcast that is compressed and encoded in H.264 format is displayed. Can do.

  According to the seventh aspect of the present invention, either video data captured by a camera or the like and video data broadcast on a television can be displayed on a mobile phone.

  According to the eighth aspect of the present invention, since one video data selected from a plurality of video data can be output, for example, when connected to a video display device having only one input means, the video display device also has a plurality of video data. Video data can be used. The video data to be displayed at this time can be selected using a control signal. In addition, since it is possible to perform predetermined arithmetic processing for converting input video data into a format that can be input to a video display device that outputs the video data, various types of video data can be used.

  According to the ninth aspect of the present invention, even if video data compressed and encoded in a predetermined compression encoding format is input, it can be decompressed and output.

  According to the tenth aspect of the present invention, it is possible to output either video data captured by a camera or the like and video data broadcast on television.

  According to the eleventh aspect of the present invention, even when video data compressed and encoded in the MPEG4 format is input, it can be decompressed and output.

  According to the invention described in claim 12, either one of video data picked up by a camera or the like and video data of terrestrial digital television broadcast that is compressed and encoded in H.264 format is output. Can do.

<Configuration of video display device>
FIG. 1 is a diagram showing a configuration of a video display device 1 according to an embodiment of the present invention. The video display device 1 operates in one of a camera mode that operates as a camera for live view display of a video obtained by capturing an object and a television mode that operates as a television for displaying video that has received a digital terrestrial television broadcast. It is a possible mobile terminal. Specific examples of the portable terminal include a portable game machine, a PDA (Personal Digital Assistants), and the like in addition to a cellular phone having a camera function and a television function.

  In the following description, it is assumed that the video display device 1 is a mobile phone.

  The operation in the camera mode and the television mode described above is a function of the mobile phone that is the video display device 1, and if it is a mobile phone, it has other functions related to the display of video data. ing. Specifically, it is possible to display video data stored and saved in a memory or the like, or display VOD (Video On Demand) of video data on a network. Description of functions will be omitted, and only functions according to the present invention will be described.

  As shown in FIG. 1, a video display device 1 includes a camera unit (imaging means) 2 that outputs video data obtained by imaging a target, and a tuner unit 3 that extracts radio waves transmitted from a desired television broadcast station from received radio waves. , An OFDM demodulator 4 for OFDM demodulating the received radio wave extracted by the tuner unit 3, and data that outputs one of the data output from the camera unit 2 and the OFDM demodulator 4 in a format that can be input to the main processing unit 8 A processing unit (data processing unit) 5, a main processing unit (main processing unit) 8 that realizes basic functions of the mobile phone such as a call function for operating as a telephone, and a main processing unit connected to the main processing unit 8 And a display unit (display means) 10 composed of a liquid crystal display or the like for displaying the processing content in FIG.

  The data processing unit 5 also includes a decompression processing unit 6 that converts data input from the OFDM demodulating unit 4 into video data in a format that can be input to the main processing unit 8, camera data input from the camera unit 2, and And an output control unit 7 that selects and outputs one of the television data input from the decompression arithmetic unit 6.

  Further, the data processing unit 5 and the main processing unit 8 are provided with interfaces (I / F in the figure) 9A and 9B for transmitting and receiving data such as command commands to each other.

  These units and units are realized by dedicated hardware or dedicated hardware and software programs. The camera unit 2, the tuner unit 3, the OFDM demodulator unit 4, the data processing unit 5, the main processing unit 8 and the display unit 14 are individually modularized, for example, in the form of LSIs, etc. Various functions as the video display device 1 are realized by transmitting and receiving data and data. The tuner 3 and the OFDM demodulator 4 are not limited to being separately modularized, and may be integrated as a digital terrestrial television broadcast receiving module.

  The camera unit 2 (imaging means) performs processing such as pixel interpolation, gamma correction, and color space conversion on a signal imaged by an image sensor such as a CCD or CMOS via an optical lens or the like, and YUV format video data (first image). Video data).

  The tuner unit 3 has a function of receiving radio waves of digital terrestrial television broadcasting and extracting radio waves received from a desired broadcasting station. The tuner unit 3 includes an antenna (not shown) necessary for receiving broadcast radio waves.

  The OFDM demodulator 4 demodulates received data from the received radio wave of the channel extracted by the tuner unit 3. The received data demodulated here includes video data compressed and encoded in the H.264 format at the broadcasting station.

  Here, the tuner unit 3 and the OFDM unit 4 constitute data output means.

  The decompression arithmetic unit 6 performs arithmetic processing to decompress and decode the received data input from the OFDM demodulator 4 and compressed and encoded in the H.264 format, which is a higher performance version of the MPEG4 format. It is converted into YUV format video data (second video data) and output.

  Note that the television broadcast reception data extracted by the tuner unit 3 and the OFDM demodulation unit 4 includes not only video data but also audio data. Therefore, the decompression arithmetic unit 6 may be in a mode in which similar processing is performed on audio data, instead of a mode in which only video data is processed as described above. In this case, the audio data decoded by the decompression arithmetic unit 7 may be processed by an audio data processing unit (not shown), output to a speaker (not shown) provided in the mobile phone, and reproduced.

  The output control unit 7 has a function of selecting one of camera data input from the camera unit 2 and television data input from the decompression calculation unit 6 and outputting the selected data to the main processing unit 8. Which data is selected is selected by the user operating an operator (not shown) such as a button of the mobile phone 1. Specifically, the main processing unit 8 inputs a control signal indicating the operation mode selected by the user to the data processing unit 5 via the I / F (9A, 9B), and the output control unit according to the contents of the control signal. 7 performs a selection operation. The data selected here and output from the data processing unit 5 is YUV format video data in either case of camera data or television data.

  Here, the data processing unit 5 having the decompression operation unit 6 and the output control unit 7 constitutes a video data processing apparatus, and will be described as the data processing unit 5 below.

  The main processing unit 8 converts the YUV format video data input from the data processing unit 5 into RGB format data that can be displayed on the display unit 10 and outputs the data. In addition, the main processing unit 8 includes a call function, a function for recording and storing video data input from the camera unit 2 as a still image or a moving image, a function for realizing use of e-mail, the Internet, and the like, document creation Various functions that the conventional mobile phone 1 has as basic functions such as a function for performing schedule management and the like are realized. That is, the main processing unit 8 has a function of using the video data input from the data processing unit 5 while realizing all the functions that the mobile terminal that is the video display device 1 has conventionally.

  The display unit 10 is composed of a liquid crystal display or the like, and has a function of displaying RGB format video data input from the main processing unit 8.

  The functions and operations of the main processing unit 8 and the display unit 10 are modules having a function of converting the YUV signal into the RGB signal by the display unit 10 in addition to the above-described aspects. Alternatively, the YUV format data may be output to the display unit 10 as it is.

  The reception of television broadcasts is not limited to terrestrial digital television broadcasts, and may be satellite television broadcasts in addition to analog terrestrial television broadcasts conventionally performed. If the tuner unit 3, the OFDM demodulator unit 4 and the decompression operation unit 6 are made compatible with the format of the received radio wave and the compression encoding method of the video data, it is possible to support various broadcasts.

  As can be seen by comparing the configuration described using FIG. 1 with the configuration of the conventional mobile phone 11 described using FIG. 2, according to the present invention, the configuration of the conventional device can be effectively used. it can.

  As shown in FIG. 2, as long as YUV format data can be input to the main processing unit 13 of the mobile phone 11, as shown in FIG. If a data processing unit 5 that is modularized separately from the main processing unit, and a tuner unit 3 and an OFDM demodulating unit 4 connected to the data processing unit 5 are added to the main processing unit, the television broadcasting can be further performed while using the camera unit 12 that has been used conventionally. Can be received and displayed. At this time, the main processing unit 8 only needs to add an I / F (9B), change or modify a software program or the like to enable a command to be input to the data processing unit 5 or the like. There is no need to change from the basic structure. Therefore, compared with the case where the function which the data processing part 5 has on the conventional main processing part 13 is added, there exists an effect that the time and cost concerning development can be suppressed.

  Further, even when the conventional configuration cannot be used as it is, the configuration described with reference to FIG. 1 can be easily adapted to future function additions and changes.

  Specifically, for example, when the compression encoding method of the received television broadcast is changed to a method other than H.264, the function and operation of the decompression arithmetic unit 6 portion of the data processing unit 5 in the configuration of FIG. It is possible to cope with this by simply changing.

  Further, when the broadcast radio wave format is changed from the OFDM format, it can be dealt with by changing only the OFDM demodulator 4. Alternatively, the tuner unit 3 and the OFDM demodulator unit 4 can be changed to hardware capable of extracting and demodulating predetermined data from the received radio wave, and the expansion unit 6 can convert the predetermined data into video data in YUV format. If it changes to this, it can also respond to the broadcast which employ | adopts a new transmission system and a compression encoding system.

  Furthermore, if necessary hardware is added and the data processing unit 5 is changed so that data input from the hardware can be processed, video data selected from three or more data is input to the main processing unit 8. It is also possible to do so.

  In this way, the data processing unit 5 is made into a separate module with respect to the main processing unit 8 that realizes the basic functions of the mobile phone, so that the configuration of the conventional device can be used and future function changes can be made. It is possible to easily cope with or addition.

<Operation of video display device>
Next, the operation of the video display device 1 will be described.

  When using the camera function of the mobile phone which is the video display device 1, the user operates the operation unit such as a button of the mobile phone and instructs to start the operation in the camera mode.

  Receiving this, the main processing unit 8 inputs a control signal indicating the operation in the camera mode to the data processing unit 5 using the I / F (9A, 9B). The data processing unit 5 controls the output control unit 7 to output camera data, which is YUV format video data input from the camera unit 2, in accordance with the control signal received from the main processing unit 8. At this time, since the main processing unit 8 also notifies the camera unit 2 that the camera unit 2 operates in the camera mode, the camera unit 2 starts to output video data in YUV format in which the object is imaged. .

  Video data input from the camera unit 2 is input from the output control unit 7 of the data processing unit 5 to the main processing unit 8. The main processing unit 8 converts the input video data into RGB format data and outputs it. The display unit 10 displays the video imaged by the camera unit 2 using the data input from the main processing unit 8.

  When the user uses the TV function of the mobile phone that is the video display device 1, the user operates the operation unit such as a button of the mobile phone to instruct the start of the operation in the TV mode.

  Receiving this, the main processing unit 8 uses the I / F (9A, 9B) to input a control signal indicating the operation in the television mode to the data processing unit 5. The data processing unit 5 controls the output control unit 7 to output television data which is YUV format video data input from the expansion arithmetic unit 6 in accordance with the control signal received from the main processing unit 8.

  At this time, the main processing unit 8 also notifies the tuner unit 3 and the OFDM demodulation unit 4 that it operates in the television mode. The tuner unit 3 receives a television broadcast and extracts received radio waves of a predetermined channel. Then, the OFDM demodulator 4 demodulates the received radio wave extracted by the tuner 3 and outputs received data including video data compressed and encoded in the H.264 format to the data processor 5. The channel extracted by the tuner unit 3 can be designated by the user by operating the operator of the mobile phone.

  The reception data input from the OFDM demodulator 4 is expanded by the expansion arithmetic unit 6 and converted into video data in the YUV format and output. Then, the television data as YUV format video data is input to the main processing unit 8 through the output control unit 7.

  The main processing unit 8 converts the input video data into RGB format data and outputs it.

  The display unit 10 displays a video image of the television broadcast of the channel selected by the tuner unit 3 based on the data input from the main processing unit 8.

  By operating in this way, a user who uses the display device 1 can select and browse either video data captured by the camera or video data broadcast on television.

  In addition, this embodiment is an example and this invention is not limited to this. A data processing unit 5 that can input a plurality of video data and can output the selected video data after converting the input video data into a format that can be input to the main processing unit 8. As long as it is a module different from the main processing unit 8 that realizes the function as a portable terminal, other modes than those described above may be used. Specifically, for example, the input data may be three or more, and the input data may be data other than camera data or television data.

  Thus, by making the data processing unit 5 (data processing device) a module different from the main processing unit 8, it is possible to use the main processing unit constituting the conventional device, It becomes easy to cope with addition and the like.

It is a figure which shows the structure of the video display apparatus which concerns on one embodiment of this invention. It is a figure which shows the structure of the conventional video display apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Video display apparatus 2 Camera part 3 Tuner part 4 OFDM demodulation part 5 Data processing part 6 Decompression operation unit 7 Output control unit 8 Main processing part 10 Display part

Claims (12)

A portable video display device for displaying video data,
Imaging means for outputting first video data obtained by imaging an object;
Data output means for outputting video data in a predetermined format;
Select one of the first video data input from the imaging unit and the second video data obtained by performing arithmetic processing on the video data of the predetermined format input from the data output unit. Data processing means to output;
A main processing unit that has a function of controlling the operation of the entire video display device, and that outputs video data input from the data processing unit;
Display means for displaying the video data output from the main processing means;
With
The video display apparatus, wherein the data processing means and the main processing means are separate modules. The video display device according to claim 1,
The video display device, wherein the data processing means selects data to be output in accordance with control by the main processing means. The video display device according to claim 1 or 2,
The video display apparatus according to claim 1, wherein the video data of the predetermined format output from the data output means is data obtained by receiving and demodulating radio waves of a television broadcast. The video display device according to any one of claims 1 to 3,
The video data in the predetermined format output by the data output means is data compressed and encoded in a predetermined compression encoding format,
The video display device, wherein the arithmetic processing performed by the data processing means is decompression decoding processing corresponding to the predetermined compression encoding format. The video display device according to claim 4,
The video display apparatus characterized in that the predetermined compression encoding format is an MPEG4 format. The video display device according to any one of claims 3 to 5,
The television broadcast is a terrestrial digital television broadcast,
The video display apparatus according to claim 1, wherein the predetermined compression encoding format is an H.264 format. The video display device according to any one of claims 1 to 6,
The video display device is a mobile phone. Means for performing predetermined arithmetic processing on at least one of the plurality of video data input from the outside;
Means for outputting one piece of video data selected in accordance with a control signal input from the outside, from a plurality of the video data and the video data subjected to the predetermined arithmetic processing;
A video data processing apparatus comprising: The video data processing apparatus according to claim 8, wherein
The plurality of video data input from the outside includes video data compressed and encoded in a predetermined compression encoding format,
The video data processing apparatus according to claim 1, wherein the predetermined arithmetic processing is decompression decoding processing corresponding to the predetermined compression encoding method. The video data processing device according to claim 8 or 9, wherein
The plurality of video data input from the outside includes video data obtained by imaging an object and video data demodulated by receiving a television broadcast. The video data processing device according to claim 8 or 9, wherein
The video data processing apparatus according to claim 1, wherein the predetermined compression encoding method is an MPEG4 format. The video data processing apparatus according to claim 10 or 11,
The television broadcast is a terrestrial digital television broadcast,
The video data processing apparatus according to claim 1, wherein the predetermined compression encoding format is an H.264 format.

Images