WO2003101102A1

WO2003101102A1 - Mobile communication device

Info

Publication number: WO2003101102A1
Application number: PCT/JP2003/006329
Authority: WO
Inventors: Aki Kimura; Satoshi Minami; Mitsunobu Yoshinaga; Yasuo Maeda
Original assignee: Mitsubishi Denki Kabushiki Kaisha
Priority date: 2002-05-24
Filing date: 2003-05-21
Publication date: 2003-12-04
Also published as: TW200402655A; JPWO2003101102A1; TWI221252B

Abstract

A mobile communication device handling a plurality of types of moving picture files including video data of a common format. A software group installed includes a video decoder driver (32) for displaying a video based on the moving picture file on a display device (4) and a recording/reproduction library (22). A plurality of moving picture files are provided to the recording/reproduction library (22). When the moving picture file is in a format which can be processed by the video decoder driver (32), the moving picture file is provided to the video decoder driver (32). When the moving picture file is not in a format which can be processed by the video decoder driver (32), the moving picture file is separated so that video data contained in the moving picture file is provided to the video decoder driver (32).

Description

Mobile communication device technology

The present invention provides a function for playing back data files (hereinafter referred to as "movie files") downloaded over a network, a function for playing back video files stored during a videophone call (video conference), and a function for playing back video files stored by camera shooting. It relates to mobile communication devices such as next-generation mobile phone devices (for example, conforming to the IMT20000 standard) with functions and the like, and in particular, to the implementation of software groups for playing moving image files on mobile communication devices. Things. Background art

Unlike a personal computer that operates with a combination of general-purpose hardware that can operate at high speed and dedicated software that runs on it, in order to realize a video playback function, videophone function, etc. with a mobile communication device, It requires dedicated hardware to implement the functions and software to control each hardware. An example of the software configuration of the mobile communication device is described in, for example, the monthly magazine "Inte rfa ce (interface)", February 2000, p. 100 (published by CQ Publishing Nedo).

The conventional software configuration includes a library that plays video files stored in a videophone, a library that provides a function to play video files that have been stored by downloading, and a camera function of the terminal itself. Libraries that correspond to each function are included, such as a library that provides a function to play back video files acquired by. Therefore, for example, a video file downloaded and stored from a content distribution server is played back; in ^, a playback function is realized by controlling a group of device drivers via a library that provides a playback function of the stored video file. To play back data stored in a videophone call ^^, a playback function is realized by controlling a group of device drivers via a library that implements the videophone function. W

2

As described above, the conventional mobile communication device implements a library for executing each of the playback functions in order to realize the playback of the video file obtained by downloading and the playback of the video file obtained by the videophone function. I was In other words, in the storage device of the conventional portable communication device, a number of playback execution libraries according to the type of moving image file are installed. Therefore, when trying to increase the number of types of moving image files that can be handled by the mobile communication device and to increase the functionality of the mobile communication device, the size of the entire installed program became too large. . For this reason, in a conventional software implementation method of a portable communication device,

10 Due to the small capacity of the storage device, there is a problem that it is difficult to increase the functionality of a portable communication device having a limited storage area for programs. Further, this problem can be solved by increasing the capacity of the storage device of the mobile communication device. However, the increase in the storage device causes another problem that the manufacturing cost of the mobile communication device increases.

Therefore, the present invention has been made in order to solve the problems of the prior art as described above.

The purpose of the present invention is to provide a portable communication device that employs a software implementation method capable of realizing multi-functionality while suppressing an increase in the size of the entire program to be implemented. Disclosure of the invention

20 One embodiment of the portable communication device of the present invention is an apparatus for handling a plurality of types of moving image files including data having a common format, the moving image file obtaining means for obtaining a moving image file, and displaying a video. A display unit; a storage unit; and a control unit that controls operations of the moving image file acquisition unit, the storage unit, and the display unit by using a software group installed in the storage unit. For storage means

25 The installed software group is capable of processing at least the video data, and displays a | based on the video file acquired by the video file acquisition unit on the display unit. When the moving image file obtained by the means is in a format that can be processed by the device driver, the moving image file obtained by the moving image file obtaining means is read. When the moving image file obtained by the moving image file obtaining means is not in a format that can be processed by the depth driver, the moving image file obtained by the moving image file obtaining means is separated. Accordingly, a library for executing a reproduction control process for making the device driver use the video data included in the video file acquired by the video file acquisition means. '

In another aspect of the portable communication device of the present invention, each of the plurality of types of moving image files includes at least I ^ data and audio data.

In still another embodiment of the portable communication device of the present invention, the software group installed in the storage unit includes an application that provides a user interface for each of the plurality of types of moving image files.

Still another embodiment of the portable communication device according to the present invention includes: a moving image file acquiring unit, a communication unit that acquires a moving image file, an input device, a video information processing device, a microphone device, and an audio information processing device. A moving image that generates a moving image file containing video data obtained by the input device and encoded by the video information processing device and audio data obtained by the microphone device and encoded by the audio information processing device; Photographing means.

In still another embodiment of the portable communication device of the present invention, the moving image file acquired by the communication means includes a moving image file downloaded from a content distribution server and a moving image transmitted from a videophone call destination. Huai Nole is included.

Further, still another mode of the portable communication device of the present invention includes: storing the moving image file acquired by the library power moving image file acquiring unit in the storage unit; and setting the moving image file recorded in the storage unit to This executes the reproduction control processing.

Further, in still another mode of the portable communication device of the present invention, the library converts a moving image file acquired by the moving unit into a format of the downloaded moving surface file and records the format in the storage unit. Is what you do.

Further, still another embodiment of the portable communication device according to the present invention is configured such that the library power 03 06329

(4) A moving image file acquired by the image photographing means is converted into a format of a moving image file described from a destination of the videophone and is recorded in the storage means.

According to still another aspect of the portable communication device of the present invention, the moving image file obtained by the moving image file obtaining unit is configured by data to which a time stamp can be added. It has information processing means having a function of decoding the data of the moving image file according to the time stamp and a function of decoding the data ignoring the time stamp. BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 is a block diagram schematically showing a hardware configuration of a mobile communication device according to Embodiments 1 to 5 of the present invention.

FIG. 2 is a block diagram showing a software configuration of the mobile communication device according to Embodiment 1 of the present invention.

FIG. 3 is a diagram showing a flow of request and data in a reproduction process of a moving image file by download by the mobile communication device according to the first embodiment of the present invention, and FIG. 4 shows a flow according to the first embodiment of the present invention. FIG. 3 is a diagram showing a flow of a request and data in a reproduction process of a video file by a videophone by a mobile communication device;

FIG. 5 is a block diagram showing a software configuration of the mobile communication device according to Embodiment 2 of the present invention.

FIG. 6 is a diagram showing a flow of a request and data in a moving image file recording process by download by the portable communication device according to the second embodiment of the present invention. FIG. 7 is a diagram showing a second embodiment of the present invention. FIG. 5 is a diagram showing a flow of a request and data in a recording process of a video file by a videophone by the portable communication device according to

FIG. 8 is a diagram showing a flow of a request and data in a recording process of a moving image file by camera shooting by the mobile communication device according to Embodiment 2 of the present invention.

FIG. 9 is a diagram showing a request and data flow in a moving image file reproduction process by the mobile communication device according to Embodiment 2 of the present invention.

FIG. 10 is a diagram illustrating camera photographing by the portable communication device according to Embodiments 3 and 4 of the present invention. FIG. 11 is a diagram showing a flow of a request and data in a data conversion / storage process. FIG. 11 shows audio data when a downloaded moving image file is reproduced by the portable communication device according to the fifth embodiment of the present invention. FIG. 5 is a diagram showing a sequence for synchronizing the video data with the video data;

FIG. 12 is a diagram showing a sequence when an error occurs when playing a moving image file while synchronizing audio data and video data with the portable communication device according to Embodiment 5 of the present invention.

FIG. 13 is a diagram showing a sequence for reproducing a moving image file including only video data by the portable communication device according to Embodiment 5 of the present invention.

FIG. 14 is a diagram illustrating a playback method when the downloaded moving image file is played back frame by frame by the mobile communication device according to the sixth embodiment of the present invention. FIG. 15 is a diagram illustrating the playback method according to the sixth embodiment. This figure shows how to capture the frame-by-frame video data as a still image when the mobile communication device is playing back the downloaded moving image file by frame. BEST MODE FOR CARRYING OUT THE INVENTION

FIG. 1 is a block diagram schematically showing a hardware configuration of a mobile communication device according to Embodiments 1 to 5 of the present invention. The mobile communication device according to the first to fifth embodiments is, for example, a mobile phone device or a mobile information terminal having a function of playing a downloaded moving image file, a videophone (video conference) function, a camera function, and the like. Device.

As shown in FIG. 1, the mobile communication device according to the first to fifth embodiments includes a communication device 1 that transmits and receives a plurality of types of data through a wireless or wired communication line. Video files received by the communication device include video phone video files (ITU-TH.324, H.324ZM, or 3GPP) that multiplex I ^ data and audio data. (Compliant with the 3G-324M standard, etc., specified by the 3rd Generation Partnership Project) and video files downloaded from the content distribution server (for example, ASF (Advanced Streaming Format) format and MP4 format (image compression Method MP EG 4 I and audio compression method ΓΜΡ 3 (MPEG-1 audio layer 3) ", and file formats by QCELP (Qualcomm Code Exited Linear Predictive coding)))).

Also, as shown in FIG. 1, the mobile communication devices according to Embodiments 1 to 5 are a video information processing device (装置 coding / decoding device) 2 for encoding / decoding video data. An audio information processing device (audio encoding / decoding device) 3 for encoding and decoding audio data. The video information processing device 2 and the audio information processing device 3 have a function of decoding the moving image file according to the time stamp in the compressed data. And a function for ignoring the time stamp and decoding immediately after data reception. Therefore, data of different formats can be decoded by a common decoder.

The mobile communication devices according to the first to fifth embodiments include a display device 4 for displaying », a speaker device 5 for outputting sound, a video input device 6 for generating a video signal by photographing with a camera, and an audio device. And a microphone device 7 for generating a signal. Further, the mobile communication device according to the first to fifth embodiments includes a storage device (memory) 8 and a CPU (central processing unit) 9. Note that a plurality of storage devices 8 may be provided and used separately for storing programs and for storing moving image files. The CPU 9 controls the operations of the components 1 to 8 by using a software group installed in the storage device 8 and a real-time operating system (real-time OS). Embodiment 1

FIG. 2 is a block diagram showing a software configuration of the mobile communication device according to Embodiment 1 of the present invention. The arrows in FIG. 2 indicate the transfer of data between the software of the mobile communication device.

As shown in FIG. 2, the software group installed in the storage device 8 includes an application layer 10 having software for providing a user interface (ui), a library layer 20 having software for performing data processing, A driver layer 30 having software for controlling devices (including the above configurations 1 to 8), and a resource layer for controlling software included in each of the layers 10, 20, 30. It can be classified as OS40.

The application layer 10 includes a video conference application (Video Conference Application) 11 used when executing a videophone call, and a movie used to play video files stored in the storage device 8. 'View ヮ · Application (Movie View ヮ · Application: Movie Viewer Application)

Library layer 20 performs videophone sequence control when videophone is executed. Video conference library (videophone library: Video

Conference Library) 21 and a recording / playback library with video file recording / playback function (Video Record / Play Library) 22 via a network (for example, from a content distribution server on the network) Multimedia Service Library 23, which separates downloaded video file data into video data and audio data, is included.

The driver layer 30 includes software for controlling the hardware β, a camera / video encoder / driver (Camera V-Encoder Driver) 31 and a multi-separation video decoder 'driver (Hide / DEMUX V—Decoder Driver) 32, Audio Driver 33, File System * Driver

(File System Driver) 34.

The recording / reproduction library 22 in the first embodiment determines whether or not the input moving image file is in a format that can be processed by the demultiplexing video decoder / driver 32. In the first embodiment, the moving image file input to the demultiplexing video decoder 'Dryno 32' is a moving image file downloaded through the communication device 1, a moving image file downloaded through the communication device 1 and stored in the storage device 8, This includes a moving image file obtained through the communication device 1 by the videophone function and a moving image file obtained through the communication device 1 by the videophone function and stored in the storage device 8. The moving image file input to the demultiplexing video decoder / driver 32 may be another type of moving image file as long as it is a moving image file containing at least video data having a common format. When the recording / playback library 22 determines that the obtained moving image file is in a format that can be processed by the demultiplexing video decoder 'driver 32', the recording / playback library 22 transmits the obtained moving image file to the demultiplexing video decoder 'driver 32. provide. Also, if it is determined that the obtained video file is not in a format that can be processed by the demultiplexing video decoder driver 32, the recording / playback library 22 will send the video file to the multimedia service library 23. Then, the data included in the moving image file is sent to the demultiplexing video decoder driver 32 by demultiplexing. Through the above-described playback control processing, a plurality of types of moving image files having different formats can be played back using the recording / playback library 22 that is a common playback control library.

The recording / reproducing library 22 controls the file system driver 34 to store the moving image file acquired by the communication device 1 in the storage device 8, and stores the moving image file recorded in the storage device 8. Also, a reproduction control process for reproducing is executed. Details of the accumulation process will be described in a second embodiment described later.

Playback of downloaded video files>

FIG. 3 is a diagram showing a flow of request and data in a reproduction process of a downloaded video file by the mobile communication device according to the first embodiment of the present invention. With reference to FIG. 3, a description will be given of a process of reproducing the downloaded moving image file by the mobile communication device according to the first embodiment.

When playing a downloaded video file, first, the user operates the movie (viewer), which is an application that provides a user interface for video playback, through a user operation (the operation unit is not shown). The FINO HI selection command and the playback request 50a are issued to the recording / playback library 22 as a common playback control library.

Next, upon receiving the playback request 50a, the recording / playback library 22 determines the format (standard) of the data of the video file 51a to be played back, and determines the format of the video file downloaded from the network. Poor> That is, it is determined whether or not it is necessary to separate the data making up the video file into video data and audio data. The video file to be played 5 1 a is the video file In this case, the multiplexed data 52 constituting the moving image file 51a is transmitted to the multimedia service 'library 23', and a separation request is made. The multimedia service library 23 returns the separated data 53 obtained by separating the multiplexed data 52 into «data and audio data» to the recording / reproducing library 22.

Next, the recording / reproducing library 2 2 passes the video data 56 of the separated data 53 to a demultiplexing video decoder, which is a driver for controlling hardware for video reproduction. By passing the audio data 54 of the separated data 53 to the audio driver 33, which is a driver for controlling the hardware that reproduces audio, the video file is played (S | 3, display The display of an image by the device 4 and the output of sound by the speaker device 5 are realized. When playing back the audio data 54, the audio driver 33 returns the size 55 of the reproduced audio data 54 to the recording / playback library 22. The playback time of the video data and the audio data is synchronized by calculating the elapsed time and passing the data 56 to the demultiplexing video decoder / driver 32 in synchronization with the elapsed time.

Video file storage processing during videophone calls>

A process of storing a moving image file by the mobile communication device according to the first embodiment will be described with reference to FIGS. In order to record a video file received during a videophone call, first, the user operates the video conference application 11 to provide a user interface for the videophone. A recording request is issued to a video conference library 21 which is a library for providing a videophone function.

Next, the video conference 'library 21 receiving the recording request issues a recording request to the recording / playback library 22 which is a library for performing moving picture recording / playback control. The recording / playback library 22 issues a recording request to the demultiplexer video decoder 'driver 32, which controls the hardware that exchanges video files during a videophone call, and demultiplexes the received video file into a demultiplexer video decoder driver 32. And stores it in the storage device 8 (or another storage device not shown). In the case of accumulation, video Appends identification information to the data in the Huinore, indicating that the data is recorded during a videophone call.

Playback of video files stored during video calls>

FIG. 4 is a diagram showing a flow of request and data in a reproduction process of a moving image file stored in a videophone by the portable communication device according to Embodiment 1 of the present invention. With reference to FIGS. 1, 2, and 4, a description will be given of a process of reproducing a moving image file recorded during a videophone call by the mobile communication device according to the first embodiment.

When playing back a video file recorded during a videophone call, first, the user operates the movie file, which is an application that provides a user interface for playing back the stored video file, through the movie's view application. A video file playback request 50b is issued to the recording / playback library 22 via the movie / view library 21.

The recording / playback library 22 is a movie file in which the data of the movie file 51b to be played back was recorded during a videophone call, and is data that does not need to be synchronized with the playback timing of video data and audio data. Judge that there is. In this case, the recording / reproducing library 22 passes the multiplexed data 57 of the moving image file 51 b to the demultiplexing video decoder / driver 32 to realize the moving image reproduction. Synchronization of the playback timing of video data and audio data of 5 lb of video file recorded on the own terminal is performed in the multi-separation video decoder 'driver 32, and audio data 58 is used as needed by the audio driver. 3 Passed to 3.

As described above, the playback of two types of video files having different formats (here, the downloaded video file 51a and the video file 51b recorded during a videophone call) is performed using a common playback function library. It can be realized using a certain recording / reproducing library 22, a demultiplexer video decoder / dryno 32, which is a common driver, and common hardware.

As described above, in the portable communication device according to the first embodiment, the recording / reproducing library 22 which is a common reproducing function library for a plurality of types of video files (for example, the video files 51a and 51b) is used. You are using In other words, the portable communication device according to Embodiment 1 is a standard for current or future portable communication devices. Focusing on the fact that the video data of multiple types of video files are s «data composed of a common format, a conventional method that has a playback function library for each of multiple types of video files is adopted. I haven't. Instead, in the mobile communication device according to the first embodiment, the playback control process is executed by using a recording / playback library 22 which is a common playback function library capable of processing data common to a plurality of types of video files. are doing.

As described above, in the portable communication device according to the first embodiment, a plurality of types of moving image files can be reproduced by the common recording / reproducing library 22 through a process called separation. In order to increase the functionality of the mobile communication device by increasing the types of video files that can be handled by, but compared to the conventional technology having a playback function library for each of multiple types of video files, The overall size of the installed program (software group) can be reduced. Therefore, even if the storage capacity of the storage device is small, and the storage area of the program is limited, even a portable communication device can realize multifunctionality that can handle many types of moving image files.

In the above description of the first embodiment, the case where the portable communication device has a function of reproducing a downloaded moving image file and a function of recording and reproducing a moving image file in a videophone call has been described. The portable communication device according to the above may have other functions.

In the description of the first embodiment, the downloaded video file is separated from the data and passed to the recording / playback library 22, and the video file recorded during the videophone call is not separated. Although the case of passing to the recording / playback library 22 has been described, when the format of the moving image file is different, the processing method of the moving image file is also different. Therefore, if the format of the video file is different, the downloaded video file is passed to the recording / playback library 22 without separating the data, and the video file recorded during a videophone call is separated after the data is separated. It may be passed to the recording / playback library 22. Embodiment 2 FIG. 5 is a block diagram showing a software configuration of the portable communication device according to Embodiment 2 (or Embodiments 3 and 4) of the present invention. Note that arrows in FIG. 5 indicate data transfer between the software of the portable communication device.

Similarly to the software configuration of the first embodiment, the software group installed in the storage device 8 in the second embodiment includes an application layer 10, a library layer 20, a driver layer 30, and a real-time OS 40. Can be classified as

The application layer 10 includes a video 'conference application 11 used when executing a videophone call, a movie used to play a video file stored in the storage device 8, a view application 12 and a network. When storing video files downloaded from the above server, video is captured with a web browser application (Web Browser Application) 13 and a user interface 6 for network access, and a video input device 6 Camera application (Camera Application) 14 used when performing the operation.

The library layer 20 includes a video conference library 21 for performing a videophone sequence control when a videophone is executed, a recording / playback library 22 having a video file recording / playback function, and a network (for example, a network). (From the above content distribution server) Download the video file data! ^ Multimedia service that separates data and voice data 'Library 23 and Power S included.

The driver layer 30 includes software for controlling the hardware β, such as a camera / video encoder 'driver 31, a demultiplexer video decoder' driver 32, an audio driver 33, and a finale system. 'Drivers 3 and 4 are included.

The recording / reproducing library 22 in the second embodiment determines whether or not the input moving image file is in a format that can be processed by the demultiplexing video decoder / driver 32. In the second embodiment, a moving image file input to the demultiplexing video decoder 'Dryno 32' is a moving image file downloaded through the communication device 1, and a moving image file downloaded through the communication device 1 and stored in the storage device 8. A video file obtained through the communication device 1 by the aisle or videophone function, a video file obtained through the communication device 1 by the videophone function and stored in the storage device 8, a video input device 6 and a microphone device 7 Video files. However, the input moving image file may be another type of moving image file as long as the moving image file includes at least video data having a common format.

When the recording / playback library 22 determines that the input video file is in a format that can be processed by the demultiplexer video decoder * driver 32, the obtained video file is transmitted to the demultiplexer video decoder 'driver 32. provide. When the recording / playback library 22 determines that the input video file is not in a format that can be processed by the demultiplexing video decoder 'driver 32, it sends the video file to the multimedia service library 23, By demultiplexing, the video data included in the moving image file is sent to the demultiplexing video decoder 'driver 32. Through the above-described playback control processing, a plurality of types of moving image files having different formats can be played back using the recording / playback library 22 which is a common playback control library.

The recording / reproducing library 22 controls the file system driver 34 to record the moving image file acquired by the communication device 1 in the storage device 8, and stores the moving image file stored in the storage device 8. Also, a reproduction control process for reproducing is executed.

FIG. 6 is a diagram showing a flow of request and data in a process of accumulating a downloaded moving image file by the mobile communication device according to Embodiment 2 of the present invention. The operation of the mobile communication device according to the second embodiment will be described with reference to FIG. 1, FIG. 5, and FIG.

When storing video files downloaded from a server on the network via a communication line, the web browser app, which is an application that provides a user interface for network access, by user operation Record and play the video file download request 6 1 through the location 13 Issued to Library 2 2 The recording / playback library 2 2 is a demultiplexing video decoder that controls the hardware that sends and receives video files 6 3 during network access. The recording request 6 2 is issued to the driver 3 2, and the received video files 6 3 The corresponding multiplexed data 64 is received from the demultiplexer video decoder / driver 32, and the multiplexed data 65 corresponding to the multiplexed data 64 is a driver for controlling the file system. The data is stored in the storage device 8 via the storage device. At the time of storage, identification information indicating that the data is downloaded data is added to the video file data.

Storage of videophone video files>

FIG. 7 is a diagram showing a flow of request and data in a videophone video file storage process performed by the mobile communication device according to Embodiment 2 of the present invention. The operation of the mobile communication device according to the second embodiment will be described based on FIG. 1, FIG. 5, and FIG. When storing video files during a videophone call, the videoconferencing application 11, which is an application that provides a user interface for the videophone, is operated by the user. The recording request 71 is issued to the video conference library 21 that provides a videophone function.The video conference receiving the recording request 71. The library 21 controls the video recording and playback. Issues a recording request 7 2 to the recording and playback library 22 which is the library to be executed The recording and playback library 22 is a demultiplexing video decoder driver which controls the hardware for exchanging video files during a videophone call 3 2 Issue a recording request 73 to the multiplexed data 75 corresponding to the received video file 74. Decoder / Dryno 32 Receives the multiplexed data 76 corresponding to the multiplexed data 75 to the storage device 8 via the file system / dryer 34 which controls the file system. At the time of storage, identification information is added to the video file data to indicate that it is recorded data during a videophone call.

FIG. 8 is a diagram showing a flow of request and data in an accumulation process of camera photographing data by the mobile communication device according to Embodiment 2 of the present invention. Figure 1, Figure 5, and Figure 8 The operation of the mobile communication device according to the second embodiment will be described based on FIG.

When accumulating moving image files captured by the camera of the force device 6 attached to the terminal, a camera application 1 that provides a user interface for photographing the camera by user operation 4, a request for recording a captured image 81 is issued to the recording / reproducing library 22. The recording / playback library 22 issues a recording request 81 to a demultiplexing video decoder 'driver 32 that controls hardware for synthesizing video data and audio data during camera shooting. Demultiplexing video decoder ♦ Driver 32 records and reproduces multiplexed data 85 composed of video data 84 from camera video encoder driver 31 and audio data 83 from audio driver 33 Library 22 The recording / reproducing library 22 stores the multiplexed data 86 corresponding to the multiplexed data 85 in the storage device 8 via the file system driver 34 which is a driver for controlling the file system. . At the time of storage, identification information indicating that the data is video recording data captured by a camera is added to the video file data.

Playback of stored video files>

FIG. 9 is a diagram showing a flow of request and data in a reproduction process of a stored moving image file by the portable communication device according to Embodiment 2 of the present invention. The operation of the mobile communication device according to the second embodiment will be described based on FIG. 1, FIG. 5, and FIG.

In order to play the stored video files of multiple types ^, the movie, view, and application 12 issues a file selection and playback request 50 by user operation to the recording and playback library 22. . Receiving the playback request 50, the recording / playback library 22 determines the data of the video file to be played back, and determines the power of the downloaded video file, that is, the multiplexed data constituting the video file as data. It is determined whether or not the audio data needs to be separated. If the video file 51 to be played is a video file obtained by downloading, the multiplexed data 52 constituting the video file 51 is transferred to the multimedia service library 23. The multimedia 'service' library 23 separates the multiplexed data 52 into «data and audio data, and returns the separated data 53 to the recording / reproducing library 22. Next, the recording / playback library 22 passes §¾ data 56 to a demultiplexing video decoder / driver 32, which is a driver for controlling hardware for video playback, and also converts the audio data 54 into audio data. By passing the data to the audio driver 33, which is a driver for controlling the hardware that performs playback, the playback of video files is realized. When playing back audio data, the audio driver returns the size 55 of the reproduced audio data to the recording / playback library 22.The recording / playback library 22 shows the elapsed time played from the size 55. Then, by synchronizing with the elapsed time and passing the video data 56 to the demultiplexing video decoder / driver 32, the reproduction of the video data and the audio data is synchronized.

When playing a video file recorded during a videophone call, first, the user operates the movie “View ヮ application 12, which is an application that provides a user interface for playing the stored video file. , A playback request 50 of the stored moving image file is issued to the recording and playback library 22. The recording / playback library 22 is a video file recorded in a videophone when the data of the video file 51 to be played back is a video file that is not required to be synchronized with the playback timing of the data and audio data. to decide. In this case, the recording / playback library 22 transfers the multiplexed data 57 of the moving image file 51 to the multiplex separation video decoder Dryno 32 to realize the moving image reproduction. Synchronization of the playback timing of video data and audio data of 5 lb of video files recorded on the terminal is performed within the multiplexed video decoder / driver 32, and audio data 58 is converted as necessary. Dio * Dryno 3 passed to 3

In order to play back a movie file acquired and captured by camera image capture by the elephant input device 6, first, a user application operates a user interface for playing a user interface for playing the stored movie file. ^ A request 50 to play back the stored video file is issued to the recording / playback library 22 through the "beview application 12".

The recording / playback library 22 is a movie file in which the data of the movie file 51 as playback ^ is stored by the camera. For example, «data that does not need to synchronize the playback timing of the data with the audio data Judge. This; ^ First, the recording / playback library 22 passes the multiplexed data 57 of the moving picture file 51 to the demultiplexing video decoder * driver 32 to realize the moving picture reproduction. Synchronization of the playback timing of video data and audio data of the video file 51b recorded by the terminal is performed within the demultiplexer video decoder driver 32, and the audio data 58 is converted to the audio driver as necessary. 3 Passed to 3.

As described above, playback of multiple types of video files with different formats (here, downloaded video files, video files recorded during a videophone call, and video files stored from the camera) This can be realized by using the recording / reproducing library 22, which is a common reproducing function library, the demultiplexing video decoder driver 32, which is a common driver, and common hardware.

As described above, in the mobile communication device according to the second embodiment, a plurality of types of moving image files (for example, downloaded moving image files, moving image files recorded during a videophone call, and moving image File) uses the recording / playback library 22 which is a common playback function library. That is, in the mobile communication device according to the second embodiment, video data of a plurality of types of moving image files that are standardized for the current or future mobile communication device are configured in a common format. Focusing on the fact that it is data, it does not adopt the conventional method that has a playback function library for each of multiple types of video files. Instead, in the mobile communication device according to the second embodiment, the playback control process is performed using the recording / playback library 22 which is a common playback function library capable of processing video data common to a plurality of types of video files. are doing.

As described above, in the mobile communication device according to the second embodiment, a plurality of types of moving image files can be played back by the common recording / playback library 22 through a process called separation. Even if the mobile communication device is to be multi-functional by increasing the types of video files that can be handled by, it is installed compared to the conventional technology that has a playback function library for each of multiple types of video files. The size of the entire program (software group) can be reduced. Because of this, the capacity of the program is Even a mobile communication device with a limited storage area can realize multifunctionality that can handle many types of moving image files.

In the description of the second embodiment, a case has been described in which the mobile communication device uses a downloaded moving image file, a moving image file recorded during a videophone call, and a moving image file stored by camera shooting. However, the mobile communication device according to the second embodiment may be configured to use another moving image file.

In the description of the second embodiment, for the downloaded video file, the data is separated and passed to the recording / playback library 22, and the video file recorded during the videophone call and the video stored by the camera are stored. As for the file, the case where the data is passed to the recording / reproducing library 22 without being separated has been described. However, when the format of the moving image file is different, the processing method of the moving image file is also different. For example, for downloaded video files and video files stored by camera shooting, the data is separated before being passed to the recording / playback library 22, and for video files recorded during a videophone call, the data is not separated. If the format of the moving image file is different, as in the case of passing it to the recording / playback library 22, a different processing method is adopted. Embodiment 3.

FIG. 10 is a diagram showing a flow of a request and data in conversion / accumulation processing of camera photographing data by the portable communication device according to the third and fourth embodiments of the present invention. The hardware configuration of the mobile communication device according to the third embodiment is the same as the configuration in FIG. 1, and the software configuration of the mobile communication device according to the third embodiment is the same as the configuration in FIG. The mobile communication device according to the third embodiment converts a moving image captured by the video input device 6 of its own terminal into a moving image format used for television telephone communication and stores the converted moving image format. The operation of the mobile communication device according to the third embodiment will be described based on FIGS. 1, 5, and 10. FIG.

In order to capture the video file captured by the camera using the video device 6 of the terminal itself and store the captured video file, the camera's application 14 requests the recording of the captured image 7 1 by the user's operation, and the recording / playback library 2 Issued for 2. The recording / playback library 22 is a hardware that combines data and audio data during camera shooting. Demultiplexing video decoder that controls air. Issues recording request 72 to Dryno 32.

The demultiplexer video decoder driver 32 was encoded by the camera 'video encoder' driver 31! ^ Receiving data 74 and encoded voice data 73 from audio driver 33. The demultiplexing video decoder / driver 32 passes the video data 74 and the audio data 73 to the recording / reproducing library 22 as data 75 which is kept separated. The recording / playback library 2 2 passes the received video data Z audio data 7 6 to the multimedia service library 4, and the multimedia 'service library 2 3 converts it to the video format used for videophone communication. Do.

The recording / playback library 22 receives the video file 77 composed of the format-converted data from the multimedia service library 23 and stores the data in the file system via the file system driver 34. I do. At the time of storage, identification information indicating that the data is recording data being captured by the camera is added to the moving image file.

According to the mobile communication device of the third embodiment, the moving image file acquired by the camera shooting is converted into the format of the moving image file referred to by the call destination of the videophone, and is stored in the storage device 8. A moving image file shot by a terminal can be transmitted quickly and easily to a partner terminal.

In the third embodiment, the other points are the same as those in the second embodiment. Embodiment 4.

The hardware configuration of the mobile communication device according to the fourth embodiment is the same as the configuration in FIG. 1, and the software configuration of the mobile communication device according to the fourth embodiment is the same as the configuration shown in FIG. The mobile communication device according to the fourth embodiment converts a moving image file obtained by shooting with a camera by the image device 6 of the terminal into the same format as the downloaded moving image file, and stores the converted file in the storage device 8. The camera photographing operation by the mobile communication device according to the fourth embodiment will be described based on FIGS. 1, 5, and 10. FIG. In order to capture a video file captured by the camera using the »input device 6 of the terminal and store the captured video file, a request to record the captured image 7 1 is sent to the recording / playback library 22 2 by user operation using the camera application 14. Issued to The recording / reproducing library 22 issues a recording request 72 to a demultiplexing video decoder / dryno 32 that controls hard-air that synthesizes audio data and audio data during camera shooting.

The demultiplexing video decoder 'driver 32 receives video data 74 encoded from the camera / video encoder' driver 31 and audio data 73 encoded from the audio 'driver 33. The demultiplexing video decoder 'driver 32 transfers the video data 74 and the audio data 73 to the recording / reproducing library 22 as data 75 with the data separated. The recording / playback library 22 passes the received video data / audio data 76 to the multimedia service library 23, and the multimedia service library 23 places it in the same format as the downloaded video file. Perform the conversion.

The recording / reproducing library 22 receives the video file 77 composed of the format-converted data from the manole media service library 23, and accumulates the data in the file system via the file system dryino 34. Do. In addition, at the time of storage, identification information indicating that the data is recording data being captured by a camera is applied to the video file.

According to the mobile communication device of the fourth embodiment, the moving image file obtained by the camera shooting is converted into the same format as the downloaded moving image file and stored in the storage device 8. Can be quickly and easily installed on the network.

Except for the points described above, Embodiment 4 is the same as Embodiment 2 described above. Embodiment 5

FIG. 11 shows synchronization between audio data and S «data when a downloaded moving image file is reproduced by the portable communication device according to Embodiment 5 of the present invention. FIG. 7 is a diagram showing a sequence for the second embodiment. The hardware configuration of the mobile communication device according to the fifth embodiment is the same as that of FIG. 1, and the software configuration of the mobile communication device according to the fifth embodiment is the same as that of FIG. The portable communication device according to the fifth embodiment performs reproduction by synchronizing audio data and other data when reproducing a downloaded moving image file. The operation of the mobile communication device according to the fifth embodiment will be described based on FIG. 2, FIG. 3, and FIG.

As shown in FIG. 2 or FIG. 3, when playing the downloaded video file, the user operates the application “Movie View which provides a user interface for video playback”. Through the application 12, a moving image file selection command and a reproduction request 50 a are issued to the recording / reproduction library 22 as a common reproduction control library.

As shown in FIG. 2 or FIG. 3, when the video file 1a to be played back is a video file acquired by downloading, the recording / playback library 2 2 multiplexes the video file 51a. Data 52 is converted to Manolechi Media * Service 'Library 23 and a separation request is made. The Manolechimedia service library 23 separates the multiplexed data 52 into «data and audio data, and returns the separated data 53 to the recording / playback library 22.

Next, as shown in FIG. 11, the recording / reproducing library 22 creates a time table 22 5 for synchronizing audio data and video data from the separated data 53. The time tape information 225 describes the cumulative processing size of audio data and the cumulative processing size of video data at a certain time.

At the playback start time A, the recording / playback library 22 passes the video data 56 for one frame to the demultiplexing video decoder 'driver 32, which is a driver for controlling hardware for performing playback. The audio data 54 is passed to an audio driver 33 which is a driver for controlling hardware for performing audio reproduction. Also set the internal timer 221 in case no notification from the audio driver 33 occurs due to an error. The interval between the occurrence of an event of the internal timer 221 is set to the same as that of the notification from the audio driver 33]. The audio 'driver 33 returns the accumulated size (ie, audio data size) 55 of the processed audio data to the recording / playback library 22 at regular time intervals IT. Here, the interval 1T is an interval determined according to a frame rate [ _s — which is the number of frames to be displayed within a fixed time, and is based on one frame period (= 1 ÷ frame rate [s-^). Also need to be short intervals. The recording / playback library 22 calculates the current time from the accumulated size 55 of the processed audio data by using the time table 222. Further, the recording / reproducing library 22 refers to the time table 2 25 to determine at time B whether or not the accumulated size of the processed data has reached one frame of the video. At time B, the cumulative size 55 5 of the processed audio data does not reach the video data for one frame, so the recording / playback library 22 passes the video data to the demultiplexer video decoder 'driver 32. I will not do it.

Further, at time C at which the notification from the audio driver 3 3 is received, the recording / playback library 22 refers to the time table 2 25 in the same manner as at time B, and the cumulative size of the processed elephant data is one frame. Determine if the minute has been reached. At time C, the accumulated size of the processed video data has reached one frame, so the recording and playback library 22 passes the video data 56 of that frame size to the demultiplexing video decoder , The video data is displayed.

At the time D when the notification from the audio driver 33 is issued, the cumulative size of the audio data 55 (for example, the cumulative size of the audio data processed from time A to time D) is passed to the audio driver 33. Before reaching the size of the audio data 54 (for example, at time A, the audio data passed from the recording / playback library 22 to the audio driver 33), the recording / playback library 22 returns the audio data 54 again. Pass it to the audio driver 33 (for example, in B Temple D) so that the audio data to be processed by the audio driver 43 does not expire. Further, at the time E when the notification is received from the audio driver 33, the recording / playback library 22 refers to the time table 225 in the same manner as the time C, and the cumulative size of the data becomes If the number of frames that has been played back at the time reaches + (data of one frame), the recording and playback library The data 56 is passed to the demultiplexing video decoder Dryno 33, and the data is displayed.

As described above, according to the mobile communication device according to the fifth embodiment, the recording / reproducing library 22 receives the amount of audio data processing from the audio / drink 33 and reproduces the video in accordance with the audio processing. Therefore, the audio can be synchronized with the audio without interruption.

Next, an example of ^^ for reproducing an illegal content having no audio data will be described. As can be understood from FIG. 11, when the control P for audio / video data reproduction is performed using only the internal timer 221, the video data is displayed at the time C after the time A. Unauthorized content that lacks audio data between time A and time B; ^, audio data from time B to time C must be played between time A and time B in order not to interrupt audio playback Therefore, the audio data being reproduced at time C is that of time D. Therefore, the result is that the synchronization of audio and video data reproduction is not synchronized.

In the mobile communication device according to the fifth embodiment, when there is no audio data to be reproduced between time A and time B, the audio driver 33 transmits the audio data from time B to time C so that the reproduced sound is not interrupted. Play the audio data to be played between time A and time B. As a result, the accumulated data size returned from the audio driver 33 to the recording / playback library 22 at time B is the value originally returned at time C. At time B, the recording / playback library 22 uses the time table 25 to determine the current time from the accumulated data size of the audio data.As a result, it judges that it is time C, and demultiplexes the video data 56. Video decoder 'Dryoku' 32 passes the video data. For this reason, in the audio / video synchronization method using only the internal timer 221, even in the case of illegal content that lacks audio data such that synchronization is lost in the middle, audio data and data are not interrupted at all times. Can be synchronized.

FIG. 12 is a diagram showing a sequence in which an error has occurred when playing a moving image file while synchronizing audio data and data with the portable communication device according to the fifth embodiment. The portable communication device according to the fifth embodiment is described with reference to FIGS. 6329

The operation of the error processing will be described.

As shown in FIG. 2 or FIG. 3, in the same manner as in the normal operation, the video playback / selection command and the playback request 50a are shared by the user through the movie-view-application 12 through the playback control. Issued to the recording / playback library 22 as a library.

As shown in FIG. 2 or FIG. 3, the recording / reproducing library 22 sends the multiplexed data 52 constituting the moving image file 51a to the Manore media service library 23 and sends a separation request. Do. The multimedia 'service' library 23 separates the multiplexed data 52 into video data and audio data, and returns the separated data 53 to the recording / playback library 22.

Next, as shown in FIG. 12, the recording / reproducing library 22 creates a time table 22 5 for synchronizing audio data and video data from the separated data 53. In this time table 225, the cumulative processing size of audio data at a certain time and the cumulative processing size of data are described.

At playback start time A, the recording / playback library 22 passes one frame of video data 56 to the demultiplexing video decoder 'driver 32, which is a driver for controlling hardware for playing back video. The audio data 54 is passed to an audio driver 33 which is a driver for controlling hardware for performing audio reproduction. Also, set the internal timer 221 in case no notification from the audio driver occurs due to an error. The interval between the occurrence of events of the internal timer 222 is set to the same as the interval of the notification generated from the audio driver 33. -The audio data is returned to the recording and playback library 22 at regular intervals] T at regular intervals] T. If the audio data size 55 is not returned to the recording / playback library 22 for some reason (indicated by 符号 in Figure 12), a preset event 2 23 of the internal timer 2 21 occurs and the recording / playback occurs. At time Β, the library 22 can determine whether the cumulative size of the processed video data has reached one frame of the video. At time Β, it was processed! ^ Since the cumulative size of the data does not reach the data for one frame, The recording / reproducing library 22 does not pass the data to the demultiplexing video decoder 'driver 32.

Furthermore, for some reason, the notification from the audio driver 33 was not returned to the recording / playback library 22 ^ (see Q in Fig. 12). At the time C, when the event 2 23 of 22 1 occurs, the recording / reproducing library 22 can determine whether the cumulative size of the processed video data has reached one frame of the moving image. At time C, since the accumulated size of the processed video data has reached one frame of data, the recording / playback library 22 converts the one frame of video data 56 into a demultiplexed video decoder 'driver. 3 can be passed to 2.

Similarly, when the notification from the audio driver 3 3 is not returned to the recording / playback library 22 (reference R in FIG. 12), the event of the preset internal timer 22 1 similarly occurs. At time D, the recording / reproducing library 22 can determine the processing status of the video data and the audio data. At time D, it can be determined from the time table 2 25 that the audio data 5 passed to the audio driver 3 3 in advance may be lost, so the recording / playback library 22 sends the next audio data 5 4 To audio driver 3 3.

As described above, according to the portable communication device of the fifth embodiment, the notification of the audio data processing amount (that is, the audio data size) 55 from the audio driver 33 is recorded for some reason. Even if the playback library 22 is not reached, the playback timing of the audio data and the video data can be set by the event 2 23 of the internal timer 2 21 set in advance. Therefore, the video can be played back while synchronizing the audio with! ^.

FIG. 13 is a diagram showing a sequence in which the mobile communication device according to the fifth embodiment reproduces a moving image file composed of only data. The playback operation of a moving image file composed only of video data of the mobile communication device according to the fifth embodiment will be described with reference to FIGS.

As shown in FIG. 2 or FIG. 3, by the user's operation, the movie file selection command and the playback request 50a are shared through the movie.view.application 12. It is issued to the recording / reproducing library 22 as a general reproducing control library. As shown in FIG. 2 or FIG. 3, the recording / reproducing library 22 sends the multiplexed data 52 constituting the moving image file 51a to the Manolechi media service library 23 and issues a separation request. The multimedia service library 23 separates the multiplexed data 52 into video data and audio data, and returns the separated data 53 to the recording / playback library 22. However, in the moving image playback mode shown in FIG. 13, since the moving image file is composed of only video data, no audio data exists.

Next, as shown in FIG. 13, the recording / reproducing library 22 creates, from the separated data 53, a time tape information 22 for matching the reproduction timing of the audio data and the data. In this case, since there is no audio data, the time table 2 25 describes only the cumulative processing size of the video data at a certain time. At the playback start time A, the recording / playback library 22 passes one frame of video data 56 to the demultiplexing video decoder / driver 32, which is a driver for controlling the hardware that performs video playback. In this case, since there is no audio data, the recording / reproducing library 22 does not pass the audio data to the audio driver 33, so that the audio 'driver does not return a notification at regular intervals ΐτ. Also, as in the examples of FIGS. 11 and 12, the internal timer 22 1 is set at a fixed interval IT.

The internal timer 222 notifies the recording / reproducing library 22 of the event 222 after the time IT (time Β in FIG. 13). At this time ライブラリ, the recording / reproducing library 22 can determine whether the cumulative size of the processed video data has reached one frame of the moving image. At time Β, the accumulated size of the processed 8 ^ data does not reach the data of one frame, so the recording / reproducing library 22 sends the video data to the demultiplexed video decoder. do not do.

Further, after the time 1T has elapsed, the internal timer 222 notifies the recording / playback library 22 of the event 222 (time C in FIG. 13). At time C, since the accumulated size of the processed video data has reached one frame of the video, the recording / playback library 22 converts the data 56 of one frame into a demultiplexed video decoder and a driver 3. 2 can be passed. As described above, according to the mobile communication device according to the fifth embodiment, even when a moving image file that does not include audio data is reproduced, the mobile communication device is created from the video data by the event 2 23 generated by the internal timer 2 21. Movies can be played back according to the timetable 2 25.

FIG. 14 is a diagram showing a reproducing method when the downloaded moving image file is frame-by-frame reproduced by the portable communication device according to Embodiment 6 of the present invention. The hardware configuration of the mobile communication device according to the sixth embodiment is the same as the configuration in FIG. 1, and the software configuration of the mobile communication device according to the sixth embodiment is the same as the configuration in FIG. Although the mobile communication device according to the sixth embodiment can play back the downloaded moving image file by frame, the operation of the mobile communication device according to the sixth embodiment will be described with reference to FIG.

The movie, view, and application 12 have a user interface for advancing frames, and a frame advance request 81 is sent to the recording and playback library 22 in accordance with the input. At time A, the movie playback view 22 received a frame advance request 8 1 from the movie view application 12, and the recording / playback library 2 2, if not playing back at that time, is a multimedia * service library 2 3 The received demultiplexed data 83 passes the one-frame «data 86> to the demultiplexing video decoder driver. If the reproduction is being performed, the reproduction is stopped at that point, but the video data 86 displayed by the demultiplexing video decoder 'driver 32 is kept displayed as it is.

In response to the frame feed request 81 from the movie, the view II, and the application 12 transmitted continuously, the recording / reproducing library 22 passes the video data 86 of the next frame to the demultiplexing video decoder 'driver 32. In this manner, in the mobile communication device according to the sixth embodiment, video data can be displayed frame-by-frame in response to an input from a user.

FIG. 15 shows a method of capturing frame-by-frame I data as a still image when the mobile communication device according to Embodiment 6 is playing back a downloaded video file by frame-by-frame playback. .

Movie · View ヮ · Application 1 2 is a user-in In addition to the interface, a user interface for capturing still images is provided, and a capture request 91 is sent to the recording / reproducing library 22 according to the input.

Still image capture is performed during frame-by-frame playback. Movie ・ View ヮ・ Application 1 2 In response to the frame advance request 8 1 notified, the recording / playback library 22 passes the video data 86 for one frame to the demultiplexing video decoder Is sent to the display memory 41 and displayed on the display device. The end user watching the frame-by-frame playback display operates the capture user interface, and the capture request 91 from the movie's view application application 12 is sent to the recording / playback library 22. The recording / reproducing library 22 captures the video data 96a currently displayed on the display device from the display memory 41 at that time. The elephant data 96a is converted into a still image format suitable for storage, and the converted video data 96b is passed to the file system driver 34 and stored in the file system.

In this way, the portable communication device according to Embodiment 6 can record and save, as a still image, image data reproduced and played back by the end user by frame.

Except for the above points, Embodiment 6 is the same as Embodiment 5 described above. Industrial applicability

As described above, in the present invention, the software group installed in the storage unit includes a library capable of processing video data commonly included in a plurality of types of moving image files. This library has a function of determining the type of a video file and a playback control function. If the video file obtained by the video file obtaining unit is in a format that can be processed by the depth driver, it is obtained by the video file obtaining unit. When the video file obtained by the video file obtaining means is not in a format that can be processed by the decompile driver, the video file obtained by the video file obtaining means is separated from the video file obtained by the video file obtaining means, thereby obtaining the video file. Obtained by means The video data contained in the video file is provided to the device dryino. As described above, according to the present invention, since moving image files of different formats can be played back by the common library, multifunctionalization can be realized while minimizing an increase in the size of the entire program installed in the storage device. .

Further, since the present invention has a function of distinguishing moving image files of different formats by using a common library, a software configuration that uses a common user interface at the time of playing a moving image regardless of the type of the moving image file format is provided. This can improve the user's convenience.

In addition, when converting a moving image file acquired by the moving image means into a format of a downloaded moving image file and recording the converted moving image file in the storage means, the moving image previously stored on the terminal is quickly and easily uploaded to a server on the network. can do.

In addition, the video file obtained by the video shooting means is converted to the format of the video file sent from the destination of the videophone call and recorded in the storage means. It is possible to quickly and easily transmit a moving image captured by the terminal to the partner terminal.

In addition, when a function of decoding the data of the moving image file obtained by the moving image file obtaining means in accordance with the time stamp and a function of ignoring the time stamp and decoding the data are provided, the data of different formats can be shared by a common decoder. Thus, it is possible to realize a function of reproducing moving image files of a plurality of formats while suppressing an increase in the size of the entire program.

Claims

The scope of the claims

1. A portable communication device that handles multiple types of video files including video data with a common format.

Moving image file obtaining means for obtaining the moving image file,

Display means for displaying an image,

Storage means;

A control unit that controls operations of the moving image file obtaining unit, the storage unit, and the display unit using a software group installed in the storage unit;

The software group installed in the storage means,

A device driver capable of processing at least video data having the same format, and displaying on the display means a video based on the video file obtained by the video file obtaining means;

When the moving image file obtained by the moving image file obtaining means is in a format that can be processed by the device driver, the moving image file obtained by the moving image file obtaining means is used as the device driver, and the moving image file obtaining means is provided. If the moving image file obtained by the moving image file is not in a format that can be processed by the decompile driver, the moving image file obtained by the moving image file obtaining unit is separated into the moving image file obtained by the moving image file obtaining unit. A portable communication device comprising: a library that executes a reproduction control process for sending the data including the common format to the depth driver.

2. The mobile communication device according to claim 1, wherein each of the plurality of types of moving image files includes at least 赚 data and audio data.

3. The software group installed in the storage means includes an application for performing a user interface for the plurality of types of video files. 3. The mobile communication device according to claim 1, wherein:

4. The moving image file obtaining means is:

Communication means for obtaining video files;

An image processing device, a video information processing device, a microphone device, and an audio information processing device, the data being obtained by the elephant input device and being encoded by the! A moving image for generating a moving image file containing audio data encoded by the audio information processing device;

The mobile communication device according to claim 1, further comprising:

5. In the moving image file obtained by the communication means,

A video file downloaded from the content distribution server,

The video file sent from the videophone

5. The portable communication device according to claim 4, wherein

6. The library capability is that the moving image file acquired by the moving image file acquiring unit is recorded in the storage unit, and the reproduction control process is executed by using the moving image file recorded in the storage unit. Claim 1 or 2

7. The portable communication device according to claim 5, wherein the moving image file acquired by the moving image photographing means is converted into a format of the downloaded moving image file and recorded in the storage means. apparatus.

8. The library device according to claim 5, wherein the moving image file obtained by the moving image photographing means is converted into a moving image file format specified by the call destination of the videophone and recorded in the storage means. A portable communication device as described.

9. The moving image file obtained by the moving image file obtaining means is time-stamped. A function for decoding the data of the moving image file acquired by the moving image file acquiring means according to the time stamp, and a function of ignoring the time stamp. 3. The portable communication device according to claim 1, further comprising information processing means having the following.

1 0. It has an audio driver that processes audio data,

Providing the audio data separated from the video file to the audio driver,

Providing the video data separated from the moving image file one frame at a time

At each time interval determined based on the cumulative size of the audio data processed by the audio driver, the cumulative size of the video data processed by the depth driver is checked, and the cumulative size of the processed video data is determined by a predetermined value. When the standard is reached, the video data is provided to the device driver.

3. The portable communication device according to claim 2, wherein:

1 1. Has an internal timer,

When the cumulative size of the audio data processed by the audio driver is not notified, it is preferable to check the cumulative size of the video data processed by the depth driver at every time interval determined by the internal timer. 10. The mobile communication device according to claim 10, wherein the mobile communication device is a portable communication device.

1 2. Has an internal timer,

Providing the video data separated from the video file to the decompile driver one frame at a time,

At each time interval determined by the internal timer, the cumulative size of the video data processed by the device driver is checked. If the cumulative size of the processed video data reaches a predetermined standard, the video Said depilation of data Performing the offer to the driver

The mobile communication device according to claim 1, wherein: