JP2008136057A - Motion picture file generating device and control method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile phone such that a landscape motion picture of high picture quality can be viewed and a portrait motion picture can be easily viewed. <P>SOLUTION: When the motion picture of high picture quality is viewed, it is displayed while inscribed in the landscape display screen of the mobile phone as shown in (A) when the mobile phone is held laterally and in the portrait display screen 41 of the mobile phone as shown in (B) when the mobile phone is held longitudinally. The motion picture 43 can be viewed in a state wherein the mobile phone is easy to hold. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a moving image file generation apparatus and a control method thereof.

It is considered to distribute a moving image from a server to a user terminal such as a mobile phone. Since mobile phones have different capabilities depending on the model, some mobile phones change the compression rate of moving image files according to the capabilities of user terminals that distribute moving images (Patent Document 1).
JP 2006-121614 A

In addition, there is a technique that prevents a deterioration in image quality even when a high-definition image is distributed when distributing moving image data to a receiving device (Patent Document 2).
JP 2005-176068 A

  In a mobile phone, when displaying a moving image with a large image, the moving image is displayed with the mobile phone facing sideways. However, it may be difficult to view the video because the mobile phone must be turned sideways.

  An object of this invention is to make it easy to see a moving image.

  A moving image file generating apparatus according to the present invention generates a moving image for horizontal orientation corresponding to the size and aspect ratio of a horizontal image displayed when a vertical display screen provided in a mobile phone is turned horizontally from a given moving image file. A horizontally oriented moving image file generating means for generating a horizontally oriented moving image file, a vertically oriented image displayed when the vertically long display screen provided in the mobile phone is vertically oriented from the given moving image file; When the display screen is in landscape orientation, the length of the display screen in the vertical direction is the length in the horizontal direction, and the portrait screen is composed of portrait images having the same aspect ratio as the aspect ratio of the landscape image. Vertical video file generation means for generating a vertical video file representing a video, and the above-mentioned horizontal motion for a plurality of types of mobile phones. Generated under the control of the horizontal moving image file generating means and the vertical moving image file generating means, and the control means so as to perform the file generating process and the vertical moving image file generating process. A storage control means for storing the horizontal moving image file and the vertical moving image file in a moving image file storage device corresponding to the type of the mobile phone is provided.

  The present invention also provides a control method suitable for the moving image file generating apparatus. In other words, this method corresponds to the size and aspect ratio of the horizontal image displayed when the horizontal video file generation means switches the vertical display screen provided on the mobile phone from the given video file to the horizontal orientation. A video file for horizontal orientation that represents the video for horizontal orientation is generated, and the video file generation means for vertical orientation displays the portrait display screen provided on the mobile phone from the given video file in portrait orientation. When the display screen is turned horizontally, the vertical length of the display screen is the horizontal length and has the same aspect ratio as the aspect ratio of the horizontal image. A vertical moving image file representing a vertical moving image composed of images is generated, and the control means performs the horizontal moving image for a plurality of types of mobile phones. The horizontal moving image file generating means and the vertical moving image file generating means are controlled so as to perform the file generating process and the vertical moving image file generating process, and the storage control means is controlled under the control of the control means. The moving image file for horizontal orientation and the moving image file for vertical orientation generated in the above are stored in a moving image file storage device corresponding to the type of mobile phone.

  According to the present invention, from a given video file, a horizontal video file representing a horizontal video corresponding to the size and aspect ratio of the horizontal image displayed when the vertically long display screen provided in the mobile phone is turned horizontally. , A portrait image that is displayed when the portrait display screen is set to portrait orientation, and the display screen portrait orientation when the display screen is set to landscape orientation is a landscape length image. A vertical moving image file representing a vertical moving image of a vertical image having the same aspect ratio is generated for a plurality of mobile phones. The generated horizontal moving image file and vertical moving image file are stored corresponding to the type of mobile phone. Since a horizontal moving image file and a vertical moving image file are generated corresponding to the type of the mobile phone, the horizontal moving image file or the vertical moving image file can be transmitted to the mobile phone as necessary. On mobile phones, you can watch high-quality video for landscape orientation and easy-to-view video for portrait orientation.

  Receiving means for receiving a moving image file request transmitted from a mobile phone, identifying means for identifying the mobile phone that has transmitted the moving image file request received by the receiving means, and corresponding to the mobile phone identified by the identifying means You may provide the moving image file transmission means which reads a horizontal moving image file or a vertical moving image file from the said moving image file storage device, and transmits to the mobile phone which transmitted the said moving image file request.

  FIG. 1 shows an embodiment of the present invention and shows an outline of a moving image communication system.

  The moving image communication system includes n mobile phones 1 to n, a content server 10 and a moving image server 20 that can communicate with each other via a network such as the Internet.

  The content server 10 stores a moving image file representing a moving image. The moving image file is given from the content server 10 to the moving image server 20 and transmitted from the moving image server 20 to the mobile phones 1 to n. The display screens provided in the mobile phones 1 to n are generally vertically long. For this reason, when displaying a high-quality moving image, a moving image file representing the moving image displayed sideways is transmitted to the mobile phones 1 to n. Since the horizontal moving images are displayed on the display screens of the mobile phones 1 to n, the users of the mobile phones 1 to n see the moving images displayed on the display screen with the mobile phones 1 to n facing sideways. However, since the mobile phones 1 to n have to be turned sideways, it may be difficult to see a moving image while holding the mobile phones 1 to n. In this embodiment, a moving image file representing a vertically oriented moving image can be transmitted to the mobile phones 1 to n.

  In FIG. 1, mobile phones 1 to n are illustrated as moving image file transmission targets. However, the moving image file is not limited to a mobile phone and is transmitted to a portable information terminal such as a PDA (Personal Digital Assistants). May be.

  FIG. 2 is a block diagram showing an electrical configuration of the moving image server 20.

  The moving image server 20 is given the original moving image file, conversion parameters, and transmission parameters stored in the content server 10 from the content server 10. The original moving image file, conversion parameters, and transmission parameters given to the moving image server 20 are input to the conversion information management circuit 21 and temporarily stored. The original moving image file, conversion parameters, and transmission parameters stored in the conversion information management circuit 21 are given to the moving image conversion circuit 22.

  FIG. 3 is an example of a conversion parameter, and FIG. 4 is an example of a transmission parameter.

  Referring to FIG. 3, the conversion parameter determines the conversion logic when the original moving image file is transmitted to mobile phones 1 to n. The conversion parameter items include priority setting, stereo setting, and display setting processing.

  The priority setting is for setting the quality of the moving image represented by the moving image file when transmitting the moving image file to the mobile phones 1 to n. The priority settings include standard image quality, image quality priority, motion priority, and audio priority. Image quality priority is set to reduce the frame rate of moving images and increase the video bit rate. Motion priority is set to increase the video bit rate and decrease the audio bit rate. Audio priority is set to reduce the video bit rate and increase the audio bit rate.

  The stereo setting is used to set whether to output automatically stereo audio or to monaural audio. The display setting is for setting the vertical display or horizontal display of the moving image. The vertical display is a display suitable when the mobile phones 1 to n are viewed in the vertical direction. The horizontal display is a display suitable when the mobile phones 1 to n are viewed sideways.

  Referring to FIG. 4, the transmission parameters are the mobile phone company (destination carrier) with which the mobile phone that transmits the video file is contracted and the transmission method (limited to streaming video files, or allows download of video files Is set).

  Returning to FIG. 2, the moving image server 20 also includes a terminal information management circuit 23. The terminal information management circuit 23 stores terminal information about the mobile phones 1 to n to be transmitted. The terminal information stored in the terminal information management circuit 23 is given to the moving image conversion circuit 22.

  FIG. 5 is an example of terminal information.

  The terminal information includes mobile phone video file format, image resolution (image standard) that can be displayed on the display screen of the mobile phone, upper video bit rate, lower video bit rate, frame The rate, type of audio codec, upper limit audio bit rate, lower limit audio bit rate, sampling frequency, display size, 240 pixel x 180 pixel display orientation, etc.

  Of these terminal information, the main information will be described. The video bit rate represents the amount of data per second of image data. In mobile phones, since the upper and lower video bit rates are determined, the upper video bit rate and the lower video bit rate are defined in the terminal information. The frame rate is the number of frames per second of images constituting a moving image. The audio bit rate represents the amount of data per second of audio data. As for the audio bit rate, since the upper limit and the lower limit are determined in the mobile phone, the upper limit audio bit rate and the lower limit audio bit rate are defined in the terminal information.

  The display size is the size of the display screen provided in the mobile phone. 96 × 80 indicates 96 horizontal pixels and 80 vertical pixels. Sub-QCIF (Quarter Common Intermediate Format) is 128 pixels × 96 pixels. QCIF is 176 × 144 pixels. QVGA (Quarter Video Graphics Array) is 320 pixels by 240 pixels. In the example shown in FIG. 5, the display size of the mobile phone 1 is one of 96 × 80, the display size of the mobile phone 2 is one of Sub-QCIF, and the mobile phone 3 to the mobile phone. The display size of 5 is QCIF, but the mobile phones 6 and 7 are 240 × 180 pixels and QVGA. The mobile phones 1 to 5 can display only videos of any corresponding size, but the mobile phones 6 and 7 have a video size of 240 pixels x 180 pixels or a QVGA size. Indicates that the video can be displayed. In the case of a mobile phone that can display both a video with a size of 240 pixels × 180 pixels or a video with a size of QVGA, such as a mobile phone 6 or 7, a mobile phone with a size of QVGA Although it cannot be displayed unless it is in landscape orientation, a moving image having a size of 240 pixels × 180 pixels can be displayed in either a portrait orientation or a landscape orientation. The display direction of 240 pixels × 180 pixels indicates the display direction when a moving image file representing a moving image having a size of 240 pixels × 180 pixels is given on a mobile phone. When the display orientation is portrait orientation, if a movie file with a size of 240 pixels x 180 pixels is given, a 90 degree rotation process is performed to make the movie easier to see when the mobile phone is oriented vertically. Is called. On the other hand, when the display orientation is landscape, if a movie file with a size of 240 pixels × 180 pixels is given, the movie rotation process is performed in the same way as when a movie with a QVGA size is given. Is not done. The mobile phone must be turned sideways. For this reason, in this embodiment, a mobile phone that has been rotated 90 degrees in the moving image server 20 is transmitted for a mobile phone whose display direction is landscape. Even a mobile phone that does not perform rotation processing can watch a video of 240 pixels x 180 pixels in a portrait orientation.

  Returning to FIG. 2 again, in the moving image conversion circuit 22, the mobile phone 1 is based on the original moving image file, the conversion parameter and the transmission parameter given from the conversion information management circuit 21, and the terminal information given from the terminal information management circuit 23. The moving image conversion process is performed so as to generate a moving image file corresponding to each display size of .about.n. This moving image conversion process will be described later in detail.

  The moving image files corresponding to each of the mobile phones 1 to n in the moving image conversion circuit 22 are given to the converted moving image management circuit 24 and stored therein.

  When the moving image server 20 is accessed from any one of the mobile phones 1 to n, terminal information for identifying the accessed mobile phone is input to the model discrimination circuit 25 of the moving image server 20. In the model discrimination circuit 25, the model of the mobile phone that has accessed the video server 20 is discriminated, and data representing the discriminated model is input to the video transmission circuit 26. A moving image file corresponding to the accessed mobile phone is read from the converted moving image management circuit 24 and input to the moving image transmission circuit 26. The moving image file corresponding to the accessed mobile phone is transmitted by the moving image transmission circuit 26 to the accessed mobile phone.

  6A and 6B show the appearance of a mobile phone.

  FIG. 6A shows a state in which a moving image is displayed by horizontal display on the mobile phone 40, and FIG. 6B shows a state in which a moving image is displayed by vertical display on the mobile phone 40.

  6A and 6B, the mobile phone 40 is configured such that an upper half 41 and a lower half 46 can be bent. An antenna 42 is formed on the upper half 41. In addition, a display screen 41A is provided almost in front of the upper half 41. The lower half 46 is formed with an operation unit 47 such as a numeric keypad.

  When a moving image is displayed in the horizontal display, the user of the mobile phone 40 has the mobile phone 40 so as to be in a horizontal orientation as shown in FIG. The moving image 43 is displayed on the display screen 41 in a state where the mobile phone 40 is in the horizontal direction.

  When a moving image is displayed in the vertical display, the user of the mobile phone 40 has the mobile phone 40 so as to be oriented vertically as shown in FIG. The moving image 43 is displayed on the display screen 41 in a state where the mobile phone 40 is in the vertical direction. Hatchings 45 and 46 are shown above and below the moving image 43 to indicate that the moving image 43 is not displayed.

  FIG. 7A shows a moving image 43 displayed on the display screen 41 in the horizontal display.

  When the mobile phone 40 is held sideways, the display screen 41 has a width w1 and a height h1. The aspect ratio (horizontal vs. vertical) is w1: h1. If the display screen has a QVGA display size, the width w1 = 320 pixels and the height h1 = 240 pixels. When a moving image (horizontal moving image) composed of an image having a width of 320 pixels and a height of 240 pixels is given, the moving image can be displayed by turning the mobile phone horizontally as shown in FIG.

  FIG. 7B shows the relationship between the moving image and the display screen 41 when the moving image is displayed in the vertical display.

  When the mobile phone 40 is oriented vertically, the display screen 41A has a width h1 and a height w1 (the vertical length h1 in the horizontal orientation is the horizontal length h1 in the vertical orientation). In such a state, when the vertically oriented moving image 43 is displayed on the display screen 41A so as to fit within the display screen 41, the width of the moving image 43 is set to the vertical direction of the mobile phone 40 as shown in FIG. This corresponds to the width h1 at that time (that is, 240 pixels). The aspect ratio of movie 43 is the same as that of QVGA. Therefore, the height h2 of the moving image 43 is 180 pixels. If it is a moving picture of 240 pixels × 180 pixels, it will fit in the display screen 41 when the mobile phone 40 is oriented vertically as shown in FIG.

  As described above, the moving image 43 is not displayed in the regions 45 and 46 (both indicated by hatching) above the region where the moving image 43 is displayed on the display screen 41.

  FIG. 8 is a flowchart showing a processing procedure of the moving image server 20.

  As described above, the original moving image file, conversion parameters, and transmission parameters given from the content server 10 are input to the moving image conversion circuit 22 via the conversion information management circuit 21 (step 31). Conversion logic is determined based on the input conversion parameters (step 32). That is, on the basis of the priority setting items, the quality of the moving image file to be converted, the stereo setting, the display setting for vertical display or horizontal display, and the like are determined.

  If the display setting is not vertical display (NO in step 33), a moving image file of a size that can be displayed on the mobile phone to generate a moving image file for transmission is generated (step 36).

  If the display setting is vertical display (YES in step 33), it is confirmed whether the display orientation of 240 pixels × 180 pixels on the mobile phone that is to generate the moving image file for transmission is vertical (step 34). ). For mobile phones that cannot display a video of 240 pixels x 180 pixels, information about the display direction of 240 pixels x 180 pixels is not included in the terminal information, so this display direction is determined not to be vertical. .

  If it is in the vertical orientation (YES in step 34), a vertical display moving image file of 240 pixels × 180 pixels is generated as described above (step 35). If it is not vertically oriented (NO in step 34), a horizontal display moving image file of 240 pixels × 180 pixels is generated (step 37). When a moving image file for vertical display is given to the mobile phone, a moving image that is easy to view is displayed with the mobile phone held in a vertical orientation without being rotated. When a video file for landscape display is given to a mobile phone, it will be difficult to view the video if the mobile phone is not held horizontally unless rotation processing is performed. As a result, the movie file is rotated 90 degrees. However, regardless of the display setting, two types of video files for vertical display and video files for horizontal display may be generated.

  The generated moving image file is stored in the converted moving image management circuit 24 corresponding to the mobile phone (step 41). The processing of steps 32 to 38 is repeated for all mobile phones 1 to n (step 42).

  9 and 10 are flowcharts showing the processing procedure of the moving image communication system.

  It is assumed that the converted moving image management circuit 24 of the moving image server 20 stores moving image files corresponding to all the mobile phones 1 to n to be transmitted as described above.

  The moving image transmission link data is transmitted from the moving image server 20 to the content server 10 (step 81). The moving image transmission link data transmitted from the moving image server 20 is received by the content server 10 (step 71). Then, it is described in the HTML (Hyper Text Markup Language) page of the content server 10.

  When the HTML page of the content server 10 is accessed by the mobile phone (step 51), the moving image transmission link data is transmitted from the content server 10 to the mobile phone (step 72).

  An HTML page is displayed on the display screen of the mobile phone, and a video transmission link is embedded in the HTML page. When the link is clicked by the mobile phone and the moving image transmission link is accessed (YES in step 52), the http request file is transmitted from the mobile phone to the linked moving image server 20. The header of the http (Hyper Text Transfer Protocol) request file includes a User-Agent that identifies the model of the mobile phone. As a result, the model information is transmitted from the mobile phone to the moving image server 20 (step 53). When the mobile phone model information or the like is received by the video server 20 (step 82), a video display HTML file corresponding to the mobile phone company and the model is generated and transmitted to the mobile phone (step 83).

  FIGS. 11A and 11B are examples of scripts described in the generated HTML file. FIG. 11A shows a case where a mobile phone company of Company A downloads and plays a moving picture on a mobile phone of 3 gpp (Generation Partnership Project) 2 format. FIG. 11 (B) shows a case where a moving image is downloaded and played on a mobile phone of the B person's mobile phone company. In any case, a moving image display HTML file corresponding to the mobile phone company and the model is generated and transmitted to the mobile phone.

  Referring to FIG. 9, the HTML file transmitted from moving image server 20 is received by the mobile phone, and the moving image display HTML page is displayed on the display screen of the mobile phone (step 54). A download link is embedded in the video display HTML page displayed on the display screen of the mobile phone, and when the download link is clicked by the mobile phone user (YES in step 55), the mobile phone Model information, a video request, etc. are transmitted from the mobile phone to the video server 20 (step 56).

  When the model information, the movie request, etc. transmitted from the mobile phone are received by the movie server 20, the movie file corresponding to the model is read from the converted movie management circuit 24 and transmitted to the cell phone (step 85).

  When the moving image file transmitted from the moving image server 20 is received by the mobile phone (step 58), it is confirmed whether the moving image represented by the received moving image file is 240 pixels × 180 pixels (step 59). . If it is 240 pixels × 180 pixels (YES in step 59), it is confirmed whether or not the moving image has been rotated 90 degrees as described above (step 60). If 90 degree rotation processing has been performed, information to that effect will be recorded in the header of the video file, so it is confirmed from the information whether 90 degree rotation processing has been performed. Is done. If the 90-degree rotation process has not been performed (NO in step 60), the 90-degree rotation process is performed so that it is easy to see when the mobile phone is held vertically as described above (step 61). This 90 degree rotation process can be realized by rotating the display position of the display screen by 90 degrees. If the 90 degree rotation process is being performed (YES in step 60), the process in step 61 is skipped. If the received moving image file is not 240 × 180 pixels (NO in step 59), the processing in steps 60 and 61 is skipped.

  Thereafter, the moving image represented by the received moving image file is displayed on the display screen of the mobile phone (step 62). If the video is displayed vertically, it will be easy to view with the mobile phone in a vertical position.

1 shows an overview of a video communication system. It is a block diagram which shows the electric constitution of a moving image server. It is an example of a conversion parameter. It is an example of a transmission parameter. It is an example of terminal information. (A) And (B) is a front view of a mobile phone. (A) and (B) are examples of moving images displayed on the display screen. It is a flowchart which shows the process sequence of a moving image server. It is a flowchart which shows the process sequence of a moving image communication system. It is a flowchart which shows the process sequence of a moving image communication system. (A) and (B) are examples of HTML scripts.

Explanation of symbols

20 Video server
22 Movie conversion circuit
23 Terminal information management circuit
24 Conversion video management circuit
25 Model discrimination circuit
26 Movie transmission circuit

Claims (3)

Creates a landscape video file that represents a landscape video that corresponds to the size and aspect ratio of the landscape image that is displayed when the portrait display screen provided on the mobile phone is turned horizontally from the given movie file. Movie file generation means,
A vertically oriented image that is displayed when the vertically long display screen provided on the mobile phone is turned vertically from the given video file, and the display screen is vertically oriented when the display screen is turned horizontally. A vertical video that generates a vertical video file that represents a vertical video consisting of a vertical image that has the same length as the horizontal image and has the same aspect ratio as the horizontal image. File generation means,
Control means for controlling the horizontal moving picture file generating means and the vertical moving picture file generating means so as to perform the horizontal moving picture file generating process and the vertical moving picture file generating process for a plurality of types of mobile phones; And storage control means for storing the horizontal moving picture file and the vertical moving picture file generated under the control of the control means in a moving picture file storage device corresponding to the type of mobile phone,
A moving image file generating apparatus. A receiving means for receiving a video file request sent from a mobile phone;
Identification means for identifying the mobile phone that has transmitted the video file request received by the receiving means, and a horizontal video file or a vertical video file corresponding to the mobile phone identified by the identification means from the video file storage device A video file transmission means for reading and transmitting the video file request to the mobile phone that has transmitted the request,
The moving image file generating apparatus according to claim 1, comprising: The horizontal moving image file generation means represents the horizontal moving image corresponding to the size and aspect ratio of the horizontal image displayed when the vertical display screen provided in the mobile phone is turned horizontally from the given moving image file. Create a video file for landscape orientation,
A vertically oriented video file generating means is a vertically oriented image displayed when the vertically long display screen provided in the mobile phone is oriented vertically from the given video file, wherein the display screen is oriented horizontally. The vertical length of the display screen is the length of the horizontal direction, and the video for vertical orientation is composed of vertical images with the same aspect ratio as the aspect ratio of the horizontal image. Generate a video file,
The control unit controls the horizontal moving image file generating unit and the vertical moving image file generating unit so that the horizontal moving image file generating process and the vertical moving image file generating process are performed for a plurality of types of mobile phones. And
The storage control means stores the horizontal video file and the vertical video file generated under the control of the control means in the video file storage device corresponding to the type of mobile phone.
Control method of moving image file generation apparatus.

Images