JP2011193387A - Device and method for displaying moving image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce time until the display of a list of thumbnail images of a moving image file is completed, and to efficiently manage the thumbnail images. <P>SOLUTION: A controller 100 stores a moving image file of which the thumbnail images have been displayed once in an incorporated cache memory 101 in advance, and reads the moving image file from the cache memory 101 to be displayed when the thumbnail images of the moving image file are displayed again. The controller 100 manages, based on final reference time information of a corresponding table, the time when the thumbnail images to be kept in the cache memory 101 are finally displayed, deletes a thumbnail image that is least used when a new thumbnail image is created, and keeps the new thumbnail image instead. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  Embodiments described herein relate generally to a moving image display apparatus.

  As is well known, devices equipped with a function for storing a moving image file obtained by reception or photographing, such as a digital TV broadcast recorder, a digital camera with a moving image photographing function, and a mobile phone with a one-segment broadcasting receiving function, have become widespread. These devices have a function to generate thumbnail images (reduced still image data) based on each video file and display them as a list so that the user can easily manage the stored video files. (For example, refer to Patent Document 1).

The thumbnail image is generated by reading the data of the first I frame from the moving image file, decoding it, and converting it into still image data of a thumbnail display format and size. For this reason, when displaying a plurality of moving image files as thumbnails, the above process takes time, and the user may feel poor responsiveness. Further, in a portable terminal driven by a battery, if thumbnail display is repeated, battery power is repeatedly consumed.
In the case of a digital television broadcast video file, copyright management is also required for the generated thumbnail image.

JP 2002-281432 A

  Conventionally, since it takes a long time to generate a thumbnail image of a moving image file, it takes time until the thumbnail list display is completed, and there is a problem that the user feels poor responsiveness.

  The present invention has been made to solve the above-mentioned problem. A moving image display capable of shortening the time required to complete the list display of thumbnail images of moving image files and efficiently managing thumbnail images. An object is to provide an apparatus and a moving image display method.

  According to the embodiment, display means for displaying an image, first storage means for storing a plurality of moving image files, second storage means for storing information using a volatile storage medium, and first storage means For a video file in which the second storage means does not store the thumbnail image associated with the identification information of the video file to be stored, a thumbnail image is generated from the video file and displayed on the display means, and the generated thumbnail is displayed. The image is recorded in the second storage unit in association with the identification information of the moving image file, while the second storage unit stores the thumbnail image associated with the identification information of the moving image file stored in the first storage unit. The moving image file includes a thumbnail display control unit that reads out the thumbnail image from the second storage unit and displays the thumbnail image on the display unit. It was.

  As described above, when the thumbnail image once displayed is recorded in the volatile second storage means in association with the identification information of the original moving image file, the thumbnail image of the moving image file is displayed later. The thumbnail images stored in the second storage means are displayed.

  Therefore, since the saved thumbnail images can be used, it is possible to shorten the time required to complete the list display of the thumbnail images of the video files, and the identification information of the moving image files is used, so that the thumbnail images can be managed efficiently. It is possible to provide a moving image display apparatus and a moving image display method that can be performed in a simple manner.

1 is a circuit block diagram showing a configuration of an embodiment of a moving image display apparatus according to the present invention. 6 is a flowchart for explaining a thumbnail image management operation of the moving image display apparatus shown in FIG. 1. The figure explaining the management operation | movement of the thumbnail image of the moving image display apparatus shown in FIG.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
A moving image display apparatus according to an embodiment of the present invention has a function of storing and reproducing a moving image file, such as a digital TV broadcast recorder, a mobile phone with a moving image shooting function, a digital camera, a PDA (Personal Digital Assistants), and the like. It is a device equipped with. In the following description, as an example of the moving image display device, a multi-function mobile phone, a so-called smartphone will be described as an example.

  As shown in FIG. 1, the cellular phone according to the present invention includes, as main components, a control unit 100, a wireless communication unit 10, a display unit 20, a call unit 30, an operation unit 40, and a storage unit 50. A broadcast receiving unit 60, a GPS receiving unit 70, a digital camera 80, and an infrared communication unit 90. Main functions include a communication function for performing voice communication and data communication via the base station device BS and the mobile communication network MN, a broadcast reception function for receiving a terrestrial digital broadcast signal transmitted from the broadcast station BC, and the above Video data storage function that saves (records) copyrighted video files acquired by the communication function and the broadcast reception function, positioning function that positions itself, infrared communication function that performs infrared communication with other mobile phones MS, etc. And a function of executing application software using these. In addition, Bluetooth (registered trademark) and non-contact short-range wireless communication have a credit settlement function, an electronic money function that uses transportation and pays for purchases of goods.

The radio communication unit 10 performs radio communication with the base station apparatus BS accommodated in the mobile communication network MN in accordance with an instruction from the control unit 100, thereby transmitting / receiving voice data, e-mail data, etc. Or streaming video streaming data.
The display unit 20 displays images (still images and moving images), character information, and the like under the control of the control unit 100, and visually transmits information to the user. For example, thumbnail images of a plurality of moving image files are displayed.

  The call unit 30 includes a speaker 31 and a microphone 32, converts user's voice input through the microphone 32 into voice data that can be processed by the control unit 100, and outputs the voice data to the control unit 100. The voice data received from the other party through the phone is decoded and output from the speaker 31.

  The operation unit 40 includes a touch panel provided on the display unit 20 in addition to a plurality of key switches and the like, and receives instructions from the user through the touch panel. The touch panel may be any system such as a resistance film system, a capacitance system, and an electromagnetic induction system, and detects coordinates on the touch panel operated by the user and notifies the control unit 100 of the detected coordinates.

  Note that the control unit 100 detects an icon or a function key displayed in the display area on the display unit 20 corresponding to the coordinate based on the coordinate notified from the operation unit 40, and recognizes it as an operation for this. For operations, one-click, double-click, drag, and other actions based on multi-point contact are detected, and commands intended by the user (selection, execution, movement, display enlargement / reduction, screen slide (page feed), etc.) Is recognized and executed by the control unit 100.

  The storage unit 50 includes control program and control data of the control unit 100, application software, address data that associates the name and telephone number of the communication partner, transmitted and received e-mail data, Web data downloaded by web browsing, download Stored content data. The storage unit 50 stores moving image streaming data, terrestrial digital broadcast data, and image data (still images and moving images) obtained by a digital camera 80 described later under the control of the control unit 100. The storage unit 50 is realized using hardware such as an HDD or a flash memory (NAND memory).

  The broadcast receiving unit 60 receives one segment of the terrestrial digital broadcast signal transmitted from the broadcast station BC, and obtains broadcast data (encoded stream) in which the video signal is encoded in a format such as H.264. . In this example, the broadcast receiving unit 60 receives a low-frame-rate one segment as an example. However, the broadcast receiving unit 60 is not limited thereto, and may be a digital tuner that receives a full-segment having a higher frame rate. The broadcast station BC may be a normal broadcast station that broadcasts over a wide area, or may be an area-limited broadcast station that has a specific area such as a large store or public facility as a reception area.

  The GPS receiver 70 receives a GPS (Global Positioning System) signal transmitted from the GPS satellites ST1 to STn and measures a position (latitude, longitude, altitude), and position information obtained by this positioning. (Latitude, longitude, altitude) is output to the control unit 100.

  The digital camera 80 is a digital camera that captures an image using an image sensor such as a CCD (Charge-Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). And the image data is output to the control unit 100.

  The infrared communication unit 90 performs infrared communication with an opposite device (for example, another mobile phone MS) having an infrared communication function. Operation setting is performed by the control unit 100 and transmission data provided from the control unit 100 is transmitted. Data transmitted by infrared light or data transmitted by infrared light from the opposite device is received and output to the control unit 100 as received data.

  The control unit 100 includes a microprocessor, operates according to a control program and control data stored in the storage unit 50, and controls each unit of the mobile radio terminal device. For example, voice communication or data communication Communication control function that controls each part of the communication system, email software for creating and sending / receiving emails, browser software for web browsing, downloading and playing streaming data Media playback software, broadcast receiving software for receiving digital terrestrial broadcast signals transmitted from the broadcasting station BC, image processing software for controlling the digital camera 80 to shoot, QR (Quick Response) code (registered trademark) images Execute image analysis software that decodes by analysis, and It comprises an application processing function of controlling the respective units.

  The control unit 100 executes the media playback software to control the wireless communication unit 10, downloads streaming data from the server device SV connected to the Internet NW through communication through the wireless communication unit 10, and stores it in the storage unit 50. save. In addition, the control unit 100 executes broadcast reception software to control the broadcast reception unit 60 to receive broadcast data and store it in the storage unit 50. The control unit 100 also executes image processing software to control the digital camera 80, captures a still image or a moving image, and stores image data obtained thereby in the storage unit 50.

  In the following description, streaming data obtained from the server device SV, broadcast data obtained by the broadcast receiving unit 60, and moving image image data obtained by the digital camera 80 are referred to as a moving image file. In addition, when a usage rule (copyright information) based on copyright is set for these moving image files, the storage unit 50 also stores copyright information together so that the control unit 100 protects the copyright. Video files are managed in

  The control unit 100 includes a cache memory 101. The cache memory 101 is a volatile memory such as a DRAM, and the stored data disappears when the function of the control unit 100 stops. The work memory used as a work area for data processing by the control unit 100 It is. For example, when the control unit 100 generates thumbnail images of a plurality of moving image files stored in the storage unit 50, the generated thumbnail images are recorded in the cache memory 101.

  Next, the operation of the mobile phone configured as described above will be described. In the following description, operations such as normal voice communication, digital television broadcast reception, streaming data reception, and the like will be omitted, and thumbnail display processing related to generation and display of thumbnail images of moving image files will be described.

  FIG. 2 is a flowchart for explaining the thumbnail display process, which is executed by the control unit 100. A control program and control data for realizing this flowchart are stored in the storage unit 50 and executed by the control unit 100, thereby realizing the thumbnail display process.

  This process is executed for each moving image file stored in the folder when the user performs an operation for opening a folder storing the moving image file through the operation unit 40. That is, for example, when three moving image files are stored in a folder in which an opening operation has been performed, the processing shown in FIG. 2 is executed for each of the three moving image files.

  In the following description, as an example, it is assumed that a moving image file is stored in the storage unit 50 as shown in FIG. That is, the storage unit 50 includes three folders 50a, 50b, and 50c. The folder 50a stores three movie files (file names: MOVIE_1, MOVIE_2, MOVIE_3), the folder 50b stores two movie files (file names: MOVIE_1, MOVIE_2), and the folder 50c. Stores one moving image file (file name: MOVIE_1), and in this way, the moving image files having the same file name are stored in different folders. The cache memory 101 includes a folder 101a, and thumbnail images are stored in this virtual area.

  First, in step 2a, the control unit 100 selects one of the video files stored in the folder (one of 50a, 50b, and 50c) designated by the user operation through the operation unit 40. The unique identification information (ID) set uniquely for the selected moving image file (hereinafter referred to as the target file) is extracted, and the process proceeds to Step 2b. The unique identification information (ID) exists as a part of the management data of the moving image file together with information such as the file name, file size, and data type of the moving image file.

  In step 2b, the control unit 100 refers to the correspondence table stored in the folder 101a of the cache memory 101, and determines whether there is a thumbnail image associated with the unique identification information (ID) extracted in step 2a.

  The correspondence table records information indicating correspondence between identification information of thumbnail images stored in the folder 101a of the cache memory 101 and unique identification information (ID). The correspondence table also records final reference time information indicating the last reference time for each thumbnail image.

  If there is a thumbnail image associated with the unique identification information (ID), the process proceeds to step 2c. On the other hand, if there is no thumbnail image associated with the unique identification information (ID). The process proceeds to step 2d.

  In step 2c, the control unit 100 reads out the thumbnail image associated with the unique identification information (ID) extracted in step 2a from the folder 101a, updates the correspondence table, and proceeds to step 2h. That is, of the unique identification information (ID) recorded in the correspondence table, the last reference time information associated with the unique identification information (ID) extracted in step 2a is updated to the current time.

  On the other hand, in step 2d, the control unit 100 reads the data of the first I frame from the target file, decodes the data, and generates still image data of a preset size (resolution) and identification information of this data. . That is, a thumbnail image of the target file and its identification information are generated, and the process proceeds to step 2e.

  In step 2e, the control unit 100 determines whether or not there is a free space that can store the thumbnail image generated in step 2d in the storage area previously assigned to the folder 101a. That is, it is determined whether the total amount of thumbnail images stored in the folder 101a is equal to or less than a preset data amount and has enough free space to further store the thumbnail images generated in step 2d.

  If there is no free space, the process proceeds to step 2f. On the other hand, if there is free space, the process proceeds to step 2g. Note that the number of thumbnail images to be stored may be managed instead of the capacity, and it may be determined whether or not this number has reached the upper limit (threshold value). In this case, if the upper limit value has been reached, the process proceeds to step 2f. If the upper limit value has not been reached, the process proceeds to step 2g.

  In step 2f, the control unit 100 refers to the correspondence table stored in the folder 101a of the cache memory 101, detects a thumbnail image associated with the oldest last reference time information, deletes it from the folder 101a, and frees it. An area is generated, and information (unique identification information and last reference time information) related to the deleted thumbnail image is deleted from the correspondence table, and the process proceeds to step 2g.

  In step 2g, the control unit 100 records the thumbnail image generated in step 2d in the folder 101a of the cache memory 101, updates the correspondence table, and proceeds to step 2h. That is, the unique identification information (ID) extracted in step 2a, the identification information of the thumbnail image generated in step 2d, and the last reference time information are recorded in the correspondence table in association with each other. The current time is recorded in the last reference time information.

In step 2h, the control unit 100 displays the thumbnail image read in step 2c or the thumbnail image generated in step 2d on the display unit 20, and ends the process.
The above processing is executed for all the moving image files in the folder designated by the user operation through the operation unit 40. As a result, thumbnail images of all the moving image files in the folder are displayed on the display unit 20.

  In the above description, the final reference time information of the thumbnail image is stored in the correspondence table, and an empty area is generated in the folder 101a based on the final reference time information. However, the present invention is not limited to this. It is also possible to manage thumbnail images by using 101a as a ring buffer.

  That is, when a thumbnail image is referred to, this thumbnail image, unique identification information (ID), and thumbnail image identification information may be moved to the head position of the ring buffer or newly registered. In this way, when it is necessary to secure an empty area in the folder 101a, erasing is performed in order from the tail end of the ring buffer, so that it is not necessary to have the last reference time information together. Further, the unique identification information (ID) and the identification information of the thumbnail image may be managed in the ring buffer, and the thumbnail image may be stored in an area other than the ring buffer.

  FIG. 3 shows the relationship between the moving image files stored in the folders 50a, 50b, and 50c in the storage unit 50 and the thumbnail images stored in the folder 101a in the cache memory 101.

  That is, when the user performs an operation to open the folder 50 a through the operation unit 40, a thumbnail image associated with the unique identification information (ID) of each moving image file is generated and recorded in the folder 101 a of the cache memory 101. . Similarly, thumbnail images are generated for the moving image files stored in the folders 50b and 50c.

  Here, in the folders 50a, 50b, and 50c in the storage unit 50, there are moving image files having the same file name such as MOVIE_1 and MOVIE_2, but the thumbnail image corresponds to the unique identification information (ID) of each moving image file. Therefore, even when it is necessary to display thumbnail images of moving image files having the same file name, the corresponding thumbnail images can be read out from the folder 101a and displayed.

  As described above, in the moving image display apparatus having the above-described configuration, when a moving image file once displaying a thumbnail image is stored in the cache memory 101 and the thumbnail image of the moving image file is displayed again, the cache memory 101 is read and displayed.

  Therefore, according to the moving image display device having the above-described configuration, the decoding process of the moving image file can be omitted for the moving image file once displaying the thumbnail image, so that the list display is completed when displaying the thumbnail of the moving image file. Time can be shortened, and responsiveness can be improved.

  Further, the last display time information of the thumbnail image stored in the cache memory 101 is managed by the last reference time information in the correspondence table, and when a new thumbnail image is created, the least used thumbnail image is deleted. Instead, LRU (Least Recently Used) that holds a new thumbnail image is performed to efficiently use the cache memory 101.

  Further, since the thumbnail images stored in the cache memory 101 are managed in association with the unique identification information (ID) of the moving image file, the moving image files having the same file name are stored in different folders on the storage unit 50. Even if there is, the corresponding thumbnail image can be accurately displayed.

  Furthermore, in the above embodiment, since the thumbnail image is held in the cache memory 101 instead of the storage unit 50, even if the thumbnail image is a copyrighted moving image file, it is held in the storage unit 50. It is much more difficult to read from the outside than the case, and the copyright can be protected.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. Further, for example, a configuration in which some components are deleted from all the components shown in the embodiment is also conceivable. Furthermore, you may combine suitably the component described in different embodiment.

  As an example, for example, in the above-described embodiment, information (correspondence table) in which the unique identification information (ID) of the moving image file is associated with the thumbnail image (correspondence table) is generated, and the thumbnails held in the cache memory 101 based on this information are generated. Manage images.

  Instead of this, for example, the unique identification information (ID) of the moving image file is set in the file name of the created thumbnail image or a part of the file name, the thumbnail image is held in the cache memory 101, and stored in the cache memory 101. When the retained thumbnail image is displayed, information on the creation date and time of the thumbnail image is updated to the current time. The oldest thumbnail image may be deleted in order to perform the LRU based on the creation date and hold the newly created thumbnail image in the cache memory 101. Even in such a configuration, the same effect can be obtained.

In step 2f, the control unit 100 detects the thumbnail image associated with the oldest last reference time information and deletes it, but it may be determined for each folder. That is, it is limited to the thumbnail image associated with the moving image file stored in the folder opened to start the processing of FIG. 2, and among these, the thumbnail image associated with the oldest last reference time information is detected. However, this may be deleted.
In addition, it goes without saying that the present invention can be similarly implemented even if various modifications are made without departing from the gist of the present invention.

  DESCRIPTION OF SYMBOLS 10 ... Wireless communication part, 20 ... Display part, 30 ... Call part, 31 ... Speaker, 32 ... Microphone, 40 ... Operation part, 50a, 50b, 50c, 101a ... Folder, 50 ... Memory | storage part, 60 ... Broadcast receiving part, DESCRIPTION OF SYMBOLS 70 ... GPS receiving part, 80 ... Digital camera, 90 ... Infrared communication part, 100 ... Control part, 101 ... Cache memory, BC ... Broadcasting station, BS ... Base station apparatus, MN ... Mobile communication network, MS ... Mobile phone, NW ... Internet, ST1-STn ... GPS satellites, SV ... server equipment.

Claims (5)

Display means for displaying an image;
First storage means for storing a plurality of video files;
Second storage means for storing information using a volatile storage medium;
For the moving image file in which the second storage unit does not store the thumbnail image associated with the moving image file identification information stored in the first storage unit, the display unit generates a thumbnail image from the moving image file. The generated thumbnail image is recorded in the second storage unit in association with the identification information of the moving image file, while the identification information of the moving image file stored in the first storage unit is associated with the thumbnail image. The moving image file in which the second storage unit stores a thumbnail image includes a thumbnail display control unit that reads the thumbnail image from the second storage unit and displays the thumbnail image on the display unit. Video display device. A management unit that manages reference time information indicating a time at which the thumbnail image stored in the second storage unit is displayed on the display unit;
When the thumbnail display control unit generates a thumbnail image, the thumbnail display control unit includes an image deletion unit that references the reference time information managed by the management unit and deletes the thumbnail image at the oldest time from the second storage unit. The moving image display apparatus according to claim 1, wherein: The second storage means has a ring buffer structure;
Further, when the thumbnail display control means generates a thumbnail image, the generated thumbnail image is registered at the top position of the second storage means having the ring buffer structure, and the thumbnail image is deleted from the last position. The moving image display apparatus according to claim 1, further comprising management means.   The thumbnail display control means, for the video file in which the second storage means does not store the thumbnail image in which the file name including the identification information of the video file stored in the first storage means is stored, A thumbnail image is generated and displayed on the display means, and a file name including identification information of the moving image file is set in the generated thumbnail image and recorded in the second storage means, while the first storage For the moving image file in which the second storage unit stores a thumbnail image in which a file name including identification information of the moving image file stored by the unit is stored, the thumbnail image is read from the second storage unit and displayed. The moving image display device according to claim 1, wherein the moving image display device displays the image on a means. Among the moving image files stored in the first storage unit, the moving image file that does not store the thumbnail image associated with the identification information of the moving image file in the second storage unit made of a volatile storage medium is obtained from the moving image file. Generating a thumbnail image and displaying the thumbnail image on the display unit, and recording the generated thumbnail image in the second storage unit in association with the identification information of the moving image file;
Among the moving image files stored in the first storage unit, the thumbnail image is stored in the second storage unit for the moving image file in which the second storage unit stores the thumbnail image associated with the identification information of the moving image file. A moving image display method comprising: reading out from the display means and displaying on the display means.

Images