JP4869710B2 - Portable terminal device and image display method - Google Patents

Description

  The present invention relates to a mobile terminal device capable of displaying an image and an image display method thereof, for example, a mobile terminal device such as a mobile phone that displays an image for wallpaper in a standby mode.

  In recent years, portable electronic devices have become more and more sophisticated. For example, mobile phones and portable game machines that can display still images and moving images are widely used. In addition, some of such electronic devices can reproduce image files in various formats such as JPEG (joint photographic experts group) and GIF (graphic interchange format). The selected image file can be transferred from the outside and displayed as wallpaper in the standby mode.

  Usually, an image file handled by a mobile phone is compressed and encoded from the viewpoint of saving memory capacity, and it is necessary to perform a decoding process in order to reproduce it. For this reason, when a new image file is reproduced and displayed, for example, when switching the image for wallpaper, the display of the image is delayed due to the time required for decoding the image file, and the user is dissatisfied. The inconvenience arises.

As a method for solving such inconvenience, there is a method described in Patent Document 1. In this method, the first image of the moving image is decoded in advance and stored in the memory, and when it is requested to reproduce the moving image, the first image stored in the memory is displayed first. Thus, since the head image is displayed immediately when the reproduction of the moving image is requested, the user's dissatisfaction can be reduced as compared with the case where no image is displayed until the reproduction is started after the reproduction is requested.
JP 2005-151484 A

  The method described in Patent Document 1 is based on the premise that the same image is always displayed at the start of reproduction. Therefore, when reproducing a file such as an animation image whose head image changes according to a predetermined condition, a memory is stored in advance. There is a problem in that the image stored in the above and the image when playback is actually started do not match, which gives the user a sense of incongruity.

For example, in an animation file (hereinafter referred to as a “Flash file”) created by software called “Flash (trademark)” manufactured by Macromedia Inc. of the United States, the display content can be changed in conjunction with the playback time. . If the Flash file is used, for example, a clock animation indicating the current time can be displayed on a part of the standby screen.
When the first image of the Flash file including the clock animation is saved in the memory, the clock in the saved image indicates the time at the time of saving. Therefore, if the image stored in the memory is displayed before the start of the reproduction of the Flash file, the animation clock points to a time completely different from the current time, which makes the user feel uncomfortable.

  The present invention has been made in view of such circumstances, and an object of the present invention is to reduce user dissatisfaction due to a delay from the start of reproduction of image data until the actual reproduction image is displayed, and It is an object of the present invention to provide a portable terminal device and an image display method thereof that can reduce visual discomfort when display starts.

A first aspect of the present invention relates to a portable terminal device that includes a display unit that displays an image, and that can reproduce image data of an image having a background and display the image data on the display unit. The portable terminal device includes a control unit that controls display of the display unit, and the image data includes data for dynamically displaying a predetermined display object on a predetermined background, and the control unit includes: Data specifying at least one of the color, brightness, and pattern of the predetermined background of the display object is acquired in advance from the image data as background data relating to the display mode of the predetermined background, and the image data is reproduced. When displaying on the display unit, the background image based on the acquired background data is displayed on the display unit from the start of the reproduction processing of the image data to the display of the reproduction result image on the display unit. To do.

  When the control unit reproduces the image data and displays the image data on the display unit, the control unit displays a background image based on the background data on the display unit, and the display unit from the image data while the background image is displayed. Data in a reproducible format may be generated, and an image based on the generated data may be replaced with the background image and displayed on the display unit.

  The mobile terminal device according to the first aspect may include a storage unit that stores the image data and an input unit that inputs an instruction. In this case, the control unit reads the image data from the storage unit according to an instruction input from the input unit, acquires background data related to the display mode of the background, and stores the acquired background data in the storage It may be stored in the part.

The control unit may reproduce and display the image data on the display unit when the operation mode is shifted to a predetermined operation mode.
In addition, the mobile terminal device according to the first aspect may include, for example, an input unit that inputs an instruction and a communication unit that performs communication. In this case, the predetermined operation mode may be an operation mode in which an image indicating that a call process by the communication unit and an instruction input process from the input unit are not performed is displayed on the display unit.

Before SL background data, the color of the background of the display object, may specify at least one of brightness and pattern.

  When performing the reproduction process of the image data, the control unit may decode data encoded by a predetermined encoding method in the image data by a predetermined decoding method.

A second aspect of the present invention relates to a method in which an apparatus including a display unit displays an image. This image display method is reproducible as an image having a background and has a predetermined display on a predetermined background. Data specifying at least one of the color, brightness, and pattern of the predetermined background of the display object from image data including data for dynamically displaying the object is used for the background related to the display mode of the predetermined background. In the first step of acquiring as data, and when reproducing the image data and displaying it on the display unit, from the start of the reproduction process of the image data until the image of the reproduction result is displayed on the display unit And a second step of displaying a background image based on the acquired background data on the display unit.

  According to the present invention, when the background data related to the display mode of the reproduced image is acquired in advance from the image data and the image data is reproduced and displayed, the reproduction result image is obtained after the reproduction process is started. Until it is displayed, by displaying a background image based on the background data acquired in advance, it is possible to reduce user dissatisfaction due to a delay from the start of reproduction of the image data until the actual reproduction image is displayed, It is possible to reduce the visual discomfort when the display of the playback image starts.

FIG. 1 is a diagram illustrating an example of a configuration of a mobile terminal device according to an embodiment of the present invention.
1 includes an antenna 101, a communication unit 102, a key input unit 103, an audio processing unit 104, a speaker 105, a microphone 106, a display unit 107, a storage unit 108, and a control unit. 110.

  The communication unit 102 performs wireless communication with a base station (not shown) connected to the communication network. For example, the communication unit 102 performs predetermined modulation processing on the transmission data supplied from the control unit 110 to convert it into a radio signal, and transmits it from the antenna 101. In addition, a predetermined demodulation process is performed on a radio signal from the base station received by the antenna 101 to convert it into reception data, which is output to the control unit 110.

  The key input unit 103 has keys to which various functions such as a power key, a call key, a numeric key, a character key, a direction key, and an enter key are assigned, and these keys are operated by the user. Then, a signal corresponding to the operation content is generated and input to the control unit 110 as a user instruction.

  The audio processing unit 104 processes an audio signal output from the speaker 105 and an audio signal input from the microphone 106. That is, the audio signal input from the microphone 106 is subjected to signal processing such as amplification, analog-digital conversion, encoding, and the like, converted into digital audio data, and output to the control unit 110. Further, the audio data supplied from the control unit 110 is subjected to signal processing such as decoding, digital-analog conversion, amplification, etc., converted into an analog audio signal, and output to the speaker 105.

  The display unit 107 is configured using a display device such as a liquid crystal display panel or an organic EL panel, for example, and displays an image corresponding to a video signal supplied from the control unit 110. For example, various information and images such as the telephone number of the callee at the time of outgoing call, the telephone number of the other party at the time of incoming call, the contents of received mail and outgoing mail, date, time, remaining battery level, standby screen, etc. are displayed.

  The storage unit 108 stores various data used for processing in the control unit 110. For example, a computer program provided in the control unit 110, an address book for managing personal information such as a telephone number or an e-mail address of a communication partner, an audio file for playing a ring tone or an alarm sound, an image file for a standby screen, Various setting data, temporary data used in the program processing, etc. are stored.

  The storage unit 108 is configured by, for example, a non-volatile storage device (non-volatile semiconductor memory, hard disk device, optical disk device, etc.), a randomly accessible storage device (eg, SRAM, DRAM), or the like.

  The control unit 110 comprehensively controls the overall operation of the mobile terminal device 100. That is, various processes of the mobile terminal device 100 (voice calls performed via a circuit switching network, creation and transmission / reception of e-mails, browsing of Internet websites, etc.) are appropriately performed according to the operation of the key input unit 103. As described above, the operation of each unit described above (transmission / reception of signals in the communication unit 102, input / output of audio in the audio processing unit 104, display of images on the display unit 107, etc.) is controlled.

  For example, the control unit 110 includes a computer that executes processing based on a program (operating system, application, etc.) stored in the storage unit 108, and executes the above-described processing according to a procedure instructed in this program. That is, instruction codes are sequentially read from programs such as an operating system and application programs stored in the storage unit 108, and processing is executed.

  In addition, the control unit 110 executes some of the various processes described above by an application program that operates under a predetermined execution environment program (platform). For example, processing such as browsing an Internet website or displaying an image in a standby mode is executed by an application program. When a predetermined event occurs in response to an input operation of the key input unit 103 or the like, the execution environment program starts a predetermined application program corresponding to the event and executes a specific process.

  When an instruction is input from the key input unit 103 so as to perform setting related to the standby mode, the control unit 110 activates an application program that performs the setting process. The control unit 110 displays a setting menu screen on the display unit 107 by the activated application program, and determines the processing content in the standby mode according to an instruction input from the key input unit 103.

  In this standby mode setting process, control unit 110 determines a wallpaper image file 109A to be displayed on the screen of display unit 107 as wallpaper. For example, the image file for wallpaper 109 </ b> A is selected from the image files stored in the storage unit 108 in accordance with an instruction input in the key input unit 103.

In this case, the image file in a predetermined format is set as an image file 109A wallpaper, the control unit 110 reads the image file of the predetermined format from the storage unit 108, data related to the display mode of the background of the reproduced image It is acquired and stored in the storage unit 108 as background data 109B.
The image file of the predetermined format is an image file for animation reproduction such as a Flash file, for example, and includes data capable of dynamically displaying a predetermined display object on a predetermined background.
The background data 109B includes data for designating the background color, brightness, pattern, etc. of the display object.

FIG. 2 is a diagram illustrating a configuration example of the image file of the predetermined format described above.
The image file shown in FIG. 2 has a header and a data body.
The header includes file information, creation information, and reproduction supplement information. The file information indicates information such as the size of the file, the size of the storage area necessary for decoding, and the decoding method. The creation information indicates the date and time of creation of the file, information about the creator and copyright, and the like. The reproduction supplement information indicates information such as the background color and pattern.
The data body includes rendering information, operation processing, text, sound, and other information.
The rendering information includes information relating to the reproduction time of the image, information relating to the object body to be displayed, the reproduction rate, and the size of the reproduction image.
For example, when an image file in the above-described format is set as the wallpaper image file 109A, the control unit 110 stores information on the background color and pattern included in the reproduction supplement information of the header portion as background data 109B. Save to.
That is, the control unit 110 first secures background color data from the reproduction supplement information in the header as information necessary for reproduction, and the moving image of the display object in the rendering information based on the background color specified by this data. An image is drawn on the display unit 107 at a specified display rate. Here, when the display object is not of a size that fills the entire screen of the display unit, the background color is visible and hidden behind the display object on the screen of the display unit 107. When displaying the text information included in the data body, the text is drawn on the display unit 107 based on the background color described above.

  The control unit 110 has a predetermined condition such as when key operation (instruction input processing) is not performed in the key input unit 103 or when communication processing (call or data communication) is not performed in the communication unit 102. Shifts to the standby mode. When shifting to the standby mode, the control unit 110 activates a dedicated application program. An application program that is activated in the standby mode is hereinafter referred to as a “standby application”.

When the standby application is activated, the control unit 110 reproduces the image file 109 </ b> A of the storage unit 108 set as wallpaper in advance by the setting application and displays it on the display unit 107. At this time, when the image file 109A is the image file of the predetermined format described above, the control unit 110 is based on the background data 109B from the start of the reproduction process until the display of the reproduction result image on the display unit 107. A background image is displayed on the display unit 107.
In this case, first, the control unit 110 displays a background image based on the background data 109B on the display unit 107, and generates data in a format that can be reproduced on the display unit 107 from the data of the image file 109A during the display of the background image. . For example, when the image file 109A includes data encoded by a predetermined encoding method, image data that can be reproduced by the display unit 107 is generated by decoding the image file 109A by a predetermined decoding method.
When image data that can be played back on the display unit 107 is generated, the control unit 110 replaces the generated image data with a background image and displays it on the display unit 107. When the image data is a moving image such as an animation, when the generation of the image data corresponding to at least the first screen is completed, the image based on the generated image data is replaced with the background image.

  Here, the operation relating to the display of the wallpaper image in the mobile terminal device having the above-described configuration will be described with reference to the flowcharts of FIGS.

  FIG. 3 is a flowchart showing an example of the selection process of the wallpaper image file 109A displayed in the standby mode.

  When an instruction is input from the key input unit 103 so as to make a setting related to the standby mode, the control unit 110 activates an application program for performing the setting process and displays a menu screen for setting on the display unit 107. For example, the control unit 110 displays a list of image files currently stored in the storage unit 108 on the menu screen, and in response to an instruction input from the key input unit 103, the control unit 110 uses the list as wallpaper in the standby mode. A file to be displayed is selected (step ST100).

  When a file is selected, control unit 110 determines whether the file is a predetermined format file such as a Flash file (step ST105). If the file is not in a predetermined format, control unit 110 saves the file as wallpaper image file 109A in storage unit 108 (step ST125).

  When the selected file is a file of a predetermined format (step ST105), the control unit 110 performs a decoding process on the selected file (step ST110), and obtains data related to the display mode of the background of the reproduced image from the decoding result. (Step ST115), and this is stored in the storage unit 108 as background data 109B (step ST120). Further, the file selected in step ST100 is stored in the storage unit 108 as a wallpaper image file 109A (step ST125).

  FIG. 4 is a flowchart showing an example of the wallpaper display operation when the standby mode is changed.

Control unit 110 under predetermined conditions such as when key operation (instruction input processing) is not performed at key input unit 103 or when communication processing (such as a call or data communication) is not performed at communication unit 102. Enters standby mode and activates the standby application.
When the standby application is activated, control unit 110 determines whether wallpaper image file 109A set in the setting process shown in the flowchart of FIG. 3 is a file of a predetermined format such as a Flash file (step ST200). If the file is not in a predetermined format, control unit 110 starts decoding of wallpaper image file 109A (step ST220) and displays the decoding result on display unit 107 (step ST225).

On the other hand, when wallpaper image file 109A is an image file of a predetermined format, control unit 110 reads background data 109B from storage unit 108 (step ST205), and renders a background image corresponding to this on the screen of display unit 107. (Step ST210). Specifically, the entire screen is painted with the color or pattern specified as the background.
Next, control unit 110 draws various images to be displayed other than wallpaper on the screen of display unit 107 (step ST215). For example, various icons representing the remaining battery level, reception sensitivity, incoming e-mail, operation mode, etc., numbers and characters representing the date and time are drawn.
In parallel with this, the control unit 110 starts decoding the wallpaper image file 109A (step ST220). When the decoding result is obtained, the background image displayed from step ST205 is converted into the decoding result. Replace with an image (step ST225).

As described above, according to the present embodiment, the background data 109B relating to the display mode of the background of the reproduced image is acquired in advance from the wallpaper image data 109A displayed in the standby mode. Then, when the operation mode shifts to the standby mode under a predetermined condition, the background data 109B acquired in advance is displayed from the start of the reproduction process of the wallpaper image data 109A until the image of the reproduction result is displayed on the display unit 107. A background image based on this is displayed on the display unit 107.
Thus, when the mode is shifted to the standby mode, the image of the background data 109B is immediately displayed as a standby screen without waiting for the decoding of the wallpaper image data 109A. Therefore, the decoding of the wallpaper image data 109A is completed. User dissatisfaction can be reduced compared to the case where the standby screen is not displayed.

  In addition, a method of displaying a standard background image or a solid color image before starting the playback of the Flash file is also conceivable. However, since these images are not related to the playback image of the Flash file, the decoding of the Flash file is completed. As a result, there is a problem that the user feels visually uncomfortable when switching to the actual playback image. According to the present embodiment, the background image of the background data 109B is configured based on the display mode of the background of the reproduced image obtained by decoding the wallpaper image data 109A. Visual discomfort when switching to a playback image can be reduced.

  Some current mobile phones enter the suspend mode when a standby state is displayed and no operation continues for a predetermined time for power saving control and prevention of burn-in of the display unit. The suspend mode is a mode in which the display on the display unit itself is stopped, or in some cases, the operation of the control unit is also partially stopped. When the mobile terminal device supports this suspend function, the following event occurs. When the key input unit 103 is operated after entering the suspend mode because there is no operation for a predetermined time and further entering the suspend mode because there is no operation for a predetermined time, the mode is returned from the suspend mode to the standby mode. At this time, the standby application is read again from the memory and activated. Even in such an operation, by applying the present invention, a display object based on a file of a predetermined format that is first drawn on the entire screen of the display unit 107 with data relating to the background stored in advance and then decoded. By displaying, it is possible to prevent the user from being aware of the time required for decoding as much as possible.

  As mentioned above, although embodiment of this invention was described, this invention is not limited only to said form, A various change is possible.

  In the above-described embodiment, in step ST225, the background image drawn based on the background data stored in advance is replaced with the image of the decoding result, but it should be displayed on this background image without replacement. Needless to say, you can display objects directly.

  In the above-described embodiment, a file created by “Flash (trademark)” is given as an example of a file format requiring decoding, but the present invention is not limited to this. For example, any file that includes data defining the background in the file and develops a predetermined display object on the defined background may be used. Further, not limited to a moving image, a fixed image that does not move on a predetermined background may be displayed.

  In the above-described embodiment, a case where an image for wallpaper is displayed in the standby mode is taken as an example, but the present invention is not limited to this. That is, the present invention can be applied to a case where a moving image is displayed in various other operation modes.

  All the functions of each component of the mobile terminal device may be realized by software, or at least a part thereof may be realized by hardware. For example, the processing in the control unit 110 and the data processing in the communication unit 102 and the audio processing unit 104 may be realized on a computer by one or a plurality of programs, or at least a part thereof may be realized by hardware. good.

  In the above-described embodiment, the case where the standby screen is mainly displayed on the mobile phone is taken as an example. However, the present invention is not limited to this, and the present invention can be applied to various devices including an image display unit.

It is a figure which shows an example of a structure of the portable terminal device which concerns on embodiment of this invention. It is a figure which shows the structural example of the image file for wallpaper. It is a flowchart which shows an example of the selection process of the image file for wallpaper. It is a flowchart which shows an example of the display operation of a wallpaper.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 ... Antenna, 102 ... Communication part, 103 ... Key input part, 104 ... Sound processing part, 105 ... Speaker, 106 ... Microphone, 107 ... Display part, 108 ... Memory | storage part, 109A ... Image file for wallpaper, 109B ... Background data 110 ... Control unit

Claims (7)

In a mobile terminal device that includes a display unit that displays an image, and that can reproduce and display image data of an image having a background on the display unit,
A control unit for controlling display of the display unit;
The image data includes data for dynamically displaying a predetermined display object on a predetermined background,
The control unit obtains in advance data specifying at least one of the color, brightness, and pattern of the predetermined background of the display object from the image data as background data related to the display mode of the predetermined background, When the image data is reproduced and displayed on the display unit, a background image based on the acquired background data is displayed from the start of the reproduction process of the image data until the image of the reproduction result is displayed on the display unit. It displays on the said display part. The portable terminal device characterized by the above-mentioned. When the control unit reproduces the image data and displays the image data on the display unit, the control unit displays a background image based on the background data on the display unit, and the display unit from the image data while the background image is displayed. The portable terminal device according to claim 1, wherein data in a reproducible format is generated, and an image based on the generated data is replaced with the background image and displayed on the display unit. A storage unit for storing the image data;
An input unit for inputting instructions,
Wherein, in accordance with an instruction input from the input unit, the image data acquires xenon scene data before reading from said storage unit, and stores the background data that the acquired in the storage unit,
The mobile terminal device according to claim 1, wherein the mobile terminal device is a mobile terminal device. The portable terminal device according to any one of claims 1 to 3, wherein the control unit reproduces the image data and displays the image data on the display unit when the mode is shifted to a predetermined operation mode. An input unit for inputting instructions;
A communication unit that performs communication,
The predetermined operation mode is an operation mode in which an image indicating that a call process by the communication unit and an instruction input process from the input unit are not performed is displayed on the display unit. 5. The mobile terminal device according to 4. Wherein, the case of performing reproduction processing of image data, according to claim 1 to 5, characterized in that for decoding the coded predetermined decoding scheme for data by a predetermined encoding method in the image data The mobile terminal device according to any one of the above. An apparatus including a display unit displays an image,
The color, brightness, and pattern of the predetermined background of the display object from image data that can be reproduced as an image having a background and includes data for dynamically displaying the predetermined display object on the predetermined background data designating at least one of: a first step of acquiring a background data about the display mode of the predetermined background,
In a case where the image data is reproduced and displayed on the display unit, a background image based on the acquired background data from when the reproduction process of the image data is started until an image as a reproduction result is displayed on the display unit A second step of displaying the image on the display unit.

Images