JP2012163621A - Terminal device and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a terminal device allowing reduction in power consumption while more reliably suppressing deterioration of display quality.SOLUTION: A terminal device 100 for displaying an image on the basis of image data stored in a memory comprises: an application management part 130 for obtaining the image data of an original image including one or a plurality of image components; an image generation part 160 for storing the image data of the original image in the memory; and a power-saving instruction part 150 for causing the image generation part 160 to replace the image data of a power-saving image, in which the image components of the original image have been replaced with power-saving image components whose data sizes have been reduced for each of the image component, with the image data of the original image, and to store the image data.

Description

  The present invention relates to a terminal device that performs image display based on data stored in a memory and an image processing method.

  In recent years, the progress of image display in various devices has been particularly remarkable in the increase in the number of colors of image display in a liquid crystal display device or the like of a mobile terminal device. For example, RGB (red-green-blue color model) representation methods such as RGB16 (16-bit color) and RGB24 (24-bit color) have become common in mobile phones and portable game machines. RGB16 is a color expression method in which R (red color) and B (blue color) are each represented by 5 bits and G (green color) is represented by 6 bits. Similarly, RGB 24 is a color expression method in which R, G, and B are each represented by 8-bit information.

  In general, the greater the number of colors for image display, the higher the power consumption in memory operation and data transfer. However, in the case of a portable terminal device, since it is mainly driven by a battery, it is required to operate while suppressing power consumption as much as possible.

  Therefore, in the prior art, the data size of the image data to be displayed (hereinafter referred to as “original image data”) is reduced, and the memory size used for displaying the image is reduced to save power. (For example, refer to Patent Document 1).

  This prior art operates by switching the image display on the terminal device from the normal 24-bit mode (RGB 24) to the 16-bit mode (RGB 16) having a lower display color number. That is, the conventional technique reduces the data size of the image to be displayed. As a result, the memory size used for image display is suppressed, and the processing load of memory operation and data transfer is reduced. Therefore, the prior art can save power for image display.

  However, an image with a reduced data size has a loss of information (missing fine color differences in the above example) compared to the original image, so the image quality is lowered and the user feels a decrease in display quality. easy. Here, the display quality refers to the image quality that is recognized by the viewer.

  Therefore, in the prior art, the data size is reduced while the illuminance around the display device is high on the assumption that the display quality is hardly lowered even if the number of colors is reduced in a bright environment. Yes. As a result, the related art can maintain the display quality while reducing the power of image display in the terminal device.

JP 2008-275880 A

  However, the prior art has a problem that the display quality is lowered when the power consumption is reduced when the terminal device is used for a long time in a dark environment. In general, many terminal devices such as mobile phones and portable game machines are often used for a long time in a dark environment such as indoors or at night. Therefore, there is a demand for a technology that can reduce the power consumption while more reliably suppressing the deterioration of display quality.

  An object of the present invention is to provide a terminal device and an image processing method capable of reducing power consumption while more surely suppressing deterioration in display quality.

  A terminal device of the present invention is a terminal device that displays an image based on image data stored in a memory, and an application management unit that acquires image data of an original image including one or a plurality of image components; An image generation unit that stores image data of an original image in the memory, and the image generation unit that reduces the data size of the image component of the original image for the image generation unit. A power-saving instruction unit that replaces the image data of the replaced power-saving image with the image data of the original image and stores the image data in the memory;

  The image processing method of the present invention is an image processing method in a terminal device that displays an image based on image data stored in a memory, and acquires image data of an original image including one or more image components. Generating image data of a power-saving image obtained by replacing the image component of the acquired original image with a power-saving image component whose data size is reduced for each image component; and the generated power-saving image Replacing the image data with the image data of the original image and storing it in the memory.

  According to the present invention, it is possible to reduce the power consumption while more reliably suppressing the deterioration of display quality.

The block diagram which shows an example of a structure of the terminal device which concerns on one embodiment of this invention The figure which shows an example of the content of the terminal specific information in this Embodiment The figure which shows an example of the content of the image components information for power saving in this Embodiment The figure which shows an example of the content of the search order setting rule in this Embodiment The flowchart which shows an example of operation | movement of the terminal device which concerns on this Embodiment. The figure which shows the original image in this Embodiment typically The figure which shows typically the hierarchical structure of the original image in this Embodiment The figure which shows an example of the content of the application information in this Embodiment The figure which shows an example of the content of the application information with an image components search order in this Embodiment The figure which shows an example of the content of the power saving requirement information in this Embodiment Flowchart showing an example of list dialog decision processing in the present embodiment The flowchart which shows an example of the determination process for buttons in this Embodiment The figure which shows an example of the content of the image image generation command in this Embodiment The figure which shows a mode that a synthesized image is produced | generated in this Embodiment

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram illustrating an example of a configuration of a terminal device according to the present embodiment.

  In FIG. 1, a terminal device 100 according to the present embodiment includes a terminal-specific information database (DB) 110, a power saving image component information database 120, an application management unit 130, a power saving requirement information generating unit 140, a power saving. A display instruction unit 150, an image generation unit 160, an image management unit 170, a composition unit 180, and a display unit 190.

  The terminal-specific information database 110 stores terminal-specific information describing information related to a memory (not shown) that the terminal device 100 has.

  FIG. 2 is a diagram illustrating an example of the content of terminal-specific information.

  As shown in FIG. 2, the terminal-specific information 210 describes, for each information item 211, information content 212 related to the memory in that item.

  In the present embodiment, terminal device 100 has a first memory and a second memory. This is because the power consumption of the entire memory device can be reduced by stopping the power supply to the unused memory.

  Therefore, in FIG. 2, the terminal specific information 210 describes that the terminal device 100 has these two memories, for example. The terminal-specific information 210 describes that the data size of each memory is, for example, that the capacity of the first memory is 256 MB (megabytes) and the remaining capacity is 40 MB. Here, the remaining capacity means a memory size of a portion of the usable memory of the terminal specific information 210 that is not used.

  Further, it is assumed that the terminal-specific information 210 describes, for example, a memory operation rule in which only the first memory is operated when the remaining battery level is lower than the threshold value. The terminal device 100 can reduce the power consumption of the terminal device 100 by cutting the power supply of the second memory or deactivating the clock according to such an operation rule.

  For example, the terminal-specific information 210 is stored in the terminal-specific information database 110 in advance by the manufacturer of the terminal device 100 before product shipment. Further, the terminal-specific information database 110 may accept setting or changing (rewriting) of the terminal-specific information 210 from the user via a GUI (graphical user interface) generated by the display unit 190 described later. Further, the terminal specific information database 110 may accept setting or changing of the terminal specific information 210 through authentication from the outside via a network such as the Internet. Further, the terminal-specific information database 110 may change the terminal-specific information 210 as needed according to changes in the status of the terminal device 100 (for example, addition of memory, change in remaining capacity, etc.).

  The power saving image component information database 120 in FIG. 1 stores power saving image component information. The image component information for power saving includes the attribute of the image component including at least one of the display hierarchy, the display screen size (relative to the size of the original image), the image type, and the superimposed state, and the data size of the image component. This is information associated with a combination with a reduction method when reducing the amount of. The power-saving image component information is information that defines the priority order for reducing the data size (hereinafter simply referred to as “priority order”). In addition, the priority order of the power saving image component information is in the order of less influence on the display quality due to the reduction.

  Here, the image component is an image that constitutes an image (hereinafter referred to as “original image”) that is installed on the terminal device 100 or that is a target of screen display by a group of application software that is running on the terminal device 100. Is a unit. The image component is an image that can be individually subjected to image processing such as display, deletion, movement, and change of display form. By configuring an image with image components, the terminal device 100 can easily perform, for example, processing of the entire image and implementation of a function as a GUI such as a button. Examples of image parts include list dialogs, buttons, JPEG (Joint Photographic Experts Group) images, PNG (portable network graphics) images, and moving images.

  FIG. 3 is a diagram illustrating an example of the content of power saving image component information.

  As shown in FIG. 3, the power saving image component information 220 describes a set of a component type 222 and a processing content 223 for each priority order 221. The component type 222 is information indicating the attribute of the image component including the display hierarchy, the display screen size, the image type, and the superimposed state with other image components. The component type 222 indicates the degree of deterioration in display quality when the data size is reduced. Corresponding. The processing content 223 is information for designating a generation method for generating a power-saving image component with a reduced data size of the image component. The processing content 223 may be specific processing content itself, or may be information that designates a preset processing by identification information or the like.

  For example, an image component of the component type 222 “button” has a lower degree of deterioration in display quality of the entire image when the data size is reduced than an image component of the component type 222 “JPEG image”. This is because the user usually pays attention to visual information in a JPEG image, but pays attention to functional information in a button.

  Accordingly, the power saving image component information 220 is associated with the priority order 221 of “1”, for example, the component type 222 of “list dialog”, and the processing content 223 of “execution of power saving list dialog generation”. Is described. The power saving list dialog generation process is, for example, a process of reducing the number of lines in the list displayed simultaneously in the list dialog by three lines. Then, the power saving image component information 220 is associated with a lower priority “221” of “3”, for example, a component type 222 “PNG image” and a processing content “execution of power saving PNG image generation processing”. 223 and 223 are described.

  The application management unit 130 in FIG. 1 manages the above-described application software group. The application management unit 130 acquires image data (original image data) of an original image every time application software that is running updates (draws) a screen to be displayed. This original image data is image data including one or a plurality of image components that are displayed (drawn) by application software. Then, the application management unit 130 acquires application information that is information regarding image components (hereinafter referred to as “used image components”) included in the original image, and outputs the acquired application information to the power saving instruction unit 150 together with the original image data.

  The application management unit 130 may extract application information from original image data or may acquire it from application software. A specific example of the contents of the application information will be described later. Here, for the sake of simplicity of explanation, it is assumed that there is one application software that is moving.

  The power saving requirement information generation unit 140 generates power saving requirement information with reference to the terminal specific information (see FIG. 2) stored in the terminal specific information database 110 and outputs the power saving requirement information to the power saving instruction unit 150. Here, the power saving requirement information is information that defines the conditions for performing the power saving process by describing the requirement not to perform the power saving process (hereinafter referred to as “power saving requirement”). . The power saving process is to replace the image data (power saving image data) of the power saving image obtained by replacing the image component of the original image with the power saving image component, and store it in the memory (bitmap development) with the original image data. It is processing of. A specific example of the content of the power saving requirement information will be described later.

  The power saving instruction unit 150 generates an image image generation command based on the original image data, and outputs it to the image generation unit 160 together with the original image data. Here, the image image generation instruction is information for instructing to display original image data based on the original image data stored in the memory by storing the original image data in the memory (bitmap expansion).

  However, the power saving instruction unit 150 appropriately rewrites the image image generation command to the content instructing the power saving process based on the power saving requirement.

  Specifically, it is as follows. First, the power saving instruction unit 150 sequentially determines whether to perform power saving processing based on the power saving requirement information. When the power saving instruction unit 150 determines that the power saving process is to be performed, the power saving instruction unit 150 sets a search order for the used image components in accordance with a preset search order setting rule. Here, the search order setting rule is a search according to each attribute including at least one of a display hierarchy, a display screen size, an image type, and a superimposed state with another image component for the used image component. This is a rule for setting the order. Further, the search order is an order for searching for an object whose data size is to be reduced. The search order is determined corresponding to the small degree of influence on the display quality when the data size is reduced for each image part.

  FIG. 4 is a diagram illustrating an example of the contents of the search order setting rule.

  As shown in FIG. 4, the search order setting rule 230 describes, for example, that “a higher-order search order is set for an image component having a larger number of other superimposed image components”. Yes. In this case, the power saving instruction unit 150 sets the first search order for the image component having the largest number of other image components whose display areas overlap.

  Note that the search order setting rule 230 may be, for example, a content for setting a lower search order for an image component of a higher display hierarchy. In addition, the search order setting rule 230 may be a content that sets a lower search order for an image component having a larger display screen size when superposition is performed in the display hierarchy order. Alternatively, the search order setting rule 230 may be a content that sets a search order for a rank obtained by combining a rank based on the display hierarchy and a rank based on the display screen size.

  Then, the power saving instruction unit 150 in FIG. 1 generates application information with search order, which is information describing the set search order and the like. Furthermore, the power saving instruction unit 150 generates an image image generation instruction that instructs the power saving process based on the application information with the search order, and outputs the image image generation instruction to the image generation unit 160 together with the original image data. Specific examples of the contents of the application information with search order and the contents of the image image generation command will be described later.

  The image generation unit 160 generates layer images corresponding to the respective image parts based on the original image data and the image image generation command, and outputs the generated layer image group to the image management unit 170. The layer image is an image for each display hierarchy, and in the present embodiment, each layer image includes one image component.

  The image management unit 170 manages the layer image group for each application software, and outputs the layer image group to the synthesis unit 180 together with an image image generation command. Specifically, the image management unit 170 stores a group of input image data of the layer image group in a memory. The image data stored in the memory becomes original image data when the power saving process is not performed, and becomes power saving image data when the power saving process is performed.

  The synthesizing unit 180 generates synthesized image data (hereinafter referred to as “synthesized image data”) obtained by superimposing and synthesizing layer images by α synthesis or the like based on the image image generation command, and outputs the synthesized image data to the display unit 190.

  The display unit 190 includes a liquid crystal display, for example, and displays an image based on the composite image data. The image displayed on the display unit 190 is an original image when the power saving process is not performed, and is a power saving image when the power saving process is performed.

  Although not shown, the terminal device 100 includes, for example, a central processing unit (CPU), a storage medium such as a ROM (read only memory) that stores a control program, and a working memory such as a random access memory (RAM). . In this case, the function of each unit described above is realized by the CPU executing the control program.

  Thus, the terminal device 100 performs data size reduction for each image component. Therefore, the terminal device 100 according to the present embodiment can limit the data size reduction to image parts that have little influence on the display quality. In addition, the terminal device 100 according to the present embodiment can increase the degree of data size reduction only for image components that have little influence on display quality. Therefore, the terminal device 100 can reduce power consumption while more reliably suppressing a deterioration in display quality.

  Next, the operation of the terminal device 100 will be described.

  FIG. 5 is a flowchart illustrating an example of the operation of the terminal device 100. The feature of the operation of the terminal device 100 is mainly the operation of the power saving instruction unit 150. Therefore, the operation of the power saving instruction unit 150 will be mainly described.

  First, in step S <b> 1100, the power saving instruction unit 150 acquires from the application management unit 130 original image data and application information of an original image for one screen to be newly displayed. As described above, the application information is acquired by the application management unit 130 every time the original image is switched.

  FIG. 6 is a diagram schematically showing an original image assumed in the following description.

  As shown in FIG. 6, the original image 310 is configured by superimposing first to fifth image components 311 to 315. It is assumed that identifiers α, β, γ, δ, and ε are sequentially assigned to the first to fifth image components 311 to 315.

  In the present embodiment, it is assumed that each image component has a one-to-one correspondence with the layer image constituting the original image 310 as described above. For this reason, the identifier of the image component indicates the display hierarchy (depth information on the screen, z-axis information) as it is.

  FIG. 7 is a diagram schematically showing the hierarchical structure of the original image shown in FIG.

  As shown in FIG. 7, the first to fifth image components 311 to 315 (identifiers α to ε) are arranged in this order from the lower layer to the upper layer. Therefore, for example, the first image component 311 (identifier α) located in the lowest layer is covered with other image components 312 to 315 (identifiers β to ε) in the original image.

  Note that the original image in the present embodiment has an image format in which transparency is added to the RGB method, and is, for example, an RGBA (red-green-blue-alpha) image. Therefore, the image component includes a translucent image.

  FIG. 8 is a diagram showing an example of the contents of application information generated corresponding to the original image shown in FIG.

  As shown in FIG. 8, the application information 410 describes, for each information item 411, information content 412 related to the original image data in that item. Specifically, the application information 410 describes the identifier and attribute of each used image component and the application used memory size related to the original image data. Here, the application use memory size is the maximum memory size used by the application software main body excluding the memory size used for displaying the used image parts. Here, the application information 410 includes, for example, that the used image component of the identifier (display hierarchy) “α” is the component type “JPEG image” and its display area (0, 0-799, 1279). Is described. The application information 410 describes that the application use memory size of the original image data is 35 MB.

  In step S1200 of FIG. 5, the power saving instruction unit 150 determines the search order for the used image parts from the application information (see FIG. 8) according to the search order setting rule (see FIG. 4). Further, the power saving instruction unit 150 acquires the data size of each used image component from the original image data or the component type described in the application information and the size of the display area. The power saving instruction unit 150 calculates the data size of the used image component from the rectangular size of the used image component described in the application information, for example, with RGBA8888, the data size of one pixel is 32 bits (4 bytes). Then, the power saving instruction unit 150 generates application information with a search order from the determined search order and the acquired data size of each used image component. Here, the data size of the used image component is a memory size used for displaying the used image component.

  FIG. 9 is a diagram illustrating an example of the contents of the application information with image component search order generated from the application information illustrated in FIG. 8.

  As illustrated in FIG. 9, the application information 420 with search order describes, for each information item 421, information content 422 relating to the original image data in that item. Specifically, the application information with search order 420 describes the identifier and attribute of each image component associated with the search order, the application use memory size, and the image use memory size.

  Here, the image use memory size is a memory size used for displaying all the used image components included in the original image data, and is a total value of the data sizes of the used image components. In the example shown in FIG. 9, the image use memory sizes of the use image components of the identifiers α to ε are “4 MB”, “0.4 MB”, “1.8 MB”, “1.4 MB”, and “0.4 MB” in this order. It is. Therefore, the image use memory size is “8 MB” which is the total value of these.

  The application information with search order 420 describes the identifier and attribute of each image component associated with the search order. For example, the application information 420 with search order describes that the used image component of the identifier (display hierarchy) “α” is the component type “JPEG image” and its data size is 4 MB. In addition, the application information with search order 420 describes that the first to fifth search orders are set in this order for the used image parts having the identifiers α to ε.

  In step S 1300, the power saving instruction unit 150 acquires power saving requirement information from the power saving requirement information generation unit 140. As described above, the power saving requirement information is generated by the power saving requirement information generation unit 140 based on the terminal-specific information (see FIG. 2) and the status of the terminal device 100.

  FIG. 10 is a diagram illustrating an example of the content of the power saving requirement information.

  As shown in FIG. 10, the power saving requirement information 260 describes, for each information item 261, the contents 262 of the power saving requirement in that item. Here, the power saving requirement information 260 indicates that, as a power saving requirement, the sum of the application use memory size and the image use memory size (hereinafter referred to as “total use memory size”) is 40 MB or less which is the remaining capacity of the first memory. Describe something. This stipulates that power saving processing is performed when the total memory size used exceeds 40 MB.

  In step S1400 of FIG. 5, the power saving instruction unit 150 determines that the content of the application information with search order (see FIG. 9), that is, the original image data, satisfies the power saving requirement of the power saving requirement information (see FIG. 10). Judge whether it meets. If the original image data satisfies the power saving requirement (S1400: YES), the power saving instruction unit 150 proceeds to step S2200. If the original image data does not satisfy the power saving requirement (S1400: NO), the power saving instruction unit 150 proceeds to step S1500.

  For example, in the example shown in FIG. 9, the total used memory size is “43 MB” as described above, which exceeds 40 MB, which is the remaining capacity of the first memory. Therefore, in this case, the power saving instruction unit 150 determines that the power saving requirement is not satisfied, and proceeds to step S1500.

  In step S1500, the power saving instruction unit 150 selects one priority order of the power saving image component information (see FIG. 3) stored in the power saving image component information database 120 according to the priority order. That is, the power saving instruction unit 150 selects the priority “1” when first proceeding to step S1500, and selects the priority “2” when returning to step S1500 next. In other words, the power saving instruction unit 150 repeatedly selects the power saving image component information corresponding to the priority order by selecting the priority order until the power saving requirement is satisfied.

  In step S1600, the power saving instruction unit 150 selects the component type of the used image component described in the application information with search order in accordance with the search order of the application information with search order, and selects the power saving image part information. Search in. That is, the power saving instruction unit 150 searches for a used image component corresponding to the selected priority order and the processing content in the priority order as a used image component capable of reducing the data size. The reduction in the data size of the used image component means that the used image component is replaced with a power-saving image component generated based on the corresponding processing content.

  For example, the case where the power saving instruction unit 150 performs the first search (that is, the search with priority 1) for the application information with the search order shown in FIG. 9 using the power saving image component information shown in FIG. Suppose. In the search with priority 1, the power saving instruction unit 150 first obtains a list dialog with the identifier δ as a search result, and then obtains a button with the identifier ε as a search result. However, since the target component types are only list dialogs and buttons (see FIG. 3), the power saving instruction unit 150 does not obtain the search results for the JPEG images with the identifiers α and δ and the PNG images with the identifier β. It will be.

  The power saving instruction unit 150 proceeds to step S1700 each time one used image component is searched. Note that the power saving instruction unit 150 may proceed to step S1900, which will be described later, when a use image component capable of reducing the data size is not searched.

  In step S1700, the power saving instruction unit 150 calculates the total used memory size when the original image data is replaced with the power saving image data obtained by adding the searched used image component to the data size reduction target. To do.

  In step S1800, the power saving instruction unit 150 determines whether the power saving image data obtained by adding the used image component to the data size reduction target satisfies the power saving requirement of the power saving requirement information (see FIG. 10). Judge whether or not. If the power saving image data does not satisfy the power saving requirement (S1800: NO), the power saving instruction unit 150 proceeds to step S1900.

  In step S1900, the power saving instruction unit 150 determines whether there is still a used image component that can be added to the data size reduction target for the priority order being selected. If there is still a use image part that can be added to the data size reduction target (S1900: YES), the power saving instruction unit 150 returns to step S1600 and searches for the next use image part. Further, when there is no use image component that can be added to the data size reduction target (S1900: NO), the power saving instruction unit 150 proceeds to step S2000. Thereby, the power saving instruction unit 150 adds the data size reduction target according to the search order until the power saving requirement is satisfied within the range of the priority order being selected. That is, the power saving instruction unit 150 adds data size reduction targets until the data size of the power saving image data is indirectly defined by the power saving requirement and becomes equal to or smaller than the target data size. Specifically, the power saving instruction unit 150 applies the reduction method to the image parts in accordance with an order in which the priority order is higher and the search order is lower.

  In step S2000, the power saving instruction unit 150 determines whether or not the power saving image component information (see FIG. 3) has a lower priority than the currently selected priority. If there is a lower priority (S2000: YES), the power saving instruction unit 150 returns to step S1500 and selects the next priority. As a result, the power saving instruction unit 150 adds data size reduction targets while sequentially decreasing the priority order until the power saving requirement is satisfied.

  Then, when the power saving image data satisfies the power saving requirement (S1800: YES), the power saving instruction unit 150 proceeds to step S2100. In the above example, the power saving instruction unit 150 adds the data size reduction target until the image use memory size is less than “8 MB” (original data size) to “5 MB” (target data size). Will go.

  Also, the power saving instruction unit 150 proceeds to step S2100 even when the lower priority does not exist (S2000: NO). In this case, it is desirable that the power saving instruction unit 150 notifies the user that the power saving process cannot be performed sufficiently by image display or the like. Further, the power saving instruction unit 150 may issue an instruction to stop other application software that is operating and has a low priority or is in the sleep mode.

  The power saving instruction unit 150 may dynamically change the content of the power saving image component generation process for each used image component. Here, a specific example of the process of determining the content of the above-described power saving list dialog generation process (hereinafter referred to as “list dialog determination process”) will be described. Here, a specific example of a process for determining the content of the power saving button generation process (hereinafter referred to as “button determination process”) will be described. These processes are executed, for example, in step S1700 of FIG.

  FIG. 11 is a flowchart illustrating an example of the list dialog determination process.

  When the searched list dialog can be canceled semi-transparent (S1701: YES), the power saving instruction unit 150 determines the cancellation and calculates the total memory size used when the list dialog is canceled (S1702). For example, the power saving instruction unit 150 determines whether or not semi-transparency can be canceled based on whether or not the data in the list dialog is translucent. Then, the power saving instruction unit 150 ends the process when the power saving requirement is satisfied by the semi-transparent cancellation (S1703: YES).

  The power saving instruction unit 150 can reduce the color of the list dialog when the translucent state cannot be canceled (S1701: NO) or when the power saving requirement is not satisfied even if the translucency is canceled (S1703: NO). It is determined whether or not (S1704). For example, the power saving instruction unit 150 performs this determination based on whether or not the colors used in the list dialog exceed a predetermined number of colors necessary for character display or the like, such as two colors. .

  When the color reduction is possible (S1704: YES), the power saving instruction unit 150 determines the color reduction and calculates the total memory size used when color reduction is performed (S1705). If the power saving requirement is satisfied by the color reduction (S1706: YES), the power saving instruction unit 150 ends the process.

  The power saving instruction unit 150 proceeds to step S1707 when the color reduction is not possible (S1704: NO), or when the power saving requirement is not satisfied even if the color reduction is performed (S1706: NO). Then, the power saving instruction unit 150 determines whether or not the list lines that can be displayed simultaneously can be reduced by one line from the current state (S1707). For example, the power saving instruction unit 150 determines this based on whether or not the number of list lines that can be displayed simultaneously exceeds a predetermined number of lines necessary for grasping the scroll state of the list, such as three lines. I do.

  If the power saving instruction unit 150 can reduce the number (S1707: YES), the power saving instruction unit 150 determines to delete one line in the list, and calculates the total memory size to be used when the list is deleted (S1708). Then, when the power saving requirement is satisfied by the deletion (S1709: YES), the power saving instruction unit 150 ends the process.

  The power saving instruction unit 150 returns to step S1707 if the power saving requirement is not satisfied even after the deletion (S1709: NO). Then, the power saving instruction unit 150 ends the process when it is not possible to reduce the number of rows in the list, such as the last one row (S1707: NO).

  Note that when the power saving instruction unit 150 determines to reduce the number of lines in the list displayed simultaneously in the list dialog, the power saving instruction unit 150 generates an image reduced (reduced resolution) according to the number of lines. May be determined. In this case, when generating the composite image data, the subsequent synthesis unit 180 enlarges the reduced image to the original size and performs superposition and synthesis. At that time, in the bitmap font, there is a possibility that jaggy may be conspicuous, so the reduction that does not affect the display quality is the limit. In addition, the power saving instruction unit 150 may generate information on scalable fonts separately, and cause the synthesis unit 180 at the subsequent stage to generate a list dialog based on this information.

  FIG. 12 is a flowchart illustrating an example of the button determination process.

  If the searched button can cancel the translucent button (S1711: YES), the power saving instruction unit 150 determines the cancellation and calculates the total memory size used when the button is canceled (S1712). Then, the power saving instruction unit 150 ends the process when the power saving requirement is satisfied by the semitransparent cancellation (S1713: YES).

  If the power saving instruction unit 150 cannot cancel the translucency (S1711: NO), or if the power saving requirement is not satisfied even if it is canceled (S1713: NO), the process proceeds to step S1714. move on. Then, the power saving instruction unit 150 determines whether or not the button can reduce the color (S1714).

  If color reduction is possible (S1714: YES), the power saving instruction unit 150 determines the color reduction, calculates the total memory size used when color reduction is performed (S1715), and ends the process.

  The power saving instruction unit 150 ends the process when color reduction is not possible (S1714: NO).

  Through these processing content generation processing, the power saving instruction unit 150 creates power saving image component generation processing content suitable for the characteristics of each used image component, and achieves power saving by reducing the data size. be able to.

  For example, when the translucency is canceled in an image component having an image format of RGBA8888, the data size can be reduced by 25%. In addition, when the color is reduced from RGB24 (RGB888) to RGB16 (RGB565), the data size can be reduced by 50% including a semi-transparent stop.

  Note that the criteria for determining whether or not semi-transparent cancellation, color reduction, and list row reduction are possible may be defined in, for example, application software, original image data, or terminal-specific information. In this case, the power saving instruction unit 150 determines whether or not semi-transparent cancellation, color reduction, and list row reduction are possible based on, for example, original image data, application information, and power saving requirement information. Further, the criteria for determining whether or not semi-transparent cancellation, color reduction, and list row reduction are possible may be set by the user.

  The processing content generation processing can be applied to various image components other than the list dialog and buttons.

  In step S2100 of FIG. 5, the power saving instruction unit 150 generates power saving image data by applying the specified processing content. Then, the power saving instruction unit 150 generates an image image generation command that instructs to replace the original image data with the generated power saving image data. That is, the power saving instruction unit 150 stores the processing content for each used image component searched for the data size reduction in the image image generation command.

  FIG. 13 is a diagram illustrating an example of the contents of an image image generation command.

  As illustrated in FIG. 13, the image image generation command 430 describes a component type 432, processing content 433, and rectangular coordinate information 434 in association with the identifier 431 of the used image component.

  The identifier 431 corresponds to the identifier (see FIG. 8) described in the application information and indicates depth information on the screen. The processing content 433 describes that a normal image component is used by default, and when it is a data size reduction target, processing content for generating a power saving image component is described. The rectangular coordinate information 434 describes information indicating the position of the used image component in the display image. The component type 432 corresponds to the component information described in the application information, but is not always necessary. The processing content 433 may be specific processing content itself, or may be information specifying a preset processing by identification information or the like.

  Here, for example, with respect to the list dialog of the identifier δ, it is described that an image is generated by changing the display from 10 items to 8 items, and further, opaqueness and color reduction are performed from RGBA 8888 to RGB8.

  In step S <b> 2200 of FIG. 5, the power saving instruction unit 150 outputs an image image generation command to the image generation unit 160. As a result, the power saving instruction unit 150 causes the image generation unit 160 to generate an image and store it in the memory. As a result, the composite image (original image or power saving image) is displayed on the display unit 190.

  FIG. 14 is a diagram schematically illustrating how a composite image is generated from an image image generation command.

  As illustrated in FIG. 14, the image generation unit 160 includes layer images 322 including image components (or power-saving image components) 321-1 to 321-5 based on an image image generation command (see FIG. 13). 1-32-5 are generated. Then, the image generation unit 160 sends the generated layer images 322-1 to 322-5 to the synthesis unit 180 via the image management unit 170 together with the image image generation command.

  The synthesizing unit 180, based on the depth information (identifier) of the image image generation command input from the image management unit 170, synthesized image data of the synthesized image 323 obtained by superimposing the layer images 322-1 to 322-5. Is generated. Then, the synthesis unit 180 stores the synthesized image data in the memory. The display unit 190 displays a composite image based on the composite image data stored in the memory.

  In step S2300 of FIG. 5, the power saving instruction unit 150 determines whether or not an instruction to end the process is given by a user operation or the like. If the power saving instruction unit 150 has not been instructed to end the process (S2300: NO), the process returns to step S1100 and repeats the process for the application information of the next original image. Moreover, the power saving instruction | indication part 150 complete | finishes a series of processes, when the completion | finish of a process is instruct | indicated (S2300: YES).

  With such an operation, the terminal device 100 can save power for each image component in consideration of the influence on the display quality.

  Note that the terminal device 100 may generate a plurality of image component search order-added application information (see FIG. 9) using a plurality of search order patterns, and may employ the best power saving technique. As a plurality of search order patterns, for example, a display hierarchy order of image components and an order of screen sizes of areas displayed without being superimposed can be adopted. As the best judgment criteria, for example, a large amount of data size reduction, a small number of replacements with power saving image components, and the like can be employed. In addition, the terminal device 100 continues the image size reduction target in the past processing as the data size reduction target, or continues the data size reduction processing content determined for the image component. May be applied.

  As described above, the terminal device 100 according to the present embodiment replaces the image data of the power saving image obtained by replacing the image component of the original image with the corresponding power saving image component with the image data of the original image. To store. As a result, the terminal device 100 can save power by reducing the data size in units of image parts, where the degree of influence on display quality differs for each image part. Therefore, the terminal device 100 can reduce the power consumption while more reliably suppressing the deterioration of the display quality as compared with the conventional technique that uniformly reduces the entire data size of the original image. Thus, the terminal device 100 can reduce the size and number of memories, and can achieve weight reduction and cost reduction.

  In recent years, on-screen representations in various terminal devices tend to be complicated, and image parts having a large data size such as transparent buttons are frequently used as GUIs. Therefore, the present invention is suitable for various terminal devices.

  Further, the terminal device 100 according to the present embodiment includes two memory devices, and performs data size reduction in units of image parts with the target of all used memory sizes that can stop one memory. By stopping the power supply of some memory devices, the power consumption of the entire memory is reduced. Therefore, the terminal device 100 can further reduce power consumption.

  Note that the power consumption of the entire memory can also be reduced by increasing the data update cycle for holding data in some memory devices. Therefore, the terminal device 100 may reduce the data size with the target of all used memory sizes that can lengthen the data update period of one memory.

  In the embodiment described above, the terminal device 100 stops the operation of one of the two memories according to the remaining battery level, and then saves power for image display according to the remaining battery level. However, the present invention is not limited to this. The terminal device 100 may have a configuration including two or more memories. Further, the terminal device 100 may be equipped with only one memory and perform power saving of image display according to the remaining battery level. Further, the terminal device 100 may perform power saving for image display regardless of the remaining battery level, or always or according to other conditions such as user designation.

  Each functional unit such as the power saving instruction unit 150 may be realized by an LSI (large scale integrated circuit) as an integrated circuit in addition to the software realized by the control program as described above. In this case, each functional unit may be individually made into one chip, or a plurality of parts may be made into one chip. The LSI here may be referred to as an IC (integrated circuit), a system LSI, a super LSI, an ultra LSI, or the like depending on the degree of integration.

  An integrated circuit that implements each functional unit such as the power saving instruction unit 150 is not limited to an LSI, and may be a dedicated circuit or a general-purpose processor. The integrated circuit may be a field programmable gate array (FPGA) that can be programmed after manufacture, or a reconfigurable processor that can reconfigure internal circuit cell connections and settings. Furthermore, when a technique for circuit integration that replaces LSI, such as circuit integration by biotechnology, appears due to the advancement of semiconductor technology or other derived technology, it is of course possible to use that technology.

  INDUSTRIAL APPLICABILITY The terminal device and the image processing method according to the present invention are useful as a terminal device and an image processing method that can reduce power consumption while more reliably suppressing a deterioration in display quality. Therefore, the present invention is useful for various mobile terminal devices such as mobile phones, portable game machines, and portable AV (audio-video) players, and video terminal devices such as stationary television devices. .

DESCRIPTION OF SYMBOLS 100 Terminal apparatus 110 Terminal specific information database 120 Power saving image component information database 130 Application management part 140 Power saving requirement information generation part 150 Power saving instruction | indication part 160 Image generation part 170 Image management part 180 Composition part 190 Display part

Claims (10)

A terminal device that displays an image based on image data stored in a memory,
An application management unit that acquires image data of an original image including one or more image components;
An image generator that stores image data of the original image in the memory;
For the image generation unit, the image data of the power-saving image obtained by replacing the image component of the original image with a power-saving image component whose data size is reduced for each image component is converted into image data of the original image. A power saving instruction unit that is stored in the memory instead of
Terminal device. The image generation unit
Generating the power-saving image component by reducing the data size for the image component, and generating image data of the power-saving image using the generated power-saving image component;
The terminal device according to claim 1. The power saving instruction unit includes:
For each of the image parts, based on the attribute, determine whether to replace the power-saving image parts,
The terminal device according to claim 2. The power saving instruction unit includes:
For each of the image parts, a data size reduction method is determined based on the attribute.
The terminal device according to claim 3. The attributes include a display hierarchy, a display screen size, an image type, and a superimposed state with other image components.
The terminal device according to claim 4. The power saving instruction unit includes:
For each of the image components included in the original image, application information with search order is generated by associating each data size with a search order according to the attribute, the application information with search order, and the original image Determining the image component to be replaced based on the original data size of the image data and the target data size of the image data of the power saving image;
The terminal device according to claim 5. A power-saving image component information database that stores power-saving image component information that defines the priority of reducing the data size in association with the combination of the attribute and the reduction method;
The power saving instruction unit includes:
Applying the reduction technique to the image components according to a combination of the priority order as the upper order and the search order as the lower order until the data size of the image data of the power saving image is equal to or less than the target data size;
The terminal device according to claim 6. The power saving instruction unit includes:
The search order application information is generated by associating the search order based on at least one of the display hierarchy, the display screen size, the image type, and the superposition state,
The power saving image component information describes the priority order in association with at least one of the display hierarchy, the display screen size, the image type, and the superposition state.
The terminal device according to claim 7. The reduction technique includes at least two of one or more levels of list display row reduction, translucency, and color reduction.
The terminal device according to claim 8. An image processing method in a terminal device for displaying an image based on image data stored in a memory,
Obtaining image data of an original image including one or more image components;
Generating image data of a power-saving image in which the image component of the acquired original image is replaced with a power-saving image component whose data size is reduced for each image component;
Replacing the generated image data of the power saving image with the image data of the original image and storing it in the memory,
Image processing method.

Images