US20160104462A1 - Frame drawing method and associated mobile electronic device - Google Patents
Frame drawing method and associated mobile electronic device Download PDFInfo
- Publication number
- US20160104462A1 US20160104462A1 US14/974,962 US201514974962A US2016104462A1 US 20160104462 A1 US20160104462 A1 US 20160104462A1 US 201514974962 A US201514974962 A US 201514974962A US 2016104462 A1 US2016104462 A1 US 2016104462A1
- Authority
- US
- United States
- Prior art keywords
- image
- drawing region
- icon
- memory
- region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/39—Control of the bit-mapped memory
- G09G5/395—Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/39—Control of the bit-mapped memory
- G09G5/393—Arrangements for updating the contents of the bit-mapped memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/60—Memory management
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/001—Arbitration of resources in a display system, e.g. control of access to frame buffer by video controller and/or main processor
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/34—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators for rolling or scrolling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/12—Frame memory handling
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/12—Frame memory handling
- G09G2360/127—Updating a frame memory using a transfer of data from a source area to a destination area
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/18—Use of a frame buffer in a display terminal, inclusive of the display panel
Definitions
- the invention relates in general to a frame drawing method, a frame updating method and an associated mobile electronic device, and more particularly, to a frame drawing method and a frame updating method that update an image of a predetermined region in a user interface by a graphics component or display the image of the predetermined region through fetching a temporarily stored image, and a mobile electronic device applying the frame drawing method or the frame updating method.
- a user When operating a user interface displayed on a touch screen of a common mobile electronic device, a user may browse various kinds of information accessed by the user interface by finger sliding movements on the user interface.
- a processor of the mobile electronic device employs a graphics component (usually implemented by software) to redraw an image displayed by the user interface.
- contents of the user interface processed by the graphics component are unaffected by the above sliding movement.
- a common mobile electronic device temporarily stores the image of the entire user interface (greater than the actual image of a single page of the user interface) as an additional snapshot.
- the processor only needs to directly fetch the part to be displayed from the above temporarily stored snapshot to complete the display corresponding to the above sliding movement. Large amounts of processing time and computation that the graphics component requires for redrawing the entire user interface can then be saved, yielding better performance of a smooth sliding operation on the user interface.
- FIG. 1 shows a schematic diagram of an image distribution on a user interface displayed by a touch screen of a common conventional mobile electronic device.
- a maximum drawing range supported by the touch screen is T 1 , whose size is restricted by hardware specifications of the mobile electronic device.
- a drawing region T 2 is a fixed viewable range of the user interface displayed by the touch screen. From perspectives of a user, the drawing region T 2 does not exceed beyond the drawing region T 1 regardless of how the drawing region T 2 is moved by a touch command. In other words, with respect to processes of the mobile electronic device, the drawing region T 2 is moved according to a coordinate system established by the drawing region T 1 .
- the amount of computation brought upon the mobile electronic device by a movement of the drawing region T 2 also increases, thus obstructing the touch screen from presenting a smooth sliding effect.
- FIG. 2 shows a schematic diagram of an image distribution on a user interface displayed by a touch panel of another common conventional mobile electronic device.
- images on the touch panel are applied with a concept of hierarchical control.
- a drawing region A 1 is a maximum controllable range of the touch screen
- a drawing region A 2 covering a part of the drawing region A 1 may be regarded as a sub drawing region of the drawing region A 1
- a graphics component for displaying the drawing region A 1 may be utilized to control a graphics component for displaying the drawing region A 2
- the graphics component for displaying the drawing region A 2 may be utilized to control a graphics component for displaying a drawing region A 3 .
- a frame drawing method, a frame updating method, and a mobile electronic device applying the frame drawing method or the frame updating method are provided by the present invention.
- a frame drawing method is provided by the present invention.
- the frame drawing method is applied to draw a frame of an electronic device.
- the frame includes an image region and an icon that is associated with a status of an application program of the electronic device, and the image region includes the icon.
- the drawing method includes: drawing an image of the icon, and storing the image of the icon into a memory; updating the image of the icon according to the status of the application program; storing the updated image of the icon into the memory; and drawing the icon by using the updated image of the icon in the memory when drawing the image region.
- a mobile electronic device is further provided by the present invention.
- the mobile electronic device is configured to display a frame, which includes an image region and an icon.
- the icon is associated with a status of an application program of the electronic device, and the image region includes the icon.
- the mobile electronic device includes a memory and a processing unit.
- the processing unit stores an image of the icon into the memory, updates the image of the icon according to the status of the application program, and stores the updated image of the icon into the memory. When displaying the image region, the icon is drawn by using the updated image of the icon in the memory.
- FIG. 1 and FIG. 2 are schematic diagram of an image distribution on a user interface displayed by a touch screen of a common conventional mobile electronic device
- FIG. 3 is a block diagram of a mobile electronic device according to an embodiment of the present invention.
- FIG. 4 is a schematic diagram of a frame updating method applied to a user interface according to an embodiment of the present invention.
- FIG. 5 is a schematic diagram of a frame updating method according to an embodiment of the present invention when a drawing region S 3 in FIG. 4 is moved according to a sliding operation of a user command and does not exceed a range of a drawing region S 2 ;
- FIG. 6 is a schematic diagram of a frame updating method according to an embodiment of the present invention when a drawing region S 3 in FIG. 4 is moved according to a sliding operation of a user command and exceeds a range of the drawing region S 2 ;
- FIG. 7 is a schematic diagram of combining a drawing region S 31 and a drawing region S 32 in FIG. 6 to display an image R according to an embodiment of the present invention
- FIG. 8 is a flowchart of a frame updating method according to an embodiment of the present invention and the frame updating method in FIGS. 4 to 7 ;
- FIG. 9 and FIG. 10 are schematic diagram of a frame drawing method with an assistance of a decorator component according to an embodiment of the present invention.
- FIG. 11 is a flowchart of a frame drawing method according to an embodiment of the present invention and the frame drawing method in FIGS. 9 and 10 .
- FIG. 3 shows a block diagram of a mobile electronic device 100 according to an embodiment of the present invention.
- the mobile electronic device 100 includes a processor 110 , a memory 120 , a graphics engine 130 , a touch screen 140 , a bus 150 , and a graphics component module 160 .
- the processor 110 collaborates with various graphics components of the graphics engine 130 and the graphics component module 160 to redraw drawing regions on a user interface displayed by the touch screen 140 .
- the drawing regions on the user interface correspond to respective graphics components in the graphics component module 160 .
- the memory 120 temporarily stores a backup image of a drawing region when the processor 110 redraws the drawing region.
- Data transmission between the processor 110 , the memory 120 , the touch screen 140 and the graphics component module 160 is performed via the bus 150 , so as to speedily process redrawn regions or backup images of drawing regions in large amounts. Details of the components for implementing the user interface drawing method of the present invention are given shortly. It should be noted that, in the embodiments below, redrawing operations (excluding pure image fetching operations) performed on the drawing regions by the processor 110 are implemented by the processor 110 calling the corresponding graphics components in the graphics component module 160 and the graphics engine 130 via the bus 150 . Therefore, in the description below, for simplification purposes, such redrawing operations are mainly managed by the processor 110 .
- FIG. 4 shows a schematic diagram of a frame updating method applied to a user interface according to an embodiment of the present invention.
- a user interface displayed on the touch screen 140 includes a drawing region S 1 , a drawing region S 2 , and a drawing region S 3 .
- the drawing region S 1 correspond to a maximum controllable range of the touch screen 140 , i.e., the range of the entire user interface; the drawing region S 3 corresponds to a display range of the touch screen 140 at a time point.
- the drawing region S 3 is a part of the drawing region S 1
- the size of the drawing region S 2 is between those of the drawing region S 1 and the drawing region S 3
- the drawing region S 2 is also a part of the drawing region S 1 .
- the processor 110 draws a part of the drawing region S 1 (i.e., the drawing region S 2 ) in advance and stores the drawn image into the memory 120 .
- the drawing region S 3 can be readily displayed by using the image of the drawing region S 2 stored in the memory 120 .
- the drawing region S 1 is larger and completely covers the drawing regions S 2 and S 3 .
- the drawing region S 2 is larger than and completely covers the drawing region S 3 , whereas the drawing region S 3 may temporarily exceed the range covered by the drawing region S 2 based on a sliding operation of a user command that a user sends via the touch screen 140 .
- the drawing region S 1 corresponds to the maximum controllable range of the touch screen 140 , any changes in the drawing regions S 2 and S 2 do not exceed beyond the range of the drawing region S 1 .
- the drawing regions S 2 and S 3 are in equivalence located under a coordinate system constructed by the drawing region S 1 .
- an x-axis (the horizontal axis) and a y-axis (the vertical axis) of the coordinate system are set as in FIG.
- the coordinates of the upper-left vertex of the drawing region S 1 may be set as (0, 0) representing an origin
- the coordinates of the upper-left vertex of the drawing region S 2 may be set as (X 2 , Y 2 )
- the coordinates of the upper-left vertex of the drawing region S 3 may be set as (X 3 , Y 3 ), where X 2 , Y 2 , X 3 and Y 3 are greater than 0, and X 3 >X 2 and Y 3 >Y 2 .
- the drawing region S 3 which represents the display range that the touch screen 140 displays at a particular time point, has a width W and a length L in fixed values. In other words, the drawing region S 3 has a fixed size. Given that the drawing region S 2 completely covers and is larger than the drawing region S 3 , and the drawing region S 1 completely covers and is larger than the drawing region S 2 , a length LS and a width WS of the drawing region S 2 may be dynamically configured, giving the drawing region S 2 has a dynamically adjustable size.
- the corresponding coordinates (i.e., position information) and sizes of the drawing regions S 2 and S 3 are temporarily stored in the memory 120 under the control of the processor 110 . Further, according to the coordinates and sizes of the drawing regions S 2 and S 3 , the processor 110 determines whether the drawing region S 3 is moved and exceeds the range of the drawing region S 2 each time a user command moves the drawing region S 3 .
- the processor 110 also draws the image R (not shown) of the drawing region S 2 and stores the image R into the memory 120 in advance.
- the size of the image R completely covers and equals the drawing region S 2 , and is updated in the memory 120 by the processor 110 under certain conditions.
- FIG. 5 shows a schematic diagram of a frame updating method according to an embodiment of the present invention when the drawing region S 3 in FIG. 4 is moved according to a sliding operation of a user command and does not exceed the range of the drawing region S 2 .
- the user command that the user sends via the touch screen 140 is to move the user interface (i.e., the fixed range covered by the drawing region S 3 ) upward by a distance D 1
- the drawing region S 3 is substantially moved downward relative to the drawing regions S 1 and S 2 by the distance D 1 .
- the new coordinates of the upper-left vertex of the drawing region S 3 are updated to (X 3 , Y 3 +D 1 ) by the processor 110 , and the updated coordinates are stored into the memory 120 by the processor 110 .
- the drawing region S 3 After being moved according to the user command, the drawing region S 3 does not exceed the range of the drawing region S 2 . Therefore, upon detecting such condition, the processor 110 performs display by directly fetching an image R 1 corresponding to the moved drawing region S 3 from the image R stored in the memory 120 .
- An advantage of the above approach is that, before displaying the moved drawing region S 3 , the processor 110 need not spend additional time and computation to call again graphics components to draw the drawing region S 3 , thereby maintaining the smoothness in displaying the sliding movement in a corresponding frame.
- the drawing region S 2 need not be updated, and so the image R stored in the memory 120 need not be updated either; that is, no additional time and computation are required to redraw the drawing region S 2 .
- FIG. 6 shows a schematic diagram of a frame updating method according to an embodiment of the present invention when the drawing region S 3 in FIG. 4 is moved according to a sliding operation of a user command and exceeds the range of the drawing region S 2 .
- the drawing region S 3 is substantially moved downward relative to the drawing regions S 1 and S 2 by the distance D 2 .
- the processor 110 Upon detecting that the drawing region S 3 is moved and exceeds the range of the drawing region S 2 , the processor 110 first updates the new coordinates of the upper-left vertex of the drawing region S 3 to (X 3 , Y 3 +D 2 ).
- the drawing region S 3 includes a drawing region S 32 that is non-overlapping with the drawing region S 2 and a drawing region S 31 that overlaps with the drawing region S 2 .
- the processor 110 then needs to first determine an updated drawing region S 2 that covers the moved drawing region S 3 . That is to say, the processor 110 needs to have the updated drawing region S 2 that simultaneously covers the drawing regions S 32 and S 31 . Accordingly, the processor 110 updates the image R stored in the memory 120 , and finally fetches the image corresponding to the moved drawing region S 3 from the memory 120 and displays the fetched image on the touch screen 140 .
- FIG. 7 shows a schematic diagram of updating the image R stored in the memory 120 according to an embodiment of the present invention.
- the processor 110 first deletes a sub-image R_Delete of the image R stored in the memory 120 according to the drawing regions S 31 and S 32 , and keeps another sub-image R 2 of the image R.
- the image R is stored at a section of continuous addresses in the memory 120 , and so the sub-image R_Delete and the sub-image R 2 included in the image R are also stored in continuous addresses in the memory 120 .
- the processor 110 utilizes a memory copy instruction to copy contents of the sub-image R 2 to a section of continuous memory addresses starting from the starting address of the sub-image R_Delete in the memory 120 .
- the processor 110 then calls the graphics components to draw a sub-image R 3 , and stores contents of the sub-image R 3 to a section of continuous memory addresses starting from the ending address of the sub-image R 2 and ending at the ending address of the image R.
- the size of the sub-image R 3 equals the size of the sub-image R_Delete.
- the original image R is consisted of the sub-image R_Delete and the sub-image R 2
- the updated image R is consisted of the sub-image R 2 with a relocated storage position and the newly drawn sub-image R 3 .
- the sub-image R 2 includes an image corresponding to the drawing region S 31
- the sub-image R 3 includes an image corresponding to the drawing region S 32 .
- the updated image R includes an image corresponding to the moved drawing region S 3 .
- the memory 110 fetches the image corresponding to the moved drawing region S 3 from the memory 120 and displays the fetched image on the touch screen 140 .
- the processor 110 fetches and displays the moved drawing region S 3 , the position and size of the drawing region S 2 may be dynamically adjusted.
- the processor 110 then adjusts the coordinates (position information, e.g., the coordinates of the upper-left vertex) of the drawing region S 2 according to the adjusted drawing region S 2 , draws a corresponding image and stores the image into the memory 120 .
- An advantage of the approach in FIG. 7 is that, as the sub-image R 2 in the image R need not be redrawn by the processor 110 through the graphics engine 130 , a part of computation and processing time are saved, and computation and processing time are only required for drawing the sub-image R 3 , thereby overcoming the issue of the large amounts of computation and processing time brought about by redrawing the drawing region T 2 having an increased size in the prior art.
- the improvement offered by the present invention gets more apparent as the ratio of the drawing region S 31 in the drawing region S 3 gets larger, i.e., as the ratio of the moved drawing region S 3 exceeding the drawing region S 2 gets smaller.
- step of updating the image R in FIG. 7 are performed within the same section of continuous memory addresses in the memory 120 , and memory resources consumed and allocated for updating the image are also fixed, meaning that no additional load is posed on the memory 120 during updating.
- the drawing region S 3 When the drawing region S 3 is moved by the user command, it is possible that the movement range is too large in a way that the drawing region S 3 completely exceeds the drawing region S 2 . That is, only the drawing region S 32 but not the drawing region S 31 exists between the drawing regions S 3 and S 2 .
- the image R includes only the sub-image R_Delete but not the sub-image R 2 .
- the processor 110 may draw the sub-image R 3 directly based on the change in the drawing region S 2 to provide an updated image R that includes only the sub-image R 3 . That is to say, the starting address and the ending address of the sub-image R 3 are respectively the same as the starting address and the ending address of the image R.
- a situation where the user interface is slid downward by the user command may also be processed by the frame updating method shown in FIGS. 4 to 7 .
- horizontal movements of the user interface may also be applied. Details of such process can be easily deduced by one person skilled in the art with reference to the frame updating method and the associated description, and shall be omitted herein.
- situations where the user interface is moved slantingly may also be processed.
- FIG. 8 shows a flowchart of a frame updating method according to an embodiment of the present invention and the frame updating method in FIGS. 4 to 7 .
- the frame updating method of the present invention includes the following steps.
- step 202 a drawing region S 2 is determined from the user interface, and an image of the drawing region S 2 is drawn and stored into the memory 120 .
- step 204 an image of the drawing region S 3 is obtained from the image of the drawing region S 2 in the memory 120 to display a frame of the mobile electronic device 100 .
- step 206 a movement command is received.
- the movement command requests to perform a movement on the drawing region S 3 in the user interface.
- step 208 it is determined whether the moved drawing region S 3 exceeds the drawing region S 2 according to the movement command.
- step 210 when the moved drawing region S 3 exceeds the drawing region S 2 , the image of the drawing region S 2 in the memory 120 is updated.
- FIG. 8 The steps in FIG. 8 are a summary of the frame updating method in FIGS. 4 to 7 .
- Other embodiments derived from appropriate modifications and reasonable combinations of the above steps or applied with limitations mentioned above are to be regarded as embodiments of the present invention.
- the frame updating method shown in FIGS. 4 to 8 is for solving issues of the prior art in FIG. 1 .
- a frame drawing method to be described with reference to FIGS. 9 and 10 is for solving issues of the prior art in FIG. 2 .
- the frame drawing method in FIGS. 9 and 10 may be implemented by the mobile electronic device 100 in FIG. 3 .
- FIG. 9 shows a schematic diagram of a frame drawing method according to an embodiment of the present invention.
- a main difference of the embodiment in FIG. 9 from the conventional solution in FIG. 2 is that, in addition to determining by the processor 110 whether updating between the drawing regions A 2 and A 3 is required in response to a user command received by the touch screen according to hierarchy, a decorator component C 1 is disposed between the drawing regions A 2 and A 3 , so that the processor 110 may control whether the drawing region A 3 needs to be redrawn via the decorator component C 1 .
- an icon region of the decorator component C 1 shown in FIG. 9 covers and is slightly larger than the drawing region A 3
- a controllable range of the decorator component C 1 is substantially the range covered by the drawing region A 3 .
- the depiction of the decorator component C 1 being slightly larger than the drawing region A 3 in FIG. 9 is merely for better representing the controllable range of the decorator component C 1 .
- the decorator component C 1 may be the processor 110 .
- the processor 110 may draw an image of the drawing region A 3 in advance, and store the image into the memory 120 .
- the mobile electronic device 100 receives various types of updating commands when operating, e.g., notifications of new emails or new messages received.
- updating of an image of a display frame may be required.
- the drawing region A 3 represents an icon of an email or a message
- the processor 110 requests the graphics engine and graphics component module of the drawing region A 3 via the decorator component C 1 to draw an updated image of the drawing region A 3 , and to store the updated image into the memory 120 .
- the processor 110 When the mobile electronic device 100 is to update or display a frame, according to the hierarchy in FIG. 9 , the processor 110 first requests the graphics engine and graphics component module of the drawing region A 2 to draw the drawing region A 2 . At this point, the graphics engine and graphics component module of the drawing region A 2 request the decorator component C 1 to provide the image of the drawing region A 3 . If the drawing region A 3 need not be updated, the decorator component C 1 directly fetches the image of the drawing region A 3 from the memory 120 for a direct use, thereby saving the time for redrawing the drawing region A 3 when the processor 110 requests to draw the drawing region A 2 .
- the decorator component C 1 requests the graphics engine and graphics component module of the drawing region A 3 to draw the updated image of the drawing region A 3 , to store the updated image to the memory 120 , and to provide the updated image for the use of the graphics engine and graphics component module of the drawing region A 2 .
- the image of the drawing region A 3 is arranged in a section of continuous memory addresses in the memory 120 for access.
- the non-updated image of drawing region A 3 occupies a section of continuous memory addresses in the memory 120
- the updated image of drawing region A 3 also occupies the same section of continuous memory addresses in the memory 120 .
- a memory duplication command may be utilized to assist the above process of updating contents of the drawing region A 3 in the memory 120 .
- a time point at which the processor 110 updates the contents of the drawing region in the memory 120 and a time point at which the processor 110 redraws the display frame may be independent.
- the processor 110 may be triggered to redraw the display frame by periodically activating the user interface or by activating the user interface by the user.
- the updated drawing region A 3 can be directly fetched from the memory 120 as it is already stored in the memory 120 . Further, the time that the processor 110 needs to redraw the display frame is also shortened.
- FIG. 10 shows a schematic diagram of a user interface drawing method according to an embodiment of the present invention.
- Main differences of FIG. 10 from FIG. 9 are additional drawing regions A 4 and A 5 in the drawing region A 3 , and an additional decorator component C 2 between the drawing regions A 3 and A 5 .
- the processor 110 may directly control the updating of the drawing region A 5 via the decorator component C 2 .
- the updating of the drawing region A 5 unaffected by the updating of the drawing region A 3 , is independent from the drawing mechanism of the drawing region A 3 .
- the processor 110 when disposing the decorator component 2 , the processor 110 also stores an image of the drawing region A 5 in the memory 120 in advance.
- whether to dispose a decorator component on a drawing region is determined by a user command entered by a user. Further, as the number or the updating frequency of drawing regions controlled by the decorator component gets larger/higher, the more apparent the time saved for the redrawing performed by the processor 110 .
- FIG. 11 shows a flowchart of a frame drawing method according to an embodiment of the present invention and the frame drawing method in FIGS. 9 and 10 .
- the frame drawing method of the present invention includes the following steps.
- step 302 an image of the drawing region A 3 is drawn into the memory 120 .
- step 304 an updated image of the drawing region A 3 is drawn into the memory 120 .
- step 306 when drawing the drawing region A 2 , the updated image of the drawing region A 3 in the memory 120 is utilized to display the drawing region A 3 .
- FIG. 11 is exemplified by the drawing operations between the drawing regions A 2 and A 3 , the steps may also be applied to the drawing operations between the drawing regions A 3 and A 5 in FIG. 10 .
- Other embodiments derived from appropriate modifications and reasonable combinations of the above steps or applied with limitations mentioned above are to be regarded as embodiments of the present invention.
- a frame updating method, a frame drawing method and a mobile electronic device are disclosed by the present invention.
- a part of drawing regions that need not be updated in the user interface with a backup image stored in advance, computation and processing time for redrawing an updated drawing region may be saved, thereby offering satisfactory smoothness in operations on the user interface of the mobile electronic device.
Abstract
A mobile electronic device is provided by the present invention. The mobile electronic device is configured to display a frame, which includes an image region and an icon. The icon is associated with a status of an application program of the electronic device, and the image region includes the icon. The mobile electronic device includes a memory and a processing unit. The processing unit stores an image of the icon into the memory, updates the image of the icon according to the status of the application program, and stores the updated image of the icon into the memory. When displaying the image region, the icon is drawn by using the updated image of the icon in the memory.
Description
- This application claims the benefit of Taiwan application Serial No. 102143048, filed Nov. 26, 2013, the subject matter of which is incorporated herein by reference.
- 1. Field of the Invention
- The invention relates in general to a frame drawing method, a frame updating method and an associated mobile electronic device, and more particularly, to a frame drawing method and a frame updating method that update an image of a predetermined region in a user interface by a graphics component or display the image of the predetermined region through fetching a temporarily stored image, and a mobile electronic device applying the frame drawing method or the frame updating method.
- 2. Description of the Related Art
- When operating a user interface displayed on a touch screen of a common mobile electronic device, a user may browse various kinds of information accessed by the user interface by finger sliding movements on the user interface. When an operation of the finger sliding movement corresponds to a maximum display range of a single page displayed on the user interface, a processor of the mobile electronic device employs a graphics component (usually implemented by software) to redraw an image displayed by the user interface. However, contents of the user interface processed by the graphics component are unaffected by the above sliding movement.
- To reduce the load of the processor that utilizes the graphics component to redraw the image displayed by the user interface, a common mobile electronic device temporarily stores the image of the entire user interface (greater than the actual image of a single page of the user interface) as an additional snapshot. Thus, when the user operates the user interface by a sliding movement, the processor only needs to directly fetch the part to be displayed from the above temporarily stored snapshot to complete the display corresponding to the above sliding movement. Large amounts of processing time and computation that the graphics component requires for redrawing the entire user interface can then be saved, yielding better performance of a smooth sliding operation on the user interface.
- However, as the size of the user interface expands, the range of the temporarily stored image of the user interface also becomes larger. As a result, by directly implementing the above method, certain mobile electronic devices equipped with a smaller memory may fail to present expected smoothness for the corresponding sliding movement on the user interface.
-
FIG. 1 shows a schematic diagram of an image distribution on a user interface displayed by a touch screen of a common conventional mobile electronic device. As shown inFIG. 1 , a maximum drawing range supported by the touch screen is T1, whose size is restricted by hardware specifications of the mobile electronic device. A drawing region T2 is a fixed viewable range of the user interface displayed by the touch screen. From perspectives of a user, the drawing region T2 does not exceed beyond the drawing region T1 regardless of how the drawing region T2 is moved by a touch command. In other words, with respect to processes of the mobile electronic device, the drawing region T2 is moved according to a coordinate system established by the drawing region T1. - When a user of the mobile electronic device sends out a user command by a sliding movement to slide the user interface upward by a distance D, a result that the user observes is in equivalence sliding the drawing region T2 by the distance D. However, from perspectives of the mobile electronic device, the drawing region T2 is substantially unmoved, and the drawing region T1 is in fact slid upward by the distance D. On the other hand, for the coordinate system established based on the drawing region T1, a relative position of the drawing region T2 is moved downward by the distance D.
- As previously stated, with an increasing range of the drawing region T2, the amount of computation brought upon the mobile electronic device by a movement of the drawing region T2 also increases, thus obstructing the touch screen from presenting a smooth sliding effect.
-
FIG. 2 shows a schematic diagram of an image distribution on a user interface displayed by a touch panel of another common conventional mobile electronic device. As shown inFIG. 2 , images on the touch panel are applied with a concept of hierarchical control. Assuming that the range of a drawing region A1 is a maximum controllable range of the touch screen, a drawing region A2 covering a part of the drawing region A1 may be regarded as a sub drawing region of the drawing region A1, and a graphics component for displaying the drawing region A1 may be utilized to control a graphics component for displaying the drawing region A2. Similarly, the graphics component for displaying the drawing region A2 may be utilized to control a graphics component for displaying a drawing region A3. - Under the mechanism shown in
FIG. 2 , when a user command sent by a user is for sliding the drawing region A3, it is known from the hierarchical relationship of the drawing regions A1, A2 and A3 that, all of the drawing regions A1, A2 and A3 need to be redrawn in response to the user command. However, if the user command is for sliding a part that is in the drawing region A2 but excluding the drawing region A3, the drawing region A3 that is not operated by the user command also needs to be redrawn as the drawing region A2 needs to be redrawn. Under the abovementioned circumstances of the increasing size of the user interface, the need of compulsorily redrawing a region such as the drawing region A3 that is not operated by a user command due to redrawing a parent drawing region is becoming frequent occurrences, thereby posing a significant load on the amount of graphics computation for a mobile electronic device. - To mitigate massive amounts of computation incurred by redrawing a drawing region on a user interface of a touch screen of a conventional mobile electronic device, a frame drawing method, a frame updating method, and a mobile electronic device applying the frame drawing method or the frame updating method are provided by the present invention.
- A frame drawing method is provided by the present invention. The frame drawing method is applied to draw a frame of an electronic device. The frame includes an image region and an icon that is associated with a status of an application program of the electronic device, and the image region includes the icon. The drawing method includes: drawing an image of the icon, and storing the image of the icon into a memory; updating the image of the icon according to the status of the application program; storing the updated image of the icon into the memory; and drawing the icon by using the updated image of the icon in the memory when drawing the image region.
- A mobile electronic device is further provided by the present invention. The mobile electronic device is configured to display a frame, which includes an image region and an icon. The icon is associated with a status of an application program of the electronic device, and the image region includes the icon. The mobile electronic device includes a memory and a processing unit. The processing unit stores an image of the icon into the memory, updates the image of the icon according to the status of the application program, and stores the updated image of the icon into the memory. When displaying the image region, the icon is drawn by using the updated image of the icon in the memory.
- The above and other aspects of the invention will become better understood with regard to the following detailed description of the preferred but non-limiting embodiments. The following description is made with reference to the accompanying drawings.
-
FIG. 1 andFIG. 2 are schematic diagram of an image distribution on a user interface displayed by a touch screen of a common conventional mobile electronic device; -
FIG. 3 is a block diagram of a mobile electronic device according to an embodiment of the present invention; -
FIG. 4 is a schematic diagram of a frame updating method applied to a user interface according to an embodiment of the present invention; -
FIG. 5 is a schematic diagram of a frame updating method according to an embodiment of the present invention when a drawing region S3 inFIG. 4 is moved according to a sliding operation of a user command and does not exceed a range of a drawing region S2; -
FIG. 6 is a schematic diagram of a frame updating method according to an embodiment of the present invention when a drawing region S3 inFIG. 4 is moved according to a sliding operation of a user command and exceeds a range of the drawing region S2; -
FIG. 7 is a schematic diagram of combining a drawing region S31 and a drawing region S32 inFIG. 6 to display an image R according to an embodiment of the present invention; -
FIG. 8 is a flowchart of a frame updating method according to an embodiment of the present invention and the frame updating method inFIGS. 4 to 7 ; -
FIG. 9 andFIG. 10 are schematic diagram of a frame drawing method with an assistance of a decorator component according to an embodiment of the present invention; and -
FIG. 11 is a flowchart of a frame drawing method according to an embodiment of the present invention and the frame drawing method inFIGS. 9 and 10 . -
FIG. 3 shows a block diagram of a mobileelectronic device 100 according to an embodiment of the present invention. As shown inFIG. 3 , the mobileelectronic device 100 includes aprocessor 110, amemory 120, agraphics engine 130, atouch screen 140, abus 150, and agraphics component module 160. Theprocessor 110 collaborates with various graphics components of thegraphics engine 130 and thegraphics component module 160 to redraw drawing regions on a user interface displayed by thetouch screen 140. The drawing regions on the user interface correspond to respective graphics components in thegraphics component module 160. Thememory 120 temporarily stores a backup image of a drawing region when theprocessor 110 redraws the drawing region. Data transmission between theprocessor 110, thememory 120, thetouch screen 140 and thegraphics component module 160 is performed via thebus 150, so as to speedily process redrawn regions or backup images of drawing regions in large amounts. Details of the components for implementing the user interface drawing method of the present invention are given shortly. It should be noted that, in the embodiments below, redrawing operations (excluding pure image fetching operations) performed on the drawing regions by theprocessor 110 are implemented by theprocessor 110 calling the corresponding graphics components in thegraphics component module 160 and thegraphics engine 130 via thebus 150. Therefore, in the description below, for simplification purposes, such redrawing operations are mainly managed by theprocessor 110. -
FIG. 4 shows a schematic diagram of a frame updating method applied to a user interface according to an embodiment of the present invention. As shown inFIG. 4 , a user interface displayed on thetouch screen 140 includes a drawing region S1, a drawing region S2, and a drawing region S3. The drawing region S1 correspond to a maximum controllable range of thetouch screen 140, i.e., the range of the entire user interface; the drawing region S3 corresponds to a display range of thetouch screen 140 at a time point. That is to say, the drawing region S3 is a part of the drawing region S1, the size of the drawing region S2 is between those of the drawing region S1 and the drawing region S3, and the drawing region S2 is also a part of the drawing region S1. According to an embodiment of the present invention, theprocessor 110 draws a part of the drawing region S1 (i.e., the drawing region S2) in advance and stores the drawn image into thememory 120. As such, when displaying the drawing region S3, the drawing region S3 can be readily displayed by using the image of the drawing region S2 stored in thememory 120. Under all circumstances, the drawing region S1 is larger and completely covers the drawing regions S2 and S3. In general, the drawing region S2 is larger than and completely covers the drawing region S3, whereas the drawing region S3 may temporarily exceed the range covered by the drawing region S2 based on a sliding operation of a user command that a user sends via thetouch screen 140. - Since the drawing region S1 corresponds to the maximum controllable range of the
touch screen 140, any changes in the drawing regions S2 and S2 do not exceed beyond the range of the drawing region S1. Further, the drawing regions S2 and S3 are in equivalence located under a coordinate system constructed by the drawing region S1. In one embodiment of the present invention, when an x-axis (the horizontal axis) and a y-axis (the vertical axis) of the coordinate system are set as inFIG. 4 , the coordinates of the upper-left vertex of the drawing region S1 may be set as (0, 0) representing an origin, the coordinates of the upper-left vertex of the drawing region S2 may be set as (X2, Y2), and the coordinates of the upper-left vertex of the drawing region S3 may be set as (X3, Y3), where X2, Y2, X3 and Y3 are greater than 0, and X3>X2 and Y3>Y2. - The drawing region S3, which represents the display range that the
touch screen 140 displays at a particular time point, has a width W and a length L in fixed values. In other words, the drawing region S3 has a fixed size. Given that the drawing region S2 completely covers and is larger than the drawing region S3, and the drawing region S1 completely covers and is larger than the drawing region S2, a length LS and a width WS of the drawing region S2 may be dynamically configured, giving the drawing region S2 has a dynamically adjustable size. - The corresponding coordinates (i.e., position information) and sizes of the drawing regions S2 and S3 are temporarily stored in the
memory 120 under the control of theprocessor 110. Further, according to the coordinates and sizes of the drawing regions S2 and S3, theprocessor 110 determines whether the drawing region S3 is moved and exceeds the range of the drawing region S2 each time a user command moves the drawing region S3. - As previously described, the
processor 110 also draws the image R (not shown) of the drawing region S2 and stores the image R into thememory 120 in advance. The size of the image R completely covers and equals the drawing region S2, and is updated in thememory 120 by theprocessor 110 under certain conditions. -
FIG. 5 shows a schematic diagram of a frame updating method according to an embodiment of the present invention when the drawing region S3 inFIG. 4 is moved according to a sliding operation of a user command and does not exceed the range of the drawing region S2. As shown inFIG. 5 , when the user command that the user sends via thetouch screen 140 is to move the user interface (i.e., the fixed range covered by the drawing region S3) upward by a distance D1, the drawing region S3 is substantially moved downward relative to the drawing regions S1 and S2 by the distance D1. The new coordinates of the upper-left vertex of the drawing region S3 are updated to (X3, Y3+D1) by theprocessor 110, and the updated coordinates are stored into thememory 120 by theprocessor 110. - After being moved according to the user command, the drawing region S3 does not exceed the range of the drawing region S2. Therefore, upon detecting such condition, the
processor 110 performs display by directly fetching an image R1 corresponding to the moved drawing region S3 from the image R stored in thememory 120. An advantage of the above approach is that, before displaying the moved drawing region S3, theprocessor 110 need not spend additional time and computation to call again graphics components to draw the drawing region S3, thereby maintaining the smoothness in displaying the sliding movement in a corresponding frame. In addition, under the condition shown inFIG. 5 , the drawing region S2 need not be updated, and so the image R stored in thememory 120 need not be updated either; that is, no additional time and computation are required to redraw the drawing region S2. -
FIG. 6 shows a schematic diagram of a frame updating method according to an embodiment of the present invention when the drawing region S3 inFIG. 4 is moved according to a sliding operation of a user command and exceeds the range of the drawing region S2. As shown inFIG. 6 , when the user command that the user sends via thetouch screen 140 moves the user interface upward by a distance D2, the drawing region S3 is substantially moved downward relative to the drawing regions S1 and S2 by the distance D2. Upon detecting that the drawing region S3 is moved and exceeds the range of the drawing region S2, theprocessor 110 first updates the new coordinates of the upper-left vertex of the drawing region S3 to (X3, Y3+D2). Since a part of the moved drawing region S3 exceeds the range covered by the drawing region S2, the drawing region S3 includes a drawing region S32 that is non-overlapping with the drawing region S2 and a drawing region S31 that overlaps with the drawing region S2. Theprocessor 110 then needs to first determine an updated drawing region S2 that covers the moved drawing region S3. That is to say, theprocessor 110 needs to have the updated drawing region S2 that simultaneously covers the drawing regions S32 and S31. Accordingly, theprocessor 110 updates the image R stored in thememory 120, and finally fetches the image corresponding to the moved drawing region S3 from thememory 120 and displays the fetched image on thetouch screen 140. -
FIG. 7 shows a schematic diagram of updating the image R stored in thememory 120 according to an embodiment of the present invention. InFIG. 7 , theprocessor 110 first deletes a sub-image R_Delete of the image R stored in thememory 120 according to the drawing regions S31 and S32, and keeps another sub-image R2 of the image R. It should be noted that, the image R is stored at a section of continuous addresses in thememory 120, and so the sub-image R_Delete and the sub-image R2 included in the image R are also stored in continuous addresses in thememory 120. A starting address of the sub-image R2 adjacently follows an ending address of the sub-image R_Delete. Next, theprocessor 110 utilizes a memory copy instruction to copy contents of the sub-image R2 to a section of continuous memory addresses starting from the starting address of the sub-image R_Delete in thememory 120. Theprocessor 110 then calls the graphics components to draw a sub-image R3, and stores contents of the sub-image R3 to a section of continuous memory addresses starting from the ending address of the sub-image R2 and ending at the ending address of the image R. In the embodiment, the size of the sub-image R3 equals the size of the sub-image R_Delete. That is to say, the original image R is consisted of the sub-image R_Delete and the sub-image R2, and the updated image R is consisted of the sub-image R2 with a relocated storage position and the newly drawn sub-image R3. The sub-image R2 includes an image corresponding to the drawing region S31, and the sub-image R3 includes an image corresponding to the drawing region S32. Thus, the updated image R includes an image corresponding to the moved drawing region S3. As such, thememory 110 fetches the image corresponding to the moved drawing region S3 from thememory 120 and displays the fetched image on thetouch screen 140. - In one embodiment of the present invention, when the
processor 110 fetches and displays the moved drawing region S3, the position and size of the drawing region S2 may be dynamically adjusted. Theprocessor 110 then adjusts the coordinates (position information, e.g., the coordinates of the upper-left vertex) of the drawing region S2 according to the adjusted drawing region S2, draws a corresponding image and stores the image into thememory 120. - An advantage of the approach in
FIG. 7 is that, as the sub-image R2 in the image R need not be redrawn by theprocessor 110 through thegraphics engine 130, a part of computation and processing time are saved, and computation and processing time are only required for drawing the sub-image R3, thereby overcoming the issue of the large amounts of computation and processing time brought about by redrawing the drawing region T2 having an increased size in the prior art. The improvement offered by the present invention gets more apparent as the ratio of the drawing region S31 in the drawing region S3 gets larger, i.e., as the ratio of the moved drawing region S3 exceeding the drawing region S2 gets smaller. - Further, the step of updating the image R in
FIG. 7 are performed within the same section of continuous memory addresses in thememory 120, and memory resources consumed and allocated for updating the image are also fixed, meaning that no additional load is posed on thememory 120 during updating. - When the drawing region S3 is moved by the user command, it is possible that the movement range is too large in a way that the drawing region S3 completely exceeds the drawing region S2. That is, only the drawing region S32 but not the drawing region S31 exists between the drawing regions S3 and S2. In the above situation, taking
FIG. 7 for example, the image R includes only the sub-image R_Delete but not the sub-image R2. In response, theprocessor 110 may draw the sub-image R3 directly based on the change in the drawing region S2 to provide an updated image R that includes only the sub-image R3. That is to say, the starting address and the ending address of the sub-image R3 are respectively the same as the starting address and the ending address of the image R. - In another embodiment of the present invention, in addition to processing a situation where the user interface is slid upward by the user command, a situation where the user interface is slid downward by the user command may also be processed by the frame updating method shown in
FIGS. 4 to 7 . Alternatively, instead of processing vertical movements of the user interface as in the foregoing situations, horizontal movements of the user interface may also be applied. Details of such process can be easily deduced by one person skilled in the art with reference to the frame updating method and the associated description, and shall be omitted herein. Further, in another embodiment of the present invention, in addition to processing vertical movements and horizontal movements of the user interface, situations where the user interface is moved slantingly may also be processed. -
FIG. 8 shows a flowchart of a frame updating method according to an embodiment of the present invention and the frame updating method inFIGS. 4 to 7 . As shown inFIG. 8 , the frame updating method of the present invention includes the following steps. - In
step 202, a drawing region S2 is determined from the user interface, and an image of the drawing region S2 is drawn and stored into thememory 120. - In
step 204, an image of the drawing region S3 is obtained from the image of the drawing region S2 in thememory 120 to display a frame of the mobileelectronic device 100. - In
step 206, a movement command is received. The movement command requests to perform a movement on the drawing region S3 in the user interface. - In
step 208, it is determined whether the moved drawing region S3 exceeds the drawing region S2 according to the movement command. - In
step 210, when the moved drawing region S3 exceeds the drawing region S2, the image of the drawing region S2 in thememory 120 is updated. - The steps in
FIG. 8 are a summary of the frame updating method inFIGS. 4 to 7 . Other embodiments derived from appropriate modifications and reasonable combinations of the above steps or applied with limitations mentioned above are to be regarded as embodiments of the present invention. - The frame updating method shown in
FIGS. 4 to 8 is for solving issues of the prior art inFIG. 1 . A frame drawing method to be described with reference toFIGS. 9 and 10 is for solving issues of the prior art inFIG. 2 . The frame drawing method inFIGS. 9 and 10 may be implemented by the mobileelectronic device 100 inFIG. 3 . -
FIG. 9 shows a schematic diagram of a frame drawing method according to an embodiment of the present invention. A main difference of the embodiment inFIG. 9 from the conventional solution inFIG. 2 is that, in addition to determining by theprocessor 110 whether updating between the drawing regions A2 and A3 is required in response to a user command received by the touch screen according to hierarchy, a decorator component C1 is disposed between the drawing regions A2 and A3, so that theprocessor 110 may control whether the drawing region A3 needs to be redrawn via the decorator component C1. Although an icon region of the decorator component C1 shown inFIG. 9 covers and is slightly larger than the drawing region A3, a controllable range of the decorator component C1 is substantially the range covered by the drawing region A3. The depiction of the decorator component C1 being slightly larger than the drawing region A3 inFIG. 9 is merely for better representing the controllable range of the decorator component C1. It should be noted that, the decorator component C1 may be theprocessor 110. - Via the control of the decorator component C1, the
processor 110 may draw an image of the drawing region A3 in advance, and store the image into thememory 120. - The mobile
electronic device 100 receives various types of updating commands when operating, e.g., notifications of new emails or new messages received. When the mobileelectronic device 100 receives an external updating command, updating of an image of a display frame may be required. Assuming that the drawing region A3 represents an icon of an email or a message, when the mobileelectronic device 100 receives an external new email or new message, the drawing region A3 may need to display a prompting message such as displaying a new value for reminding the user of the above event of receiving a new email or new message. According an embodiment of the present invention, theprocessor 110 requests the graphics engine and graphics component module of the drawing region A3 via the decorator component C1 to draw an updated image of the drawing region A3, and to store the updated image into thememory 120. When the mobileelectronic device 100 is to update or display a frame, according to the hierarchy inFIG. 9 , theprocessor 110 first requests the graphics engine and graphics component module of the drawing region A2 to draw the drawing region A2. At this point, the graphics engine and graphics component module of the drawing region A2 request the decorator component C1 to provide the image of the drawing region A3. If the drawing region A3 need not be updated, the decorator component C1 directly fetches the image of the drawing region A3 from thememory 120 for a direct use, thereby saving the time for redrawing the drawing region A3 when theprocessor 110 requests to draw the drawing region A2. If the drawing region A3 need be updated, the decorator component C1 requests the graphics engine and graphics component module of the drawing region A3 to draw the updated image of the drawing region A3, to store the updated image to thememory 120, and to provide the updated image for the use of the graphics engine and graphics component module of the drawing region A2. Further, the image of the drawing region A3 is arranged in a section of continuous memory addresses in thememory 120 for access. In other words, the non-updated image of drawing region A3 occupies a section of continuous memory addresses in thememory 120, and the updated image of drawing region A3 also occupies the same section of continuous memory addresses in thememory 120. In another embodiment of the present invention, to prevent from using memory addresses other than the designated section of continuous memory addresses, a memory duplication command may be utilized to assist the above process of updating contents of the drawing region A3 in thememory 120. - It should be noted that, upon receiving the updating command, a time point at which the
processor 110 updates the contents of the drawing region in thememory 120 and a time point at which theprocessor 110 redraws the display frame may be independent. In other words, after theprocessor 110 updates the contents of the drawing region A3 in thememory 120, theprocessor 110 may be triggered to redraw the display frame by periodically activating the user interface or by activating the user interface by the user. Thus, when theprocessor 110 is triggered to redraw the display frame, the updated drawing region A3 can be directly fetched from thememory 120 as it is already stored in thememory 120. Further, the time that theprocessor 110 needs to redraw the display frame is also shortened. - The frame drawing method of the present invention shown in
FIG. 9 is not limited to a single hierarchical layer represented by the drawing regions A2 and A3, and may be further applied to multiple hierarchical layer regions having more than two hierarchy layers.FIG. 10 shows a schematic diagram of a user interface drawing method according to an embodiment of the present invention. Main differences ofFIG. 10 fromFIG. 9 are additional drawing regions A4 and A5 in the drawing region A3, and an additional decorator component C2 between the drawing regions A3 and A5. Thus, theprocessor 110 may directly control the updating of the drawing region A5 via the decorator component C2. In other words, the updating of the drawing region A5, unaffected by the updating of the drawing region A3, is independent from the drawing mechanism of the drawing region A3. Similarly, when disposing thedecorator component 2, theprocessor 110 also stores an image of the drawing region A5 in thememory 120 in advance. - It should be noted that, whether to dispose a decorator component on a drawing region is determined by a user command entered by a user. Further, as the number or the updating frequency of drawing regions controlled by the decorator component gets larger/higher, the more apparent the time saved for the redrawing performed by the
processor 110. -
FIG. 11 shows a flowchart of a frame drawing method according to an embodiment of the present invention and the frame drawing method inFIGS. 9 and 10 . As shown inFIG. 11 and with the example shown inFIG. 9 orFIG. 10 , the frame drawing method of the present invention includes the following steps. - In
step 302, an image of the drawing region A3 is drawn into thememory 120. - In
step 304, an updated image of the drawing region A3 is drawn into thememory 120. - In
step 306, when drawing the drawing region A2, the updated image of the drawing region A3 in thememory 120 is utilized to display the drawing region A3. - Although the steps in
FIG. 11 are exemplified by the drawing operations between the drawing regions A2 and A3, the steps may also be applied to the drawing operations between the drawing regions A3 and A5 inFIG. 10 . Other embodiments derived from appropriate modifications and reasonable combinations of the above steps or applied with limitations mentioned above are to be regarded as embodiments of the present invention. - As above, a frame updating method, a frame drawing method and a mobile electronic device are disclosed by the present invention. By directly replacing a part of drawing regions that need not be updated in the user interface with a backup image stored in advance, computation and processing time for redrawing an updated drawing region may be saved, thereby offering satisfactory smoothness in operations on the user interface of the mobile electronic device.
- While the invention has been described by way of example and in terms of the preferred embodiments, it is to be understood that the invention is not limited thereto. On the contrary, it is intended to cover various modifications and similar arrangements and procedures, and the scope of the appended claims therefore should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements and procedures.
Claims (6)
1. A frame drawing method, applied for drawing a frame of an electronic device, the frame comprising an image region and an icon, the icon being associated with a status of an application program of the electronic device, the image region comprising the icon, the frame drawing method comprising:
drawing an image of the icon, and storing the image of the icon into a memory;
updating the image of the icon according to the status of the application program;
storing the updated image of the icon into the memory; and
drawing the icon by the updated image of the icon in the memory when drawing the image region.
2. The frame drawing method according to claim 1 , wherein the image of the icon and the updated image of the icon are stored at same memory addresses in the memory.
3. The frame drawing method according to claim 1 , wherein the step of updating the image of the icon according to the status of the application program comprises:
receiving an updating command associated with the status of the application program.
4. An electronic device, configured to draw a frame, the frame comprising an image region and an icon, the icon being associated with a status of an application program of the electronic device, the image region comprising the icon, the electronic device comprising:
a memory; and
a processing unit, configured to store an image of the icon into the memory, to update the image of the icon according to the status of the application program, storing the updated image of the icon into the memory, and to draw the icon by the updated image of the icon in the memory when drawing the image region.
5. The electronic device according to claim 4 , wherein the image of the icon and the updated image of the icon are stored at same memory addresses in the memory.
6. The electronic device according to claim 4 , further comprising:
a receiving unit, configured to receive an updating command associated with the status of the application program.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/974,962 US20160104462A1 (en) | 2013-11-26 | 2015-12-18 | Frame drawing method and associated mobile electronic device |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW102143048 | 2013-11-26 | ||
TW102143048A TWI512593B (en) | 2013-11-26 | 2013-11-26 | Frame drawing method, frame updating method, and mobile electronic device thereof |
US14/313,232 US9251558B2 (en) | 2013-11-26 | 2014-06-24 | Frame drawing method, frame updating method and associated mobile electronic device |
US14/974,962 US20160104462A1 (en) | 2013-11-26 | 2015-12-18 | Frame drawing method and associated mobile electronic device |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/313,232 Division US9251558B2 (en) | 2013-11-26 | 2014-06-24 | Frame drawing method, frame updating method and associated mobile electronic device |
Publications (1)
Publication Number | Publication Date |
---|---|
US20160104462A1 true US20160104462A1 (en) | 2016-04-14 |
Family
ID=53182279
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/313,232 Active - Reinstated 2034-10-02 US9251558B2 (en) | 2013-11-26 | 2014-06-24 | Frame drawing method, frame updating method and associated mobile electronic device |
US14/974,962 Abandoned US20160104462A1 (en) | 2013-11-26 | 2015-12-18 | Frame drawing method and associated mobile electronic device |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/313,232 Active - Reinstated 2034-10-02 US9251558B2 (en) | 2013-11-26 | 2014-06-24 | Frame drawing method, frame updating method and associated mobile electronic device |
Country Status (2)
Country | Link |
---|---|
US (2) | US9251558B2 (en) |
TW (1) | TWI512593B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106017483A (en) * | 2016-05-06 | 2016-10-12 | 厦门蓝斯通信股份有限公司 | Map vehicle icon drawing method and system and navigation terminal |
CN110851118A (en) * | 2019-10-21 | 2020-02-28 | 中国地质大学(武汉) | Vector icon drawing method and device for three-dimensional scene |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6784953B2 (en) * | 2016-08-26 | 2020-11-18 | 富士ゼロックス株式会社 | Information processing equipment and programs |
FR3098629B1 (en) * | 2019-07-12 | 2021-08-13 | Aledia | Image display system and ordering process |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5630081A (en) * | 1995-09-07 | 1997-05-13 | Puma Technology, Inc. | Connection resource manager displaying link-status information using a traffic light iconic representation |
US5796401A (en) * | 1996-08-09 | 1998-08-18 | Winer; Peter W. | System for designing dynamic layouts adaptable to various display screen sizes and resolutions |
US20070171298A1 (en) * | 2006-01-23 | 2007-07-26 | Seiko Epson Corporation | Image capturing element, image capturing apparatus, image capturing method, image capturing system, and image processing apparatus |
US20080291119A1 (en) * | 2007-05-24 | 2008-11-27 | Contec Co., Ltd. | PC image distributing facility |
US20090295788A1 (en) * | 2008-06-03 | 2009-12-03 | Microsoft Corporation | Visually emphasizing peripheral portions of a user interface |
US20120081278A1 (en) * | 2010-10-01 | 2012-04-05 | Flextronics Id, Llc | User interface with screen spanning icon morphing |
US20120188243A1 (en) * | 2011-01-26 | 2012-07-26 | Sony Computer Entertainment Inc. | Portable Terminal Having User Interface Function, Display Method, And Computer Program |
US20130135234A1 (en) * | 2011-11-28 | 2013-05-30 | Kyocera Corporation | Device, method, and storage medium storing program |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2320927B (en) * | 1997-01-06 | 2001-04-18 | Reckitt & Colman Inc | Germicidal hard surface cleaner |
US20020101406A1 (en) * | 2001-01-26 | 2002-08-01 | Chin-Shu Tseng | Touch-controlled hot key device |
KR100965883B1 (en) * | 2003-10-17 | 2010-06-24 | 삼성전자주식회사 | Storage medium containing audio-visual data including mode information, display playback device and display playback method thereof |
TW200744019A (en) * | 2006-05-23 | 2007-12-01 | Smedia Technology Corp | Adaptive tile depth filter |
KR101526995B1 (en) * | 2008-10-15 | 2015-06-11 | 엘지전자 주식회사 | Mobile terminal and method for controlling display thereof |
TWI381306B (en) * | 2009-04-23 | 2013-01-01 | Htc Corp | Portable electronic device and image data communication method thereof |
TW201112043A (en) * | 2009-09-21 | 2011-04-01 | Hon Hai Prec Ind Co Ltd | Mobile device and method for controlling browse of images |
TW201135696A (en) * | 2010-04-06 | 2011-10-16 | Hon Hai Prec Ind Co Ltd | Electronic device and controlling method thereof |
-
2013
- 2013-11-26 TW TW102143048A patent/TWI512593B/en active
-
2014
- 2014-06-24 US US14/313,232 patent/US9251558B2/en active Active - Reinstated
-
2015
- 2015-12-18 US US14/974,962 patent/US20160104462A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5630081A (en) * | 1995-09-07 | 1997-05-13 | Puma Technology, Inc. | Connection resource manager displaying link-status information using a traffic light iconic representation |
US5796401A (en) * | 1996-08-09 | 1998-08-18 | Winer; Peter W. | System for designing dynamic layouts adaptable to various display screen sizes and resolutions |
US20070171298A1 (en) * | 2006-01-23 | 2007-07-26 | Seiko Epson Corporation | Image capturing element, image capturing apparatus, image capturing method, image capturing system, and image processing apparatus |
US20080291119A1 (en) * | 2007-05-24 | 2008-11-27 | Contec Co., Ltd. | PC image distributing facility |
US20090295788A1 (en) * | 2008-06-03 | 2009-12-03 | Microsoft Corporation | Visually emphasizing peripheral portions of a user interface |
US20120081278A1 (en) * | 2010-10-01 | 2012-04-05 | Flextronics Id, Llc | User interface with screen spanning icon morphing |
US20120188243A1 (en) * | 2011-01-26 | 2012-07-26 | Sony Computer Entertainment Inc. | Portable Terminal Having User Interface Function, Display Method, And Computer Program |
US20130135234A1 (en) * | 2011-11-28 | 2013-05-30 | Kyocera Corporation | Device, method, and storage medium storing program |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106017483A (en) * | 2016-05-06 | 2016-10-12 | 厦门蓝斯通信股份有限公司 | Map vehicle icon drawing method and system and navigation terminal |
CN110851118A (en) * | 2019-10-21 | 2020-02-28 | 中国地质大学(武汉) | Vector icon drawing method and device for three-dimensional scene |
Also Published As
Publication number | Publication date |
---|---|
TWI512593B (en) | 2015-12-11 |
US20150145877A1 (en) | 2015-05-28 |
US9251558B2 (en) | 2016-02-02 |
TW201520872A (en) | 2015-06-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107168712B (en) | Interface drawing method, mobile terminal and computer readable storage medium | |
US8797232B2 (en) | Information processing apparatus, display control method, and program | |
US20160104462A1 (en) | Frame drawing method and associated mobile electronic device | |
US20170139824A1 (en) | Memory management and image display for mobile devices | |
CN112099686B (en) | Icon display control method and device and electronic equipment | |
RU2741516C1 (en) | Display processing method and electronic device | |
WO2022194003A1 (en) | Screen capture method and apparatus, electronic device, and readable storage medium | |
EP3133481A1 (en) | Terminal device display method and terminal device | |
KR20150081765A (en) | Outputting Method For Screen data And Electronic Device supporting the same | |
US10235975B2 (en) | Method and system for providing a real time content updates to a user | |
US10474413B2 (en) | Display structure, display method, display device and operating system for providing multiple user display interfaces | |
US11024257B2 (en) | Android platform based display device and image display method thereof | |
CN113282262A (en) | Control method and device for screen projection display picture, mobile terminal and storage medium | |
WO2016181436A1 (en) | Image output control method, image output control program, and display device | |
US20200066235A1 (en) | Location-Based Display of Pixel History | |
TW201237730A (en) | Method of adjusting windows and electronic device using same | |
JP2009252083A (en) | Information processing apparatus, window display method and display control program | |
US20100182331A1 (en) | Method and apparatus for drawing image | |
CN113407290B (en) | Application notification display method and device and electronic equipment | |
CN114115639A (en) | Interface control method and device, electronic equipment and storage medium | |
KR20130048526A (en) | Mobile terminal and method for controlling the same | |
US20140362399A1 (en) | Image forming apparatus and non-transitory computer readable medium | |
US9582158B2 (en) | Efficient usage of screen real estate on an electronic device | |
US20130152108A1 (en) | Method and apparatus for video processing | |
JP2005031510A (en) | Information processor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MSTAR SEMICONDUCTOR, INC., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LAI, CHENG-HUNG;REEL/FRAME:037332/0847 Effective date: 20140623 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |