JP4230528B1 - Display processing device, mobile phone provided with display processing device, display processing method, control program, and recording medium - Google Patents

Abstract

To smoothly take over a drawing process among a plurality of drawing apparatuses, and to shorten a display switching time.
A display processing apparatus 1 of the present invention displays a 3D drawing unit 7 for drawing the object and a second display mode so as to display the object in a first display mode. In addition, a 2D drawing unit 8 for drawing the object and a takeover information storage unit 30 for storing the processing contents applied to the object by the 3D drawing unit 7 or 2D drawing unit 8 in association with each object as takeover information. Each drawing unit, when the drawing result output to the display unit is switched from the one by another drawing unit to the one by itself, the processing contents indicated by the takeover information associated with the object Is applied to draw the object.
[Selection] Figure 1

Description

  The present invention relates to a display processing device including a plurality of drawing devices, a mobile phone including the display processing device, a display processing method, a control program, and a recording medium.

  Conventionally, a user interface (UI) component (object) such as a figure, a button, an icon, or a text box is generally displayed on a display unit. A display processing device that displays such an object includes a drawing device. The drawing apparatus analyzes a script describing the attributes (size, shape, color, texture, etc.) of the object, draws the object, and outputs it to the frame buffer as screen data for display on the display unit.

  The display processing device can also include a plurality of drawing devices. In a display processing device that outputs drawing results from a plurality of drawing devices to the display unit, the content (object) displayed on the display unit by the drawing processing of one drawing device can be displayed by the drawing processing of another drawing device. Is possible.

For example, if a plurality of drawing apparatuses each equipped with different types of analysis engines are provided, the same object can be displayed on the display unit with different visual effects. More specifically, a button that is a UI component is displayed as a two-dimensional rectangular figure by drawing with a 2D drawing apparatus, and is displayed as a figure that virtually appears as a three-dimensional cuboid by drawing with a 3D drawing apparatus. It is possible.
JP 2007-317130 A (released on December 6, 2007) JP 2003-346183 A (released on December 5, 2003)

  In a display processing device including a plurality of drawing devices, there are cases where a plurality of drawing results from each drawing device must be selectively output to a display unit due to hardware resource restrictions. That is, it is necessary to switch the drawing apparatus that draws the object.

  When the switching of the drawing device occurs, the display processing device takes the history information of the operations and processes performed on the object so that the drawing device after the switching takes over the display contents and the state of the object by the previous drawing device. Must be accumulated.

  For example, as described in Patent Document 1 (FIG. 3), history information is accumulated every time an operation or process is performed.

  However, in the technique of Patent Literature 1, since the display processing device is not considered to include a plurality of drawing devices, the history information cannot be shared by a plurality of drawing devices, and accordingly, the display content can be switched. It cannot be done smoothly.

  As in the system described in Patent Document 2, the server that provides the content provides each terminal with either 3D content or 3D content rendered as 2D content according to the capability of the terminal (display processing device). To be delivered. However, in the system described in Patent Document 2, even if the terminal is capable of displaying both 2D content and 3D content, since the rendering is switched on the server side that provides the content, the server and the terminal Communication processing is required between the terminal and the terminal, and it is difficult to smoothly switch the display on the terminal.

  Note that the above-described problem is not limited to switching between the 2D drawing apparatus and the 3D drawing apparatus, and similarly in a display processing apparatus that includes a plurality of drawing apparatuses and selectively outputs the drawing results of each drawing apparatus to the display unit. It is a problem that arises.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a display processing device and a display processing device that can smoothly take over drawing processing among a plurality of drawing devices and reduce display switching time. To provide a mobile phone, a display processing method, a control program, and a recording medium.

  In order to solve the above problems, a display processing apparatus according to the present invention displays an object to be displayed in a first display mode in a display processing apparatus that selectively outputs drawing results by a plurality of drawing means to a display unit. The first drawing means for drawing the object, the second drawing means for drawing the object so as to display the object in the second display mode, and the first drawing means or A takeover information storage unit that stores processing contents applied to the object by the second drawing unit in association with each object as takeover information, and each drawing unit outputs a drawing result output to the display unit However, when switching from other drawing means to own means, the object is associated with the object in the takeover information storage unit. By applying the processing contents shown are takeover information that is, is characterized by drawing the object.

  According to the above configuration, the display processing device includes a plurality of drawing means, that is, at least the first drawing means for displaying the object in the first display mode, and the object in the first display mode. And a second drawing means for displaying the image, and a drawing result drawn by one of the first drawing means and the second drawing means is displayed on the display unit. .

  Then, the processing content applied to the object during the drawing process by any of the drawing means is stored in the takeover information storage unit as takeover information for each object.

  Here, when the drawing means for outputting the drawing result to the display unit is switched, specifically, the first drawing means is switched to the second drawing means or vice versa. When switching, the drawing means after switching refers to the takeover information associated with the object to be drawn, and similarly reflects the processing content applied to the object. Then the object is drawn.

  As a result, even if switching between different drawing means occurs, it is possible to smoothly switch over only the display mode immediately without changing the display contents before and after switching. That is, it is possible to smoothly take over the drawing process among a plurality of drawing apparatuses, and to shorten the display switching time.

  Furthermore, the display processing device may include a switching control unit that switches a drawing unit that outputs a drawing result to the display unit in response to occurrence of a predetermined event in the own device.

  According to the above configuration, when an event occurs in the display processing apparatus, if the event is an event that requires switching of the drawing unit, the switching control unit controls each drawing unit to control the drawing unit. Switch over. For example, the drawing process of the drawing means that has been drawing until the event occurs is terminated, and the drawing process by another drawing means is started.

  This makes it possible to select and switch an appropriate drawing unit according to the status of the display processing apparatus. This switching is also smoothly executed by the takeover information.

  Further, the first drawing means is a 3D drawing means for drawing the object in three dimensions based on the structured data defining the object in three dimensions, and the second drawing means is a two-dimensional drawing of the object. 2D rendering means for rendering an object in two dimensions based on the structured data to be defined, wherein the switching control means is configured to display the display unit when a situation occurs in which an accelerator included in the apparatus cannot be used for 3D rendering. The drawing means for outputting the drawing result may be switched from the 3D drawing means to the 2D drawing means.

  According to the above configuration, the switching control means of the display processing device can switch whether the object is displayed three-dimensionally or two-dimensionally according to an event that occurs in the own device.

  More specifically, the event means that the accelerator included in the display processing apparatus falls into a situation where it cannot be used for 3D drawing. The switching control means is configured such that when the event occurs, the 3D drawing means When the drawing process is in progress, the 3D drawing unit is switched to the 2D drawing unit.

  This makes it possible to select and switch an appropriate drawing unit according to the status of the display processing apparatus. This switching is also smoothly executed by the takeover information.

  The switching control means changes the drawing means for outputting a drawing result to the display unit from the 3D drawing means to the 2D drawing when the sound reproducing means provided in the own apparatus uses the accelerator when reproducing the sound. You may switch to a means.

  As a result, when the sound reproduction means uses the accelerator when reproducing sound and the accelerator cannot be used for 3D drawing, the object is drawn by switching to the 2D drawing means. Therefore, it is possible to avoid the 3D drawing by the 3D drawing means from being overlapped with the audio reproduction process.

  Further, the switching control means changes the drawing means for outputting a drawing result to the display unit from the 2D drawing means to the 3D drawing means when the accelerator is returned from a situation where it cannot be used for 3D drawing. It may be switched.

  This makes it possible to select and switch an appropriate drawing unit according to the status of the display processing apparatus. This switching is also smoothly executed by the takeover information.

  It is preferable that the takeover information storage unit stores, in association with the object, one processing content applied by the drawing means before switching immediately before the switching of each drawing means.

  According to the above configuration, the takeover information in the takeover information storage unit includes only one processing content that is applied last to one object.

  Thereby, the data amount of takeover information can be minimized.

  Therefore, since the amount of data that each drawing means should refer to at the time of switching can be minimized, it is possible to further reduce the time required for the switching process.

  In the technique of Patent Document 1 (FIG. 3), history information is accumulated every time an operation or process is performed.

  When such history information is used for drawing an object, the following problems occur. That is, the drawing apparatus after switching analyzes the accumulated history information and draws the object reflecting the analysis result. For this reason, in the display processing device, the larger the amount of history information, the longer it takes to take over between drawing devices, and the more time it takes to switch between drawing devices, that is, to switch display contents. This causes a problem that it is not performed smoothly.

  According to the above-described configuration of the present invention, the data amount of the takeover information can be suppressed to a necessary minimum, so that the time required for the switching process can be further shortened.

  Furthermore, the display processing device includes takeover information management means for managing takeover information stored in the takeover information storage unit, and the takeover information management means performs the first drawing according to the occurrence of an event in the own apparatus. When the means or the second drawing means applies the process to the object, it is preferable to update the handover information to the applied process content.

  According to the above configuration, when a change occurs in the displayed object in response to some event occurring in the display processing device, each drawing unit applies some processing to the object to redraw the object. . At this time, the takeover information management means updates the takeover information of the object by storing the contents of the process applied to the object by the drawing means in association with the object.

  As a result, even when a change occurs in an object, it is possible to keep the inheritance information of the object always up-to-date. Can take over.

  The first drawing means is 3D drawing means for drawing an object in three dimensions based on structured data that specifies the object in three dimensions, and the second drawing means specifies the object in two dimensions. 2D drawing means for drawing an object in two dimensions based on structured data may be used.

  Thereby, the display processing apparatus can display the object in three dimensions or two dimensions. Then, when the object is switched from the three-dimensional display to the two-dimensional display, or vice versa, the processing contents of the object can be taken over smoothly. Only the switching between 3D display and 2D display can be immediately executed without changing the display contents.

  In order to solve the above-described problems, a mobile phone according to the present invention includes the above-described display processing device.

  Thus, when the display processing apparatus of the present invention is applied to a mobile phone having a relatively small size and limited hardware resources, the effect of the present invention is particularly great.

  In recent years, mobile phones have been provided with a three-dimensional display function to provide a user interface with a high visual effect.

  However, the conventional mobile phone uses an accelerator for efficient drawing of a three-dimensional object, and there is a problem that three-dimensional display cannot be performed when the accelerator cannot be used due to some limitation.

  As a countermeasure against this problem, the three-dimensional display is switched to the two-dimensional display in the mobile phone of the present invention. However, even if the display mode is switched, the display content is not changed, and therefore it is necessary to appropriately take over the display content.

  With a conventional mobile phone, it is only possible to refer to the history of user operations and the history of system status accumulated in time series, analyze it, and take over the display contents. Since these pieces of history information have a large amount of data, there has been a problem that the display mode cannot be switched smoothly. This is a particularly serious problem for mobile phones that are relatively small and have limited hardware resources.

  Therefore, by applying the display processing device of the present invention to a mobile phone, a mobile phone capable of smoothly switching the display mode by shortening the switching time of the drawing means using the transfer information. It can be realized.

  In order to solve the above problems, a display processing method of the present invention is a display processing method in a display processing apparatus that selectively outputs a drawing result by a plurality of drawing means to a display unit, and displays a display target object as a first object. Either the first drawing step for drawing the object so as to display in the display mode or the second drawing step for drawing the object so as to display the object in the second display mode. The transfer information storage unit of the display processing device includes a drawing execution step to be executed, and the transfer information in which the processing content applied to the object during execution of the drawing execution step is associated with each object is stored. The drawing step executed in the drawing execution step is any of the first drawing step and the second drawing step. In the first drawing step or the second drawing step that has been switched to, the processing content indicated by the takeover information associated with the object in the takeover information storage unit is applied to the object. Thus, the object is drawn.

  As a result, even if switching between different drawing steps occurs, the display content can be taken over smoothly without changing the display contents before and after the switching, and only the display mode can be switched immediately. That is, the drawing process can be smoothly taken over and the display switching time can be shortened.

  The display processing device may be realized by a computer. In this case, the display processing device control program for realizing the display processing device by the computer by causing the computer to operate as each of the means, and A computer-readable recording medium on which it is recorded also falls within the scope of the present invention.

  In order to solve the above problems, a display processing apparatus according to the present invention displays an object to be displayed in a first display mode in a display processing apparatus that selectively outputs drawing results by a plurality of drawing means to a display unit. The first drawing means for drawing the object, the second drawing means for drawing the object so as to display the object in the second display mode, and the first drawing means or A takeover information storage unit that stores processing contents applied to the object by the second drawing unit in association with each object as takeover information, and each drawing unit outputs a drawing result output to the display unit However, when switching from other drawing means to own means, the object is associated with the object in the takeover information storage unit. By applying the processing contents shown are takeover information that is, is characterized by drawing the object.

  In order to solve the above-described problems, a mobile phone according to the present invention includes the above-described display processing device.

  In order to solve the above problems, a display processing method of the present invention is a display processing method in a display processing apparatus that selectively outputs a drawing result by a plurality of drawing means to a display unit, and displays a display target object as a first object. Either the first drawing step for drawing the object so as to display in the display mode or the second drawing step for drawing the object so as to display the object in the second display mode. The transfer information storage unit of the display processing device includes a drawing execution step to be executed, and the transfer information in which the processing content applied to the object during execution of the drawing execution step is associated with each object is stored. The drawing step executed in the drawing execution step is any of the first drawing step and the second drawing step. In the first drawing step or the second drawing step that has been switched to, the processing content indicated by the takeover information associated with the object in the takeover information storage unit is applied to the object. Thus, the object is drawn.

  Thereby, the drawing process between a plurality of drawing apparatuses can be smoothly taken over, and the display switching time can be shortened.

  An embodiment of the present invention is described below with reference to the drawings. In the present embodiment, as an example, a case where the display processing device of the present invention is applied to a mobile phone will be described. However, the present invention is not intended to be limited to this, and the display processing apparatus of the present invention can be applied to various information processing apparatuses, electronic devices, and the like having a display unit such as a television, a personal computer, and a PDA (personal digital assistant). is there.

[Configuration of mobile phone]
FIG. 1 is a block diagram showing a main configuration of a mobile phone 100 including a display processing device 1 according to an embodiment of the present invention. As shown in FIG. 1, the mobile phone 100 according to the present embodiment includes a storage unit 2, a main control unit 3, a wireless communication unit 4, a battery unit 5, an input unit 6, a 3D drawing unit 7, a 2D drawing unit 8, and a 3D frame buffer. 9, 2D frame buffer 10 and display unit 12 are provided. Further, an audio output unit 18 and a broadcast wave receiving unit 19 may be provided.

  The wireless communication unit 4 performs wireless communication with an external communication terminal device or a mobile phone. The wireless communication unit 4 includes a wireless communication antenna, and realizes wireless communication with a base station in a mobile phone network. That is, communication functions such as telephone, electronic mail, and the Internet are realized.

  The battery unit 5 supplies appropriate power to various components in the mobile phone 100, and includes, for example, a rechargeable secondary battery such as a lithium ion battery or a power supply circuit.

  The input unit 6 implements an input interface for inputting an instruction for the user to operate the mobile phone 100. Input key group including up / down / left / right keys for selecting an item (moving the cursor) on the GUI screen displayed on the display unit 12, a decision key for determining the selected item, a number key for inputting numbers and characters, and the like It consists of The input unit 6 sends an input to the input key to the main control unit 3 as an input signal. Receiving this, the main control unit 3 performs an operation according to the input signal. Thereby, the mobile phone 100 performs an operation according to the input operation of the user.

  The audio output unit 18 converts the audio signal from the audio processing unit 17 into a sound wave and outputs it to the outside. For example, the audio output unit 18 includes a speaker, an earphone, or an audio output connector.

  The broadcast wave receiving unit 19 receives a broadcast signal supplied through a broadcast wave receiving antenna (not shown) and transmits the broadcast signal to the mobile phone 100. For example, the broadcast wave receiving unit 19 includes a tuner, a demodulation unit, a decoder, and the like. .

  The 3D drawing unit 7 analyzes the 3D script 41 stored in the storage unit 2 and draws a 3D object based on data specifying a three-dimensional shape. The result of the drawing process performed by the 3D drawing unit 7 is once output as screen data to the 3D frame buffer 9 and then output to the display unit 12, whereby a 3D object is displayed on the display unit 12.

  The 2D drawing unit 8 analyzes the 2D script 42 stored in the storage unit 2 and draws a 2D object based on data for specifying a planar shape. The result of the drawing process performed by the 2D drawing unit 8 is temporarily output as screen data to the 2D frame buffer 10 and then output to the display unit 12, whereby a 2D object is displayed on the display unit 12.

  In the present embodiment, screen data drawn by either one of the 3D drawing unit 7 and the 2D drawing unit 8 is displayed on the display unit 12. Under the control of the switching control unit 15, the 3D drawing unit 7 and It is possible to switch which drawing result of the 2D drawing unit 8 is adopted.

  When the drawing unit is switched, the 3D drawing unit 7 and the 2D drawing unit 8 analyze a script (3D script 41 or 2D script 42) indicating the same content as the drawing unit before the switching. In addition to drawing the object, the drawing unit before switching takes over the processing applied to the object, and the contents are reflected on the object for drawing.

  In order to take over the processing performed by the drawing unit before switching, in this embodiment, the 3D drawing unit 7 and the 2D drawing unit 8 acquire takeover information stored in a takeover information storage unit 30 described later, and take over information. The contents of are reflected in the object.

  The display unit 12 displays a GUI screen, a still image, a moving image, text data, or the like drawn by the 3D drawing unit 7 or the 2D drawing unit 8 in accordance with an instruction from the main control unit 3. As the display unit 12, for example, an LC (liquid Crystal) display device, an EL (Electro Luminescence) display device, or the like can be suitably applied.

  Note that the mobile phone 100 is not limited to the above-described configuration, and although not illustrated, the mobile phone 100 may include various functions included in a known mobile phone such as a camera unit, a television receiver, and a GPS unit.

  The main control unit 3 performs overall control of each unit of the mobile phone 100, and further functions as an event processing unit 13, an effect processing unit 14, an audio processing unit 17, a switching control unit 15, and handover information as functional blocks. A management unit 16 is included. Each unit shown as the functional block is realized by a CPU (central processing unit) reading a program stored in a storage device such as a ROM (read only memory) into a RAM (random access memory) and executing the program. it can. In the present embodiment, the switching control unit 15, which is a functional block of the main control unit 3, the takeover information management unit 16, the 3D drawing unit 7, the 2D drawing unit 8, the 3D frame buffer 9, the 2D frame buffer 10, and the storage The unit 2 functions as the display processing device 1 of the present invention in the mobile phone 100.

  The storage unit 2 is a recording device that records various data used by the mobile phone 100. For example, a known nonvolatile recording device such as a flash ROM (Read Only Memory) can be used as appropriate. As shown in FIG. 1, the storage unit 2 includes a takeover information storage unit 30 and a script storage unit 31.

  The script storage unit 31 stores a script that each drawing unit analyzes in order to draw an object.

  A script is structured data including various information necessary for each drawing unit to draw an object, and is described in a language (for example, XML (extensible markup language)) that each drawing unit can analyze. Has been. One script may be prepared for each object, or one script may be prepared for each GUI (graphical user interface) screen composed of a plurality of objects. When the 2D object and the 3D object indicate the same object, the 3D script 41 and the 2D script 42 are assigned object IDs indicating the same object script. Thereby, each drawing unit can grasp the correspondence relationship of objects to be displayed, and can acquire a script of an appropriate object from the storage unit 2.

  In the example illustrated in FIG. 1, the script storage unit 31 includes a 3D script 41 for the 3D drawing unit 7 to draw a 3D object, and a 2D script 42 for the 2D drawing unit 8 to draw the 2D object. ing. In this way, a script is created for each type of analysis engine of each drawing unit.

  However, it is not limited to this. Information that can be analyzed by both the 3D drawing unit 7 and the 2D drawing unit 8 and has the same content is preferably stored as a common script 43 so that it can be referred to by any drawing unit. Thus, by sharing as much common information as possible about the same object, the amount of data stored in the mobile phone 100 can be reduced.

  Specific examples of each script will be described later with reference to the drawings.

  The takeover information storage unit 30 stores takeover information.

  This takeover information is stored for each object in association with the object ID. The object ID is identification information for uniquely identifying an object. In the script, the same ID is assigned to the same object so that each drawing unit can identify the object in common even if the drawing unit is switched.

  Thus, even if the 3D script 41 analyzed by the 3D drawing unit 7 and the 2D script 42 analyzed by the 2D drawing unit 8 are different data, a common object ID is assigned to the same object, and the display is performed. The entire processing apparatus 1 can be recognized as the same object. Therefore, even if the drawing unit is switched, it is possible to display the same content only by changing the appearance of 2D display / 3D display.

  The takeover information indicates a history of processing contents applied to the object by each drawing unit when the state of the mobile phone 100 changes according to an event generated by the mobile phone 100.

  For example, the following events can be considered as events generated by the mobile phone 100 that trigger the update of the handover information.

  First, there is a key input event that occurs when a user presses a key using the input unit 6. For example, when an up / down / left / right key, a determination key, a numeric key, or the like is pressed, a signal corresponding to each key is input to the main control unit 3 of the mobile phone 100, and the event processing unit 13 detects this.

  Next, when the state of the mobile phone 100 satisfies a predetermined condition, there is a notification event that is notified to the display processing device 1. When these notification events occur, the event processing unit 13 detects this and instructs each drawing unit of the display processing device 1 to display a message for notifying the user of the occurrence of the notification event. Specific examples of the notification event include an insufficient charge remaining notification indicating that the remaining charge of the battery unit 5 has become a certain amount or less, and a mail (call) indicating that the wireless communication unit 4 has received an e-mail (call) ) A reception notification, a memory shortage notification, or a notification of prohibiting multiple activation of a specific application is assumed.

  Here, the content of the event that is a trigger for updating the takeover information is not limited to the above. Any event that requires an object to be redrawn is assumed. When such an event occurs, each drawing unit redraws the object and the takeover information is updated accordingly.

  For example, in a GUI screen composed of a plurality of objects, when the focus target (object on which the cursor is placed) is changed in response to pressing of the up / down / left / right key, information (object ID) for specifying the latest focus target object is displayed. , Updated as takeover information. Alternatively, when a numeric key is pressed in order to input a character string in a text box (= object), the latest character string information input in the current text box is updated as takeover information. Alternatively, when a URL of a certain website is registered as a bookmark by a user operation, information on a reference destination URL applied to the bookmark is updated as takeover information. A specific example of the takeover information will be described in detail later with reference to the drawings.

  Next, each part of the functional block of the main control unit 3 will be described.

  The event processing unit 13 detects each event occurring in the mobile phone 100 and executes a process corresponding to the detected event. Or you may transmit an instruction | indication signal to the other member which performs the said process.

  Specific examples of events that occur in the mobile phone 100 include the following. That is, all events such as operation of the input unit 6 (key input) by the user, change in the remaining charge of the battery unit 5, arrival of a predetermined time, reception of e-mail, incoming call, activation of the camera unit, memory shortage notification, and the like are assumed. The

  The effect processing unit 14 applies a visual effect (hereinafter referred to as an effect) such as an animation defined by the script to the object in accordance with the description of the script. For example, the description of the effect is realized by describing an API (Application Program Interface) of the OpenGL function using a Java (registered trademark) script. The effect processing unit 14 can analyze a description related to such an effect and add a complicated animation such as a movement or a change in appearance to the object drawn by the drawing unit. As a result, not only a 2D / 3D object can be displayed, but also the displayed object can be moved and its shape, color, texture, etc. can be changed.

  The voice processing unit 17 converts a voice signal from a voice input unit such as a microphone (not shown) into predetermined voice data and transmits the voice data to the wireless communication unit 4 during a call, and also sends the voice data from the wireless communication unit 4 to the voice signal. To be transmitted to the audio output unit 18. In addition, when an incoming call is received, an audio file such as a ringtone stored in the storage unit 2 is reproduced and output to the audio output unit 18. Specifically, the audio processing unit 17 controls an A / D converter, a D / A converter, an amplifier, an audio codec circuit, and the like.

  The switching control unit 15 switches a frame buffer that outputs screen data to the display unit 12 according to the state of the mobile phone 100. Furthermore, it is possible to control the activation or termination of the drawing unit according to the switching of the frame buffer.

  For example, in the present embodiment, the mobile phone 100 includes two frame buffers, a 3D frame buffer 9 and a 2D frame buffer 10, and screen data held by any of them is output to the display unit 12. . The switching control unit 15 selects an appropriate drawing unit and frame buffer according to the state of the mobile phone 100. As a result, the object can be displayed in 2D or 3D, and the display method can be switched according to the state of the mobile phone 100.

  The operation of the switching control unit 15 will be described more specifically. The state of the mobile phone 100 is, for example, because the main control unit 3 performs other high-priority screen display processing (incoming notification, broadcast wave) It is conceivable that the 3D object rendering process of the 3D rendering unit 7 that is highly loaded cannot be performed properly.

  Therefore, when the mobile phone 100 falls into such a state, the switching control unit 15 activates the 2D drawing unit 8 to switch to 2D display, and the screen data of the 2D frame buffer 10 written by the 2D drawing unit 8 is displayed. Is output to the display unit 12.

  On the contrary, when the screen display process with high priority is completed and the main control unit 3 returns to the state in which the 3D object drawing of the 3D drawing unit 7 can be controlled, the switching control unit 15 should switch to the 3D display again. The 3D drawing unit 7 is activated and the screen data of the 3D frame buffer 9 is output to the display unit 12.

  Alternatively, the switching control unit 15 may be configured to switch between 2D display and 3D display according to an event that occurs in the mobile phone 100 according to a predetermined rule. The storage unit 2 includes a switching rule storage unit (not shown) in which an event and information indicating which 2D / 3D display is adopted are stored in association with each other. Referring to the switching rule storage unit, the 2D display and the 3D display may be switched by controlling the activation / termination of each drawing unit in accordance with an event that has occurred in the mobile phone 100.

  The takeover information management unit 16 always maintains the takeover information stored in the takeover information storage unit 30 to the latest information. The takeover information management unit 16 updates the takeover information in the takeover information storage unit 30 in response to the occurrence of an event of the mobile phone 100. When an event occurs in the mobile phone 100, each unit including the drawing unit in the mobile phone 100 executes some processing in response to the event. If this is a process involving some change to the object being displayed, the drawing unit needs to redraw the object. When any change processing is executed on an object by any drawing unit that is currently drawing, the takeover information management unit 16 updates the takeover information in order to leave a history of the processing contents.

  As a result, the 3D drawing unit 7 and the 2D drawing unit 8 can grasp the processing performed by the drawing unit before the switching on the object and appropriately take over the processing according to the takeover information.

  As described above, the plurality of drawing units (for example, the 3D drawing unit 7 and the 2D drawing unit 8) included in the mobile phone 100 draw the object according to each script that can be analyzed by each analysis engine, and further, takeover information Referring to, the processing performed on the object by the drawing unit before switching is reflected on the object. In this way, the same display content can be transferred smoothly and appropriately between different drawing units. Hereinafter, the data structure of the script and the takeover information will be described in detail by taking as an example a case where the 3D drawing unit 7 and the 2D drawing unit 8 draw a GUI screen when the user operates the mobile phone 100.

[Display script data structure and objects]
FIG. 2A is a diagram schematically showing the data structure of the 3D script 41.

  As shown in FIG. 2A, the 3D script 41 has a structure including a layout script 141, an event processing script 142, an effect processing script 143, 3D shape data 144, and image data 145.

  The layout script 141 defines in which position on the display unit 12 each object is drawn.

  The event processing script 142 instructs activation of various processes to be executed in association with object display. For example, it instructs activation of initialization processing, drawing processing, and effect processing executed by the effect processing unit 14 executed by each drawing unit.

  The effect processing script 143 defines specific contents of the effect added to the object.

  The 3D shape data 144 is polygon data describing each point of a three-dimensional object in XYZ coordinates.

  The image data 145 is image data that is mapped to the 3D shape of the 3D shape data 144 in order to draw each surface of the 3D shape object defined by the 3D shape data 144. The image format of the image data is not particularly limited. For example, PNG (Portable Network Graphics) or JPEG (Joint Photographic Experts Group) format can be adopted.

  FIG. 2B is a diagram specifically showing a part of the 3D script 41.

  As shown in FIG. 2B, in the present embodiment, the 3D script 41 on the GUI screen referred to by the 3D drawing unit 7 describes the object ID and information necessary for processing the object in association with each other. . In the example shown in FIG. 2B, since the GUI screen is composed of five objects, in the 3D script 41, object IDs 1 to 5 are assigned to each object, and the object layout and The operation when the object is selected is defined.

  In the present embodiment, the 3D script 41 describes an object using XML. The tags shown in the L1 and L7 lines indicate that the script sandwiched between these tags is a 3D script for 3D object drawing.

  L2 is a description of the button object to which object ID = 1 is assigned. When this object is selected and activated by a user operation, it is specified that a Web site with a URL specified in the description of L2 is displayed on a browser. In accordance with an instruction from the event processing unit 13 of the mobile phone 100, an application execution unit (not shown) that executes a browser function displays a Web site on the display unit 12.

  L3 is a description of the button object given the object ID = 2. When this object is activated, it is specified that an application execution unit (dialer) that executes a call function in the mobile phone 100 is activated.

  L4 is a description of the button object given the object ID = 3. When this object is activated, it is specified that an application execution unit (mailer) that executes a mail function in the mobile phone 100 is activated.

  L5 is a description of a text box object to which a character string is given a ticker display with an object ID = 4. Here, it is defined that a predetermined character string is tickered in a predetermined area. In the example shown in FIG. 2B, it is specified that “S company announces the construction of a complex” is tickered in the initial state.

  L6 is a description of an input dialog object to which a user inputs a character string, to which an object ID = 5 is assigned. Here, it is defined that a dialog box for a user to input a character string is displayed in a predetermined area. In the initial state, there is no character string data to be displayed, so nothing is displayed in the dialog box.

  FIG. 2C is a diagram illustrating a specific example of a GUI screen displayed on the display unit 12 as a result of the 3D rendering unit 7 rendering each object defined by the 3D script 41 illustrated in FIG. .

  An object 51 represents a button object drawn according to the description of L2 shown in FIG. An object 52 indicates a button object drawn according to the description of L3. An object 53 indicates a button object drawn according to the description of L4. An object 54 indicates a text box object drawn according to the description of L5. An object 55 represents an input dialog object drawn according to the description of L6.

  The cursor 56 is for indicating the object currently focused on. The example of FIG. 2C shows a state where the object 52 is focused. The user can move the cursor 56 to another object by operating the up / down / left / right keys provided in the input unit 6.

  FIG. 3A is a diagram schematically illustrating the data structure of the 2D script 42.

  As shown in FIG. 3A, the 2D script 42 has a structure including a layout script 151, an event processing script 152, an effect processing script 153, 2D shape data 154, and image data 155.

  The difference from the structure of the 3D script 41 shown in FIG. 2A is that it has 2D shape data 154 instead of the 3D shape data 144. The 2D shape data 154 is data describing each point of a graphic object in XY coordinates.

  If the 2D script 42 is described so that the layout script 151, the event processing script 152, the effect processing script 153, and the image data 155 can be analyzed by the 2D drawing unit 8, the layout script 141 of the 3D script 41 The event processing script 142, the effect processing script 143, and the image data 145 may be exactly the same. In the present embodiment, as described above, the common part between the 3D script 41 and the 2D script 42 is described as the common script 43, and the script so that both the 3D drawing unit 7 and the 2D drawing unit 8 can refer to it. Stored in the storage unit 31.

  FIG. 3B is a diagram specifically showing a part of the 2D script 42.

  The 2D script 42 shown in FIG. 3B is a script for 2D displaying the same content as the 3D display GUI screen shown in FIGS. In this embodiment, similarly to the 3D script 41 shown in FIG. 2B, object IDs 1 to 5 are assigned to each object, and information necessary for processing the object in association with the object ID, that is, the object The layout and the operation when the object is selected are defined.

  In the present embodiment, the 2D script 42 describes an object using XML, like the 3D script 41. The tags shown in the rows L1 and L7 in FIG. 3B indicate that the script sandwiched between these tags is a 2D script for drawing a 2D object.

  Here, for the five objects constituting the GUI screen, in the 2D script 42, the same object ID is assigned to the same object as the object of the 3D script 41.

  That is, since L2 is a description of the 2D object corresponding to the button object (object 51 in FIG. 2C), object ID = 1 is assigned. Since L3 is a description of the 2D object corresponding to the button object (object 52), object ID = 2 is given. Similarly, in L4, the same object ID = 3 is assigned to the 2D object corresponding to the object 53. In L5, the object ID = 4 is assigned to the 2D object corresponding to the object 54. In L6, the object 55 is assigned to the object 55. Object ID = 5 is assigned to the corresponding 2D object.

  This makes it possible to recognize objects having the same contents as the same object even when the objects are drawn by different scripts between different drawing units.

  FIG. 3C is a diagram showing a specific example of a GUI screen displayed on the display unit 12 as a result of the 2D drawing unit 8 drawing each object defined by the 2D script 42 shown in FIG. .

  The object 61 is an image object (icon image) drawn by the 2D drawing unit 8 in accordance with the description of L2 shown in FIG. 3B, and corresponds to the object 51 on the 3D display GUI screen. By activating this image object, the browser can be activated to display the Web site with the specified URL.

  The object 62 is an image object drawn according to the description of L3, and corresponds to the object 52. The dialer can be activated by activating this image object.

  The object 63 is an image object drawn according to the description of L4, and corresponds to the object 53. The mailer can be activated by activating this image object.

  The object 64 is a text box object drawn according to the description of L5, and corresponds to the object 54. Similar to the object 54, a predetermined character string ("Company S announces construction of complex") is tickered in the object 64.

  The object 65 is an input dialog object drawn according to the description of L6, and corresponds to the object 55. Even if the object 65 is activated, nothing is activated, but the user can input a character string in the object 65.

  As described above, even when objects handled by different drawing units of the mobile phone 100 are defined in separate scripts for each drawing unit, a common object ID is assigned to objects having the same content. It is. Further, the content (character string or the like) of data to be displayed in each object is described as a common script 43 and designated to each drawing unit so as to refer to it. As a specifying method, it is conceivable to describe a command statement referring to the common script 43 in each of the 3D script 41 and the 2D script 42.

  As a result, each drawing unit can identify the object in common and refer to the common script 43 to perform the same processing on the same object. Furthermore, information that can be shared by the common script 43 is integrated and stored as much as possible, so that the same information need not be stored repeatedly for each drawing unit. As a result, the amount of data referenced by each drawing unit during drawing processing is reduced.

  Note that the data structures of the 3D script 41 and the 2D script 42 shown in FIGS. 2A and 3A are examples, and do not limit the script of the present invention. For example, if it is not necessary to add an effect to the object described in the script, the effect processing script 143 (153) may not be included. The script only needs to include information necessary for each drawing unit to draw an object.

[Data structure of transfer information]
FIG. 4 is a diagram illustrating a specific example of the takeover information stored in the takeover information storage unit 30.

  As described above, the transfer information refers to the processing contents that the 3D drawing unit 7 and the 2D drawing unit 8 apply to the object as a result of the mobile phone 100 executing various processes in accordance with the event that has occurred in the mobile phone 100. This shows the history.

  As the transfer information, records for objects handled by each drawing unit of the mobile phone 100 are prepared, and one record corresponds to one object. In this embodiment, as shown in FIG. 2 and FIG. 3C, since five objects are handled, five records are prepared in advance.

  In one object record, four fields of “assigned application name”, “focus”, “startup setting”, and “character string” are prepared in association with the object ID (item name “id”).

  The value stored in the item name “id” corresponds to the value of the id attribute described in the 3D script 41 (or 2D script 42), and each drawing unit displays the takeover information of the object to be drawn. Records can be correctly extracted based on the object ID.

  The “assigned application name” indicates an application assigned to the object indicated by id. Thus, the event processing unit 13 can determine which application should be activated when the object is selected.

  “Focus” is a field for storing a flag indicating which object is currently selected (whether the cursor is hit). In the present embodiment, basically, any one of the five objects is focused (the cursor hits), and therefore, as shown in FIG. It becomes 1 record. As shown in FIG. 2C, since the cursor is focused on the dialer object (object ID = 2), a flag is set on the record with id = 2.

  “Startup setting” indicates whether or not an application can be started from a drawn object. For example, the application activation “×” is stored for the object ID = 5. This is because the character string to be displayed is not acquired in the initial state for the input dialog object with the object ID = 5, so the application execution unit of the function for displaying the headline information acquires the headline information. It means that it is impossible (cannot start application).

  The “character string” is a field for storing a character string to be inherited (to be drawn in common) in the same object even when display switching is performed between different drawing units. For example, a URL is stored in an object (id = 1) corresponding to a browser application. An object (id = 4) corresponding to the application of the headline 1 stores a news character string to be displayed in a ticker.

  The information of each field described above is managed by the takeover information management unit 16, and when the object is changed by the operation performed by the mobile phone 100 according to the event, the takeover information management is performed in accordance with the change. The unit 16 sequentially updates the takeover information. In this way, the history of the processing contents for the object is always maintained in the latest state. Each drawing unit refers to such takeover information for each object, so that even when the drawing unit is switched, the latest state of the object to be drawn is prepared and reflected smoothly in the drawing process. It becomes possible.

  For example, when the 3D drawing unit 7 draws and displays the GUI screen shown in FIG. 2C and the user presses the down key, the cursor 56 changes from the object 52 to the object 53. And The takeover information management unit 16 that has received the key input event via the event processing unit 13 detects that the cursor 56 has transitioned to the object 53 according to the key input event, and updates the takeover information. That is, the flag of the “focus” field in FIG. 4 is set to the record of id = 3 instead of the record of id = 2.

  As a result, when the focused object is updated during the drawing of the 3D drawing unit 7, when the drawing display is switched from the 3D drawing unit 7 to the 2D drawing unit 8, the takeover information is referred to. It becomes possible to take over the update smoothly.

[Process flow]
Next, an operation of the mobile phone 100 that displays a GUI screen using the above-described script and takeover information will be described.

  FIG. 5 is a flowchart showing the flow of takeover information update processing in the takeover information management unit 16 when an event occurs in the mobile phone 100. Here, a case where the 3D rendering unit 7 performs rendering processing on the GUI screen illustrated in FIG. 2C will be described as an example.

  When the 3D drawing unit 7 is executing the drawing process, the event processing unit 13 receives a notification event (such as a change in the remaining charge amount of the battery unit 5) or a key input event (such as a user pressing the up / down / left / right key). Then (YES in S101), the event processing unit 13 first executes event processing according to the event that has occurred (or causes other execution units to execute it) (S102). When the content of the GUI screen output to the display unit 12 changes with the execution of the event process in S102, the 3D drawing unit 7 reflects the execution result of the event process on a necessary object ( (S103) Each object is redrawn (S104).

  Next, when detecting the occurrence of an event accompanied by an object change via the event processing unit 13, the takeover information management unit 16 acquires information indicating which object has been changed and how from the 3D drawing unit 7. . The object ID of the changed object and the change contents associated therewith are acquired (S105).

  For example, when the change is made such that the cursor 56 on the object 52 is changed to the object 53, the takeover information management unit 16 associates “object ID = 2” with “focus: off” of the object 52. The attached information is acquired from the 3D drawing unit 7. Further, information that associates “object ID = 3” with “focus: on” of the object 53 is acquired from the 3D rendering unit 7.

  The takeover information management unit 16 stores new takeover information in the takeover information storage unit 30 based on the information acquired from the 3D drawing unit 7. Alternatively, the already stored takeover information is updated (S106). Specifically, in the takeover information shown in FIG. 4, the focus field flag of the record with id = 2 is canceled and the focus flag of the record with id = 3 is set.

  The takeover information updated as described above is referred to by the 2D drawing unit 8 even when the 2D drawing unit 8 is drawing the same GUI screen, and according to the drawing process of the 2D drawing unit 8 Thus, the takeover information management unit 16 is constantly updated to the latest state.

  In the example illustrated in FIG. 5, the mobile phone 100 is configured to wait for the occurrence of an event when it does not receive an event, but is not limited thereto. For example, in the mobile phone 100, when the display processing device 1 determines that drawing is necessary based on a predetermined rule regardless of whether the event is received or not, the 3D drawing unit 7 (or 2D The mobile phone 100 can also be configured so that the drawing unit 8) continues to write the GUI screen to the 3D frame buffer 9 (2D frame buffer 10) even when the object is not changed.

  In the example illustrated in FIG. 5, the takeover information update timing is described as being configured to be executed by the takeover information management unit 16 each time an event occurs. However, the present invention is not limited to this. For example, the update of the takeover information does not need to be performed every time, and may be collectively updated immediately before the drawing unit is switched.

  FIG. 6 is a flowchart showing a flow of drawing switching processing in the mobile phone 100 when a switching event requiring switching of the drawing unit occurs in the mobile phone 100. Here, an example will be described in which the 3D drawing unit 7 switches to the drawing process of the 2D drawing unit 8 according to an event when the GUI screen shown in FIG. 2C is being drawn.

  When the 3D drawing unit 7 is executing the drawing process, the event processing unit 13 receives a switching event (for example, the main control unit 3 cannot control the 3D drawing process) (YES in S201). The switching control unit 15 switches the drawing unit in accordance with an instruction from the event processing unit 13. That is, the drawing process of the 3D drawing unit 7 is terminated (S202), and the 2D drawing unit 8 is activated instead (S203). The switching control unit 15 controls the display unit 12 to display the screen data output from the 2D frame buffer 10 instead of the 3D frame buffer 9.

  At startup, the 2D drawing unit 8 reads a 2D script 42 corresponding to the 3D script 41 on the GUI screen that has been referred to by the 3D drawing unit 7 during the drawing process. The script linking is realized, for example, by assigning unique identification information to the GUI screen, and assigning common identification information to the 3D script 41 and the 2D script 42. As a result, the 2D drawing unit 8 can start drawing the GUI screen having the same content as the 3D drawing unit 7 has drawn so far.

  When the 2D drawing unit 8 draws each object constituting the GUI screen using the 2D script 42, the 2D drawing unit 8 subsequently acquires the takeover information stored in the takeover information storage unit 30 (S204). Then, the takeover content is reflected for each object based on the object ID (S205). Finally, each object reflecting the inherited contents is drawn, and the screen data is output to the 2D frame buffer 10 (S206).

  In the example illustrated in FIG. 6, the case of switching from the 3D drawing unit 7 to the 2D drawing unit 8 has been described, but the case of switching from the 2D drawing unit 8 to the 3D drawing unit 7 is substantially the same. For example, when the event processing unit 13 detects that the main control unit 3 has returned to a state in which the 3D drawing unit 7 can be controlled, the switching control unit 15 activates the 3D drawing unit 7 to store the 3D frame buffer 9. Control is performed so that the screen data is output to the display unit 12.

  The 3D drawing unit 7 draws an object based on the 3D script 41 on the GUI screen and the takeover information in the takeover information storage unit 30.

  In the present embodiment, the case where the 3D script 41 and the 2D script 42 are handled as separate data has been described, but the 3D script 41 and the 2D script 42 may be archived as one.

  In this case, the archive defines conditions for switching between 3D drawing processing and 2D drawing processing.

  FIG. 7 is a diagram illustrating a specific example of an archive describing switching conditions for 3D / 2D drawing processing. In the script shown in FIG. 7, a drawing process using the 2D script 42 is performed when a 2D display event occurs, and a drawing process using the 3D script 41 is performed when a 3D display event occurs. Describes the conditions.

  In the present embodiment, the case has been described where switching between 3D display and 2D display is performed depending on whether the main control unit 3 can control the 3D drawing unit 7, but the configuration of the display processing device 1 of the present invention is not limited to this. .

  For example, when the display unit 12 of the mobile phone 100 is provided so as to be rotatable in portrait / landscape (for example, rotation by a cycloid system), the display contents are displayed in portrait display and landscape display according to the orientation of the display unit 12. It is conceivable to switch with Here, when the landscape display is performed in the mobile phone 100, the display area of the GUI screen is limited as compared with the case of the portrait display, and thus the screen resolution when displaying the GUI screen is also limited. Therefore, 2D display is preferable for landscape display, and 3D display is preferable only for portrait display.

  Therefore, the display processing apparatus 1 may be configured to describe a switching condition in a script and switch between the 3D drawing unit 7 and the 2D drawing unit 8 in accordance with a change in the direction of the display unit 12.

  FIG. 8 is a diagram showing another specific example of the archive describing the switching conditions of the 3D / 2D drawing process. The script shown in FIG. 8 has a condition that the drawing process using the 2D script 42 is performed when the display unit 12 is in the landscape display, and the drawing process using the 3D script 41 is performed in the portrait display. is described.

  As described above, according to the configuration of the display processing device 1 of the present invention, information on objects that should be referred to in common among different drawing units is integrated and managed in association with the object ID. Can be referenced.

  Thus, in the mobile phone 100 (or the display processing device 1) that is switched between different drawing units, a history of processing contents performed on the object in accordance with an event that occurs in the mobile phone 100 is displayed in the drawing unit. It becomes easy to take over when switching. That is, each drawing unit can smoothly draw an object with reference to the common handover information and reflecting the history. Since the common part of the object information is managed in an integrated manner, the amount of takeover information is reduced and the amount of information that the drawing unit needs to read is reduced compared to the case where the object information is held for each drawing unit. Is done. As a result, even if switching occurs between the drawing units, switching and drawing processing can be performed at high speed, and display switching can be realized without impairing real-time performance.

  Further, when the cause of switching the drawing unit is removed, even when returning to the original drawing unit, it is possible to smoothly return to the original drawing unit while reflecting the history at that time.

  Furthermore, the conventional technology (for example, Patent Document 1) has a problem that history information (takeover information) always increases with time. However, according to the above configuration, for each object identified by the id in the description of the 3D script 41 (or 2D script 42), the latest processing history is saved, and used to maintain the takeover information. It is possible to manage the memory capacity to be maintained below a certain amount. For this reason, when the display processing apparatus 1 of the present invention is applied to a portable and small-sized device having a large hardware resource limit such as the mobile phone 100, the effect is particularly great.

[Modification]
Next, when the display processing apparatus 1 of the mobile phone 100 includes the media accelerator 11, the configuration and operation of the mobile phone 100 for the mobile phone 100 to perform 2D / 3D display switching will be described.

  FIG. 9 is a block diagram showing a main configuration of a mobile phone 100 including the display processing device 1 according to another embodiment of the present invention. The mobile phone 100 shown in FIG. 9 is different from that shown in FIG. 1 in that the display processing apparatus 1 includes a media accelerator 11 (hereinafter referred to as an accelerator 11) that can be used for 3D drawing computation by the 3D drawing unit 7. It is.

  The accelerator 11 is undertaken for calculation of drawing processing performed by each drawing unit (3D drawing unit 7 and 2D drawing unit 8) of the mobile phone 100 and calculation of audio reproduction processing performed by the audio processing unit 17, and Each processing is speeded up, and is realized by, for example, an LSI chip.

  The operation of the switching control unit 15 in this embodiment will be described more specifically.

  The state of the cellular phone 100 is, for example, that the accelerator 11 is used for other high-priority and high-load processing (for example, ringtone reproduction processing for incoming notification). 7 can be used for the rendering process of the 3D object.

  This is because the accelerator 11 according to the present embodiment serves not only as 3D drawing but also as an audio reproduction chip. For this reason, the same memory space is used in the 3D rendering process and the audio reproduction process. With such a configuration, the 3D drawing process and the audio reproduction process can be executed exclusively. Therefore, since 3D display cannot be performed during voice reproduction (for example, during ringtone reproduction), when an incoming call event occurs in the mobile phone 100, it is necessary to switch 3D display to 2D display.

  First, when the event processing unit 13 detects an incoming call via the wireless communication unit 4, the display processing device 17 outputs a ringing tone that outputs the ringing tone to the audio output unit 18 in accordance with an instruction from the event processing unit 13. Execute the process. Since the process for notifying the user of an incoming call is a process with a high priority, the accelerator 11 is preferentially used for the ring tone reproduction process of the display processing device 17.

  For this reason, the accelerator 11 cannot be used for the drawing process of the 3D drawing unit 7. When the switching control unit 15 detects that the accelerator 11 falls into a state where it cannot be used for the drawing process of the 3D drawing unit 7, the switching control unit 15 ends the 3D drawing unit 7, activates the lower-load 2D drawing unit 8, and Switch 3D display to 2D display.

  In this way, even when hardware resources such as the accelerator 11 fall into a state in which they cannot be used for 3D drawing processing, the switching control unit 15 is configured with an appropriate drawing unit so that each process in the mobile phone 100 is executed smoothly. Can be selected.

  Note that the event when the switching control unit 15 switches drawing is not limited to the above-described example. The processing for the main control unit 3 to output the video signal to the display unit 12 when the broadcast wave receiving unit 19 shown in FIGS. 1 and 9 receives the broadcast wave is also 3D for the main control unit 3 and the accelerator 11. It is assumed that it will be a high-load process that is difficult to process simultaneously with drawing.

  Therefore, also when the broadcast wave receiving unit 19 receives a broadcast wave (when the tuner and the decoder operate), the switching control unit 15 may switch the 3D display to the 2D display.

  In the example shown in FIGS. 1 and 9, the configuration in which the switching control unit 15 switches the 2D display to the 3D display in response to the occurrence of the switching event in the mobile phone 100 has been described. The configuration is not limited to this.

  For example, the display processing apparatus 1 uses a moving image drawing unit (not shown) that displays a moving image object as a moving image as the first drawing unit, and a still image object or one frame of the moving image object as the second drawing unit. In the case where a still image rendering unit (not shown) that displays an image is provided, the switching control unit 15 switches between the moving image rendering unit and the still image rendering unit in response to the occurrence of a switching event in the mobile phone 100. Configuration is conceivable. Specifically, when another high-load process with high priority for the main control unit 3 occurs, the switching control unit 15 ends the moving image drawing unit and activates the still image drawing unit.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

  Finally, each block of the mobile phone 100 (display processing device 1), in particular, the switching control unit 15, the takeover information management unit 16, the 3D drawing unit 7 and the 2D drawing unit 8 may be configured by hardware logic. Alternatively, it may be realized by software using a CPU as follows.

  That is, the mobile phone 100 includes a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, a RAM (random access memory) that expands the program, A storage device (recording medium) such as a memory for storing the program and various data is provided. An object of the present invention is to enable a computer to read program codes (execution format program, intermediate code program, source program) of a control program of the mobile phone 100 (display processing device 1), which is software that realizes the above-described functions. This can also be achieved by supplying the recorded recording medium to the mobile phone 100 (display processing apparatus 1) and reading out and executing the program code recorded on the recording medium by the computer (or CPU or MPU). .

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  Further, the mobile phone 100 (display processing apparatus 1) may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  According to the display processing device of the present invention, when a plurality of drawing devices are provided, even if the drawing device is switched, the display state before the switching is inherited using the takeover information, and after the switching is smoothly performed. The drawing result by the drawing device can be displayed on the display unit. Therefore, the present invention can be applied to a display processing device that includes a plurality of drawing devices and needs to switch drawing devices. In particular, it is suitable for embedded devices (small devices such as mobile phones) with limited resources.

It is a block diagram which shows the principal part structure of a mobile telephone provided with the display processing apparatus concerning embodiment of this invention. (A) is a figure which shows typically the data structure of 3D script, (b) is a figure which shows a part of 3D script concretely, (c) is the 3D script shown to (b). FIG. 6 is a diagram illustrating a specific example of a GUI screen displayed on the display unit as a result of the 3D rendering unit rendering each object defined in FIG. (A) is a figure which shows the data structure of 2D script typically. (B) is a diagram specifically showing a part of the 2D script. (C) is a figure which shows the specific example of the GUI screen displayed on a display part as a result of having drawn each object prescribed | regulated by 2D script shown in (b) by the 2D drawing part. It is a figure which shows the specific example of the takeover information memorize | stored in the takeover information storage part. It is a flowchart which shows the flow of the takeover information update process in a takeover information management part when an event generate | occur | produces in a mobile telephone. It is a flowchart which shows the flow of the drawing switching process in a mobile telephone when the switching event which requires switching of a drawing part generate | occur | produces in a mobile telephone. It is a figure which shows the specific example of the archive which described the switching conditions of 3D / 2D drawing processing. It is a figure which shows the other specific example of the archive which described the switching conditions of 3D / 2D drawing processing. It is a block diagram which shows the principal part structure of a mobile telephone provided with the display processing apparatus concerning other embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Display processing apparatus 2 Memory | storage part 3 Main control part 4 Wireless communication part 5 Battery part 6 Input part 7 3D drawing part (drawing means / first drawing means / 3D drawing means)
8 2D drawing unit (drawing means / second drawing means / 2D drawing means)
9 3D frame buffer 10 2D frame buffer 11 Media accelerator 12 Display unit 13 Event processing unit 14 Effect processing unit 15 Switching control unit (switching control means)
16 Takeover information management part (takeover information management means)
17 Voice processing unit (voice playback means)
18 audio output unit 19 broadcast wave receiving unit 30 takeover information storage unit 31 script storage unit 41 3D script (structured data)
42 2D script (structured data)
43 Common script (structured data)
100 Mobile phone (mobile phone)

Claims (9)

In a display processing apparatus for selectively outputting drawing results by a plurality of drawing means to a display unit,
3D rendering means for rendering each of a plurality of objects to be displayed in three dimensions based on structured data defining the objects in three dimensions ;
2D drawing means for drawing each of the plurality of objects in two dimensions based on structured data defining the objects in two dimensions ;
A takeover information storage unit that stores processing contents applied to each of the objects by the 3D drawing unit or the 2D drawing unit in association with each object as takeover information ;
A switching control unit that switches a drawing unit that outputs a drawing result to the display unit in response to the occurrence of a predetermined event in the device ;
Each drawing means, when the drawing result output to the display unit is switched from the other drawing means to the own means,
Each drawing means applies the processing content indicated by the takeover information associated with each object in the takeover information storage unit to each object, draws each object ,
The switching control means switches the drawing means for outputting the drawing result to the display unit from the 3D drawing means to the 2D drawing means when a situation occurs in which the accelerator included in the apparatus cannot be used for 3D drawing. A characteristic display processing device.   The switching control means includes
  When the sound reproduction means provided in the own apparatus uses the accelerator for reproducing sound, the drawing means for outputting a drawing result to the display unit is switched from the 3D drawing means to the 2D drawing means. The display processing apparatus according to claim 1.   The switching control means includes
  The drawing means for outputting a drawing result to the display unit when the accelerator is restored from a situation where the accelerator cannot be used for 3D drawing is switched from the 2D drawing means to the 3D drawing means. 3. The display processing device according to 1 or 2.   The takeover information storage unit
  The processing content of 1 applied by the drawing means before switching is stored in association with the object immediately before the switching of each drawing means. The display processing device according to 1.   A takeover information managing means for managing the takeover information stored in the takeover information storage unit;
  The takeover information management means
  2. The takeover information is updated to the applied processing content when the 3D drawing means or the 2D drawing means applies a process to an object in response to the occurrence of an event in its own apparatus. 5. The display processing device according to any one of items 1 to 4.   A mobile phone comprising the display processing device according to any one of claims 1 to 5.   A display processing method in a display processing apparatus for selectively outputting drawing results by a plurality of drawing means to a display unit,
  Based on the structured data defining the object in three dimensions, the 3D rendering step for rendering each of the plurality of objects to be displayed in three dimensions, or the structured data defining the object in two dimensions A drawing execution step for executing any one of the 2D drawing steps for drawing each of the objects in two dimensions;
  A switching control step of switching a drawing means for outputting a drawing result to the display unit in response to occurrence of a predetermined event in the own device,
  In the takeover information storage unit of the display processing device,
  Inheritance information that associates, for each object, the processing content applied to each of the objects during execution of the drawing execution step is stored.
  When the drawing step executed in the drawing execution step is switched to either the 3D drawing step or the 2D drawing step,
  In the switched 3D drawing step or 2D drawing step,
  Applying the processing content indicated by the takeover information associated with each object in the takeover information storage unit to each object, drawing each object,
  In the switching control step, when a situation occurs in which the accelerator included in the apparatus cannot be used for 3D drawing, the drawing execution step of outputting the drawing result to the display unit switches from the 3D drawing step to the 2D drawing step. A display processing method characterized by the above.   The control program for functioning a computer as each means of the display processing apparatus of any one of Claim 1-5. A computer-readable recording medium on which the control program according to claim 8 is recorded.

Images