JP2011015204A - Terminal device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To properly control a display mode of display information.SOLUTION: The terminal device (1) which controls a display section (17) capable of displaying arbitrary display information is provided with: an instruction means (11) for instructing to display first arbitrary display information on the display section as one of the pieces of display information; a determination means (11) for determining a display mode of second display information to be displayed on the display section with the first display information based on at least one of the content of the first display information and additional information associated with the first display information; and a control means (11) for performing control so as to display the first display information on the display section and to display the second display information on the display section in the display mode determined by the determination section.

Description

  The present invention relates to a terminal device and a program for controlling a display unit that can display arbitrary display information.

  Conventionally, a terminal device such as a cellular phone has a display unit for a user interface (consisting of a liquid crystal display panel of several inches), and this display unit can be used to make and receive calls. We provide various user support.

  In general, the display of the display unit is simple while the terminal is turned on. For example, display of required characters, or display information such as so-called pictograms such as the remaining battery capacity and the strength of radio waves has been displayed. Information can also be displayed, and the screen design can be set according to each user's preference.

  As described above, by allowing an arbitrary background image to be displayed, an advantage is obtained in that a screen design can be set according to each user's preference. However, unless the user himself intentionally changes the background image, The screen design that you set never changes, so you get bored quickly.

  Regarding this point (change in screen design), for example, in Patent Document 1 below, the background image can be changed (replaced) according to the current position of the terminal, and the pictogram appearance (display) on the image is displayed. A technique in which the aspect) can also be changed is disclosed.

Japanese Patent Laid-Open No. 2003-087857

  However, in the technique described in Patent Document 1, when the current position of the terminal does not change, for example, when the terminal is continuously used at home or the like, a background image or a pictographic display (display mode of display information) ) Is not changed at all, there is still a problem that it is easy to get bored.

  Accordingly, an object of the present invention is to appropriately control the display mode of display information.

  According to the first aspect of the present invention, in the terminal device for controlling the display unit capable of displaying arbitrary display information, the instruction means for instructing the display unit to display arbitrary first display information as one of the display information. And display of second display information to be displayed on the display unit together with the first display information based on at least one of the content of the first display information and the additional information associated with the first display information Determining means for determining a mode; and control means for controlling the display unit to display the first display information on the display unit and to display the second display information on the display unit in a display mode determined by the determining unit. It is characterized by comprising.

  Further, a program for realizing the main functions shown in the invention described in claim 1 is provided to the computer (the invention described in claim 10).

The invention described in claim 1 described above may be as follows.
The determining means determines the display mode of the second display information based on at least one of the content of the first display information and the additional information associated with the first display information, and the second display information. Is selected (invention of claim 2).

 The determination means analyzes any of the type of object, the outline of the object, the person attribute when the object is a person, the color scheme, the number of characters, the character arrangement included in the first display information, and according to the analysis result, The display mode of the 2nd display information displayed on the said display part with the said 1st display information is determined (invention of Claim 3).

  When the first display information is an image, the determining means is based on the shooting date and time of the image, the shooting location of the image, the title of the image, or when the first display information is a television broadcast. The display mode of the second display information to be displayed on the display unit together with the first display information is determined based on the TV broadcast channel and the TV broadcast program information (the invention according to claim 4).

  The display mode is at least one of the display number, size, color, shape, facial expression, action, and type of the second display information (the invention according to claim 5).

  When the display of the first display information is interrupted in the middle, the control means stores the display mode of the second display information at the time of the interruption, and the display of the first display information is resumed. Sometimes, the stored display mode is read out, and the second display information is displayed based on the display mode (the invention according to claim 6).

  The instruction means instructs the display unit to display an arbitrary standby image as the first display information in the terminal standby state, and the control means receives the first display information specified as the standby image. When displayed on the display unit, control is performed so that the second display information is displayed together with the first display information in the display mode determined by the determining means (the invention according to claim 7).

  The communication device further includes a communication unit, and the instruction unit displays an arbitrary communication notification image for informing at least one of incoming and outgoing calls on the display unit as the first display information when communication is performed by the communication unit. When the first display information designated as the communication notification image is displayed on the display unit, the control means displays the first display information together with the first display information in the display mode determined by the determination means. (2) Control to display the display information (the invention according to claim 8).

  The designation unit instructs the display unit to display a menu screen or a character display screen as the first display information, and the control unit displays the first display information designated as the menu screen or the character display screen. When the first display information is displayed, the second display information is controlled to be displayed together with the first display information in the display mode determined by the determining means (the invention according to claim 9).

  According to the present invention, the display mode of display information can be appropriately controlled.

It is the block diagram which showed the communication network system which can utilize a mobile telephone. 3 is a block diagram showing basic components of the mobile phone 1. FIG. 1 is an external view of a mobile phone 1. FIG. 6 is a diagram illustrating a display example of the display unit 17. FIG. It is a figure for demonstrating the background image memory | storage part M3. It is a figure which shows the image memorize | stored in the background image memory | storage part M3. It is a figure for demonstrating the character image memory | storage part M4. It is a figure which shows the character memorize | stored in the character image memory | storage part M4. It is a figure for demonstrating the character determination condition memory | storage part M5. It is a figure which shows an example of the user interface screen used in order to change the "setting flag" of character determination conditions. It is a figure for demonstrating the character content storage part M6. It is a figure for demonstrating operation | movement determination condition memory | storage part M7. It is a figure which shows an example of the user interface screen used in order to change the "setting flag" of operation determination conditions. It is a figure for demonstrating the operation | movement content storage part M8. It is a figure for demonstrating the registration image information storage part M9. 4 is a flowchart showing an outline of the overall operation on the mobile phone 1 side that is started when power is turned on. It is a flowchart of a standby display process. It is a flowchart of an image registration process. It is a flowchart of an image registration process. It is a flowchart of an incoming image display process. It is a display example of a background image and a character. It is a display example of a background image and a character. It is a conceptual diagram at the time of background image selection.

Hereinafter, embodiments of the present invention will be described with reference to the drawings, taking as an example the case of application to a mobile phone.
FIG. 1 is a block diagram showing a communication network system in which a mobile phone can be used. In this figure, the mobile phone 1 includes a call function, an e-mail function, an Internet connection function (Web access function), a camera shooting function, a playback function of a shot image, and a digital TV broadcast (for example, one-segment terrestrial digital). TV broadcast) reception function.

  When the mobile phone 1 is connected to the wired / wireless communication network (general public telephone communication network and mobile communication network) 2 from the exchange 2B via the nearest base station 2A, the mobile phone 1 passes through the wired / wireless communication network 2. Thus, it becomes possible to make a call with another mobile phone or a general subscriber phone (not shown). In addition, when the mobile phone 1 is connected to the Internet 3 via the wired / wireless communication network 2, the mobile phone 1 can access the Web site and browse content in the Web site, and the information distribution device 4 as appropriate. Information (information such as moving images, still images, music, news, etc.) can be downloaded via the Internet 3 and the wired / wireless communication network 2. The mobile phone 1 receives digital terrestrial broadcasts transmitted from the TV station 5 via the transmission antenna 6, but information is transmitted via the wired / wireless communication network 2 and the Internet 3 like Internet radio. A digital broadcast can be downloaded and received from the distribution device 4.

FIG. 2 is a block diagram showing basic components of the mobile phone 1.
In this figure, a central control unit 11 operates by supplying power from a battery unit 12 having a secondary battery (not shown), and performs the overall operation of the cellular phone 1 according to various programs in the storage unit 13. A central processing unit (computer) (not shown), a memory (not shown), and the like are controlled. The storage unit 13 includes a program storage unit M1, various information temporary storage units M2, a background image storage unit M3, a character image storage unit M4, a character determination condition storage unit M5, a character content storage unit M6, an action determination condition storage unit M7, An operation content storage unit M8, a registered image information storage unit M9, and the like are provided.

  The program storage unit M1 stores programs and various applications for realizing the present embodiment in accordance with the operation procedures shown in FIGS. 16 to 20, and also operates such programs and various applications. Information necessary for the storage is stored. The various information temporary storage unit M2 is a work area that temporarily stores various information necessary for the operation of the mobile phone 1, such as flag information, timer information, and screen information. The background image storage unit M3, the character image storage unit M4, the character determination condition storage unit M5, the character content storage unit M6, the motion determination condition storage unit M7, the motion content storage unit M8, and the registered image information storage unit M9 will be described later. It shall be described in detail.

  The wireless communication unit 14 includes a wireless unit, a baseband unit, a demultiplexing unit, and the like (not shown). For example, during operation of a call function, an e-mail function, an Internet connection function, etc., data communication with the nearest base station 2A is possible. When transmitting / receiving the call function, a signal is received from the receiving side of the baseband unit and demodulated into a received baseband signal, and then the audio is output from the speaker SP for calling through the audio signal processing unit 15, Input voice data from the call microphone MC is taken in from the voice signal processing unit 15 and encoded into a transmission baseband signal, which is then given to the transmission side of the baseband unit and transmitted from the antenna.

  The TV broadcast receiver 16 can receive program information such as an electronic program guide (EPG) in addition to the one-segment terrestrial digital TV broadcast for terminal devices. The television broadcast receiver 16 includes a receiver (analog circuit) that extracts a broadcast signal, and OFDM (Orthogonal Frequency Division Multiplexing) demodulation of the received broadcast signal, or video, audio, It has a digital circuit unit that separates data (character data) and decodes it, or decompresses compressed data. The display unit 17 uses a high-definition liquid crystal to display display information such as character information, a standby image, a television image, and the display screen (display area) of the display unit 17 is rectangular (rectangular). Is made.

  The operation unit 18 inputs dial input, character input, command input, and the like. The central control unit 11 executes processing according to an input operation signal from the operation unit 18. The RTC (real-time clock module) 19 constitutes a clock unit, and the central control unit 11 acquires the current date and time from the RTC 19. The notification unit 20 includes a sound speaker 20a, an LED (light emitting diode) 20b, and a vibration motor 20c. The notification unit 20 is driven at the time of an incoming call to notify the incoming call by sound, light, or vibration, and is also driven at the time of alarm notification.

  The imaging unit 21 includes a two-dimensional imaging device such as a CCD or a CMOS. When the mobile phone 1 is operating in the camera shooting mode, a moving image (through image or live view image) for checking and correcting the shooting composition. ) Is output to the display unit 17 via the central control unit 11, and when a specific key (shutter key) of the operation unit 18 is pressed down, a high-definition image is responded to a command from the central control unit 11. The image signal is output to the central control unit 11, and under the control of the central control unit 11, the image signal is compression-encoded to be stored in a required area of the storage unit 13, for example, the background image storage unit M3. Save and save. The storage unit 13 may be provided with a dedicated storage area for captured images.

  FIG. 3 is an external view of the mobile phone 1. In this figure, the mobile phone 1 is not particularly limited, but is, for example, a biaxial hinge type that can be changed into a plurality of styles according to the connection state of a plurality of casings constituting the device main body (device main body). The operation unit casing 1A and the display unit casing 1B are connected to each other via a hinge unit 1C so that the operation unit casing 1A and the display unit casing 1B can be folded and opened and rotated. The hinge portion 1C is provided with an opening / closing hinge shaft for folding and closing the operation portion housing 1A and the display portion housing 1B, and one housing is mounted substantially orthogonally to the opening / closing hinge shaft. A rotating hinge shaft for rotating with respect to the other housing is provided.

  Such a two-axis hinge type mobile phone 1 has a plurality of styles (closed style, closed style) depending on how the operation unit housing 1A and the display unit housing 1B are connected. 3 (a) shows an open style in a state in which the fold between the operation unit housing 1A and the display unit housing 1B is opened. The operation unit 18 is disposed on the inner surface of the operation unit housing 1A, and the display unit 17 is disposed on the inner surface of the display unit housing 1B. A call microphone MC is arranged, and a call speaker SP is arranged on the inner surface of the display unit housing 1B. FIG. 3B shows a view style in a state where the display unit housing 1B is folded 180 degrees after being folded in the open style. In this way, the display unit 17 that is on the inside in the open style is directed outward on the view style.

  FIG. 4 is a diagram illustrating a display example of the display unit 17. In this drawing, the display screen of the display unit 17 has a radio wave icon 22 indicating the strength of radio waves, a battery icon 23 indicating the remaining battery level, a mail icon 24 indicating incoming mail, and a time icon indicating the current time. The pictographic display area 26 for displaying display information such as 25 is displayed, and the image display area 27 for displaying other display information such as images and menu screens is used as an example. For example, the image display area 27 is almost the entire area of the display unit 17, and pictographic images such as the radio wave icon 22, the battery icon 23, the mail icon 24, and the time icon 25 are superimposed on the image display area 27. Also good.

FIG. 5 is a diagram for explaining the background image storage unit M3.
The background image storage unit M3 stores actual data of various images that can be used as the background image (standby image, incoming image, etc.) of the display unit 17 along with additional information such as the title, shooting date and time, and shooting position in units of records. In each record, information (hereinafter referred to as background ID) for uniquely identifying these images is set. For example, in the illustrated example, actual data relating to an image with the title “train” is stored in the background ID = A01, and actual data relating to an image having the title “cake” is stored in the background ID = A02. ing. Further, actual data related to the image with the title name “Mr. Tanaka” is stored in the background ID = A03, and actual data related to the image with the title name “Hokkaido Furano” is stored in the background ID = A04. = Actual data related to an image with the title name “Italy Florence” is stored in A05.
These images may be stored in advance as default data at the time of shipment from the factory, or may be captured arbitrarily by setting the mobile phone 1 in the camera mode. Alternatively, it may be downloaded from the information distribution device 4 via the Internet 3. Further, the storage date and time of the image may be included in the additional information.

  FIG. 6 is a diagram illustrating an image stored in the background image storage unit M3. In this figure, (a) is an image 28 of “train” corresponding to background ID = A01, (b) is an image 29 of “cake” corresponding to background ID = A02, and (c) is a background ID. = Image 30 of “Mr. Tanaka” corresponding to A03, (d) is an image 31 of “Hokkaido Furano” corresponding to background ID = A04, and (e) is “Italy Florence” corresponding to background ID = A05 Is an image 32 of "."

FIG. 7 is a diagram for explaining the character image storage unit M4.
The character image storage unit M4 stores actual data of various character images to be superimposed and displayed on the background image of the display unit 17 together with additional information such as the title, motion name, and basic motion control information in record units. Yes, information (hereinafter referred to as character ID) for uniquely identifying these images is set in each record. For example, in the illustrated example, actual data relating to the character with the title “dog” is stored in the character ID = B01, and actual data relating to the character having the title “bird” is stored in the background ID = B02. ing. Furthermore, actual data related to the character whose title is “mouse” is stored in the background ID = B03, actual data related to the character whose title is “daph” is stored in the background ID = B04, and background ID = B05. The actual data relating to the character whose title is “ant” is stored.
Note that the actual character data has a structure necessary for expressing the movement of each character, and is, for example, a plurality of frame images (such as polygons) obtained by decomposing the movement in time series. . In addition, the “motion name” of the additional information is a name representing a motion specific to each character. For example, “walk” for a dog, “fly” for a bird, “jump” for a mouse, In the case of ants, it means “crowd”. In addition, “basic motion control information” as additional information is control information necessary for each character to move. For example, in the case of a dog, how to walk and walk, in the case of a bird, how to fly and fly, the mouse In case of, it is how to run and speed, in case of Daphnia, how to jump and jump, and in case of ant, how to walk and flock density.

  FIG. 8 is a diagram showing characters stored in the character image storage unit M4. In this figure, (a) is a “dog” character 33 corresponding to character ID = B01, (b) is a “bird” character 34 corresponding to character ID = B02, and (c) is a character ID. = "Mouse" character 35 corresponding to B03, (d) is a "daphnia" character 36 corresponding to character ID = B04, and (e) is an "ant" character corresponding to character ID = B05. 37.

  Here, in the example of the character image storage unit M4 shown in FIG. 7, one character performs one action (for example, dog → walks), but is not limited to this. One character may perform a plurality of actions. For example, in the case of a dog, set two actions, “walk” and “run”, and decide which action to select according to the content of the background image (eg, the background image contains a car → You may be allowed to run, or a person in the background image → walk).

FIG. 9 is a diagram for explaining the character determination condition storage unit M5.
The character determination condition storage unit M5 stores character determination conditions to be superimposed and displayed on the background image of the display unit 17. The character determination condition is a condition indicating the character to be determined based on “what” of the background image. In this example, items indicating the determination condition include “object type (including person attribute)”, “shooting time” ”And“ Shooting position ”are set. The “setting flag” associated with “on” and “off” of these items indicates which of the items is currently valid, “1” is valid, and “0” is invalid. Show. The contents of the “setting flag” are arbitrarily set by a user operation.

FIG. 10 is a diagram illustrating an example of a user interface screen used for changing the “setting flag” of the character determination condition. In this figure, in the image display area 27 of the display unit 17, together with a required setting title (“character determination condition setting”) 27a, “object type (including person attribute)”, “shooting time”, “shooting position”, A list box 27b including selection items such as..., A slide bar 27c that displays items hidden by sliding the list box 27b up and down, an OK button 27d, and a cancel button 27e are displayed. . These displays can be performed by operating a predetermined key (menu key) of the operation unit 18 to select a system setting.
The white inverted item in the list box 27b indicates the character determination condition currently set. A user who desires to change the character determination condition selects and highlights a desired item and then presses the OK button 27d, or presses the cancel button 27e to cancel the change.

  Here, an object refers to an element that can be extracted independently from the elements constituting the image. For example, it refers to a person or plant in an image, an object such as an automobile or a building, or another object having a shape. Therefore, the object type means the type of those elements, and according to the above example, a person, a plant, a car, a building, another object, and the like correspond to the object type. Note that the object types in this embodiment are assumed to be four types (refer to FIG. 11A) for convenience of explanation: “food”, “vehicle”, “person”, and “others”.

FIG. 11 is a diagram for explaining the character content storage unit M6.
In this figure, (a) is referred to when “object type (including person attributes)” in the character determination condition storage unit M5 is valid, and (b) is “shooting time” in the character determination condition storage unit M5. "Is referred to when the" shooting position "of the character determination condition storage unit M5 is valid.

  In FIG. 11A, the character content storage unit M6 includes items “food”, “vehicle”, “person”, “others”, and the character ID of the character image storage unit M4 associated with these items. For example, when “food” of the object type is selected, the character with the character ID “B05” in the character image storage unit M4, that is, “ant” is designated. This is because, if the background image includes “food” of the object type (for example, cake), “ant” seems to be appropriate (or interesting) as a character related to the food. In the same way, when “vehicle” of the object type is selected, the character with the character ID “B01” in the character image storage unit M4, that is, “dog” is designated. This means that if the background image includes a “vehicle” of the object type (for example, a train), a “dog” with the habit of chasing moving objects is suitable (or interesting) as a character related to the vehicle. Because it seems. Note that the “person” of the object type further includes personal attributes such as “female under 30”, “female over 30”, “male under 30”, and “male over 30” (here, age). ), And a character ID for each person attribute is set. For example, “B02” as the character ID of “female under 30”, “B01” as the character ID of “female over 30”, “B01” as the character ID of “male under 30”, “30 years old” “B02” is set as the character ID of “male”. The character ID “B01” is “dog”, and the character ID “B02” is “bird”.

  In FIG. 11B, the character content storage unit M6 stores items “07: 0 to 19:00” and “19:00 to 07:00” as shooting times, and character images associated with these items. For example, when “07: 0 to 19:00” is selected, the character with character ID “B02” in the character image storage unit M4, that is, “bird” is designated. It has become so. This is a "bird" that is active during the day as a character related to the image when the shooting time of the background image is "07: 0 to 19:00", that is, when it was taken during the day. This seems to be appropriate (or interesting). In the same way, when “19:00 to 07:00” is selected, the character with the character ID “B01” in the character image storage unit M4, that is, “dog” is designated. This is because, when the shooting time of the background image is “19:00 to 07:00”, that is, when it is taken at night, a “dog” that is active at night is also a character related to the image. This seems to be appropriate (or interesting). In addition, although it is set as imaging | photography time here, it is not restricted to this, For example, you may show the seasons (spring / summer / autumn / winter etc.) calculated from the imaging | photography date.

  In FIG. 11C, the character content storage unit M6 includes items “outside Japan” and “inside Japan” as shooting positions, and the character ID of the character image storage unit M4 associated with these items. For example, when “outside Japan” is selected, the character with the character ID “B04” in the character image storage unit M4, that is, “daphnia” is designated. When “Japan” is selected, the character with the character ID “B05” in the character image storage unit M4, that is, “ant” is designated. It should be noted that the shooting position inside and outside the country can be distinguished from the information of the base station 2A to be communicated. Further, since more detailed position information (for example, a prefecture, a municipality, or the vicinity of a station) can be acquired from the information of the base station 2A, the detailed position information is used as information on the shooting position. It may be used as Alternatively, when the mobile phone 1 is equipped with a GPS function, position information acquired from the GPS information may be used as shooting position information.

FIG. 12 is a diagram for explaining the operation determination condition storage unit M7.
The action determination condition storage unit M7 stores the action determination condition of the character to be superimposed and displayed on the background image of the display unit 17. The character motion determination condition is a condition indicating what character motion is determined based on “what” of the background image. In this example, “object type (including person attribute)” is an item indicating the motion determination condition. , “Outline”, “Color”, “Shooting time” and “Shooting position” are set, but other items (for example, the position of the object, the number of characters or the character arrangement when the object is a character, etc.) Or additional information such as image shooting date and time, image shooting location, image title, TV broadcast channel, TV broadcast program information, and the like. The “setting flag” associated with “on” and “off” of these items indicates which of the items is currently valid, “1” is valid, and “0” is invalid. Show. The contents of the “setting flag” are arbitrarily set by a user operation.

FIG. 13 is a diagram illustrating an example of a user interface screen used for changing the “setting flag” of the operation determination condition. In this figure, in the image display area 27 of the display unit 17, “object type (including person attribute)”, “contour line”, “color”, “ A list box 27g including selection items such as “shooting time”, “shooting position”,..., A slide bar 27h that slides up and down the list box 27g to display hidden items, an OK button 27i, and A cancel button 27j is displayed. These displays can be performed by operating a predetermined key (menu key) of the operation unit 18 to select a system setting.
The white inverted item in the list box 27g indicates the operation determination condition currently set. A user who desires to change the operation determination condition selects a desired item and highlights it, and then presses an OK button 27i, or presses a cancel button 27j to cancel the change.

  Here, the “contour line” refers to the outline of various “objects” included in the background image, that is, a line connecting portions where the density value of the image changes rapidly. Various algorithms such as Sobel, Roberts, and Prewitt are known as contour line extraction algorithms. The extraction of the contour line is sometimes referred to as edge detection. The “color” refers to a color included in the background image, and in particular, a color that represents the image, for example, a large area and a conspicuous color.

FIG. 14 is a diagram for explaining the operation content storage unit M8.
In this figure, (a) is referred to when the “object type (including person attribute)” in the motion determination condition storage unit is valid, and (b) is the “contour line” in the motion determination condition storage unit. Reference is made when it is valid, (c) is referenced when the “color” of the motion determination condition storage unit is valid, and (d) is the “shooting time” of the motion determination condition storage unit. (E) is referred to when the “shooting position” of the motion determination condition storage unit is valid.

  In FIG. 14A, the action content storage unit M8 includes items of “food”, “vehicle”, “person”, “others”, and action contents associated with these items. When “Food” is selected, “activate greatly” is designated as the operation content. When the “vehicle” of the object type is selected, “move according to the traveling direction of the vehicle” is designated as the operation content. The “person” of the object type further includes personal attributes such as “female under 30 years old”, “female over 30 years old”, “male under 30 years old”, and “male over 30 years old”. In addition, “move around the face with a small motion” and “move around the face with a large motion” are set as the operation content for each person attribute.

In FIG. 14B, “move along the contour line” is set in the motion content storage unit M8 as the motion content related to “the contour line”.
In FIG. 14C, the operation content storage unit M8 is set to “operate around a position where the number of colors is small (color density is small)” as the operation content related to “color”.
In FIG. 14D, the operation content storage unit M8 stores items “07: 0 to 19:00” and “19:00 to 07:00” as shooting times, and operation details associated with these items. For example, “largely operate” is set as the operation content of “07: 0 to 19:00”, and “smallly operate” is set as the operation content of “19:00 to 07:00”.
In FIG. 14E, the operation content storage unit M8 includes items “outside Japan” and “inside Japan” as shooting positions and operation content associated with these items. For example, “outside Japan” “Largely operates” is set as the operation content when “is selected”, and “Operates smallly” is set as the operation content of “Japan”.

FIG. 15 is a diagram for explaining the registered image information storage unit M9.
In this figure, the registered image information storage unit M9 includes items such as “standby image” and “incoming image”, and background ID, character ID, operation parameter, interruption information, character display color, pictograph associated with each item. It is configured to include display colors. Here, the background ID is reference information of the background image storage unit M3 shown in FIG. 5, the character ID is reference information of the character image storage unit M4 shown in FIG. 7, and the motion parameter is generated by the background image. This is a parameter indicating the movement of the character. The actual movement of the character is controlled based on this motion parameter and basic motion control information included in the additional information of the character image storage unit M4 in FIG. The interruption information is information indicating how far the character's movement has been performed when the image display is interrupted due to an incoming call or the like, and is used to determine the character's movement starting point when the image display is resumed.

  Next, the operation concept of the mobile phone 1 in the present embodiment will be described with reference to the flowcharts shown in FIGS. Each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed in the central control unit 11. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. In other words, in addition to the recording medium, the operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium such as a network.

  FIG. 16 is a flowchart (hereinafter, also referred to as a main flow) showing an outline of the overall operation on the mobile phone 1 side that is started when the power is turned on. First, in the cellular phone 1, when the power-on operation for turning on the power is performed (YES in step S1), the central control unit 11 starts the power supply and executes a power-on process for initializing a predetermined memory and the like. After that, standby processing for performing location registration through communication with the base station 2A is performed (step S2), and then standby image display for displaying a standby image or the like on the display unit 17 is performed. Processing is performed (step S3).

  FIG. 17 is a flowchart of the standby display process. In this standby display process, first, the registered image information used for the standby image is read with reference to the registered image information storage unit M9 of FIG. 15 (step S3a), and the read image is displayed on the display unit 17 as a standby image. Display (step S3b). Specifically, since “A02” is set in the background ID of the item “standby image” in the registered image information storage unit M9 in FIG. 15, the background ID = A02 in the background image storage unit M3 in FIG. The actual data is read, and the actual data is displayed in the image display area 27 of the display unit 17 as a background image.

  Thereby, the image of background ID = A02, that is, the cake image 29 shown in FIG. 6 is displayed on the display unit 17 of the mobile phone 1 as a standby image.

  Once the standby image is displayed, the required pictograph is then displayed (step S3c). Specifically, pictogram displays such as the radio wave icon 22, the battery icon 23, the mail icon 24, and the time icon 25 shown in FIG. Note that the color of the pictographic display at this time follows the pictographic display color (here, “yellow”) set in the item “standby image” of the registered image information storage unit M9 in FIG.

  When the pictogram display is completed, the character is displayed next. Specifically, a required character display is performed based on the character ID, the operation parameter, the character display color, and the interruption information set in the item “standby image” of the registered image information storage unit M9 in FIG. That is, the actual data (ant character 37 shown in FIG. 8) and basic motion control information of the same character ID (B05) and basic motion control information are read from the character image storage unit M4 of FIG. 7, and according to the basic motion control information and the motion parameters described above. Set the character's action (in this case, "ants" swarm) and set the character's color according to the character display color ("red" in this case), then place the character on the background image Superimposed display.

  As a result, a character ("ant") that is set in red and swarming action is displayed on the standby image in which the cake image 29 shown in FIG. 6 is used.

  At this time, the presence / absence of the above interruption information is determined (step S3d). If there is interruption information, that is, if the character was previously interrupted in the middle of the character motion, Is resumed (step S3d). On the other hand, if there is no interruption information, the character motion is started from the beginning (step S3e).

  When the standby display process is completed, the process returns to the main flow of FIG. 16 again to determine the presence / absence of setting operation (step S4), the presence / absence determination of image registration operation (step S5), the presence / absence determination of incoming call detection (step S6), The power-off operation presence / absence determination (step S7) and the other operation presence / absence determination (step S8) are sequentially performed. If any determination result is NO, the process returns to the standby image display process of step S3.

  If it is determined in step S4 that there is a setting operation, the character display interruption information (information indicating how far the character has been moved, that is, information indicating the resumption point of the movement) is stored in the registered image of FIG. The interruption information of the item “standby image” in the information storage unit M9 is written and saved (step S9), the necessary setting process is executed (step S10), and the process returns to the standby image display process of step S3. The “required setting process” refers to various setting processes related to the background image and the character. For example, the background image registration process (camera shooting, download, etc.), the character registration process, and the character determination condition And operation determination conditions and operation contents.

  If it is determined in step S5 that there is an image registration operation, the character display interruption information (information indicating how far the character has been moved, that is, information indicating the resumption point of the movement) is registered in FIG. Write and save the interruption information of the item “standby image” in the image information storage unit M9 (step S11), execute the required image registration process (step S12), and then return to the standby image display process of step S3.

18 and 19 are flowcharts of the image registration process.
In this image registration process, first, a standby image / incoming image selection operation (step S121) is performed, and then various background images (image 28 to image in FIG. 6) stored in the background image storage unit M3 in FIG. 32) (step S122), the background ID of the selected background image is stored in the registered image information storage unit M9 in FIG. 15 (step S123). Here, the standby image / incoming image selection operation refers to a selection operation for registering a standby image or an incoming image, and in the former case, the background of the background image selected in step S122. The ID is registered in the background ID of the item “standby image” in the registered image information storage unit M9 in FIG. 15, while in the latter case, the ID is registered in the background ID of the item “incoming image” in the storage unit M9.

  Next, the character determination condition of setting flag = 1 is read with reference to the character determination condition storage unit M5 of FIG. 9 (step S124). For example, the character determination condition storage unit M5 in FIG. 9 currently reads the “object type” as the character determination condition since the object type setting flag is “1”.

  Next, it is determined whether or not the read character determination condition is “object type” (step S125). Here, since the setting flag of the object type is 1 in the character determination condition storage unit M5 of FIG. 9, the character determination condition read in step S124 is “object type”. In this case, step S125 The determination result is YES, and the character corresponding to the object type is selected (steps S126 to S129).

  Specifically, first, using the background ID (“A02” for the standby image and “A01” for the incoming image) of the registered image information storage unit M11 of FIG. 15, the background image storage unit M3 of FIG. To read the actual data of the corresponding background image (“cake” image 29 in the case of a standby image and “train” image 28 in the case of an incoming image) (step S126), and then to the actual data of the background image. The included object type (“vehicle” for “train”, “food” for “cake”) is analyzed (step S127), and the character ID corresponding to the analyzed object type (“vehicle” is “ In the case of “B01” and “food”, “B05”) is read (step S128), and the character ID is stored (step S129).

  If the determination result in step S125 is NO, that is, if the read character determination condition is not “object type”, it is determined whether or not the character determination condition is “shooting time” (step S130). ). If the character determination condition is “shooting time”, the determination result in step S130 is YES, and the character corresponding to the shooting time is selected (step S131, step S132, step S129).

  Specifically, first, using the background ID (“A02” for the standby image and “A01” for the incoming image) of the registered image information storage unit M11 of FIG. 15, the background image storage unit M3 of FIG. The shooting date and time of the corresponding background image is read out (step S131), and then the character ID corresponding to the time information included in the shooting date and time (if the time information is in the range of “07: 0 to 19:00”, “B02 "," B01 "in the range of" 19: 00 to 07:00 ") is read (step S132), and the character ID is stored (step S129).

  If the determination result in step S130 is NO, that is, if the read character determination condition is not “shooting time”, the character determination condition is regarded as the remaining “shooting position” and corresponds to the shooting position. The selected character is selected (step S133, step S134, step S129).

  Specifically, first, using the background ID (“A02” for the standby image and “A01” for the incoming image) of the registered image information storage unit M11 of FIG. 15, the background image storage unit M3 of FIG. Is read out from the shooting position of the corresponding background image (step S133), and then the character ID corresponding to the shooting position ("B04" if the shooting position is "outside Japan", "B05" if it is "Japan"). ) Is read (step S134), and the character ID is stored (step S129).

  In these step S125 to step S128 and step 130 to step S134 (range surrounded by a one-dot chain line), in short, processing for automatically selecting a character corresponding to the character determination condition designated by the user is executed.

  When the storage of the character ID is completed as described above, the operation determination condition with the setting flag = 1 is read with reference to the operation determination condition storage unit M7 in FIG. 12 (step S135), and the read operation determination condition Is “object type” (step S136). Here, since the setting flag of “contour line” is 1 in the current motion determination condition storage unit M7, “contour line” is read as the motion determination condition in this case, so the determination result in step S136 is NO. However, if the “object type” setting flag is 1 in the motion determination condition storage unit M7, the determination result in step S136 is YES, and the character motion corresponding to the object type is determined. The contents are determined (steps S137 to S139).

  Specifically, first, using the background ID (“A02” for the standby image and “A01” for the incoming image) of the registered image information storage unit M11 of FIG. 15, the background image storage unit M3 of FIG. To read the actual data of the corresponding background image (“cake” image 29 in the case of a standby image and “train” image 28 in the case of an incoming image) (step S137), and then to the actual data of the background image. The included object type ("vehicle" for "train", "food" for "cake") is analyzed (step S138), and the action content of the character ("vehicle") corresponding to the analyzed object type is analyzed. In this case, “move in accordance with the traveling direction of the vehicle”, and in the case of “food”, “move greatly”) is read (step S139).

  If the determination result in step S136 is NO, that is, if the read motion determination condition is not “object type”, it is determined whether or not the motion determination condition is “contour line” (step S140). ). If the motion determination condition is “contour line”, the determination result in step S140 is YES, and the motion content of the character corresponding to the contour line is determined (steps S141 to S143).

  Specifically, first, using the background ID (“A02” for the standby image and “A01” for the incoming image) of the registered image information storage unit M11 of FIG. 15, the background image storage unit M3 of FIG. The actual data of the corresponding background image is read from (step S141), the contour line included in the actual data is analyzed (step S142), and the action content of the character corresponding to the analyzed contour line ("contour line" It moves along "") and reads (step S143).

  If the determination result in step S140 is NO, that is, if the read operation determination condition is not “contour line”, it is determined whether or not the operation determination condition is “color” (step S144). . If the action determination condition is “color”, the determination result in step S144 is YES, and the action content of the character corresponding to the color is determined (step S145 to step S147).

  Specifically, first, using the background ID (“A02” for the standby image and “A01” for the incoming image) of the registered image information storage unit M11 of FIG. 15, the background image storage unit M3 of FIG. The actual data of the corresponding background image is read out from (step S145), then the colors included in the actual data are analyzed (step S146), and the action content of the character corresponding to the analyzed color (“the number of colors is small ( The operation is performed centering on the position where the color density is small))) is read (step S147).

  If the determination result in step S144 is NO, that is, if the read operation determination condition is not “color”, it is determined whether the operation determination condition is “shooting time” (step S148). . If the action determination condition is “shooting time”, the determination result in step S148 is YES, and the action content of the character corresponding to the shooting time is determined (steps S149 and S150).

  Specifically, first, using the background ID (“A02” for the standby image and “A01” for the incoming image) of the registered image information storage unit M11 of FIG. 15, the background image storage unit M3 of FIG. From this, the shooting date and time of the corresponding background image is read (step S149), and then the action content of the character corresponding to the time information included in the shooting date and time is read (step S150).

  If the determination result in step S148 is NO, that is, if the read operation determination condition is not “shooting time”, the operation determination condition is regarded as the remaining “shooting position” and corresponds to the shooting position. The action content of the character is determined (step S151, step S152).

  Specifically, first, using the background ID (“A02” for the standby image and “A01” for the incoming image) of the registered image information storage unit M11 of FIG. 15, the background image storage unit M3 of FIG. Then, the shooting position of the corresponding background image is read out (step S151), and the action content of the character corresponding to the shooting position (if the shooting position is "outside Japan", "acts greatly", "in Japan" In this case, “acts small”) is read (step S152).

  In these step S136 to step S152 (range surrounded by the alternate long and short dash line), in short, processing for automatically selecting the operation content corresponding to the operation determination condition specified by the user is executed.

  When the action content of the character is determined as described above, the action content is then converted into a motion parameter (step S153), and the motion parameter is temporarily stored (step S154). Next, using the background ID (“A02” for the standby image and “A01” for the incoming image) of the registered image information storage unit M11 in FIG. 15, the corresponding background image from the background image storage unit M3 in FIG. The actual data is read (step S155), and the color of the actual data is analyzed (step S156). In addition, when there is color arrangement information in the additional information of the background image storage unit M3 in FIG. 5, the color of the background image may be identified from the additional information.

  Next, the character display color corresponding to the analyzed color is determined (step S157), but it may be determined to be a color similar to the color frequently used in the background image, the opposite color or a color having a specific relationship. . Next, the character display color is stored (step S158), the pict display color corresponding to the color is determined (step S159), the pict display color is stored (step S160), and the process returns to the main flow of FIG.

  Next, when step S6 of the main flow in FIG. 16 is YES, that is, when it is determined that there is incoming call detection, the interruption information of the character display at that time (information on how far the character has been moved, That is, the information indicating the resumption point of the operation) is written and stored in the interruption information of the item “standby image” in the registered image information storage unit M9 in FIG. 15 (step S13), and the required incoming image display process is executed (step S13). After S15), the call processing (step S16) is performed, and the process returns to the standby image display processing of step S3.

  FIG. 20 is a flowchart of incoming image display processing. In this incoming image display process, first, the registered image information used for the incoming image is read with reference to the registered image information storage unit M9 in FIG. 15 (step S14a), and the read image is displayed on the display unit 17 as the incoming image ( Step S14b). Specifically, since “A01” is set as the background ID of the item “incoming image” in the registered image information storage unit M9 in FIG. 15, the background ID = A01 in the background image storage unit M3 in FIG. The data is read and the actual data is displayed in the image display area 27 of the display unit 17 as a background image.

  Once the background image is displayed, the required pictograph is then displayed (step S14c). Specifically, pictogram displays such as the radio wave icon 22, the battery icon 23, the mail icon 24, and the time icon 25 shown in FIG. Note that the color of the pictogram display at this time follows the pictogram display color set in the item “standby image” of the registered image information storage unit M9 in FIG.

  When the pictogram display is completed, the character is displayed next. Specifically, a required character display is performed based on the character ID, the operation parameter, the character display color, and the interruption information set in the item “incoming image” of the registered image information storage unit M9 in FIG. That is, the actual data of the same character ID and the basic motion control information are read from the character image storage unit M4 of FIG. 7, the character motion is set according to the basic motion control information and the motion parameters, and the color of the character Is set in accordance with the character display color, and the character is superimposed and displayed on the background image. At this time, the presence / absence of the interruption information is determined (step S14d). If there is interruption information, the character's action is resumed from the interruption point (step S14e). After starting the character action from the beginning (step S14f), the process returns to the standby image display process in step S3 again.

  Next, when step S7 of the main flow in FIG. 16 is YES, that is, when it is determined that there is a power-off operation, the character display interruption information at that time (information on how far the character has been moved) That is, the information indicating the resumption point of the operation) is written and saved in the interruption information of the item “standby image” in the registered image information storage unit M9 in FIG. 15 (step S17), and the necessary power-off process is executed (step After S18), the main flow is terminated.

  Next, when step S8 of the main flow of FIG. 16 is YES, that is, when it is determined that there is another operation, the character display interruption information at that time (information on how far the character has been moved) In other words, the information indicating the resumption point of the operation) is written and stored in the interruption information of the item “standby image” in the registered image information storage unit M9 in FIG. 15 (step S19), and necessary processing (related to other operations) ) (Step S18), the process returns to the standby image display process in step S3.

The operation concept of the mobile phone 1 in the present embodiment is as described above. Here, the characteristic items of the present embodiment will be described. First, an object of the present invention is to “control the display mode of display information appropriately” as described above.
The background image as an example of the display information is an arbitrary image (standby image or incoming image) displayed on the display unit 17 at the time of incoming standby or incoming. The standby image is the corresponding image (standby image display process) in step S3 (standby image display process) of the main flow in FIG. 16, and the incoming image is the corresponding image (standby image display process) in step S14 (incoming image display process) of the main flow in FIG. (Received image or incoming image) is read out and displayed on the display unit 17.

  Specifically, the detailed flow of these background image display processing (standby image display processing and incoming image display processing) is shown in FIG. 17 (standby image display processing) and FIG. 20 (incoming image display processing). In each detailed flow, a corresponding image (standby image or incoming image) is read from the registered image information storage unit M9, and pictogram display and characters as an example of display information corresponding to the standby image and incoming image are displayed. Display is done.

  The registered image information storage unit M9 stores a motion parameter indicating character motion information as an example of a display mode of display information, and the character on the display unit 17 performs a required motion according to the motion parameter. It has become. Further, character color information (information relating to the color of the character) and pictographic display color (information relating to the color of the pictographic display) as examples of display modes are also stored in the registered image information storage unit M9. The color of the pictogram display is controlled according to the color information.

  As described above, in the present embodiment, display information (such as a character having movement) corresponding to display information (background image or the like) selected by the user can be displayed. Since (such as the color of the character and pictogram display) can be controlled according to display information (background image, etc.), the purpose of “controlling the display mode of display information appropriately” can be achieved.

  21 and 22 are diagrams showing display examples of the background image and the character. For example, in FIG. 21A, an image 29 of “cake” as a standby image (or incoming image) is displayed in the image display area 27 of the display unit 17. When the “ant” character 37 is set as the character corresponding to the “ant” character 37, the “ant” character 37 is displayed on the “cake” image 29 as shown in FIG. It has become. Alternatively, in FIG. 22A, an “train” image 28 as a standby image (or incoming image) is displayed in the image display area 27 of the display unit 17. When the “mouse” character 35 is set as the character corresponding to the character, the “mouse” character 35 is displayed on the “train” image 28 as shown in FIG. It has become.

  In addition, in this embodiment, when a background image is selected, it is possible to set additional information such as character settings corresponding to the background image, character movement, and character color.

  FIG. 23 is a conceptual diagram when a background image is selected. In this figure, M3 is a background image storage unit, M5 is a character determination condition storage unit, M6 is a character content storage unit, M7 is an action determination condition storage unit, M8 is an operation content storage unit, and M9 is a registered image information storage unit. It is. When the background image (standby image or incoming image) is displayed on the display unit 17, the last M9 is referred to. That is, when displaying a standby image, the background ID and character ID of the standby image are read from M9, and the actual data of the background image corresponding to the background ID is read from the background image storage unit M3 in FIG. 5 and displayed. In addition to outputting to the unit 17, the actual character data corresponding to the character ID is read from the character image storage unit M 4 of FIG. 7 and output to the display unit 17. At the same time, the character operation parameters, character display color and pictographic display color are read out from M9, and the character operation displayed on the display unit 17 and the character and pictographic display colors are controlled.

  Similarly, when displaying an incoming image, the background ID and character ID of the incoming image are read from M9, and the actual data of the background image corresponding to the background ID is read from the background image storage unit M3 of FIG. 17, and the actual data of the character corresponding to the character ID is read from the character image storage unit M 4 in FIG. 7 and output to the display unit 17. At the same time, the character operation parameters, character display color and pictographic display color are read out from M9, and the character operation displayed on the display unit 17 and the character and pictographic display colors are controlled.

  When the background image is selected, that is, when the image registration process shown in FIGS. 18 and 19 is executed, the stored contents of M9 are updated. The flow of this update is outlined below.

(01) First, referring to M3, an image to be used as a background image (standby image or incoming image) is selected from images registered in M3 (steps S121 and S122 in FIG. 18). ).
(02) Next, the identification information (background ID) of the selected background image is registered in M9 (step S123 in FIG. 18). At this time, if it is a standby image, a background ID is registered in the record of the item “standby image” of M9, and if it is an incoming image, a background ID is registered in the record of the item “incoming image” of M9. .

(03, 04) Next, the character determination condition of M5 flag = 1 is read (step S124 in FIG. 18). The character determination condition to be read out is any one of “object type”, “shooting time”, and “shooting position”.
(05) Next, M6 is referenced using the character determination conditions read from M5, and the character ID corresponding to the character determination conditions is extracted from M6 (steps S125 to 128 and steps S130 to 134 in FIG. 18). At the same time, the character ID is registered in M9 (step S129 in FIG. 18). The character ID extracted from M6 corresponds to the character determination condition of “object type”, “shooting time”, or “shooting position”. Specifically, the character determination condition is “object type”. In this case, the object (“food”, “vehicle”, “person”, “other”) reflected in the target background image (standby image or incoming image corresponding to the background ID stored in M9) is displayed. ) Associated with the character ID and character determination condition is “shooting time”, it is associated with the shooting time of the background image (“07: 0 to 19:00”, “19: 0 to 07:00”). When the character ID and character determination condition are “shooting position”, the character ID is associated with the shooting position of the background image (“outside Japan”, “in Japan”).

(06, 07) Next, the operation determination condition of M7 flag = 1 is read (step S135 in FIG. 19). The operation determination condition to be read out is any one of “object type”, “contour line”, “color”, “imaging time”, and “imaging position”.
(08) Next, M8 is referred to using the operation determination condition read from M7, and the operation content corresponding to the operation determination condition is extracted from M8 (steps S136 to 152 in FIG. 19). Action contents taken out from M8 The action contents correspond to the action determining conditions of “object type”, “contour line”, “color”, “shooting time” or “shooting position”, and specifically When the action determination condition is “object type”, an object (“food”, “received image” or “incoming image corresponding to the background ID stored in M9”) is copied to the target background image. If the action content related to “vehicle”, “person”, “other”) (eg food → moves greatly) and the action determination condition is “contour line”, it is related to the contour line of the same background image If the action content (moves along the contour line) and the action determination condition is “color”, the action contents associated with the color of the background image (acts around a position with a small number of colors), the action determination condition Is `` Shooting time '' In this case, the operation content (for example, 07:00 to 19:00) → the operation is greatly performed associated with the shooting time of the background image (“07: 0 to 19:00”, “19:00 to 07:00”). ), When the operation determination condition is “shooting position”, the operation content (eg, outside of Japan → largely operates) associated with the shooting position of the background image (“outside of Japan”, “inside of Japan”).

(09) Next, the operation content read from M8 is converted into an operation parameter (step S153 in FIG. 19).
(10) Next, the operation parameter is stored in M9 (step S154 in FIG. 19).
(11, 12) Next, the color of the target background image (the standby image or the incoming image corresponding to the background ID stored in M9) is analyzed, and the character corresponding to the color and the color of the pictographic display are determined. These character display colors and pictographic display colors are stored in M9 (steps S155 to S160 in FIG. 19).

  As described above, when the background image is changed, the background image identification information (background ID) is registered in M9 in accordance with the steps (01) to (12) in FIG. 23, and the character corresponding to the background image is registered. Is automatically selected and the identification information (character ID) of the character is registered in M9, and information such as the operation parameter of the character, the color of the character, and the pictographic display color are also registered in M9 at the same time.

  Accordingly, by freely replacing the standby image and the incoming image, there is an advantage that a screen design that does not get tired can be freely set. In the present embodiment, the standby image and the incoming image are further provided. In addition, the character's movement, color, and pictogram display color can be automatically set according to the standby image and the incoming image. It is possible to achieve a unique effect that it is possible to realize a screen design that does not come from.

  Specifically, a character can perform an action according to a scene on an image such as a standby image or an incoming image, and the movement of the character is changed according to the analysis result of the image content. be able to. For example, move the character along the outline of the image, or recognize the face of the person in the image and change the character's action according to the person. Recognize and change the character's color, make the character appear in places with low color density, recognize the object in the image, change the character's action according to the type of the object, Depending on the shooting location, the action of the character can be changed, and so on.

In addition, embodiment mentioned above shows an example of the aspect which can be implemented, and is not limited to it. For example, the following may be used.
The terminal device is not limited to the mobile phone 1. Any terminal device such as a personal computer, a PDA, a digital camera, or a music player may be used. In addition, although the folding type terminal device (mobile phone 1) is used, it may have any housing structure such as a straight type, a slide type, and a spin top type.
Moreover, although the memory | storage part 13 was used as the memory | storage part with which the terminal device was equipped, arbitrary external storage devices, such as a memory card and an external hard disk, may be sufficient. The display unit 17 is a display unit provided in the terminal device, but may be an arbitrary external display device such as an external monitor.
The background image may be a still image such as a photograph or a moving image, but may be arbitrary display information such as a television broadcast program, a menu screen, a mail display screen, or a character display screen. Moreover, although the display information superimposed on the background image is a character or a pictograph, any display information may be used.
The background image content to be analyzed and identified is the object type, object outline, person attribute, color scheme, time information, and position information. For example, the object position, the number of characters, the character arrangement, the title, and the TV broadcast channel Any content such as TV broadcast program information may be used.
In addition, the display mode of characters and pictograms determined based on the background image is the type, motion, display color, and display position. For example, in any display mode such as the number, size, shape, and facial expression to be displayed There may be.
Also, the timing for displaying characters and pictograms is displayed during standby image display or incoming image display. However, any display information may be displayed during outgoing image display, TV broadcast program output, menu screen display, etc. . For example, video color analysis is performed at a predetermined interval while a TV broadcast program is displayed, and the pictograph display is changed at a predetermined interval based on the analysis result, or is displayed during mail display or menu display. It may be possible to perform control such as analyzing the number of characters and the arrangement of characters and changing the action of the character accordingly.

1 Mobile phone (terminal equipment)
11 Central control unit (instruction means, determination means, control means)
14 Wireless communication unit (communication means)
17 Display

Claims (10)

In a terminal device that controls a display unit that can display arbitrary display information,
Instruction means for instructing to display arbitrary first display information on the display unit as one of the display information;
A display mode of second display information to be displayed on the display unit together with the first display information based on at least one of the content of the first display information and the additional information associated with the first display information. A decision means for making a decision;
Control means for controlling the display unit to display the first display information on the display unit and to display the second display information on the display unit in a display mode determined by the determination unit. Terminal device.   The determining means determines the display mode of the second display information based on at least one of the content of the first display information and the additional information associated with the first display information, and the second display information. The terminal device according to claim 1, wherein the terminal device is selected.   The determination means analyzes any of the type of object, the outline of the object, the person attribute when the object is a person, the color scheme, the number of characters, the character arrangement included in the first display information, and according to the analysis result, The terminal device according to claim 1, wherein a display mode of second display information to be displayed on the display unit together with the first display information is determined.   When the first display information is an image, the determining means is based on the shooting date and time of the image, the shooting location of the image, the title of the image, or when the first display information is a television broadcast. The display mode of the second display information to be displayed on the display unit together with the first display information is determined based on the TV broadcast channel and TV broadcast program information. Terminal equipment.   2. The terminal device according to claim 1, wherein the display mode is at least one of a display number, a size, a color, a shape, a facial expression, an action, and a type of the second display information.   When the display of the first display information is interrupted in the middle, the control means stores the display mode of the second display information at the time of the interruption, and the display of the first display information is resumed. 2. The terminal device according to claim 1, wherein the stored display mode is read and the second display information is displayed based on the display mode.   The instruction means instructs the display unit to display an arbitrary standby image as the first display information in the terminal standby state, and the control means receives the first display information specified as the standby image. 2. The terminal according to claim 1, wherein the second display information is controlled to be displayed in the display mode determined by the determination unit together with the first display information when displayed on the display unit. apparatus.   The communication device further includes a communication unit, and the instruction unit displays an arbitrary communication notification image for informing at least one of incoming and outgoing calls on the display unit as the first display information when communication is performed by the communication unit. When the first display information designated as the communication notification image is displayed on the display unit, the control means displays the first display information together with the first display information in the display mode determined by the determination means. 2. The terminal device according to claim 1, wherein the terminal device is controlled to display two display information.   The designation unit instructs the display unit to display a menu screen or a character display screen as the first display information, and the control unit displays the first display information designated as the menu screen or the character display screen. 2. The terminal device according to claim 1, wherein when the first display information is displayed, the second display information is controlled to be displayed together with the first display information in a display mode determined by the determination unit. To a computer of a terminal device that controls a display unit that can display arbitrary display information,
Instructing means for instructing the display unit to display arbitrary first display information as one of the display information,
A display mode of second display information to be displayed on the display unit together with the first display information based on at least one of the content of the first display information and the additional information associated with the first display information. Decision means for making decisions,
And realizing each function of control means for controlling the display unit to display the first display information on the display unit and to display the second display information on the display unit in the display mode determined by the determination unit. Program.

Images