JP2010102097A - Mobile communication device, display control method, and display control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reliably and rapidly form a light emitting pattern that is illumination display with individuality, and to use it for information. <P>SOLUTION: The portable communication device including a light emitting unit having a plurality of light emitting areas where light is turned on and turned off includes: an image input unit configured to receive input of an image; a characteristic point extraction unit configured to extract characteristic points of the image based on color information of the image received by the image input unit; a light emitting pattern generation unit configured to generate the light emitting pattern of each of the light emitting areas so that a display unit may display a figure showing the characteristic points extracted by the characteristic point extraction unit; and a light emitting pattern control unit configured to display the figure showing the characteristic points by making each of the light emitting areas to emit light in the light emitting pattern generated by the light emitting pattern generation unit. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a mobile communication device, a display control method, and a display control program.

As an example of the mobile communication device, a background art will be described using a mobile phone device as an example. As a means for notifying a user of an incoming voice call, incoming mail, web information, etc. in a mobile phone device, a notification means by sound, vibration of the mobile phone device, illumination display using light, etc. is known. ing. This notification means by illumination display is made up of a plurality of light emitting areas, in which a mobile phone device emits a light emitting area in which light is turned on and off with a light emission pattern (color, light intensity, timing of turning on and off, etc.). It is a means for performing notification by displaying a figure on the light emitting unit.
Conventionally, in this notification means by illumination display, a technique has been known in which a mobile phone device performs notification by causing a light emitting area to emit light with a light emission pattern stored at the time of manufacture of the mobile phone device. Also, in recent notification means by illumination display, there is known a technique in which a mobile phone device performs notification by causing a light emitting area to emit light with a light emission pattern downloaded via the Internet or a light emission pattern created by a user using software. It has been.

For example, Patent Document 1 discloses notification pattern data and its tempo for generating a pattern of change in lighting color by a combination of blinking of a plurality of LEDs by driving a plurality of LEDs of different colors for each tempo. Memory means for storing data, drive data generating means for repeatedly generating drive data for driving a plurality of LEDs according to data written from the memory means, and a plurality of LEDs corresponding to the drive data. There is described an incoming call notification pattern setting circuit for a mobile phone, characterized in that it comprises drive means for driving each independently, and is configured so that data in the memory means can be set from the outside.
In this technique, information on a light emission pattern set from the outside is stored in a memory unit, and a plurality of LEDs are blinked in accordance with the light emission pattern of the stored information, so that the mobile phone device performs notification.

Patent Document 1 describes a method for setting an incoming call notification pattern of a mobile phone device in which notification pattern data stored in a memory means and tempo data thereof are input from an operation unit.
This technique is a technique for generating a light emission pattern and storing information on the light emission pattern in a memory means by a user directly operating the operation unit of the mobile phone device.
JP 2001-157254 A

However, in the technology in which the light emitting pattern stored at the time of manufacture of the mobile phone device or the light emitting pattern light emitting region downloaded via the Internet emits light to notify the mobile phone device, it is displayed on the light emitting unit composed of a plurality of light emitting regions. Since the illuminated display is uniform, there is a drawback that it lacks individuality.
In addition, it is difficult to reliably and quickly create a light emission pattern that provides an illumination display desired by the user with the technology in which the light emitting area is caused to emit light with a light emission pattern generated by input from the operation unit and the mobile phone device notifies. There was a drawback of being. In particular, an input interface with a small number of input keys such as a cellular phone device has a drawback that it takes time to operate. Similarly, it takes time to operate a light emission pattern created on a personal computer in cooperation with a personal computer.
As described above, the conventional technique has a drawback in that a light emission pattern that is a unique illumination display cannot be reliably and quickly created and used for notification.

  The present invention has been made in view of the above points, and the purpose thereof is a portable communication device, a display control method, and the like, which can reliably and quickly create a light emission pattern that becomes a unique illumination display and use it for notification. And providing a display control program.

(1) The present invention has been made in order to solve the above-described problems. One aspect of the present invention is to input an image in a portable communication device including a light-emitting unit having a plurality of light-emitting regions that turn on and off light. An image input unit that accepts, a feature point extraction unit that extracts feature points of the image based on color information of the image received by the image input unit, and a figure that represents the feature points extracted by the feature point extraction unit A light emission pattern generation unit for generating a light emission pattern for each of the light emission regions, and a figure representing the feature points by causing each of the light emission regions to emit light with the light emission pattern generated by the light emission pattern generation unit. And a light emission pattern control unit to be displayed.
According to the above configuration, the mobile communication device extracts the feature points of the image based on the color information of the input image, and displays the graphic representing the extracted feature points on the light emitting unit. Each light emission pattern is generated, each of the light emission regions is caused to emit light with the generated light emission pattern, and a graphic representing the extracted feature point is displayed on the light emitting unit, so that a light emission pattern that is a unique illumination display can be reliably and securely displayed. It can be quickly created and used for notification.

(2) Moreover, one aspect of the present invention is characterized in that the feature point extraction unit extracts an outline of an object in the image as the feature point based on a positional change of color information in the image. Mobile communication device.
According to the above configuration, the mobile communication device extracts the contour of the object in the image as the feature point, and displays information such as an incoming call by displaying a graphic representing the extracted feature point. By inputting an image of an object having a contour desired by the user of the apparatus, a light emission pattern for illuminating and displaying the contour can be created reliably and quickly and used for notification.

(3) Further, according to one aspect of the present invention, the image is a moving image that changes with time, and the feature point extraction unit extracts a change with time of color information in the moving image as the feature point. This is a portable communication device.
According to the above configuration, the mobile communication device extracts temporal changes in color information in the moving image as the feature points and displays a graphic representing the extracted feature points, so the color information changes temporally. A light emission pattern of illumination display can be created reliably and quickly and used for notification.

(4) According to another aspect of the present invention, the light emission pattern generation unit generates the light emission pattern by combining at least two light emission patterns selected from the generated light emission patterns in time order. A portable communication device is characterized.
According to the above configuration, the mobile communication device generates the light emission pattern by combining at least two light emission patterns selected from the plurality of light emission patterns generated in advance in time order. A light emission pattern in which illumination displays are combined in order of time can be reliably and quickly created and used for notification.

(5) One embodiment of the present invention is a portable communication device including an imaging unit that generates a captured image, and the image input unit accepts input of an image generated by the imaging unit. .
According to the above configuration, the mobile communication device accepts input of a captured image, extracts feature points, and displays a graphic representing the extracted feature points, thereby providing a unique illumination display from the captured image. A light emission pattern can be created reliably and quickly and used for notification.

  (6) Further, according to one aspect of the present invention, in the notification method in the portable communication device including a light emitting unit including a plurality of light emitting regions that turns on and off light, the portable communication device receives a first input image. And a second step of extracting feature points of the image based on the color information of the image received in the first step, and a feature extracted by the portable communication device in the second step. A third process of generating a light emission pattern of each of the light emitting areas so that a figure representing a point is displayed on the light emitting unit; and the portable communication device generates each of the light emitting areas in the third process. And a fourth process of displaying a figure representing the feature point by emitting light with the light emission pattern.

  (7) Further, according to one embodiment of the present invention, an image input unit that receives an image input to a computer of a portable communication device including a light emitting unit including a plurality of light emitting regions that turns on and off light, the image input unit Based on the color information of the received image, the feature point extracting means for extracting the feature points of the image, and the light emitting area so that the figure representing the feature points extracted by the feature point extracting means is displayed on the light emitting section. A light emitting pattern generating means for generating a light emitting pattern, and a light emitting pattern control means for causing each of the light emitting areas to emit light with the light emitting pattern generated by the light emitting pattern generating means and to display a figure representing the feature point. It is a control program.

  According to the present invention, the mobile communication device extracts the feature points of the image based on the color information of the input image, and displays the graphic representing the extracted feature points on the light emitting unit. A light emission pattern is generated, each light emitting area is made to emit light with the generated light emission pattern, and a graphic representing the extracted feature point is displayed on the light emitting part, so that a light emission pattern that is unique illumination display can be created reliably and quickly. Can be used for notification.

<Example of Mobile Communication Device: Appearance of Mobile Phone Device 1>
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a schematic external view showing an external appearance of a mobile phone device 1 described as an example of a mobile communication device according to an embodiment of the present invention. In the present embodiment, the mobile phone device 1 is a clamshell type mobile phone device. FIG. 1A is an external view of the inside of the mobile phone device 1 in an opened state, and FIG. 1B is an external view of the outside of the mobile phone device 1 in an opened state.

  As shown in FIG. 1A, the cellular phone device 1 includes a display unit 12 and an operation unit 13 including keys such as a cross key. The display unit 12 is a liquid crystal display and displays information such as characters and images. In addition, the cellular phone device 1 accepts an operation of a cursor displayed on the display unit 12 and an input of information by pressing a key on the operation unit 13.

  As shown in FIG. 1B, the mobile phone device 1 includes an imaging unit 11 and a light emitting unit 16. The imaging unit 11 is a camera provided in the mobile phone device 1. Moreover, the light emission part 16 is provided with the electroluminescent display board which spread | overlaid several LED (Light Emitting Diode: Light emitting diode), and the translucent cover which covers the electroluminescent display board. The light emitting unit 16 generates a light emitting area that turns on and off the light on the cover part by turning on and off the light of each LED. The light emitting unit 16 performs graphic display (hereinafter referred to as illumination display) by turning on and off the light of the plurality of LEDs according to the light emission pattern.

FIG. 2 is another schematic external view showing the external appearance of the mobile phone device 1 according to the present embodiment. FIG. 2A is an external view showing an enlarged portion of the display unit 12 in FIG. 1A, and FIG. 2B is an enlarged view of the light emitting unit 16 in FIG. FIG.
FIG. 2A shows that the image A <b> 1 is displayed on the display unit 12. The image A1 is an image received by an image input unit 141 (to be described later), and is an image obtained by capturing the object a1.

FIG. 2B shows that an illumination display is displayed on the light emitting unit 16. In this figure, a hatched area surrounded by a solid circle and an area surrounded by a dotted circle indicate a display area that is lit, and a plurality of displays that are hatched and surrounded by a solid circle A set of areas a21 and a set of display areas a22 surrounded by a dotted circle indicate that the color of light to be lit or the intensity of light is different.
This figure also shows that the outline of the object a1 in the image A1 is extracted as a feature point in the cellular phone device 1 of the present embodiment, and a graphic representing the feature point is illuminated by turning on the display area set a21. It shows that it is given.

<About the configuration of the mobile phone device 1>
Hereinafter, the configuration of the mobile phone device 1 will be described.
FIG. 3 is a schematic block diagram showing the configuration of the mobile phone device 1 according to the present embodiment. The cellular phone device 1 includes a communication unit 10, an imaging unit 11, a display unit 12, an operation unit 13, a control unit 14, a time measuring unit 15, and a light emitting unit 16.
The control unit 14 includes an image data storage unit 140, an image input unit 141, a feature point extraction unit 142, a light emission pattern generation unit 143, a light emission pattern control unit 144, and a light emission pattern storage unit 145.
In FIG. 3, only the outline of the configuration of the mobile phone device 1 related to the description of the present embodiment is shown.

The communication unit 10 performs wireless communication with the base station device. The communication unit 10 displays an image from the Internet website via the base station device on the display unit 12 based on the operation of the operation unit 13 by the user of the mobile phone device 1, downloads the image as necessary, and the image input unit 141 is output. The communication unit 10 may store the downloaded image in the image data storage unit 140.
In addition, when the communication unit 10 receives an incoming call signal indicating incoming voice, mail, or web information to the mobile phone device 1, the communication unit 10 displays the incoming information on the display unit 12 and outputs it to the light emission pattern control unit 144. .

The imaging unit 11 includes a lens and an optical sensor such as a CCD (Charge Coupled Device) and has a digital camera function. The imaging unit 11 captures an image based on the operation of the operation unit 13 by the user of the mobile phone device 1. The imaging unit 11 displays the captured image information on the display unit 12 and outputs the captured image to the image input unit 140. The imaging unit 11 may store the captured image information in the image data storage unit 140.
The image captured by the imaging unit 11 may be a moving image as well as a still image.

The display unit 12 displays an image input from the communication unit 10 or the imaging unit 11 or an image read from the image data storage unit 140. The display unit 12 displays the feature points extracted by the feature point extraction unit 142 and information input from the issue pattern control unit 144.
The operation unit 13 receives input of information by the user of the mobile phone device 1. The operation unit 13 outputs the received information to the light emission pattern generation unit 143.

  The image data storage unit 140 stores an image. Note that the image data storage unit 140 may store an image predetermined by the manufacturing apparatus when the mobile phone is manufactured, or may store an image created by a user using software or the like. The image data storage unit 140 may store an image stored in the memory card input to the mobile phone device 1 from an input unit of a memory card such as a flash memory (not shown).

The image input unit 141 reads an image from the image data storage unit 140. For example, the image input unit 141 reads an image generated by the imaging unit 11 and stored in the image data storage unit 140. That is, the image input unit 141 receives an input of an image generated by the imaging unit 11.
The image input unit 141 outputs the read image to the feature point extraction unit 142.

The feature point extraction unit 142 extracts feature points of the image input from the image input unit 141. Here, the feature points are, for example, the contour of an object in the image, color information (for example, hue, saturation, luminance (or brightness)), arrangement, and light source. If the image is a moving image, This is a change in feature points, for example, a change in color information.
In the present embodiment, a case where the feature point is an outline of an object or a change in color information will be described. The details of the object contour and color information change extraction method will be described later (FIGS. 4, 5, and 6).
The feature point extraction unit 142 generates an image representing the extracted feature points, and causes the display unit 12 to display an image representing the generated feature points. In addition, the feature point extraction unit 142 outputs the light emission pattern generation unit 143.

The light emission pattern generation unit 143 converts the image representing the feature point input from the feature point extraction unit 142 into an image having a resolution represented by the number of light emitting areas of the light emission unit 16. In the present embodiment, it is assumed that the resolution represented by the number of light emitting areas of the light emitting unit 16 is smaller than the resolution of the image representing the feature points input from the feature point extracting unit 142.
Here, the light emission pattern generation unit 143 obtains pixels representing the contour of the object in the image input from the feature point extraction unit 142, and pixels in the converted image corresponding to pixels having color information changes, respectively. As a pixel representing the contour of the object and a pixel having a change in color information, a graphic representing the contour of the object and color information (a graphic representing a feature point) is generated.
Moreover, the light emission pattern production | generation part 143 changes the figure showing a feature point based on control of the issue pattern control part 144 so that it may mention later. Moreover, the light emission pattern production | generation part 143 produces | generates the light emission pattern of each light emission area | region of the light emission part 16 based on control of the issuing pattern control part 144 so that it may mention later.
The light emission pattern generation unit 143 outputs a graphic image representing the generated feature points to the issue pattern control unit 144.

The issuance pattern control unit 144 causes the display unit 12 to display a graphic image representing the feature point input from the light emission pattern generation unit 143.
The issuance pattern control unit 144 receives input of information from the operation unit 13, presence / absence of regeneration of a figure representing a feature point, change of a display portion for displaying an illumination among figures representing a feature point, and feature points for displaying illumination Changes in the size and arrangement of the figure representing The issuance pattern control unit 144 controls the light emission pattern generation unit 143 to change the graphic representing the feature point based on the received information. The details of the display portion changing process performed by the issuance pattern control unit 144 will be described later (FIGS. 8B and 8C).
The issuance pattern control unit 144 causes the display unit 12 to display a graphic image representing the feature point changed by the light emission pattern generation unit 143.

The issuance pattern control unit 144 accepts input of information from the operation unit 13 and accepts setting of light emission information for a figure representing a feature point input from the light emission pattern generation unit 143. The setting of the light emission information is, for example, the setting of the presence / absence of light emission, the color information of light emission, the blinking cycle, etc. for the outline or the inside or outside surrounded by the outline. Note that the light emission pattern generation unit 143 measures the blinking cycle based on the timing information input from the timing unit 15.
Based on the received information, the issuance pattern control unit 144 causes the display unit 12 to display a graphic representing the feature point for which the light emission information is set, with the set light emission information.

The issuance pattern control unit 144 also receives information on whether to determine light emission information from the operation unit 13. When the issuance pattern control unit 144 receives the information indicating that the light emission information is determined, the light emission pattern generation unit 143 causes the light emission pattern generation unit 143 to emit light with the determined light emission information. Control is performed to generate each light emission pattern. That is, the light emission pattern generation unit 143 generates a light emission pattern for each light emission region so that the graphic representing the feature point extracted by the feature point extraction unit 142 is displayed on the light emission unit 16.
The issuance pattern control unit 144 stores the light emission pattern generated by the light emission pattern generation unit 143 in the light emission pattern storage unit 145.

  The issuance pattern control unit 144 causes the display unit 12 to display the two light emission patterns from the plurality of light emission patterns stored in the light emission pattern storage unit 145, and the mobile phone device 1 operates based on the operation of the operation unit 13. Control may be performed by causing the user to select, and generating the light emission pattern generation unit 143 by combining the selected at least two light emission patterns in time order. That is, the light emission pattern generation unit 143 generates a light emission pattern by combining at least two light emission patterns selected from the generated light emission patterns in time order.

The issuance pattern control unit 144 controls to turn on / off the LED of the light emitting unit 16 with the light emission pattern of information stored in the light emission pattern storage unit 145 when incoming information is input from the communication unit 10. As a result, a figure representing the feature point is illuminated and displayed on the light emitting unit 16. That is, the issuance pattern control unit 144 causes each light emitting region to emit light with the light emission pattern generated by the light emission pattern generation unit 143 and causes the light emission unit 16 to display a graphic representing the feature point extracted by the feature point extraction unit 142.
In addition, when the light emission pattern is a light emission pattern that changes with time, for example, when the LED is blinked, the issuance pattern control unit 144 measures the blinking cycle according to the timekeeping information input from the timekeeping unit 15.

The timing unit 15 measures time and outputs this timing information to the issue pattern control unit 144.
The light emitting unit 16 turns on and off the LED according to the control of the issuance pattern control unit 144.

<About the feature point extraction method>
Hereinafter, an outline of an object and a method for extracting changes in color information will be described with reference to FIGS. First, an object outline extraction method will be described with reference to FIG.

  FIG. 4 is a diagram illustrating an example of an image representing feature points according to the present embodiment. FIG. 4 shows an image displayed on the display unit 12 of the mobile phone device 1. 4A shows that the image displayed on the display unit 12 is the image A1 received by the image input unit 141, and FIG. 4B shows that the image displayed on the display unit 12 is characteristic. It shows that the point extraction unit 142 is an image (image representing a feature point) A3 representing the outline of the object a1 extracted from the image A1 of FIG.

The feature point extraction unit 142 compares the color information of the pixel in the image A1 with the color information of the pixel adjacent to the pixel, and extracts the outline a31 of the object a1. That is, the feature point extraction unit 142 extracts the contour of the object a1 in the image A1 as a feature point based on the positional change of the color information in the image A1.
For example, the feature point extraction unit 142 extracts pixels having a large difference in color information as contours. However, the present invention is not limited to this, and the contour may be extracted by other image analysis means.

Next, a method for extracting changes in color information will be described with reference to FIGS.
FIG. 5 is a diagram illustrating an example of a moving image according to the present embodiment. This figure shows that a moving image is displayed on the display unit 12 of the mobile phone device 1, and shows that time elapses in the order of FIG. 5 (a), FIG. 5 (b), and FIG. 5 (c). .
In this figure, an image B11 displayed on the display unit 12 is an image in which electrical decorations b11 and b13 are applied to a tree b12. Moreover, in this figure, the hatched part in the image displayed on the display unit 12 indicates that light is emitted. Moreover, in this figure, electrical decoration b13, b14 shows light-emission with a red hue.

  FIG. 5A shows that the electric decoration b11 is turned off, the electric decoration b13 is turned on, and the electric decoration b14 is turned off. Next, FIG. 5B shows that the electrical decoration b11 is turned on, the electrical decoration b13 is turned off, and the electrical decoration b14 is turned on. Next, FIG. 5C shows that the electrical decoration b11 is turned on, the electrical decoration b13 is turned on, and the electrical decoration b14 is turned off. FIG. 5 shows that other objects in the image displayed on the display unit 12, for example, the tree b12, have no change in color information.

FIG. 6 is a diagram illustrating an example of an image representing feature points of a moving image according to the present embodiment. FIG. 6 shows that a moving image is displayed on the display unit 12 of the mobile phone device 1, and shows that time elapses in the order of FIG. 6 (a), FIG. 6 (b), and FIG. 6 (c). .
Further, this figure shows that the image displayed on the display unit 12 is an image obtained by extracting the color information only for the pixels whose color information has changed from the moving image of FIG. That is, the feature point extraction unit 142 extracts temporal changes in color information in the moving images B11 to B13 as feature points. In this figure, images B21 to B23 are images obtained by extracting feature points of the images B11 to B13 in FIG.

For example, this figure shows that the electrical decorations b11, b13, and b14 whose color information has changed due to the blinking of light in FIG. 5 are extracted as electrical decorations b21, b23, and b24 in FIG. 6, respectively. The color information of the object having no change in color information, for example, the tree b12 is not extracted. For example, the hue is extracted as red from the color information of the electrical decoration b23 of the images B21 and B23 and the electrical decoration b24 of the image B22.
Note that the image with which the feature point extraction unit 142 compares whether or not there is a change is an image in units of 1/10 second, for example, an image before and after the passage of 0.2 second, but this time may be changed by setting. .
Further, the feature point extraction unit 142 may extract only the light source having the color information change as the feature point. In this case, the feature point extraction unit 142 extracts, for example, pixels whose predetermined luminance (or brightness) has changed to a certain value or more.

FIG. 7 is a diagram illustrating an example of a graphic representing feature points of a moving image according to the present embodiment. FIG. 7 shows that a moving image is displayed on the display unit 12 of the mobile phone device 1, and shows that time elapses in the order of FIG. 7 (a), FIG. 7 (b), and FIG. 7 (c). .
This figure also shows that the image displayed on the display unit 12 is a graphic image representing a change in color information generated by converting the resolution of the image of FIG. In this figure, images B31 to B33 are graphic images generated by converting the resolutions of the images B11 to B13 in FIG.
For example, this figure shows that the electrical decorations b21, b23, and b24 in FIG. 6 are converted into graphics b31, b33, and b34, respectively. At this time, of the color information of the figures b33 and b34, the hue is the hue that the display area can emit light, and is the most red in the colors b23 of the images B21 and B23 and b24 of the image B22, respectively. Displayed as a close hue.

  FIG. 7A shows that the figure b31 is turned off and the figure b33 is lit. Next, FIG. 7B shows that the figure b31 is lit and the figure b34 is lit. Next, FIG. 7C shows that the graphic b31 is lit and the graphic b33 is lit.

<About display area change processing>
Hereinafter, the display part changing process will be described with reference to FIG.
FIG. 8 is an explanatory diagram for explaining the display portion change processing according to the present embodiment. FIGS. 8A to 8C each show that an image is displayed on the display unit 12 of the mobile phone device 1.

FIG. 8A shows that the image displayed on the display unit 12 is the image C1 received by the image input unit 141. FIG. 8B is an image C2 of a graphic representing the feature point generated from the extracted image by extracting the feature point (the contour of the object) of the image C1 from the image displayed on the display unit 12. It shows that.
FIG. 8B shows that the display portion c21 is selected so as to surround the figure c2 of the image C2 by the operation of the operation unit 13 by the user of the mobile phone device 1. In the present embodiment, the display portion c21 is selected by the user of the mobile phone device 1 by the operation unit 13, but the present invention is not limited to this. For example, the display unit 12 is used as a touch panel. The display portion c21 may be selected by touching or tracing the display unit 12.

FIG. 8C shows that the image displayed on the display unit 12 is an image C3 displayed by enlarging the display portion c21 selected in the image C2, and the figure c3 enlarges the figure c2. Indicates that the figure is
In this way, the light emission pattern generation unit 143 accepts the selection of the portion to be illuminated and changes the graphic representing the feature point for the graphic representing the generated feature point.

<Operation of the mobile phone device 1>
Hereinafter, the operation of the mobile phone device 1 will be described.
FIG. 9 is a flowchart showing the operation of the mobile phone device according to the present embodiment.

(Step S <b> 101) The mobile phone device 1 displays an image to be stored on the display unit 12 and causes the user of the mobile phone device 1 to select an image by operating the operation unit 13. The cellular phone device 1 reads the selected image. Thereafter, the process proceeds to step S102.
(Step S102) The cellular phone device 1 extracts the feature points of the image read in step S101. Thereafter, the process proceeds to step S103.

(Step S103) The cellular phone device 1 generates a graphic representing the feature point extracted in Step S102. Note that the cellular phone device 1 regards the figure representing the feature point generated for the first time as the figure most reflecting the extracted feature point, and the figure representing the feature point to be generated for the second and subsequent generations is one of the figures. A figure with a changed part is generated. The change of a part of the figure representing the feature point is, for example, a change of the presence or absence of light emission, color information of light emission, a blinking cycle, or the like for the outline or the inside or the outside surrounded by the outline. Thereafter, the process proceeds to step S104.

(Step S104) The cellular telephone device 1 displays a graphic image representing the feature point generated in Step S103 on the display unit 12. Thereafter, the process proceeds to step S105.
(Step S <b> 105) The mobile phone device 1 determines whether information indicating that a figure representing a feature point is generated is input again by the operation of the operation unit 13 by the user of the mobile phone device 1.
When the mobile phone device 1 determines again that information indicating that a graphic representing a feature point is generated has been input, the process proceeds to step S103.
On the other hand, when the mobile phone device 1 determines again that information indicating that a graphic representing a feature point is generated has been input, the process proceeds to step S106.

(Step S106) The mobile phone device 1 changes the display portion for displaying the illumination among the graphics representing the feature points generated in step S103, and the size of the graphic to be displayed, by the operation of the operation unit 13 by the user of the mobile phone device 1. It is determined whether or not information indicating that the arrangement is to be changed has been input.
When the mobile phone device 1 determines that information indicating that the display portion is to be changed and the size and arrangement of the graphic to be displayed has been changed is input, the process proceeds to step S107.
On the other hand, when the mobile phone device 1 determines that information indicating that the display portion is to be changed and the size and arrangement of the graphic to be displayed are to be changed is not input, the process proceeds to step S109.

(Step S107) The mobile phone device 1 accepts the change of the display part for displaying the illumination (see FIG. 9) among the figures representing the feature points generated in Step S103, and represents the feature points generated in Step S103. The figure is changed to the figure of the display part that accepted the change. Thereafter, the process proceeds to step S107.

(Step S108) The cellular phone device 1 accepts the change in the size and arrangement of the graphic representing the feature point changed in Step S107, and the graphic representing the changed feature point in Step S107 is the size of the change received. And change to the figure of arrangement. Thereafter, the process proceeds to step S109.

(Step S109) The cellular phone device 1 accepts the setting of the light emission information of the graphic representing the feature point changed in Step S108 or the graphic representing the feature point generated in Step S103. The setting of the light emission information is, for example, the setting of the presence / absence of light emission, the color information of light emission, the blinking cycle, etc. for the outline or the inside or the outside surrounded by the outline. Then, it progresses to step S110.

(Step S110) The cellular phone device 1 displays the figure representing the feature point changed in Step S108 or the figure representing the feature point generated in Step S103 by emitting light with the light emission information received in Step S109. To do. Then, it progresses to step S111.

(Step S111) The cellular phone device 1 accepts information on whether or not to determine light emission information. When the mobile phone 1 receives information indicating that the light emission information is determined, the process proceeds to step S112. On the other hand, when the mobile phone 1 receives information indicating that the light emission information is not determined, the process proceeds to step S109.

(Step S112) The cellular telephone device 1 displays the figure representing the feature point changed in Step S108 or the figure representing the feature point generated in Step S103 with illumination information determined in Step S111. Thus, the light emission pattern of each light emission area | region is produced | generated. Thereafter, the process proceeds to step S113.

(Step S113) The cellular phone device 1 determines whether or not there is an incoming call. When the mobile phone device 1 determines that there is an incoming call, the process proceeds to step S114. On the other hand, when the mobile phone device 1 determines that there is no incoming call, the process proceeds to step 113.
(Step S114) The mobile phone device 1 notifies the incoming call information by turning on and off the light emitting area with the light emission pattern generated in step S112.

<Modification>
In the embodiment described above, the mobile phone 1 broadcasts incoming information. However, the present invention is not limited to this, and when other events occur, the information may be notified. For example, the mobile phone 1 has a schedule management function for storing the time set by the user and a wake-up function for generating a sound at the time set by the user. When the set time is reached, the light area is turned on and off. It may be notified that the set time has been reached.

In this case, the mobile phone 1 stores the time set by the user (hereinafter referred to as the set time), and determines whether or not the set time and the current time match. If the set time matches the current time as a result of the determination, the mobile phone 1 turns on and extinguishes the light emitting area with the generated light emission pattern, and notifies that the set time has been reached.
In this case, the light emission pattern may be changed for each schedule content or set time. Further, the light emission pattern may be a light emission pattern set by the user in advance for each schedule content or set time, or a light emission pattern randomly selected by the mobile phone 1 from a plurality of light emission patterns previously set by the user. There may be.
The operation according to this modification will be described below.

FIG. 10 is a flowchart showing another operation of the mobile phone device according to this embodiment.
When the flowchart according to this modification (FIG. 10) is compared with the flowchart according to the above-described embodiment (FIG. 9), step S200 and step S213 are different. However, since the other operations (steps S101 to S112 and step S114) are the same, the description of the same operations in the flowchart of FIG. 10 and the flowchart of FIG. 9 is omitted.

(Step S200) The user of the mobile phone device 1 sets a set time by registering a schedule and setting a wake-up. The cellular phone device 1 stores the set time. Then, it progresses to step S101.
(Step S213) The cellular phone device 1 determines whether or not the set time and the current time match. When the mobile phone device 1 determines that the set time and the current time match, the process proceeds to step S114. On the other hand, if the cellular phone device 1 determines that the set time does not match the current time, the process proceeds to step 113.

  As described above, according to the present embodiment, the mobile phone device 1 extracts the feature points of the image based on the color information of the input image, and causes the light emitting unit 12 to display the extracted feature points. A light emitting pattern for each light emitting area is generated, each light emitting area is caused to emit light with the generated light emitting pattern, and a graphic representing the extracted feature point is displayed on the light emitting unit 12 to notify information such as an incoming call. As a result, the mobile phone device 1 can reliably and quickly create a light emission pattern that provides a unique illumination display and use it for notification.

  In addition, according to the present embodiment, the cellular phone device 1 extracts the outline of an object in the image as a feature point and displays information such as an incoming call by displaying a graphic representing the extracted feature point. Accordingly, the mobile phone device 1 can input an image of an object having a user-desired contour of the mobile phone device 1 to create a light emission pattern for illumination display of the contour reliably and quickly and use it for notification. it can.

  Further, according to the present embodiment, the mobile phone device 1 extracts temporal changes in color information in the moving image as feature points, and displays information such as incoming calls by displaying a graphic representing the extracted feature points. Inform. Accordingly, the cellular phone device 1 can reliably and quickly create an illumination display light emission pattern in which color information changes with time, and can use it for notification.

  Further, according to the present embodiment, the mobile phone device 1 generates a light emission pattern by combining at least two light emission patterns selected from a plurality of light emission patterns generated in advance in time order. Thereby, the light emission pattern which combined the illumination display desired by the user of a mobile telephone apparatus in time order can be produced reliably and rapidly, and it can use for alerting | reporting.

  In addition, according to the present embodiment, the mobile phone device 1 receives input of a captured image, extracts feature points, and displays information such as an incoming call by displaying a graphic representing the extracted feature points. As a result, the mobile phone device 1 can reliably and quickly create a light emission pattern that provides a unique illumination display from the captured image and use it for notification.

  Further, according to the present embodiment, the mobile phone device 1 has been described. However, the present invention is not limited to this, and mobile phones such as a PHS (Personal Handy-phone System), a satellite phone, a PDA (Personal Digital Assistant), and a smartphone. It may be a communication device. In addition, a portable communication device has a longer time for a person to carry than other devices, and has many opportunities to see not only the owner of the device but also others. Therefore, if a light emitting pattern that provides a unique illumination display can be created reliably and quickly on a mobile communication device and used for notification, a unique illumination display can be shown to many people as compared to other devices. be able to.

  Moreover, in the said embodiment, about the case where the mobile telephone apparatus 1 makes the outline of an object, or the change of color information a feature point, this invention is not limited to this, It is also possible to combine a plurality of feature points as a feature point. Good. For example, information such as an incoming call may be notified by displaying a graphic representing both feature points with the contours of the object and changes in color information as feature points.

In the above embodiment, the case where the cellular phone device 1 extracts the contour of an object or a change in color information as a feature point has been described. However, the present invention is not limited to this, and a light source may be used as a feature point.
For example, the cellular phone device 1 uses a pixel whose luminance, saturation, or luminous intensity exceeds a predetermined value as a light source. In addition, the cellular phone device 1 may add wavelength information measured with a wavelength meter to an image that accepts input, and specify a light source based on the wavelength information. For example, the fluorescent lamp is 253.7 nm, the three-wavelength fluorescent lamp is 450 nm in the blue region, the green region is 540 nm, the red region is 610 nm, and the LED is 450 nm in blue, 520 nm in green, 590 nm in yellow, Since the wavelength of red is 660 nm, the color information of the portion emitting light having a wavelength close to this value out of the wavelengths of the wavelength information may be extracted as the color information of the light source. Further, whether the light is direct light or indirect light may be determined by analyzing the wavelength.

  In the above embodiment, the image data storage unit 140 and the light emission pattern storage unit 145 hold data, and are realized using a magnetic hard disk device or a semiconductor memory. Further, the image data storage unit 140 and the light emission pattern storage unit 145 may be realized by a storage medium removable from the cellular phone device 1 such as a USB (Universal Serial Bus) memory or a memory card. Good. As described above, the image data storage unit 140 and the light emission pattern storage unit 145 may be a storage device or a storage medium external to the control unit 14, or may be external to the mobile phone device 1 and connected. It may be a readable storage device or storage medium.

  Note that a part of the mobile phone device 1 in the above-described embodiment, for example, the image input unit 141, the feature point extraction unit 142, the light emission pattern generation unit 143, and the issue pattern control unit 144 may be realized by a computer. . In that case, the program for realizing the control function may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by a computer system and executed. Here, the “computer system” is a computer system built in the mobile phone device 1 and includes an OS and hardware such as peripheral devices. The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” is a medium that dynamically holds a program for a short time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line, In such a case, a volatile memory inside a computer system serving as a server or a client may be included, and the one holding a program for a certain period of time may be included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  As described above, the embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to the above, and various design changes and the like can be made without departing from the scope of the present invention. It is possible to

1 is a schematic external view showing an external appearance of a mobile phone device according to an embodiment of the present invention. It is another schematic external view which shows the external appearance of the mobile telephone apparatus which concerns on this embodiment. It is a schematic block diagram which shows the structure of the mobile telephone apparatus which concerns on this embodiment. It is a figure which shows an example of the image showing the feature point which concerns on this embodiment. It is a figure which shows an example of the moving image which concerns on this embodiment. It is a figure which shows an example of the image showing the feature point of the moving image which concerns on this embodiment. It is a figure which shows an example of the figure showing the feature point of the moving image which concerns on this embodiment. It is explanatory drawing explaining the change process of the display part which concerns on this embodiment. It is a flowchart which shows operation | movement of the mobile telephone apparatus which concerns on this embodiment. It is a flowchart which shows another operation | movement of the mobile telephone apparatus which concerns on this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Mobile telephone apparatus, 10 ... Communication part, 11 ... Imaging part, 12 ... Display part, 13 ... Operation part, 14 ... Control part 140 ... Image data storage part , 141... Image input unit, 142... Feature point extraction unit, 143... Light emission pattern generation unit, 144.

Claims (8)

In a portable communication device including a light emitting unit having a plurality of light emitting regions for turning on and off light,
An image input unit for receiving image input;
A feature point extraction unit that extracts feature points of the image based on the color information of the image received by the image input unit;
A light emission pattern generation unit that generates a light emission pattern of each of the light emission regions so that a graphic representing the feature point extracted by the feature point extraction unit is displayed on the light emission unit;
A light emission pattern control unit that causes each of the light emission regions to emit light with a light emission pattern generated by the light emission pattern generation unit and to display a figure representing the feature point;
A portable communication device comprising: The mobile communication device according to claim 1, wherein the feature point extraction unit extracts an outline of an object in the image as the feature point based on a positional change of color information in the image. The image is a video that changes over time,
The mobile communication device according to claim 1, wherein the feature point extraction unit extracts a temporal change of color information in the moving image as the feature point. The said light emission pattern production | generation part produces | generates the said light emission pattern by combining the at least 2 said light emission pattern selected from the produced | generated several said light emission pattern in time order. The portable communication device according to item 1. An imaging unit for generating a captured image;
The mobile communication device according to any one of claims 1 to 4, wherein the image input unit receives an input of an image generated by the imaging unit. The mobile communication device according to any one of claims 1 to 4, wherein the image input unit receives an input of an image obtained by communication. In a display control method in a portable communication device including a light emitting unit composed of a plurality of light emitting regions for turning on and off light,
A first process in which the mobile communication device receives an input of an image;
A second step of extracting feature points of the image based on the color information of the image received in the first step;
A third step of generating a light emission pattern of each of the light emitting regions so that the portable communication device displays a graphic representing the feature point extracted in the second step on the light emitting unit;
A fourth process in which the mobile communication device causes each of the light emitting areas to emit light with the light emission pattern generated in the third process and to display a figure representing the feature point;
A display control method comprising: In a computer of a portable communication device provided with a light emitting unit composed of a plurality of light emitting regions for turning on and off light,
Image input means for receiving image input;
Feature point extraction means for extracting feature points of the image based on the color information of the image received by the image input means;
A light emission pattern generating means for generating a light emission pattern for each of the light emitting areas so as to display on the light emitting section a figure representing the feature point extracted by the feature point extracting means;
Light emission pattern control means for causing each of the light emitting areas to emit light with the light emission pattern generated by the light emission pattern generation means and to display a figure representing the feature point;
Display control program to function as.

Images