JP5253560B2 - Mobile phone - Google Patents

Description

  The present invention relates to a mobile phone in which an image display surface of an image display device is provided on the front surface of a portable casing, and an image pickup device is provided on the back surface of the casing. It relates to a mobile phone that can be used.

Conventionally, a mobile phone can display various images such as an image downloaded from the Internet or an image taken by a camera on a display when waiting for an incoming call. Along with the development of communication technology, a display provided in a mobile phone has been enlarged, and a standby image constitutes a design of the entire phone together with a casing. Therefore, various mobile phones that can automatically change a standby image without performing a user operation have been proposed (see, for example, Patent Documents 1 and 2). Patent Document 1 discloses a technique for changing a standby image according to a user photographed by a camera provided in a mobile phone or an image around the user.

  In addition, in a conventional mobile phone, when an incoming call is received, notification by sound such as a melody and / or notification by vibration of a vibrator is performed, and notification by an incoming call display on a display is performed. At this time, the above-mentioned standby image or the incoming image set by the user is displayed as the incoming display image.

JP 2005-151271 A JP 2007-318208 A

  However, in a conventional mobile phone, when an incoming call is received while placed on a desk or floor, if the image displayed on the display is fused with the color or pattern of the desk or floor, May be difficult to find and may not be able to respond promptly. In particular, it is difficult to find when the “manner mode” is set in which a notification is made by a vibrator without making a sound notification when an incoming call is received.

  Accordingly, an object of the present invention is to provide a mobile phone that can be easily found at the time of an incoming call when placed on a desk or floor.

In the mobile phone according to the present invention, the image display surface of the image display device is provided on the front surface of the portable casing, and the imaging device is provided on the back surface of the casing. And the mobile phone
A state detecting means for detecting that the casing is approaching the object and detecting that the casing is placed on the object;
Photographing control means for operating the imaging device at least once from when it is detected that the casing is approaching the object until it is detected that the casing is placed on the object;
For the image signal obtained from the imaging device, the color of a part or all of the pixels constituting the image signal is arranged in the hue ring on the opposite side according to one or a plurality of predetermined conversion rules. Color conversion processing means for performing color conversion processing for converting to a color located on the opposite side;
Image signal storage means for storing one or more color conversion image signals obtained from the color conversion processing means;
When there is an incoming call after it is detected that the casing is placed on an object, one or more color conversion image signals stored in the image signal storage means are converted into one image of the color conversion image signal. An incoming image display processing means for outputting to the display device and displaying the color conversion image on the image display surface of the image display device is provided.

  In the mobile phone according to the present invention, when it is placed on an object such as a desk or a floor, it is detected that the casing is placed on the object after it is detected that the casing is approaching the object. The imaging operation is executed at least once by the imaging device. Here, since the mobile phone is usually placed on an object such as a desk or a floor with the casing front surface on which the image display surface of the image display device is disposed facing upward, depending on the imaging device disposed on the back surface of the casing The surface of an object such as a desk or floor is photographed.

The image signal obtained from the imaging device by the above-described photographing operation is subjected to color conversion processing by the color conversion processing means according to one or a plurality of predetermined conversion rules. In the color conversion process, the color of some or all of the pixels constituting the image signal is converted into a complementary color located on the opposite side or a color located on the substantially opposite side in the hue circle. As a result, the color of each or all of the pixels of the image captured by the imaging device is converted into a contrasting color having a strong contrast (a large color difference) in relation to each color. One or a plurality of color-converted image signals obtained by the color conversion process are stored in the image signal storage means.

Then, when it is detected that the casing has been placed on the object, and there is an incoming call (when receiving a telephone communication or receiving an e-mail), one or more colors stored in the image signal storage means Among the converted image signals, one color converted image signal is output to the image display device, and the color converted image is displayed on the image display surface. At this time, the color-converted image has a color that is in contrast to the image captured by the imaging device as described above, so that the color-converted image is conspicuous on an object such as a desk or a floor. Therefore, the user can easily find the telephone body and can respond promptly.

  For example, when placed on a black desk, a black captured image is obtained, and the image is converted into a white image by color conversion processing. It will be displayed on the image display surface.

  Specifically, the incoming image display processing unit repeats the operation of displaying the color conversion image on the image display surface of the image display device until a user operation is performed after an incoming call.

  In the above specific configuration, even if the incoming call is not noticed at the time of the incoming call, the color conversion image is repeatedly displayed on the image display surface thereafter, so that the incoming call can be surely known.

  More specifically, the imaging control means repeatedly operates the imaging device from when it is detected that the casing is approaching the object until it is detected that the casing is placed on the object, The color conversion processing means performs color conversion processing on the image signal obtained by the last photographing operation. This makes it possible to obtain a color-converted image of an image taken immediately before the casing is placed on the object.

Specifically,
When it is detected that the casing is placed on the object, the image signal obtained from the imaging device is output to the image display device, and the captured image is displayed on the image display surface of the image display device. Display processing means are provided.

  In the above-described specific configuration, when it is detected that the casing is placed on an object such as a desk or floor, images captured by the imaging device up to that time are displayed on the image display surface. . Here, since the photographed image represents the surface of an object such as a desk or floor as described above, it is fused with the color or pattern of the surface of the object such as a desk or floor.

  For example, when placed on a black desk as described above, a captured image that is entirely black is displayed on the image display surface.

More specifically, the incoming image display processing means includes:
A selection means for selecting an image corresponding to a telephone number or an address of a transmission source from a plurality of types of images including one or a plurality of color conversion images and the original photographed image;
Display processing means for displaying the image selected by the selection means on the image display surface of the image display device.

  In the specific configuration, when an incoming call is received, an image corresponding to the telephone number or address of the transmission source is displayed on the image display surface of the image display device. For example, when the transmission source telephone number is registered, the above color conversion image is displayed on the image display surface, and when the transmission source telephone number is not notified, the above original photographed image is an image. Displayed on the display surface.

  More specifically, the state detection means includes an acceleration sensor that detects the acceleration of the casing, and a proximity sensor that is disposed on the back surface of the casing and detects the distance from the object, and the output value of the acceleration sensor. That the casing is approaching the object based on the output value of the proximity sensor and the casing is placed on the object based on the output value of the acceleration sensor and the output value of the proximity sensor Is detected.

  In the specific configuration, the common acceleration sensor and proximity sensor can detect that the casing is approaching the object and that the casing is placed on the object.

  According to the mobile phone of the present invention, when placed on an object such as a desk or floor, a color-converted image having a color contrasted with an image obtained by photographing the surface of the object such as a desk or floor is received when an incoming call is received. Since it is displayed on the display surface, the user can easily find it.

It is a perspective view showing the front surface of the mobile phone according to the present invention. It is a perspective view showing the back surface of the said mobile phone. It is a block diagram showing the electric constitution of the said mobile phone. It is a flowchart showing the procedure performed in the state in which the power supply to the said mobile telephone was turned on. It is a flowchart showing the procedure performed when the said mobile telephone is set | placed on the object. It is a flowchart showing the procedure performed after the said mobile telephone is set | placed on the object. It is a flowchart showing the procedure after an incoming call. It is a flowchart showing the rewriting procedure of an incoming call display necessity flag. It is a perspective view for demonstrating operation | movement when the said mobile telephone is set | placed on a desk. It is a chart showing an example of the display pattern at the time of an incoming call. It is a chart showing the other example of the display pattern at the time of an incoming call. It is a chart showing the other example of the display pattern at the time of an incoming call.

  Hereinafter, embodiments of the present invention will be specifically described with reference to the drawings.

  The mobile phone according to the present invention includes a flat casing (1) as shown in FIG. 1, and a front part of the casing (1) is provided with a receiver (2) with a built-in speaker at the upper end. At the lower end, a transmitter (3) with a built-in microphone is provided. A plurality (three in the illustrated example) of operation keys (4), (4) and (4) are provided on the front surface of the casing (1), and an image display surface of the display (5) is provided. Yes. An antenna (not shown) is built in the lower part of the casing (1).

  In addition to the operation keys (4), (4), and (4), the cellular phone includes a touch panel input device (6), and the touch panel input device (6) is a transparent touch. The operation surface is pasted on the image display surface of the display (5). When a plurality of touch input keys including a numeric keypad are displayed on the image display surface of the display (5) and the user performs a touch operation on any touch input key, information processing corresponding to the touch input key is executed. Is done.

  On the other hand, on the back surface of the casing (1), as shown in FIG. 2, a camera (7) is provided at the upper end, and a proximity sensor (8) for detecting a distance from the object is provided. The proximity sensor (8) includes a light emitting unit (81) that outputs infrared rays, and a light receiving unit (82) that receives infrared rays output from the light emitting unit (81) and reflected by an object. A value corresponding to the amount is output.

  FIG. 3 shows an electrical configuration of the mobile phone. The signal received by the antenna (9) is supplied to the modulation / demodulation circuit (11) through the transmission / reception circuit (10), and the received signal is demodulated. The received signal is supplied to the speaker (13) through the control circuit (12) and emitted. The transmission signal input from the microphone (14) is supplied to the modulation / demodulation circuit (11) through the control circuit (12) and modulated. The modulated transmission signal is transmitted from the antenna (9) through the transmission / reception circuit (10).

The control circuit (12) includes the above-described display (5), touch panel input device (6), operation keys (
4) and a camera (7) are connected, and a memory (15) for storing various information including image data is connected.

  The control circuit (12) is connected to the proximity sensor (8) described above and an acceleration sensor (16) for detecting the acceleration of the telephone body.

The mobile phone according to the present invention is usually placed on the desk (20) with the front surface of the casing on which the image display surface of the display (5) is provided facing upward as shown in FIG. At this time, from the time when the casing (1) approaches the desk (20) to a certain distance, image capturing by the camera provided on the back surface of the casing (1) is repeated. Thereafter, when the casing (1) is placed on the desk (20), the image capturing by the camera is stopped, the image data obtained by the last image capturing is output to the display (5), and the captured image is awaited. The image is displayed on the image display surface. At this time, the captured image was taken immediately before the casing (1) was placed on the desk (20).
Since the image represents the surface of (20), the entire telephone is fused with the color and pattern of the surface of the desk (20).

  At this time, the image data obtained by the last image shooting as described above is subjected to a complementary color conversion process for converting the color of each pixel into a complementary color located on the opposite side in the hue circle. The complementary color converted image data is stored in the memory. The complementary color conversion process will be described later.

  Thereafter, when there is an incoming call, notification by sound and / or vibration is performed as in the prior art, and the complementary color conversion image data is output to the display (5), and the complementary color conversion image is displayed on the image display surface. Will be. At this time, the complementary color conversion image is obtained by converting the color of each pixel of the image taken immediately before the casing (1) is placed on the desk (20) into a complementary color having the strongest contrast in relation to each color. As a result, the entire phone will appear prominently on the desk (20), and the user can easily find the phone body.

  For example, when placed on a black desk, a black photographed image is obtained, and the image is converted into a white image by complementary color conversion processing. It is displayed on the image display surface of the display (5).

  If the incoming call is not noticed and the off-hook operation is not performed when the incoming call is received as described above, the complementary color conversion image is repeatedly displayed at a predetermined cycle (5) until an operation for confirming the incoming call is performed. ) Will be displayed.

  FIG. 4 shows a procedure executed by the control circuit 12 when the telephone body is powered on. The proximity sensor and the acceleration sensor are activated when power is supplied to the telephone body.

  First, in step S1, whether the casing is approaching the object by determining whether the output value of the proximity sensor exceeds a predetermined threshold Th and whether the output value of the acceleration sensor is a value other than zero. If the answer is no, the procedure is terminated. Here, the threshold value Th is set to a value of about 90% of the output value of the proximity sensor when the mobile phone is placed with the back surface of the casing facing down, for example. It is also possible to provide a predetermined threshold value other than zero for the output value of the acceleration sensor, and determine whether or not the magnitude of the output value of the acceleration sensor exceeds the threshold value. According to this configuration, it is possible to prevent erroneous determination that the telephone body is approaching even though the telephone body is stationary.

  In the process of placing the casing on the object, when approaching a certain distance to the object, it is determined as YES in step S1, the process proceeds to step S2, and the image is taken by the camera. The image data obtained by the image shooting by is stored in the memory. Subsequently, in step S4, whether or not the casing is placed on the object by determining whether or not the output value of the proximity sensor exceeds the predetermined threshold value Th and the output value of the acceleration sensor is zero. If NO is determined, the process proceeds to step S5, and it is determined whether or not a predetermined time has elapsed since YES is determined in step S1. Here, when it is determined NO, the process returns to step S2 and image capturing is executed again. Image capture is repeated by repeating the processes in steps S2 to S5 described above.

After that, when the casing is placed on the object with the rear face of the casing where the proximity sensor is disposed facing down, it is determined as YES in step S4 and the process proceeds to step S6, and the image data obtained by the last image shooting Is read from the memory and output to the display. As a result, the last photographed image is displayed on the image display surface of the display.

  If the casing is not placed on the object within a predetermined time after being determined as YES in step S1, it is determined as YES in step S5 and the procedure is terminated.

  According to the above procedure, image capturing by the camera is repeated from the time when the casing approaches a certain distance to the object, and when the casing is placed on the object thereafter, the last captured image is displayed as a standby image on the display. Will be displayed on the screen.

  FIG. 5 represents the procedure executed by the control circuit 12 when the casing is placed on the object. If the casing is placed on the object and it is determined YES in step S4 of FIG. 4, in step S11 of FIG. 5, the image data for one frame obtained by the last image shooting is read from the memory and read. A complementary color conversion process described later is performed on the image data.

  When the luminances of R data, G data, and B data of the three primary colors constituting the image data of one pixel are represented by 2 digits in hexadecimal numbers, for example, red image data is “FF0000” (R data = FF, G Data = 00, B data = 00). Complementary color refers to a color that is mixed to become white, and white image data is represented by “FFFFFF”. Therefore, in complementary color conversion processing, by subtracting the value of each color data from “FF”, complementary color is obtained. Image data after conversion can be obtained. For example, red image data “FF0000” is converted into light blue image data “00FFFF”, and blue image data “0000FF” is converted into yellow image data “FFFF00”. The complementary color conversion process may be performed in units of one pixel or in units of blocks.

  After the complementary color conversion process is executed as described above, in step S12, the complementary color converted image data obtained in step S11 is stored in the memory, and the procedure ends.

  When the casing is placed on the object, complementary color-converted image data is created from the image data obtained by the immediately preceding image photographing by the above procedure and stored in the memory.

  FIG. 6 represents the procedure executed by the control circuit 12 after the casing is placed on the object. The memory (15) stores an incoming call display necessity flag indicating whether or not the incoming call display needs to be repeated.

When the casing is placed on the object, first, in step S21, it is determined whether or not there is an incoming call. If it is determined to be no, the procedure is terminated, whereas if it is determined to be YES, the process proceeds to step S22. Incoming call processing is performed. In the incoming call processing, as in the prior art, notification by sound such as a melody and / or vibration of the vibrator is performed according to the incoming call setting information set by the user, and according to the telephone number of the transmission source, for example, FIG. The incoming call is displayed with the pattern shown in. When the telephone number of the transmission source is registered in the phone book table in the memory, the complementary color conversion image data stored in the memory is output to the display, and the complementary color conversion image is displayed on the image display surface of the display. . If the telephone number of the transmission source is registered in the telephone directory table and is the telephone number specified by the user, the incoming call display according to the incoming call display pattern set by the user is performed. When the sender telephone number is not registered in the phone book table, when there is no sender telephone number, and when the sender telephone number cannot be notified, a preset default value “1”, An incoming call display corresponding to the default value “2” and the default value “3” is performed. Further, when the notification is not made, the above-described photographed image is continuously displayed. In any case, as in the prior art, the telephone number of the sender, the name of the sender, etc. are displayed on the image display surface, and the backlight is turned on.

  Subsequently, in step S23 of FIG. 6, it is determined whether or not an off-hook operation has been performed. If the user notices an incoming call and performs the off-hook operation, the process proceeds to step S24, and an incoming call display necessity flag is set. If the value is set to “0” indicating that it is not necessary to repeat the display and the procedure is terminated, if the user does not notice the incoming call and the off-hook operation is not performed, the process proceeds to step S25. The incoming call display necessity flag is set to a value of “1” indicating that the incoming call display needs to be repeated, and the procedure is terminated.

  According to the above procedure, when an incoming call is received, notification by sound such as a melody and / or vibration of the vibrator is performed according to the incoming call setting information set by the user as in the conventional case, and the telephone number of the transmission source is set. A corresponding incoming call display is performed. At this time, if the telephone number of the transmission source is registered in the phone book table, a complementary color conversion image obtained by performing complementary color conversion on the image taken immediately before the casing is placed is displayed on the image display surface of the display. The

  FIG. 7 shows the procedure executed by the control circuit 12 after receiving an incoming call. First, in step S31, it is determined whether or not the value of the incoming call display necessity flag is “1”. Here, when an incoming call is noticed and an off-hook operation is performed, the incoming call display necessity flag has a value of “0” as described above. If no off-hook operation has been performed, the incoming call display necessity flag has a value of “1”, so that it is determined yes and the process proceeds to step S32 to display the above incoming call. Next, in step S33, it is determined whether or not a predetermined time has elapsed since the incoming call display, and if it is determined no, the same determination is repeated in step S33. After that, when a predetermined time has passed and it is determined as YES in step S33, the process returns to step S31, and the value of the incoming call necessity flag is determined again.

  By repeating the processes of steps S31 to S33 described above, the incoming call display is repeated at the predetermined time period, and then the user confirms the incoming call and the value of the incoming call necessity flag is set to “0”. When it is rewritten to "", it is determined NO in step S31, and the procedure is terminated.

  According to the above procedure, when the off-hook operation is not performed at the time of incoming call, the incoming call display is repeated at the predetermined time period until the user confirms the incoming call.

  FIG. 8 shows the rewriting procedure of the incoming call display necessity flag executed by the control circuit (12). In step S41, it is determined whether or not an operation for confirming the incoming call has been performed by the user. If YES, the procedure ends. If YES, the process proceeds to step S42, the incoming call display necessity flag is rewritten to a value of “0”, and the procedure ends.

  According to the above procedure, when the user performs an operation of confirming the incoming call, the incoming call display necessity flag is rewritten, whereby the incoming call display procedure shown in FIG. 7 after the incoming call is completed.

  As described above, in the mobile phone according to the present invention, for example, the surface of the desk is photographed immediately before being placed on the desk, and the photographed image is displayed on the image display surface of the display (5) as a standby image. The entire telephone will be fused with the color and pattern of the desk surface, preventing the surrounding people from being distracted.

In addition, when an incoming call is received, a complementary color conversion image having a color contrasted with the captured image is displayed on the display (
Since it is displayed on the image display surface of 5), the entire telephone will be conspicuous on the desk, and the user can easily find it.

  Further, even if the user does not notice the incoming call when the incoming call is received, the incoming call display is repeated until the user performs an operation for confirming the incoming call, so that the incoming call can be surely known.

  In addition, each part structure of this invention is not restricted to the said embodiment, A various deformation | transformation is possible within the technical scope as described in a claim.

  For example, in the above-described embodiment, in the color conversion process, the colors of all the pixels constituting the image data for one frame obtained by image capturing by the camera are converted into complementary colors. It is also possible to convert colors to complementary colors. For example, it is possible to convert the color of only the most colored pixels among the pixels constituting the image data for one frame into a complementary color.

  In the color conversion process, the color of each pixel is converted to a complementary color by subtracting the value of each color data of R data, G data, and B data from “FF”. Not limited to this, it is possible to adopt various conversion rules for converting to colors located on the substantially opposite side in the hue circle.

Further, in the above embodiment, image capturing by the camera (7) is repeated from when it is detected that the casing (1) is approaching the object until it is detected that the casing (1) is placed on the object. The last photographed image is displayed on the display (5) as a standby image, and the color-converted image of the image is displayed on the display (5) when an incoming call is received, but not limited to the last photographed image, Any image obtained by shooting is displayed as a standby image (
5), and any color-converted image may be displayed on the display (5).

  It is also possible to adopt a configuration in which an image is taken by the camera (7) only when it is detected that the casing (1) is approaching the object. In such a configuration, the threshold value of the proximity sensor used when detecting that the casing (1) is approaching is, for example, a value corresponding to the distance from the object to the position where the lens of the camera (7) is in focus. Is set.

  When a predetermined user operation is performed, an image is taken by the camera (7), and an image obtained by the image photographing is displayed as a standby image on the display (5). It is also possible to display an image on the display (5).

  Also, from the time when the telephone body is turned on or when a predetermined user operation is performed, it is detected that the casing (1) is placed on the object by repeatedly taking images with the camera (7). Sometimes, it is possible to display any image taken before that as a standby image on the display (5) and to display a color-converted image of the image on the display (5) when an incoming call is received.

Further, it is possible to set and cancel an image display mode in which a captured image is displayed on the display (5) as a standby image and a complementary color conversion image of the captured image is displayed on the display (5) when an incoming call is received. It is also possible to adopt a configuration in which the procedure shown in FIG. 4 is repeatedly executed when a predetermined mode setting operation for setting the display mode is performed. In this configuration, the proximity sensor (8) and the acceleration sensor (16) are activated when the predetermined mode setting operation is performed, and are maintained in the ON state when the image display mode is set. The

  In the above embodiment, the casing (1) is approaching the object and the casing (1) is placed on the object by the common proximity sensor (8) and the acceleration sensor (16). Although it is detected, it is also possible to separately provide a proximity sensor and an acceleration sensor for detection.

  Furthermore, when an incoming call is received, not only the pattern shown in FIG. 10 but also the incoming call display can be performed with the pattern shown in FIG. 11 or FIG. Note that “photographed image” in the figure represents an image photographed before it is detected that the casing is placed on the object.

  It is also possible to create a plurality of types of color conversion images from a single photographed image using a plurality of conversion rules of two or more for color conversion processing. In the example shown in FIG. Color conversion image is created and the source phone number is registered in the phone book table, the color conversion image with low brightness is displayed on the display, while the source phone number is displayed in the phone book table. If it is registered and is a specific telephone number, a color conversion image with high brightness is displayed on the display.

(1) Casing
(5) Display
(7) Camera
(8) Proximity sensor
(15) Memory
(16) Acceleration sensor

Claims (2)

In the mobile phone in which the image display surface of the image display device is arranged on the front surface of the portable casing, while the imaging device is arranged on the back surface of the casing,
A state detecting means for detecting that the casing is approaching the object and detecting that the casing is placed on the object;
Photographing control means for operating the imaging device at least once from when it is detected that the casing is approaching the object until it is detected that the casing is placed on the object;
Color conversion processing means for performing color conversion processing on an image signal obtained from the imaging device according to one or a plurality of predetermined conversion rules;
Image signal storage means for storing one or more color conversion image signals obtained from the color conversion processing means;
If there is an incoming call when the casing is placed on the object, one color-converted image signal out of one or a plurality of color-converted image signals stored in the image signal storage means is sent to the image display device. A mobile phone comprising an incoming image display processing means for outputting and displaying a color conversion image on an image display surface of the image display device.   2. The mobile phone according to claim 1, wherein the incoming image display processing unit repeats an operation of displaying the color conversion image on an image display surface of an image display device until a user operation is performed after an incoming call is received.