JP2013196140A - Portable terminal and display control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal capable of increasing and decreasing the size of display information in such a manner as to be convenient for a user.SOLUTION: A size detection unit 13 detects the size of the contour of user's face from an image of the user's face obtained by a camera 11. A comparison unit 15 compares the size of the contour of the user's face detected by the size detection unit 13 with a reference value. When the size of the contour of the user's face detected by the size detection unit 13 is larger than a reference value, a display control unit 161 decreases the size of display information to be displayed on a touch-panel display 17 and displays the information. When the size of the contour of the user's face detected by the size detection unit 13 is smaller than the reference value, the display control unit 161 increases the size of the display information to be displayed on the touch-panel display 17 and displays the information.

Description

  The present invention relates to a mobile terminal including a display unit and a display control method for display information displayed on the display unit.

  2. Description of the Related Art Conventionally, there are portable terminals that include a display unit that displays display information such as images and characters. In such a portable terminal, the convenience of the user viewing the display information is improved by enlarging or reducing the display information such as images and characters displayed on the display unit by operating a button provided on the portable terminal. Things have been done. In addition, there is a portable terminal using a touch panel display as a display unit. In such a portable terminal, the display information displayed on the touch panel display can be enlarged or reduced by double tapping the touch panel display with a finger or performing a gesture operation called pinching. For example, Patent Document 1 describes that display information is enlarged or reduced based on a pressed area when a touch panel display is pressed.

JP 2011-123575 A

  However, when the display information displayed on the display unit is enlarged or reduced, it is necessary for the user to operate a button or a touch panel display. However, the display information should be enlarged or reduced more conveniently. Is required.

  SUMMARY An advantage of some aspects of the invention is that it provides a portable terminal and a display control method capable of enlarging or reducing display information with convenience for a user.

  A portable terminal according to the present invention is a portable terminal including a display unit, and a distance measurement unit that measures a distance from the user's face, and a display that is displayed on the display unit based on a measurement result by the distance measurement unit. Display control means for enlarging or reducing information.

  The display control method according to the present invention is a display control method executed in a mobile terminal including a display unit, and includes a distance measurement step for measuring a distance from the user's face, and a measurement result in the distance measurement step. And a display control step for enlarging or reducing the display information displayed on the display unit.

  In these inventions, the display information displayed on the display unit is enlarged or reduced based on the distance between the mobile terminal and the user's face. As described above, when the display information is enlarged or reduced, it is not necessary for the user to perform an enlargement or reduction operation with a finger. Therefore, the display information can be enlarged or reduced by an intuitive operation (making the mobile terminal closer to the face). Or an operation of moving away).

  The distance measuring unit includes a camera that captures the user's face, and a distance calculating unit that obtains a distance from the user's face based on the size of the contour of the user's face captured by the camera Preferably, the control means enlarges or reduces the display information displayed on the display unit based on the distance from the user's face obtained by the distance calculation means. In this case, the distance between the mobile terminal and the user's face can be obtained based on the contour of the user's face captured by the camera provided in the mobile terminal. Therefore, it is not necessary to mount a special device for measuring the distance between the mobile terminal and the user's face, and the configuration can be simplified.

  The distance measuring unit includes an infrared device that irradiates infrared rays toward the user's face, and a distance calculation unit that obtains a distance from the user's face based on an infrared irradiation result by the infrared device, and a display control unit Preferably, the display information displayed on the display unit is enlarged or reduced based on the distance from the user's face obtained by the distance calculation means. In this case, the distance between the portable terminal and the user's face can be easily measured using an infrared device provided in the portable terminal.

  The display unit is preferably a touch panel display. In this case, since it is not necessary for the user to operate the touch panel display with a finger in order to enlarge or reduce the display information, the visibility of the display information is reduced by covering the touch panel display with a hand. There is nothing. Further, when the display information is enlarged or reduced by operating the touch panel display with a finger, it is necessary to support the mobile terminal with one hand and operate the touch panel display with the finger of the other hand. In the present invention, it is not necessary to use both hands when enlarging or reducing the display of the touch panel display. As described above, even a portable terminal including a touch panel display can enlarge or reduce the display information with good convenience for the user.

  According to the present invention, display information can be enlarged or reduced with good convenience for the user.

It is a figure which shows the whole structure of the portable terminal which concerns on 1st Embodiment. It is a figure which shows the positional relationship of a user's face and a portable terminal, (a) is a figure which shows the positional relationship of a user's face and a portable terminal, (b) is a figure which shows the change of the size of the outline of a user's face. It is a figure which shows the example of display information, (a) is the example which reduced and displayed, (b) is the figure which shows the example which expanded and displayed. It is a flowchart which shows the flow of the process which determines the size of the user's face outline as a reference value. It is a flowchart which shows the flow of a process which expands or reduces display information. It is a figure which shows the whole structure of the portable terminal which concerns on 2nd Embodiment. It is a flowchart which shows the flow of the process which determines the distance with a user's face as a reference value. It is a flowchart which shows the flow of a process which expands or reduces display information.

  An embodiment to which a portable terminal and a display control method according to the present invention are applied will be described with reference to the accompanying drawings.

(First embodiment)
First, the first embodiment will be described. As shown in FIG. 1, the mobile terminal 1 includes a camera (distance measuring unit) 11, a camera control unit 12, a size detection unit (distance calculation unit) 13, a reference value determination unit 14, a comparison unit 15, a program execution unit 16, A touch panel display (display unit) 17 and a reference value storage unit 18 are included. Note that the mobile terminal 1 has a function of performing a call, transmission / reception of mail, and the like, although detailed illustration of the functional unit is omitted. Hereinafter, the control for enlarging or reducing the display information displayed on the touch panel display 17 will be described in detail.

  The camera 11 is provided on the front surface of the mobile terminal 1 (the surface facing the user who uses the mobile terminal 1) and can capture the face of the user. As the camera 11, a front camera mounted on the mobile terminal 1 can be used.

  The camera control unit 12 controls the camera 11. The camera control unit 12 images the face of the user using the camera 11 based on an instruction from the reference value determination unit 14 or the program execution unit 16.

  The size detection unit 13 detects the size of the contour of the user's face from the image captured by the camera 11. Various existing image processing methods and the like can be used as a method for detecting the contour of the face.

  The reference value determination unit 14 determines the size of the contour of the user's face detected by the size detection unit 13 as a reference value and stores it in the reference value storage unit 18. Specifically, the reference value determination unit 14 uses, as a reference value, the size of the user's face contour detected by the size detection unit 13 in the reference value determination mode for determining the reference value of the user's contour size. When an instruction to determine is received from the user, the size of the face outline is determined as a reference value. This instruction from the user is accepted through the touch panel display 17, for example.

  Here, the reference value determination mode is a mode that is executed in advance before the display information displayed on the touch panel display 17 is enlarged or reduced. Using the reference value determined in the reference value determination mode, the display information is enlarged or reduced when the screen automatic zoom mode for enlarging or reducing the display information is executed. This screen automatic zoom mode is executed, for example, when browsing mail or browsing Internet information, and performs enlargement or reduction of mail text and enlargement or reduction of Internet information.

  The comparison unit 15 includes the size of the contour of the user's face detected by the size detection unit 13 during execution of the screen automatic zoom mode, the reference value determined in the reference value setting mode and stored in the reference value storage unit 18, Are compared to determine whether the size of the contour of the user's face detected by the size detection unit 13 is larger than the reference value.

  Here, in the image captured by the camera 11, the closer the camera 11 of the mobile terminal 1 is to the user's face, the larger the user's face appears. For example, as shown in FIG. 2A, when the mobile terminal 1 is at a position P1 that is closer to the face of the user A than the position P2, the captured image W of the camera 11 is as shown in FIG. The size of the face outline Y1 when the mobile terminal 1 is at the position P1 is larger than the face outline Y2 when the mobile terminal 1 is at the position P1. Accordingly, by comparing the reference value with the size of the contour of the user's face detected by the size detection unit 13, it is determined whether the distance between the mobile terminal 1 and the user's face is close or separated. Can do.

  The program execution unit 16 executes a mail browsing function, an Internet information browsing function, and the like, and generates display information to be displayed on the touch panel display 17. The program execution unit 16 includes a display control unit (display control unit) 161. The display control unit 161 controls enlargement or reduction of display information displayed on the touch panel display 17. In addition, the display control unit 161 activates the screen automatic zoom mode when the display information is enlarged or reduced. This screen automatic zoom mode may be automatically activated by the display control unit 161 or may be activated by an instruction from the user.

  When the screen automatic zoom mode is activated, the user's face is imaged by the camera 11, and the size of the user's face outline is detected by the size detection unit 13. The comparison unit 15 compares the size of the contour of the user's face detected by the size detection unit 13 with the reference value stored in the reference value storage unit 18.

  When the comparison control unit 15 determines that the size of the contour of the user's face detected by the size detection unit 13 is larger than the reference value, the display control unit 161 (that is, the distance between the mobile terminal 1 and the user's face) Display information displayed on the touch panel display 17 is reduced and displayed as shown in FIG. On the other hand, when the display control unit 161 determines that the size of the contour of the user's face detected by the size detection unit 13 is smaller than the reference value by the comparison unit 15 (that is, the mobile terminal 1 and the user's face) Display information displayed on the touch panel display 17 is enlarged and displayed as shown in FIG. 3B.

  The touch panel display 17 displays display information that is controlled to be enlarged or reduced by the display control unit 161. The touch panel display 17 can detect a user's touch operation. Based on the detection result of the touch operation by the touch panel display 17, the program execution unit 16 performs various processes such as mail browsing.

  The reference value storage unit 18 stores the reference value of the size of the user's face outline determined by the reference value determination unit 14 for each user. Specifically, the reference value storage unit 18 stores the user name (user ID) in association with the reference value of the face outline size.

[Flow of processing in standard value determination mode]
Next, the flow of processing for determining the size of the user's face outline as the reference value in the reference value determination mode will be described. The reference value determination mode is performed based on a predetermined timing or an instruction from the user, for example, when the mobile terminal 1 is activated. First, the reference value determination unit 14 instructs the camera control unit 12 to capture the user's face. Thereby, as shown in FIG. 4, the camera control unit 12 controls the camera 11, whereby the user's face is captured by the camera 11 (step S <b> 101).

  Next, the size detection unit 13 detects the size of the contour of the user's face from the image captured by the camera 11 (step S102). Next, the reference value determining unit 14 receives an instruction from the user as to whether or not to determine the detected size of the face contour of the user as the reference value (step S103). When receiving an instruction to determine the reference value from the user (step S103: YES), the reference value determining unit 14 determines the detected size of the user's face contour as the reference value, and the reference value storage unit 18.

  On the other hand, when receiving an instruction from the user that the reference value is not determined (step S103: NO), the reference value determination unit 14 instructs the camera control unit 12 to capture the user's face again, and the camera 11, the user's face is imaged (step S101). In this way, the above-described processing is repeated until the detected size of the user's face outline is determined as the reference value.

[Flow of processing in automatic screen zoom mode]
Next, a flow of processing for enlarging or reducing display information in the screen automatic zoom mode will be described. When the automatic screen zoom mode is activated, the display control unit 161 instructs the camera control unit 12 to capture the user's face. As a result, as shown in FIG. 5, the camera control unit 12 controls the camera 11, whereby the user's face is captured by the camera 11 (step S201).

  Next, the size detection unit 13 detects the size of the contour of the user's face from the image captured by the camera 11 (step S202). Next, the comparison unit 15 determines whether or not the size of the contour of the user's face detected by the size detection unit 13 is larger than the reference value stored in the reference value storage unit 18 (Step S203: Distance). Detection step). In addition, before the comparison part 15 acquires a reference value from the reference value storage part 18, the user name using the portable terminal 1 shall be input into the comparison part 15 beforehand, and the reference | standard corresponding to this user name The comparison unit 15 acquires the value from the reference value storage unit 18.

  When the detected size of the face outline of the user is larger than the reference value (step S203: YES), the display control unit 161 reduces the display information displayed on the touch panel display 17 (see FIG. 3A). Are displayed (step S204: display control step). On the other hand, when the size of the detected contour of the user's face is smaller than the reference value (step S203: NO), the display control unit 161 enlarges the display information displayed on the touch panel display 17 (FIG. 3B). Display) (step S205: display control step). The display enlargement or reduction process described above may be repeated at a predetermined timing, or may be performed based on an instruction from the user.

  The present embodiment is configured as described above, and the display information displayed on the touch panel display 17 is enlarged or reduced based on the distance between the mobile terminal 1 and the user's face. In this way, when the display information is enlarged or reduced, it is not necessary for the user to perform an enlargement or reduction operation with a finger. The operation can be performed more conveniently by the operation of approaching or moving away.

  In addition, since the user does not need to operate the touch panel display 17 with a finger in order to enlarge or reduce the display information, the visibility of the display information is reduced by covering the touch panel display 17 with a hand. There is no. When the display information is enlarged or reduced by operating the touch panel display 17 with a finger, the portable terminal 1 must be supported with one hand and the touch panel display 17 must be operated with the finger of the other hand. However, in this embodiment, it is not necessary to use both hands when enlarging or reducing the touch panel display 17. As described above, according to the present embodiment, the display information can be enlarged or reduced with convenience for the user.

  Further, the distance between the mobile terminal and the user's face is measured by determining whether or not the user's face is close to the mobile terminal 1 based on the size of the contour of the user's face captured by the camera 11. Therefore, it is not necessary to mount a special device for this purpose, and a simple configuration can be achieved.

(Second Embodiment)
Next, a second embodiment will be described. In the first embodiment, the case where the distance between the user's face and the mobile terminal is grasped using the contour of the user's face has been described. However, in this embodiment, the distance between the user's face and the mobile terminal is determined using an infrared device. To measure.

  As shown in FIG. 6, the mobile terminal 1 </ b> A according to the present embodiment includes an infrared device (distance measuring unit) 21, an infrared device control unit 22, a distance calculation unit (distance calculation unit) 23, a reference value determination unit 24, and a comparison unit. 25, a program execution unit 26, a touch panel display (display unit) 17, and a reference value storage unit 28. Although the detailed illustration of the functional unit is omitted, the mobile terminal 1A has a function of performing a call, sending / receiving mails, and the like, similar to the mobile terminal 1 of the first embodiment. Hereinafter, the control for enlarging or reducing the display information displayed on the touch panel display 17 will be described in detail.

  The infrared device 21 is provided on the front surface of the mobile terminal 1A (the surface facing the user who uses the mobile terminal 1A), and can irradiate infrared rays toward the user's face.

  The infrared device control unit 22 controls the irradiation of infrared rays toward the user's face by the infrared device 21. The infrared device control unit 22 controls infrared irradiation by the infrared device 21 based on an instruction from the reference value determination unit 24 or the program execution unit 26.

  The distance calculation unit 23 calculates a distance from the user's face based on the result of infrared irradiation by the infrared device 21. As a method for calculating the distance using the infrared device 21, various existing techniques such as calculating the distance to the user's face based on the infrared irradiation distance from the infrared device can be used.

  The reference value determination unit 24 determines the distance from the user's face calculated by the distance calculation unit 23 as a reference value and stores it in the reference value storage unit 28. Specifically, the reference value determination unit 24 uses the distance from the user's face calculated by the distance calculation unit 23 as a reference value in the reference value determination mode for determining the reference value of the distance to the user's face. When an instruction to determine is received from the user, the distance to the face is determined as a reference value. This instruction from the user is accepted through the touch panel display 17, for example.

  Here, the reference value determination mode is a mode that is executed in advance before the display information displayed on the touch panel display 17 is enlarged or reduced, as in the first embodiment.

  The comparison unit 25 calculates the distance from the user's face calculated by the distance calculation unit 23 when the screen automatic zoom mode is executed, and the reference value determined in the reference value setting mode and stored in the reference value storage unit 28. By comparison, it is determined whether or not the distance from the user's face calculated by the distance calculation unit 23 is longer than the reference value.

  The program execution unit 26 executes a mail browsing function, an Internet information browsing function, and the like, and generates display information to be displayed on the touch panel display 17. The program execution unit 26 includes a display control unit (display control unit) 261. The display control unit 261 controls enlargement or reduction of display information displayed on the touch panel display 17. In addition, the display control unit 261 activates the screen automatic zoom mode when the display information is enlarged or reduced. This screen automatic zoom mode may be automatically activated by the display control unit 261 or may be activated by an instruction from the user.

  By starting this screen automatic zoom mode, the distance from the user's face using the infrared device 21 is calculated. Then, the comparison unit 15 compares the distance from the user's face calculated by the distance calculation unit 23 with the reference value stored in the reference value storage unit 28.

  When the comparison unit 25 determines that the distance from the user's face calculated by the distance calculation unit 23 is farther than the reference value, the display control unit 261 displays the display information displayed on the touch panel display 17 as shown in FIG. As shown in b), it is enlarged and displayed. Conversely, the display control unit 261 displays display information to be displayed on the touch panel display 17 when the comparison unit 15 determines that the distance from the user's face calculated by the distance calculation unit 23 is closer than the reference value. As shown in FIG. 3A, the image is reduced and displayed.

  The touch panel display 17 displays the display information that has been controlled to be enlarged or reduced by the display control unit 261, as in the first embodiment. The touch panel display 17 can detect a user's touch operation. Based on the detection result of the touch operation by the touch panel display 17, the program execution unit 26 performs various processes such as mail browsing.

  The reference value storage unit 28 stores the reference value of the distance from the user's face determined by the reference value determination unit 24 for each user. Specifically, the reference value storage unit 28 stores the user name (user ID) in association with the reference value of the distance from the face.

[Flow of processing in standard value determination mode]
Next, the flow of processing for determining the distance from the user's face as a reference value in the reference value determination mode will be described. The reference value determination mode is performed based on a predetermined timing or an instruction from the user, for example, when the mobile terminal 1A is activated. First, the reference value determination unit 24 instructs the infrared device control unit 22 to irradiate infrared rays by the infrared device 21. Thereby, as shown in FIG. 7, the infrared device control part 22 controls the infrared device 21, and the infrared device 21 irradiates the user's face with infrared rays (step S301).

  Next, the distance calculation unit 23 calculates the distance from the user's face based on the result of infrared irradiation by the infrared device 21 (step S302). Next, the reference value determination unit 24 receives an instruction from the user as to whether or not to determine the calculated distance from the user's face as a reference value (step S303). When receiving an instruction to determine the reference value from the user (step S303: YES), the reference value determination unit 24 determines the detected distance from the user's face as the reference value, and the reference value storage unit 28 To store.

  On the other hand, when receiving an instruction from the user that the reference value is not determined (step S303: NO), the reference value determination unit 24 instructs the infrared device control unit 22 to irradiate infrared rays again with the infrared device 21. Then, the infrared device 21 irradiates infrared rays toward the user's face (step S101). In this way, the above-described processing is repeated until the detected distance from the user's face is determined as the reference value.

[Flow of processing in automatic screen zoom mode]
Next, a flow of processing for enlarging or reducing display information in the screen automatic zoom mode will be described. When the screen automatic zoom mode is activated, the display control unit 261 instructs the infrared device control unit 22 to irradiate infrared rays toward the user's face. As a result, as shown in FIG. 8, the infrared device control unit 22 controls the infrared device 21, whereby infrared irradiation is performed on the user's face by the infrared device 21 (step S401).

  Next, the distance calculation unit 23 calculates the distance from the user's face based on the result of infrared irradiation by the infrared device 21 (step S402: distance measurement step). Next, the comparison unit 25 determines whether or not the distance from the user's face calculated by the distance calculation unit 23 is farther than the reference value stored in the reference value storage unit 28 (step S403). In addition, before the comparison part 25 acquires a reference value from the reference value storage part 18, the user name using the portable terminal 1A shall be input into the comparison part 25 beforehand, and the reference | standard corresponding to this user name The comparison unit 25 acquires the value from the reference value storage unit 28.

  When the detected distance from the user's face is farther than the reference value (step S403: YES), the display control unit 261 enlarges the display information displayed on the touch panel display 17 (see FIG. 3B). Display (step S404: display control step). On the contrary, when the detected distance from the user's face is closer than the reference value (step S403: NO), the display control unit 261 reduces the display information displayed on the touch panel display 17 (see FIG. 3A). ) And display (step S405: display control step). The display enlargement or reduction process described above may be repeated at a predetermined timing, or may be performed based on an instruction from the user.

  The present embodiment is configured as described above, and the display information displayed on the touch panel display 17 is enlarged or reduced based on the distance between the mobile terminal 1A and the user's face. As described above, when the display information is enlarged or reduced, the user does not need to perform an enlargement or reduction operation with a finger. The operation can be performed more conveniently by the operation of approaching or moving away.

  In addition, since the user does not need to operate the touch panel display 17 with a finger in order to enlarge or reduce the display information, the visibility of the display information is reduced by covering the touch panel display 17 with a hand. There is no. Further, when the display information is enlarged or reduced by operating the touch panel display 17 with a finger, it is necessary to support the portable terminal 1A with one hand and to operate the touch panel display 17 with the finger of the other hand. However, in this embodiment, it is not necessary to use both hands when enlarging or reducing the display on the touch panel display 17. As described above, according to the present embodiment, the display information can be enlarged or reduced with convenience for the user.

  Further, by calculating the distance from the user's face based on the infrared rays emitted from the infrared device 21, the distance between the mobile terminal 1A and the user's face can be easily measured.

  As mentioned above, although this invention was concretely demonstrated based on embodiment, this invention is not limited to the said embodiment. For example, you may incorporate the structure which calculates the distance with a user's face using the infrared device 21 demonstrated in 2nd Embodiment in the portable terminal 1 which concerns on 1st Embodiment. In this case, the distance between the mobile terminal 1 and the user's face is obtained based on the contour of the user's face imaged by the camera 11, or the infrared light emitted from the infrared device 21 is used to detect the distance between the mobile terminal 1 and the user. Whether the distance to the face is to be obtained may be switched and executed by, for example, user selection.

  In addition to grasping the distance between the mobile terminal 1 and the user's face based on the contour of the user's face described in the first embodiment, other than the user's face image captured by the camera 11 The structure which grasps | ascertains the distance of the portable terminal 1 and a user's face by the method may be sufficient.

  Moreover, this invention is applicable to various devices, such as a smart phone and a tablet-type terminal, for example besides the portable terminals 1 and 1A.

  Moreover, it is not essential to use the touch panel display 17 as a display unit for displaying display information, and a display having only a display function may be used.

  DESCRIPTION OF SYMBOLS 1,1A ... Portable terminal, 11 ... Camera (distance measurement means), 15 ... Comparison part (distance calculation means), 17 ... Touch panel type display (display part), 21 ... Infrared device (distance measurement means), 23 ... Distance calculation Part (distance calculation means), 161, 261 ... display control part (display control means).

Claims (5)

A portable terminal having a display unit,
Distance measuring means for measuring the distance to the user's face;
Display control means for enlarging or reducing display information displayed on the display unit based on a measurement result by the distance measuring means;
A mobile terminal comprising: The distance measuring means includes
A camera for imaging the user's face;
Distance calculating means for obtaining a distance from the user's face based on the size of the contour of the user's face imaged by the camera;
With
The display control means enlarges or reduces the display information displayed on the display unit based on the distance to the user's face obtained by the distance calculation means.
The mobile terminal according to claim 1. The distance measuring means includes
An infrared device that emits infrared rays toward the user's face;
Distance calculating means for obtaining a distance from the user's face based on an infrared irradiation result by the infrared device;
With
The display control means enlarges or reduces the display information displayed on the display unit based on the distance to the user's face obtained by the distance calculation means.
The mobile terminal according to claim 1.   The mobile terminal according to claim 1, wherein the display unit is a touch panel display. A display control method executed in a mobile terminal including a display unit,
A distance measuring step for measuring a distance between the mobile terminal and a user's face;
A display control step for enlarging or reducing display information displayed on the display unit based on a measurement result in the distance measuring step;
A display control method including:

Images