JP2010041441A - Mobile terminal and volume control method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile terminal for controlling a distance between the mobile terminal and a user and also a volume even when the direction of a display screen is rotated at a fixed angle. <P>SOLUTION: The mobile terminal includes: an imaging means 1; an image processing means 2 for calculating a ratio between the information quantities of a subject and a background from an image captured by the imaging means 1; a volume processing means 3; and a main control means 4 for controlling the imaging means 1, the image processing means 2 and the volume processing means 3 and allowing the volume processing means 3 to process the volume on the basis of the ratio, obtained by the image processing means 2, between the information quantities of the subject and the background. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a portable terminal and a volume adjustment method thereof, and more particularly to a specific application, for example, a portable terminal having a one-segment (1seg.) Reception function and a volume adjustment method thereof.

  Currently, mobile phones and mobile terminals that can watch videos such as One Seg are spreading not only to young people but also to a wide range of age groups. One segment refers to a television broadcast for mobile terminals that transmits a broadcast similar to the main program of digital terrestrial broadcasting using 12 segments in one segment.

  In related mobile terminals, the user manually adjusts the volume each time the one-segment function is used. In addition, this mobile terminal imposes a burden on the user that he must learn a new method for adjusting the volume.

  On the other hand, an invention for reducing the burden on the user is disclosed in Patent Document 1. The main object of the present invention is to keep the display content upright even when the orientation of the display screen of the portable terminal is rotated by 90 degrees as an example. For this reason, in the present invention, the user's face is photographed using a camera provided in the mobile terminal, the feature areas such as the eyes, nose, and mouth are recognized, and the relative positional relationship between the eyes, nose, mouth, and the like is determined. Check to see if the face is upright, sideways, or upside down. Then, image display is controlled so that the face is in an upright state.

  Another object of the present invention is to control the volume according to the distance between the mobile terminal and the user. Therefore, in the present invention, the distance between the mobile terminal and the user is estimated from the size of the displayed face, and the volume is reduced when the distance is relatively short, and the volume is increased when the distance is relatively long. Control the volume.

JP 2007-017596 A

  Although the main object of the invention disclosed in Patent Document 1 is completely different from that of the present invention, other objects are common to the present invention. That is, the invention disclosed in Patent Document 1 is common to the present invention in that the volume is controlled based on a face image taken by a camera. In the present invention, the volume is controlled based on the size of the photographed face.

  However, in the case of the present invention, since the volume is controlled based only on the size of the photographed face, if the orientation of the display screen is rotated by a certain angle, the size of the face will not change by itself, so the volume should be reduced. There is a drawback that it cannot be changed.

  Accordingly, an object of the present invention is to provide a portable terminal capable of controlling the volume not only of the distance between the portable terminal and the user but also when the direction of the display screen is rotated by a certain angle, and a volume adjusting method thereof. There is.

  In order to solve the above-described problem, a mobile terminal according to the present invention includes an imaging unit, an image processing unit that calculates a ratio of an information amount of a subject and a background from an image captured by the imaging unit, a volume processing unit, and the imaging unit. And a main control unit for controlling the volume processing unit to control the volume based on the ratio of the information amount of the subject and the background obtained by the image processing unit. .

  The volume adjustment method for a mobile terminal according to the present invention includes an imaging step, an image processing step for calculating a ratio of the information amount of the subject and the background from the image captured in the imaging step, a volume processing step, and the imaging step. And a main control step for controlling the image processing step and the volume processing step, and causing the volume processing step to process the volume based on the ratio of the information amount of the subject and the background obtained in the image processing step.

  In addition, a program of a volume adjustment method for a portable terminal according to the present invention includes an imaging step, an image processing step for calculating a ratio of the amount of information on the subject and the background from the image captured in the imaging step, and a volume processing step. A program for a volume control method for a portable terminal, characterized in that the computer causes the volume processing step to process a volume based on a ratio of a subject and background information amount obtained in the image processing step.

  According to the present invention, not only the distance between the mobile terminal and the user, but also the volume can be controlled when the orientation of the display screen is rotated by a certain angle.

  First, the operating principle of the present invention will be described prior to describing the embodiment of the present invention. FIG. 1 is a configuration diagram of an example of a mobile terminal for explaining the operation principle of the mobile terminal according to the present invention. Referring to the same, the portable terminal according to the present invention is configured to include an imaging unit 1, an image processing unit 2, a volume processing unit 3, and a main control unit 4.

  The imaging means 1 images a subject such as a user. The image processing means 2 calculates the ratio of the information amount between the subject and the background from the image picked up by the image pickup means 1. The volume processing means 3 processes the volume. The main control unit 4 controls the imaging unit 1, the image processing unit 2, and the volume processing unit 3, and causes the volume processing unit 3 to process the volume based on the ratio of the information amount of the subject and background obtained by the image processing unit 2.

  That is, according to the present invention, the volume is processed based on the ratio of the information amount of the subject and the background. Assume that the information amount of the subject is A (bytes) and the information amount of the background is B (bytes). When the information amount ratio R (= A / B) is relatively large, it is estimated that the distance between the mobile terminal and the user is relatively short, so the main control unit 4 causes the volume processing unit 3 to reduce the volume. .

  On the other hand, when the information amount ratio R (= A / B) is relatively small, it is estimated that the distance between the mobile terminal and the user is relatively long. Raise it. Thereby, the volume is appropriately controlled according to the distance.

  Next, consider the case where the orientation of the display screen is rotated by a certain angle. When the user rotates the direction of the display screen of the mobile terminal by a certain angle (at this time, the distance between the mobile terminal and the user does not change), the ratio R of the information amount on the display screen changes.

  Specifically, the information amount A of the subject hardly changes according to the rotation angle of the display screen, but the background information amount B changes, so that the rotation angle of the display screen is estimated from the ratio R (= A / B). Is possible. Therefore, the volume can be changed according to the rotation angle of the display screen.

  On the other hand, in the case of the invention described in Patent Document 1, since the volume is changed based only on the size of the face, the size of the face does not change just by rotating the direction of the display screen by a certain angle. The volume cannot be changed.

  As described above, according to the present invention, since the volume is processed based on the ratio of the information amount of the subject and the background, not only the distance between the mobile terminal and the user but also the direction of the display screen is set at a certain angle. The volume can be controlled even when rotated.

  Hereinafter, embodiments of the present invention will be described. FIG. 2 is a configuration diagram of the first embodiment of the portable terminal according to the present invention. In the first embodiment, a case where the present invention is applied to a mobile phone as an example of a mobile terminal will be described.

  Referring to the figure, a mobile terminal according to the present invention includes an antenna 11, a communication control unit 12, an operation unit 13, a timer unit 14, a display unit 15, a power control unit 16, and a voice input / output unit 17. A program storage unit 18 and a main control unit 19. Furthermore, the portable terminal according to the present invention includes a front camera unit 20, a one-segment control unit 21, an image processing unit 22, an image data storage unit 23, a volume processing unit 24, a sound data storage unit 25, and a speaker unit. 26.

  The imaging unit 1, image processing unit 2, volume processing unit 3 and main control unit 4 in FIG. 1 correspond to the front camera unit 20, image processing unit 22, volume processing unit 24 and main control unit 19 in FIG. To do.

  The antenna unit 11 transmits and receives radio waves. The communication control unit 12 transmits and receives data using radio waves via the antenna unit 11. The operation unit 13 is used to input data, and includes an input key as an example. The timer unit 14 determines whether or not a specific key of the operation unit 13 has been pressed for a predetermined time. The display unit 15 is composed of a color liquid crystal panel or the like, and realizes various displays. The power control unit 16 performs power supply and charging to each part.

  The voice input / output unit 17 performs voice input / output. The program storage unit 18 stores a program for adjusting the volume of the portable terminal described later. The front camera unit 20 photographs a subject. The one-segment control unit 21 displays the received radio wave on the display unit 15. The image processing unit 22 uses the data stored in the image data storage unit 23 to perform a process of discriminating the subject (in this embodiment, the user's face as an example) and the background, and the ratio of the data amount of the face and the background calculate. A known technique is used for the process of discriminating the face from the data stored in the image data storage unit 23.

  The image data storage unit 23 stores an image photographed by the front camera unit 20. The volume processing unit 24 reads predetermined volume data from the sound data storage unit 25 and outputs it from the speaker unit 26. The sound data storage unit 25 stores volume data corresponding to the ratio of the information amount between the subject and the background. The speaker unit 26 outputs sound. The main control unit 19 controls each of the parts 12-18 and 20-26.

  Next, the operation of this embodiment will be described. First, an example of image detection and data amount calculation processing will be described. FIG. 3 is a flowchart showing an example of image detection and data amount calculation processing of the mobile terminal according to the present invention. The following processing (including processing shown in FIGS. 4 and 5 described later) is executed by the main control unit 19 controlling each of the parts 12 to 18 and 20 to 26.

  First, when the one seg viewing mode is selected by the operation unit 13, the main control unit 19 activates the one seg control unit 21 to start viewing the one seg (in the case of “Y” in step S1). Next, the main control unit 19 activates the front camera unit 20, the image processing unit 22, and the image data storage unit 23 (step S2).

  Next, the main control unit 19 starts capturing the image captured by the front camera unit 20, and temporarily stores the captured image in the image data storage unit 23 (step S3). If one-segment viewing is not started (in the case of “N” in step S1), the automatic volume adjustment described below does not function.

  Next, the main control unit 19 causes the image processing unit 22 to detect the boundary between the face and the background from the image data stored in the image data storage unit 23 (step S4). The image processing unit 22 uses the color information and the luminance information to detect the boundary between the face and the background using a known technique.

  Next, the main control unit 19 causes the image processing unit 22 to detect the outline of the face, and then compares the data amount of the face and the background to calculate the ratio of the face data (step S5). Next, the main control unit 19 outputs the calculation result of the ratio of the face data in the image processing unit 22 to the volume processing unit 24 as input information of the volume adjustment process (step S6).

  Next, an example of automatic volume control processing will be described. FIG. 4 is a flowchart showing an example of automatic volume control processing of the mobile terminal according to the present invention. It is assumed that the sound data storage unit 25 stores volume data (volumes 1 to 10) adjusted in 10 steps according to the ratio of the information amount between the subject and the background (see step S12). Now, it is assumed that the ratio of the amount of information on the subject and the background (ratio of face data) is expressed in 10 stages of R1 to R10, and the ratios R1 to R10 of face data correspond to the volumes 1 to 10, respectively.

  The main control unit 19 causes the volume processing unit 24 to capture the calculation result of the ratio of the face data in the image processing unit 22 as an input signal (step S11). The main control unit 19 causes the volume processing unit 24 to read volume data corresponding to the ratio of the captured face data from the sound data storage unit 25 (step S12).

  That is, the main control unit 19 causes the volume processing unit 24 to set the volume to 1 when the ratio of the face data is R1, as an example (step S12-1). If the face data ratio is R2, the volume is set to 2 (step S12-2). If the face data ratio is R3, the volume is set to 3 (step S12-3). When the ratio of the face data is R10, the volume is set to 10 (step S12-10).

  Note that the case where the ratio of the face data is R4 to R9 is set in the same manner as described above, and the description thereof is omitted. Next, the main control unit 19 sounds the speaker unit 26 at the volume set in the volume processing unit 24 (step S13).

  Next, an example of a pressing time measurement process in the timer unit will be described. FIG. 5 is a flowchart showing an example of a pressing time measurement process in the timer unit according to the present invention. First, the main control unit 19 detects whether or not the user has pressed a specific key of the operation unit 13 (step S21). When the specific key of the operation unit 13 is pressed (in the case of “Y” in step S21), the main control unit 19 drives the timer unit 14 and measures the time when the specific key is pressed (step S22).

  When the specific key is pressed for a predetermined time or more (in the case of “Y” in step S23) and the front camera unit 20 is capturing an image (in the case of “Y” in step S24), the main control unit 19 Causes the front camera unit 20 to stop capturing images (step S25). Next, the main control unit 19 causes the volume processing unit 24 to fix the volume to the volume when the specific key is pressed for a predetermined time or longer (step S26). As a result, the user can continuously watch 1Seg at a constant volume.

  On the other hand, when the specific key of the operation unit 13 is not pressed in step S21 (in the case of “N” in step S21), the main control unit 19 waits until the specific key is pressed. If the specific key has not been pressed for a predetermined time or longer in step S23 (in the case of “N” in step S23), the main control unit 19 waits until the specific key of the operation unit 13 is pressed again. .

  In step S24, when the front camera unit 20 is not capturing an image (in the case of “N” in step S24), the main control unit 19 causes the front camera unit 20 to resume image capturing (step S27). ). As a result, the user can continue to watch 1Seg. By pressing the specific key, the user can easily fix and set the desired volume.

  As described above, according to the first embodiment of the present invention, when one-seg viewing or the like is performed on a mobile terminal, the distance between the mobile terminal and the user (more precisely, the distance between the front camera unit 20 and the user). As an example, the volume can be automatically adjusted by changing the ratio of the subject (for example, the face) and the background imaged by bending or stretching the arm or tilting the mobile terminal. In addition, since it is not necessary for the user of the mobile terminal to newly learn a plurality of key operations, more people can easily adjust the volume to a desired level.

  Next, a second embodiment of the present invention will be described. The second embodiment relates to a program of a volume adjustment method for a portable terminal. As described above, the portable terminal of the present invention includes the program storage unit 18 (see FIG. 2). The program storage unit 18 stores a program for adjusting the volume of the portable terminal shown in the flowcharts of FIGS.

  The main control unit 19 shown in FIG. 2 reads a program for adjusting the volume of the portable terminal from the program storage unit 18 and controls each of the parts 12 to 18 and 20 to 26 according to the program. Since the contents of the control have already been described, description thereof is omitted here.

  As described above, according to the second embodiment of the present invention, not only the distance between the mobile terminal and the user but also the volume can be controlled when the direction of the display screen is rotated by a certain angle. A program for adjusting the volume of the portable terminal can be obtained.

  Other examples of portable terminals include personal portable information communication devices such as PHS (Personal Handyphone System), PDA (Personal Digital Assistant) or personal computer (Personal Computer) that have a camera function and a one-segment function. Applicable.

It is a block diagram of an example of the portable terminal for demonstrating the operation principle of the portable terminal which concerns on this invention. It is a block diagram of 1st Embodiment of the portable terminal which concerns on this invention. It is a flowchart which shows an example of the image detection and data amount calculation process of the portable terminal which concerns on this invention. It is a flowchart which shows an example of the automatic volume control process of the portable terminal which concerns on this invention. It is a flowchart which shows an example of the pressing time measurement process in the timer part which concerns on this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging means 2 Image processing means 3 Volume processing means 4 Main control means 11 Antenna 12 Communication control part 13 Operation part 14 Timer part 15 Display part 16 Power supply control part 17 Voice input / output part 18 Program storage part 19 Main control part 20 Front camera Unit 21 one-segment control unit 22 image processing unit 23 image data storage unit 24 volume processing unit 25 sound data storage unit 26 speaker unit

Claims (11)

Imaging means;
Image processing means for calculating the ratio of the information amount of the subject and the background from the image captured by the imaging means;
Volume processing means;
Main control means for controlling the imaging means, the image processing means and the volume processing means, and causing the volume processing means to process the volume based on the ratio of the information amount of the subject and the background obtained by the image processing means. Mobile terminal.   2. The portable terminal according to claim 1, wherein the main control unit activates the imaging unit, the image processing unit, and the volume processing unit when a specific application is selected. Operating means with input keys;
Timer means for measuring a long press time of the specific input key of the operation means,
The main control means controls the operation means and the timer means, and the imaging means when the long press time measured by the timer means is a predetermined time or more and an image is being captured by the imaging means The portable terminal according to claim 1 or 2, wherein the capturing of the image is stopped, and then the volume is fixed by the volume processing means. Operating means with input keys;
Timer means for measuring a long press time of the specific input key of the operation means,
The main control means controls the operation means and the timer means, and when the long press time measured by the timer means is a predetermined time or more and the image pickup means is not capturing an image, the image pickup 3. The portable terminal according to claim 1, wherein the image capturing is restarted by the means.   The portable terminal according to claim 1, wherein the subject is a user's face. Imaging step;
An image processing step of calculating a ratio of the information amount of the subject and the background from the image captured in the imaging step;
A volume processing step;
A main control step of controlling the imaging step, the image processing step, and the volume processing step, and causing the volume processing step to process the volume based on a ratio of the information amount of the subject and the background obtained in the image processing step. A method for adjusting the volume of a portable terminal.   The volume control method for a portable terminal according to claim 6, wherein the main control step starts the imaging step, the image processing step, and the volume processing step when a specific application is selected. Operation steps for key entry,
A timer step for measuring a long press time of the specific input key of the operation step,
The main control step controls the operation step and the timer step, and the imaging step is performed when the long press time measured in the timer step is a predetermined time or more and an image is being captured in the imaging step. The method of adjusting a volume of a portable terminal according to claim 6 or 7, wherein the capturing of the image is stopped and then the volume is fixed in the volume processing step. An operation step with input keys;
A timer step for measuring a long press time of the specific input key of the operation step,
The main control step controls the operation step and the timer step, and when the long press time measured in the timer step is a predetermined time or more and the image is not being captured in the imaging step, the imaging 8. The method of adjusting a volume of a portable terminal according to claim 6, wherein the step of resuming image capturing is resumed in the step.   10. The volume adjustment method for a mobile terminal according to claim 6, wherein the subject is a user's face. A program for a volume adjustment method for a mobile terminal, comprising: an imaging step; an image processing step for calculating a ratio of a subject and background information amount from the image captured in the imaging step; and a volume processing step.
A program for causing a computer to process a sound volume based on a ratio of a subject and background information amount obtained in the image processing step.

Images