JP2009187283A - Information processing apparatus, method of controlling information processing apparatus, and control program of information processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method of controlling an information processing apparatus capable of adjusting a sound volume depending on a distance between a user and the information processing apparatus. <P>SOLUTION: A speaker volume adjustment table B is referred to when a distance between the position of the user and a speaker becomes different from a standard distance when playing back the sound data of a CD or an MP3 file or the like for instance, and a speaker sound adjustment table A is referred to when the distance between the position of the user and the speaker becomes different from the standard distance when playing back video data and the sound data like a DVD or the like. Thus, different volume adjustment is executed depending on the kind of contents. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

The present invention relates to an information processing apparatus such as a notebook personal computer, a control method for the information processing apparatus, and a control program for the information processing apparatus.

In recent years, with the spread of notebook personal computers (hereinafter referred to as PCs), movies and music are often played back on PCs. There are many application software that plays movies and music, but the content of movies and music can be roughly divided into two. That is, an AVI file or the like (first type of content) including video data to be displayed on a screen such as a DVD and audio data to be output to a speaker, an MP3 or WAV file including only audio data without including video data, and the like (Second content).

In the PC, when reproducing these contents, the audio data is generally output to the speaker at a fixed audio level set in the operator ring system of the PC. Recently, there has also been a case where the audio level at the end of the content reproduction application is stored, and the audio level stored when the application is started next time is read and reproduced at that level. . (For example, see Patent Document 1)
When outputting video data, the user adjusts the size of the window (screen) of the display unit and outputs the video data to the window. Once the size of the window is determined by the user, the video data is output in a fixed window size determined by the user.
JP 2004-287474 A

  The PC user does not always exist at the same position in front of the PC when playing video or music. However, even if the user moves from a position in front of the PC, the volume of the speaker of the PC is always constant, and when the user plays music content such as MP3 on the PC and listens to the music as BGM, the user is far away. The audio data being played is inaudible.

  On the other hand, for DVDs that play back video data and audio data at the same time, if the user is too far away to see the video, the audio data is played back even though the user does not hear the audio data. The state will continue.

  Furthermore, even if the user wants to view the video data being reproduced from a position slightly away from the PC position, the window size of the display unit does not change, so the window is small and difficult to see.

 The present invention has been made to solve the above-described problems, and can adjust the volume output from the speaker according to the content of the content to be played back and the position of the user, and is convenient information for the user. It is an object of the present invention to provide a processing apparatus, a control method for an information processing apparatus, and a control program for the information processing apparatus.

In order to achieve the above object, the present invention provides a camera that captures the face of a moving user (face tracking), a display unit that displays video data, a speaker that outputs audio data, and a user that moves with the camera. Distance detection that determines the user's position according to the difference between the captured face and the fixed face size when the face of the user is shot and the size of the user's face screen is compared with the fixed face size that has been set And a sound adjuster that adjusts the volume of the sound data being reproduced by the speaker when the position of the user is determined by the distance detecting means. A method of reproducing an information processing apparatus having audio data reproducing means, comprising: a camera for photographing a user's face moving to a housing of the information processing apparatus; and a moving user photographed by the camera. The face is compared with the fixed face size, the distance between the user and the information processing device is detected according to the difference between the captured face and the fixed face size, the user's position is determined, and the user's position is determined. Accordingly, the volume of the audio data being reproduced is adjusted.

  A program according to the present invention is a control program for an information processing apparatus including a camera that captures a moving user's face and a speaker that outputs audio data, and the moving user's face captured by the camera A position determination function for detecting the distance between the user and the information processing device according to the difference between the captured face and the fixed face size and determining the position of the user, And a function of adjusting the volume of the audio data being reproduced.

An information processing apparatus, a control method for the information processing apparatus, and a control program for the information processing apparatus that can adjust the volume output from the speaker in accordance with the content to be played and the position of the user and that are convenient for the user Can be provided.

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows an external configuration of an information processing apparatus according to an embodiment of the present invention. Here, a notebook PC to which the present invention is applied is shown as an example.

In FIG. 1, the PC is composed of a computer main body 1 and a display unit 2. A display device 3 is incorporated in the display unit 2 and is attached to the computer main body 1 so as to be openable and closable. A camera 6 that captures the user's face and the user's environment is provided at a portion directly above the center of the display unit 2, that is, above the display unit 3. The computer main body 1 has a box-shaped housing, and a keyboard 4 that is operated when inputting characters or the like is provided on the top surface of the housing. A touch pad 5 is provided at a substantially central portion of the upper surface of the housing in front of the keyboard 4. On the back (rear) side on the upper surface of the computer main body 1, a left channel main speaker 7a and a right channel main speaker 7b are arranged separately on the left and right. These main speakers 7a and 7b are mainly used for reproducing audio data.

Next, FIG. 2 shows a system configuration of the computer main body 1 shown in FIG.

As shown in FIG. 2, the computer main body 1 includes a central processing unit (CPU) 8, a read-only memory / random access memory (ROM / RAM) 9, a hard disk drive (HDD) 10, an optical disk drive (CD / DVD Drive). ) 11, an audio controller (Sound Controller) 12, a volume circuit (VR) 13, a left channel main speaker amplifier 14, a right channel main speaker amplifier 15, a graphics controller 16 and the like.

The CPU 8 is provided for controlling the operation of the computer main body 1. The ROM / RAM 9 is written with a basic input / output system (BIOS) as a basic input / output system. The BIOS is a program that controls the exchange of data input and output between an operating system (OS) and hardware (for example, the display device 3 and the touch pad 5) installed in the computer.

An operating system (OS), application programs, utility programs, and the like are mounted on the hard disk drive (HDD) 10 and loaded from the hard disk drive (HDD) 10 to the ROM / RAM 9. The ROM / RAM 9 is a volatile storage medium including a ROM (Read Only Memory) and a RAM (Random Access Memory). In the ROM / RAM 9, as will be described later, based on a person image acquired from the camera 6, how far the user is from the PC, whether the user is in the center position, or a position that is biased to the left or right A dictionary table (shown in FIG. 7) for determining whether or not there is a volume and a volume adjustment table (FIGS. 9 and 10) corresponding to the distance described later are stored. The loaded program is executed by the CPU 8 through the ROM / RAM 9.

An optical disk drive (CD / DVD Drive) 11 is provided for reading information stored in a medium storing audio data and video data, such as a DVD-ROM.

The audio controller 12 inputs various audio data such as MP3 and WAV data supplied from the hard disk drive (HDD) 10 or the Internet through the audio data read from the optical disk drive (CD / DVD Drive) 12 or the CPU 8. In response thereto, a left channel audio signal (Audio L Channel) and a right channel audio signal (Audio R Channel) are output. The left channel audio signal and the right channel audio signal are supplied to a line out terminal for connecting an external audio device, and the left channel main speaker amplifier 14 and the right channel main are connected through a volume circuit (VR) 13. This is supplied to the speaker amplifier 15.

The volume circuit (VR) 13 is a circuit for adjusting the output volume of the left channel main speaker 7a and the right channel main speaker 7b, and the output volume is adjusted based on a value read from a volume adjustment table described later. Is. The left channel main speaker amplifier 14 is for driving the left channel main speaker 7a, amplifies the left channel audio signal input via the volume circuit 13, and outputs the amplified left channel audio signal to the left channel main speaker 7a. The right channel main speaker amplifier 15 is for driving the right channel main speaker 7b, amplifies the right channel audio signal input via the volume circuit 13, and outputs the amplified signal to the right channel main speaker 7b.

The camera 6 is connected to the CPU 8, and the person image from the camera 6 is taken into the RAM, and the position of the user is determined by comparing the face position and the face size with the dictionary data. Yes.

The graphics controller 16 is connected to the display device 3 and the CPU 8 and controls data displayed on the display device 3.

Next, the operation of automatically changing the volume of the speaker of the PC configured as described above and the window size (screen size) of the display device will be described.

FIG. 3A shows the user operating the PC and the position of the PC. Normally, the user places the PC in a certain place, and the user operates the PC from a central position that is a predetermined distance away from the PC. Therefore, the distance between the user and the speaker is a short distance of about 50 cm, and the distance between the user and the left channel main speaker 7a and the right channel main speaker 7b is equal.

At this time, the person image captured from the camera 6 is as shown in FIG. 3B, and is temporarily stored in the RAM and then compared with the dictionary data stored in the RAM shown in FIG. Determine the user's location. In the example of FIG. 3, it is determined that the distance level is level 2 and the left and right positions are in the center.

FIG. 4A shows a state where the user has moved to a position far away from the PC. In this state, the image data from the camera 6 is a small person image as shown in FIG. 4B, and the distance between the PC and the user is level 7 by comparing with the dictionary data of FIG. Determined to be in the middle.

  Further, FIG. 5A shows a state where the user is at a position away from the PC but is looking at the PC. In this state, the image data from the camera is as shown in FIG. 5B, and by comparing with the dictionary data in FIG. 7, the distance between the PC and the user is level 4, and the PC is viewed from the face direction. It is judged that

  Furthermore, FIGS. 6A and 6B show that the user is at a position where the left and right positions are biased to the left at a level 2 distance.

Next, the operation of adjusting the volume of the speaker and the window size (screen size) displayed on the display device according to the position of the user will be described based on the flowchart shown in FIG.

In the process shown in FIG. 8, it is determined whether or not the application is activated by the CPU 8 (step S1). When the application is activated, it is checked whether or not the type of content to be reproduced is type 1 which is content including video data and audio data such as DVD (step S2). If the content type is not type 1, it is checked whether the content type is type 2 which is content including only audio data without including video data, such as MP3 and WAV (step S3). If the content type is type 2, the camera 6 is activated by recognizing that it is an application for reproducing an MP3 file or the like (steps S4 and S5). When the camera 6 is activated, the size of the user's face acquired from the camera 6 is compared with the dictionary data shown in FIG. 7, and it is checked whether or not it is the standard face position (level 2) (step S6). In the case of the standard face position (level 2), the volume and the window size of the display unit are set to the standard size, and it is determined whether or not to end the application (steps S7 and S8). If the application is not terminated, the process returns to step S6, and the comparison between the person image from the camera 6 and the dictionary data is repeated to determine the position of the user from the size of the user's face. If the position of the user is not the standard position in step S6, the window size of the display unit and the volume of the speaker are adjusted with reference to the table B shown in FIG. 9 according to the position of the user (step S9, S10). Details thereof will be described later.

On the other hand, when it is checked in step S2 whether the content type is type 1, if it is type 1, it is recognized that the content is a DVD or the like, and the camera 6 is activated (steps S11, S12). When the camera 6 is activated, the size of the user's face acquired from the camera 6 is compared with the dictionary data shown in FIG. 7, and it is checked whether or not it is the standard face position (level 2) (step S13). In the case of the standard face position, the volume and the window size of the display unit are set to the standard size, and it is determined whether or not to end the application (steps S14 and S15). When the application is not terminated, the process returns to step S13, and the comparison between the person image from the camera 6 and the dictionary data is repeated to determine the position of the user from the size of the user's face. If the position of the user is not the standard position in step S13, the window size of the display unit and the volume of the speaker are adjusted with reference to the table A shown in FIG. 10 according to the position of the user (step S16, S17). Details thereof will be described later.

If the content type is not content 1 or content 2 when the content type is confirmed in step S3, it is checked whether or not it is an application type such as sentence creation (step S18). In the case of an application such as sentence creation, an application such as sentence creation is executed (step S19). If it is not an application for writing text, the process returns to step S1 and waits for the next application to start.

Next, with reference to FIG. 9, a description will be given of a volume adjustment method when reproducing the second type of content.

FIG. 9 shows the position of the user, the left channel main speaker 7a, and the right channel main speaker 7b when the content type is type 2 which includes only audio data without including video data, such as MP3 and WAV. The volume adjustment table B which shows the relationship with is shown. The left number in each cell indicates the volume of the left channel main speaker 7a, and the right number indicates the volume of the right channel main speaker 7b. The coordinates of the user's position are shown in the form of (X, Y), where Y is the distance from the PC, and X is the left or right or center position relative to the PC.

The normal user position is indicated by coordinates (2, 2), and the two speakers reproduce the audio data at the normal volume (1, 1). If the user moves to the left, the coordinates become (1, 2), the volume of the left channel main speaker 7a slightly increases, the volume of the right channel main speaker 7b slightly decreases, and the volume Will be (0.8, 1.3). Conversely, if the user moves to the right, the coordinates become (3, 2), the volume of the left channel main speaker 7a increases slightly, and the volume of the right channel main speaker 7b decreases slightly, Will be (1.3, 0.8).

When the user approaches in front of the PC, the coordinates become (2, 1), and the volume of the two speakers decreases to (0.5, 0.5). When the user moves to the left at this distance, the coordinates are (1, 1), and the volume of the left channel main speaker 7a and the right channel main speaker 7b is (0.8, 1.3), respectively. Conversely, when the user moves to the right, the coordinates are (3, 1), and the volume of the left channel main speaker 7a and the volume of the right channel main speaker 7b are (1.3, 0.8), respectively. )become.

Further, when the user moves away from the front of the PC, the coordinates become (2, 3), and the volume of the two speakers increases to (1.5, 1.5), respectively. When the user moves to the left at this distance, the coordinates are (1, 3), and the volume of the left channel main speaker 7a and the right channel main speaker 7b is (1.3, 1.8), respectively. Conversely, when the user moves to the right, the coordinates are (3, 3), and the volume of the left channel main speaker 7a and the right channel main speaker 7b is (1.8, 1.3), respectively.

Here, when the audio data whose content type is 2 is being reproduced, the volume is adjusted to increase so that the music can be heard as BGM even if the user is far away from the PC. For example, when the user is at the coordinates (2, n−1), the volume is adjusted to (3.2, 3.2) so that music can be heard even at the position where the user is. As in the previous example, moving to the left changes the coordinates to (1, n-1) and the volume to (3.5, 4), moving to the right moves the coordinates to (3, n-1). Instead, the volume is adjusted to (4, 3.5).

Next, with reference to FIG. 10, a volume adjustment method during reproduction of the first type of content will be described.

FIG. 10 shows the relationship between the position of the user and the left channel main speaker 7a and the right channel main speaker 7b when the content type is content 1 that includes video data and audio data such as DVD and AVI. Is a volume adjustment table A showing As in FIG. 9, the normal user position is indicated by coordinates (2, 2), and the two speakers reproduce the audio data at the normal volume (1, 1). If the user moves to the left, the coordinates become (1, 2), the volume of the left channel main speaker 7a slightly increases, the volume of the right channel main speaker 7b slightly decreases, and the volume Will be (0.8, 1.3). Conversely, if the user moves to the right, the coordinates become (3, 2), the volume of the left channel main speaker 7a increases slightly, and the volume of the right channel main speaker 7b decreases slightly, Will be (1.3, 0.8).

When the user approaches in front of the PC, the coordinates become (2, 1), and the volume of the two speakers decreases to (0.5, 0.5). When the user moves to the left at this distance, the coordinates are (1, 1), and the volume of the left channel main speaker 7a and the right channel main speaker 7b is (0.8, 1.3), respectively. Conversely, when the user moves to the right, the coordinates are (3, 1), and the volume of the left channel main speaker 7a and the volume of the right channel main speaker 7b are (1.3, 0.8), respectively. )become.

Further, when the user moves away from the front side on the PC side, the coordinates become (2, 3), and the volume of the two speakers increases to (1.5, 1.5), respectively. When the user moves to the left at this distance, the coordinates are (1, 3), and the volume of the left channel main speaker 7a and the right channel main speaker 7b is (1.3, 1.8), respectively. Conversely, when the user moves to the right, the coordinates are (3, 3), and the volume of the left channel main speaker 7a and the right channel main speaker 7b is (1.8, 1.3), respectively. Up to this point, as in the case of the second type of content, the volume of the speaker is adjusted to increase as the user leaves the PC.

However, when playing back video data such as DVD and audio data, if the user leaves the PC to some extent, the video data can no longer be viewed, so there is no need to play music data, and the volume of the speaker is reduced. It is adjusted to decrease. For example, when the user is at the coordinates (2, n−1), the user is hardly able to see the display unit, so there is no need to increase the volume. For this reason, the volume is adjusted to (0.5, 0.5). As in the previous example, moving to the left changes the coordinates to (1, n-1) and the volume to (0.3, 0.5). When moving to the right, the coordinates are changed to (3, n-1) and the volume is changed to (0.5, 0.3). Furthermore, the volume is set to zero at positions farther than this, for example, at coordinates (1, n), (2, n), and (3, n).

Next, a screen size adjustment method will be described with reference to FIGS.

In this embodiment, in addition to the volume adjustment, the size of the screen window displayed on the display unit 3 can be adjusted according to the distance between the user and the PC. For example, it is assumed that the user is looking at the PC in a state where the window of the display unit is not fully displayed while sitting in front of the PC. In this state, for example, if the user moves to a position slightly away to make a phone call, if the window is the same size as it is, it is difficult for the user to see the video of the window. In the present embodiment, the position of the user is determined from the size of the user's face acquired by the camera 6, and the window size of the display unit is adjusted.

FIG. 11 shows a normal screen window 17, which is a user window size in a normal situation. Under normal circumstances, the user is sitting in front of the PC, and the displayed window occupies about a quarter of the full screen. In this case, since the user is in front of the PC, the window screen can be clearly seen without any problem. However, as the user moves away from the PC, the video data displayed in the window is apparently smaller and difficult to see.

For this reason, the person image from the camera 6 is compared with the dictionary data in the same manner as in the above-described embodiment, so that it is determined how far the user is from the PC and the window size is increased according to the distance. I try to control it.

FIG. 12 is an example of the window 18 when the user moves away. The original window size, which occupies about 1/4 of the display unit as shown in FIG. 11, is expanded to about 3/4 of the display unit as the user moves away from the PC. It shows the state.

  When such a window size adjustment is performed, window size data is also added to the volume adjustment table corresponding to the distance between the PC and the user shown in FIG. 10, and this window size is determined according to the distance between the PC and the user. The window size may be adjusted by reading data.

In the above embodiment, the camera is described as being built in the PC. However, even if the camera is not necessarily built in the PC, an external camera is attached to the upper part of the PC display unit, and the image data is transferred to the USB terminal or the like. It is only necessary to take in via.

Further, in order to determine the user's position, the size and position of the face are stored in advance in the memory as dictionary data, and the user's face acquired from the camera is compared with this dictionary table. Instead, the determination may be made based on the size of the entire person.

Furthermore, a recent camera is equipped with a function for recognizing the position of the user's face and changing the shooting range in accordance with the movement of the user (tracking). If the camera is used, the position of the user can be determined with high accuracy, so that the speaker volume can be finely adjusted.

The perspective view which shows the external appearance structure of PC in embodiment of this invention. The block diagram which shows the system configuration | structure of PC shown in FIG. The figure for demonstrating the position of a normal user and PC. The figure for demonstrating performing the control which changes an audio | voice according to content. The figure for demonstrating expanding a window which is looking at PC far away. The figure for demonstrating changing the volume of a speaker on either side. The figure for demonstrating the distance of a user and PC. The flowchart which shows the flow of a process of adjustment of a volume and a screen window size. The figure of the volume reference table A in the 1st Embodiment of this invention. The figure of the volume reference table B in the 2nd Embodiment of this invention. The figure for demonstrating the normal screen window size in the 3rd Embodiment of this invention. The figure for demonstrating the adjusted screen window size in the 3rd Embodiment of this invention.

Explanation of symbols

1 Main unit 2 Display unit 3 Display device (LCD)
4 Keyboard 5 Touchpad 6 Web camera 7a Main speaker for left channel 7b Main speaker for right channel 8 CPU
9 ROM / RAM
10 Hard disk drive (HDD)
11 Optical disk drive (CD / DVD Drive)
12 Voice controller (Sound Controller)
13 Volume circuit (VR)
16 Graphics Controller (Graphic Controller)
17 Normal screen window size 18 Screen window size adjusted according to user position

Claims (10)

A display for displaying video data;
A speaker for outputting audio data;
Image acquisition means for acquiring person image information of a user who operates the information processing apparatus;
Position determination means for determining the position of the user based on the person image information acquired by the image acquisition means;
A first type of content including video data to be displayed on the display unit and audio data to be output to the speaker, and a second type including only audio data to be output to the speaker without including video data to be displayed on the display unit. Playback means for selectively playing back the types of content;
Audio adjusting means for adjusting the volume output from the speaker to a different volume between the first content and the second content based on the position of the user determined by the position determining means;
An information processing apparatus comprising: The position determination means determines whether the user exists in the vicinity of the information processing apparatus or in a position away from the information processing apparatus,
The sound adjusting means reduces the volume of the speaker when the reproducing means determines that the user is present at a remote position when reproducing the first content, and indicates that the user is present at a remote position when reproducing the second content. The information processing apparatus according to claim 1, wherein when the determination is made, the volume of the speaker is increased. The information processing apparatus according to claim 1, further comprising a screen size adjusting unit that adjusts a size of a screen displayed on the display unit based on the position of the user determined by the position determining unit. The speaker comprises a plurality of speakers arranged on the left and right of the information processing apparatus,
When the position determining unit determines that the user exists at a position deviated from the center of the information processing apparatus, the sound adjusting unit adjusts the volume of the left and right speakers to different values based on the position. The information processing apparatus according to claim 1. A display unit for displaying video data, a speaker for outputting audio data, a first type of content including video data to be displayed on the display unit and audio data to be output to the speaker, and display on the display unit A control method for an information processing apparatus having at least reproduction means for selectively reproducing a second type of content that does not include video data and includes only audio data output to the speaker,
Acquiring human image information of a user who operates the information processing apparatus;
Determining the position of the user based on the acquired person image information;
Adjusting the volume output from the speaker to a different volume between the first content and the second content based on the determined user position;
An information processing apparatus control method comprising: The step of determining the position determines whether the user exists in the vicinity of the information processing apparatus or in a position away from the information processing apparatus,
In the step of adjusting the volume, the volume of the speaker is reduced when the reproduction means determines that the user is present at a position away from the user when the first content is reproduced, and the user is moved away from the user when the second content is reproduced. 6. The method of controlling an information processing apparatus according to claim 5, wherein the volume of the speaker is increased when it is determined that the speaker exists. 6. The information processing according to claim 5, further comprising a screen size adjustment step of adjusting a size of a screen displayed on the display unit based on the position of the user determined in the step of determining the position. Control method of the device. The speaker comprises a plurality of speakers arranged on the left and right of the information processing apparatus,
In the step of adjusting the volume, when the user determines that the position exists in a position deviated from the center of the information processing apparatus in the step of determining the position, the volume of the left and right speakers is set to different values based on the position. The information processing apparatus control method according to claim 5, wherein adjustment is performed. A display unit for displaying video data, a speaker for outputting audio data, a first type of content including video data to be displayed on the display unit and audio data to be output to the speaker, and display on the display unit A control program for an information processing apparatus having at least reproduction means for selectively reproducing a second type of content that does not include video data and includes only audio data output to the speaker,
A function of acquiring person image information of a user who operates the information processing apparatus;
A function of determining the position of the user based on the acquired person image information;
A function of adjusting the volume output from the speaker to a different volume between the first content and the second content based on the determined user position;
A control program for an information processing apparatus. 10. The information processing according to claim 9, further comprising a screen size adjustment function for adjusting a size of a screen displayed on the display unit based on a user position determined by the function of determining the position. Device control program.

Images