JP2009063636A - Display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow the display at proper display magnification when information to be displayed is magnified or reduced so as to be displayed by taking into account of the positions and the distances of a number of persons watching the display. <P>SOLUTION: The display device includes: a photographing part photographing an image including a plurality of persons; a display part on which the photographing part is attached so that information is displayed on a display screen and a space in front of the display screen is photographed; a distance measurement part measuring the respective distances between the plurality of persons included in the image photographed by the photographing part and the photographing part; a display magnification determination part determining the display magnification of the information to be displayed on the display screen while taking into account of the positions of the plurality of photographed persons using the plurality of measured distances; and a control part displaying the information to be displayed on the display part by applying the determined display magnification thereto. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a display device, and more particularly to a display device capable of enlarging and reducing an image or the like displayed on a screen.

In today's display devices, devices that display a part of a document, an image, or the like displayed on the screen in an enlarged manner, or conversely reduce the entire display have been developed.
In addition, a distance sensor is installed in the display device, and the distance sensor measures the distance between the person viewing the display screen and the display screen, and uses the predefined distance-magnification ratio comparison table to display the display screen. Has been proposed (see Patent Document 1).
JP-A-1-277286

However, when a presentation is performed in front of a large number of participants using a large-screen display device, the distance between each participant and the display device cannot be uniquely determined. That is, some participants are close to the display device and some are far from the display device, so it is difficult to determine an appropriate magnification of the display screen.
For example, in the thing of patent document 1, since the display magnification is determined based on only one measurement distance so that the screen display adapted to the individual in front of the display device can be performed, the measurement is performed. The enlargement / reduction ratio calculated by the distance does not consider a plurality of participants, and it is difficult to flexibly change the magnification in consideration of the positions of a large number of participants.

  Therefore, the present invention has been made in consideration of the above circumstances, and calculates an appropriate display magnification by measuring the distances between a plurality of participants viewing the display screen and the display screen. An object of the present invention is to provide a display device capable of changing the display magnification of information displayed on the screen.

The present invention relates to a photographing unit for photographing an image including a plurality of persons, a display unit on which information is displayed on a display screen and the photographing unit is attached so as to photograph a front space of the display screen, and the photographing unit Taking into account the positions of a plurality of persons photographed using a plurality of measured distances, a distance measuring unit that measures the distances between the plurality of persons included in the image photographed by A display magnification determining unit that determines a display magnification of information displayed on the display screen, and a control unit that displays information to be displayed on the display unit by applying the determined display magnification. A display device is provided.
According to this, the display magnification of the displayed information can be easily changed in consideration of the distance from the display unit to a plurality of persons.

  The present invention also includes a photographing unit that photographs an image including a plurality of persons, a display unit that displays information on a display screen, and the photographing unit is attached so as to photograph a front space of the display screen, Stores a distance measurement unit that measures the distance between a plurality of persons included in an image captured by the imaging unit and the imaging unit, and a distance magnification table that defines the relationship between the measurement distance and display magnification of display information The distance information for determining the display magnification of the information displayed on the display screen is calculated from the plurality of measured distances based on the storage unit and a predetermined magnification determination condition, and the distance magnification A display magnification determining unit that determines a display magnification of display information corresponding to the calculated distance information using a table; a control unit that displays information to be displayed on the display unit by applying the determined display magnification; There is provided a display apparatus characterized by comprising.

In addition, the present invention further includes a person recognition unit that identifies a plurality of person portions included in the image using the image photographed by the photographing unit and recognizes the face position of each person, The distance measuring unit measures a distance between each face position recognized by the person recognizing unit and a photographing unit.
Furthermore, the magnification determination condition may be stored in the storage unit in advance, and the magnification determination condition may be configured from a plurality of references for calculating distance information for determining the display magnification.

Here, the display magnification determination unit may use a measurement distance (Lmax) having a maximum value among a plurality of measurement distances measured by the distance measurement unit as distance information for determining a display magnification.
In addition, the display magnification determination unit may calculate an average value of the measurement distance (Lmax) having the maximum value and the measurement distance (Lmin) having the minimum value among the plurality of measurement distances measured by the distance measurement unit, It may be distance information for determining the display magnification.

The present invention further includes a selection input unit that inputs an instruction for determining the display magnification, and a distance information display unit that displays selection information necessary for performing the instruction input, and the selection input unit Thus, when desired selection information among the displayed selection information is input, the display magnification determination unit may calculate distance information corresponding to the selection information input.
According to this, it is possible to easily change the setting of the distance information for determining the display magnification at the intention of the user.

Here, the selection information displayed on the distance information display unit is an information item including the identification symbol of the person recognized by the person recognition unit and the measurement distance measured by the distance measurement unit for each person, When either the person identification symbol or the measurement distance is instructed by the selection input unit, the display magnification determination unit determines the measurement distance for the input person or the input measurement distance itself to determine the display magnification. For this reason, the distance information may be determined.
According to this, the user can select the distance information that he considers appropriate while confirming the displayed information item.

Further, when the selection information displayed on the distance information display unit is an image captured by the imaging unit, and a person included in the captured image is input by the selection input unit, The display magnification determination unit may determine the measurement distance measured by the distance measurement unit with respect to the person who has input the instruction as distance information for determining the display magnification.
According to this, the user can visually select the distance information that he / she thinks appropriate while looking at the displayed captured image.

Further, the present invention determines a display angle for rotating the display unit based on the selection information input by the selection input unit, and changes the display angle for rotating the display screen of the display unit by the determined display angle. A display device characterized by further comprising a unit.
Here, the display angle is determined for each person recognized by the person recognition unit, and is an angle formed by a straight line connecting the face position of the person and the photographing unit and a perpendicular to the display screen.
According to this, the display unit can be rotated in a direction considered to be most easily seen by a specific person among a plurality of persons.

The selection information displayed on the distance information display unit is an information item including an identification symbol of a person recognized by the person recognition unit and a display angle for rotating the display unit with respect to each person. When the display angle is input by the unit, the angle changing unit rotates the display screen of the display unit by the display angle input by the instruction.
According to this, the user can select the display angle that he considers appropriate while confirming the displayed information item.

Further, the selection information displayed on the distance information display unit includes an identification symbol of the person recognized by the person recognition unit, a measurement distance measured by the distance measurement unit for each person, and the display unit for each person. And a display angle to be rotated. When the selection input unit inputs an identification symbol of a person displayed on the distance information display unit, the display magnification determination unit The measurement distance is determined as distance information for determining display magnification, and the angle changing unit sets the display angle for the person who is input as an instruction as the rotation angle of the display unit.
According to this, the user can easily determine the distance information for determining the display magnification and the rotation angle of the display unit simply by inputting the identification symbol of the person in the displayed information item. Can do both.

  According to the present invention, when the imaging unit includes a plurality of cameras and the display unit is viewed from different viewing angle directions with respect to the display screen of the display unit, the display unit displays the different information so that different information can be visually recognized. Are simultaneously displayed, each camera is attached to the display unit so that the shooting direction of each camera and each different viewing angle direction match, and the display magnification determination unit, for each image captured by each camera, In consideration of the position of a person included in each image, the display magnification of the information displayed with respect to the viewing angle direction that matches the shooting direction of the image is determined.

  According to the present invention, since the respective distances from the photographing unit to the plurality of persons looking at the display screen are measured, the magnification of the information to be displayed on the display unit is considered in consideration of the positions of the plurality of photographed persons. Thus, it is possible to easily change the display magnification to be considered appropriate.

Hereinafter, the present invention will be described in detail based on the embodiments shown in the drawings. In addition, this invention is not limited by this.
<Configuration of display device of the present invention>
FIG. 1 is a block diagram showing the configuration of an embodiment of a display device according to the present invention.
The display device of the present invention mainly includes a display unit 16 for displaying information such as images and documents, a photographing unit 12 for photographing a front space of the display screen of the display device, and a person recognition for recognizing a person in the photographed image. Unit 13, a distance measuring unit 14 for measuring the distance between the recognized person and the display device, and a display magnification determining unit 15 for determining a display magnification of information displayed on the display screen based on the measured distance.
In addition, the captured image 21, the distance magnification table 22 that defines the relationship between the measurement distance and the display magnification, the magnification determination condition 23 that defines the condition for determining the display magnification, and the display that is displayed on the display screen A storage unit 20 for storing information 24 and the like is provided.

In addition, it is preferable to include a distance information display unit 17 that displays the distance measured by the distance measurement unit 14 and the distance information including information (display angle) specifying the relative position of the person with respect to the display screen. However, a part of the display unit 16 may be used as the distance information display unit 17.
Furthermore, it is preferable to provide a display angle changing unit 19 for rotating the display screen of the display device in the horizontal direction.
In addition, it is preferable that the user of the display device includes a selection input unit 18 in order to input and input distance information for determining the display magnification by his / her own intention. Here, the distance information display unit 17 displays selection information necessary for inputting an instruction.
As the selection input unit 18, for example, a touch panel may be used in addition to a pointing device such as a keyboard, a mouse, and a pen.

The touch panel includes an LED array and a phototransistor array that are respectively arranged along the long side or the short side of the display screen of the distance information display unit 17.
The LED array is a plurality of LEDs arranged in parallel, and the phototransistor array is a plurality of photoelectric conversion elements arranged at positions facing each LED, and light is emitted from each LED of the LED array. It detects light. The point position on the touch panel is specified by pointing on the display screen with a touch pen.

  If the display screen has a horizontally long rectangular shape, for example, a set of array groups in which an LED array is arranged along the left short side and a phototransistor array is arranged along the right short side; Another set of array groups is used in which the LED array is arranged along the long side and the phototransistor array is arranged along the lower long side.

  In such a touch panel, when the touch pen is not operated, all the light emitted from the LED array is detected by the opposing phototransistor array. However, when the touch pen is operated to touch the display screen, the light passing through the touched position is blocked, so that the light to be detected is not detected by the phototransistor. Therefore, the position of the non-detected phototransistor can be specified as the operation position.

The selection information displayed on the distance information display unit 17 includes distance measurement information including information items as shown in FIG. 7 and a photographed image as shown in FIG.
Here, the information items include, for example, a person identification symbol recognized by the person recognition unit, a measurement distance measured by the distance measurement unit for each person, and a display angle for rotating the display unit for each person. Including. This information item is displayed as numerical information.

The control unit 11 of the present invention is a part that implements the functions of the present invention by operating each of the above functional blocks (12 to 20) as necessary. From the CPU, ROM, RAM, I / O controller, timer, etc. A microcomputer can be used.
The various functions of the present invention are realized by the CPU operating various hardware based on a control program stored in the ROM or RAM.
The control program is provided by being stored in a recording medium such as a CD, a DVD, a hard disk (HDD), or a memory card in addition to a semiconductor storage element such as a ROM, a RAM, or a flash memory.
For example, the control unit 11 applies the display magnification determined by the display magnification determination unit to enlarge or reduce the information to be displayed and display the information on the display unit.
The person recognition unit 13, the distance measurement unit 14, the display magnification determination unit 15, and the angle measurement unit 31 can be realized mainly by software processing by the CPU.

The photographing unit 12 (camera) is, for example, a CCD camera and is attached to a display device so as to widely photograph the front of the display screen of the display device.
For example, as shown in FIG. 3, the user sits in front of the display screen and shoots so that a plurality of persons who are looking at the display screen are all shown. As a situation where a large number of people view the display screen, for example, a presentation in a conference room or a video conference can be considered.
The image 21 photographed by the CCD camera is always stored in the storage unit 20 in real time.
The CCD camera may be fixedly installed at the upper center of the display device, for example.

Various display panels such as LCD, EL, and PDP can be used for the display unit 16.
Further, display information 24 stored in advance in the storage unit 20 is displayed on the display screen of the display unit 16.
The display information 24 includes various information such as documents, slides, images, graphs, photographs, and videos used in the presentation.

The person recognizing unit 13 identifies a portion of a person shown in the captured image 21 stored in the storage unit 20, and recognizes the position of the person's face, for example. A face image database is created in advance, and the person recognition unit 13 performs pattern matching with the face image database on the photographed image 21 as shown in FIG. 3 to identify the face portion, as shown in FIG. A recognition image specifying the position of the face is generated.
In FIG. 3, five persons (H1 to H5) are photographed. FIG. 4 is a recognition image in which the faces of these five persons are identified and the positions of the faces (1 to 5) are specified. .

The distance measurement unit 14 is a part that measures the distance between the camera 12 and each person using the recognition image of the face position specified by the person recognition unit 13.
For example, as shown in FIG. 2, distances (L1 to L5) from the camera are measured for five persons (H1 to H5) photographed by the camera 12. The distance may be calculated using, for example, a contrast detection method that is already used in a digital camera.

The display magnification determination unit 15 is a part that determines the display magnification of information displayed on the display unit from the measured distance, using the conditions specified in advance in the magnification determination condition 23 and the distance magnification table 22.
FIG. 5 shows an embodiment of the distance magnification table 22.
This table defines the correspondence between the measurement distance and the display magnification of the display information. The table 22 determines the display magnification of the information displayed on the display screen.
For example, in FIG. 5, when the measurement distance is 0 to 49 cm, it means that the display magnification is set to 1/4 of the normal magnification.

In general, when a person is relatively close to the display screen, the person can easily see the display information, so it can be often seen even if the display is reduced empirically.
Therefore, when giving priority to a person who is 49 cm or less from the display screen, the display information is reduced to a normal size and displayed.

In addition, when giving priority to a person located at a position about 150 cm to 199 cm away from the display screen, it means that the display is performed with a normal display size (1 time).
Further, in order to make it easy for a person at a position about 600 to 699 cm away from the display screen to view the display information, the display magnification is set to 4.5 times and a part of the display information is enlarged and displayed on the display screen.

However, the distance between each person who participates in many presentations and the display unit 16 is usually different, and the optimum distance cannot be determined uniquely.
When the reduced display is performed so that the person closest to the display unit can easily see, it is difficult for the person sitting far away to see the display information 24. On the other hand, if a part of the information 24 is enlarged and displayed so that the farthest person can easily see, it becomes easy for everyone to see the part, but the whole image of the information 24 becomes invisible.
Therefore, it is preferable to determine or change the display magnification in accordance with the situation such as the contents of explanation in the presentation, the size of displayed characters and figures, particularly the position (measurement distance) where a person wants to watch.
Therefore, some conditions for determining the display magnification may be prepared in advance so that it is possible to select which condition is adopted.

FIG. 6 shows an embodiment of the magnification determining condition 23 used in the present invention.
FIG. 6 exemplifies several conditions for determining the display magnification of the information displayed on the display screen. In particular, a plurality of criteria for calculating distance information for determining display magnification are determined. Any one of these conditions is selected and used.
For example, the condition J01 is set as an initial setting condition, and this condition J01 is normally used. However, the condition J01 may be changed to another condition as required by a user input operation. Each condition indicates a reference for calculating or selecting distance information for determining the display magnification.
The condition number J01 in FIG. 6 selects a measurement distance having a maximum value (Lmax) among the measured distances, and regards this maximum value (Lmax) as the distance in the distance magnification table 22 in FIG. This means that the display magnification is determined from this table 22. That is, the maximum measurement distance is used as distance information for determining the display magnification.
When this condition J01 is adopted, a display magnification is selected so that the person at the farthest position can easily see the display screen. For example, when the maximum value (Lmax) among the measured distances is 5 m, a display magnification of 4.0 is selected from the distance magnification table of FIG.

In condition J03, an average value of the distance (Lmin) of the closest person and the distance (Lmax) of the person farthest among the measured distances is obtained, and this is used as distance information for determining the magnification. Means that.
When this condition J03 is adopted, the image is displayed at a magnification that makes it easy to see a person at an intermediate position among many participants.

In the condition J04, an average value of measurement distances of all persons recognized in the captured image is adopted as selection distance information.
When the conditions J01 to J04 are adopted, the display magnification is automatically determined from the measurement distance, and the display information is further displayed at the determined display magnification.

On the other hand, the conditions J05 to J07 determine the display magnification by the selection input operation by the user.
Condition 05 means that the user directly selects and inputs a person in the captured image 21 displayed on the distance information display unit 17 using a touch pen.
For example, face information (H1 to H5) as shown in FIG. 4 is displayed on the distance information display unit 17, and the user points the position of desired face information using a touch pen. The pointed position is specified by blocking light emitted from the LED of the touch panel.

That is, since the position of the face information is already known by the processing of the person recognition unit 13, the face information area where the pointed position is located can be found from the position of the phototransistor that could not receive light.
For example, if the position pointed to by the user is the position of the face information H2, it means that the person H2 of the face information is used for display magnification determination. Then, a magnification corresponding to the measured distance information of the person H2 is selected using the distance magnification table 22, and is adopted as a display magnification.

In such a condition 05, the display magnification is usually determined using any one of the conditions 01 to 04. When a specific person wants to particularly see the currently displayed screen, the specific magnification is determined. This is effective when information is to be displayed on a person at an appropriate magnification.
Alternatively, if there is an objection that it is difficult for a specific person to see because the characters on the currently displayed screen are small, the condition 05 may be used. In this case, the specific person in the captured image 21 displayed on the distance information display unit 17 is selected and input with a touch pen, so that the specific person can be easily seen by simply performing an operation. It can be displayed again at the magnification.

Condition J06 means that the user directly selects and inputs the distance information.
In this case, measurement distance information as shown in FIG. 7 is displayed on the distance information display unit 17, and the identification symbol portion of the desired recognition person or the numerical value portion of the measurement distance is pointed with a touch pen. The measurement distance corresponding to the identified identification person symbol or the directly measured measurement distance is adopted as the distance for determining the magnification. Also in this case, the display magnification is determined using the table 22 of FIG.
According to this, the user selects the distance that the user thinks appropriate for the information 24 currently displayed on the display unit each time while directly checking the actual measurement distance value with his own eyes. can do.
In addition, the display angle of FIG. 7 is information used in the angle change process of the display part mentioned later.

Condition J07 means that the user selects or directly inputs the display magnification. When this condition is selected, a display magnification selection screen or a screen for directly inputting a numerical value is displayed on the distance information display unit 17, and the magnification candidate displayed with the touch pen is pointed, or a keyboard or a numeric keypad is used. The user inputs the magnification value directly.
In this case, the display magnification can be determined without referring to the table of FIG.
As described above, various conditions can be considered for the magnification determination condition 23, and conditions other than those shown in FIG. 6 may be applied.
Further, after the fact, in addition to the conditions (J01 to J07) prepared in advance, the user may newly create the magnification determination condition 23 itself.

  Furthermore, the distance magnification table 22 shown in FIG. 5 may adopt other criteria, such as the size of the conference room where the user presents, the number of participants, and other screens of the display unit to be connected. The relationship between the distance and the magnification may be set and changed as appropriate based on a criterion such as the size of.

  The distance information display unit 17 displays information necessary for the user of the display device of the present invention as described above. For example, the distance information display unit 17 displays images such as FIG. 3 and FIG. Is displayed. Therefore, it is preferable to use a display screen different from the display unit 16 viewed by the participants of the presentation. However, a separate window is provided in a partial area of the display unit 16, for example, a small area at the lower right, and this window is used. The distance information display unit 17 may also be used. This separate window is preferably displayed or deleted by a specific operation of the user.

The display angle change unit 19 mainly includes an angle measurement unit 31, a change angle instruction unit 32, and a display screen rotation unit 33.
For example, when a presentation is performed in a conference room, the relative positions of the display unit 16 and the participants (H1 to H5) are set as shown in FIG. 2, and five participants are sitting in front of the display unit. . At this time, the display angle changing unit 19 is a part that rotates the display unit 16 as shown in FIG. 8 based on a user's instruction input.

The change angle instruction unit 32 is a part for instructing the rotation angle of the display unit, and the display screen rotation unit 33 is a part for rotating the display unit 16 in the horizontal direction by an angle corresponding to the instructed rotation angle.
The display screen rotation unit 33 is composed of, for example, a rotary motor having a rotation axis at the center of the display unit 16 to which the camera is attached. Rotate.

The angle measuring unit 31 is a part for obtaining an angle from a horizontal perpendicular perpendicular to the display screen with respect to the position of each person recognized by the person recognizing unit 13. In FIG. 2, a straight line indicated by a broken line is a horizontal perpendicular to the display screen.
In FIG. 2, the angle formed between the straight line indicating the straight line distance L3 between the person H3 and the camera 12 and the horizontal perpendicular corresponds to the display angle to be measured.
Further, the display angle shown in FIG. 7 corresponds to the angle measured by the angle measuring unit 31.
FIG. 7 shows the recognized display angles (angles from the horizontal perpendicular) of the five participants.

The display angle in FIG. 7 is shown with a positive angle in the direction opposite to the clockwise direction from the horizontal perpendicular line in FIG. 2 and a negative angle in the same direction as the clockwise direction.
In FIG. 7, for example, it means that the person H1 is sitting at a position shifted from the horizontal perpendicular by an angle of 30 degrees in the direction opposite to the rotation direction of the watch.

The angle change instruction unit 32 instructs the display angle in the measurement distance information as shown in FIG. 7 displayed on the distance information display unit 17. For example, the user uses a touch pen to display the numerical value of the display angle. The rotation angle to be changed is instructed and input. The input angle is given to the display screen rotation unit 33, and the display unit is rotated based on the angle.
Alternatively, as described in the condition J05, the rotation angle may be instructed by pointing the position of the person with the touch pen while the captured image 21 as shown in FIG. 3 or FIG. 4 is displayed. .

For example, when the display angle “+15” of the person H3 is pointed in the state where FIG. 7 is displayed, this means that the display unit 16 is rotated by 15 degrees in the opposite direction to the clock. 33 rotates the display unit 16 until the positional relationship shown in FIG. At this time, the display screen is oriented to face the person H3.
By rotating in this way, the display screen is oriented in the direction that is most visible to the person H3.

Further, when changing the display angle, not only the display unit 16 is simply rotated, but also the display magnification may be changed at the same time in conjunction with the measurement distance shown in FIG. That is, in FIG. 7, when the person symbol “H3” of the person H3 is pointed, the measurement distance “2.0 m” corresponding to the person H3 and the corresponding display angle “+15 degrees” are extracted and extracted. The display magnification is determined from the measured distance, and the direction and angle for rotating the display unit are determined from the extracted display angle.
Then, as shown in FIG. 8, the display magnification of the information displayed on the display screen is changed and displayed almost simultaneously with the rotation of the display unit.

For example, in the state shown in FIG. 8, the position of the display unit is changed to an angle that is most easily viewable for the person H3, and information is displayed on the screen at a display magnification that is considered to be most easily viewable for the person H3.
Therefore, by changing the display angle and changing the display magnification in correspondence with the position of the recognized specific person, the display contents of the presentation can be displayed in an appropriate state for a specific person who wants to see the presentation. Information can be displayed.

<Example 1>
An embodiment of the display magnification determination process for the display device according to the present invention will be described below.
FIG. 9 shows a flowchart of the display magnification determination process according to the first embodiment of the present invention.
In step S1 in FIG. 9, necessary conditions and data are initially set. For example, selection of a magnification determination condition, change of a distance magnification table, and the like.
If there is only one magnification determination condition, it may be selected. However, if there are a plurality of conditions as shown in FIG. 6, the user decides whether to use the predetermined condition or which should be selected. You just have to input it.
When it is desired to change the relationship between the distance and the magnification in the distance magnification table 22, the user may directly input the numerical value of the distance or magnification to be changed.

In step S <b> 2, the camera 12 captures an image and records it in the storage unit 20.
In step S3, person recognition is performed using the captured image 21. Here, if there is an image that looks like a person in the captured image, it is cut out, face information is generated from the cut out image, and the position of the face is recognized.
For the recognition of the face position, for example, pattern matching processing using a neural network may be used.
Specifically, when a database storing a large number of face images is provided and the number of shooting pixels is 1000 × 1000 pixels, for example, an area of a size of 100 pixels × 100 pixels is cut out as one unit, Pattern matching between the image and the face image database is performed. The unit matrix region (100 × 100) is moved in the X and Y directions of the captured image, and pattern matching is sequentially performed on images in different matrix regions.

If there is a matrix area having an image that can match the image in the face image database by pattern matching, the matrix area is determined as the face position.
Such face position determination by pattern matching is performed for the entire captured image 21, and the position of the matched matrix region is stored.
For example, as shown in FIG. 2, when five persons (H1 to H5) are located, a photographed image 21 as shown in FIG. 3 is taken, and five face positions (1 to 5) as shown in FIG. It is determined that there is.

In step S4, the distance from the position of the camera 12 to each face position is measured.
For example, in the case of FIG. 2, the distances (L1 to L5) from the camera to five persons are measured. This distance measurement can use an autofocus technique called a “contrast detection method”.
Specifically, the camera is provided with a lens moving means, and the lens is moved so that the contrast of the image of the detected face position becomes the highest, and from the position of the lens with the highest contrast, the camera and each person's face position are determined. The distance is calculated.
For example, the lens position of the camera is moved back and forth, and an image is taken at each lens position. Next, for each captured image, the difference in luminance between adjacent pixels is accumulated in the matrix area of the face position portion that has already been detected. The accumulated luminance difference is compared between images taken by moving the lens.

In this comparison, since the lens position corresponding to the image with the highest cumulative value is the position with the highest contrast, the lens position is regarded as the most focused position with respect to the photographing target (face). Furthermore, the distance from the camera to the subject (face) can be calculated from the information on the lens position that is regarded as the focused position.
For example, when such distance measurement is applied to the images of FIGS. 2 and 3 in which five persons (H1 to H5) exist, five measurement distances as shown in FIG. 7 are calculated.

In step S5, distance information for determining display magnification is selected from the calculated measurement distances based on a magnification determination condition selected in advance. Alternatively, distance information for determining the display magnification is calculated using the measured distance.
For example, when the condition J01 in FIG. 6 is selected, the longest (maximum value: Lmax) of the calculated measurement distances is selected as the distance information for determining the display magnification.
Considering the five measurement distances in FIG. 7, in the case of the condition J01, the measurement distance 2.0 m of the person H3 is selected as the distance information for determining the display magnification.
When the condition J03 in FIG. 6 is selected, the average value of the maximum value (Lmax) and the minimum value (Lmin) of the measurement distance is calculated.
In the case of FIG. 7, since Lmax = 2.0 m and Lmin = 0.5 m, the average value (2 + 0.5) /2=1.25 m is calculated as distance information for determining the display magnification.

In step S6, the display magnification is determined.
Here, using the distance magnification table 22 as shown in FIG. 5, the magnification corresponding to the distance selected or calculated in step S5 is selected as the display magnification.
For example, for the distance (2.0 m) selected in the condition J01, the magnification 2.0 is selected as the display magnification. For the distance (1.25 m) calculated in the condition J03, the magnification 1/2 is selected as the display magnification.

In step S7, the display magnification of the information 24 displayed on the display unit 16 is changed using the determined display magnification.
For example, when the display magnification of 2.0 is selected, the display information 24 is enlarged twice, and only a part of the information 24 to be displayed is displayed on the display unit 16. When the determined display magnification is 1/2, the display information is reduced to 1/2 and displayed on the display unit 16. Thereafter, the process returns to step S2, and the same processing is repeated.
With the above processing, the display magnification of the information displayed on the display unit can be appropriately and almost automatically adjusted in consideration of the positions of a plurality of photographing subjects.

<Example 2>
Here, an embodiment will be described in which a distance for determining the display magnification is selected using a touch panel.
In the second embodiment, when the captured image 21 is displayed on the distance information display unit 17 and there is no user's selection input using the touch panel, the display magnification is determined by the same process as in the first embodiment of FIG. When the user selects and inputs the face position of a person recognized by shooting using the touch panel, the distance corresponding to the face position of the person is set as the display magnification.

FIG. 10 shows a flowchart of the display magnification determination process according to the second embodiment of the present invention.
In FIG. 10, the processing of each block in steps S1 to S7 is the same as that in the first embodiment in FIG.
Since steps S11, S12, and S13 in FIG. 10 are different from those in the first embodiment, the different processes will be described below.

In step S <b> 11, the image 21 photographed in step S <b> 2 is displayed on the screen of the distance information display unit 17. For example, the captured image 21 shown in FIG. 3 is displayed. Or you may display the image which consists only of face positions as shown in FIG.
The user looks at the image displayed on the distance information display unit 17 and selects and inputs the person who thinks that the display magnification to be changed is appropriate or the face position using the touch pen.

In step S12, it is checked whether or not there is such user touch input. When there is a touch input, the process proceeds to step S13, and when there is no touch input, the process proceeds to step S5.
For example, if the user points to the person H3 with a touch pen while the image as shown in FIG. 3 is displayed, it can be understood that the user's selection input has been made by the position detection function of the touch panel.

In step S13, a distance corresponding to the face position of the person selected by the user is selected.
Here, in step S3, since all face positions are already known, it is possible to know which person's face position is the position touched by the user.
If the person at the touch input position is known, the distance from the camera to the person's face position can be obtained from the distance already measured in step S4. Therefore, the distance of the face position of the person touch-inputted by the user is obtained from the distance in step S4, and this distance can be selected as distance information for determining the display magnification.
Thereafter, the distance selected in step S13 is used for determining the display magnification in step S6.

As described above, in the second embodiment, the display magnification is determined based on the selection input by the user, not based on the preset condition.
In particular, the user can determine the display magnification only by making an easy selection input on the image while viewing the captured image, and does not place an operation burden on the user.

In the above description, the embodiment has been described in which the photographed image 21 as shown in FIG. 3 is displayed on the distance information display unit 17 and the user performs touch input. However, the distance information display unit 17 as shown in FIG. The measurement distance information may be displayed, and the user may touch-input the numerical value of the measurement distance or the identification symbol portion of the recognized person.
For example, when the user points with the touch pen over the measurement distance value “1.7”, the measurement distance “1.7 m” may be used as the distance for determining the display magnification.

<Example 3>
Here, an example will be described in which a touch panel is used to select a distance for determining the display magnification and to select a rotation angle of the display unit.
That is, in the third embodiment, the user selects and displays the distance for determining the display magnification by performing one input for selecting the display item displayed on the distance information display unit 17 using the touch panel. The rotation angle of the part is selected.

FIG. 11 is a flowchart of the display magnification determination process according to the third embodiment of the present invention.
Here, the processing of each block in steps S1 to S7 is the same as in the first embodiment of FIG.
Hereinafter, processing in steps S21 to S26 different from the first embodiment will be described.

In step S21, the display angle of the face position is measured.
The display angle is obtained using the face position information obtained in step S3. The angle formed between the horizontal perpendicular line shown in FIG. 2 and the straight line obtained from the face position and the distance to the camera corresponds to the display angle.
The measured display angle is stored in the measurement distance information as shown in FIG.
The display angles of five (H1 to H5) participants as shown in FIG. 2 are numerical values as shown in FIG. 7, for example.

In step S <b> 22, the measurement distance information (selection information) is displayed on the screen of the distance information display unit 17. Here, information as shown in FIG. 7 including the display angle is displayed.
The user can see the measurement distance information as shown in FIG. 7 and consider which person to adjust the display magnification and the display angle. However, when the numerical information as shown in FIG. 7 is displayed, the actual distance and the display angle of the participant can be understood, but intuitively it is possible to know who the data of the numerical information displayed in the list is the participant's data. Difficult to grasp. Therefore, as in the second embodiment, instead of displaying the numerical information in FIG. 7, the captured image 21 as shown in FIG. 3 may be displayed in order to visually grasp the person. Alternatively, the numerical information of FIG. 7 may be superimposed on the captured image 21 and displayed in the same screen. Alternatively, a straight line may be displayed in the camera position direction from each person image in the captured image 21, and numerical values of the measurement distance and display angle of the person may be displayed on or near each straight line.
The user confirms the displayed measurement distance information and points one of the displayed items with the touch pen. The position of the pointed display item becomes information for determining the display magnification and the rotation angle.

In step S23, it is checked whether or not the user has touch-inputted any of the display items displayed on the distance information display unit 17.
For example, when there is no touch input within a certain time after display, the user thinks that there is no intention to change the display magnification, etc., and proceeds to step S5, and determines the display magnification based on a preset condition. To do.

On the other hand, if it is confirmed that a touch input has been made on the touch panel, the process proceeds to step S24.
For example, in the displayed measurement distance information of FIG. 7, when “H4” is pointed out of the identification symbol of the recognized person, this means that the person H4 has been selected, and this person H4 is easy to see. In order to change to such display magnification and display angle, steps S24 and S25 are executed. In this case, selecting the person H4 means that 1.7 m is selected as the measurement distance and −18 degrees is selected as the display angle.

Further, in FIG. 7, when the numerical part of the measurement distance is pointed, only that numerical value is selected, which means that the display magnification is changed to the magnification corresponding to the pointed measurement distance, and the display angle is changed. do not do. That is, the display unit is not rotated (step S26), and only the information is enlarged or reduced based on the change of the display magnification.
In addition, in FIG. 7, when the numerical value portion of the display angle is pointed, only the numerical value of the display angle is selected, only the display unit corresponding to the pointed display angle is rotated, and the display magnification is changed. Means no. That is, the size of the information displayed on the display unit is kept as it is, and the display unit is rotated by the selected angle.
As described above, when the measurement distance information of FIG. 7 is displayed, the user selects whether to change both the display magnification and the display angle or only one of them depending on the position to be pointed. can do.
On the other hand, when the captured image 21 of FIG. 3 is displayed, both the display magnification and the rotation angle can be changed at the same time by only pointing the person portion once.

In step S24, a display magnification corresponding to the selected display item is selected.
For example, in FIG. 7, when the identification symbol portion of the person “H2” is pointed, the measurement distance “1.0 m” corresponding to the person H2 is selected, and the distance magnification table 22 of FIG. The magnification “1/2” corresponding to the distance (1.0 m) is selected.

When the numerical portion of the measurement distance in FIG. 7 is pointed directly, a magnification corresponding to the pointed measurement distance is selected from the distance magnification table 22.
However, when the numerical value portion of the display angle in FIG. 7 is pointed, the process of step S24 is not executed or the same magnification as the currently set display magnification is selected.

In step S25, the rotation angle corresponding to the selected display item is selected.
For example, in FIG. 7, when the identification symbol portion of the person “H5” is pointed, the display angle “−24 degrees” corresponding to the person H5 is selected as the rotation angle.
When the numerical value portion of the display angle in FIG. 7 is pointed directly, the pointed numerical value is selected as it is as the rotation angle. However, when the numerical part of the measurement distance in FIG. 7 is pointed, the process of step S25 is not executed or the current rotation angle is not changed.

In step S26, the display unit is rotated based on the selected rotation angle.
For example, when the display angle “+15 degrees” of the person “H3” is selected, the display unit 16 is rotated as shown in FIG. However, when the rotation angle is not changed, the display unit is not rotated.

  In step S7, the information displayed on the display unit is enlarged or reduced based on the display magnification selected in step S24. However, if the magnification is not changed in step S24, the display state is not changed.

As described above, in the third embodiment, both the display magnification and the display angle can be selected by one touch input by the user.
Also, depending on the position of the display item to be pointed at the touch input, whether to change only the display magnification, only the display angle, or both, is selected by the user's intention. Can do.
Further, in the third embodiment, it is possible to adjust the display magnification and the display angle of the display unit that the user considers appropriate in a presentation or the like where a large number of people participate.

  In the case where there is no touch input in step S23 of FIG. 11, the process proceeds to step S5, and an embodiment in which only the display magnification is determined based on a predetermined magnification determination condition as in the first embodiment. Although shown, an angle determination condition similar to that of FIG. 6 may be set in advance for the display angle, and the display unit may be rotated based on any of the angle determination conditions.

  For example, when the maximum value (Lmax) of the measurement distance of the condition J01 in FIG. 6 is selected, the display angle of the person whose measurement distance is the maximum value (Lmax) is adopted as the rotation angle, and the display unit May be rotated by the rotation angle. In this case, information is automatically displayed at a display magnification corresponding to the person whose measurement distance is the maximum value (Lmax), and the display unit is rotated in the direction in which the person is present.

<Example 4>
Here, an embodiment using a dual view display as the display unit 16 will be described.
The dual view display is a display that simultaneously displays a plurality of pieces of image information on one display screen. For example, when two different images (A, B) are displayed simultaneously, the dual view display is on the display surface of the display unit. A participant in the viewing angle direction can see image A, and a participant in another viewing angle direction can see the other image B.
Conversely, a participant who is viewing image A cannot see image B, and a participant who is viewing image B cannot see image A.

That is, different images are simultaneously displayed on the display unit so that different information can be viewed when the display unit is viewed from different viewing angle directions with respect to the display screen of the display unit.
As the dual view display, for example, the one described in Japanese Patent Application Laid-Open No. 2005-284592 can be used.

Therefore, in the case of a dual view display, there is one display unit for displaying information, but it appears that different information is displayed depending on the direction (viewing angle direction) in which the display screen of the display unit is viewed.
If such a dual view display is adopted, for example, a display viewed by the left three participant groups (H1, H2, H3) in a state where there are participants (H1 to H5) as shown in FIG. Information (referred to as information A) and display information (referred to as information B) viewed by the two right participant groups (H4, H5) can be differentiated.
In particular, even if the information A and the information B are the same information, the information A and the information B can be displayed with different display magnifications.

FIG. 12 shows an explanatory diagram of the relationship between the display unit and the object to be photographed in the fourth embodiment of the present invention.
In FIG. 12, the participant group (H1, H2, H3) on the left side of the horizontal vertical line can see information A on the display unit 16, and the participant group (H4, H5) on the right side of the horizontal vertical line is displayed on the display unit. 16, information B is visible.
Here, as the photographing unit 12, two cameras (A, B) are provided, and the camera A photographs the viewing angle direction including the left participant group (H1, H2, H3). The viewing angle direction including the right participant group (H4, H5) is photographed.
As shown in FIG. 12, the shooting direction of the camera A that is the upper left direction matches the viewing angle direction (display direction) in which the information A can be seen, and the shooting direction of the camera B that is the upper right direction and the viewing angle direction in which the information B can be seen ( Cameras A and B are installed so that the display direction matches.

  Then, for each image captured by camera A and camera B, the series of processes (steps S2 to S7) shown in FIG. 9 is performed, and an appropriate display magnification A is determined for the image captured by camera A, Information A is displayed at the determined display magnification A, an appropriate display magnification B is determined for the image captured by the camera B, and information B is displayed at the determined display magnification B.

Here, the display magnification A and the display magnification B are determined as appropriate values depending on the number, position, and measurement distance of persons in the images captured by the respective cameras.
In other words, the display magnification is determined for each image captured by each camera, and in consideration of the position of a person included in each captured image, the viewing angle direction matches the image capturing direction of each image. The display magnification of the information displayed is determined separately.

For example, when there are many persons in the left viewing angle direction and there are persons farther away, the display magnification A of the information A is set larger so that the person farthest away can easily see the information A Is enlarged.
On the other hand, when a small number of persons are relatively close to the display unit in the right viewing angle direction, the display magnification B of the information B is set to be smaller than the reference, and the information B is reduced and displayed.
Thus, if the display magnification (A, B) of two information (A, B) displayed on the same display part 16 is adjusted separately based on the state of the participant in each direction, it will be displayed. It is possible to display more appropriate information for each group of persons with different viewing angle directions.

1 is a configuration block diagram of an embodiment of a display device of the present invention. It is explanatory drawing of one Example of the relationship between the display part of this invention, and imaging | photography object. It is explanatory drawing of one Example of the picked-up image of this invention. It is explanatory drawing of the face image created from the picked-up image of this invention. It is explanatory drawing of one Example of the distance magnification table of this invention. It is explanatory drawing of one Example of the magnification determination conditions of this invention. It is explanatory drawing of one Example of the measurement distance information of this invention. It is explanatory drawing of one Example of the display angle change process with respect to the display part of this invention. It is a flowchart of the display magnification determination process of Example 1 of this invention. It is a flowchart of the display magnification determination process of Example 2 of this invention. It is a flowchart of the display magnification determination process of Example 3 of this invention. It is explanatory drawing of the relationship between the display part of Example 4 of this invention, and imaging | photography object.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Control part 12 Image | photographing part 13 Person recognition part 14 Distance measurement part 15 Display magnification determination part 16 Display part 17 Distance information display part 18 Selection input part 19 Display angle change part 20 Storage part 21 Captured image 22 Distance magnification table 23 Magnification determination condition 24 Display information 31 Angle measurement unit 32 Change angle instruction unit 33 Display screen rotation unit

Claims (14)

A shooting unit for shooting an image including a plurality of persons;
A display unit on which information is displayed on a display screen, and the photographing unit is attached so as to photograph a front space of the display screen;
A distance measuring unit that measures a distance between each of the plurality of persons included in the image captured by the imaging unit and the imaging unit;
A display magnification determining unit that determines a display magnification of information displayed on a display screen in consideration of the positions of a plurality of persons photographed using the plurality of measured distances;
A display device comprising: a control unit that applies the determined display magnification to display information to be displayed on the display unit. A shooting unit for shooting an image including a plurality of persons;
A display unit on which information is displayed on a display screen, and the photographing unit is attached so as to photograph a front space of the display screen;
A distance measuring unit that measures a distance between each of the plurality of persons included in the image captured by the imaging unit and the imaging unit;
A storage unit storing a distance magnification table that defines a relationship between the measurement distance and display magnification of display information;
Based on a predetermined magnification determination condition, the distance information for determining the display magnification of the information displayed on the display screen is calculated from the plurality of measured distances, and the distance magnification table is used to calculate the distance information. A display magnification determining unit for determining a display magnification of display information corresponding to the calculated distance information;
A display device comprising: a control unit that applies the determined display magnification to display information to be displayed on the display unit. Using an image captured by the imaging unit, further comprising a person recognition unit that identifies a plurality of person parts included in the image and recognizes the face position of each person;
The display device according to claim 2, wherein the distance measurement unit measures a distance between each face position recognized by the person recognition unit and the photographing unit.   3. The display according to claim 2, wherein the magnification determination condition is stored in the storage unit in advance, and the magnification determination condition includes a plurality of criteria for calculating distance information for determining the display magnification. apparatus.   3. The display magnification determination unit according to claim 2, wherein a measurement distance having a maximum value among a plurality of measurement distances measured by the distance measurement unit is used as distance information for determining a display magnification. Display device.   The display magnification determination unit calculates an average value of a measurement distance (Lmax) having a maximum value and a measurement distance (Lmin) having a minimum value among a plurality of measurement distances measured by the distance measurement unit, as a display magnification. The display device according to claim 2, wherein the distance information is used for determining the distance. A selection input unit for inputting an instruction for determining the display magnification; and a distance information display unit for displaying selection information necessary for performing the instruction input,
When desired selection information among the displayed selection information is input by the selection input unit, the display magnification determination unit calculates distance information corresponding to the selection information input. The display device according to claim 2.   The selection information displayed on the distance information display unit is an information item including an identification symbol of a person recognized by the person recognition unit and a measurement distance measured by the distance measurement unit for each person, and the selection input When either the person identification symbol or the measurement distance is instructed and input by the unit, the display magnification determining unit uses the measurement distance for the instructed person or the input measurement distance itself as the distance for determining the display magnification. The display device according to claim 7, wherein the information is determined.   When the selection information displayed on the distance information display unit is an image photographed by the photographing unit, and a person included in the photographed image is input by the selection input unit, the display magnification The display device according to claim 7, wherein the determination unit determines the measurement distance measured by the distance measurement unit with respect to the person whose instruction is input as distance information for determining display magnification.   A display angle changing unit for determining a display angle for rotating the display unit based on the selection information input by the selection input unit and rotating the display screen of the display unit by the determined display angle; The display device according to claim 7, characterized in that:   The display angle is determined for each person recognized by the person recognition unit, and is an angle formed by a straight line connecting the face position of the person and a photographing unit and a perpendicular to the display screen. 10 display devices.   The selection information displayed on the distance information display unit is an information item including an identification symbol of the person recognized by the person recognition unit and a display angle for rotating the display unit with respect to each person, by the selection input unit The display device according to claim 10, wherein, when a display angle is input as an instruction, the angle changing unit rotates the display screen of the display unit by the display angle input as an instruction.   The selection information displayed on the distance information display unit rotates the identification symbol of the person recognized by the person recognition unit, the measurement distance measured by the distance measurement unit for each person, and the display unit for each person. When the identification input of the person displayed on the distance information display unit is instructed and input by the selection input unit, the display magnification determination unit is configured to measure the distance to the person input and input. The display device according to claim 10, wherein the angle change unit determines the display angle with respect to the person input as an instruction to be a rotation angle of the display unit. The imaging unit is composed of a plurality of cameras, and when the display unit is viewed from different viewing angle directions with respect to the display screen of the display unit, the display unit displays the different information simultaneously so that different information can be visually recognized. Each camera is attached to the display unit so that the shooting direction of each camera and each different viewing angle direction match.
For each image captured by each camera, the display magnification determination unit considers the position of a person included in each image, and displays information displayed with respect to the viewing angle direction that matches the image capturing direction of the image. 3. The display device according to claim 2, wherein display magnifications are respectively determined.

Images