JP2013211714A - Display device, control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce a load on a viewer by controlling a rotating table so that a monitor screen is directed to a human confrontation position on the basis of eye positions.SOLUTION: A control device 10 comprises: a detection unit 11c that detects an inclination angle of a viewer's face from a detection area of the viewer's face included in an image captured by an imaging device 20; a determination unit 12 that determines a rotation angle of a monitor 40 for displaying an image so that the angle detected by the detection unit 11c comes close to 0°; and an instruction unit 13 that generates a pulse for rotating a motor in accordance with the rotation angle received from the determination unit 12.

Description

  The present invention relates to a display device, a control method, and a program.

  A method of reducing the burden on the viewer when viewing a monitor screen of a television or the like is known. For example, based on the eyeball position detected by the image recognition processing, a signal for controlling the angle of the turntable is output so that the monitor screen faces the human facing position. A technique for controlling the above is known.

JP 2009-94723 A

  For example, consider a case where the turntable is controlled based on the eyeball position so that the monitor screen faces the human facing position. It is difficult to maintain the same posture for a long time. In addition, there are cases where viewing is desired in a lying position.

  In one aspect, the present invention aims to reduce the burden on the viewer.

  In order to achieve the above object, a disclosed control device is provided. This control apparatus has a detection part and a determination part. The detection unit detects the tilt angle of the viewer's face from the viewer's face detection area included in the image captured by the imaging device. The determination unit determines the rotation angle of the monitor that displays the image so that the angle detected by the detection unit approaches 0 °.

  In one aspect, the burden on the viewer can be reduced.

It is a block diagram which shows the function of the display apparatus of 1st Embodiment. It is a figure which shows the external shape of a display apparatus. It is a figure explaining operation | movement of a display apparatus. It is a flowchart which shows the process of a control apparatus. It is a flowchart which shows an inclination detection process. It is a figure which shows the hardware constitutions of a control apparatus. It is a block diagram which shows the function of the display apparatus of 2nd Embodiment. It is a figure explaining spectacles. It is a flowchart which shows the inclination detection process of 2nd Embodiment.

Hereinafter, a display device according to an embodiment will be described in detail with reference to the drawings.
<First Embodiment>
FIG. 1 is a block diagram illustrating functions of the display device according to the first embodiment, and FIG. 2 is a diagram illustrating an outer shape of the display device. In FIG. 2, the X, Y, and Z axis directions perpendicular to each other are defined. The XY plane is a plane parallel to the ground.

  As illustrated in FIG. 1, the display device 1 according to the first embodiment includes a control device (computer) 10, an imaging device 20, motors 31, 32, 33, and a monitor 40. The monitor 40 is connected to a graphic processing device (not shown) that displays an image on the screen of the monitor 40 in accordance with a command from a CPU (Central Processing Unit) (not shown). Examples of the monitor 40 include a device using a CRT (Cathode Ray Tube), a liquid crystal display device, and the like. As shown in FIG. 2, the monitor 40 is installed on a base 51 via support parts 52 and 53. A rotation shaft 54 parallel to the Z axis is embedded in the support portion 52. A rotation shaft 55 parallel to the X axis is embedded in the distal end portion of the support portion 53. In addition, a rotation shaft 56 parallel to the Y axis is embedded in the support portion 53.

Returning again to FIG.
The imaging device 20 is attached to the monitor 40 so that the imaging element is positioned on the display surface side of the monitor 40. Examples of the image sensor include a charge coupled device (CCD) image sensor and a complementary metal oxide semiconductor (CMOS) image sensor. The imaging device 20 periodically captures images and sends the captured images to the control device 10.

The control device 10 includes an inclination detection unit 11, a determination unit 12, and an instruction unit 13.
The inclination detection unit 11 includes a preprocessing unit 11a, an identification unit 11b, and a detection unit 11c.

The preprocessing unit 11a removes a noise component of an image captured by the imaging device 20. For example, a median filter can be used to remove the noise component.
The identification unit 11b performs a differentiation process on the image processed by the preprocessing unit 11a, and extracts a rectangular region indicating a facial region by pattern matching with facial feature parts prepared in advance in the control device 10. . For example, the Viola-Jones method can be used as a method for extracting the face region.

The detection unit 11c detects an inclination angle of the face area extracted by the identification unit 11b with respect to the ground.
In the following description, the coordinate system of the image captured by the imaging device 20 is expressed by an xy coordinate system different from the XYZ coordinate system in FIG. 2, and the lower left of the image is set to the origin (0, 0). The determination unit 12 compares the center coordinates (x1, y1) of the image captured by the imaging device 20 with the face position coordinates (x2, y2). For example, the face position coordinates are set to the coordinates of the center point of the edge identified by the identification unit 11b. When the absolute value of (x1−x2) is greater than or equal to a threshold value prepared in advance, the determination unit 12 sends the difference value to the instruction unit 13. In addition, when the absolute value of (y1−y2) is equal to or greater than a predetermined threshold value, the determination unit 12 sends the difference value to the instruction unit 13.

  Further, the determination unit 12 extracts the most frequent value of the face inclination angle obtained by the inclination detection unit 11 executing the process a plurality of times. The determination unit 12 sends the face inclination angle to the instruction unit 13 when the most frequent value of the face inclination angle is larger than a threshold value prepared in advance (hereinafter referred to as a first threshold value). On the other hand, when the most frequent value of the face tilt angle is equal to or smaller than the first threshold value, the determination unit 12 ends the process without sending the face tilt angle to the instruction unit 13.

  The instruction unit 13 generates a pulse based on the face inclination angle and the difference value received from the determination unit 12. Then, it is sent to the motors 31, 32, 33. The interval at which the instruction unit 13 sends pulses to the motor is, for example, every second.

  The motors 31, 32, and 33 are stepping motors, and the motors 31, 32, and 33 rotate based on pulses received from the control device 10. The motors 31, 32, and 33 are attached to rotation shafts 54, 55, and 56 for rotating the monitor 40 in the X, Y, and Z axis directions perpendicular to each other. The rotation shaft that rotates the monitor 40 rotates as the motors 31, 32, and 33 rotate.

Next, the processing of the instruction unit 13 will be described in detail with reference to FIG.
When the instruction unit 13 receives the difference value (x1−x2) from the determination unit 12, that is, the distance in which the position coordinates of the face are prepared in advance in the X-axis direction from the center of the image captured by the imaging device 20. When the distance is more than the above, as shown in FIG. 2A, the instruction unit 13 generates a pulse for rotating the motor 31 connected to the rotation shaft 54 parallel to the Z axis so that the difference value becomes zero. To do. As a result, the motor 31 rotates and the monitor 40 rotates in a direction parallel to the XY plane.

  When the instruction unit 13 receives the difference value (y1-y2) from the determination unit 12, that is, the distance at which the face position coordinates are prepared in advance in the Z-axis direction from the center of the image captured by the imaging device 20. 2B, the instruction unit 13 generates a pulse for rotating the motor 32 connected to the rotation shaft 55 parallel to the X axis so that the difference value becomes 0, as shown in FIG. To do. As a result, the motor 32 rotates and the monitor 40 rotates in a direction parallel to the YZ plane.

  When the face inclination angle is equal to or larger than the threshold value, the instruction unit 13 generates a pulse for rotating the motor 33 connected to the rotation shaft 56 parallel to the Y axis, as shown in FIG. As the number of pulses to be generated, for example, a value obtained by rounding off the one's place of an integer obtained by rotation angle / 0.36 is obtained. If the obtained value is positive, a pulse that rotates counterclockwise is generated, and if it is negative, a pulse that rotates clockwise is generated. As a result, the motor 33 rotates and the monitor 40 rotates in a direction parallel to the XZ plane.

  Whether or not the motors 31, 32, and 33 are to be rotated can be arbitrarily set by the viewer or the like using, for example, a remote controller (not shown). For example, the function of the control device 10 can be set so that the motor 31 does not rotate even if the face position coordinates are separated from the center of the image captured by the imaging device 20 by a distance prepared in advance in the X-axis direction. it can.

Hereinafter, the operation of the display device 1 will be described using a specific example.
FIG. 3 is a diagram for explaining the operation of the display device.
FIG. 3A shows an image 21 in which noise is removed by the preprocessing unit 11a with respect to an image captured by the imaging device 20 when the body and face of the viewer 60 are directly facing the monitor 40. FIG. The identification unit 11b extracts a rectangular area 21a indicating a face area from the image 21. In the image 21, the detection unit 11c determines that the detected face inclination angle is 0 °.

  The determining unit 12 determines that the x-coordinate of the face position coordinate p1 (x2, y2) in the image 21 is a distance prepared in advance in the X-axis direction from the center coordinate p0 (x1, y1) of the image captured by the imaging device 20. Judge that it is not far away. Further, the determination unit 12 determines that the y coordinate of the face position coordinate p1 is not separated from the center coordinate p0 by a distance prepared in advance in the Z-axis direction.

Therefore, the determination unit 12 ends the process without sending the face inclination angle and the difference value to the instruction unit 13.
As illustrated in FIG. 3B, when the imaging device 20 captures an image when the face of the viewer 60 is facing the monitor 40 and the face is tilted to the right, the captured image 22 includes , A viewer with a tilted face is shown. When the determination unit 12 determines that the face inclination angle is equal to or greater than the first threshold, the determination unit 12 sends the face inclination angle to the instruction unit 13 as illustrated in FIG.

  The determination unit 12 determines that the x-coordinate of the face position coordinate p2 in the image 22 is more than a distance prepared in advance in the X-axis direction from the center coordinate p0, and determines the difference value of the x-coordinate to the instruction unit 13. Send to. Further, the determination unit 12 determines that the y coordinate of the face position coordinate p2 is not separated from the center coordinate p0 by a distance prepared in advance in the Z-axis direction.

  The instruction unit 13 generates a pulse for rotating the motor 31 connected to the rotation shaft 54 parallel to the Z axis according to the difference value. As a result, the motor 31 is driven and the rotary shaft 54 rotates clockwise, and the monitor 40 rotates in a direction parallel to the XY plane. Further, the instruction unit 13 generates a pulse for rotating the motor 33 connected to the rotation shaft 56 parallel to the Y axis according to the tilt angle of the face. As a result, the motor 33 is driven to rotate the rotating shaft 56 clockwise, and the monitor 40 rotates in a direction parallel to the XZ plane.

  FIG. 3D shows an image 23 captured by the imaging device 20 after the monitor 40 is rotated. In the image 23, the inclination angle of the face of the viewer 60 is close to 0 ° compared to the image 22 shown in FIG. In addition, the x coordinate of the position coordinate p3 of the face of the image 23 is closer to the x coordinate of the center coordinate p0 than the x coordinate of the position coordinate p2. In this way, the viewer's load can be reduced when viewing the monitor 40 by bringing the face inclination angle close to 0 °.

Next, a process for bringing the tilt angle of the face of the control device 10 close to 0 ° will be described using a flowchart.
FIG. 4 is a flowchart showing processing of the control device.

[Step S <b> 1] The tilt detection unit 11 acquires images of 10 consecutive frames captured by the imaging device 20. Thereafter, the process proceeds to step S2.
[Step S <b> 2] The tilt detection unit 11 executes a process of detecting the tilt of the face (tilt detection process). Thereafter, the process proceeds to step S3. The contents of the tilt detection process will be described in detail later.

  [Step S3] The inclination detection unit 11 determines whether or not the inclination detection processing has been completed for all the frames of images acquired in step S1. When the tilt detection process is completed for all the images for the frames (Yes in step S3), the process proceeds to step S4. If the tilt detection processing has not been completed for all the images for the frames (No in step S3), the process proceeds to step S2.

[Step S4] The determination unit 12 extracts the most frequently occurring value of the face inclination angle obtained by the inclination detection process in step S2. Then, the process proceeds to step S5.
[Step S5] The determination unit 12 determines whether or not the most frequent value of the inclination angle extracted in step S4 is larger than a threshold value. When the most frequent inclination angle value is larger than the threshold value (Yes in step S5), the process proceeds to step S6. If the most frequent value of the tilt angle is equal to or less than the threshold value (No in step S5), the processing in FIG. 4 is terminated.

[Step S <b> 6] The instruction unit 13 generates a pulse based on the most frequent value of the tilt angle extracted in step S <b> 4 and sends the pulse to the motor 33. Thereafter, the process of FIG. 4 is terminated.
Next, the inclination detection process in step S2 of FIG. 4 will be described in detail.

FIG. 5 is a flowchart showing the tilt detection process.
[Step S <b> 2 a] The preprocessing unit 11 a removes a noise component of an image captured by the imaging device 20. Then, the process proceeds to step S2b.

[Step S2b] The identification unit 11b performs a differentiation process and pattern matching on the image processed by the preprocessing unit 11a to extract a face region. Thereafter, the process proceeds to operation S2c.
[Step S2c] The identification unit 11b determines whether or not a face region has been extracted in step S2b. When the face area is extracted (Yes in step S2c), the process proceeds to step S2d. When the face area is not extracted (No in step S2c), the process proceeds to step S2f.

  [Step S2d] The identification unit 11b determines whether there is one identified face. When there is one identified face (Yes in step S2d), the process proceeds to step S2e. If there are two or more identified faces (No in step S2d), the process proceeds to step S2f.

[Step S2e] The detection unit 11c detects an inclination. Thereafter, the process of FIG.
[Step S2f] The detection unit 11c determines the inclination to be 0 °. Thereafter, the process of FIG.

Next, the hardware configuration of the control device 10 will be described.
FIG. 6 is a diagram illustrating a hardware configuration of the control device.
The entire control device 10 is controlled by the CPU 101. A RAM 102 and a plurality of peripheral devices are connected to the CPU 101 via a bus 105.

  A RAM (Random Access Memory) 102 is used as a main storage device of the control device 10. The RAM 102 temporarily stores at least part of an OS (Operating System) program and application programs to be executed by the CPU 101. The RAM 102 stores various data used for processing by the CPU 101.

A ROM (Read Only Memory) 103 and a communication interface 104 are connected to the bus 105.
The ROM 103 is used as a secondary storage device of the control device 10. The ROM 103 stores an OS program, application programs, and various data.

  The communication interface 104 is connected to the network 50. The communication interface 104 transmits and receives data to and from other computers or communication devices via the network 50.

With the hardware configuration as described above, the processing functions of the present embodiment can be realized.
As described above, according to the control device 10, the viewer's fatigue due to the deviation of the tilt can be reduced by matching the tilt of the viewer's face with the tilt of the monitor 40.

  By the way, in the present embodiment, when the identification unit 11b extracts a plurality of face regions, the face inclination angle is determined to be 0 °. However, the present invention is not limited to this, and when the difference between the tilt angles of the face area is equal to or greater than a predetermined threshold (for example, 20 °), the determination unit 12 ends the process without sending the tilt angle of the face to the instruction unit 13. You may do it. Further, when the difference in inclination of the face area is less than a threshold value prepared in advance (for example, 20 °), the determination unit 12 obtains the average of the face inclination angles for all members, and calculates the average of the obtained face inclination angles. The value may be sent to the instruction unit 13.

  The detection unit 11c may determine the face inclination angle based on the inclination of the face of the person first identified by the identification unit 11b. Further, the face inclination angle may be determined based on the inclination of the face of the person closest to the center of the captured image.

<Second Embodiment>
Next, a control device according to a second embodiment will be described.
Hereinafter, the control apparatus according to the second embodiment will be described with a focus on differences from the first embodiment described above, and description of similar matters will be omitted.

FIG. 7 is a block diagram illustrating functions of the display device according to the second embodiment.
The control device 10 of the second embodiment shown in FIG. 7 is different from the first embodiment in the function of the inclination detection unit 11.

  The inclination detection unit 11 according to the second embodiment detects a plurality of feature portions (pointers) attached to the glasses worn by the viewer, and based on the positional relationship of the detected feature portions, the viewer's face The tilt angle of is detected. In addition, the instrument to wear is not limited to glasses.

FIG. 8 is a diagram for explaining eyeglasses.
The viewer wears the glasses 200 when viewing the monitor 40. When the monitor 40 has a 3D display function, the glasses 200 may be glasses capable of viewing an image displayed in 3D. A rectangular spectacle feature 201 is provided at the top of the spectacles 200. Characteristic portions 202, 203, and 204 are provided at three corners of the spectacle feature portion 201. The feature portions 202, 203, and 204 are rotationally symmetric similar figures such as those used in QR (Quick Response) codes.

  The detection unit 11d identifies the feature portions 202, 203, and 204 by pattern matching the image processed by the preprocessing unit 11a and data that specifies the feature portion prepared in advance in the control device 10. The detection unit 11d detects the tilt angle of the glasses 200 with respect to the ground based on the positional relationship between the characteristic portions 202, 203, and 204.

FIG. 9 is a flowchart illustrating an inclination detection process according to the second embodiment. Steps for executing the same processing as in FIG. 5 are given the same step numbers as in FIG.
[Step S <b> 2 a] The preprocessing unit 11 a removes a noise component of an image captured by the imaging device 20. Then, the process proceeds to step S2c1.

  [Step S2c1] The detection unit 11d performs pattern matching between the image processed by the preprocessing unit 11a and data specifying a feature portion prepared in advance in the control device 10. Then, the detection unit 11d determines whether or not the characteristic portions 202, 203, and 204 have been identified. When the characteristic portions 202, 203, and 204 can be identified (Yes in step S2c1), the process proceeds to step S2d1. When the characteristic portions 202, 203, and 204 cannot be identified (No in step S2c1), the process proceeds to step S2f.

  [Step S2d1] The detection unit 11d determines whether or not the identified feature portions 202, 203, and 204 are one (one set). When there is one identified feature portion 202, 203, 204 (Yes in step S2d1), the process proceeds to step S2e. When there are two or more identified feature portions 202, 203, and 204 (No in step S2d1), the process proceeds to step S2f.

[Step S2e] The detection unit 11d detects the tilt angle of the glasses 200 with respect to the ground based on the positional relationship between the feature portions 202, 203, and 204. Then, the process of FIG. 9 is complete | finished.
[Step S2f] The detection unit 11d determines that the inclination angle of the glasses 200 with respect to the ground is 0 °. Then, the process of FIG. 9 is complete | finished.

According to the control device 10 of the second embodiment, the same effect as that of the control device 10 of the first embodiment can be obtained.
According to the control device 10 of the second embodiment, since the face inclination angle is determined based on the feature portions 202, 203, and 204, the identification is simplified compared to the case of identifying the face, and the inclination angle Can be detected earlier. Also, the detection accuracy can be increased.

  The display device, the control method, and the program of the present invention have been described based on the illustrated embodiment. However, the present invention is not limited to this, and the configuration of each unit is an arbitrary function having the same function. It can be replaced with that of the configuration. Moreover, other arbitrary structures and processes may be added to the present invention.

Further, the present invention may be a combination of any two or more configurations (features) of the above-described embodiments.
The above processing functions can be realized by a computer. In that case, a program describing the processing contents of the functions of the control device 10 is provided. By executing the program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium. Examples of the computer-readable recording medium include a magnetic storage device, an optical disk, a magneto-optical recording medium, and a semiconductor memory. Examples of the magnetic storage device include a hard disk drive, a flexible disk (FD), and a magnetic tape. Examples of the optical disc include Blu-ray (registered trademark), DVD (Digital Versatile Disc), DVD-RAM, CD-ROM (Compact Disc Read Only Memory), CD-R (Recordable) / RW (ReWritable), and the like. Examples of the magneto-optical recording medium include an MO (Magneto-Optical disk).

  When distributing the program, for example, a portable recording medium such as a DVD or a CD-ROM in which the program is recorded is sold. It is also possible to store the program in a storage device of a server computer and transfer the program from the server computer to another computer via a network.

  The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. In addition, each time a program is transferred from a server computer connected via a network, the computer can sequentially execute processing according to the received program.

  Further, at least a part of the above processing functions can be realized by an electronic circuit such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or a PLD (Programmable Logic Device).

DESCRIPTION OF SYMBOLS 1 Display apparatus 10 Control apparatus 11 Inclination detection part 11a Pre-processing part 11b Identification part 11c, 11d Detection part 12 Determination part 13 Instruction part 20 Imaging device 21, 22, 23 Image 31, 32, 33 Motor 40 Monitor 200 Glasses 201 Glasses characteristic Part 202, 203, 204 Characteristic part

Claims (6)

A detection unit for detecting a tilt angle of the viewer's face from a detection area of the viewer's face included in the image captured by the imaging device;
A determination unit that determines a rotation angle of a monitor that displays an image so that the angle detected by the detection unit approaches 0 °;
A display device comprising:   The detection unit repeatedly performs detection of a face inclination angle a plurality of times within a predetermined time, and the determination unit determines a rotation angle of the monitor according to an angle having the highest appearance frequency. Item 4. The display device according to Item 1.   The display device according to claim 1, wherein the determination unit determines to rotate the monitor when an angle having the highest appearance frequency is larger than a predetermined angle.   The display device according to claim 1, wherein the detection unit detects a tilt of a face from a position detection pointer provided on an instrument worn by a viewer. Computer
Detecting the tilt angle of the viewer's face from the detection area of the viewer's face included in the image captured by the imaging device;
Determining the rotation angle of the monitor that displays the image so that the detected angle approaches 0 °;
A control method characterized by that. On the computer,
Detecting the tilt angle of the viewer's face from the detection area of the viewer's face included in the image captured by the imaging device;
Determining the rotation angle of the monitor that displays the image so that the detected angle approaches 0 °;
A program characterized by causing processing to be executed.

Images