WO2018008128A1

WO2018008128A1 - Video display device and method

Info

Publication number: WO2018008128A1
Application number: PCT/JP2016/070166
Authority: WO
Inventors: 佑人小松
Original assignee: マクセル株式会社
Priority date: 2016-07-07
Filing date: 2016-07-07
Publication date: 2018-01-11

Abstract

Provided is a video display device capable of improving visibility on a screen in accordance with a user's eyesight. To this end, the video display device 10 includes: an eyesight information acquisition unit 104 for acquiring the eyesight information of a user on the basis of a user image obtained by capturing an image of the user; an object magnification unit 110 for magnifying an object included in a video signal to be displayed on the basis of the eyesight information of the user; and a display control unit 114 for controlling the display of the video signal.

Description

Video display apparatus and method

The present invention relates to a video display apparatus and method, and more particularly to a technology for improving screen visibility.

Patent Document 1 discloses that “information is displayed on the display screen in a desired orientation according to the positional relationship between the display screen of the mobile terminal device and the user without newly providing a sensor that prevents downsizing of the mobile terminal device. ”Providing a portable terminal device capable of displaying an image”, and for this purpose, “a main body having a display portion capable of displaying at least character information, and a camera provided on the main body and photographing the periphery of the main body” And a main control unit that acquires information on a user's face based on an image captured by the camera unit and grasps at least a relative positional relationship between the orientation of the face and the orientation of the main body. The main control unit determines the direction of information to be displayed on the display screen of the display unit according to the grasped positional relationship, and controls the display control unit so that the information is displayed on the display unit according to the orientation (summary extract). " Mobile terminal device opened It is.

JP 2007-17596 A

According to Patent Document 1, although the direction of information to be displayed can be changed in accordance with the direction of the face, there is a problem that the visibility when the characters on the screen are too small for the user is not improved.

The present invention has been made in view of the above problems, and an object of the present invention is to improve the visibility of a screen according to a user's visual acuity.

In order to solve the above object, the structure described in the claims is adopted. As one aspect thereof, for example, the present invention is a video display device that displays a visual acuity information acquisition unit that acquires visual acuity information of a user based on a user image obtained by imaging the user, and the visual acuity information of the user. An object enlargement processing unit that enlarges an object included in the video signal, and a display control unit that performs display control of the video signal.

According to the present invention, it is possible to improve the visibility of the screen according to the visual acuity of the user. Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

The figure which shows the hardware constitutions of a video display apparatus Functional block diagram showing functions of video display device External view of video display measures The flowchart which shows the video display method which concerns on 1st Embodiment. Figure showing an example of an indicator pattern Diagram showing the relationship between distance, visual acuity and magnification The flowchart which shows the timing of the character expansion rate determination process in a video display apparatus (television) It is the example of a screen display in 1st Embodiment, Comprising: (a) shows the screen by original size, (b) shows the example of a screen after an expansion process. The flowchart which shows the video display method which concerns on 2nd Embodiment. The correspondence between the estimated age and the enlargement rate is shown. The flowchart which shows the image | video display method which concerns on 3rd Embodiment. The flowchart which shows the video display method which concerns on 4th Embodiment. It is a screen display example displayed in 4th Embodiment, Comprising: (a) shows the display screen of original size, (b) shows the screen of an enlarged display process.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<Hardware configuration of video display device>
A hardware configuration of the video display apparatus according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating a hardware configuration of the video display apparatus.

The video display device 10 is connected to a camera 20 that images a user, and a user image captured by the camera 20 is input to the video display device 10. The video display device 10 may be a portable video terminal device such as a projector or a smartphone as long as it is a device that can display a video signal. In the present embodiment, a television is taken as an example. Therefore, in this embodiment, it is connected to the receiving antenna 31 that receives a digital broadcast wave. Instead of a receiving antenna, a broadcast signal may be received from a cable television. Further, it is configured to be electrically connectable to a video playback device 32 such as a DVD recorder.

As shown in FIG. 1, a video display device 10 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, a HDD (Hard Disk Drive) 14, a monitor 15, and an input device. 16 (including operation buttons and remote control receiver), I / F 17, and bus 18. The CPU 11, RAM 12, ROM 13, HDD 14, monitor 15, input device 16, and I / F 17 are connected to each other via a bus 18. The ROM 13 and the HDD 14 are examples of storage. The storage may be built in the video display device 10 or may be a portable memory that can be attached to and detached from the video display device 10.

The camera 20, the receiving antenna 31, and the video playback device 32 are connected to the video display device 10 via the I / F 17. The receiving antenna 31 and the video reproduction device 32 correspond to the input destination of the video signal to the video display device 10.

Next, the program configuration of the video display device 10 will be described with reference to FIG. FIG. 2 is a functional block diagram showing functions of the video display device 10.

The video display device 10 includes a distance measuring unit 101, a face region extracting unit 102, an eye region extracting unit 103, a visual acuity measuring unit 104, an age estimating unit 105, a spectacles detecting unit 106, a contact lens detecting unit 107, and a DVD (Digital Versatile Disk). Drive 108, caption information extraction unit 109, object enlargement processing unit 110, object recognition unit 111, decoder 112, broadcast signal reception unit 113, display control unit 114, EPG (Electronic Program Guide) generation unit 115, and main control unit 116 An application program as a component is provided. The visual acuity measuring unit 104, the age estimating unit 105, the eyeglass detecting unit 106, and the contact lens detecting unit 107 are information indicating the actual measured value of the user's visual acuity or information for estimating visual acuity (the information on the wearing of the visual acuity correction device and estimated age information). Output), which corresponds to the vision information acquisition unit. The eyeglass detection unit 106 and the contact lens detection unit 107 correspond to a correction device detection unit because they detect whether or not a vision correction device (including glasses and contact lenses) is attached. Correction device wearing information indicating whether or not the user is wearing a vision correction device and estimated user age information are stored in the storage. Therefore, a partial area of the storage constitutes a correction device mounting information storage unit.

The video display apparatus 10 stores an application program in a storage. The main control unit 116 reads the program from the storage and develops the program in the RAM 12, and the main control unit 116 executes the program to realize various functions. be able to.

The application program may be stored in the storage in advance before the video display device 10 is shipped, or may be stored in an optical medium such as a CD (Compact Disk) / DVD or a medium such as a semiconductor memory and connected to the medium. May be installed in the video display device 10 via a unit (a DVD drive is an aspect of a medium connection unit). The application program can also be realized by hardware (IC chip or the like) having the same function. When implemented as hardware, each processing unit takes the lead in realizing each function.

FIG. 3 is an external view of the video display device 10. As shown in FIG. 3, the video display device 10 displays an image or video on the monitor 15. The camera 20 may be configured integrally with the video display device 10 or may be configured separately, but is connected to the video display device 10 wirelessly or by wire. The camera 20 is installed at an angle of view where the face of the user who views the screen of the monitor 15 is captured. In the present embodiment, the distance between the user and the video display device 10 is measured (estimated if configured separately) based on the user image captured by the camera 20, and automatically on the screen based on this distance. The object size such as characters and objects is changed and displayed on the monitor 15. The object here refers to character information such as subtitles and EPG from the first embodiment to the third embodiment, and refers to a partial area on the screen of the monitor 15 in the fourth embodiment.

<First Embodiment>
In the first embodiment, the user's visual acuity is measured, and characters are enlarged and displayed at an enlargement rate corresponding to the visual acuity. The first embodiment will be described below with reference to FIGS. FIG. 4 is a flowchart showing the video display method according to the first embodiment. FIG. 5 is a diagram illustrating an example of an index pattern. FIG. 6 is a diagram illustrating the relationship among distance, visual acuity, and magnification. Hereinafter, it demonstrates along the flow of FIG. FIG. 7 is a flowchart showing the timing of character enlargement rate determination processing in the video display device (television). FIGS. 8A and 8B are screen display examples according to the present embodiment. FIG. 8A shows a screen according to the original size, and FIG. 8B shows a screen after enlargement processing.

When the main power of the video display device 10 is turned on, the visual acuity measurement unit 104 displays an index pattern image for measuring the visual acuity of the user on the monitor 15 (S01). The index pattern is, for example, a point index, a ring index, a slit index, or the like. FIG. 5 shows a state in which the slit index pattern 121 is displayed on the monitor.

The camera 20 captures the user and generates a user image (S02).

The eye area extraction unit 103 extracts the eye area where the user's eyes are captured from the user image (S03). The eye area extraction unit 103 detects the shape of white eyes and black eyes of the extracted eye area.

The index pattern is reflected in the extracted eye area. Therefore, the visual acuity measurement unit 104 analyzes the index pattern image projected onto the eye region, acquires corneal shape distribution information based on the analysis result, and calculates the refractive index, thereby measuring the visual acuity of the user ( S04).

The ranging unit 101 measures the distance between the user and the video display device 10 (S05). In the present embodiment, the distance measuring unit 101 measures the distance based on the image from the camera 20. The distance between the user's eye position and the screen is proportional to the distance between the user's eyes and the screen. Therefore, the distance measuring unit 101 calculates the distance between both eyes based on the extracted eye region, and calculates the distance to the screen based on the calculated distance.

If the camera 20 is a stereo camera, the distance measurement unit 101 executes a distance calculation process based on the parallax of the stereo camera based on the face image captured by the face region extraction unit 102 with the stereo camera.

Further, a distance measuring device different from the camera 20, for example, an ultrasonic device may be connected to the video display device 10, and the distance measuring unit 101 may measure the distance to the user based on the output signal from the distance measuring device.

If there are a plurality of users, the distance measuring unit 101 measures the distance to each user based on the eye area of each user extracted by the eye region extracting unit 103 and sets the farthest position from the video display device 10. You may comprise so that the distance to the user who enters may be output as distance information.

The object enlargement processing unit 110 determines the enlargement ratio of the object displayed on the monitor 15 based on the distance information and the visual acuity information (S06). In the first to third embodiments, since character information is described as an example of an object, the object enlargement rate is also referred to as a character enlargement rate.

As shown in FIG. 6, when the distance between the user and the video display device 10 is far, the object enlargement processing unit 110 determines that the user is away from the screen and displays the enlarged character size. On the other hand, if the distance is short, it is determined that the user is not away from the screen, and the character size is reduced or displayed as the original size included in the video. Note that a threshold based on the screen size may be set so that all characters included in the video are displayed when the object is enlarged and an upper limit may be set for the enlargement ratio. The screen size may be manually input to the video display device 10 in advance, or may be automatically calculated from the size of the screen captured by the camera 20 using a wide-angle lens.

When the object is subtitles, the shape of the subtitles includes vertical, horizontal and full screen types. In the case of the vertical type or the horizontal type, the object size may be displayed with an upper limit based on the size of the display screen. In the case of the full screen type, the object size may be changed only when the font size can be enlarged or reduced, such as EPG.

The broadcast signal receiving unit 113 receives a broadcast signal via the receiving antenna 31, and the decoder 112 decodes the broadcast signal to generate a video signal. The object recognition unit 111 performs character recognition processing on the video signal, and expands the character information according to the enlargement rate determined by the object enlargement processing unit 110 in step S06. The display control unit 114 displays the video signal with enlarged characters on the monitor 15 (S07).

Further, when the EPG generation unit 115 receives an EPG signal included in the broadcast signal, the EPG generation unit 115 generates an EPG. When an EPG display operation is performed from the input device 16, the object enlargement processing unit 110 enlarges the font size of the characters included in the EPG at the enlargement rate determined in S <b> 06, and outputs it to the display control unit 114 for display on the monitor 15. Is done.

Further, when a moving image signal with subtitle information attached thereto is input to the DVD drive 108, the subtitle information extraction unit 109 outputs the subtitle information to the object enlargement processing unit 110. The subtitle characters are enlarged and displayed. Note that the moving image signal may be directly output to the display control unit 114, and the display control unit 114 may display the monitor 15 by executing a process of combining the moving image and the caption.

As shown in FIG. 7, the TV is turned on and the TV is initially set (S11 / YES). At this time, the character enlargement rate determination process (S01 to S06) is executed (S12), and the identification information of the user (for example, the shape of the white and black eyes performed by the eye region extraction unit 103 may be used) is associated with the measured visual acuity. And store it in the storage. Then, the power is turned off.

Next, when the power is turned on to view the television or when the screen is changed from the initial setting to the viewing screen (S13 / YES), the character enlargement rate determination process and the enlarged display process may be executed (S14). ).

In step S14, when a television program is displayed on the screen, the character enlargement ratio is determined during a standby time (usually when the monitor is dark) until the television program is displayed after the power is turned on. When the display of the program is started, the characters may be enlarged and displayed. When the channel is changed, there is a possibility that the viewing user may be changed. Therefore, the process of changing the channel and the input device 16 accepting the input device 16 as a trigger again performs the visual acuity measurement and the enlargement ratio determination process. You may comprise.

Referring to FIG. 8, a comparative example before and after the expansion of character information is shown. As shown in FIG. 8A, on the screen 81 before the character information is enlarged, the character information 82 and 83 are displayed in the original size and are relatively small. On the other hand, as shown in FIG. 8B, in the screen 85 after the character information is enlarged, the character information 86 and 87 are enlarged, but the character string is within the screen 85.

According to the present embodiment, the video display device can measure the user's visual acuity, and the character can be enlarged and displayed at an enlargement ratio corresponding to the visual acuity and the distance.

Second Embodiment
In the second embodiment, the magnification is determined by estimating the age from the face image without measuring the visual acuity. FIG. 9 is a flowchart showing a video display method according to the second embodiment. FIG. 10 is a diagram illustrating a correspondence relationship between the estimated age and the enlargement rate.

After capturing the user with the camera 20 (S21), the face area extraction unit 102 extracts an area (face area) where the user's face is imaged from the captured image (S22).

The age estimation unit 105 estimates the age using features such as eyes, nose, mouth, hair, and contour in the face area (S23), and outputs them to the object enlargement processing unit 110.

FIG. 10 shows the enlargement ratio data in which the distance / age and the enlargement ratio are associated with each other. The object enlargement processing unit 110 refers to the enlargement rate data, determines the character enlargement rate according to the distance and the estimated age (S24), and enlarges and displays the character information according to the determined enlargement rate (S25). The enlargement ratio data in FIG. Until the threshold based on the screen size is reached, the enlargement rate is defined by a continuous increase function according to the age, but an age threshold is set for the estimated age, the original size is displayed below the age threshold, and a predetermined enlargement is shown above the age threshold You may make it perform an enlarged display at a rate.

According to the present embodiment, the estimated age of the user is calculated, and the enlargement ratio of the character information is determined using the result, so that an easy-to-see screen with enlarged characters can be displayed especially for elderly viewers. .

<Third Embodiment>
The third embodiment is an embodiment that performs enlarged display of characters based on the presence or absence of glasses or contact lenses. The third embodiment will be described below with reference to FIG. FIG. 11 is a flowchart showing a video display method according to the third embodiment.

The room is imaged with the camera 20 from around the day, the face of the user is imaged and the face recognition process is executed, and learning data that defines the habit of wearing glasses for each user is accumulated in the storage (S31).

The target user for character enlargement display is imaged by the camera 20 (S32). This process may be executed, for example, as a trigger when an operation to turn on the main power of the television is accepted.

The face area extraction unit 102 extracts the user's face area from the captured image (S33).

The object enlargement processing unit 110 collates the face area with the learning data, and determines whether the target user is a person who has a habit of wearing glasses. In the case of a person who has a habit of wearing glasses (S34 / Yes), the glasses detection unit 106 has a geometric shape such as a frame in the face area based on the shape and color of the glasses, for example. The eyeglasses detection process is executed based on whether the image is captured or whether a color different from the human body is included.

If the eyeglasses are not worn (S35 / NO), the contact lens detection unit 107 determines whether the contact lenses are worn. The eye region extraction unit 103 extracts the eye region, and if the contact lens detection unit 107 can detect, for example, a geometric circular shape (corresponding to the shape of the contact lens) in the eye region, a contact lens is attached. (S36 / YES).

If a person who wears spectacles does not wear spectacles or contact lenses (S36 / NO), the object enlargement processing unit 110 enlarges the character using a predetermined enlargement ratio α (α> 1). The display control unit 114 displays on the monitor 15 (S37).

If the person does not have the habit of wearing glasses (S34 / NO), is wearing glasses (S35 / YES), or is wearing a contact lens (S36 / YES), the object enlargement processing unit 110 does not enlarge the characters. Display in the original size (same size).

According to the present embodiment, it is possible to visually recognize the object on the screen even when the glasses are usually worn and the glasses are rarely worn.

<Fourth embodiment>
The fourth embodiment is an embodiment in which a user's line of sight is detected and a partial area in the screen that the user is viewing is enlarged and displayed. FIG. 12 is a flowchart showing a video display method according to the fourth embodiment. FIGS. 13A and 13B are screen display examples displayed in the fourth embodiment, where FIG. 13A shows an original size screen and FIG. 13B shows an enlarged display processing screen.

The user is imaged by the camera 20 (S41), the eye area extraction unit 103 extracts the eye area in the captured image, and calculates the user's line-of-sight direction from the position of the black eye (S42). In the present embodiment, it is assumed that the positional relationship between the camera 20 and the video display device 10 is fixed.

The object recognizing unit 111 calculates the partial area in the screen that the user is viewing by specifying the area of the monitor 15 that is ahead of the user's line of sight (S43).

The object enlargement processing unit 110 determines an object enlargement rate (S44). The enlargement ratio of the object in this step is the same as the enlargement ratio described as the character information enlargement ratio in the first to third embodiments. Therefore, any of the magnification rate based on the measurement result and age of the visual acuity and whether or not the visual acuity correction device is attached may be used.

The object enlargement processing unit 110 enlarges and displays the partial area included in the video signal to be displayed according to the determined enlargement ratio (S45).

In the present embodiment, as shown in FIG. 13, the partial area A1 (see FIG. 13A) that is visually recognized by the user on the screen of the monitor 15 is enlarged and displayed larger than the other areas by the enlargement display process. (See FIG. 13B).

The above embodiments merely show one aspect of the present invention, and the present invention includes various modifications. The above-described embodiment has been described in detail for easy understanding of the present invention, and is not necessarily limited to one having all the configurations described. Further, a part of the configuration of an embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of an embodiment. In addition, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

For example, the object enlargement processing unit 110 may control the character so that it can be easily seen by changing not only the size of the character but also the contrast of the background. By changing the contrast, since the enlargement ratio of the object size is the upper limit value, even when the enlargement cannot be performed, the characters can be seen more easily.

In addition, the object size of the screen may be changed by applying this embodiment to a car navigation system, a projector, or the like.

In addition, each of the above-described configurations may be configured such that a part or all of the configuration is configured by hardware, or is realized by executing a program by a processor. Further, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown.

10: video display device, 15: monitor, 20: camera

Claims

A video display device,
A visual information acquisition unit that acquires visual information of the user based on a user image obtained by imaging the user;
An object enlargement processing unit for enlarging an object included in the video signal to be displayed based on the user's visual acuity information;
A display control unit that performs display control of the video signal;
A video display device comprising:
The video display device according to claim 1,
The vision information acquisition unit
An eye region extraction unit that extracts an eye region in which the user's eyes are captured in the user image;
A visual acuity measuring unit that displays an index pattern for measuring the user's visual acuity and measures the visual acuity of the user based on an analysis result of the index pattern reflected in the eye area;
A video display device characterized by that.
The video display device according to claim 1,
A face area extracting unit that extracts a face area in which a user's face is captured from the user image;
The visual acuity information acquisition unit includes an age estimation unit that determines an estimated age of a user imaged in the user image based on a feature amount of the face region,
The object enlargement processing unit enlarges and displays the object according to the estimated age.
A video display device characterized by that.
The video display device according to claim 1,
The visual acuity information acquisition unit is a correction device mounting information storage unit that stores correction device mounting information indicating whether or not the user is a person who wears a visual correction device;
A correction device detection unit that detects whether a vision correction device is imaged in the user image,
The object enlargement processing unit enlarges and displays the object when the vision correction device cannot be detected from a user image of a user wearing the vision correction device.
A video display device characterized by that.
The video display device according to claim 1,
A distance measuring unit for calculating a distance between the user and the video display device;
The object enlargement processing unit increases the enlargement ratio of the object as the distance between the user and the video display device increases within a range of an enlargement ratio where the object fits on a display screen.
A video display device characterized by that.
The video display device according to claim 1,
The object enlargement processing unit enlarges character information included in a video signal to be displayed, and a partial area of the video signal.
A video display device characterized by that.
A video display method for displaying video on a video display device,
Acquiring the user's visual acuity information based on a user image obtained by imaging the user;
Magnifying an object included in a video signal to be displayed based on the user's visual acuity information;
Displaying an enlarged video signal of the object;
A video display method comprising: