JP2006023953A - Information display system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically vary the size of characters displayed on a monitor according to a user's vision. <P>SOLUTION: This information display system includes: a display device for displaying character information; an imaging device for imaging the user; and a controller for controlling the devices. To display character information the user's age and distance to a screen are calculated on the basis of the user's face image taken. In the case of an elderly user, the display size of characters is increased; otherwise, the display size is not changed. When the user brings his or her face close to the screen, the display size of the characters is reduced to allow the user to recognize a wide range of a document displayed. When the user moves away from the display, the display size of the characters is increased to increase the visibility thereof. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information display system that performs easy-to-see display according to an observer who observes a screen.

  In recent years, with the spread of personal computers (PCs), it has become common to create documents and the like on a monitor screen and to browse various information using the Internet. Many PC users are elderly people who wear glasses when viewing a monitor screen, and those who correct vision by nearsightedness or farsightedness. Such PC users often change their distance from the screen by moving their face closer to or away from the monitor screen when checking small displayed characters, etc. There is inconvenience that causes fatigue. Accordingly, word processor software or the like is known which has a zoom function (see, for example, Patent Document 1) for changing the display magnification of characters.

  In addition, the viewer's iris pattern is registered in advance to authenticate the viewer and determine whether or not to display information on the monitor screen (see Patent Document 2). An information display system is known that reads age information from an IC card carried by an individual and provides information of contents suitable for each individual in a display form suitable for each individual (Patent Document 3). reference).

JP-A-6-266338 JP 2001-16514 A JP 2003-323444 A

  However, the method described in Patent Document 1 has the inconvenience that an elderly person unaccustomed to the input operation has to make a setting for changing the display magnification of the character by himself when using the computer. In addition, since the display device and the information display system of Patent Documents 2 and 3 change the display form of the monitor screen by reading pre-registered personal information, an unregistered person who has not registered personal information or the like provides services. There is an inconvenience that it cannot be used.

  The present invention has been made in consideration of the above-described problems, and does not require a troublesome setting operation, and can be suitably displayed when used by the same individual or when used by an unspecified number of persons. An object is to provide an information display system.

  In order to achieve the above object, an information display system of the present invention includes a display device having a screen for displaying character information and image information, and photographing for observing the screen to obtain an image of the viewer. And a control device for controlling these devices. The control device specifies a face image from the obtained observer image and obtains feature information of the face image. On the basis of this, there is provided display change means for changing a display form of at least one of the character information and the image information.

  The face information recognition means detects a change in the line of sight of the observer from one or both of the observer's pupil movement and face movement based on a plurality of images photographed by the photographing device, and the display change The means measures the number of characters read by the observer per predetermined time from the amount of change in the line of sight of the observer, and displays one line in the direction opposite to the direction in which the observer reads the character information on the screen. Alternatively, it is characterized in that control is performed to move and display the character information every predetermined time in units of character information for a plurality of lines.

  The face information recognition means detects a change in the line of sight of the observer from one or both of the observer's pupil movement and face movement based on a plurality of images photographed by the photographing device, and the display change The means controls the movement of the image displayed at the position of the line of sight and displaying it at the center of the screen when it is detected that the line of sight has not changed from the position belonging to the peripheral part of the screen. An image moving means is provided.

  The face information recognition unit estimates the age of the observer from a specific part of the face image, and the display change unit increases the display size of the character information according to the estimated age. It is characterized by that.

  Distance measuring means for measuring an observation distance from the screen to the observer is provided, and the display changing means changes the display size of the character information according to the measured observation distance.

  The distance measuring means measures the observation distance based on a ratio of the number of pixels occupied by the face image of the observer with respect to the total number of pixels of the image obtained by the photographing apparatus.

  It is characterized by comprising a sound output device having a speaker for outputting sound and a sound volume adjusting means for increasing the sound volume as the measured observation distance increases.

  According to the information display system of the present invention, a face image is specified from a photographed image of the observer, and the observer's line of sight, the age of the observer, and the distance between the observer and the screen are obtained as feature information from the face image. From this feature information, line feed and page feed of the document displayed on the screen are automatically performed, and the display size of the character information is set, so the observer who observes the screen of the display device is always the same Regardless of whether it is a person or an unspecified number of different persons, no troublesome setting operation is required, and optimal information display with good visibility can be performed.

  In FIG. 1, a personal computer system 10 to which an information display system of the present invention is applied includes a computer main body 11 and a monitor 12 for displaying character information and image information on a liquid crystal screen 12a based on a drawing signal output from the computer main body 11. And a keyboard 13 for the user U1 to input to the computer main body 11.

  In FIG. 2, a CCD camera 14 is provided above the monitor 12. The CCD camera 14 photographs the user U1 and sends the photographed image to the computer main body 11. A speaker 15 provided beside the monitor 12 is connected to the computer main body 11, and music information stored in the computer main body 11 is output as sound.

  In FIG. 3, the computer main body 11 has an input interface 17 to which an operation signal of the keyboard 13 is input, an image input unit 18 to which an image of the user U1 captured by the CCD camera 14 is input, and character information to the monitor 12. And a display output unit 19 that outputs a drawing signal for displaying image information, and an audio output unit 20 that performs analog conversion of the digital audio information, amplifies the obtained audio signal, and sends it to the speaker 15. .

  The computer main body 11 includes a computer main part 11a including a CPU, a hard disk device, a memory, and the like. The hard disk device stores programs such as an operating system and application software. The CPU executes various programs to manage control signals and data signals, and executes operating system and application software control programs. It functions as the control unit 23.

  As shown in FIG. 4, the face image extraction unit 24 identifies the face of the user U1 and the contour of the head from the captured image of the CCD camera 14, and extracts the face image F1 along the contour. As shown in FIG. 5, the line-of-sight detection unit 25 identifies the pupil P1 from the extracted face image F1 of the user U1, and the line of sight V1 of the user U1 on the screen 12a of the monitor 12 from the position of the pupil and the direction of the face. Is detected. The line-of-sight change calculation unit 26 monitors the movement of the line of sight V1 of the user U1 based on a plurality of captured images sent from the CCD camera 14, and calculates the line-of-sight change D per unit time.

  As shown in FIG. 6, the distance measuring unit 27 counts the number of pixels of the face image F1 of the user U1, and calculates the distance L (see FIG. 1) from the screen 12a of the monitor 12 to the user U1 based on the size of the number of pixels. The change is monitored, and when the number of pixels increases (FIG. 6A), the user performs an operation to approach the screen 12a, and when the number of pixels decreases (FIG. 6B), the user starts from the screen 12a. It is determined that the user has moved away. As shown in FIG. 7, the age estimating unit 28 uses the face image F1 of the user U1 to create a face such as an eye corner wrinkle A1, a chin slack A2, a wrinkle A3 under the eye, a forehead wrinkle A4, and a hair A5. The age and the like of the user U1 are estimated by analyzing the shadow, shape, etc. in the specific region.

  The scroll adjustment unit 29 functions during execution of a specific application program capable of inputting and editing character information or displaying a document composed of character information, and is calculated by the line-of-sight change amount calculation unit 26. The speed at which the user U1 reads the character information displayed on the screen 12a is measured from the line-of-sight change amount D. As shown in FIG. 8, the scroll adjustment unit 29 identifies the line that the user U1 is reading from the position of the line of sight V1 and displays it on the center of the screen 12a. Perform scrolling line feed processing. In this line feed process, the screen is scrolled in the direction opposite to the direction in which the user U1 reads the character information, and the scroll speed is determined so that the line that the user U1 reads is always kept at the approximate center of the screen 12a. The In addition, there is a frame display that moves a certain number of characters at a time per unit time, and a roll display that moves a certain number of characters by a distance of several pixels within a unit time. Either one is performed by the operation.

  The scroll adjustment unit 29 also functions when executing a specific application program capable of inputting and editing image information, creating and viewing illustrations, and viewing photographic images. As shown in FIG. 9, when the displayed image is larger than the screen 12a and a part of the image cannot be displayed, the line of sight V1 of the user U1 detected by the line-of-sight detection unit 25 is located in the peripheral part of the screen 12a. If so, the scroll adjustment unit 29 moves the image of the part where the line of sight V1 is located to the center of the screen 12a, and displays the image of the part that was not displayed. Whether the line of sight V1 is in the center of the screen or in the periphery of the screen is determined based on a predetermined area indicated by a frame 40. That is, the inside of the frame 40 is distinguished as the center of the screen and the outside is distinguished as the periphery of the screen.

  Similar to the scroll adjustment unit 29, the text size changing unit 30 functions when executing a specific application program that handles character information. The display size of the character is changed with reference to the data table to which an appropriate text size that allows the visual recognition of the character to be satisfactorily viewed for each distance L and the age of the user U1 obtained by the distance measuring unit 27 and the age estimating unit 28 is referred. Here, the changed display size means a display magnification on the screen 12a. However, when character information can be input or edited, the font size, that is, the number of characters per line or the size of characters to be printed. When the display is not changed and only the display for browsing the character information is performed, it is preferable that the number of characters per line and the size of the printed characters can be changed.

  When the distance measuring unit 27 detects that the user U1 has approached the screen 12a, the text size changing unit 30 reduces the character display size so that a wide range of the entire document is displayed. Further, when it is detected that the character is away from the screen 12a, the character display size is increased so that the character can be confirmed well even from a distance.

  Next, operation | movement of the control part 23 is demonstrated using FIG. The control unit 23 activates the CCD camera 14 at the same time as a specific application program that can handle character information is executed. The CCD camera 14 captures the user U1 in front of the monitor 12 and sends the captured image to the image input unit 18. For example, the CCD camera 14 performs photographing a plurality of times per second. The image input unit 18 sends the captured image input from the CCD camera 14 to the control unit 23. The control unit 23 stores the input captured image as digital image data.

  The face image extraction unit 24 identifies the user's U1 face and head contour based on the captured image stored in the control unit 23, and extracts the face image F1. The line-of-sight detection unit 25 identifies the pupil P1 of the user U1 from the extracted face image F1, and detects the line of sight V1. The control unit 23 displays the character information on the screen 12a of the monitor 12 via the display output unit 19 when character information is input from the keyboard 13 or when data having character information is read out.

  The age estimation unit 28 estimates the age of the user U1 based on the face image F1. The age estimating unit 28 sends the requested age information to the text size changing unit 30. The text size changing unit 30 refers to a data table to which a suitable character display size is assigned based on the standard vision for each age, and sends text size designation information to the control unit 23. The text size designation information is information indicating that the display size of the character is enlarged when the user U1 is an elderly person. At this time, the control unit 23 sends a signal to the audio output unit 20 to increase the amplification factor of the amplifier provided in the audio output unit 20 and increase the volume of the speaker 15. Thereby, the initial setting for determining the display size and volume suitable for the age of the user is made.

  Each time an image of the user U1 captured by the CCD camera 14 is input to the control unit 23, the face image extraction unit 24 extracts the face image F1, and the line-of-sight detection unit 25 detects the line of sight V1. The scroll adjustment unit 29 detects that the line-of-sight change amount D obtained by the line-of-sight change amount calculation unit 26 is constant, and determines whether or not the user U1 is reading a document. When it is determined that the user U1 is reading the document, the scroll adjustment unit 29 performs a suitable scroll in which the line of sight V1 of the user U1 is maintained in a substantially constant region on the screen 12a based on the line-of-sight change amount D. The speed is calculated, and scroll designation information is sent to the control unit 23. The control unit 23 scrolls the document displayed on the screen 12a based on the scroll designation information.

  The distance measuring unit 27 counts the number of pixels of the face image F1 extracted by the face image extracting unit 24, and monitors the operation of the user approaching and leaving the screen 12a. When the distance measuring unit 27 detects that the user U1 has approached the screen 12a, the distance measuring unit 27 sends user approach information to the text size changing unit 30, and the text size changing unit 30 specifies a text size for reducing the display size of the characters. Information is sent to the control unit 23. The control unit 23 reduces the display size of the characters displayed on the screen 12a and increases the number of characters displayed on the screen 12a. In addition, the control unit 23 sends a control signal to the audio output unit 20 to lower the amplification factor of the amplifier provided in the audio output unit 20 and reduce the volume of the speaker 15.

  On the other hand, when the distance measuring unit 27 detects an operation in which the user U1 leaves the screen, the distance measuring unit 27 sends user leaving information to the text size changing unit 30. The text size changing unit 30 sends text size designation information for increasing the character display size to the control unit 23. The control unit 23 increases the display size of the characters displayed on the screen 12a and improves the visibility of the characters. In addition, the control unit 23 sends a control signal to the audio output unit 20, increases the amplification factor of the amplifier provided in the audio output unit 20, and increases the volume of the speaker 15 so that the audio can be heard even from a remote location. To do.

  The line-of-sight detection unit 25 sequentially detects the line of sight V1 of the user U1, and the line-of-sight change amount calculation unit 26 obtains the line-of-sight change amount D. The scroll adjustment unit 29 performs line feed at the same scroll speed if the line-of-sight change amount D is maintained at a constant magnitude, and stops the line feed when the line-of-sight change amount D changes from the constant magnitude. Change the scroll speed.

  Further, when an image is displayed on the screen 12a, the line of sight detection unit 25 detects the line of sight V1. When the position of the line of sight V1 is stationary outside the frame 40, that is, at the periphery of the screen 12a, the scroll adjustment unit 29 causes the image at the position of the line of sight V1 to be centered on the screen 12a inside the frame 40. The line of sight V1 of the user U1 is moved to the center of the screen 12a.

  The present invention is not limited to the personal computer system 10 of the above-described embodiment, and performs operation guidance by a display device or voice like an automatic ticket vending machine such as a transportation facility or an automatic teller machine used in a financial institution or the like. The information display system may be configured to be used by an unspecified number of people. For example, as shown in FIG. 12, the information display device 50 includes a display device 51 and a photographing device 52, and the screen of the display device 51 is a touch panel that allows input by touching. The information display device 50 is provided with a camera 52 and photographs the user U2. The distance from the captured image of the camera 52 to the screen of the user U2 and the display device 51 is measured, and when the user U2 approaches the screen, it is determined that the user U2 is a low vision person and the screen on the display device 51 is displayed. Display large characters. Even if the user U2 removes his / her face from the screen, the user can see the characters on the screen well and does not need to perform an operation in a tired posture. Further, when the user brings his / her face close to the screen, whether to increase or decrease the character display magnification may be appropriately switched by changing the setting.

  In the above embodiment, the display magnification of the text information is changed according to the relative change in the distance from the user to the screen. However, the present invention is not limited to this. A light projecting unit and an infrared light receiving unit may be provided, and the magnitude of the distance from the user to the screen may be calculated based on the baseline length between the light projecting unit and the light receiving unit. If the lens of the CCD camera 14 can be adjusted, distance information may be obtained from the position of the focused lens. When an accurate distance from the user to the screen can be measured, a standard distance between the user and the screen may be calculated to determine whether the user's visual acuity is good or not, and the character display size may be determined. In addition, if the distance from the user to the screen is measured multiple times, the average value is obtained and the observation distance is statistically determined, the character is displayed each time the user performs a small action such as breaking his posture. It is possible to prevent the display from becoming complicated due to the change of the aspect. In the present invention, the character displayed as an image is not limited to the character displayed by the text data as in the above embodiment, and the character displayed as an image may be enlarged and displayed, such as a map image having detailed pixel level information If so, it is also preferable to display an enlarged image according to the age of the user and the distance from the screen. Furthermore, in order to enlarge and display characters and images, control may be performed to change the size of one pixel on the monitor screen by lowering the resolution of the monitor.

It is a side view of a personal computer system. It is a front view of a personal computer system. 1 is a block diagram schematically showing the configuration of a personal computer system. It is a conceptual diagram which shows the mode of face image extraction. It is a conceptual diagram which shows the mode of a gaze detection. It is a conceptual diagram which shows the mode of distance measurement. It is a conceptual diagram which shows the mode of age estimation. It is a conceptual diagram which shows a mode that a screen is scrolled based on the gaze change at the time of reading a character forward. It is a conceptual diagram which shows a mode that a screen is scrolled based on the gaze change at the time of observing an image. It is a conceptual diagram which shows a mode that a character size is changed. It is a flowchart which shows the flow of operation | movement of a control part. It is a side view of an information display device.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Personal computer system 12 Monitor 14 Camera 15 Speaker 19 Display output part 20 Audio | voice output part 23 Control part 24 Face image extraction part 25 Gaze detection part 26 Gaze change amount calculation part 27 Distance measurement part 28 Age estimation part 29 Scroll adjustment part 30 Text Size changing unit 50 Information display device 51 Display device 52 Imaging device

Claims (7)

A display device having a screen for displaying character information and image information, a photographing device for photographing an observer who observes the screen to obtain an image of the observer, and a control device for controlling these,
The control device includes a face information recognition unit that identifies a face image from the obtained observer image, and obtains observer feature information from the face image;
An information display system comprising: a display changing unit that changes a display form of at least one of the character information and the image information based on the feature information. The face information recognition means detects a change in the line of sight of the observer from one or both of the movement of the pupil of the observer and the movement of the face, based on a plurality of images taken by the imaging device;
The display changing means measures the number of characters that the observer reads per unit time from the amount of change in the line of sight of the observer, and the screen 1 is in a direction opposite to the direction in which the observer reads characters on the screen. The information display system according to claim 1, wherein control for moving and displaying character information for a line or a plurality of lines is performed. The face information recognition means detects a change in the line of sight of the observer from one or both of the movement of the pupil of the observer and the movement of the face, based on a plurality of images taken by the imaging device;
The display changing unit performs control to move and display the image displayed at the position of the line of sight when the line of sight has not changed from the position belonging to the peripheral part of the screen. The information display system according to claim 1. The face information recognition means estimates the age of the observer from a specific part of the face image,
The information display system according to claim 1, wherein the display changing unit increases the display size of the character information in accordance with the estimated age. A distance measuring means for measuring an observation distance from the screen to the observer;
5. The information display system according to claim 1, wherein the display change unit changes a display size of the character information in accordance with a measured observation distance.   6. The distance measuring unit measures the observation distance based on a ratio of the number of pixels occupied by the face image of the observer with respect to a total number of pixels of an image obtained by the photographing apparatus. The information display system described. The information display system according to claim 5 or 6, further comprising a sound output device including a speaker that outputs sound and a sound volume adjusting unit that adjusts the sound volume according to the measured observation distance.

Images