JP2020080046A - Electronic apparatus, control device, and control method of electronic apparatus - Google Patents

Abstract

To provide a display control device which can more improve visibility of content without increasing the operational burden of a user.SOLUTION: An electronic apparatus (1) comprises at least one display device (5) and at least one control device (2). The control device (2) detects a fixation point of a user on a display screen of the display device (5) and measures a facial distance being a distance between the display screen and a face of the user and determines whether a region around the fixation point on the display screen should be enlarged or not on the basis of the facial distance.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an electronic device, a control device, and a control method for the electronic device.

  In recent years, electronic devices such as electronic book terminals that display electronic books have been widely used. As such an electronic device, there is a demand for an electronic device that improves the visibility of contents without increasing the operation load on the user.

  For example, Patent Document 1 describes an information display device including a storage unit, a display, a display processing unit, a camera, a gazing point detection unit, and a change unit.

JP, 2012-14455, A

  However, in the related art as described above, the visibility of contents may not be sufficient.

  An object of one embodiment of the present invention is to provide an electronic device and its related technique that can further improve the visibility of contents without increasing the operation load on the user.

  In order to solve the above problems, an electronic device according to an aspect of the present invention is an electronic device including at least one display device and at least one control device, and the control device includes the display. The user's gazing point on the display screen of the device is detected, the face distance, which is the distance between the display screen and the user's face, is measured, and the periphery of the gazing point on the display screen is enlarged and displayed based on the face distance. It is determined whether to do.

  A control device according to an aspect of the present invention is a control device for an electronic device including at least one display device, the control device detecting a gazing point of a user on a display screen of the display device. Unit, a face distance measuring unit that measures a face distance that is the distance between the display screen and the user's face, and whether or not to display the periphery of the gazing point on the display screen based on the face distance. A determination unit for determining.

  An electronic device control method according to an aspect of the present invention is an electronic device control method including at least one display device and at least one control device, wherein the control device displays a display on the display device. Detecting a user's gazing point on the screen, measuring a face distance that is a distance between the display screen and the user's face, and enlarging the periphery of the gazing point on the display screen based on the face distance. This includes determining whether or not to display.

  According to one aspect of the present invention, it is possible to provide an electronic device and its related technique capable of further improving the visibility of content without increasing the operation load on the user.

It is a block diagram showing a configuration of an electronic device according to a first embodiment of the present invention. It is a figure which shows an example of a predetermined conversion table. FIG. 6 is a diagram for explaining an example of changing the size of a gazing point area by a determination unit 9. 6 is a flowchart showing an example of a flow of control processing of the electronic device according to the first embodiment of the present invention. It is a figure which shows an example of a predetermined conversion table. It is a block diagram which shows the structure of the electronic device which concerns on Embodiment 2 of this invention. It is a block diagram which shows the structure of the electronic device which concerns on Embodiment 3 of this invention.

<Embodiment 1>
Hereinafter, the electronic device 1 and the control device 2 according to the first embodiment of the present invention will be described with reference to FIGS.

[Electronic equipment 1]
FIG. 1 is a block diagram showing the configuration of an electronic device 1 according to the first embodiment of the present invention. Examples of the electronic device 1 include an electronic book terminal that displays content such as electronic books and electronic comics. As shown in FIG. 1, the electronic device 1 includes at least one control device 2, an imaging device 3, a storage device 4, at least one display device 5, and a user operation reception device 6.

[Control device 2]
As shown in FIG. 1, the control device 2 includes a face distance measuring unit 7, a gazing point detecting unit 8, a determining unit 9, and a display processing unit (control device) 10.

  The control device 2 may be, for example, a CPU. The control device 2 controls each unit in the electronic device 1 by executing the display control program stored in the storage device 4. Examples of the display control program include an OS, a device driver, middleware, and an application.

(Face distance measuring unit 7)
The face distance measuring unit 7 measures the face distance, which is the distance between the display screen and the user's face.

  Specifically, the face distance measuring unit 7 identifies the display device 5 and the face of the user watching the content displayed on the display device 5 based on the captured image in which the face of the user is captured by the image capturing device 3. To measure the distance. The face distance measuring unit 7 estimates that the distance is a face distance that is a distance between the user's face and the gazing point that is the point of the user's line of sight in the content.

  More specifically, the face distance measuring unit 7 estimates a face distance by detecting a specific part such as both eyes from the user's face in the captured image and measuring the distance between the eyes. . Since the distance between the eyes is different depending on the person, it is not possible to estimate the accurate distance, but it is possible to specify the user who is viewing the content. The face distance measuring unit 7 estimates that the face distance becomes long when the distance between the eyes becomes short and the face distance becomes short when the distance between the eyes becomes long, for example.

  The face distance measuring unit 7 may use a method other than the above method as long as the face distance can be measured (estimated) based on the captured image.

  The face distance measuring unit 7 measures the face distance for a predetermined time after the user starts viewing the content on the display device 5 or starts displaying the content on the display device 5. The face distance measuring unit 7 can read the predetermined time from the storage device 4. The face distance measuring unit 7 calculates a reference face distance (first distance), which is a reference face distance, by a predetermined algorithm based on the measured face distance for a predetermined time.

  Here, as an example of calculating the first distance by a predetermined algorithm, for example, the face distance measuring unit 7 calculates the average value of the face distances measured for a predetermined time as the first distance. Be done.

  In addition to the above example, the face distance measuring unit 7 may calculate, for example, the average value of the measured face distances excluding the face distance at the beginning of the measurement as the first distance for a predetermined time. Further, the face distance measuring unit 7 may calculate the median value or the mode value of the measured face distances as the first distance for a predetermined time. When calculating the average value of the measured face distances as the first distance for a predetermined time, when there is an outlier (noise) such as a large movement of the user's face at the stage when the face distance starts to be measured, the deviation occurs. Sensitive to value. On the other hand, as described above, by calculating the average value of the measured face distances excluding the face distances at the beginning of the measurement for the predetermined time as the first distance, the influence of the outlier is obtained. Instead, the first distance can be calculated appropriately.

  The face distance measuring unit 7 outputs the first distance and the newly measured face distance (second distance) to the display processing unit 10.

  The face distance measuring unit 7 may calculate the first distance by using a method other than the above method. As the face distance measuring unit 7, various measuring units can be used as long as they can measure the distance between the display device 5 and the face of the user.

  In the above example, the face distance measuring unit 7 is included in the control device 2, but the present embodiment is not limited to this. In the present embodiment, the face distance measuring unit 7 may have a configuration independent of the control device 2. For example, the face distance measuring unit 7 may be provided in the electronic device 1 separately from the control device 2.

(Gaze point detector 8)
The gazing point detection unit 8 detects the gazing point of the user on the display screen of the display device 5 based on the captured image in which the face of the user who is viewing the content displayed on the display device 5 is captured by the imaging device 3.

  Specifically, the gazing point detection unit 8 first detects both eyes of the user's face in the captured image. Subsequently, the gazing point detection unit 8 detects a black eye in each of the detected eyes. Subsequently, the gazing point detection unit 8 detects the line of sight of the user based on the positions and shapes of the left and right eyes and the black eyes in the left and right eyes. The gazing point detection unit 8 specifies a position (coordinates) on the content displayed on the display device 5 at the line of sight, and detects the point at the position as a gazing point.

  Note that the gazing point detection unit 8 may detect the detection point by using a method other than the above method.

  The gazing point detection unit 8 outputs the detected gazing point to the determination unit 9.

(Determination unit 9)
The determination unit 9 enlarges the periphery of the gazing point on the display screen based on the display device 5, the gazing point that is the point of the user's gaze point in the content, and the face distance that is the distance to the user's face. Determine whether to display. Further, when it is determined that the enlarged display is performed, the determination unit 9 determines the enlargement ratio of the enlarged display (a predetermined range (gazing point area) around the gazing point) according to the face distance.

  Specifically, the determination unit 9 determines the enlargement ratio of the enlarged display based on the first distance and the second distance acquired from the face distance measurement unit 7 and the content data acquired from the display processing unit 10. , It is determined whether or not to enlarge and display the gazing point area (around the gazing point). This makes it possible to further improve the visibility of the content without increasing the operational burden on the user.

  More specifically, first, the determination unit 9 acquires content data from the display processing unit 10 and reads the gazing point area and a predetermined conversion table from the storage device 4. Subsequently, the determination unit 9 refers to a predetermined conversion table on the basis of the first distance and the second distance to determine the enlargement ratio of the gazing point area, thereby performing enlarged display. As an example, when the first distance is greater than the second distance by a threshold value or more, the determination unit 9 changes the magnification ratio of the gazing point area so as to magnify and display the gazing point area. Further, when the first distance is equal to or less than the second distance, the determination unit 9 does not change the enlargement ratio of the gazing area and does not display the gazing area in an enlarged manner.

  Note that the control device 2 may allow the user to directly set the above-mentioned threshold value via the user operation accepting device 6, or may prepare a predetermined threshold value of several patterns in advance and allow the user to select it. Further, the control device 2 may set the predetermined threshold value to a predetermined number by software or the like.

  The determination unit 9 also determines whether to change the display mode of the content displayed on the display device 5 based on a user operation such as page turning. For example, when there is no particular user operation such as page turning and there is no need to switch the content display, the determination unit 9 determines not to switch the content display. Then, the determination unit 9 determines the enlargement ratio of the gazing point area and determines whether or not to perform enlarged display. When there is a user operation such as page turning and it is necessary to switch the display of the content, the determination unit 9 determines to switch the display of the content by performing processing according to the user operation such as moving the page. ..

  The determination unit 9 outputs the data of the magnified content that has been magnified and displayed or the content that has not been magnified to the display processing unit 10.

  Here, in the related art as disclosed in Patent Document 1, when it is determined that the gazing point is included in the specific area, the specific area can be enlarged and displayed, but when the gazing point is included in the specific area. The judgment does not mean that the user always wants to enlarge and display the specific area. The user may want to see a particular area displayed in its original size.

  On the other hand, generally, when it is desired to enlarge the gazing area, the determination unit 9 determines that the face of the user is close to the content of the display device 5, that is, the face distance is short. , When the face distance decreases by a threshold value or more, enlarged display is performed. Further, the determination unit 9 does not perform the enlarged display when the face distance has not decreased by the threshold value or more. As a result, if the user wants to see the gazing area enlarged, the gazing area is enlarged, and if the user wants to see the gazing area as it is, the gazing area in the original size is displayed. You can

  The determination unit 9 determines the gazing point area according to, for example, the number of pixels or the display size ratio. The determination unit 9 determines the shape of the gazing area to be a predetermined shape such as a circle, a square, an ellipse, or a rectangle. When the shape of the gazing area is an ellipse or a rectangle, the determination unit 9 separately determines the number of pixels in the horizontal or vertical direction. When the shape of the gazing area is an ellipse or a rectangle, the determination unit 9 may determine the number of pixels in a certain predetermined ratio from the number of pixels in the horizontal direction as the number of pixels in the vertical direction.

  Note that the control device 2 such as the determination unit 9 allows the user to directly set at least one of the size and shape of the gazing point area via the user operation reception device 6, or the size and shape of the gazing point area of several patterns. At least one of the shapes may be prepared in advance and the user may be allowed to select it. Further, the control device 2 may determine at least one of the size and the shape of the gazing area in advance by software or the like. As described above, when the user operation accepting device 6 accepts a user operation such as setting the gazing area, the determination unit 9 causes the display device 5 to display the content based on the user operation.

(Predetermined conversion table)
An example of the predetermined conversion table will be specifically described below with reference to FIG.

  FIG. 2 is a diagram showing an example of a predetermined conversion table. As shown in FIG. 2, when the first distance is larger than the second distance and the first distance/second distance is larger than 1, for example, when the user's face approaches the content of the display device 5, the enlargement ratio is set. Is greater than 1. Further, the larger the first distance is than the second distance, that is, the closer the user's face is to the content of the display device 5, the larger the enlargement ratio is. As a result, it is possible to meet the user's request to view the gazing area larger like a magnifying glass.

  Further, when the first distance is equal to or less than the second distance, for example, when the user's face is separated from the content of the display device 5, the enlargement ratio is maintained at 1. This makes it possible to prevent an excessive reaction to the camera shake even if the camera shake occurs.

  In addition, when the second distance is near the first distance such that the first distance/second distance is 0.9 or more and 1.1 or less, for example, when the user's face is wandering around the content of the display device 5. , The enlargement ratio remains at 1. Accordingly, even when the user's face is wandering around the content of the display device 5, the enlargement ratio is not changed, and thus it is possible to prevent a sense of discomfort from occurring.

  In the above example, the second distance is in the vicinity of the first distance in the case where the first distance/second distance is 0.9 or more and 1.1 or less. However, in the present embodiment, It is not limited to this. In the present embodiment, if the second distance is close to the first distance for the user, the range of the vicinity is not particularly limited, and for example, the user sets, adjusts or selects a predetermined conversion table via the user operation reception device 6. You can change it.

  The predetermined conversion table is not limited to the above example as long as it shows the correspondence between the first distance and the second distance and the enlargement ratio, and may be any conversion table. The control device 2 such as the determination unit 9 allows the user to directly set a predetermined conversion table via the user operation reception device 6, or prepares a predetermined conversion table of several patterns in advance and allows the user to select the conversion table. Good. Further, the control device 2 may determine the predetermined conversion table based on a conversion formula predetermined by software or the like.

(Changing the gazing area by the determination unit 9)
Hereinafter, an example of changing the gazing area by the determination unit 9 will be described with reference to FIG.

  FIG. 3 is a diagram for explaining an example of changing the gazing point area by the determination unit 9. Specifically, (a) of FIG. 3 is a diagram showing the content 11 displayed on the display device 5, and (b) of FIG. 3 shows the enlarged content 14 displayed on the display device 5. It is a figure.

  In FIG. 3A, the size of the gazing area 12 is 25% of the size of the content 11 in each of the X-axis direction (horizontal direction) and the Y-axis direction (vertical direction). Here, when the second distance is 1.5 times the first distance and the predetermined conversion table is the conversion table shown in FIG. 2, the determination unit 9 determines the enlargement ratio to be 2. Therefore, the determination unit 9 doubles the gazing point area 12. Specifically, as shown in FIG. 3B, the determination unit 9 sets the size of the gazing area 15 to be 50% of the size of the enlarged content 14 in the horizontal direction and in the vertical direction, respectively. The display of the content 11 is changed so that

  Here, in the content 11 shown in FIG. 3A, the coordinates of the gazing point 13 are located between “ke” and “ko”. Also in the enlarged content 14 shown in FIG. 3B, the coordinates of the gazing point 16 are located between “ke” and “ko” as in the case of the content 11. In addition, the gazing point area 12 in the content 11 is a range corresponding to the characters "Kakiku Koshisashi". On the other hand, the gazing point area 15 in the expanded content 14 is a range corresponding to the characters "Ueoka Kiku Koshikashi Sesusa". In addition, the enlarged content 14 is displayed so as to be superimposed so as to hide the characters "Ueoka Kiku Koshi Sashisuse".

  In the above example, the determination unit 9 determines whether or not to perform enlarged display by determining the enlargement ratio of the gazing point area based on the first distance and the second distance with reference to a predetermined conversion table. Making a decision. However, the present embodiment is not limited to this, and the determination unit 9 may determine the enlargement ratio of the gazing area by referring to the conversion formula instead of the predetermined conversion table.

(Display processing unit 10)
The display processing unit (display control unit) 10 reads the content data from the storage device 4 and outputs the content data to the determination unit 9. Further, the display processing unit 10 acquires the data of the enlarged content or the content which is not enlarged and displayed, which is acquired from the determination unit 9, and causes the display device 5 to display the enlarged content or the content which is not enlarged and displayed.

  Here, it is assumed that the determination unit 9 determines to switch to another content based on a user operation such as page turning (page moving). In this case, the display processing unit 10 reads data of another content such as a new page from the storage device 4 and displays the other content on the display device 5. In addition, when the determination unit 9 receives from the user operation reception device 6 a user operation for ending the display of the content, such as the end of the display control process, the display processing unit 10 ends the display control process.

[Imaging device 3]
The imaging device 3 images the face of the user who is viewing the content displayed on the display device 5 and generates a captured image.

  Examples of the image pickup device 3 include a camera and an image sensor.

[Memory device 4]
The storage device 4 stores content data. The storage device 4 also stores data including an OS, device drivers, middleware, applications, and contents. Examples of the storage device 4 include memories such as SRAM, DRAM, and flash ROM, SD cards, hard disks, SSDs, and the like.

[Display device 5]
The display device 5 displays display data such as contents and enlarged contents. Examples of the display device 5 include a liquid crystal display (LED), organic EL, and electronic paper.

[User operation acceptance device 6]
The user operation acceptance device 6 accepts an input of a user operation on the determination unit 9 and the display processing unit 10 in the control device 2.

  Examples of the user operation reception device 6 include UIs such as a touch panel, keys, a keyboard, and switches. The user operation reception device 6 detects a user operation such as page turning, page returning, switching to another content, and termination of use of the electronic device 1 by the UI.

[Control processing of electronic device 1]
Subsequently, a control process of the electronic device 1 according to the first embodiment (a control method of the electronic device 1) will be described with reference to FIG. FIG. 4 is a flowchart showing an example of the flow of control processing of the electronic device 1 according to the first embodiment of the present invention.

  Step S100: The display processing unit 10 reads the content data from the storage device 4 and displays the content data on the display device 5.

  Step S101: The face distance measuring unit 7 measures the face distance based on the captured image captured by the image capturing device 3.

  Step S102: The face distance measuring unit 7 determines whether or not the measurement of the face distance has passed a predetermined time. When the face distance measuring unit 7 determines that the predetermined time has not elapsed, the process returns to step S101. If the face distance measuring unit 7 determines that the predetermined time has elapsed, that is, if the face distance measuring unit 7 determines that the first distance is calculated by measuring the face distance for the predetermined time, Step S103 Proceed to processing.

  Step S103: The face distance measuring unit 7 calculates the second distance by a predetermined algorithm.

  Step S104: The gazing point detection unit 8 detects the gazing point in the user's line of sight in the content displayed on the display device 5.

  Step S105: The determination unit 9 determines whether to enlarge and display the periphery (gazing point area) of the gazing point on the display screen based on the gazing point and the first distance and the second distance. When the determination unit 9 determines that the gazing point area is displayed in an enlarged manner (YES in step S105), the process proceeds to step S106. When the determination unit 9 determines not to magnify and display the gazing point area (NO in step S105), the process returns to step S103.

  Step S106: The display processing unit 10 causes the display device 5 to display the enlarged content for enlarged display, and ends the control processing.

[Modification 1]
In the above example, the face distance measuring unit 7 measures the face distance based on the captured image in which the user's face is captured by the image capturing device 3, but the present embodiment is not limited to this. In the present embodiment, the face distance measuring unit 7 may be a distance measuring device that measures the face distance without using the captured image. In this case, the face distance measuring unit 7 may be provided in the electronic device 1 separately from the control device 2.

  Since the face distance measuring unit 7 is a distance measuring device, the face distance can be measured with high accuracy. Specifically, subtle movements of the face, such as the movements of the eyes of the user, and movements of the user's face when the user's face approaches the content can be measured with higher accuracy. As a result, the user's desire to see the gazing area of the content large can be reflected in the expanded content more preferably.

  Further, since the face distance measuring unit 7 is a distance measuring device specialized for distance measurement, the face distance can be measured with less power consumption than the image processing by the CPU, so that the load at the time of image processing of the captured image is reduced. can do. This can contribute to power saving.

  Examples of the face distance measuring unit 7 include an optical sensor such as an infrared sensor, an ultrasonic sensor, and a distance image sensor in which a distance measuring function is added to an image sensor.

[Modification 2]
In the above example, the determination unit 9 performs the enlarged display when the face distance decreases by the threshold value or more based on the first distance and the second distance, but the present embodiment is not limited to this. In the present embodiment, the determination unit 9 may perform the enlarged display even when the face is separated from the content of the display device 5 and the face distance increases by a threshold value or more.

  Hereinafter, an example of the predetermined conversion table according to the second modification will be described with reference to FIG. FIG. 5 is a diagram showing an example of a predetermined conversion table. As shown in FIG. 5, when the first distance is smaller than the second distance and the first distance/second distance is smaller than 1, for example, when the user's face is separated from the content of the display device 5, the enlargement is performed. The rate is higher than 1. In this case, the determination unit 9 refers to the predetermined conversion table shown in FIG. 5, and expands the gazing area when the first distance is smaller than the second distance by a threshold value or more.

  As a result, not only a general user but also a presbyopic user can take a quick action such as moving his face away from the contents of the display device 5 to focus on the area of interest. It can be displayed large. As a result, the visibility of the content can be further improved without increasing the operation load on the user.

  Further, the determination unit 9 sets the predetermined conversion table to be referred to as a conversion table for general users only by replacing the conversion table in the storage device 4 or by allowing the user to select it through the user operation reception device 6 or the like. , Can be switched between conversion tables for presbyopia users. As a result, only by replacing the conversion table in the storage device 4 or by allowing the user to select it via the user operation reception device 6 or the like, the display of the enlarged content for the general user and the display of the enlarged content for the presbyopia user are possible. You can switch between and.

<Embodiment 2>
In the electronic device 1 according to the first embodiment, the determination unit 9 determines whether to perform enlarged display based on the face distance. However, like the determination unit 20 in the control device 18 of the electronic device 17 according to the second embodiment, the determination unit 20 may determine whether to perform the enlarged display according to the changing speed of the face distance.

  Hereinafter, the electronic device 17 according to the second embodiment of the present invention will be described with reference to FIG. The same members as those in the first embodiment described above are designated by the same reference numerals, and detailed description thereof will be omitted.

[Electronic device 17]
FIG. 6 is a block diagram showing the configuration of the electronic device 17 according to the second embodiment of the present invention. As shown in FIG. 6, the electronic device 17 includes a control device 18 and a face distance measuring unit 19 instead of the face distance measuring unit 7 and the control device 2 of the electronic device 1 according to the first embodiment. Except for this point, the electronic device 17 has the same configuration as the electronic device 1 according to the first embodiment.

[Control device 18]
As shown in FIG. 6, the control device 18 includes a face distance measuring unit 19 and a determining unit 20 instead of the face distance measuring unit 7 and the determining unit 9 in the first embodiment. Except for this point, the control device 18 according to the second embodiment has the same configuration as the control device 2 according to the first embodiment.

(Face distance measuring unit 19)
The face distance measuring unit 19 calculates, as a first distance, an average value of the measured face distances excluding the face distances whose change rate of the face distance is less than a threshold value during the predetermined time.

  Here, when the face distance is measured for a predetermined time and the user's face slowly approaches or leaves the content of the display device 5, an outlier occurs, and the first distance is an outlier. I will be affected. This causes a mismatch with the original first distance that does not include slowly moving toward or away. As a result, inconsistency occurs when the determination unit 20 determines the magnification rate of the gazing area.

  On the other hand, the face distance measuring unit 19 calculates, as the first distance, the average value of the measured face distances excluding the face distances whose change rate of the face distance is less than the threshold value during the predetermined time. , The first distance that does not include an outlier can be calculated. As a result, it is possible to prevent inconsistency with the original first distance.

  The control device 18 may allow the user to directly set the above-described predetermined threshold value via the user operation reception device 6, or may prepare a predetermined threshold value of several patterns in advance and allow the user to select the predetermined threshold value. Further, the control device 18 may set the predetermined threshold value to a predetermined number by software or the like.

(Determination unit 20)
The determination unit 20 determines whether to perform enlarged display according to the speed at which the user's face approaches or leaves the content of the display device 5, that is, the change speed of the face distance.

  For example, when the change speed of the face distance is less than the threshold value, the determination unit 20 maintains the enlargement ratio of the gazing point area at 1 and does not enlarge the display. On the other hand, when the change speed of the face distance is equal to or more than the threshold value, the determination unit 20 determines whether or not to perform the enlarged display based on the first distance and the second distance, as in the determination unit 9 in the first embodiment.

  By the way, humans are insensitive to slow movements due to homeostasis, and unconsciously perform the movements. Therefore, even if the user makes a motion of slowly approaching the face to the content of the display device 5, there is a high possibility that the motion is unconsciously performed. Therefore, the determination unit 20 is based on the premise that the user does not want to see the content large as the user slowly moves his or her face toward the content of the display device 5. On the contrary, the determination unit 20 is based on the assumption that the user wants to see the content largely when the user approaches his/her face to the content of the display device 5 quickly.

  Therefore, according to the determination unit 20, when the user slowly brings the face closer to the content of the display device 5, the enlarged display is not performed. Therefore, it is possible to display the content according to the unconscious feeling of the user that the content does not want to be greatly viewed. As a result, the sense of discomfort can be reduced compared to the configuration in which the user enlarges the face when the user slowly brings the face closer to the content of the display device 5.

<Embodiment 3>
In the electronic device 1 according to the first embodiment, the determination unit 9 determines whether to perform enlarged display based on the face distance. However, like the electronic device 21 according to the third embodiment, the determination unit 23 of the control device 22 may determine the area in which the gazing area is enlarged according to the layout of the content displayed on the display screen. ..

  Hereinafter, the electronic device 21 according to the third embodiment of the present invention will be described with reference to FIG. 7. The same members as those in the first embodiment described above are designated by the same reference numerals, and detailed description thereof will be omitted.

[Electronic device 21]
FIG. 7 is a block diagram showing the configuration of the electronic device 21 according to the third embodiment of the present invention. As shown in FIG. 7, the electronic device 21 includes a control device 22 instead of the control device 2 of the electronic device 1 according to the first embodiment. Except for this point, the electronic device 21 has the same configuration as the electronic device 1 according to the first embodiment.

[Control device 22]
As shown in FIG. 7, the control device 22 includes a determination unit 23 instead of the determination unit 9 in the first embodiment. Except for this point, the control device 22 according to the third embodiment has the same configuration as the control device 2 according to the first embodiment.

(Determination unit 23)
The determination unit 23 determines an area in which the gazing point area is enlarged according to the layout of the content displayed on the display screen.

  Specifically, when the headline or the body of the content is in horizontal writing, the determination unit 23 determines the region in which the gazing point area is enlarged to a horizontally long range. When the content heading or characters are written vertically, the determination unit 23 determines the region in which the gazing point area is enlarged to be a vertically long range. When the content is a photograph or an illustration, the determination unit 23 determines the area in which the gazing point area is enlarged to a range that matches the frame of the content (image) displayed on the display device 5.

  In contents such as electronic books, headlines, texts, photographs, illustrations, and the like are mixed and arranged in arbitrary layouts such as vertical writing and horizontal writing. On the other hand, the determination unit 23 determines, based on the layout of the content at the position viewed by the user, an area in which the gazing point area corresponding to the layout is enlarged. Therefore, it is possible to determine a region in which the gazing point area is enlarged so that the user can easily see the content at the position where the user sees the content so that the user who views the enlarged content does not feel uncomfortable.

  In addition, in the related art, it is necessary to store, in the storage device 4, data that defines how to determine a region for enlarging the gazing area for each area for the above-described content data. On the other hand, according to the determination unit 23, the data defined above is stored in the storage device 4 in advance in order to analyze the content displayed on the display device 5 to determine the area in which the gazing area is enlarged. You don't have to.

  The determination unit 23 also adjusts the gazing area so that the center of the gazing area and the gazing point are within a predetermined range of distance. The gazing point may not be the center of the gazing area depending on the gazing area determined in consideration of the layout of the content. Therefore, the determination unit 23 can prevent the user from feeling uncomfortable by adjusting the gazing point area so that the center of the gazing point area and the gazing point are not greatly separated from each other.

Note that the determination unit 23 determines whether the layout is horizontal writing or vertical writing based on a known technique such as horizontal and vertical histograms of the content (image) displayed on the display device 5. You may.
[Example of software implementation]
The control blocks of the control devices 2, 18 and 22 in the electronic devices 1, 17 and 21 (in particular, the face distance measuring units 7 and 19, the gazing point detection unit 8, the determination units 9, 20, and 23 and the display processing unit 10) are integrated. It may be realized by a logic circuit (hardware) formed in a circuit (IC chip) or the like, or may be realized by software.

  In the latter case, the control devices 2, 18 and 22 in the electronic devices 1, 17 and 21 are equipped with a computer that executes the instructions of a display control program that is software that realizes each function. The computer includes, for example, at least one processor (control device) and at least one computer-readable recording medium that stores the display control program. Then, in the computer, the processor reads the display control program from the recording medium and executes the program to achieve the object of the present invention. As the processor, for example, a CPU (Central Processing Unit) can be used. As the recording medium, a "non-transitory tangible medium" such as a ROM (Read Only Memory), a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. A RAM (Random Access Memory) for expanding the display control program may be further provided. The display control program may be supplied to the computer via any transmission medium (communication network, broadcast wave, etc.) capable of transmitting the display control program. Note that one aspect of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the display control program is embodied by electronic transmission.

[Summary]
An electronic device according to aspect 1 of the present invention is an electronic device including at least one display device and at least one control device, wherein the control device is a user's point of regard on a display screen of the display device. Is detected, the face distance, which is the distance between the display screen and the face of the user, is measured, and it is determined whether or not the periphery of the gazing point on the display screen is enlarged and displayed based on the face distance.

  In the electronic device according to the second aspect of the present invention, in the first aspect, the control device may determine the enlargement ratio of the enlarged display according to the face distance.

  In the electronic device according to the third aspect of the present invention, according to the first or second aspect, the control device may perform the enlarged display when the face distance decreases by a threshold value or more.

  In the electronic device according to Aspect 4 of the present invention, in the above Aspects 1 to 3, the control device may perform the enlarged display when the face distance increases by a threshold value or more.

  In the electronic device according to the fifth aspect of the present invention, in the above first to fourth aspects, the control device may determine whether to perform the enlarged display according to a change speed of the face distance.

  In the electronic device according to the sixth aspect of the present invention, in the above first to fifth aspects, the control device may determine the area to be enlarged according to the layout of the content displayed on the display screen.

  A control device according to aspect 7 of the present invention is a control device for an electronic device including at least one display device, wherein the control device detects a gazing point of a user on a display screen of the display device. Unit, a face distance measuring unit that measures a face distance that is the distance between the display screen and the user's face, and whether or not to display the periphery of the gazing point on the display screen based on the face distance. A determination unit for determining.

  An electronic device control method according to aspect 8 of the present invention is an electronic device control method including at least one display device and at least one control device, wherein the control device displays a display on the display device. Detecting a user's gazing point on the screen, measuring a face distance that is a distance between the display screen and the user's face, and enlarging the periphery of the gazing point on the display screen based on the face distance. This includes determining whether or not to display.

1, 17, 21 Electronic equipment 2, 18, 22 Control device 5 Display device 7, 19 Face distance measuring unit 8 Gaze point detecting unit 9, 20, 23 Judgment unit 10 Display processing unit (control device)
11 Contents 14 Expanded contents (contents)
12, 15 gazing point area (around the gazing point)
13, 16 gazing point

Claims (8)

An electronic device comprising at least one display device and at least one control device,
The control device is
Detecting the gazing point of the user on the display screen of the display device,
Measuring the face distance, which is the distance between the display screen and the face of the user,
An electronic device, characterized in that it is determined whether or not the periphery of the gazing point on the display screen is enlarged and displayed based on the face distance.   The electronic device according to claim 1, wherein the control device determines an enlargement ratio of the enlarged display according to the face distance.   The electronic device according to claim 1, wherein the control device performs the enlarged display when the face distance decreases by a threshold value or more.   The electronic device according to claim 1, wherein the control device performs the enlarged display when the face distance increases by a threshold value or more.   The electronic device according to claim 1, wherein the control device determines whether to perform the enlarged display according to a change speed of the face distance.   The electronic device according to claim 1, wherein the control device determines an area to be enlarged according to a layout of the content displayed on the display screen. A control device for an electronic device comprising at least one display device,
The control device is
A gazing point detection unit that detects the gazing point of the user on the display screen of the display device,
A face distance measuring unit that measures a face distance that is a distance between the display screen and the user's face;
And a determination unit that determines whether or not the periphery of the gazing point on the display screen is enlarged and displayed based on the face distance. A method for controlling an electronic device, comprising at least one display device and at least one control device,
The control device is
Detecting the point of gaze of the user on the display screen of the display device,
Measuring a face distance, which is a distance between the display screen and the face of the user,
A method of controlling an electronic device, comprising: determining whether or not the periphery of the gazing point on the display screen is enlarged and displayed based on the face distance.

Images