JP2018136449A - Display, display method, control device, and vehicle - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology that can improve visibility of an image in a display.SOLUTION: A display comprises: a display part that displays a display screen of a first size; a control part that performs at least display control of the display part; and a detection part that detects vibration of the display. The control part includes: a movement amount calculation part that calculates the amount of movement that the display is moved due to the vibration of the display; an amplitude calculation part that specifies a peak of a vibration waveform on the basis of the movement amount and calculates the amount of movement of the specified peak as the amplitude of the vibration waveform; an amplitude determination part that determines whether the amplitude of the vibration waveform satisfies a predetermined condition; a reduction size determined part that determines a reduction size for reducing the display screen to a second size smaller than the first size; and a display control part that reduces the display screen and displays as a reduced display screen of the second size.SELECTED DRAWING: Figure 8

Description

  The present technology relates to a display device.

  For example, Patent Document 1 discloses a technique for controlling a display device such as a smartphone so that an image looks stationary in the air when the main body shakes.

JP2015-141700A

  As disclosed in Patent Document 1, display devices are required to improve image visibility.

  The present invention has been made in view of the above points, and an object of the present invention is to provide a technique capable of improving the visibility of an image in a display device.

  One embodiment is a display device, and includes a display unit that displays a display screen of a first size, a control unit that performs display control of at least the display unit, and a detection unit that detects vibration of the display device. The control unit includes a movement amount calculation unit that calculates a movement amount that the display device has moved due to the vibration of the display device, specifies a peak of the vibration waveform based on the movement amount, and determines the movement amount of the specified peak as an amplitude of the vibration waveform. An amplitude calculation unit that calculates the amplitude of the vibration waveform, an amplitude determination unit that determines whether the amplitude of the vibration waveform satisfies a predetermined condition, and an amplitude that satisfies the predetermined condition. A reduction size determination unit that determines a reduction size for reducing to a smaller second size, and a display control unit that reduces the display screen and displays it as a reduced display screen of the second size.

  The visibility of the image on the display device is improved.

It is a perspective view which shows an example of the external appearance of a display apparatus. It is a rear view which shows an example of the external appearance of a display apparatus. It is a block diagram which shows an example of the electrical constitution of a display apparatus. It is a flowchart explaining operation | movement of a display apparatus. It is a flowchart explaining operation | movement of a display apparatus. It is a figure which shows typically operation | movement of a display apparatus. It is a figure which shows an example of a vibration waveform. It is a block diagram which shows an example of a structure of a control part. It is a flowchart explaining the method to reduce a screen according to movement amount. It is a figure explaining the state which reduced and displayed the screen according to the movement amount of the display apparatus. It is the block diagram which showed typically the structure provided with main CPU and sub CPU. It is the block diagram which showed typically the structure provided with main CPU and sub CPU.

<Appearance of display device>
1 and 2 are a perspective view and a rear view showing an example of the appearance of the display device 1, respectively. As shown in FIGS. 1 and 2, the display device 1 includes a plate-like device case 10 that is substantially rectangular in plan view. The device case 10 constitutes the exterior of the display device 1.

  On the front surface 1a of the device case 10, a display area 11 on which various information such as characters, symbols, figures and the like are displayed is located. A touch panel 140 (FIG. 3) to be described later is located on the back side of the display area 11. Thereby, the user can input various information to the display device 1 by operating the display area 11 on the front surface of the display device 1 with a finger or the like. Note that the user can also input various types of information to the display device 1 by operating the display area 11 with a touch panel pen such as a stylus pen other than a finger.

  A receiver hole 12 is located at the upper end of the front surface 1a of the device case 10. A speaker hole 13 is located at the lower end of the front surface 1a. A microphone hole 14 is located on the lower side surface 1 c of the device case 10.

  From the upper end portion of the front surface 1a of the device case 10, a lens 191 included in a first camera 190 (FIG. 3) described later is visible. As shown in FIG. 2, a lens 201 included in a second camera 200 (FIG. 3) to be described later is visible from the upper end of the back surface 1 b of the device case 10.

  The display device 1 includes an operation button group 18 having operation buttons 15, 16 and 17. Each of the operation buttons 15 to 17 is a hardware button. Specifically, each of the operation buttons 15 to 17 is a push button. Note that at least one operation button included in the operation button group 18 may be a software button displayed in the display area 11.

  The operation button group 18 includes a power button and a volume button (not shown) located on the surface of the device case 10.

<Electrical configuration of display device>
FIG. 3 is a block diagram mainly showing an example of the electrical configuration of the display device 1. As illustrated in FIG. 3, the display device 1 includes a control unit 100, a wireless communication unit 110, a display unit 120, a touch panel 140, and an operation button group 18. The display device 1 further includes a receiver 160, a speaker 170, a microphone 180, a first camera 190, and a second camera 200. The display device 1 further includes an acceleration sensor 150 (detection unit) and a battery 210. These components included in the display device 1 are housed in a device case 10.

  The control unit 100 can comprehensively manage the operation of the display device 1 by controlling other components of the display device 1. The control unit 100 can also be said to be a control device. The controller 100 includes at least one processor to provide control and processing capabilities to perform various functions, as described in further detail below.

  According to various embodiments, at least one processor may be implemented as a single integrated circuit (IC) or as a plurality of communicatively connected integrated circuits ICs and / or discrete circuits. Good. The at least one processor can be implemented according to various known techniques.

  In one embodiment, the processor includes one or more circuits or units configured to perform one or more data computation procedures or processes, for example, by executing instructions stored in associated memory. In other embodiments, the processor may be firmware (eg, a discrete logic component) configured to perform one or more data computation procedures or processes.

  According to various embodiments, the processor may include one or more processors, controllers, microprocessors, microcontrollers, application specific integrated circuits (ASICs), digital signal processors, programmable logic devices, field programmable gate arrays, or the like. The functions described below may be performed including any combination of devices or configurations, or other known device and configuration combinations.

  In this example, the control unit 100 includes a CPU (Central Processing Unit) 101, a DSP (Digital Signal Processor) 102, and a storage unit 103. The storage unit 103 includes a non-transitory recording medium that can be read by the CPU 101 and the DSP 102, such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM included in the storage unit 103 is, for example, a flash ROM (flash memory) that is a nonvolatile memory. The storage unit 103 stores a plurality of control programs 103 a for controlling the display device 1. Various functions of the control unit 100 are realized by the CPU 101 and the DSP 102 executing various control programs 103 a in the storage unit 103.

  Note that the control unit 100 may include a plurality of CPUs 101. In this case, the control unit 100 may include a main CPU that performs relatively complicated processing and a sub CPU that performs relatively simple processing. Further, the control unit 100 may not include the DSP 102 or may include a plurality of DSPs 102. Further, all the functions of the control unit 100 or a part of the functions of the control unit 100 may be realized by a hardware circuit that does not require software to realize the function.

  The storage unit 103 may include a computer-readable non-transitory recording medium other than the ROM and RAM. The storage unit 103 may include, for example, a small hard disk drive and an SSD (Solid State Drive).

  The plurality of control programs 103a in the storage unit 103 includes various applications (application programs). The storage unit 103 stores, for example, a call application for making a voice call and a video call, a browser for displaying a website, and a mail application for creating, browsing, and transmitting / receiving an e-mail. The storage unit 103 also has a camera application for photographing a subject using the first camera 190 and the second camera 200, and a recorded image display application for displaying still images and moving images recorded in the storage unit 103. In addition, a music reproduction control application for performing reproduction control of music data stored in the storage unit 103 is stored. At least one application in the storage unit 103 may be stored in advance in the storage unit 103. The at least one application in the storage unit 103 may be one that the display device 1 has downloaded from another device and stored in the storage unit 103.

  The wireless communication unit 110 has an antenna 111. The wireless communication unit 110 can use the antenna 111 to perform wireless communication using a plurality of types of communication methods, for example. Wireless communication of the wireless communication unit 110 is controlled by the control unit 100. It can be said that the wireless communication unit 110 is a communication circuit.

  The wireless communication unit 110 can perform wireless communication with a base station of the mobile phone system. The wireless communication unit 110 can communicate with a mobile phone and a web server other than the display device 1 through the base station and a network such as the Internet. The display device 1 can perform data communication, voice call, video call, and the like with other mobile phones and the like.

  The wireless communication unit 110 performs various processing such as amplification processing on the signal received by the antenna 111, and outputs the processed received signal to the control unit 100. The control unit 100 performs various processes on the input received signal and acquires information included in the received signal. In addition, the control unit 100 outputs a transmission signal including information to the wireless communication unit 110. The wireless communication unit 110 performs various processing such as amplification processing on the input transmission signal, and wirelessly transmits the processed transmission signal from the antenna 111.

  The display unit 120 includes a display area 11 located in front of the display device 1 and a display panel 130. The display unit 120 can display various information in the display area 11. The display panel 130 is, for example, a liquid crystal display panel or an organic EL (Electro Luminescence) panel. The display panel 130 can display various types of information such as characters, symbols, and figures by being controlled by the control unit 100. The display panel 130 faces the display area 11 in the device case 10. Information displayed on the display panel 130 is displayed in the display area 11.

  The touch panel 140 can detect an operation with an operator such as a finger on the display area 11. The touch panel 140 is, for example, a projected capacitive touch panel. The touch panel 140 is located on the back side of the display area 11, for example. When the user operates the display area 11 with an operator such as a finger, the touch panel 140 can input an electric signal corresponding to the operation to the control unit 100. The control unit 100 can specify the content of the operation performed on the display area 11 based on the electrical signal (output signal) from the touch panel 140. And the control part 100 can perform the process according to the specified operation content.

  When the operation buttons 15 to 17 of the operation button group 18 are operated by a user, an operation signal indicating that the operation buttons 15 to 17 are operated can be output to the control unit 100. Accordingly, the control unit 100 can determine whether or not each of the operation buttons 15 to 17 has been operated. When the control unit 100 to which the operation signal is input controls other components, the display device 1 executes a function assigned to the operated operation button.

  The microphone 180 can convert a sound input from the outside of the display device 1 into an electrical sound signal and output it to the control unit 100. Sound from the outside of the display device 1 is taken into the display device 1 from the microphone hole 14 and input to the microphone 180.

  The speaker 170 is, for example, a dynamic speaker. The speaker 170 can convert an electrical sound signal from the control unit 100 into a sound and output the sound. Sound output from the speaker 170 is output from the speaker hole 13 to the outside. The user can hear the sound output from the speaker hole 13 even at a location away from the display device 1.

  The receiver 160 can output a received sound. The receiver 160 is a dynamic speaker, for example. The receiver 160 can convert an electrical sound signal from the control unit 100 into a sound and output the sound. The sound output from the receiver 160 is output from the receiver hole 12 to the outside. The volume of the sound output from the receiver hole 12 is smaller than the volume of the sound output from the speaker hole 13. The user can hear the sound output from the receiver hole 12 by bringing his ear close to the receiver hole 12. Instead of the receiver 160, a vibration element such as a piezoelectric vibration element that vibrates the front portion of the device case 10 may be provided. In this case, the sound is transmitted to the user by the vibration of the front portion.

  The first camera 190 includes a lens 191 and an image sensor. The second camera 200 includes a lens 201 and an image sensor. Each of the first camera 190 and the second camera 200 can photograph a subject based on control by the control unit 100, generate a still image or a moving image indicating the photographed subject, and output the still image or moving image to the control unit 100. .

  The lens 191 of the first camera 190 is visible from the front surface 1 a of the device case 10. Accordingly, the first camera 190 can photograph a subject existing on the front side (display area 11 side) of the display device 1. The first camera 190 is called an in camera. On the other hand, the lens 201 of the second camera 200 is visible from the back surface 1 b of the device case 10. Therefore, the second camera 200 can photograph a subject existing on the back side of the display device 1. The second camera 200 is called an out camera.

  The acceleration sensor 150 can detect the acceleration of the display device 1. The acceleration sensor 150 is, for example, a three-axis acceleration sensor. The acceleration sensor 150 can detect the acceleration of the display device 1 in the X-axis direction, the Y-axis direction, and the Z-axis direction. For example, the X-axis direction, the Y-axis direction, and the Z-axis direction of the acceleration sensor 150 are set in the longitudinal direction, the lateral direction, and the thickness direction of the display device 1, respectively.

  The battery 210 can output the power supply of the display device 1. The battery 210 is, for example, a rechargeable battery. The power output from the battery 210 is supplied to various components such as the control unit 100 and the wireless communication unit 110 included in the display device 1.

  The display device 1 may include a sensor other than the acceleration sensor 150. For example, the display device 1 may include at least one of a geomagnetic sensor, a gyro sensor, an atmospheric pressure sensor, a temperature sensor, a proximity sensor, and an illuminance sensor.

<Prerequisite technology>
Prior to the description of the embodiment, a premise technique for improving the visibility of the display device 1 will be described with reference to FIGS. 1 to 3 and FIGS.

  4 and 5 are flowcharts for explaining the operation of the display device 1 for improving the visibility, and FIG. 6 is a diagram schematically showing the operation.

  The control unit 100 turns on a correction mode for moving the image displayed on the display unit 120 in response to the movement of the display device 1 when the display device 1 moves in a spatial position due to shaking or the like. Judge whether or not. Note that the correction mode is set to ON or OFF when the user performs an operation to set the correction mode on the menu screen of the display device 1, for example.

  As illustrated in FIG. 4, the control unit 100 confirms whether or not the correction mode of the display device 1 is ON in Step S401. If the correction mode is ON (Yes), the control unit 100 proceeds to Step S402. If the correction mode is not ON (No), the operation in step S401 is repeated.

  In step S402, the control unit 100 calculates the movement amount of the display device 1, that is, the movement amount of the image, based on the output of the acceleration sensor 150. The image movement amount calculation operation in step S402 will be described with reference to FIG.

  When the correction mode is turned on, the control unit 100 turns on the acceleration sensor 150 (step S501). Next, the control unit 100 calculates an image movement amount that is a movement amount of the image displayed in the display area 11 of the display unit 120 based on the output of the acceleration sensor 150 (step S502).

  Here, returning to the description of FIG. 4, the control unit 100 moves the image displayed in the display area 11 based on the calculated image movement amount (step S403). The direction in which the image is moved is a direction in which the image appears to be fixed on the display screen. For example, when the display device 1 moves in the X axis positive direction, the display device 1 is moved in the direction to cancel the movement, that is, in the X axis negative direction. Note that the control unit 100 may display the image display position on the display unit 120 after step 403 described above so that the image display position is slightly closer to the position when the operation mode is OFF (standard display position). Thereby, the possibility that the display position of the image is greatly separated from the standard display position can be reduced.

  Thereafter, the control unit 100 determines whether or not the correction mode is turned off. When the correction mode is turned off (Yes), the operation is terminated. When the correction mode is not turned off (No), the operation after Step S402 is performed. Repeat (step S404). Note that the control unit 100 causes the display position of the image to be displayed so as to return to the standard display position after step 404 described above.

  The operation of the display device 1 described with reference to FIGS. 4 and 5 will be described with reference to FIG. In FIG. 6, directions are expressed using an XYZ orthogonal coordinate system, and the X-axis direction, the Y-axis direction, and the Z-axis direction correspond to the short side direction, the long side direction, and the thickness direction of the display device 1, respectively. In the example shown in FIG. 6, it is assumed that the display device 1 has moved by a movement amount L in the positive X-axis direction of the acceleration sensor 150, and the screen of the display area 11 of the display device 1 faces the Z-axis direction of the acceleration sensor 150. It shall be.

  In this case, the control unit 100 detects the acceleration of the moving display device 1 from the output value of the acceleration sensor 150, and calculates the movement amount L of the display device 1 based on the detected acceleration. For example, the movement amount L is obtained by the control unit 100 integrating the acceleration twice over time.

  Next, based on the detected movement amount L, the control unit 100 moves the image displayed in the display area 11 before the display device 1 is moved, here, the entire display screen 301 in the display area 11. In FIG. 6, the display device 1 before movement is shown on the upper side, and the display device 1 after movement is shown on the lower side. In the example shown in FIG. 6, since the display device 1 is moving to the right side (X-axis positive direction) in the drawing, the display screen 301 is detected to the left side (X-axis negative direction) in the display area 11. It is moved by the movement amount L.

  In FIG. 6, a heart-shaped image 3011 is indicated by a solid line on the display screen 301 before the display device 1 moves to make the operation easy to understand. When the correction mode is ON, when the display device 1 moves to the right side (X-axis positive direction) on the drawing, the display screen 301 is detected to move to the left side (X-axis negative direction) in the display area 11. Since the display device 1 moves by the amount L, the center line CL of the image 3011 does not move even after the display device 1 moves, and the image 3011 appears to be stationary on the display screen 301, and the visibility of the display device 1. Will improve. Note that, when the display screen 301 moves to the left in the display area 11 by the movement amount L, an area NR indicating a margin is generated at the right end of the display area 11. In the area NR, an image different from the display screen 301 is displayed. For example, an image painted in a predetermined single color is displayed over the entire area NR.

  On the other hand, when the correction mode is not ON, when the display device 1 moves to the right (X-axis positive direction) by the movement amount L on the drawing, the display screen 301 also moves to the right by the movement amount L. As a result, the image 3011 also moves to the right by the movement amount L, becomes the position of the image 3012 indicated by a broken line, and the visibility of the display device 1 decreases.

  For example, when the user is holding and using the display device 1 in a vehicle, the user also shakes as the vehicle shakes. In this case, the user's head (eyes) and the hand holding the display device 1 do not move in synchronization, and if the correction mode is not ON, the image is shaken and visibility is lowered. However, if the correction mode is ON, the image appears to be fixed on the display screen 301 of the display device 1, and for example, reading of characters and the like is facilitated, and visibility is improved.

  For a user whose hand holding the display device 1 shakes due to circumstances such as aging or illness, even if the hand shakes, the image on the display screen of the display device 1 appears to be fixed, and thus visibility is improved.

  In order to move the display screen 301 in accordance with the detected movement amount L, for example, the central portion CP of the display screen 301 before the movement, that is, the central portion of the display screen 301 in the X-axis direction and the Y-axis direction is the origin. The image data position may be changed so that the origin moves in the X-axis direction and the Y-axis direction.

  In the above description, the entire display screen 301 is moved. However, only a specific image on the display screen 301 may be moved.

  Since the display device 1 displays an image in the display area 11 at a predetermined frame rate, the amount of movement of the display device 1 is calculated a plurality of times during one frame period defined by the frame rate. A total value of a plurality of movement amounts can be taken as a movement amount in one frame period. For example, if the frame rate is 60 fps (frames per second), the length of the frame period is 1/60 second, which is about 17 msec. During this time, if the acceleration sensor 150 measures the acceleration applied to the display device 1 every 5 msec, for example, three measurements are possible. The image displayed in the display area 11 at a predetermined frame rate may be a moving image or a still image.

  In the above description, the configuration in which the movement amount of the display device 1 is calculated based on the output of the acceleration sensor has been described. However, the movement amount of the display device 1 is calculated based on the movement amount of the image captured by the camera. Also good.

  That is, the control unit 100 specifies a reference image in the captured image captured by the first camera (out camera) 190. As the reference image, for example, an image having the highest luminance among the captured images is detected and set as the reference image. Note that the reference image setting method is not limited to the highest brightness among the captured images, and a person image, an image having a predetermined shape, a predetermined color in the captured image You may set to the image etc. which have. For example, an image having a predetermined image data value such as contrast may be used as the reference image. And the control part 100 specifies the predetermined coordinate position of the reference | standard image in a captured image, and makes it a 1st coordinate.

  Next, after the display device 1 has moved by the movement amount L, the control unit 100 identifies a reference image in the captured image captured by the out-camera 190, and identifies a predetermined coordinate position in the reference image. , The second coordinate.

  Next, the control unit 100 obtains the movement amount of the reference image from the displacement value from the first coordinate to the second coordinate in the captured image, and calculates the movement amount L of the display device 1.

  In addition, although the example which calculates the movement amount L of the display apparatus 1 using the captured image imaged with the 1st camera (out camera) 190 was shown above, the captured image imaged with the 2nd camera (in camera) 200 was shown. It may be used to calculate the movement amount L of the display device 1.

  Whether the first camera 190 or the second camera 200 is used, the captured image is not limited to a moving image, and still images may be continuously captured to calculate the amount of image movement.

<Embodiment>
Hereinafter, embodiments will be described with reference to FIGS. As described with reference to FIG. 6, by turning on the correction mode, the image 3011 appears to be stationary on the display screen 301 even after the display device 1 is moved, but the display screen 301 is within the display area 11. By moving to the left by the movement amount L, a region NR where no display image exists is generated at the right end of the display region 11. The width of the region NR (the length in the X-axis direction) is the same as the movement amount L, and the display screen 301 has moved to the left by the movement amount L, so that the left end of the display screen 301 before the movement is moved. The amount L is not displayed and is not visible. In FIG. 6, the image 3011 on the display screen 301 is visible after the movement, but depending on the amount of movement L, a part or all of the image 3011 may be invisible.

  Therefore, even when the display screen 301 is moved in accordance with the movement of the display device 1, the entire display screen 301 is reduced and displayed, so that part or all of the image 3011 can be prevented from being seen. A method is conceivable. In that case, it is conceivable to set the reduced size of the display screen 301 so that the moving range of the display device 1 can be assumed in advance, so that the entire moving range can be accommodated. It may become too difficult to see the image. Based on this problem recognition, the inventors have reached the technical idea of setting a reduced size of the display screen 301 based on the amount of movement of the display device 1.

  FIG. 7 is a waveform diagram illustrating an example of a vibration waveform applied to the display device 1, where the horizontal axis indicates time and the vertical axis indicates the amount of movement of the display device 1.

  That is, when the correction mode is turned on, the control unit 100 turns on the acceleration sensor 150, and the turned-on acceleration sensor 150 repeats measurement of acceleration at a predetermined interval. Accordingly, when the correction mode of the display device 1 in the vehicle is turned on and vibration is applied to the display device 1, the acceleration sensor 150 causes the acceleration applied to the display device 1 at a predetermined interval, for example, every 5 msec. Is measured and output to the control unit 100.

  The control unit 100 detects the acceleration from the output value of the acceleration sensor 150 and calculates the amount of movement of the display device 1 by integrating the acceleration twice over time. By repeating this series of processing, a vibration waveform as shown in FIG. 7 can be acquired.

  FIG. 7 shows a state in which a vibration with a small amplitude (amount of movement) suddenly increases and a vibration with a large amplitude continues for about 1 second. Such a state corresponds to, for example, a state in which the display device 1 is vibrated as the vehicle shakes when the user uses the display device 1 while holding the vehicle in the vehicle.

  In FIG. 7, the movement amount of the point P1 at the first peak on the positive (+) side of the vibration waveform is L1, and the movement amount of the point P2 at the second peak on the positive side of the vibration waveform is L2. Hereinafter, the half amplitude of the waveform is referred to as the amplitude of the waveform.

  Here, the minute waveform that exists until the first peak appears is a waveform in the measurement error range of the acceleration sensor 150, and is a background waveform and is not handled as vibration applied to the display device 1. Note that the amount of movement of the point P0 at the positive peak of the background waveform is L0.

  In order to identify the point P1 at the first peak on the positive side of the vibration waveform as described above, the acceleration may be measured at least three times including the point P1. That is, if acceleration is measured three times and the change in time of the movement amount at three points is known, it changes whether it changes toward the peak, away from the peak, or includes the peak. You can see if it is. If the acceleration sensor 150 measures the acceleration applied to the display device 1 every 5 msec, three measurements can be performed in 1/60 second, and one peak of the vibration waveform can be specified. .

  When one peak of the vibration waveform is specified, the reduced size of the display screen 301 is set based on the movement amount at the peak. In this way, by setting the reduced size of the display screen 301 based on the specified peak, the reduced size of the display screen 301 is set by assuming the movement range of the display device 1 in advance. The subsequent display screen 301 becomes too small and it is difficult to see the image.

<Functional blocks in the control unit>
FIG. 8 is a diagram illustrating some functional blocks formed by the CPU 101 and the DSP 102 executing the control program 103 a in the storage unit 103.

  As shown in FIG. 8, the control unit 100 includes a movement amount calculation unit 300, an amplitude calculation unit 400, an amplitude determination unit 500, a reduced size determination unit 600, and a display control unit 700 as functional blocks. At least one of the movement amount calculation unit 300, the amplitude calculation unit 400, the amplitude determination unit 500, the reduced size determination unit 600, and the display control unit 700 may be realized by a hardware circuit that does not require software to execute the function. .

  The movement amount calculation unit 300 detects the acceleration from the output value of the acceleration sensor 150 and calculates the movement amount of the display device 1 by integrating the acceleration twice over time.

  The amplitude calculation unit 400 identifies one peak of the vibration waveform based on the movement amount of the display device 1 calculated by the movement amount calculation unit 300, and calculates a movement amount representing the height of the identified peak as the amplitude of the vibration waveform. To do.

  The amplitude determination unit 500 determines whether or not the amplitude of the vibration waveform calculated by the amplitude calculation unit 400 satisfies a predetermined condition.

  The reduction size determination unit 600 determines the reduction size of the display screen based on the amplitude of the vibration waveform that satisfies a predetermined condition.

  The display control unit 700 performs display control for reducing the display screen 301 so as to match the reduction size of the display screen determined by the reduction size determination unit 600.

<Reduction processing of display screen by control unit>
Next, display screen reduction processing by the control unit 100 will be described using the flowchart shown in FIG. 9 with reference to FIG.

  When the correction mode is turned on, the control unit 100 turns on the acceleration sensor 150, and causes the acceleration sensor 150 that is turned on to repeat measurement of acceleration at a predetermined interval (step S1).

  The movement amount calculation unit 300 of the control unit 100 detects the acceleration from the output value of the acceleration sensor 150, and calculates the movement amount of the display device 1 by integrating the acceleration twice over time (step S2).

  When the amplitude calculation unit 400 of the control unit 100 identifies one peak of the vibration waveform based on the movement amount of the display device 1 calculated by the movement amount calculation unit 300, the height of the identified peak is used as the amplitude of the waveform. Calculate (step S3). In addition, when the peak of the vibration waveform cannot be identified and the amplitude cannot be calculated, for example, when the time change of the movement amount obtained by measuring the acceleration three times changes toward the peak or changes away from the peak In the case where the amplitude is not calculated, it is assumed that the amplitude could not be calculated, and the processes in and after step S1 are repeated. On the other hand, when the time change of the movement amount changes including the peak, it is assumed that the amplitude has been calculated, and the process proceeds to step S4.

  The amplitude determination unit 500 of the control unit 100 determines whether or not the amplitude calculated in step S3 is greater than or equal to a predetermined first threshold value (step S4). This determination is performed in order to exclude a peak identified in step S3 that is not a peak due to vibration such as a peak of a background waveform shown in FIG. Therefore, the first threshold value is set to the value of the movement amount of the point P0 at the peak of the background waveform. The first threshold value is not limited to this, and may be set to a value larger than the peak of the background waveform so that the reduction function of the display screen does not react to minute vibrations. By doing so, it is possible to suppress frequent reduction and enlargement of the display screen.

  If it is determined in step S4 that the amplitude is smaller than the first threshold value, the process from step S1 is repeated, and if the amplitude is determined to be greater than or equal to the first threshold value, the process proceeds to step S5. .

  The amplitude determination unit 500 of the control unit 100 determines whether or not the amplitude calculated in step S3 is greater than or equal to a predetermined second threshold value (step S5). This determination is performed in order to eliminate peaks that are extremely large compared to other peaks, such as the second peak on the positive side of the vibration waveform shown in FIG. This is performed to prevent the display screen 301 from being extremely reduced when the amount of movement due to vibration is extremely large. For this reason, the second threshold value is set to a value that does not result in a size that makes it impossible to determine the display screen 301. For example, when the amount of movement due to vibration is about ¼ of the length of the display area 11 in the X-axis direction, if the display screen 301 is reduced corresponding to this, the X-axis of the reduced display screen 301 The length in the direction is half that in the normal display, and the Y-axis direction is similarly reduced, so that the area is about ¼ that in the normal display. Therefore, for example, when the amount of movement is set to a value smaller than ¼ of the length of the display area 11 in the X-axis direction, the display screen may be extremely reduced. Do not. This value is an example, and may be set arbitrarily depending on the size of the display area 11 and the like. A method for determining the reduced size of the display screen will be further described later.

  If it is determined in step S5 that the amplitude is larger than the first threshold value, the processing from step S1 is repeated, and if it is determined that the amplitude is smaller than the first threshold value, step S6 is performed. Proceed to

  The reduction size determination unit 600 of the control unit 100 determines the reduction size of the display screen based on the amplitude of the waveform calculated in step S3 (step S6). For example, when the amplitude calculated in step S3 is 5 mm, the display screen 301 is reduced and displayed so that the display screen 301 becomes smaller by 5 mm on the left and right sides in the X-axis direction and 5 mm on the upper and lower sides in the Y-axis direction. FIG. 10 schematically shows a reduced display screen 302 reduced in this way. Due to the reduction, the image 3011 is also reduced to an image 3013. The screen size (screen size) of the display screen 301 may be referred to as a first size, and the screen size of the reduced display screen 302 may be referred to as a second size.

  FIG. 10 shows a case where the display device 1 is moved to the right side (X-axis positive direction) in the drawing, and the reduction display screen 302 is detected to the left side (X-axis negative direction) in the display area 11. Since it moves by L (here, 5 mm), the center line CL of the image 3013 does not move even after the display device 1 moves, and the image 3013 appears to be stationary on the reduced display screen 302. Note that when the reduced display screen 302 moves to the left in the display area 11 by the movement amount L, an area NR in which no display image exists is generated at the right end of the display area 11, and the length in the X-axis direction is 2L. In addition, the region NR also occurs on the top and bottom of the reduced display screen 302 in the Y-axis direction.

  Here, the region NR generated around the reduced display screen 302 is set to a darker color than the reduced display screen 302 such as black and dark blue. Darkening the periphery of the reduced display screen 302 makes it easier to see the image on the reduced display screen 302. Further, in the self-luminous display device, the power consumption of the display device 1 can be reduced by darkening the periphery of the reduced display screen 302. The area NR may be set to the same or similar color as the background color of the reduced display screen 302. By setting the area NR to the same color as or similar to the background color of the reduced display screen 302, when the area NR occurs, the change in the amount of light at the position corresponding to the area NR is reduced, so that the user's eyes are less tired. . The color set in the region NR may be changed depending on the type of screen displayed on the reduced display screen 302. For example, when the reduced display screen 302 is a screen with a low probability of browsing for a long time such as a home screen or a screen where priority is given to the visibility of a screen such as a video playback application screen, the area NR is compared with the reduced display screen 302. And set it to a dark color. When the reduced display screen 302 is a screen such as a Web browser application, a game application screen, or an SNS application screen that can be browsed for a long time, if the area NR is set to a color that is the same as or similar to the background color of the reduced display screen 302 Good.

  Note that, as a reduction size determination method, a reduction rate corresponding to the detected movement amount may be set in advance, and the display screen 301 may be reduced in the X-axis direction and the Y-axis direction with the reduction rate. In this case, the same reduction ratio may be used in the X-axis direction and the Y-axis direction. However, by using different reduction ratios in the X-axis direction and the Y-axis direction so as to maintain the aspect ratio of the display area 11, A reduced display screen 302 that maintains the aspect ratio can be obtained, and the uncomfortable feeling caused by the reduction can be reduced.

  Further, instead of reducing the display screen 301 in the X-axis direction and the Y-axis direction, the display screen 301 may be reduced only in the direction in which the display device 1 has moved. By reducing only one direction, it is possible to suppress the reduction display screen 302 from becoming small, and to prevent the display image from becoming difficult to distinguish.

  In addition, as the time for which the display screen 301 is reduced to become the reduced display screen 302 is as short as possible, control for moving the image is started earlier while suppressing a part or all of the image 3011 from being invisible. This is preferable. On the other hand, the time for which the reduced display screen 302 is enlarged to become the display screen 301 is preferably as long as possible because the user's eyes are less likely to get tired. Therefore, it is preferable that the time for which the reduced display screen 302 is enlarged to become the display screen 301 is longer than the time for which the display screen 301 is reduced to become the reduced display screen 302.

  The display control unit 700 of the control unit 100 performs display control so that the display screen 301 is reduced and displayed based on the reduction size of the display screen determined by the reduction size determination unit 600 (step S7). In addition, in parallel with the display screen reduction process, the control unit 100 also performs control to move the display screen in a direction to cancel the movement of the display device 1, and the reduced display screen 302 is displayed as shown in FIG. The movement amount L is moved to the left in the area 11.

  After the display screen 301 is reduced and displayed, the control unit 100 determines whether or not the period during which the amplitude is not detected in step S3 exceeds a predetermined time (undetected time) (step S8). If not, the process after step S1 is repeated while maintaining the reduced size of the display screen 301. If the undetected time is exceeded, the reduced display is canceled at step S9, and the process after step S1 is performed. repeat.

  That is, the control unit 100 repeats the processing from step S1 until the correction mode is turned off, but once the display screen 301 is reduced and displayed, the display is continued until the amplitude of the next waveform is calculated in step S3. The reduced size of the screen 301 is maintained. For example, in FIG. 7, after the display screen 301 is reduced and displayed based on the movement amount L1 of the point P1 at the first peak on the positive side of the vibration waveform, the first peak on the negative (−) side of the vibration waveform is displayed. The reduced size of the display screen is maintained until the amplitude of the point P3 is calculated.

  In this way, once the display screen 301 is reduced and displayed, the reduced size of the display screen 301 is maintained until the amplitude of the next waveform is calculated in step S3, so the size of the display screen 301 changes frequently. This is suppressed, and the visibility of the display device 1 is improved. As described above, the control for moving the display screen in the direction to cancel the movement of the display device 1 is also performed in parallel, and this control is performed regardless of the presence or absence of the peak, so that the size of the reduced display screen 302 is maintained. Even during this period, the image 3013 appears to be stationary on the reduced display screen 302.

  On the other hand, since it is not necessary to maintain the reduced display screen 302 until the display device 1 no longer vibrates, the reduced display is canceled when the amplitude is not calculated for a certain time. Since the reduced display is not executed unless the amplitude of the vibration waveform is calculated in step S3, the display screen 301 is maintained. Although the undetected time can be set arbitrarily, it can be set based on the period assuming vibration applied to the display device 1. That is, if the vibration frequency is about 10 Hz, the period is about 0.1 seconds. If the non-detection time is set shorter than 0.1 seconds, the reduced display is canceled before the end of one cycle, so that the reduction and enlargement of the display screen are frequently repeated. Therefore, when the vibration frequency is about 10 Hz, it is desirable to set the non-detection time to about 1 second to several seconds.

<Modification of control unit>
Although FIG. 3 shows a configuration in which the control unit 100 includes one CPU 101, the control unit 100 may include a plurality of CPUs. In this case, the control unit 100 may include a main CPU that performs relatively complicated processing and a sub CPU that performs relatively simple processing.

  FIG. 11 is a block diagram schematically illustrating a configuration in which the control unit 100 includes a main CPU 101m and a sub CPU 101s.

  In such a configuration, the main CPU 101m transmits the image data of the display screen 301 to the display panel 130, and the sub CPU 101s performs the above-described processing of steps S1 to S9 based on the reduced size obtained. The display screen 301 is reduced and displayed by changing the image data. By adopting such a configuration, the sub CPU 101s need only have a function of executing the processes of steps S1 to S9, and the device configuration is simplified.

  FIG. 12 is also a block diagram schematically illustrating a configuration in which the control unit 100 includes the main CPU 101m and the sub CPU 101s. However, the main CPU 101m does not transmit the image data of the display screen 301 to the display panel 130. Instead, the image data of the display screen 301 is transmitted via the sub CPU 101s. In this case, the sub CPU 101s has a function of creating the image data of the display screen 301, and the display panel 130 displays the image data that has been changed based on the reduced size obtained by executing the processes of steps S1 to S9 described above. Will be sent to. By adopting such a configuration, the sub CPU 101s generates image data, so that the processing amount of the main CPU 101m can be reduced.

  11 and FIG. 12, the processing amount of the main CPU 101m is reduced, and the power saving of the main CPU 101m can be achieved.

  Also, the main CPU 101m and the sub CPU 101s can perform parallel processing, and the time from when the acceleration is detected by the acceleration sensor 150 until the reduction size of the display screen 301 is determined can be shortened. Further, when the processing of steps S1 to S9 is executed by the main CPU, a waiting time for other processing by the main CPU may occur. However, when the sub CPU 101s is used, acceleration is detected. It is possible to shorten the time until the reduction size of the display screen 301 is determined.

<Other embodiments>
In the above-described embodiment, an example in which the display device is used in a portable electronic device has been described. However, the display device is not limited to a portable device, and is fixed in a vehicle such as a train or an automobile. You may use for a display apparatus. In that case, the embodiment is a vehicle including the display device.

  In the present invention, the embodiments can be appropriately modified and omitted within the scope of the invention.

DESCRIPTION OF SYMBOLS 120 Display part 150 Acceleration sensor 300 Movement amount calculation part 400 Amplitude calculation part 500 Amplitude determination part 600 Reduction size determination part 700 Display control part

Claims (9)

A display device,
A display unit for displaying a display screen of a first size;
A control unit that performs display control of at least the display unit;
A detection unit for detecting vibration of the display device,
The controller is
A movement amount calculation unit for calculating a movement amount of movement of the display device due to vibration of the display device;
An amplitude calculation unit that identifies the peak of the vibration waveform based on the movement amount, and calculates the movement amount of the identified peak as the amplitude of the vibration waveform;
An amplitude determination unit that determines whether the amplitude of the vibration waveform satisfies a predetermined condition;
A reduced size determining unit that determines a reduced size for reducing the display screen to a second size smaller than the first size based on an amplitude that satisfies the predetermined condition;
A display control unit configured to reduce the display screen and display the reduced display screen as the second size reduction display screen. The amplitude that satisfies the predetermined condition is
The display device according to claim 1, wherein the display device has an amplitude that is greater than or equal to a first threshold and less than or equal to a second threshold that is greater than the first threshold. The display control unit
The display device according to claim 1, wherein the display position of the reduced display screen is moved and displayed by the same movement amount as the movement amount calculated by the movement amount calculation unit in a direction to cancel the movement of the display device. The display control unit
The display device according to claim 1, wherein an area where no image is generated by reducing the display screen to the reduced display screen is displayed in a darker color than the reduced display screen. The controller is
The display device according to claim 1, wherein the reduced display screen is returned to the display screen when vibration is no longer applied to the display device. The detector is
The display device according to claim 1, wherein the display device is an acceleration sensor that detects acceleration of the display device. A display method on a display unit of a display device,
(A) calculating the amount of movement of the display device due to vibration of the display device;
(B) identifying the peak of the vibration waveform based on the movement amount calculated in step (a), and calculating the movement amount of the identified peak as the amplitude of the vibration waveform;
(C) determining whether the amplitude of the vibration waveform satisfies a predetermined condition;
(D) determining a reduction size for reducing the display screen to a second size smaller than the first size based on the amplitude satisfying the predetermined condition;
(E) reducing the display screen to the second size and displaying it as a reduced display screen. A control device that performs display control of a display unit of a display device,
Processing for calculating the amount of movement of the display device due to vibration of the display device;
Identifying a peak of the vibration waveform based on the amount of movement, and calculating the amount of movement of the identified peak as the amplitude of the vibration waveform;
A process of determining whether the amplitude of the vibration waveform satisfies a predetermined condition;
A process of determining a reduction size for reducing the display screen to a second size smaller than the first size based on an amplitude that satisfies the predetermined condition;
A control device that performs processing for reducing the display screen to the second size and displaying the reduced screen as a reduced display screen.   A vehicle comprising the display device according to any one of claims 1 to 6.

Images