JP6639954B2 - Display device - Google Patents

Description

  The present invention relates to a display device capable of changing a display area.

  In recent years, there is a technique for displaying an image around a position serving as a reference such as a current position of a user. For example, a technique called Augmented Reality (AR) has been considered. According to the technology of augmented reality, various contents can be provided to a user by superimposing and displaying an object for explaining an object shown in the video on an actual video. Patent Document 1 describes an AR technology. In this document, a method of superimposed display is changed based on a distance between an object projected in the real world and a viewpoint of a video in the real world. There is a description.

International Publication 2010/073616 pamphlet

  By the way, when an image around the reference position is displayed, not only a certain direction (for example, the front as viewed from the user) but also an image in another direction is included in order to widen the area visible to the user. Thus, it is desired to easily change the area of the display target (for example, video).

  Therefore, it is an object to provide a display device capable of easily changing the display target area.

In order to solve the above-described problems, a display device of the present invention is configured to be able to bend a display screen, to display a space content corresponding to a predetermined area, and to detect a bent state of the display means. Detecting means , based on the bending state detected by the detecting means, the display means, a positional relationship specifying means for specifying a positional relationship with a user, and an area based on the bending state detected by the detecting means. Display control means for displaying the changed spatial content on a display screen , wherein the display control means displays the spatial content corresponding to the area based on the positional relationship specified by the positional relationship specifying means .

According to the present invention, the spatial content whose area is changed based on the bending state of the display means is displayed, so that the spatial content whose area to be displayed is changed can be easily displayed. Furthermore, since the area of the spatial content is changed in consideration of the positional relationship with the user, the spatial content can be easily displayed in consideration of the user's field of view.

  Further, in this display device, the display control means may display on the display screen the spatial content in which the area is expanded when the detection means detects that the display means is bent in the valley direction.

  According to the present invention, when it is bent in the valley direction, the space content in which the area is expanded is displayed, so that the space content in which the area has been changed can be easily changed.

  In this display device, the display control means may cause the display screen to display the spatial content whose display angle has been changed based on the bending state detected by the detection means.

  According to the present invention, since the spatial content whose display angle is changed according to the bending state is displayed, the spatial content in the direction in which the bending is performed can be easily displayed.

  According to the present invention, the display area can be easily changed.

FIG. 1 is an external view illustrating an external appearance of a display device 100. FIG. 2 is a block diagram illustrating functions of the display device 100 according to the embodiment. FIG. 2 is a hardware configuration diagram of a display device 100. FIG. 4 is a diagram illustrating a method for calculating a distance to a user. It is a figure showing example (1) which changes a display area. It is a figure showing example (2) which changes a display area. 4 is a flowchart illustrating processing contents of the display device 100.

  An embodiment of the present invention will be described with reference to the accompanying drawings. When possible, the same parts are denoted by the same reference numerals, and redundant description will be omitted.

  FIG. 1 is an external view showing the external appearance of a display device 100 (display device) of the present embodiment. The display device 100 is a so-called flexible display including a display unit 101 (display units 101a to 101c) that is a display unit that can be bent toward the near side (valley direction) along the folding lines L1 and L2. is there. Note that a mechanism (for example, a hinge or the like) for folding the display unit 101 is provided on the back surface of the display device 100, and can be folded along the folding lines L1 and L2. In addition, an in-camera is provided at the center of the upper end of each of the display units 101a to 101c (positions P1 to P3). In addition, the display device 100 displays a screen (for example, a map screen) corresponding to a predetermined position in response to a user operation request. Further, when an arbitrary position (reference position) and direction (reference direction) on the screen are set by a user input or the like, the display device 100 displays an image (spatial content) of the direction at an arbitrary position on the map screen. It is displayed on the display unit 101 (display screen). Here, the spatial content is an image indicating spatial content based on the reference position and the reference direction, and is, for example, an image of the real world, a three-dimensional map, or the like. Note that the direction may be set in advance instead of being set by a user input (for example, an upward direction from the bottom of the displayed map screen). These screens and images are information acquired from the server device via the network. The server device stores the position, the direction, the angle indicating the display range, and the image in association with each other. Upon receiving the position, the direction, and the angle from the display device 100 and receiving the image transmission request, the image corresponding to the position, the direction, and the angle are transmitted to the display device 100. When the server device receives the position and the direction from the display device 100 and receives the image transmission request, the server device displays the image corresponding to the position, the angle, and the angle stored in the server device as a default value in advance. The data is transmitted to the display device 100.

  FIG. 2 is a block diagram illustrating functions of the display device 100 according to the present embodiment. As shown in FIG. 2, the display device 100 includes a display unit 101, a bending detection unit 102 (detection unit), a positional relationship identification unit 103 (positional relationship identification unit), and a display control unit 104 (display control unit). It is comprised including.

  FIG. 3 is a hardware configuration diagram of the display device 100. The display device 100 shown in FIG. 2 physically includes, as shown in FIG. 3, one or a plurality of CPUs 11, a RAM 12 and a ROM 13 as main storage devices, an input device 14 as an input device such as a touch panel, and the like. Including a camera 15 such as an in-camera, an output device 16 such as a display, a communication module 17 such as a data transmission / reception device such as a network card, an auxiliary storage device 18 such as a semiconductor memory, and a bending sensor 19 for detecting a bending state of the display It is configured as a computer system. The functions described in FIG. 2 are performed by reading predetermined computer software on hardware such as the CPU 11 and the RAM 12 shown in FIG. 4, so that the input device 14, the camera 15, the output device 16, This is realized by operating the communication module 17 and the bending sensor 19 and reading and writing data in the RAM 12 and the auxiliary storage device 18. Hereinafter, each functional block will be described based on the functional blocks shown in FIG.

  The display unit 101 is a part that displays the image and the map screen acquired by the display control unit 104. In addition, the display unit 101 can bend the display screen along the folding lines L1 and L2. The display unit 101 may be a touch panel display that can accept a touch operation from a user on a touch surface of the display unit 101.

  The bending detection unit 102 is a unit that detects a bending state of the display unit 101. The bending detection unit 102 acquires the resistance values of the bending sensors 19 arranged at the bending line L1 and the bending line L2, respectively, and detects the bending state. The bending sensor 19 changes its electric resistance in proportion to the curvature. For example, the bending sensor 19 changes its electric resistance only for bending in one direction. The bending sensor 19 is disposed at the upper end or the lower end of the display unit 101 so as not to obstruct the visual recognition of the image (end points of the bending lines L1 and L2). The bending detection unit 102 stores information in which the electric resistance value is associated with angle information indicating how much the display unit 101 has been bent, and refers to the associated information to refer to the bending sensor 19. Specify the angle (information on the bending state) corresponding to the electric resistance value acquired from. The bend detecting unit 102 sends the angle to the positional relationship specifying unit 103 and the display control unit 104.

  The positional relationship specifying unit 103 is a unit that specifies the positional relationship between the display unit 101 and the user based on the angle specified by the bending detecting unit 102. First, the positional relationship specifying unit 103 acquires an angle from the bending detection unit 102. The positional relationship specifying unit 103 calculates the distance of the in-camera between the display units 101 based on the angle and the position of the in-camera arranged on each display unit 101. The positional relationship specifying unit 103 stores the position of the in-camera of each display unit 101 in advance. For example, as shown in FIG. 4, the positional relationship specifying unit 103 calculates the distance between the in-cameras based on the in-camera positions P1 to P3 of each display unit 101.

  Subsequently, the positional relationship specifying unit 103 operates the in-cameras arranged in each of the display units 101 to acquire an image of the user captured by the in-camera of each of the display units 101. The positional relationship specifying unit 103 specifies a common part (for example, a user's nose part (position P4)) from an image captured by the in-camera of each display unit 101. Subsequently, the positional relationship specifying unit 103 calculates the distance between each in-camera and the user by triangulation, which is a known technique. The positional relationship specifying unit 103 specifies the angles α and β shown in FIG. 4 based on the distance between each camera and the distance between the camera and the user.

  As described above, the positional relationship specifying unit 103 specifies the angles α and β as shown in FIG. 4 as the positional relationship between the display unit 101 and the user. The positional relationship specifying unit 103 sends the angle γ obtained by adding the specified angle α and angle β to the display control unit 104. The angle γ decreases when the user is away from the display unit 101, and increases when the user approaches the display unit 101. That is, the angle γ is information indicating the positional relationship between the user and the display unit 101.

  The display control unit 104 is a unit that controls display of an image and a screen to be displayed on the display unit 101. When detecting a request to display an image on a map by a user operation, the display control unit 104 transmits information indicating a reference position and a reference direction to an external server (for example, a Web server), and An image corresponding to the reference direction is acquired from the server, and the image is output to the display unit 101. For example, as illustrated in FIG. 5A, the display control unit 104 acquires an image in which an area AR1 which is an area in front of the reference position of the display unit 101 as a display area, and displays the image on the display unit 101. Let it. In this case, for example, an image as shown in FIG. 5B is displayed. As described above, the display control unit 104 causes the display unit 101 to display an image corresponding to a predetermined area (area AR1) based on the reference position and the reference direction. That is, the display unit 101 displays an image corresponding to a predetermined area.

  Further, in a state where the image as shown in FIG. 5B is displayed, the display control unit 104 compares the angle obtained from the bending detection unit 102 with the angle specified by the positional relationship specifying unit 103. The display area of the image is changed based on the image. Specifically, the display control unit 104 acquires the angle acquired from the bending detection unit 102 and the angle specified by the positional relationship specifying unit 103. Subsequently, the display control unit 104 specifies the direction in which the display unit 101a and the display unit 101c face based on the angle and the reference direction (the direction of the display unit 101b) acquired from the bending detection unit 102.

  When the angle acquired from the bending detection unit 102 indicates that the display unit 101 is bent along the bending line L1 and the bending line L2, the display control unit 104 displays the display unit 101a, the display unit 101b, and the display unit. The information indicating the respective directions of 101c, the reference position, and the angle specified by the positional relationship specifying unit 103 are sent to the server. The display control unit 104 acquires an image based on the information from the server, and causes the display unit 101 to display the acquired information. As described above, the display control unit 104 specifies a plurality of display locations (display surfaces of the display units 101a to 101c) based on the angle acquired from the bending detection unit 102, and displays the display locations of the respective display locations. Display the acquired image.

  As shown in FIG. 5C, the display control unit 104 displays each of the divided areas AR2, AR3, and AR4 corresponding to each of the divided display units 101a, 101b, and 101c in the display area. Is acquired, and the image is displayed on each display unit 101. As described above, the display control unit 104 displays the display such as the area AR2 and the area AR4 based on the information indicating the respective directions of the display unit 101c, the reference position, and the angle specified by the positional relationship specifying unit 103. An image in a region having a different angle (a region in a direction different from the reference direction) is acquired, and the image is displayed. For example, an image as shown in FIG. 5D is displayed. As shown in FIG. 5D, the display control unit 104 displays not only an image in one direction but also an image in another direction. Here, the area AR2, the area AR3, and the area AR4 are areas based on the angle specified by the positional relationship specifying unit 103. That is, when the angle is small, the display area becomes narrow, and when the angle is large, the display area becomes wide.

  As described above, since the display control unit 104 displays an image based on the angle calculated by the positional relationship specifying unit 103, the displayed image changes according to the positional relationship between the user and the display unit 101. That is, the display control unit 104 changes the display area based on the positional relationship between the user and the display unit 101.

  The display control unit 104 acquires an image on the entire display unit 101 based on the angle specified by the positional relationship specifying unit 103 and displays the image, in addition to displaying images in a plurality of directions as described above. You may do so.

  For example, in a state where the image as shown in FIG. 5B is displayed, the display control unit 104 is specified by the information indicating the direction of the display unit 101b, the reference position, and the positional relationship specifying unit 103. Is sent to the server. Then, as illustrated in FIG. 6A, the display control unit 104 acquires an image of the area AR5, which is a display area based on the angle γ specified by the positional relationship specifying unit 103, from the server, and displays the image. It is displayed on the display unit 101. The display control unit 104 causes the display unit 101 to display a panoramic image as shown in FIG. In this case, although distortion occurs at the folding lines L1 and L2 shown in FIG. 1, an image corrected by a known distortion correction is displayed. For example, the image acquired by the display control unit 104 is corrected.

  As described above, since the display control unit 104 displays an image based on the angle calculated by the positional relationship specifying unit 103, the displayed image changes according to the positional relationship between the user and the display unit 101. That is, the display control unit 104 changes the display area based on the positional relationship between the user and the display unit 101. Further, as shown in FIG. 6A, when the display unit 101 is bent in the valley direction, the display area 101 is wider than the area AR1 which is the display area before being bent. ing.

  Next, the operation of the display device 100 thus configured will be described with reference to FIG. FIG. 7 is a flowchart illustrating the operation of the display device 100 according to the present embodiment.

  The display control unit 104 transmits information indicating the reference position and the orientation to the server device, acquires an image corresponding to the reference position and the orientation from the server device, and causes the display unit 101 to display the image. (Step S1).

  Subsequently, the bending detection unit 102 detects the bending state of the display unit 101, and sends the detection result to the positional relationship specifying unit 103 and the display control unit 104 (Step S2).

  Subsequently, the positional relationship specifying unit 103 calculates an angle indicating the positional relationship between the display device 100 and the user based on the detection result obtained from the bending detecting unit 102 and the imaging results obtained by the plurality of cameras, and calculates the angle. Is sent to the display control unit 104 (step S3).

  The display control unit 104 transmits the reference position, the reference direction, and the angle to the server device. Then, an image based on the reference position, the direction information, and the angle is obtained from the server device (step S4), and the image is displayed on the display unit 101 (step S5).

  Next, the operation and effect of the display device 100 of the present embodiment will be described. In the display device 100 according to the present embodiment, the content of the area (for example, the area AR1) determined by the reference position and the reference direction is displayed, the bending state of the display unit 101 is detected by the bending detection unit 102, and the display control unit is displayed. By 104, the content whose area is changed based on the bending state is displayed. As described above, since the area is changed based on the bending state of the display unit 101 by the bending operation by the user, the area can be changed by a simple operation. Further, since the area is changed according to the bending operation, the display area can be changed by an intuitive operation.

  Also, in the display device 100, when the bending detection unit 102 detects that the display unit 101 is bent in the valley direction, the area is changed to be expanded. As described above, since the area is changed so as to be enlarged based on the bending state of the display unit 101, the area can be changed with a simple operation.

  Further, in the display device 100, the display control unit 104 specifies a plurality of display locations to be displayed on the display unit 101 based on the bending state detected by the bending detection unit 102, and further specifies the display locations in the respective directions of the identified display locations. The content of the area based on the content is displayed at each display location. In this manner, a plurality of display locations (the display units 101a to 101c) on the display unit 101 are specified based on the bending state of the display unit 101, and the display locations correspond to regions further based on the respective directions of the display locations. Since the content is displayed at each display location, multi-point content can be displayed by an intuitive operation.

  Further, the display device 100 displays a content corresponding to an area further based on the positional relationship specified by the positional relationship specifying unit 103. As described above, since the area is changed in consideration of the positional relationship with the user, it is possible to display the content based on the area (viewing angle) visible to the user.

  In the above-described embodiment, the case where the display area is changed based on the positional relationship between the user and the display unit 101 has been described. However, the bending of the display unit 101 is performed without specifying the positional relationship between the user and the display unit 101. The display area may be changed based on the state. For example, the directions of the display unit 101a and the display unit 101c may be specified based on the bending state of the display unit 101, and the images of the respective directions may be displayed on the display unit 101a and the display unit 101c. In this case, the display area may be a preset range, or the range may be made variable according to the bending state. For example, when the degree of bending in the valley direction is large, a larger range may be set.

  In the above-described embodiment, the case has been described where the distance between the user and the display unit 101 is calculated using an image captured by the in-camera. However, the distance between the user and the display unit 101 is calculated by another method. You may do so. For example, the distance between the user and the display unit 101 may be calculated using a proximity sensor (a sensor using infrared rays). Alternatively, the distance between the user and the display unit 101 may be calculated using only one in-camera. For example, the reference size of the user's portion (for example, the nose) may be held, and the distance may be estimated by comparing the size based on the imaging result with the reference size.

  Further, in the above-described embodiment, the case where the image is obtained from the external server has been described, but the display device 100 may store the image in advance.

  Further, in the above-described embodiment, a case has been described in which an image (still image) corresponding to a position on the map is displayed, but a moving image at each position may be displayed. In addition, when displaying an image or the like based on the reference position in a simulation game (for example, a vehicle driving game), the display area is changed according to the bending state of the display unit 101, not limited to the map. Is also good.

  In the above-described embodiment, the case where the display unit 101 is folded in a valley is described. However, in a flexible display that can be folded in a mountain, a display area may be changed according to a bending state by the mountain fold. .

  In the above-described embodiment, the foldable flexible display has been described. However, the present invention may be applied to a flexible display that can be bent (bent). For example, the bending detection unit 102 may detect that the flexible display has been bent into a curve, and the display control unit 104 may display an image in which the display area is enlarged based on the detection result.

11 CPU, 12 RAM, 13 ROM, 14 input device, 15 camera, 16 output device, 17 communication module, 18 auxiliary storage device, 19 bending sensor, 100 display device, 101 display Unit: 102: bending detection unit; 103: positional relationship specifying unit; 104: display control unit.

Claims (3)

Display means configured to be able to bend the display screen and displaying spatial content corresponding to a predetermined area;
Detecting means for detecting a bending state of the display means,
Based on the bending state detected by the detection means, the display means, a positional relationship specifying means for specifying a positional relationship with the user,
Display control means for displaying, on the display screen, spatial content in which the area has been changed based on the bending state detected by the detection means ,
The display control means displays a spatial content corresponding to an area based on the positional relationship specified by the positional relationship specifying means,
A display device comprising:   2. The display device according to claim 1, wherein when the detection unit detects that the display unit is bent in a valley direction, the display control unit displays the spatial content in which the area is expanded on the display screen. 3. .   2. The display device according to claim 1, wherein the display control unit displays on the display screen spatial content whose display angle has been changed based on the bending state detected by the detection unit. 3.

Images