WO2023037476A1

WO2023037476A1 - Display device, method for controlling display device, and program

Info

Publication number: WO2023037476A1
Application number: PCT/JP2021/033203
Authority: WO
Inventors: 雅也田丸; 晃鈴木
Original assignee: 日本電信電話株式会社
Priority date: 2021-09-09
Filing date: 2021-09-09
Publication date: 2023-03-16

Abstract

This display device (1a, 1b) comprises: a display unit 40 (40a, 40b) including a transmissive display 20, and a touch sensor 30 (30a, 30b) having transmissivity, disposed on one side of the transmissive display 20, and disposed so as to detect contact from the side opposite the transmissive display 20; and a control unit 10 that, when the display unit 40 (40a, 40b) is disposed such that the touch sensor 30 (30a, 30b) comes into contact with an applied object 70, 80, detects a target range, which is a range occupied by the applied object 70, 80 in relation to the transmissive display 20, on the basis of the position of contact detected by the touch sensor 30 (30a, 30b), and sets a display region 22, which is a region where an image is displayed in the transmissive display 20, on the basis of the detected target range.

Description

DISPLAY DEVICE, CONTROL METHOD FOR DISPLAY DEVICE, AND PROGRAM

The present disclosure relates to a display device, a display device control method, and a program.

In recent years, transmissive displays with transparent backgrounds have been commercialized (Non-Patent Document 1). By replacing the glass surface of the window or binoculars with a transmissive display, or superimposing the transmissive display on the existing glass surface, the image displayed on the transmissive display is superimposed on the actual background. becomes possible.

FIG. 10 is a diagram schematically showing an example of superimposed display by a transmissive display. FIG. 10 shows an example in which a transmissive display 92 is attached to the window 91. As shown in FIG. In the example of FIG. 10, a real mountain 93 exists in the background of the window 91 . The transmissive display 92 displays an image 94 showing information about the mountain 93 (for example, the name of the mountain 93, etc.). When the transmissive display 92 is superimposed on such a window 91, it is possible to superimpose and display an image 94 showing information about the mountain 93 in association with the mountain 93 existing as a background.

Since existing objects such as windows or binoculars have various shapes, when a transmissive display is retrofitted to an object, the display area of the transmissive display is limited to the range occupied by the object. need to match. However, it is generally difficult to individually process and adjust the size of the object of the transmissive display according to the application object. In addition, when a transmissive display that is larger than the target range of the application target is arranged with respect to the application target, it is necessary to individually adjust the display area of the transmissive display according to the target range of the application target, which is complicated. work is required. As described above, in the conventional configuration, there is room for improvement in that the transmissive display can be easily retrofitted to the object to be used.

An object of the present disclosure is to provide a display device, a display device control method, and a program that can be easily retrofitted to an application object and used.

A display device according to one embodiment includes a transmissive display and transmissivity disposed on one side of the transmissive display and arranged to detect contact from the opposite side of the transmissive display. a touch sensor; and when the display unit is arranged such that the touch sensor contacts the application object, the application object is detected based on the contact position detected by the touch sensor. detects a target range that is a range occupied by the transmissive display, and sets a display area that is an area in which an image is displayed on the transmissive display based on the detected target range. .

A method of controlling a display device according to one embodiment includes: a transmissive display; and a control unit, wherein the control unit is arranged such that the display unit and the touch sensor are in contact with an application object. detecting, based on the contact position detected by the touch sensor, a target range, which is a range occupied by the application target with respect to the transmissive display, based on the detected target range, and setting a display area, which is an area for displaying an image on the transmissive display.

According to one embodiment of the present disclosure, it is possible to easily attach a transmissive display device to an application object and use it.

1 is a diagram illustrating a hardware configuration example of a display device according to an embodiment of the present disclosure; FIG. FIG. 2 is a diagram schematically showing the principle by which the display device of FIG. 1 detects a target range; 2 is a diagram showing an example of applying the display device of FIG. 1 to an application target; FIG. 3B is a diagram showing an example of a target range detected in the display device of FIG. 3A; FIG. It is a figure which shows an example of the relationship between the contact position which prescribes|regulates a target range, and a display area. It is a figure which shows an example of the relationship between the contact position which prescribes|regulates a target range, and a display area. It is a figure which shows an example of the relationship between the contact position which prescribes|regulates a target range, and a display area. It is a figure which shows an example of the relationship between the contact position which prescribes|regulates a target range, and a display area. It is a figure which shows an example of the relationship between the contact position which prescribes|regulates a target range, and a display area. 2 is a diagram showing an example of the software configuration of the display device of FIG. 1; FIG. 2 is a flowchart showing an example of area determination processing by the display device of FIG. 1; 4 is a flowchart showing an example of output control processing by the display device of FIG. 1; FIG. 10 is a diagram illustrating a hardware configuration example of a display device according to another embodiment of the present disclosure; FIG. FIG. 9 is a diagram schematically showing the principle of detection of the target range by the display device of FIG. 8; FIG. 4 is a diagram schematically showing an example of superimposed display by a transmissive display;

An embodiment of the present disclosure will be described below with reference to the drawings. In each drawing, parts having the same configuration or function are given the same reference numerals. In the description of the present embodiment, overlapping descriptions of the same parts may be appropriately omitted or simplified.

<First embodiment>
In a display device according to an embodiment of the present disclosure, a touch sensor is arranged on at least one side of a transmissive display screen, and an image is displayed as a display target based on the result of recognizing the shape of an application object in contact with the touch sensor. Set a region. Therefore, according to the display device according to the present embodiment, it is possible to recognize the superimposed displayable area and perform appropriate display without individually processing the size of the transmissive display or performing complicated adjustment work. It is possible.

FIG. 1 is a diagram showing a hardware configuration example of a display device 1a according to the first embodiment of the present disclosure. The display device 1a includes a control section 10 and a display section 40a. The display unit 40 a includes the transmissive display 20 and the touch sensor 30 . The display unit 40a has a structure in which the transmissive display 20 and the touch sensor 30 are overlapped.

The control unit 10 is a device that reads touch sensor information detected by the touch sensor 30, sets a display area on the transmissive display 20, and controls image display. The control unit 10 operates by being supplied with power from a power source (not shown). The control unit 10 includes a processor 11 , a storage unit 12 and an input I/F (interface) 13 .

The processor 11 includes one or more processors and controls the operation of the entire display device 1a. In one embodiment, a "processor" is a general-purpose processor or a dedicated processor specialized for a particular process, but is not limited to these. The processor is, for example, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), or a combination thereof. may

The storage unit 12 stores arbitrary information used for the operation of the display device 1a. For example, the storage unit 12 may store a system program, touch sensor information read by the touch sensor 30 , and information such as an image input from the input I/F 13 . The storage unit 12 includes one or more memories, and may include, for example, semiconductor memory, magnetic memory, optical memory, and the like. Each memory included in the storage unit 12 may function as, for example, a main memory device, an auxiliary memory device, or a cache memory. The storage unit 12 does not necessarily have to be provided inside the display device 1a, and may be provided outside the display device 1a.

The input I/F 13 is an interface for inputting information of an image to be displayed from the outside. The input I / F 13 may adopt any method as long as it is an interface that can input information such as images. For example, monitor interfaces such as HDMI (registered trademark) and Display Port, USB (Universal Serial Bus ) may be used as a general-purpose interface.

The processor 11, for example, reads a program from the storage unit 12 and executes it. The processor 11 performs control of each of the above components and various arithmetic processing according to programs stored in the storage unit 12 .

The program may be stored in a computer-readable storage medium. By using such a storage medium, it is possible to install the program in the computer. Here, the storage medium storing the program may be a non-transitory storage medium. A non-temporary storage medium is not particularly limited, but may be, for example, a CD-ROM, a DVD-ROM, or a USB memory. This program may be downloaded from an external device via a network.

The control unit 10 is communicably connected to each of the transmissive display 20 and the touch sensor 30 by a wired cable, but may be connected to at least one of the transmissive display 20 and the touch sensor 30 by wireless communication means. Further, the control unit 10 can be provided as a circuit configuration provided separately from the transmissive display 20 and the touch sensor 30, but for example, the circuit may be miniaturized and mounted on the frame portion of the display unit 40a. good. By miniaturizing the control unit 10 in this way, the display device 1a can be applied to various application objects.

The transmissive display 20 is a display device that displays images with a structure capable of transmitting at least part of external light. While the transmissive display 20 displays an image on the display surface, the transparent display surface allows the observer to observe the background. The transmissive display 20 may be, for example, a transmissive organic EL (Electro-Luminescence) display, a transmissive inorganic EL display, a transmissive LC (Liquid Crystal) display, or a different transmissive display.

The touch sensor 30 is a device that detects (senses) whether or not an object touches the touch surface provided on the display surface of the transmissive display 20, and outputs touch sensor information indicating the detection result to the control unit 10. . In this embodiment, the touch sensor 30 is arranged on one side of the transmissive display 20 that contacts the application target. The touch sensor 30 detects contact with an object by detecting contact from the side opposite to the transmissive display 20 . The touch sensor information may include information indicating the position of the contact point of the object, but may also include other information such as contact strength. The position of the contact point of the object may be identified by coordinates set on the touch sensor 30, for example. The method of detecting contact of an object by the touch sensor 30 may be any method as long as it can detect contact with the touch surface of the touch sensor 30. For example, a resistive film method, a capacitance method, an optical method, and an ultrasonic method can be used. , or an electromagnetic induction method or the like may be used. Like the transmissive display 20, the touch sensor 30 has transparency that allows at least part of external light to pass therethrough. Therefore, the display section 40a having a structure in which the transmissive display 20 and the touch sensor 30 are overlapped has transparency.

FIG. 2 is a diagram schematically showing the principle by which the display device 1a of FIG. 1 detects the target range. FIG. 2 shows how the display unit 40a is attached to an application object 70 such as an existing window, binoculars, or VR (Virtual Reality) goggles. As shown in FIG. 2 , the display unit 40 a is arranged with respect to the application object 70 so that the touch sensor 30 faces the application object 70 . In the example of FIG. 2, the application object 70 comprises a base 72, such as transparent glass, and an edge 71 forming its edge. In the example of FIG. 2 , the edge portion 71 protrudes with respect to the display portion 40 a , so that the edge portion 71 comes into contact with the touch sensor 30 when the display portion 40 a is attached to the application target 70 . Touch sensor 30 detects contact position 31 where edge 71 is in contact with touch sensor 30, and outputs touch sensor information including information indicating contact position 31 to control unit 10 via a wired cable. The processor 11 of the control unit 10 detects the target range, which is the range occupied by the application target 70, based on the information indicating the contact position 31 included in the touch sensor information. Specifically, the processor 11 detects the range surrounded by the contact positions 31 as the target range of the application target 70 . Next, the processor 11 sets a display area 22, which is an area for displaying an image on the transmissive display 20, based on the detected target range. Thus, the display device 1a detects the target range of the application target 70 based on the information of the contact position 31 detected when the touch sensor 30 contacts the application target 70, and based on the target range, the transmissive display 20 automatically sets the display area 22 . Therefore, the user can easily retrofit the display device 1a to the application object 70 and use it without performing complicated work in advance.

In this embodiment, an example will be described in which the display device 1a detects the contact of the edge 71 protruding from the application object 70 and detects the range surrounded by the contact positions 31 as the target range of the application object 70. However, the method for detecting the target range of the application target 70 is not limited to this. For example, if the application object 70 does not have a protruding edge 71 on the contact surface for the touch sensor 30 , the base 72 will directly contact the touch sensor 30 . Therefore, the display device 1 a may detect the range in which the touch sensor 30 detects contact as the target range of the application target 70 .

In addition, in the example of FIG. 2, the base 72 and the display part 40a of the application object 70 have a planar shape, but the base 72 and the display part 40a of the application object 70 may have a curved surface shape. Thus, for example, the display device 1a can be attached to an application object 70 having a curved surface such as a windshield of an automobile. In addition, by configuring the transmissive display 20 and the touch sensor 30, which constitute the display unit 40a, from bendable members, the display device 1a can be used by attaching the display device 1a to the application target 70 having various surface shapes. can do.

3A is a diagram showing an example of applying the display device 1a of FIG. 1 to the application object 70. FIG. FIG. 3A shows an example in which a display unit 40a is attached to the eyepiece side or the objective side of binoculars, which is the application target 70. FIG.

FIG. 3B is a diagram showing an example of the target range detected by the display device 1a of FIG. 3A. In the example of Figures 3A and 3B, the application object 70 has two edges, each edge protruding and having a circular shape. When the display unit 40 a is attached to the binoculars that are the application object 70 , the two circular edges come into contact with the touch sensor 30 . Therefore, the touch sensor 30 detects two

circular contact positions

31a and 31b. The processor 11 of the control unit 10 detects ranges surrounded by the

respective contact positions

31a and 31b as target ranges 35a and 35b of the application target 70 . The processor 11 sets the display area 22 at the position of the transmissive display 20 corresponding to each

target range

35a, 35b. Thus, when a plurality of target ranges defined by the edge of the application target 70 is detected, the display device 1a sets the display area 22 for each of the plurality of target ranges.

4A to 4E are diagrams showing an example of the relationship between the contact position 31 that defines the target range and the display area 22. FIG. As described above, the display device 1a automatically sets the display area 22 on the transmissive display 20 based on the target range. For example, the display device 1 a may set, as the display area 22 , a rectangle having the largest area among the rectangles inscribed in the target range defined by the contact position 31 in the transmissive display 20 . For example, as shown in FIG. 4A, when the target range defined by the contact position 31 has a rectangular shape, the display device 1a may set a rectangle overlapping with the rectangle as the display area 22 on the transmissive display 20. . For example, when the target range defined by the contact position 31 has a circular shape as shown in FIG. can be set to For example, as shown in FIG. 4C, when the target range defined by the contact position 31 has a triangular shape, the display device 1a sets the display area 22 to be a rectangle having the maximum area inscribed in the triangle. can be set to In this way, by setting the rectangle having the largest area among the rectangles inscribed in the target range of the application object 70 as the display area 22, the display device 1a can display the rectangular display area 22 having the largest display area in the target range. image can be displayed. When there are a plurality of rectangles having the maximum area inscribed in the target range, the display device 1a sets the aspect ratio of the rectangles to a predetermined value (for example, 1:1, 3:4, or 9:1). 12, etc.) may be set in the transmissive display 20 as the display area 22. FIG.

Further, the display device 1a may set, for example, a rectangle circumscribing the entire area of the target range defined by the contact position 31 as the display area 22 on the transmissive display 20. FIG. For example, as shown in FIG. 4D, when the target range defined by the contact position 31 has a circular shape, the display device 1a may set a rectangle circumscribing the circle as the display area 22 on the transmissive display 20. good. For example, as shown in FIG. 4E, when the target range defined by the contact position 31 has a triangular shape, the display device 1a may set a rectangle circumscribing the triangle as the display area 22 on the transmissive display 20. good. By using a rectangle circumscribing the entire area of the target range as the display area 22, the display device 1a can display an image over the entire area of the target range.

In the present embodiment, as shown in FIGS. 4A to 4C, a setting method of setting a rectangle having the largest area among the rectangles inscribed in the target range as the display area 22 is called "automatic setting". A method of setting the display area 22 by a method other than the above is called “manual setting”. A setting method in which a rectangle circumscribing the entire area of the target range is set as the display area 22 as shown in FIGS. 4D and 4E is an example of "manual setting." The contents of "manual setting" are set according to a user's instruction, and are not limited to the methods described with reference to FIGS. 4D and 4E.

As an example, the display device 1a sets a rectangular display area 22 on the transmissive display 20, but the shape of the display area 22 is not limited to a rectangle. For example, the display device 1 a may set the display area 22 having the same shape as the target range of the application object 70 on the transmissive display 20 . For example, when the target range defined by the contact position 31 has a circular shape, the display device 1a may set a region having the same shape as the circular shape as the display region 22 on the transmissive display 20 . Further, for example, when the target range defined by the contact position 31 has a triangular shape, the display device 1a may set an area having the same shape as the triangular shape as the display area 22 on the transmissive display 20 . Thus, the method of setting the display area 22 having the same shape as the target range of the application object 70 is an example of "manual setting."

FIG. 5 is a diagram showing a software configuration example of the display device 1a of FIG. The program is read and executed by the processor 11 so that the control section 10 operates as the area determination section 41 and the output control section 42 .

In FIG. 5, at least one piece of information indicating an image to be displayed is input to the information input unit 2. The information input unit 2 is a device that mixes at least one piece of input information. In the example of FIG. 5, information A and information B are input to the information input section 2 . The information input section 2 outputs the mixed information to the output control section 42 of the control section 10 .

The area determination unit 41 of the control unit 10 performs area determination processing, which will be described later. That is, the area determination unit 41 acquires touch sensor information from the touch sensor 30 and detects the target range of the application target object 70 based on the touch sensor information. The area determination unit 41 determines the display area 22 to be set in the transmissive display 20 according to the target range of the application object 70 .

The output control unit 42 performs output control processing, which will be described later. In other words, the output control section 42 performs control for outputting image information input from the information input section 2 to the transmissive display 20 . The output control unit 42 resizes and outputs the image indicated by the input information for each of the display areas 22 determined by the area determination unit 41 .

FIG. 6 is a flowchart showing an example of area determination processing by the display device 1a of FIG. FIG. 7 is a flow chart showing an example of output control processing by the display device 1a of FIG. The operation of the display device 1a described with reference to FIGS. 6 and 7 corresponds to an example of the control method of the display device 1a according to this embodiment. 6 and 7 are executed under the control of the processor 11 of the control unit 10. FIG. A program for causing a computer to execute the control method of the display device 1a according to this embodiment can include at least part of each step shown in FIGS.

At step S1 in FIG. 6, the processor 11 reads and acquires the touch sensor information including information indicating the position of the contact point of the object from the touch sensor 30 .

In step S2, the processor 11 refers to the touch sensor information and determines whether the touch sensor 30 has been touched. If there is contact (YES in step S2), the processor 11 proceeds to step S3; otherwise (NO in step S2), it returns to step S1 to continue processing.

In step S3, the processor 11 refers to the touch sensor information and detects the coordinates of the contact point. The processor 11 causes the storage unit 12 to hold the coordinates of the detected contact point for a certain period of time.

In step S4, the processor 11 determines whether or not there is a change from the previous contact state based on the coordinates of the contact point detected in step S3 and the coordinates of the previous contact point held in the storage unit 12. . If there is a change from the previous contact state (YES in step S4), the processor 11 proceeds to step S5; otherwise (NO in step S4), it returns to step S1 to continue processing.

In step S5, the processor 11 sets the value of the parameter n to 0. The parameter n is a serial number that identifies the target range of the application target 70 and the display area 22 set on the transmissive display 20 . In this embodiment, the target range and display area 22 are identified by n=1, 2, .

In step S6, based on the coordinates of the contact point detected in step S3, the processor 11 determines that the area surrounded by the edge of the touch sensor 30, which has not been set as the target range in step S8, is detected. Determine if it exists. For example, when the application object 70 has a protruding edge 71, the processor 11 may determine whether or not there is an area surrounded by the edge using the coordinates of the contact point as the edge. For example, when the application object 70 does not have a protruding edge 71, the processor 11 defines a region surrounded by the border between the point where the contact was detected and the point where the contact was desired to be detected. You may determine the presence or absence of The area enclosed by such edges corresponds to the target range of the application target 70 . The processor 11 proceeds to step S7 if there is an area surrounded by edges (YES in step S6), and otherwise proceeds to step S9 (NO in step S6).

At step S7, the processor 11 increments the value of the parameter n by one.

In step S8 , the processor 11 sets the area surrounded by the edge determined in step S6 as the target range n of the application target 70 . After finishing the process of step S8, the processor 11 returns to step S6.

In step S9, the processor 11 determines whether the value of the parameter n is 0. If the value of parameter n is 0 (YES in step S9), processor 11 returns to step S1, otherwise (NO in step S10), proceeds to step S10.

In step S10 , the processor 11 reads information indicating the setting method of the display area 22 . The information indicating the setting method of the display area 22 indicates whether it is the aforementioned "automatic setting" or "manual setting", and indicates the contents in the case of "manual setting". Information indicating the setting method of the display area 22 is stored in the storage unit 12 in advance.

In step S11, the processor 11 determines whether or not the setting method of the display area 22 is "automatic setting". The processor 11 proceeds to step S12 if it is "automatic setting" (YES in step S11), and otherwise proceeds to step S11 (NO in step S11).

In step S12, the processor 11 sets, as the display area 22, a rectangular area having the largest area within the target range for each of the areas set as the target range in step S8. Processor 11 may identify, with the same parameter n, display areas 22 corresponding to the target range identified by parameter n. After completing the process of step S12, the processor 11 ends the area determination process.

In step S13, the processor 11 sets the display area 22 for each of the areas set as the target range in step S8 according to the set value that defines the contents of the "manual setting". The setting value can indicate a setting method for setting a rectangle circumscribing the entire area of the target range as the display area 22, for example, as shown in FIGS. 4D and 4E. Processor 11 may identify, with the same parameter n, display areas 22 corresponding to the target range identified by parameter n. After completing the process of step S13, the processor 11 ends the area determination process.

After finishing the area determination process, the processor 11 starts the output control process of FIG. In step S21 , processor 11 inputs information indicating an image to be displayed from information input unit 2 via input I/F 13 .

In step S22, the processor 11 reads the output setting information from the storage unit 12. The output setting information is setting information for displaying and outputting an image in each display area 22 set in the area determination process, and is stored in the storage unit 12 in advance. The output setting information may include, for example, information indicating a resizing method when an image is output to each display area 22, information indicating whether to display the same image in a plurality of display areas 22, and the like.

In step S23, the processor 11 determines whether or not there is an area set as the display area 22 by the area determination process. If there is an area set as the display area 22 (YES in step S23), the processor 11 proceeds to step S24, otherwise (NO in step S23) ends the output control process.

In step S24, the processor 11 determines whether or not there are multiple areas set as the display area 22 by the area determination process. If there are multiple areas set as the display area 22 (YES in step S24), the processor 11 proceeds to step S27; otherwise (NO in step S24), the process proceeds to step S25.

In step S25 , the processor 11 resizes the image indicated by the information input from the information input unit 2 to match the display area 22 set on the transmissive display 20 .

In step S26, the processor 11 outputs the image resized in step S25 to the transmissive display 20, and displays the resized image in the display area 22. After completing the process of step S26, the processor 11 ends the output control process.

At step S27, the processor 11 sets the value 1 to the parameter n.

In step S28, the processor 11 determines whether the images displayed in each display area 22 have the same content. For example, if the information input from the information input unit 2 indicates one image, or if the output setting information indicates that the same image content is to be displayed, the processor 11 selects the image to be displayed in each display area 22. may be determined to be images with the same content. If the images displayed in each display area 22 have the same content (YES in step S28), processor 11 proceeds to step S29, otherwise (NO in step S28), proceeds to step S33.

In step S29 , the processor 11 resizes the image indicated by the information input from the information input unit 2 to match the display area n set on the transmissive display 20 .

In step S30, the processor 11 outputs the image resized in step S29 to the transmissive display 20, and displays the resized image in the display area n.

In step S31, the processor 11 determines whether or not there is still a display area 22 that has not output an image. If the display area 22 still exists (YES in step S31), the processor 11 proceeds to step S32, otherwise (NO in step S31) ends the output control process.

At step S32, the processor 11 increments the value of the parameter n by one. After finishing the process of step S32, the processor 11 returns to step S29 and continues the process.

In step S33, the processor 11 resizes the image to be displayed in the display area n to match the display area n.

In step S34, the processor 11 outputs the image resized in step S33 to the transmissive display 20, and displays the resized image in the display area n.

In step S35, the processor 11 determines whether or not there is still a display area 22 that has not output an image. If the display area 22 still exists (YES in step S35), the processor 11 proceeds to step S36, otherwise (NO in step S35) ends the output control process.

At step S36, the processor 11 increments the value of the parameter n by one. After finishing the process of step S36, the processor 11 returns to step S33 and continues the process.

<Second embodiment>
The display unit 40 a of the display device 1 a according to the first embodiment includes one touch sensor 30 arranged on one side of the transmissive display 20 . On the other hand, in the display unit 40b of the display device 1b according to the second embodiment, in addition to the touch sensor 30a arranged on one surface side of the transmissive display 20, the touch sensor 30a arranged on the opposite side to the touch sensor 30a. 30b. Then, when the target range of the application target detected by the touch sensor 30a and the target range of the application target detected by the touch sensor 30b match, the display device 1b displays the transmissive display 20 based on the target range. , the display area 22 is set to . Therefore, according to the display device 1b according to the present embodiment, when the display unit 40b of the display device 1b is sandwiched between two application objects, it is possible to set the display area 22 by stable operation. is. Hereinafter, constituent elements that perform the same functions or operations as in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.

FIG. 8 is a diagram showing a hardware configuration example of the display device 1b according to the second embodiment of the present disclosure. In FIG. 8, the display device 1b includes a control section 10 and a display section 40b. The display unit 40b includes a transmissive display 20, a first touch sensor 30a, and a second touch sensor 30b. The display unit 40b has a structure in which the first touch sensor 30a, the transmissive display 20, and the second touch sensor 30b are stacked. The control unit 10 is communicably connected to each of the transmissive display 20, the first touch sensor 30a, and the second touch sensor 30b by a wired cable. The configurations of the control unit 10 and the transmissive display 20 are the same as those of the first embodiment. Both the first and

second touch sensors

30a and 30b have the same configuration as the touch sensor 30 of the first embodiment.

FIG. 9 is a diagram schematically showing the principle by which the display device 1b of FIG. 8 detects the target range. FIG. 9 illustrates, for example, the first, second application objects 70 and 80, which are parts of the binoculars separated in two along the optical path of the binoculars, and combined to assemble one binocular. An example of arranging the display unit 40b of the display device 1b between the second application objects 70 and 80 is shown.

As shown in FIG. 9 , the display unit 40b is arranged with respect to the first application object 70 so that the first touch sensor 30a faces the first application object 70 . Similar to FIG. 2, the first application object 70 comprises a base 72, such as transparent glass, and an edge 71 forming its edge. In the example of FIG. 9, the edge portion 71 protrudes with respect to the display portion 40b, so when the display portion 40b is attached to the first application object 70, the edge portion 71 contacts the touch sensor 30a. Accordingly, the control unit 10 detects the first target range, which is the range occupied by the first application target 70 with respect to the transmissive display 20, based on the contact position 31a detected by the first touch sensor 30a. .

Further, the display unit 40b is arranged with respect to the second application object 80 such that the second touch sensor 30b faces the second application object 80. In the example of FIG. 9, the second application object 80 comprises only members forming the edges of the viewing area. Therefore, when the display unit 40b is attached to the second application object 80, the second application object 80 contacts the touch sensor 30b. Accordingly, the control unit 10 detects the second target range, which is the range occupied by the second application target 80 with respect to the transmissive display 20, based on the contact position 31b detected by the second touch sensor 30b. .

The control unit 10 determines whether or not the first target range determined based on the contact position 31a and the second target range determined based on the contact position 31b match. If they match, the control unit 10 sets the display area 22 in the transmissive display 20 based on the target range, and controls the transmissive display 20 to display the image in the display area 22 . In this way, the display device 1b includes the

touch sensors

30a and 30b on both sides of the transmissive display 20, respectively. , a display area 22 corresponding to the target range is set. Therefore, according to the display device 1b according to the present embodiment, when the application objects 70 and 80 are accurately aligned, the display area 22 is set according to that, so malfunctions do not occur when a foreign object comes into contact with the object. It is possible to stabilize the operation without

As described above, the display device 1 (1a, 1b) according to the present disclosure includes the display unit 40 (40a, 40b) and the control unit 10. The display unit 40 (40a, 40b) includes a transmissive display 20 and a transmissive display arranged on one side of the transmissive display 20 so as to detect contact from the opposite side of the transmissive display 20. and a touch sensor 30 (30a, 30b) having When the display unit 40 (40a, 40b) is arranged such that the touch sensors 30 (30a, 30b) are in contact with the application objects 70, 80, the control unit 10 causes the touch sensors 30 (30a, 30b) to Based on the detected contact position, the target range, which is the range occupied by the application objects 70 and 80 with respect to the transmissive display 20, is detected. The control unit 10 sets a display area 22, which is an area for displaying an image on the transmissive display 20, based on the detected target range. In this way, the display device 1 (1a, 1b) detects the target range of the

applicable objects

70, 80 based on the contact position detected by the touch sensor 30 (30a, 30b), and based on the target range, the transmissive type A display area 22 is set on the display 20 . Therefore, the display device 1 (1a, 1b) can automatically set the display area 22 according to the target range of the application objects 70, 80, and the application object 70 can be displayed without complicated work. , 80, the display area 22 can be adjusted appropriately.

Further, the display device 1 (1a, 1b) may set, as the display area 22, the rectangle having the largest area among the rectangles inscribed in the detected target range. Therefore, according to the display device 1 (1a, 1b), it is possible to display the entire image to be displayed in the largest size in each target range regardless of the shape of the target range. Moreover, since the display device 1 (1a, 1b) automatically sets the display area 22 for each of the detected target ranges, it is possible to automatically set a plurality of display areas 22. FIG.

Further, the display device 1 (1a, 1b) may set a rectangle circumscribing the entire area of the detected target range as the display area 22 for each of the detected target ranges. Therefore, according to the display device 1 (1a, 1b), in each target range, regardless of the shape of the target range, it is possible to display the image to be displayed over the entire target range. Moreover, since the display device 1 (1a, 1b) automatically sets the display area 22 for each of the detected target ranges, it is possible to automatically set a plurality of display areas 22. FIG.

In addition, the display devices 1 (1a, 1b) display, in each of the display areas 22 set in the transmissive display 20, an image to be displayed resized according to the display area 22. good too. Therefore, according to the display device 1 (1a, 1b), it is possible to display an image that matches the size of each display area 22 regardless of the size of the image to be displayed.

Further, the display device 1 (1a, 1b) determines the edge of the

application object

70, 80 based on the position of contact detected by the touch sensor 30 (30a, 30b), and determines the area surrounded by the edge. It may be detected as a range. Therefore, according to the display device 1 (1a, 1b), the edges of the application objects 70, 80 in contact with the touch sensor 30 (30a, 30b) can be determined to appropriately detect the target range.

In addition to the first touch sensor 30a, the display unit 40b detects contact from the side opposite to the transmissive display 20, which is arranged on the other side opposite to the one side of the transmissive display 20. A transmissive second touch sensor 30b may be further provided. In the display device 1b, when the display unit 40b is arranged so that the first touch sensor 30a contacts the first application object 70, based on the contact position detected by the first touch sensor 30a, A first target area may be detected, which is the area that the first application object 70 occupies relative to the transmissive display 20 . In the display device 1b, when the display unit 40b is arranged so that the second touch sensor 30b contacts the second application object 80, based on the contact position detected by the second touch sensor 30b, A second target area may be detected, which is the area that the second application object 80 occupies relative to the transmissive display 20 . When the first target range and the second target range match, the display device 1b may set the display area 22 in the transmissive display 20 based on the target range. In this way, the display device 1b sets the display area 22 accordingly when the application objects 70 and 80 are accurately aligned, so that the display device 1b can stably operate without malfunctioning when a foreign object comes into contact with it. It is possible to make

The display device 1 (1a, 1b) may turn on the transmissive display 20 when the touch sensor 30 (30a, 30b) detects contact. Further, as in the second embodiment, when the display device 1b includes two

touch sensors

30a and 30b, the transmissive display 20 is powered on when both of the two

touch sensors

30a and 30b detect contact. It may be turned ON. By doing so, it is possible to avoid turning on the transmissive display 20 unnecessarily, thereby reducing power consumption.

The present disclosure is not limited to the above-described embodiments. For example, multiple blocks shown in the block diagrams may be combined, or a single block may be divided. Instead of being performed in chronological order according to the description, multiple steps described in the flowcharts may be performed in parallel or in different orders, depending on the processing power of the device performing each step or as required. . Other modifications are possible without departing from the scope of the present disclosure.

1, 1a, 1b display device 2 information input unit 10 control unit 11 processor 12 storage unit 13 input I/F
20 transmissive displays 22, 22a,

22b display areas

30, 30a,

30b touch sensors

31, 31a,

31b contact positions

35a, 35b target ranges 40, 40a, 40b display unit 41 area determination unit 42

output control units

70, 80 application target Object 71 Edge 72 Base

Claims

A display unit comprising a transmissive display and a transmissive touch sensor arranged on one side of the transmissive display and arranged to detect contact from a side opposite to the transmissive display. and,
When the display unit is arranged such that the touch sensor is in contact with the applicable object, based on the position of contact detected by the touch sensor, within the range occupied by the applicable object with respect to the transmissive display a control unit that detects a certain target range and sets a display area, which is an area in which an image is displayed in the transmissive display, based on the detected target range;
A display device.
The display device according to claim 1, wherein, for each of the detected target ranges, the control unit sets, as the display region, a rectangle having the largest area among rectangles inscribed in the target range.
The display device according to claim 1, wherein, for each of the detected target ranges, the control unit sets a rectangle circumscribing the entire area of the target range as the display area.
4. The control unit according to any one of claims 1 to 3, wherein, for each of the display areas set in the transmissive display, the image to be displayed resized to match the display area is displayed in the display area. 1. The display device according to item 1.
5. The control unit according to any one of claims 1 to 4, wherein the edge of the object to be applied is determined based on the contact position detected by the touch sensor, and an area surrounded by the edge is detected as the target range. 1. The display device according to item 1.
The display unit, in addition to the first touch sensor that is the touch sensor, is arranged on the other side of the transmissive display opposite to the one side of the transmissive display. further comprising a transmissive second touch sensor positioned to detect contact;
The control unit
When the display unit is arranged such that the first touch sensor contacts the first application object, the first application is performed based on the position of contact detected by the first touch sensor. detecting a first target area, the area occupied by an object relative to the transmissive display;
When the display unit is arranged such that the second touch sensor contacts the second application object, the second application is performed based on the contact position detected by the second touch sensor. detecting a second target area, the area occupied by an object relative to the transmissive display;
When the first target range and the second target range match, setting the display area in the transmissive display based on the target range;
The display device according to any one of claims 1 to 5.
A display unit comprising a transmissive display and a transmissive touch sensor arranged on one side of the transmissive display and arranged to detect contact from a side opposite to the transmissive display. , and a control method for a display device comprising a control unit,
The control unit
When the display unit is arranged such that the touch sensor is in contact with the applicable object, based on the position of contact detected by the touch sensor, within the range occupied by the applicable object with respect to the transmissive display detecting a range of interest;
setting a display area, which is an area for displaying an image on the transmissive display, based on the detected target range;
A method of controlling a display device, comprising:
A program that causes a processor to operate as a controller included in the display device according to any one of claims 1 to 6.