JP2016224628A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device which, when an object is placed on a display surface, displays a display item the importance of which is high in a remaining region where a touch operation is possible so as to be easily manipulated.SOLUTION: Provided is a display device mounted in a vehicle, the display device comprising: a display unit for displaying an image; a sensor unit for detecting a touch operation on the display surface of the display unit and object placement on the display surface other than the touch operation separately from each other; a region recognition unit for recognizing a region on the display surface on which object placement is performed on the basis of the result of detection by the sensor unit; and a control unit for making a display item for manipulation displayed by the display unit, which is prepared for each manipulation screen of a car onboard apparatus. In the case of object placement, if the size of a remaining region that is defined for a region where there is no object placement on the display surface is less than a predefined threshold, the control unit makes a display item determined in accordance with the order of priority predefined for each manipulation screen displayed in the remaining region by the display unit.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display device that detects contact with a display surface.

  Vehicles equipped with a touch panel on large consoles and rear seat controllers are in widespread use. For example, an operation screen of an in-vehicle device is displayed on the touch panel. When the user performs a touch operation on a display item that is a GUI (Graphical User Interface) component in the operation screen, the operation of the in-vehicle device corresponding to the selected display item is controlled.

  In addition, a display device has been proposed that attempts to eliminate the disadvantage that the display is hidden under the object by placing the object on the display unit. Patent Document 1 describes a display device that detects that a portable terminal is placed on a touch panel and displays operation information on a screen portion (operable area) where the portable terminal is not placed. When the operable area is small, the display device displays only some information and restricts display of other information. Patent Document 2 describes a display device that, when an RF tag is held over a display unit, detects a display area that is not covered by the RF tag and displays the reading status of the RF tag in the display area. .

JP 2008-123476 A Japanese Patent No. 5338940

  However, when an object is placed on the touch panel and each display item is displayed in a dense state in the remaining area where the touch operation can be performed, it is difficult to distinguish a display item with high importance from other display items. The selection operation is difficult. In addition, since display items with high importance are different for each in-vehicle device, applying uniform display restriction conditions to the remaining area where touch operation is possible and narrowing the display target will not necessarily display the display items with high importance. It will not be done.

  In view of the above problems, the present invention provides a display device that displays a display item with high importance so that it can be easily operated in a remaining area where a touch operation can be performed when the display surface is touched. is there.

  1st invention is a display device carried in vehicles, Comprising: The display part which displays an image, The touch operation to the display surface of the said display part, The object mounting on the said display surface other than the said touch operation, A sensor unit that distinguishes and detects a region, a region recognition unit that recognizes a region on the display surface on which the object is placed based on a detection result by the sensor unit, and an in-vehicle that is an operation target on the display unit A control unit that displays a display item for operation prepared for each operation screen of the device, and the control unit is configured to place the object on the display surface when the object is placed. If the size of the remaining area determined as the non-area is less than a predetermined threshold, the display unit displays the display item determined according to the priority order predetermined for each operation screen in the remaining area.

  According to the first aspect, the region recognition unit recognizes a region on the display surface where an object is placed other than the touch operation from the detection result of the sensor unit. When the area recognition unit recognizes the area where the object is placed, if the size of the remaining area defined outside the area on the display surface is less than a predetermined threshold, the control unit displays the remaining area on the display unit. Display items determined according to a predetermined priority order for each operation screen of the in-vehicle device to be operated.

  Thereby, a display item with a high priority is displayed for each operation screen of the in-vehicle device in the remaining area on the display surface. Accordingly, there is no inconvenience that a display item having a high importance level is difficult to distinguish from other display items or is not displayed. The user can easily select an important operation item for each operation screen of the in-vehicle device in the remaining visible area even if the area that can be visually recognized is narrowed by touching the display surface.

  According to the present invention, when an object is placed on a display surface, it is possible to provide a display device that displays a display item with high importance so that it can be easily operated in the remaining area where a touch operation is possible. it can.

The block diagram which shows the structure of the display apparatus which concerns on embodiment of this invention. It is a figure explaining operation | movement of the display apparatus which concerns on embodiment of this invention, Comprising: (a) is a figure explaining the operation screen displayed in the state by which the object mounting is not made on the display surface, (b) is. The figure explaining the operation screen displayed in the state where the object is placed on the display surface The flowchart explaining operation | movement of the display apparatus which concerns on embodiment of this invention.

Hereinafter, embodiments will be described in detail with reference to FIGS.
[Overview]
The display device according to the present embodiment recognizes a region where an object is placed other than the touch operation on the display surface from the detection result of the sensor unit. If the size of the remaining area on which the object is not placed on the display surface is less than a predetermined threshold value, the remaining area is selected according to a predetermined priority order for each operation screen of the in-vehicle device. Display items. The user can select important operation items for each operation screen of the in-vehicle device in the remaining area.

[Configuration of display device]
FIG. 1 shows a configuration of a display device 1 according to the present embodiment. The display device 1 is mounted on a vehicle and includes a display unit 1a, a touch sensor (sensor unit) 1b, a region recognition unit 1c, a control unit 1d, and a storage unit 1e. The touch sensor 1b is formed integrally with the display unit 1a, and the display unit 1a and the touch sensor 1b constitute a touch panel P.

(Display section)
The display unit 1a includes, for example, a liquid crystal display device or an organic EL display device, and displays an image. The display part 1a is arrange | positioned, for example in the controller for a center console or a backseat so that the touch operation by a user's finger | toe may be received. The touch operation may be performed with a touch pen.

  For example, as illustrated in FIG. 2A, the display unit 1 a displays on the display surface H an operation screen 10 that can be switched for each in-vehicle device that is a user's operation target. In the operation screen 10 of FIG. 2A, a menu bar A1 and various operation buttons B1 of the in-vehicle device are displayed as operation display items (GUI parts) (for convenience of illustration, some operations are performed). Only the button is labeled B1). Such display items are prepared for each operation screen of the in-vehicle device.

  The user can switch the screen to the operation screen 10 for each in-vehicle device such as audio, air conditioner, and seat by performing a touch operation on the menu button A1x arranged on the menu bar A1. The menu button A1x related to the currently selected sheet is highlighted, for example. On the operation screen 10, various operation buttons B1 relating to the left and right sheets are displayed. When the user performs a touch operation on the operation button B1, the device operation assigned to the operation button B1 is executed.

(Touch sensor)
The touch sensor 1b distinguishes and detects a touch operation on the display surface of the display unit 1a and an object placement on the display surface other than the touch operation (hereinafter, object placement on the display surface other than the touch operation is detected). Simply referred to as object placement). The touch operation and the object placement detection method may be arbitrary.

  The touch sensor 1b distinguishes between the touch operation and the object placement by, for example, detecting a change in capacitance formed in the vicinity of the display surface of the display unit 1a. The object may be any object that is not grounded. A touch operation, which is a touch on the display surface with a finger or a touch pen, is changed in a direction of decreasing the capacitance. The contact of the object that is not grounded with the display surface changes in a direction that increases the capacitance.

  In the power-on state of the display device 1, the touch sensor 1b periodically acquires a detection signal from a detection target portion on the display surface. The touch sensor 1b individually processes a detection signal obtained from each detection target location, and whether the detection signal indicates that a touch operation has been performed, whether an object has been placed, or whether the touch operation is an object. A detection result is obtained as to whether it is indicated that no placement has been made. The touch sensor 1b inputs a signal indicating the detection position of the object placement to the area recognition unit 1c at each sampling timing. A signal indicating the detection location of the touch operation may be used for screen control by being input to the region recognition unit 1c, but description of screen switching processing by the touch operation is omitted here.

  Here, the sensor unit is composed of the touch-on sensor 1b, but the sensor unit is composed of a combination of a sensor that detects a touch operation and another sensor that detects an object placement on a display surface other than the touch operation. It may be.

(Region recognition unit)
The area recognition unit 1c recognizes an area where an object is placed on the display surface of the display unit 1a based on a signal input from the touch sensor 1b.

  When the signal indicating the detection position of the object placement is continuously input from the touch sensor 1b for the first predetermined time or more (that is, the first predetermined sampling number or more), the area recognition unit 1c displays the object on the display surface. Recognize the placed area. Then, the region recognition unit 1c inputs a signal indicating the recognition result of the region where the object is placed to the control unit 1d.

  For example, as illustrated in FIG. 2B, when an ungrounded object 2 different from a finger and a touch pen is placed on the display surface H, the touch sensor 1 b displays the display surface on which the object 2 is placed. It is detected that an object is placed at one or more detection target locations in a region F surrounded by a thick broken line on H. A signal indicating the detection position of the object placement in the region F is input from the touch sensor 1b to the region recognition unit 1c. Thereby, the area recognition unit 1c recognizes the area F as the area where the object is placed. The area recognition unit 1c inputs information on the range of the area F to the control unit 1d as a recognition result.

  In addition, the area recognition unit 1c stops the signal indicating the detection position of the object placement input from the touch sensor 1b, and the object is detected when the second predetermined time or more (that is, the second predetermined number of samplings) has elapsed. A signal indicating that there is no placement is input to the control unit 1d.

(Control part)
The control unit 1d determines the display items to be included in the operation screen displayed on the display unit 1a and the layout of the operation screen according to the content of the signal input from the region recognition unit 1c. And the control part 1d displays the operation screen containing the determined display item on the display part 1a with the determined layout.

  When the signal indicating the recognition result of the region where the object is placed is input from the region recognition unit 1c, the control unit 1d displays the operation screen display item that has been displayed until immediately before the object placement on the display surface. It is determined whether or not display is possible in an area where is not performed. In order to make the determination, the control unit 1d compares the size of the area for the operation screen set in the area where the object is not placed with a predetermined threshold value.

  For example, as illustrated in FIG. 2B, the control unit 1 d includes the region F so as to surround the display surface H with a one-dot chain line when a signal indicating the recognition result of the region F is input from the region recognition unit 1 c. The invalid area M including is determined. The invalid area M is an area where the detection function of the touch operation is invalidated (for example, electrostatic input by a finger and a touch pen is invalidated). In order to invalidate the detection function of the touch operation, for example, the detection operation in the invalid area M of the touch sensor 1b is turned off. The size and shape of the invalid area M may be set arbitrarily. The determination rule for the invalid region M is stored in the storage unit 1e, and the control unit 1d determines the invalid region M with reference to the determination rule. And the control part 1d sets as the remaining area | region N so that the outside of the invalid area | region M on the display surface H may be enclosed with a broken line.

  The control unit 1d compares the size of the remaining area N with a threshold value stored in advance in the storage unit 1e. If the size of the remaining area N is equal to or greater than the threshold value, the control unit 1d displays the same number of display items as that displayed on the operation screen 10 in FIG. On the other hand, if the size of the remaining area N is less than the threshold value, the control unit 1d displays a simplified operation screen 20 as shown in FIG.

  The operation screen 20 is preferentially displayed for each of the left and right sheets because the size of the remaining area N is insufficient to display the same display items as displayed on the operation screen 10. It consists only of the operation buttons you want to do. The control unit 1d determines the operation buttons to be preferentially displayed according to the display item display priority order on the operation screen for each in-vehicle device. The priorities are stored in advance in the storage unit 1e.

  As a result of arranging the display items on the operation screen 10 in accordance with such priorities, for example, the menu bar A2 and the operation buttons B2 (for convenience of illustration, only some of the operation buttons are labeled B2) are displayed. The menu bar A2 has a configuration in which the size of the menu bar A1 is reduced, and the operation button B2 includes a button type in which the numeric buttons are deleted from the operation button B1. The relative positional relationship between the display area of the menu bar A2 and the display area of the operation button B2 may be different from the relative positional relationship between the display area of the menu bar A1 and the display area of the operation button B1.

(Memory part)
As described above, the storage unit 1e includes the control unit in addition to the data used for the screen, the rule for determining the invalid area M, the threshold for determining the size of the remaining area N, and the display item display priority. A program executed by 1d is stored. The program includes, for example, a display item layout procedure.

[Operation of display device]
Next, the operation of the display device 1 having the above configuration will be described. FIG. 3 shows a flowchart of processing performed by the control unit 1d. The flow starts when the display device 1 is turned on and ends when the power is turned off.

  In step S101, the control unit 1d determines whether or not an object is placed on the display surface of the display unit 1a based on a signal input from the region recognition unit 1c. In step S101, when the object is placed, the process proceeds to step S102, and when the object is not placed, the process proceeds to step S107.

  In step S102, the control unit 1d, based on the signal indicating the recognition result of the region on which the object is placed input from the region recognition unit 1c, as indicated by the remaining region N in FIG. It is determined whether or not the size of the remaining area determined in the area where no object is placed on the display surface is equal to or greater than a threshold value. If the size of the remaining area is greater than or equal to the threshold value in step S102, the process proceeds to step S103, and if the size of the remaining area is less than the threshold value, the process proceeds to step S105.

  In step S103, the control unit 1d causes the display unit 1a to display an operation screen including all display items in the remaining area. At this time, the control unit 1d may set an area on the display surface where the detection of the touch operation is invalid, similarly to the invalid area M shown in FIG. For example, the control unit 1d displays an area in which detection of the touch operation is invalid so that it can be distinguished from the operation screen. After step S103, the process proceeds to step S104.

  In step S105 advanced from step S102, the control unit 1d follows the display item display priority stored in the storage unit 1e like the display item shown in the operation screen 20 of FIG. The display items to be displayed in the remaining area are determined. In subsequent step S106, the control unit 1d performs the layout of the determined display item on the remaining area and causes the display unit 1a to display the display item. At this time, the control unit 1d may set an area on the display surface where detection of the touch operation indicated as the invalid area M in FIG. For example, the control unit 1d displays an area in which detection of the touch operation is invalid so that it can be distinguished from the operation screen. After step S106, the process proceeds to step S104.

  In step S107 advanced from step S101, the control unit 1d causes the display unit 1a to display the operation screen in a default layout including all display items, as in the operation screen 10 illustrated in FIG. After step S107, the process proceeds to step S104.

  In step S104, the control unit 1d determines whether an event that causes the display device 1 to enter the power-off state, such as a power-off operation by the user, has occurred. If it is determined in step S104 that an event for shifting to the power-off state has occurred, the flow ends. If it is determined that an event for shifting to the power-off state has not occurred, the process returns to step S101.

[Effects of the embodiment, etc.]
As described above, the display device 1 of the present embodiment has the following operational effects. The area recognition unit 1c recognizes the area F on the display surface H where an object is placed other than the touch operation from the detection result of the sensor unit 1b. When the region recognition unit 1c recognizes the region F, the control unit 1d causes the display unit 1a to display the remaining region N if the size of the remaining region N determined outside the region F on the display surface H is less than a predetermined threshold. Display items determined according to a predetermined priority order for each operation screen of the in-vehicle device to be operated.

  Thereby, in the remaining area N on the display surface H, a display item with a high priority is displayed for each operation screen of the in-vehicle device. Accordingly, there is no inconvenience that a display item having a high importance level is difficult to distinguish from other display items or is not displayed. The user can easily select an important operation item for each operation screen of the in-vehicle device in the remaining area N that can be visually recognized even if the area that can be visually recognized is narrowed by contact with the display surface H.

  As described above, when the object is placed on the display surface H, the display device 1 can display the display items having high importance in the remaining area N where the touch operation is possible so as to be easily operated. it can.

  The present invention is applicable to a console device mounted on a vehicle, a controller of an in-vehicle device, and the like.

DESCRIPTION OF SYMBOLS 1 Display apparatus 1a Display part 1b Touch sensor 1c Area | region recognition part 1d Control part 1e Storage part 2 Object 10, 20 Operation screen A1, A2 Menu bar A1x, A2x Menu button B1, B2 Operation button F Area H Display surface M Invalid area N Remaining area P Touch panel

Claims (1)

A display device mounted on a vehicle,
A display for displaying an image;
A sensor unit that distinguishes and detects a touch operation on the display surface of the display unit and an object placement on the display surface other than the touch operation;
A region recognition unit that recognizes a region on the display surface on which the object is placed, from a detection result by the sensor unit;
A control unit that displays a display item for operation prepared for each operation screen of an in-vehicle device that is an operation target on the display unit;
When the object is placed, if the size of the remaining area determined in the area on the display surface where the object is not placed is less than a predetermined threshold, the control unit And displaying the display item determined according to a priority order predetermined for each of the operation screens in the remaining area.

Images