WO2021059479A1

WO2021059479A1 - Display control device for displaying operation subject within operable range

Info

Publication number: WO2021059479A1
Application number: PCT/JP2019/038146
Authority: WO
Inventors: 匠武井; 政信大澤
Original assignee: 三菱電機株式会社
Priority date: 2019-09-27
Filing date: 2019-09-27
Publication date: 2021-04-01

Abstract

A display control device comprising: an acquisition unit (11) that acquires remote operation information indicating that a function executable by a touch-operable display device (2) has been designated by a remote operation; an operation subject identification unit (12, 12a) that, on the basis of the remote operation information, identifies an operation subject to be touch-operated by an operator of the display device (2) and identifies the initial display position of the operation subject; an operation state identification unit (13) that identifies the operation state of the operator who performed the remote operation; a determination unit (14, 14a) that, on the basis of the operation state of the operator, determines whether the initial display position of the operation subject on the display screen of the display device (2) is within an operable range of touch-operability by the operator; and a display control unit (15, 15a) that, if the determination unit (14, 14a) determines that the initial display position of the operation subject is not within the operable range, controls display of the operation subject by the display device (2) such that the operation subject is displayed within the operable range.

Description

[Name of invention determined by ISA based on Rule 37.2.] Display control device that displays the object to be operated within the operable range

The present invention relates to a display control device and a display control method for controlling the display of a display object on a touch-operable display device.

In recent years, a display device that can be touch-operated and has a large screen is known. In a display device having a large screen, the display object displayed on the display device may be displayed at a position far from the operator so that the operator of the display device cannot perform a touch operation. Therefore, the operator may not be able to touch the desired display object from the current position.
For example, a display device having a large screen as described above may be provided in a vehicle. In that case, the driver, who is the operator, may not be able to touch the desired display object from the current position.
On the other hand, for example, Patent Document 1 provides a touch panel on the upper layer of the display unit, and when it detects that the operator's finger or the like touches the touch panel, the position of the input icon arranged on the display unit is determined. A display device is disclosed in which the position of the input icon is moved closer to the finger in the order closer to the contact coordinates of the finger or the like on the display unit. In the display device disclosed in Patent Document 1, the number of input icons arranged around the contact coordinates is limited.

Japanese Unexamined Patent Publication No. 2011-210083

In the prior art as disclosed in Patent Document 1, as described above, since the number of input icons arranged around the contact coordinates is limited, the display object that the operator desires to touch is the operator. May not be moved near your finger.
Therefore, there is still a problem that the operator may not be able to touch the desired display object from the current position.

The present invention has been made to solve the above-mentioned problems, and in a touch-operable display device, a position where the operator can touch-operate a display object that the operator of the display device desires to touch. It is an object of the present invention to provide a display control device which can be displayed on the screen.

The display control device according to the present invention has an acquisition unit that acquires remote control information indicating that a function that can be executed via a touch-operable display device is specified by remote control, and an acquisition unit that acquires the function. Based on the remote control information, the operator of the display device identifies the operation target to be touch-operated, and the operation target identification unit that specifies the initial display position of the operation target, and the operator who performed the remote control. The operator can touch-operate the initial display position of the operation target specified by the operation target identification unit based on the operation state specification unit that specifies the operation state and the operation state of the operator specified by the operation state specification unit. When the judgment unit that determines whether or not the operation target is within the operable range on the display screen of the display device and the judgment unit determine that the initial display position of the operation target is not within the operable range, the operation target It is provided with a display control unit that controls the display of the operation target object on the display device so that the object is displayed within the operable range.

According to the present invention, in a touch-operable display device, a display object that the operator of the display unit desires to touch can be displayed at a position where the operator can touch-operate.

It is a figure which shows the configuration example of the display control device which concerns on Embodiment 1. FIG. It is a figure for demonstrating the image of the display device in the state which the display device is installed in the vehicle in the vehicle equipped with the display control device which concerns on Embodiment 1. FIG. FIG. 3A is a diagram for explaining an example of an image of the operable range based on the operating state of the operator in the first embodiment, and FIG. 3A shows the operable state when the operating state is the position of the “left seat”. FIG. 3B is a diagram for explaining an image of a range, and FIG. 3B is a diagram for explaining an image of an operable range when the operating state is the position of the “right seat”. In the first embodiment, the display position determination unit determines the display position of the Audio icon so that the Audio icon is displayed within the operable range, and the display control unit determines the audio icon at the position determined by the display position determination unit. It is a figure which shows the image of the display screen example of the display device after displaying. It is a flowchart for demonstrating operation of the display control apparatus which concerns on Embodiment 1. FIG. It is a figure which shows the configuration example of the display control device which concerns on Embodiment 2. FIG. It is a figure for demonstrating the image of an example of the target identification information which an operation object specifying part refers to when specifying an operation object in Embodiment 2. FIG. It is a figure for demonstrating the image of an example of the initial display position of an audio menu screen in Embodiment 2. FIG. In the second embodiment, the display position determination unit determines the display position of the audio menu screen so that the audio menu screen is displayed within the operable range, and the display control unit determines the position determined by the display position determination unit. It is a figure which shows the image of the display screen example of the display device after displaying an audio menu screen. It is a flowchart for demonstrating operation of the automatic operation control apparatus which concerns on Embodiment 2. 11A and 11B are diagrams showing an example of the hardware configuration of the display control device according to the first embodiment and the second embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
Embodiment 1.
FIG. 1 is a diagram showing a configuration example of the display control device 1 according to the first embodiment.
In the first embodiment, it is assumed that the display control device 1 is mounted on the vehicle. Further, in the vehicle equipped with the display control device 1, a large screen and touch-operable display device 2 is installed in front of the driver's seat and the passenger seat located in front of the vehicle in the traveling direction of the vehicle. It is assumed that it has been done.

Here, FIG. 2 is a diagram for explaining an image of the display device 2 in a state where the display device 2 is installed in the vehicle in the vehicle equipped with the display control device 1 according to the first embodiment.
The display device 2 is a touch panel type display having a touch panel on the surface. One or more display objects are displayed on the display device 2. The driver performs various functions by touch-operating any one of one or more display objects displayed on the display device 2. The display device 2 is a large-screen display device 2 having a width such that a touch-operable area exists both in front of the driver's seat and in front of the passenger seat. Therefore, the display object displayed on the display device 2 can be displayed at a position so far away from the driver that the driver cannot perform a touch operation.
In the following description, the driver's seat is also referred to as a "right seat" or a "left seat". The "right seat" is a seat that passes through the center of the width direction of the vehicle in the direction of travel of the vehicle and is located on the right side of a straight line substantially parallel to the direction of travel of the vehicle, and is a "left seat". Refers to a seat existing on the left side of the straight line in the direction of travel of the vehicle. That is, when the vehicle is a right-handed vehicle, the driver's seat is the "right seat", and when the vehicle is a left-handed vehicle, the driver's seat is the "left seat".

In the first embodiment, the display control device 1 controls the display device 2 as described above so that the display object touch-operated by the driver is displayed in a range that the driver can touch. The display control of the display object displayed on the display device 2 is performed by the display control unit 15 described later in the display control device 1.
Specifically, the display control device 1 acquires information (hereinafter referred to as "remote control information") indicating that a function that can be executed via the display device 2 is specified by remote control. Based on the acquired remote control information, a display object (hereinafter referred to as "operation target object") to be touch-operated by the driver is specified. Then, the display control device 1 displays the specified operation target on the display device 2 in a range where the driver can touch-operate (hereinafter, referred to as "operable range").
In the first embodiment, the remote control is an operation performed in a non-contact manner, for example, an operation performed by utterance. Further, in the following embodiment 1, a person who touch-operates an operation object displayed on the display device 2 is referred to as an "operator". That is, in the first embodiment, the driver is the "operator".
Further, in the first embodiment, the functions that can be executed via the display device 2 include various functions that can be executed by the occupant in the vehicle. For example, a telephone function for making a call, a search function for causing a navigation device (not shown) to execute a route search, or an audio function for causing an audio device (not shown) to play music. Is.

The operator can execute the above-mentioned functions via the display device 2. Specifically, the operator can execute the function by performing a determination operation on the operation target displayed on the display device 2. The determination operation is, for example, a touch operation. However, as described above, the display object displayed on the display device 2 may be displayed at a position so far away from the operator that the operator cannot perform a touch operation.
Therefore, the operator can specify the function to be executed by remote control, and the display control device 1 can acquire the remote control information when the remote control is performed. ing. Specifically, the operator specifies a function to be executed by remote control using the input device 3. In the first embodiment, the input device 3 is, for example, an array microphone. The array microphone can acquire spatial information of sound that cannot be obtained by one microphone, and can control directivity and the like.
The display control device 1 acquires remote control information from the input device 3. The display control device 1 identifies the operation target based on the acquired remote control information, and controls the operation target so as to be displayed within the operable range.

In the first embodiment, the operation target displayed on the display device 2 is an icon. The icon is a button or the like for the operator to execute various functions.
In FIG. 2, as an example, a TEL icon 201 for instructing the execution of the telephone function, a Search icon 202 for instructing the execution of the search function, and an Audio icon 203 for instructing the execution of the audio function are display devices. It is assumed that it is displayed in 2.
The icon is displayed in the initial state of the display device 2. The initial state of the display device 2 is, for example, when the power is turned on. In addition, the function to be executed when the icon is determined is determined in advance for each icon.

Returning to the description of FIG.
The display control device 1 includes an acquisition unit 11, an operation target object identification unit 12, an operation state identification unit 13, a determination unit 14, and a display control unit 15. The operation target object identification unit 12 includes an initial display position identification unit 121. The determination unit 14 includes an operation range determination unit 141. The display control unit 15 includes a display position determination unit 151.
The acquisition unit 11 acquires remote control information indicating that a function that can be executed via the touch-operable display device 2 is specified by remote control.
Specifically, the acquisition unit 11 acquires a voice signal based on the voice that specifies the execution of the function, which is input by the operator using the array microphone, as remote control information from the array microphone. For example, as shown in FIG. 2, it is assumed that the operator utters "operate audio" while the TEL icon 201, the Search icon 202, and the Audio icon 203 are displayed on the display device 2. At this time, the driver's seat in which the operator is seated is the "left seat", and the operator cannot touch the Audio icon 203. The acquisition unit 11 acquires an audio signal based on the utterance "manipulate audio" from the array microphone as remote control information.
The acquisition unit 11 outputs the acquired remote control information to the operation target object identification unit 12 and the operation state identification unit 13.

Based on the remote control information acquired by the acquisition unit 11, the operation object identification unit 12 specifies the operation object to be touch-operated by the operator of the display device 2 and specifies the initial display position of the operation object. ..
First, the operation target object identification unit 12 selects an operation target object to be touch-operated by the operator among one or more display objects displayed on the display device 2 based on the remote control information output from the acquisition unit 11. Identify. Specifically, the operation target identification unit 12 selects an icon that the operator touch-operates among one or more icons displayed on the display device 2 based on the audio signal output from the acquisition unit 11. , Specify as an operation target. The operation target object identification unit 12 performs voice recognition processing on the voice signal by using a well-known voice recognition technique. Then, the operation target identification unit 12 identifies the operation target by referring to the target identification information, for example, based on the voice recognition result. The target identification information is at least information in which keywords and icon identification information are associated with each other. The icon identification information may be any information that can identify the icon. The target identification information is generated in advance and stored in a storage unit (not shown) that can be referred to by the display control device 1. The storage unit may be provided in the display control device 1, or may be provided in a place outside the display control device 1 where the display control device 1 can be referred to.

For example, in the above example, the operation target identification unit 12 performs voice recognition processing on a voice signal indicating "manipulate audio", and obtains the keyword "audio" as the voice recognition result. Further, in the target identification information, it is assumed that the identification information of the Audio icon 203 is associated with the "audio". The operation target object identification unit 12 identifies the Audio icon 203 as an operation target object with reference to the target identification information.

Then, the operation target object specifying unit 12 specifies the initial display position of the operation target object on the display screen of the display device 2 based on the information about the specified operation object. Specifically, the initial display position specifying unit 121 of the operation target object specifying unit 12 specifies the initial display position of the operation target object.
The current display position on which the display object is displayed on the display device 2 is predetermined according to the display object before the remote control is performed by the operator. In the first embodiment, the current display position determined in advance according to the display object is referred to as an initial display position of the display object. The initial display position is, for example, a display position where a display object is displayed when the power is turned on. Further, the initial display position is, for example, a display position that is shifted from the display position of the display object that was displayed when the power is turned on, depending on the display status of other display objects and the like.
The display position of the display object is represented by the coordinates on the display screen of the display device 2.
The initial display position specifying unit 121 specifies the initial display position of the operation target by referring to the initial display position specifying information based on the information about the operation target. For example, the initial display position specifying information in which the identification information of the display object that can be displayed on the display device 2 and the information regarding the initial display position of the display object are associated with each other is generated in advance and stored in the storage unit. In the first embodiment, at least the identification information of the icon that can be displayed on the display device 2 and the information about the initial display position of the icon are defined in association with the information for specifying the initial display position. To do.
For example, the display control unit 15 described later has the function of the initial display position specifying unit 121, and the operation target object specifying unit 12 sets the initial display position based on the information regarding the initial display position acquired from the display control unit 15. It may be specified. Further, for example, the management unit (not shown) has the function of the initial display position specifying unit 121, and the operation target object specifying unit 12 specifies the initial display position based on the information regarding the initial display position acquired from the management unit. You may do so.

In the above example, the initial display position specifying unit 121 specifies the initial display position of the Audio icon 203. Here, it is assumed that the initial display position of the Audio icon 203 is the position shown in FIG.
The operation target object identification unit 12 outputs the specified information on the operation target object and the information on the initial display position of the operation target object to the determination unit 14 and the display control unit 15.

Here, the target identification information and the initial display position identification information are set as separate information, but this is only an example, and the target identification information and the initial display position identification information can be combined as one piece of information. Good. For example, in the target identification information, the information regarding the initial display position of the icon may be defined in association with the identification information of the icon. In this case, the initial display position specifying unit 121 may specify the initial display position of the icon based on the target identification information.

The operation state specifying unit 13 specifies the operation state of the operator based on the remote control information output from the acquisition unit 11. In the first embodiment, the operation state of the operator is the position of the operator who has performed the remote control.
Specifically, the operation state specifying unit 13 specifies the position of the operator when the remote control is performed, based on the audio signal output from the acquisition unit 11. The position of the operator is, for example, the position of the seat in which the operator is seated.
The operation state specifying unit 13 analyzes the audio signal output from the acquisition unit 11 and specifies the direction of the source of the audio signal. The operation state specifying unit 13 may analyze the voice signal and specify the direction of the source of the voice signal by using a well-known technique. The operation state specifying unit 13 identifies the seat in which the operator is seated from the direction of the specified source of the voice signal. Then, the operation state specifying unit 13 sets the specified seat position as the position of the seat on which the operator is seated. The position of each seat of the vehicle is predetermined, and the operation state specifying unit 13 may specify the position of the seat on which the operator is seated based on the predetermined information regarding the position of each seat. it can.
The operation state specifying unit 13 is, for example, on the right side of a straight line in which the direction of the identified voice signal source passes through the center in the width direction of the vehicle with respect to the traveling direction of the vehicle and is substantially parallel to the traveling direction of the vehicle. In the case of the direction of the space, the "right seat" is the seat on which the operator is seated, and the position of the "right seat" is the position of the operator. On the contrary, the operation state specifying unit 13 is, for example, a straight line in which the direction of the identified voice signal source passes through the center in the width direction of the vehicle with respect to the traveling direction of the vehicle and is substantially parallel to the traveling direction of the vehicle. In the direction of the space on the left side of, the "left seat" is the seat on which the operator is seated, and the position of the "left seat" is the position of the operator. In the above example, the operation state specifying unit 13 uses the position of the "left seat" as the position of the operator.
The operation state specifying unit 13 outputs the specified information on the operation state of the operator, in other words, the specified information on the position of the operator, to the determination unit 14. In the first embodiment, the information regarding the position of the operating seat is, for example, the position information of the "right seat" or the position information of the "left seat".

The determination unit 14 is a display device 2 in which the operator can touch-operate the initial display position of the operation object specified by the operation object identification unit 12 based on the operation state of the operator specified by the operation state identification unit 13. It is determined whether or not it is within the operable range on the display screen of.
First, in the determination unit 14, the operation range determination unit 141 of the determination unit 14 determines the operable range based on the information regarding the operation state of the operator output from the operation state identification unit 13.
In the first embodiment, the operable range is predetermined according to the position of the seat in which the operator is seated, and is for specifying the range in which the information regarding the position of the seat in the vehicle and the operable range are associated with each other. Information is generated in advance and stored in the storage unit. The operable range is determined to be, for example, the range on the display screen of the display device 2 in which an operator having a standard physique can perform touch operations without being in an unreasonable posture while sitting in a seat. There is. The operable range is represented by the coordinates on the display screen of the display device 2.

Here, FIG. 3 is a diagram for explaining an example of an image of the operable range based on the operating state of the operator in the first embodiment. FIG. 3A is a diagram illustrating an image of an operable range (shown by 301 in FIG. 3A) when the operator's operating state is the position of the “left seat” (see FIG. 2), and FIG. 3B is a diagram illustrating It is a figure explaining the image of the operable range (shown by 302 in FIG. 3B) when the operation state of an operator is the position of "right seat" (see FIG. 2). In FIG. 3, as an example, the operable range is a circular range, but the operable range is not limited to the circular range. The operable range may be a range on the display screen of the display device 2 that can be touch-operated without being in an unreasonable posture when the operator is seated.

The operation range determination unit 141 determines the operable range with reference to the range specifying information based on the information regarding the operation state of the operator.
In the above example, the operation range determination unit 141 identifies the operable range (for example, see 301 in FIG. 3A) associated with the position of the “left seat” in the range identification information as the operable range. To do.

Next, the determination unit 14 determines the operation target object based on the information regarding the initial display position of the operation target object output from the operation target object identification unit 12 and the information regarding the operable range specified by the operation range determination unit 141. Determine if the initial display position is within the operable range. In the first embodiment, the determination unit 14 operates whether or not the initial display position of the operation target is within the operable range, for example, the center coordinates when the operation target is displayed at the initial display position. Judgment shall be made based on whether or not it is within the possible range.
In the above example, the determination unit 14 determines whether or not the center coordinates when the Audio icon 203 is displayed at the initial display position (see FIG. 2) are within the operable range shown by 301 in FIG. 3A. To judge.
The determination unit 14 outputs a determination result (hereinafter referred to as “range determination result information”) as to whether or not the initial display position of the operation target is within the operable range to the display control unit 15.
In the above example, since the center coordinates when the Audio icon 203 is displayed in the initial display position are not within the operable range, the determination unit 14 determines that the initial display position of the Audio icon 203 is not within the operable range. The range determination result information is output to the display control unit 15.

When the determination unit 14 determines that the initial display position of the operation target is not within the operable range, the display control unit 15 displays the operation target on the display device 2 so that the operation target is displayed within the operable range. Control the display of the operation target.
Specifically, in the display control unit 15, the display position determination unit 151 outputs information on the initial display position of the operation object output from the operation object identification unit 12, and the range determination result output from the determination unit 14. Based on the information, the display position of the operation target on the display device 2 is determined.
When the display position determination unit 151 indicates that the range determination result information indicates that the initial display position of the operation target is not within the operable range, in other words, the determination unit 14 can operate the initial display position of the operation object. If it is determined that the operation target is not within the range, the display position of the operation target is determined so that the operation target is displayed within the operable range.
In the first embodiment, the state in which the operation target is displayed within the operable range means that at least the operation target is appropriately performed by touching the operation target. It is assumed that an area having a sufficient size (hereinafter referred to as "touch operation effective area") is displayed within the operable range.
In the above example, since the determination unit 14 outputs the range determination result information that the center coordinates of the initial display position of the Audio icon 203 are not within the operable range (see 301 in FIG. 3), the display position is displayed. The determination unit 151 determines the display position of the Audio icon 203 in which the Audio icon 203 is displayed within the operable range.

On the other hand, when the range determination result information indicates that the initial display position of the operation target is within the operable range, the display position determination unit 151, in other words, the determination unit 14 determines the initial display position of the operation target. When it is determined that the operation target is within the operable range, the initial display position of the operation target is determined to be the display position of the operation target. The display position determination unit 151 may determine the initial display position of the operation object based on the information regarding the initial display position of the operation object output from the operation object identification unit 12. The information regarding the display position of the operation object determined by the display position determination unit 151 is, for example, the coordinates of the center of the operation object on the display screen of the display device 2.

The display control unit 15 determines that the operation object is displayed at the display position determined by the display position determination unit 151 based on the information regarding the display position of the operation object determined by the display position determination unit 151. Controls the display on the display device 2. Specifically, the display control unit 15 sets the coordinates of the center of the operation target when displayed on the display device 2 to be the coordinates of the center of the operation target determined by the display position determination unit 151, for example. The display position of the operation target is moved.
In FIG. 4, in the first embodiment, the display position determination unit 151 determines the display position of the Audio icon 203 so that the Audio icon 203 is displayed within the operable range, and the display control unit 15 determines the display position. It is a figure which shows the image of the display screen example of the display device 2 after displaying the Audio icon 203 at the position decided by the part 151.
As shown in FIG. 4, the display control unit 15 shifts the display position of the Audio icon 203 from the position shown in FIG. 2 to the position shown in FIG. 4 based on the display position of the Audio icon 203 determined by the display position determination unit 151. By moving the audio icon 203 to the display, the driver can touch the Audio icon 203.
Here, as an example, when the display control unit 15 controls the display of the operation target object so that it is displayed at the display position determined by the display position determination unit 151 from the state displayed at the initial display position, the operation target is operated. The display position of the object is to be moved. However, this is only an example, and the display control unit 15 keeps the operation target in the state of being displayed at the initial display position, and further, the operation target is also displayed at the display position determined by the display position determination unit 151. It may be controlled so that it is displayed. The display control unit 15 may display the operation target at the display position of the operation target determined by the display position determination unit 151.
The display control unit 15 can control the display position of the other icon when the operation target is displayed and overlaps with the other icon. Specifically, the display control unit 15 shifts the display position of another icon to a position that does not overlap with the operation target, for example. The display position determining unit 151 may determine whether or not the display position of the operation object overlaps with another icon.

The operation of the display control device 1 according to the first embodiment will be described.
FIG. 5 is a flowchart for explaining the operation of the display control device 1 according to the first embodiment.
The acquisition unit 11 acquires remote control information indicating that a function that can be executed via the touch-operable display device 2 is specified by remote control (step ST501).
The acquisition unit 11 outputs the acquired remote control information to the operation target object identification unit 12 and the operation state identification unit 13.

Based on the remote control information acquired by the acquisition unit 11 in step ST501, the operation object identification unit 12 identifies the operation object to be touch-operated by the operator of the display device 2, and initially displays the operation object. The position is specified (step ST502).
First, the operation target object identification unit 12 selects an operation target object to be touch-operated by the operator among one or more display objects displayed on the display device 2 based on the remote control information output from the acquisition unit 11. Identify.
Then, the operation target object specifying unit 12 specifies the initial display position of the operation target object on the display screen of the display device 2 based on the information about the specified operation object. Specifically, the initial display position specifying unit 121 of the operation target object specifying unit 12 specifies the initial display position of the operation target object.
The operation target object identification unit 12 outputs the specified information on the operation target object and the information on the initial display position of the operation target object to the determination unit 14 and the display control unit 15.

The operation state specifying unit 13 specifies the operation state of the operator based on the remote control information output from the acquisition unit 11 in step ST501 (step ST503).
Specifically, the operation state specifying unit 13 specifies the position of the operator when the remote control is performed, based on the audio signal output from the acquisition unit 11.
The operation state specifying unit 13 outputs the specified information on the operation state of the operator, in other words, the specified information on the position of the operator, to the determination unit 14.

In the determination unit 14, the initial display position of the operation target object specified by the operation target object identification unit 12 in step ST502 is the operable range based on the operation state of the operator specified by the operation state identification unit 13 in step ST503. It is determined whether or not it is inside (step ST504).
Specifically, first, in the determination unit 14, the operation range determination unit 141 of the determination unit 14 determines the operable range based on the information regarding the operation state of the operator output from the operation state identification unit 13.
Next, the determination unit 14 determines the operation target object based on the information regarding the initial display position of the operation target object output from the operation target object identification unit 12 and the information regarding the operable range specified by the operation range determination unit 141. Determine if the initial display position is within the operable range.
The determination unit 14 outputs the range determination result information as to whether or not the initial display position of the operation target is within the operable range to the display control unit 15.

When the determination unit 14 determines in step ST504 that the initial display position of the operation target is not within the operable range, the display control unit 15 displays the operation target so that it is displayed within the operable range. The display of the operation target object on the device 2 is controlled (step ST505).
Specifically, in the display control unit 15, the display position determination unit 151 outputs information on the initial display position of the operation object output from the operation object identification unit 12, and the range determination result output from the determination unit 14. Based on the information, the display position of the operation target on the display device 2 is determined.
When the display position determination unit 151 indicates that the range determination result information indicates that the initial display position of the operation target is not within the operable range, in other words, the determination unit 14 can operate the initial display position of the operation object. If it is determined that the operation target is not within the range, the display position of the operation target is determined so that the operation target is displayed within the operable range.
On the other hand, when the range determination result information indicates that the initial display position of the operation target is within the operable range, the display position determination unit 151, in other words, the determination unit 14 determines the initial display position of the operation target. When it is determined that the operation target is within the operable range, the initial display position of the operation target is determined to be the display position of the operation target.
The display control unit 15 determines that the operation object is displayed at the display position determined by the display position determination unit 151 based on the information regarding the display position of the operation object determined by the display position determination unit 151. Controls the display on the display device 2.

In the flowchart of FIG. 5, the order of the operation of step ST502 and the operation of step ST503 does not matter. The operation of step ST502 and the operation of step ST503 may be performed in parallel.

As described above, the display control device 1 according to the first embodiment is the display device 2 capable of touch operation, and the initial display of the operation target object for which the operator of the display device 2 desires the touch operation. Even if the position is a position where the operator cannot perform the touch operation, it is possible to control the operation object to be displayed at the position where the operator can perform the touch operation. Specifically, in the display control device 1 according to the first embodiment, the initial display position of the icon for executing the function designated by the remote control in the touch-operable display device 2 is operated. It is possible to control the icon to be displayed at a position where the operator can perform the touch operation even if the person cannot perform the touch operation.

In the conventional technique of moving the position of the input icon near the finger as described above, the display object that the operator desires to touch is not always moved near the finger.
Further, in the conventional technique, the operation target that the operator does not want is moved near the operator's finger. As a result, even if the operation target desired by the operator is moved near the finger, the operator may erroneously operate an input icon that is not desired.
On the other hand, in the display control device 1 according to the first embodiment, the initial display position of the operation object that the operator of the display device 2 desires to touch is the position where the operator cannot touch the operation object. Even so, it is possible to control the operation object to be displayed at a position where the operator can perform a touch operation.

As described above, according to the first embodiment, the remote control information indicating that the function that can be executed by the display control device 1 via the touch-operable display device 2 is specified by remote control. Based on the acquisition unit 11 to acquire the above and the remote control information acquired by the acquisition unit 11, the operation object to be touch-operated by the operator of the display device 2 is specified, and the initial display position of the operation object is specified. Operation target identification unit 12 to be operated, an operation state specification unit 13 to specify the operation state of the operator who performed the remote control, and an operation target identification unit 13 to specify the operation state of the operator specified by the operation state specification unit 13. The determination unit 14 and the determination unit 14 determine whether or not the initial display position of the operation object specified by 12 is within the operable range on the display screen of the display device 2 that can be touch-controlled by the operator. , When it is determined that the initial display position of the operation object is not within the operable range, the display control for controlling the display of the operation object on the display device 2 so that the operation object is displayed within the operable range. It is configured to include a part 15.
Therefore, in the touch-operable display device 2, the operation target that the operator of the display device 2 desires to touch can be displayed at a position where the operator can touch-operate.

Embodiment 2.
In the first embodiment, the display device 2 displays one or more icons as display objects, and the display control device 1 is designated by remote control among the one or more icons displayed on the display device 2. The icon for executing the specified function is specified as the operation target.
In the second embodiment, the operation target specified by the display control device 1a will be a display object to be displayed on the display device 2 after the icon is operated.

In the second embodiment, as in the first embodiment, the display device 2 displays one or more icons for executing the function as display objects (see FIG. 2).
Further, in the second embodiment, for example, when any one of the icons displayed on the display device 2 is operated, the function associated with the icon is executed, and the function associated with the icon is executed according to the executed function. Displayed objects will be displayed. For example, if the Audio icon 203 is operated, the audio menu screen will be displayed. For example, if the audio menu screen is operated, the volume setting screen may be displayed. It should be noted that the case where the displayed object is operated means the case where the displayed object is determined, and the determined operation is a touch operation or the like.
As described above, in the second embodiment, a certain display object and a display object to be displayed next when the display object is operated are determined. That is, the display objects are defined in a hierarchical structure. In the above example, the audio menu screen is defined in the lower layer of the Audio icon 203. The hierarchical structure has two or more layers. For example, when a function associated with an icon is executed, one of the display objects defined in a plurality of layers below the icon is displayed according to the executed function. The object is displayed on the display device 2.
In the second embodiment, the display object displayed when the function is executed is referred to as a "response display object".

Also in the second embodiment, as in the first embodiment, the input device 3 is, for example, an array microphone. The operator uses the array microphone to specify the function to be executed by voice.

FIG. 6 is a diagram showing a configuration example of the display control device 1a according to the second embodiment.
Regarding the display control device 1a according to the second embodiment, the same reference numerals are given to the same configuration as the display control device 1 described with reference to FIG. 1 in the first embodiment, and duplicate description will be omitted. The configuration of the display control device 1a according to the second embodiment is different from the configuration of the display control device 1 according to the first embodiment in that the display control unit 15a includes the response generation unit 152. Further, in the display control device 1a according to the second embodiment, the specific operations of the operation target object identification unit 12a, the initial display position identification unit 121a, the determination unit 14a, the display control unit 15a, and the display position determination unit 151a are performed. Specific operations of the operation target identification unit 12, the initial display position identification unit 121, the determination unit 14, the display control unit 15, and the display position determination unit 151 in the display control device 1 according to the first embodiment, respectively. Is different.

The operation of the operation target identification unit 12a is basically the same as the operation of the operation object identification unit 12 described in the first embodiment.
However, in the first embodiment, the operation target specified by the operation target identification unit 12 is an icon displayed on the display device 2 for executing the function designated by remote control. In the second embodiment, the operation target specified by the operation target identification unit 12a is displayed on the display device 2 according to the execution of the function when the remote operation for designating the execution of the function is performed. The difference is that it is a response display.

For example, as in the example given in the first embodiment, as shown in FIG. 2, the operator displays the TEL icon 201, the Search icon 202, and the Audio icon 203 on the display device 2. Suppose you say "manipulate audio". At this time, the driver's seat in which the operator is seated is the left seat, and the operator cannot touch the Audio icon 203. The acquisition unit 11 acquires a voice signal based on the voice "manipulate audio" from the array microphone as remote control information, and outputs the remote control information to the operation target object identification unit 12a and the operation state identification unit 13. ..

The operation target identification unit 12a responds to be displayed on the display device 2 according to the executed function when the function specified by remote control is executed based on the audio signal output from the acquisition unit 11. The display object is specified as an operation object, and the initial display position of the operation object is specified.
Specifically, the operation target object identification unit 12a first performs voice recognition processing on the voice signal by using a well-known voice recognition technique. Then, the operation target object identification unit 12a identifies the operation target object by referring to the target identification information, for example, based on the voice recognition result. In the second embodiment, at least the keyword, the identification information of the icon, the identification information of the function to be executed by operating the icon, and the identification information of the function to be executed when the function is executed are displayed in the target identification information. It is assumed that the identification information of the response display object is associated with the information. The function identification information may be any information that can identify the function. Further, the identification information of the response display object may be any information that can identify the response display object.

FIG. 7 is a diagram for explaining an image of an example of target identification information referred to when the operation target object identification unit 12a identifies the operation target object in the second embodiment.
For example, in the example given in the first embodiment, the operation target object identification unit 12a first performs voice recognition processing on a voice signal indicating "manipulate audio", and as a voice recognition result, "audio". Get the keyword. The operation target identification unit 12a identifies the "audio menu screen", which is a response display object associated with the "audio", as the operation target by referring to the target identification information.

Then, the operation target object specifying unit 12a specifies the initial display position of the operation target object on the display screen of the display device 2 based on the information about the specified operation object. Specifically, the initial display position specifying unit 121a of the operation target object specifying unit 12a specifies the initial display position of the operation target object. The operation of the initial display position specifying unit 121a is basically the same as the operation of the initial display position specifying unit 121 described in the first embodiment.
In the first embodiment, the operation target for which the initial display position specifying unit 121 specifies the initial display position is an icon, whereas in the second embodiment, the initial display position specifying unit 121a specifies the initial display position. The difference is that the operation target is a response display.
The initial display position specifying unit 121a specifies the initial display position of the operation target, in other words, the response display object, with reference to the initial display position specifying information based on the information about the operation target, for example. In the second embodiment, at least the identification information of the response display object that can be displayed on the display device 2 and the information regarding the initial display position of the response display object are defined in the initial display position identification information in association with each other. ing.
In the above example, the initial display position specifying unit 121a specifies the initial display position of the audio menu screen.

FIG. 8 is a diagram for explaining an image of an example of the initial display position of the audio menu screen 801 in the second embodiment. The initial display position specifying unit 121a specifies the display position of the audio menu screen 801 shown in FIG. 8 as the initial display position of the audio menu screen 801. Note that FIG. 8 shows a state in which the audio menu screen 801 is displayed at the initial display position for convenience, but the audio menu screen 801 is not a display object displayed in the initial state of the display device 2. The audio menu screen 801 is displayed on the display device 2 after the icon for executing the audio function is operated. Specifically, on the audio menu screen 801, when a function called "audio menu display" associated with the audio icon 203 for executing the audio function is executed, the "audio menu display" is executed. As a result, it will be displayed on the display device 2.
The operation object specifying unit 12a outputs the specified information on the operation object and the information on the initial display position of the operation object to the determination unit 14a and the display control unit 15a.

The operation of the determination unit 14a is basically the same as the operation of the determination unit 14 described in the first embodiment.
In the first embodiment, the operation target for which the determination unit 14 determines whether or not the initial display position is within the operable range is an icon, whereas in the second embodiment, the determination unit 14a determines whether or not the initial display position is within the operable range. The difference is that the operation target for determining whether or not the initial display position is within the operable range is the response display object. In the second embodiment, the specific operation of the operation range determination unit 141a for determining the operable range is the same as the specific operation of the operation range determination unit 141 described in the first embodiment. Duplicate description is omitted.
The determination unit 14a is based on the information regarding the initial display position of the operation target object output from the operation target object identification unit 12a and the information regarding the operable range specified by the operation range determination unit 141a, that is, the operation target object, in other words, It is determined whether or not the initial display position of the response display object is within the operable range.
In the above example, the determination unit 14a determines whether or not the center coordinates when the audio menu screen 801 is displayed at the initial display position (see FIG. 8) are within the operable range (see 301 in FIG. 8). Is determined.
In the above example, the determination unit 14a outputs the range determination result information that the center coordinates of the initial display position of the audio menu screen are not within the operable range to the display control unit 15a.

In the second embodiment, the display control unit 15a includes a display position determination unit 151a and a response generation unit 152.
In the display control unit 15a, the response generation unit 152 generates response display information for displaying the response display object based on the information about the operation object output from the operation object identification unit 12a. In the above example, the response generation unit 152 generates response display information for displaying the “audio menu screen”.

When the determination unit 14a determines that the operation target, in other words, the initial display position of the response display object is not within the operable range, the display control unit 15a displays the operation target within the operable range. , Controls the display of the operation target on the display device 2.
Specifically, in the display control unit 15a, the display position determination unit 151a has information on the initial display position of the operation object output from the operation object identification unit 12a, and the range determination result output from the determination unit 14a. Based on the information, the display position of the operation target on the display device 2 is determined.
When the range determination result information indicates that the initial display position of the operation target is not within the operable range, the display position determination unit 151a, in other words, the determination unit 14a can operate the initial display position of the operation target. If it is determined that the operation target is not within the range, the display position of the operation target is determined so that the operation target is displayed within the operable range.
In the above example, the determination unit 14a outputs range determination result information that the center coordinates of the initial display position of the audio menu screen 801 are not within the operable range (see 301 in FIG. 8). The position determination unit 151a determines the display position of the audio menu screen 801 on which the audio menu screen 801 is displayed within the operable range.

Also in the second embodiment, as in the first embodiment, the state in which the operation target is displayed within the operable range means that at least the touch operation effective area is displayed within the operable range. To do. For example, when the audio menu screen 801 is a display object including a plurality of display objects such as buttons for which the operator performs a touch operation, the display position determination unit 151a touches all the display objects included in the audio menu screen 801. The display position in which the operation effective area is within the operable range is determined as the display position of the audio menu screen 801.

On the other hand, when the display position determination unit 151a indicates that the range determination result information indicates that the initial display position of the response display object is within the operable range, in other words, the determination unit 14a determines that the initial display position of the response display object is If it is determined that the response display is within the operable range, the initial display position of the response display is determined to be the display position of the response display. The display position determination unit 151a may determine the initial display position of the response display object based on the information regarding the initial display position of the response display object output from the operation target object identification unit 12a.

The display control unit 15a operates at the display position determined by the display position determination unit 151a based on the information regarding the display position of the operation target determined by the display position determination unit 151a and the response display information generated by the response generation unit 152. The display of the response display object on the display device 2 is controlled so that the object, in other words, the response display object is displayed. Specifically, in the display control unit 15a, for example, when the response display object is displayed on the display device 2 based on the response display information, the coordinates of the center of the response display object are set by the display position determination unit 151a. The response display object is displayed so as to be the coordinates of the center of the determined response display object. The response display information includes information such as the size of the response display object, and the display control unit 15a sets the coordinates of the center of the displayed response display object as the display position based on the response display information. It is possible to specify the coordinates of the display position of the response display object, which is the coordinates of the center of the response display object determined by the determination unit 151a.

In FIG. 9, in the second embodiment, the display position determination unit 151a determines the display position of the audio menu screen 801 so that the audio menu screen 801 is displayed within the operable range, and the display control unit 15a displays the display. It is a figure which shows the image of the display screen example of the display device 2 after displaying the audio menu screen 801 at the position determined by the position determination unit 151a.
As shown in FIG. 9, the display control unit 15a displays the audio menu screen 801 as the initial display of the audio menu screen 801 shown in FIG. 8 based on the display position of the audio menu screen 801 determined by the display position determination unit 151a. By displaying the audio menu screen 801 at the position shown in FIG. 9 instead of the position, the driver can perform a touch operation on the audio menu screen 801.

The operation of the display control device 1a according to the second embodiment will be described.
FIG. 10 is a flowchart for explaining the operation of the display control device 1a according to the second embodiment.
The acquisition unit 11 acquires remote control information indicating that a function that can be executed via the touch-operable display device 2 is specified by remote control (step ST1001). The specific operation of step ST1001 is the same as the specific operation of step ST501 described with reference to FIG. 5 in the first embodiment.
The acquisition unit 11 outputs the acquired remote control information to the operation target object identification unit 12a and the operation state identification unit 13.

The operation target identification unit 12a identifies the operation target to be touch-operated by the operator of the display device 2 based on the remote control information acquired by the acquisition unit 11 in step ST1001, and initially displays the operation target. The position is specified (step ST1002).
The operation object specifying unit 12a outputs the specified information on the operation object and the information on the initial display position of the operation object to the determination unit 14a and the display control unit 15a.

The operation state specifying unit 13 specifies the operation state of the operator based on the remote control information output from the acquisition unit 11 in step ST1001 (step ST1003). The specific operation of step ST1003 is the same as the specific operation of step ST503 described with reference to FIG. 5 in the first embodiment.
The operation state specifying unit 13 outputs the information regarding the specified operation state, in other words, the specified information regarding the position of the seat where the operator is seated, to the determination unit 14a.

In the determination unit 14a, the initial display position of the operation target object specified by the operation target object identification unit 12a in step ST1002 is within the operable range based on the operation state of the operator specified by the operation state identification unit 13 in step ST1003. It is determined whether or not it is inside (step ST1004).
The determination unit 14a outputs the range determination result information as to whether or not the initial display position of the operation target is within the operable range to the display control unit 15a.

When the display control unit 15a determines in step ST1004 that the operation target object, in other words, the initial display position of the response display object is not within the operable range, the operation target object is within the operable range. The display of the operation target object on the display device 2 is controlled so as to be displayed in (step ST1005).
The display control unit 15a operates at the display position determined by the display position determination unit 151a based on the information regarding the display position of the operation target determined by the display position determination unit 151a and the response display information generated by the response generation unit 152. The display of the response display object on the display device 2 is controlled so that the object, in other words, the response display object is displayed.

In the flowchart of FIG. 10, the order of the operation of step ST1002 and the operation of step ST1003 does not matter. The operation of step ST1002 and the operation of step ST1003 may be performed in parallel.

As described above, in the display control device 1a according to the second embodiment, in the touch-operable display device 2, the initial display of the operation target object for which the operator of the display device 2 desires the touch operation is displayed. Even if the position is a position where the operator cannot perform the touch operation, it is possible to control the operation object to be displayed within the range where the operator can perform the touch operation. Specifically, the display control device 1a according to the second embodiment is displayed according to the function specified by the remote control on the touch-operable display device 2. For a response display object that the operator desires to touch, the operator can touch the response display object even if the initial display position of the response display object is a position where the operator cannot perform the touch operation. It can be controlled to be displayed at the position.

The display control device 1 according to the first embodiment uses an operation target as an icon displayed on the display device 2 for executing a function designated by remote control, and is associated with the icon by remote control. When the execution of the function is specified, the icon is displayed at a position where the operator can perform a touch operation.
In this case, the operator touches the icon again to instruct the execution of the function associated with the icon, even though the function to be executed by remote control is specified. Then, when the operator touches the icon again, the response display object to be displayed when the function specified by the remote control is executed is displayed.
In the above example, the operator can specify the audio function to be executed by saying "operate the audio", and can execute the audio function by touching the Audio icon 203 again. it can.
That is, the operator needs to specify the audio function by remote control and instruct the execution of the audio function by touch operation before the audio function is executed. Even though the audio function to be executed is specified, it is possible for the operator to execute the audio function by touching the Audio icon 203 after the Audio icon 203 is displayed at a position where the audio function can be touched again. It can be said that it will be troublesome twice.

On the other hand, in the display control device 1a according to the second embodiment, as described above, when the remote control for designating the execution of the function is performed, the response display to be displayed on the display device 2 according to the execution of the function is performed. Display an object at a display position where the operator can touch it.
Specifically, for example, when a remote control for designating the execution of a function called "audio menu display" is performed, the display control device 1a should be displayed on the display device 2 according to the execution of the function. The "audio menu screen" is displayed at a display position where the operator can perform touch operation. The operator performs an operation of touch-operating the Audio icon 203 after the Audio icon 203 for executing the function, which is associated with the function of "audio menu display", is displayed at a touch-operable position. The "audio menu screen" displayed when the audio function is executed by the touch operation of the Audio icon 203 can be touch-operated without performing the operation.
As described above, when the display control device 1a according to the second embodiment performs the remote control for designating the execution of the function, the display control device 1a operates the response display object to be displayed on the display device 2 according to the execution of the function. By displaying the display at a display position where the user can perform touch operation, the operator can execute the desired function without performing the double operation of remote control and touch operation, and the function is executed. The display control of the display object displayed on the display device 2 can be performed so that the display object can be quickly touch-controlled.

As described above, according to the second embodiment, the display control device 1a indicates that the function that can be executed via the touch-operable display device 2 is specified by remote control. Based on the acquisition unit 11 to acquire the above and the remote control information acquired by the acquisition unit 11, the operation object to be touch-operated by the operator of the display device 2 is specified, and the initial display position of the operation object is specified. Operation target object identification unit 12a, operation state identification unit 13 that specifies the operation state of the operator who performed the remote control, and the operation object identification unit 13 that specifies the operation state of the operator specified by the operation state identification unit 13. The determination unit 14a and the determination unit 14a determine whether or not the initial display position of the operation object specified by 12a is within the operable range on the display screen of the display device 2 that can be touch-controlled by the operator. , When it is determined that the initial display position of the operation object is not within the operable range, the display control for controlling the display of the operation object on the display device 2 so that the operation object is displayed within the operable range. It is configured to include the part 15a.
Therefore, in the touch-operable display device 2, even if the initial display position of the operation target that the operator of the display device 2 desires to touch is a position that the operator cannot touch. It is possible to control the operation object to be displayed in the touchable range of the operator.

Further, in the display control device 1a according to the second embodiment, the display device 2 can display an icon for executing the function, and the operation target is the display device after the icon is operated. It was assumed that the response display was displayed in 2. That is, when the display control device 1a determines that the initial display position of the response display object is not within the operable range, the response display object is displayed on the display device 2 so that the response display object is displayed within the operable range. Control the display of. As a result, the display control device 1a causes the operator to execute the desired function without performing the double operation of remote control and touch operation, and promptly touches the response display object due to the execution of the function. It is possible to control the display of the display object displayed on the display device 2 so that the display device 2 can be operated.

In the first and second embodiments described above, the operation state specifying unit 13 of the display control devices 1 and 1a determines the operation state of the operator based on the voice signal output from the array microphone as the input device 3. It was intended to be specified, but this is just an example.
For example, the operation state specifying unit 13 may specify the operation state based on the captured image captured inside the vehicle.
In this case, the acquisition unit 11 of the display control devices 1 and 1a is connected to an image pickup device (not shown) that images the inside of the vehicle, and acquires the captured image from the image pickup device. The imaging device is, for example, a visible light camera or an infrared camera. The image pickup device may be shared with the image pickup device included in the so-called "driver monitoring system" mounted on the vehicle for monitoring the state of the driver in the vehicle.
The operation state specifying unit 13 calculates the opening degree of the occupant of the vehicle based on the captured image acquired by the acquisition unit 11. The operation state specifying unit 13 may perform image recognition processing using a well-known image recognition technique to calculate the opening degree of the occupant of the vehicle. The operation state specifying unit 13 considers that the occupant whose calculated opening is equal to or higher than a preset threshold value (hereinafter referred to as “opening degree determination threshold value”) is an operator, and the seat in which the operator is seated. The position of is specified as the position of the operator.
As described above, when the operation state specifying unit 13 specifies the operation state of the operator based on the captured image, it is not essential that the microphone as the input device 3 is an array microphone.

Further, in the above-described first and second embodiments, the operator specifies the function to be executed by voice, but this is only an example.
For example, the operator may specify the function to be executed by a gesture. In this case, the input device 3 is an imaging device as described above.
The acquisition unit 11 of the display control devices 1 and 1a acquires the acquired captured image as remote control information, and the operation

target identification units

12 and 12a specify the operation target based on the captured image acquired by the acquisition unit 11. To do.
Specifically, for example, the gesture performed by the operator is a pointing action of pointing to an icon associated with the function to be executed, and in the display control device 1 according to the first embodiment, the operation target identification unit 12 is set. By performing image recognition processing using a well-known image recognition technique and specifying the content of the pointing operation by the operator and the pointing direction, the icon pointed by the operator is specified as the operation target. Further, for example, in the display control device 1a according to the second embodiment, the operation target object identification unit 12a performs an image recognition process using a well-known image recognition technique, and the operator points and points. By specifying the direction, the icon pointed by the operator is specified, and from the specified icon, the response display object associated with the icon is specified as the operation target object.

Gestures performed by the operator are not limited to pointing movements. For example, the gesture is determined in advance according to the function to be executed, such as holding a hand, and the operator may perform the gesture according to the function to be executed. The operation

object identification units

12 and 12a perform image recognition processing using a well-known image recognition technique, identify gestures from captured images, and identify predetermined functions associated with gestures. .. Then, the operation target

object specifying units

12 and 12a specify the operation target object from the specified function.

When the input device 3 is used as an image pickup device and the operator specifies a function to be executed by a gesture, the operation state specifying unit 13 of the display control devices 1 and 1a operates the operator based on the captured image. Identify the state. Specifically, the operation state specifying unit 13 performs image recognition processing using, for example, a well-known image recognition technique, identifies an operator performing a gesture, and seats the operator. The position of is set to the operation state of the operator.

Further, in the above-described first and second embodiments, for example, the input device 3 may be a remote controller (hereinafter referred to as "remote controller"), and the operator may specify the function to be executed by the remote controller. Good. When the operator specifies a function to be executed by remote control operation, the acquisition unit 11 acquires information indicating the designated function (hereinafter referred to as "remote control information") from the remote control as remote control information.
The operation

target identification units

12 and 12a of the display control devices 1, 1a specify the operation target based on the remote control information acquired by the acquisition unit 11.
In this case, the display control devices 1 and 1a are connected to, for example, an imaging device as described above, and the operation state specifying unit 13 acquires an captured image from the imaging device via the acquisition unit 11. Then, the operation state specifying unit 13 specifies the operation state of the operator based on the acquired captured image. Specifically, the operation state specifying unit 13 performs image recognition processing using, for example, a well-known image recognition technique, identifies an operator who is operating the remote controller, and the operator is seated. The position of the seat is the operating state of the operator.

In the above, the input device 3 is an array microphone, a microphone, an image pickup device, or a remote controller, and the acquisition unit 11 is an audio signal output from the array microphone or the microphone, an image captured image output from the image pickup device, or a remote controller. It was explained that the remote control information output from the remote control may be used as remote control information, but this is only an example.
The acquisition unit 11 may acquire, for example, any one or more of the audio signal, the captured image, and the remote control information as remote control information.

Further, in the above-described first and second embodiments, when the operation state specifying unit 13 specifies the position of the operator as the operation state of the operator based on the captured image, the inside of the vehicle of the operator The position in the space of is also the position of the operator.
When the operation state specifying unit 13 analyzes the voice signal and specifies the position of the operator by specifying the direction of the source of the voice signal, strictly speaking, the position of the operator in the vehicle may be specified. Can not. Therefore, in the first and second embodiments described above, the position of the seat where the operator is seated is set as the position of the operator based on the direction of the source of the voice signal.
On the other hand, the operation state specifying unit 13 can specify the position of the operator in the space inside the vehicle based on the captured image. For example, the operation state specifying unit 13 may specify the face position of the operator in the captured image based on the captured image, and set the face position as the position of the operator in the space inside the vehicle. Since the imaging range of the imaging device is known in advance, the operation state specifying unit 13 can identify the position of the operator in the space inside the vehicle if the face position of the operator in the captured image can be specified.

The operation state specifying unit 13 determines that the position of the operator in the space inside the vehicle is the position of the operator, as compared with the case where the position of the seat in which the operator is seated is the position of the operator. When the operation

range determination units

141, 141a of the

units

14 and 14a determine the operable range, the operator's operable range can be specified more accurately. As a result, the

display control units

15 and 15a can more reliably determine the display position of the operation target and control the display of the operation target so that the operator can perform the touch operation more reliably. In this case, for example, it is assumed that the spatial position in the vehicle and the operable range are associated with the range specifying information referred to when the operating

range determining units

141 and 141a specify the operable range.

Further, in the above-described first and second embodiments, when the operation state specifying unit 13 specifies the operation state of the operator based on the captured image, the position of the operator and the posture of the operator are determined. , It may be specified as the operation state of the operator. The posture of the operator is, for example, the orientation of the body of the operator. The orientation of the operator's body is, for example, the amount of change in the angle from the reference orientation, with the vehicle traveling direction side as the front and the operator sitting straight toward the front as the reference orientation. Represented. To give a specific example, for example, when the operator is facing the reference direction, the angle is set to 0 degrees, and when the operator is facing the right side with respect to the front, the angle is set to be positive by the amount facing the right side. If the operator faces the left side with respect to the front, the angle should be negative by the amount facing the left side. The operation state specifying unit 13 specifies the position of the operator and the angle as described above as the operation state of the operator.
The operation

range determination units

141 and 141a determine the operable range based on the position of the operator and the posture of the operator specified by the operation state identification unit 13. Specifically, for example, the operation

range determination units

141 and 141a display the operable range associated with the position of the operator on the right side or the display screen of the display device 2 according to the posture of the operator. Move it to the left. It is assumed that how much the operation

range determination units

141 and 141a shift the operable range according to how much posture is determined in advance.

Further, the posture of the operator may be, for example, the amount of inclination of the seat in which the operator is seated.
The operation state specifying unit 13 may calculate the amount of inclination of the seat in which the operator is seated, for example, based on the captured image. Further, the operation state specifying unit 13 may acquire information regarding the amount of inclination of the seat in which the operator is seated, for example, from a sensor installed in the seat. The operation state specifying unit 13 specifies the position of the operator and the amount of inclination calculated based on the captured image as the operation state of the operator. Alternatively, the operation state specifying unit 13 specifies the position of the operator and the amount of inclination acquired from the sensor as the operation state of the operator.
The operation

range determination units

141 and 141a display the operable range associated with the position of the operator on the right side or the display screen of the display device 2 according to the posture of the operator. Move it to the left and reduce it. It is assumed that how much the operation

range determination units

141 and 141a shift the operable range according to the posture and how much the operable range is reduced are predetermined.

Further, in the above-described first and second embodiments, it is premised that the display device 2 is installed in the vehicle in front of the driver's seat and the passenger's seat located in front of the traveling direction of the vehicle. However, the installation position of the display device 2 assumed in the first embodiment and the second embodiment is only an example.
The display device 2 may be installed on the right side surface or the left side surface of the vehicle interior with respect to the traveling direction of the vehicle, or may be installed on the ceiling of the vehicle interior.
Further, a plurality of display devices 2 may be installed in the vehicle. Specifically, for example, the display device 2 may be installed in the vehicle in front of the driver's seat and the passenger seat located in front of the vehicle in the traveling direction, and on both sides of the vehicle interior. Good.

When a plurality of display devices 2 are installed in the vehicle, the operation

range determination units

141 and 141a determine the operable range based on the position of the operator and the posture of the operator specified by the operation state specifying unit 13. When making a determination, the operation

range determination units

141 and 141a select the display device 2 to be touch-operated by the operator from among the plurality of display devices 2, and then determine the operable range in the selected display device 2. You may.
For example, the posture of the operator is the orientation of the body of the operator. Then, it is assumed that the operation state specifying unit 13 specifies that the position of the driver's seat where the operator is seated is the position of the "right seat" and the posture of the operator is plus 90 degrees. Further, it is assumed that the display device 2 is installed in the vehicle in front of the driver's seat with respect to the traveling direction of the vehicle and on both side surfaces of the vehicle interior.
In this case, the operation

range determination units

141 and 141a first select the display device 2 installed on the right side surface of the vehicle interior with respect to the traveling direction. For example, the first display device selection in which information on the position of the operator, information on the posture of the operator, and information on the display device 2 determined to be touch-operated by the operator among the plurality of display devices 2 are associated. It is assumed that the information for use is generated in advance and stored in the storage unit. Here, for example, in the information for selecting the first display device, the position of the operator is the position of the "right seat" and the posture of the operator "plus 90 degrees" is the display device 2 installed on the right side surface. It is assumed that they are associated with each other. The operation

range determination units

141 and 141a select the first display device based on the information of the position of the "right seat" and the information of the operator's posture "plus 90 degrees" specified by the operation state identification unit 13. The display device 2 installed on the right side of the vehicle interior with respect to the traveling direction is selected with reference to the information.
Then, the operation

range determination units

141 and 141a determine the operable range of the selected display device 2 installed on the right side surface. For example, it is assumed that the first display device selection information defines the position of the operator, the posture of the operator, and the operable range of the display device 2 in addition to the display device 2, and determines the operating range.

Units

141 and 141a may determine the operable range with reference to the information for selecting the first display device.

Further, in the above-described example in which a plurality of display devices 2 are installed in the vehicle, the posture of the operator may be the amount of inclination of the seat in which the operator is seated.
In this case, for example, the position of the operator, the amount of inclination of the seat on which the operator is seated, and the display device 2 which is determined to be touch-operated by the operator among the plurality of display devices 2 are associated with each other in advance. It is assumed that the information for selecting the second display device is generated and stored in the storage unit. The operation

range determination units

141 and 141a select the display device 2 to be touch-operated by the operator with reference to the second display device selection information. Then, the operation

range determination units

141 and 141a determine the operable range in the selected display device 2.

For example, it is assumed that the operation state specifying unit 13 specifies that the position of the driver's seat in which the operator is seated is the position of the "right seat" and the amount of inclination of the "right seat" is "140 degrees". Further, it is assumed that the display device 2 is installed in the vehicle in front of the driver's seat with respect to the traveling direction of the vehicle and on both side surfaces of the vehicle interior. In addition, in the information for selecting the second display device, the position of the "right seat", the amount of inclination of the seat on which the operator is seated "130 to 145 degrees", and the installation on the right side of the passenger compartment with respect to the traveling direction. It is assumed that the display device 2 is associated with the display device 2.

In this case, the operation

range determination units

141 and 141a provide the second display device selection information based on the position of the operator specified by the operation state identification unit 13 and the amount of inclination of the seat in which the operator is seated. With reference to this, the display device 2 installed on the right side surface of the vehicle interior is selected with respect to the traveling direction, and the operable range is determined. For example, the second display device selection information includes information on the position of the operator, information on the amount of inclination of the seat in which the operator is seated, and information on the display device 2, and the operable range in the display device 2. Is also defined, and the operation

range determination units

141 and 141a may determine the operable range by referring to the information for selecting the second display device.

Further, in the above-described first and second embodiments, it is assumed that the operator is the driver, but the operator is not limited to the driver. The operator may be an occupant other than the driver.
For example, the operator may be an occupant seated in the passenger seat, or the operator may be an occupant seated in the rear seat.

Further, in the above-described first and second embodiments, it is assumed that the number of operators is one, but the number of operators is not limited to one, and the number of operators may be a plurality of occupants. .. To give a specific example, for example, the driver and the occupant seated in the passenger seat (hereinafter, simply referred to as "passenger") may be used as the operator. In this case, the operation state specifying unit 13 can identify a plurality of operators. Then, when a plurality of operators are specified, the operation state specifying unit 13 specifies the operation state of each of the specified plurality of operators.
The plurality of operators are all persons who can perform touch operations on the display device 2, but it is the plurality of operators who perform remote control on one or more display objects displayed on the display device 2. It shall be one of them.

In this case, it is assumed that the display control devices 1 and 1a are connected to, for example, an imaging device as described above, and the operation state specifying unit 13 acquires an captured image from the imaging device via the acquisition unit 11 and captures the image. A plurality of operators are specified based on the image, and the operation state is specified for each of the specified operators.
Specifically, the operation state specifying unit 13 detects, for example, a plurality of occupants existing in the vehicle by performing image recognition processing on the captured image acquired from the image pickup device using a well-known image recognition technique. To do. In the above example, the operation state specifying unit 13 detects the driver and the passenger and identifies them as the operators, respectively. Then, the operation state specifying unit 13 specifies the operation state of the driver and the operation state of the passenger. For example, when the operating state is the position of the operator, the operating state specifying unit 13 specifies the position of the driver and the position of the passenger. Then, the operation state specifying unit 13 outputs the identified information on the driver's operation state and the information on the passenger's operation state to the

determination units

14 and 14a.
In this case, the operation

range determination units

141 and 141a of the

determination units

14 and 14a determine the operable range based on the operation states of a plurality of operators specified by the operation state identification unit 13. Specifically, the operation

range determination units

141 and 141a first determine the operable range of each of the plurality of operators (hereinafter referred to as "operator unit operable range") based on the operation states of the plurality of operators. To do. The method in which the operation

range determination units

141 and 141a determine the operable range for each operator is the method in which the operation

range determination units

141 and 141a determine the operable range described in the first and second embodiments. It is the same method as. Next, the operation

range determination units

141 and 141a calculate the range in which the operator unit operable range corresponding to each of the plurality of operators overlaps. Then, the operation

range determination units

141 and 141a determine the calculated overlapping range as the operable range.
In the above example, the operation

range determination units

141 and 141a first determine the operator-based operable range according to the driver based on the position of the driver. Further, the operation

range determination units

141 and 141a determine the operator unit operable range according to the passenger based on the position of the passenger. Next, the operation

range determination units

141 and 141a calculate a range in which the operator unit operable range corresponding to the driver and the operator unit operation range corresponding to the passenger overlap. Then, the operation

range determination units

141 and 141a determine the calculated overlapping range as the operable range.

If there is no overlapping range of a plurality of operator unit operable ranges, the operation

range determination units

141 and 141a determine that the operator unit operable range corresponding to the operator who performed the remote control is the operable range. To do. For example, when the operation state specifying unit 13 specifies the operation state, the operator who has performed the remote control is also specified. The operation

range determination units

141 and 141a may acquire information about the operator who has performed the remote control from the operation state specifying unit 13. For example, when the operator performs remote control by voice, the operation state specifying unit 13 performs remote control among a plurality of operators based on the direction of the source of the voice signal and the captured image acquired from the imaging device. It suffices to identify the operator. Further, for example, when the operator performs remote control by gesture, the operation state specifying unit 13 may identify the operator who has performed remote control among a plurality of operators based on the captured image acquired from the imaging device. Good.

Further, in the display control devices 1 and 1a according to the first embodiment and the second embodiment, it is determined whether the number of operators is only one or a plurality of operators depending on the function to be executed. You may try to do it.
Specifically, when specifying the operation state, the operation state specifying unit 13 acquires information on the function associated with the operation target from the operation

target identification units

12 and 12a. The operation target

object specifying units

12 and 12a can specify the function associated with the operation target object based on the target identification information. In this case, the target identification information includes at least the keyword, the identification information of the icon, the identification information of the function executed by operating the icon, and the response display displayed when the function is executed. It is assumed that the identification information of the object is associated with it.
The operation state specifying unit 13 detects an occupant present in the vehicle when the function associated with the operation target is a function that can be targeted by a plurality of operators. Specifically, the operation state specifying unit 13 acquires an captured image from the image pickup device as described above via, for example, the acquisition unit 11, and uses a well-known image recognition technique for the captured image. Image recognition processing is performed to detect one or more occupants present in the vehicle. The operation state specifying unit 13 uses one or more detected occupants as operators. Then, the operation state specifying unit 13 specifies the operation state for each of one or more operators. Further, the operation

range determination units

141 and 141a determine the operable range based on the operation state of one or more operators specified by the operation state identification unit 13. The operation state specifying unit 13 determines a specific operation for specifying the operation state for each of one or more operators, and the operation

range determination units

141 and 141a determine the operable range based on the operation state of one or more operators. Since the specific operation to be performed has already been explained, duplicate explanations will be omitted.

On the other hand, if the function associated with the operation target object is not the target function that can be operated by a plurality of operators, the operation state specifying unit 13 is irrespective of the number of occupants present in the vehicle. , Only the operator who performed the remote control is set as the operator, and the operation state of the operator is specified. Since the specific operation of the operation state specifying unit 13 to identify the operator who performed the remote control has already been explained, duplicate explanations will be omitted.

Further, in the above-described first and second embodiments, the display control devices 1 and 1a respecify the operation state of the operator in a preset cycle (hereinafter referred to as "range re-determination cycle"). Then, the operable range may be re-determined based on the operation state of the specified operator.
A specific operation in which the display control devices 1 and 1a re-identify the operating state of the operator and redetermine the operable range based on the specified operating state of the operator will be described. The operations described below are based on the premise that the operations described using the flowcharts shown in FIGS. 5 and 10, respectively, have been performed in the display control devices 1 and 1a, respectively. In the following description, it is assumed that the image pickup device as described above is connected to the display control devices 1, 1a, and the display control devices 1, 1a acquire the captured image of the inside of the vehicle from the image pickup device. ..

When the

display control units

15 and 15a control the display of the operation target object on the display device 2 (see step ST505 in FIG. 5 and step ST1005 in FIG. 10), the operation

range determination units

141 and 141a redetermine the range. It waits until the cycle is reached, and when the range redetermination cycle is reached, the captured image is acquired from the imaging device via the acquisition unit 11.
The operation state specifying unit 13 specifies the current operation state of the operator based on the acquired captured image. Since the specific operation of specifying the operation state of the operator based on the captured image has already been explained, duplicate description will be omitted. Here, as an example, the operation state specifying unit 13 specifies the position of the operator as the operation state of the operator.

Here, the operation state specifying unit 13 determines whether or not there is a change between the most recently determined operation state and the current operation state of the operator. Specifically, here, the operation state specifying unit 13 determines whether or not the current position of the operator has changed from the position of the operator determined most recently.
When the operation state of the operator is specified, the operation state specifying unit 13 stores the specified operation state of the operator in the storage unit. The operation state specifying unit 13 compares the specified current position of the operator with the stored latest position of the operator to determine the operator's current position most recently. From the position of, it is determined whether or not it has changed.
When the operation state specifying unit 13 determines that there is no change between the most recently determined operation state of the operator and the current operation state of the operator, the operation state specifying unit 13 waits again until the range redetermination cycle is reached.
On the other hand, when the operation state specifying unit 13 determines that there is a change between the most recently determined operation state of the operator and the current operation state of the operator, the operation state specifying unit 13 operates information on the current operation state of the operator. It is output to the

range determination units

141 and 141a. Here, the operation state specifying unit 13 outputs information regarding the current position of the operator to the operation

range determination units

141 and 141a.

When the operation

range determination unit

141, 141a outputs information on the current operation state of the operator from the operation state identification unit 13, the operator's operable range is based on the output information on the operation state of the operator. (See, for example, step ST504 in FIG. 5 and step ST1004 in FIG. 10).
Since the subsequent specific operation is the same as the specific operation of step ST505 described in FIG. 5 or the specific operation of step ST1005 described in FIG. 10, duplicated description will be omitted.
In this way, in the display control devices 1 and 1a, the operation state of the operator is re-specified in the range re-judgment cycle, and the re-judgment of the operable range is performed based on the specified operation state of the operator. can do.

It should be noted that the display control devices 1 and 1a described above re-identify the operating state of the operator in the range re-judgment cycle, and re-determine the operable range based on the specified operating state of the operator. In the description of the case, the display control devices 1 and 1a are connected to the image pickup device, and the operation state specifying unit 13 specifies the current operation state of the operator based on the captured image acquired from the image pickup device. However, this is just one example. For example, the display control devices 1 and 1a are connected to the array microphone, and the operation state specifying unit 13 acquires a voice signal based on the utterance from the array microphone via the acquisition unit 11, and based on the voice signal, The current operation state of the operator may be specified.

Further, the display control devices 1 and 1a described above re-identify the operation state of the operator in the range re-judgment cycle, and re-determine the operable range based on the specified operation state of the operator. In the explanation of the case, the operation state of the operator is the position of the operator, but this is only an example. For example, the operating state of the operator may be the posture of the operator.
In the display control devices 1 and 1a, the operation state specifying unit 13 specifies the current posture of the operator when the range re-determination cycle is reached, and determines whether or not there is a change in the posture of the operator. For example, the operation state specifying unit 13 acquires an image of the inside of the vehicle from an image pickup device as described above via the acquisition unit 11, and specifies the current posture of the operator based on the acquired image. To do.
When the operation state specifying unit 13 determines that the posture of the operator has changed, the operation

range determination units

141 and 141a operate the operator based on the current posture of the operator specified by the operation state specifying unit 13. Redetermine the possible range.

Further, for example, in the display control devices 1 and 1a, the re-determination of the operable range may be performed depending on whether or not the number of operators changes.
In the display control devices 1 and 1a, the operation state specifying unit 13 detects the operator and the current number of the operators when the range re-determination cycle is reached, and determines whether or not there is a change in the current number of operators. To do. For example, the operation state specifying unit 13 acquires an image of the inside of the vehicle from an image pickup device as described above via the acquisition unit 11, and based on the acquired image, the current operator and the operator. Detect the number of operators.
The operation

range determination units

141 and 141a may redetermine the operable range of the operator when the operation state specifying unit 13 determines that the number of operators has changed. When it is determined that the number of operators has changed, the operation state specifying unit 13 specifies the operation state of each of the detected one or more operators. The operation

range determination units

141 and 141a determine the operable range based on the operation state of each of one or more operators specified by the operation state identification unit 13. Since the specific operation in which the operation

range determination units

141 and 141a determine the operable range based on the operation state of one or more operators has already been explained, duplicate description will be omitted.
For example, in the range re-determination cycle, the range in the vehicle for the operation state specifying unit 13 to detect the number of operators (hereinafter referred to as “number of person specifying range”) is predetermined, and the operation state specifying unit 13 May detect the current number of operators in the number-specific range. The number-of-person identification range is, for example, a predetermined range centered on the position of the operator who has performed the remote control for designating the execution of the function in the captured image.

In this way, the display control devices 1 and 1a determine whether or not there is a change in the operating state, and redetermine the operable range based on the determination result of whether or not there is a change in the operating state. You may try to do it. Further, the display control devices 1 and 1a determine whether or not the number of operators has changed, and redetermine the operable range based on the determination result of whether or not the number of the operators has changed. May be carried out. As described above, in the display control devices 1, 1a, the operation

range determination units

141, 141a determine the operable range according to the current operation state of the operator specified by the operation state identification unit 13. It can be determined dynamically.
The display control devices 1 and 1a determine whether or not there is a change in the operating state, or determine whether or not there is a change in the number of operators, and re-determine the operable range based on the determination result. By doing so, the display control devices 1 and 1a cannot touch the operation target because the operation state changes after the operation target is once displayed in the operable range. It can be prevented from being lost.

11A and 11B are diagrams showing an example of the hardware configuration of the display control devices 1 and 1a according to the first and second embodiments.
In the first and second embodiments, the functions of the acquisition unit 11, the operation

target identification unit

12, 12a, the operation state identification unit 13, the

determination unit

14, 14a, and the

display control unit

15, 15a are It is realized by the processing circuit 1101. That is, the display control devices 1 and 1a are processing circuits that specify the operation target and control the display position of the specified operation target on the display device 2 when the remote control for specifying the execution of the function is performed. 1101 is provided.
The processing circuit 1101 may be dedicated hardware as shown in FIG. 11A, or may be a CPU (Central Processing Unit) 1105 that executes a program stored in the memory 1106 as shown in FIG. 11B.

When the processing circuit 1101 is dedicated hardware, the processing circuit 1101 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable). Gate Array) or a combination of these is applicable.

When the processing circuit 1101 is the CPU 1105, the functions of the acquisition unit 11, the operation

target identification unit

12, 12a, the operation state identification unit 13, the

determination unit

14, 14a, and the

display control unit

15, 15a are software and firmware. Or, it is realized by a combination of software and firmware. That is, the acquisition unit 11, the operation target

object identification unit

12, 12a, the operation state identification unit 13, the

determination unit

14, 14a, and the

display control unit

15, 15a are HDD (Hard Disk Drive) 1102, memory 1106, etc. It is realized by a processing circuit such as a CPU 1105 that executes a program stored in the above and a system LSI (Large-Scale Integration). Further, the programs stored in the HDD 1102, the memory 1106, etc. are the acquisition unit 11, the operation target

object identification unit

12, 12a, the operation state identification unit 13, the

determination unit

14, 14a, and the

display control unit

15, 15a. It can also be said to cause a computer to perform a procedure or method. Here, the memory 1106 is, for example, a RAM, a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), an EPROM (Electrically Emergency Memory), an EPROM (Electrically Emergency Memory), a volatile Optical, etc. A semiconductor memory, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD (Digital Versaille Disc), or the like is applicable.

Some of the functions of the acquisition unit 11, the operation

target identification unit

12, 12a, the operation state identification unit 13, the

determination unit

14, 14a, and the

display control unit

15, 15a are realized by dedicated hardware. However, a part may be realized by software or firmware. For example, the operation

target identification units

12 and 12a are realized by the processing circuit 1101 as dedicated hardware, and the acquisition unit 11, the operation state identification unit 13, the

determination units

14, 14a, and the display control unit are realized. The functions of 15 and 15a can be realized by the processing circuit 1101 reading and executing the program stored in the memory 1106.
Further, the display control devices 1 and 1a include a device such as a display device 2 or an input device, and an input interface device 1103 and an output interface device 1104 that perform wired communication or wireless communication.

In the above-described first and second embodiments, the display control devices 1 and 1a are in-vehicle devices mounted on the vehicle, and the acquisition unit 11, the operation target

object identification units

12, 12a, and the operation state identification unit 13 are used. The

determination units

14, 14a and the

display control units

15, 15a are assumed to be provided in the display control devices 1, 1a.
Not limited to this, a part of the acquisition unit 11, the operation target

object identification unit

12, 12a, the operation state identification unit 13, the

determination unit

14, 14a, and the

display control unit

15, 15a is mounted on the vehicle. An automatic driving control system may be configured by the in-vehicle device and the server, assuming that the in-vehicle device and the server are provided in the server connected to the in-vehicle device via a network. Specifically, for example, the operation

target identification units

12 and 12a may be provided in the server.

Further, in the above-described second embodiment, the response display information corresponding to the response display object may be generated in advance and stored in the storage unit. In this case, the display control unit 15a acquires the generated response display information and controls the display of the response display object so that the response display object is displayed at the display position determined by the display position determination unit 151a. In such a configuration, the display control device 1a does not have to include the response generation unit 152.

In the present invention, within the scope of the invention, it is possible to freely combine each embodiment, modify any component of each embodiment, or omit any component in each embodiment. ..

The display control device according to the present invention can be applied to a display control device that controls the display of a display object on a touch-operable display device.

1,1a Display control device, 2 Display device, 3 Input device, 11 Acquisition unit, 12, 12a Operation target identification unit, 121, 121a Initial display position identification unit, 13 Operation state identification unit, 14, 14a Judgment unit, 141 , 141a operation range determination unit, 15,15a display control unit, 151,151a display position determination unit, 152 response generation unit, 1101 processing circuit, 1102 HDD, 1103 input interface device, 1104 output interface device, 1105 CPU, 1106 memory.

Claims

An acquisition unit that acquires remote control information indicating that a function that can be executed via a touch-operable display device is specified by remote control,
Based on the remote control information acquired by the acquisition unit, the operation object identification unit that specifies the operation object to be touch-operated by the operator of the display device and the initial display position of the operation object, and the operation object identification unit.
An operation state specifying unit that specifies the operation state of the operator who performed remote control,
A display of the display device on which the operator can touch-operate the initial display position of the operation target specified by the operation target identification unit based on the operation state of the operator specified by the operation state specifying unit. On the screen, a judgment unit that determines whether or not it is within the operable range, and
When the determination unit determines that the initial display position of the operation target is not within the operable range, the operation on the display device so that the operation target is displayed within the operable range. A display control device equipped with a display control unit that controls the display of an object.
An icon for executing a function can be displayed on the display device, and the operation target object is a response display object displayed on the display device after the icon is operated. The display control device according to claim 1.
The display control device according to claim 1, wherein the remote control includes any one or more of voice operation, gesture, and remote control operation.
The operation state specifying unit identifies the position and posture of the operator who has performed remote control, and determines the position and posture of the operator.
The determination unit is characterized in that it determines whether or not the initial display position of the operation target is within the operable range based on the position and posture of the operator specified by the operation state specifying unit. The display control device according to claim 1.
The operation state specifying unit can identify a plurality of the operators, and when a plurality of the operators are specified, the operation state of each of the specified plurality of operators is specified.
Based on the operation state of the operator specified by the operation state specifying unit, the determination unit can be touch-operated by the operator for each operator, and can be operated by the operator on the display screen of the display device. The display control device according to claim 1, further comprising an operation range determination unit for determining the operable range based on the operator-unit operable range for each operator.
The operation range determination unit
The display control device according to claim 5, wherein a range in which a plurality of the operator-unit operable ranges overlap is defined as the operable range.
A step of acquiring remote control information indicating that a function that can be executed by the acquisition unit via a touch-operable display device is specified by remote control, and
A step in which the operation target identification unit specifies an operation target to be touch-operated by the operator of the display device based on the remote control information acquired by the acquisition unit, and also specifies the initial display position of the operation target. When,
A step in which the operation state specifying unit specifies the operation state of the operator who has performed remote control,
The operator can touch-operate the initial display position of the operation target specified by the operation target identification unit based on the operation state of the operator specified by the operation state identification unit. On the display screen of the display device, the step of determining whether or not it is within the operable range, and
When the display control unit determines that the initial display position of the operation target is not within the operable range, the display control unit displays the operation target within the operable range on the display device. A display control method comprising a step of controlling the display of the operation object.