JP6991187B2 - Equipment operation device, equipment operation method, and program - Google Patents

Description

The present invention relates to a device operating device, a device operating method, and a program.

An automobile input device for operating a device (power window, remote control mirror, wiper, fog lamp, etc.) mounted on an automobile on a touch panel screen of a navigation device has been proposed (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 11-334493

However, in the prior art, for example, when the headlights are turned on, when viewed from the outside of the vehicle, it is not possible to know how bright the headlights are set. As described above, in the conventional technique, the user cannot intuitively know the effect of the setting contents.

The present invention has been made in consideration of such circumstances, and an object of the present invention is to provide a device operating device, a device operating method, and a program in which a user can intuitively know the effect of a setting content. It is one of.

The device operating device, the device operating method, and the program according to the present invention have the following configurations.
(1): The device operating device according to one aspect of the present invention has an acquisition unit for acquiring environment expression information indicating an environment state and a determination unit for selecting an operation target associated with the acquired environment expression information. The article image data includes an environmental image data corresponding to the environmental expression information and an image generation unit for displaying the article image data of the article including the selected operation target, and the article image data is an image of the appearance of the article. It is data or image data in the article, and the image generation unit is a device operating device that selects image data of the appearance of the article or image data in the article based on the operation target .

(2): In the aspect of (1) above, the acquisition unit acquires the current environmental expression information of the article.

(3): In the embodiment (1) or (2) above, the image generation unit generates icon image data of the selected operation target, and the generated icon image data is associated with the operation target. It is to be placed in.

(4): In any one of the above (1) to (3), the environmental expression information is an expression based on at least one of the weather, time, terrain, and the number of people outside the article. ..

(5): In any one of the above (1) to (4), the acquisition unit acquires a change instruction for the operation target, and the image generation unit obtains a change instruction for the operation target based on the change instruction for the operation target. , The article image data is changed.

(6): In any one of the above (1) to (5), the image generation unit calculates the article image data and the article image data of the 3D image of the own vehicle from the polygon data, and performs shader processing. The environment image data is calculated by pasting a background texture on dome-shaped or cylindrical polygon data to switch the image data and using the HDR environment map method.

( 7 ): In any one of the above (1) to ( 6 ), the article is a vehicle, and the operation target is at least one of the headlight, the wiper, and the interior light included in the article. Is.

( 8 ): In the device operation method according to one aspect of the present invention, the environmental expression information indicating the state of the environment is acquired, the operation target associated with the acquired environmental expression information is selected, and the environmental expression information is described. The environmental image data corresponding to the above and the article image data of the article including the selected operation target are displayed, and the article image data is the image data of the appearance of the article or the image data in the article, and the said. It is a device operation method for selecting image data of the appearance of the article or image data in the article based on the operation target .

( 9 ): The program according to one aspect of the present invention causes a computer included in the device operating device to acquire environment expression information indicating the state of the environment, and selects an operation target associated with the acquired environment expression information. The environmental image data corresponding to the environmental expression information and the article image data of the article including the selected operation target are displayed, and the article image data is the image data of the appearance of the article or the inside of the article. It is an image data, and is a program for selecting image data of the appearance of the article or image data in the article based on the operation target .

In (1) to ( 9 ), the operation target associated with the acquired environmental expression information is selected, the surrounding environmental expression of the vehicle is expressed, and the operation set for the environmental expression and the operation target provided by the article. Was expressed in conjunction with. Thereby, according to (1) to ( 9 ), the user can intuitively know the effect of the setting content on the operation target.
In (2), in order to acquire the current environment expression status, it is possible to select an operation target according to this environment expression information.
In (3), since the icon image data of the selected operation target is arranged in association with the operation target, the user can know the operation target corresponding to the selected environment expression information and can set it. ..
In (4), the article image data is changed according to the change for the operation target. As a result, according to (4), the user can appropriately know the effect when the state of the operation target changes.
In (6), the image of the article and the background is reproduced more realistically. As a result, according to ( 6 ), the user can confirm the effect of setting the equipment of the article by the displayed image.
In (1), (8), or (9) , the article image data to be displayed is selected according to the operation target. Thereby, according to (1), (8) or (9) , the user can know the effect seen from the outside of the article or the inside of the article according to the operation target.

It is a block diagram which shows the structural example of the equipment operation apparatus which concerns on embodiment. It is a figure which shows the example of the information which the storage part which concerns on embodiment stores. It is a figure which shows the example of the calculation method of the vehicle image data and the background image data which concerns on embodiment. It is a figure which shows the example of the top menu screen which concerns on embodiment. It is a figure which shows the other example of the top menu screen which concerns on embodiment. It is a figure which shows the example of the image data displayed on the display part when dusk is selected as the environmental expression information which concerns on embodiment. It is a figure which shows the example of the image data displayed on the display part when rain is selected as the environmental expression information which concerns on embodiment. It is a figure which shows the other example of the image data which is displayed on the display part when rain is selected as the environmental expression information which concerns on embodiment. It is a figure which shows the example of the image data which is displayed on the display part when night and snow are selected as the environmental expression information which concerns on embodiment. It is a flowchart of the process performed by the equipment operation apparatus which concerns on embodiment.

Hereinafter, the device operating device, the device operating method, and the embodiment of the program of the present invention will be described with reference to the drawings.

<Configuration example of device operating device>
FIG. 1 is a block diagram showing a configuration example of the device operating device 1 according to the present embodiment. As shown in FIG. 1, the device operation device 1 includes an operation unit 11, a determination unit 12, a storage unit 13, an image generation unit 14, a display unit 15, an acquisition unit 16, and an output unit 17. The storage unit 13 includes a vehicle data storage unit 131 and a background data storage unit 132.

<Functions and operations of equipment operating devices>
Next, the functions and operations of the device operating device 1 will be described. The device operating device 1 is attached to the vehicle. The device operating device 1 may have, for example, a car navigation function. The device operating device 1 displays, for example, a 3D image of the own vehicle, selects the equipment to be operated according to the result of selecting the environment (weather, time, terrain, etc.), and displays the setting screen. The device operating device 1 generates an image of the own vehicle when the selected equipment is operating, generates a background image which is an environmental expression according to the selected equipment and the environment, and generates a background image and a background image. Display the image of the own vehicle when the generated equipment is operating. The device operating device 1 may be combined and displayed, for example, by superimposing an image of the own vehicle when the equipment is operating on the background image. In the following embodiment, an example of synthesizing and displaying will be described. The device operating device 1 may be a mobile terminal or the like capable of communicating with a vehicle control device (not shown) mounted on the vehicle. Further, the target on which the device operating device 1 is mounted is not limited to a moving body such as a vehicle, but may be an infrastructure-equipped device such as a security camera.

The operation unit 11 is, for example, a touch panel sensor provided on the display unit 15. The operation unit 11 detects the operation result operated by the user and outputs the detected operation result to the determination unit 12. The operation result includes environment expression information indicating the state of the environment, equipment setting information related to equipment setting, and the like. The environmental expression information is, for example, at least one of information on weather, information on time, information on temperature, information on the number of people around the vehicle, information on topography, and the like. The equipment setting information is, for example, information indicating the strength of the operation of the wiper when the equipment is a wiper, and information indicating the brightness of the light when the equipment is a headlight or an interior light, for example. The operation result includes equipment information indicating the type of equipment when the user selects equipment other than the equipment selected by the determination unit 12.

The determination unit 12 acquires the environment expression information and the equipment setting information output by the operation unit 11. The determination unit 12 selects the equipment to be operated by referring to the information stored in the storage unit 13 using the acquired environment expression information. The determination unit 12 outputs the environment expression information, the equipment information indicating the selected equipment, and the equipment setting information to the image generation unit 14. The determination unit 12 may set the environment expression information by using the position information, the time information, or the weather information acquired by the acquisition unit 16. Further, when the operation unit 11 outputs the setting information, the determination unit 12 outputs the acquired equipment information to the image generation unit 14.

The storage unit 13 stores the operation target in association with the environment expression information. The storage unit 13 stores the operation target of the own vehicle.

The vehicle data storage unit 131 stores the data of the own vehicle and the equipment provided in the own vehicle. The data of the own vehicle and the equipment provided in the own vehicle may be image data. These may be three-dimensional model data or rendered images, and may be CAD (Computer Aided Design).

The background data storage unit 132 stores the background data. The background data may be image data, or may be a texture, a feature amount, or the like used when generating a background image.

The image generation unit 14 acquires the environment expression information, the equipment information, and the equipment setting information output by the determination unit 12. The image generation unit 14 selects or calculates vehicle image data of a 3D image of the own vehicle by using the data of the own vehicle and the equipment provided in the own vehicle stored in the vehicle data storage unit 131. The image generation unit 14 selects or calculates the background image data according to the environment expression information based on the background data and the environment expression information stored in the background data storage unit 132. The vehicle image data and the background image data will be described later. The image generation unit 14 synthesizes the selected or calculated vehicle image data and the selected or calculated background image data, and causes the display unit 15 to display the combined image data. The image generation unit 14 outputs the set equipment setting information to the output unit 17. The equipment setting information includes information indicating the equipment to be operated and equipment setting information.

The display unit 15 is, for example, a liquid crystal display device, an organic EL (Electroluminescence) display device, or the like. The display unit 15 displays the image data generated by the image generation unit 14.

The acquisition unit 16 is, for example, a GPS (Global Positioning System) receiving unit, and acquires position information and time information based on the information received from the GPS. Further, the acquisition unit 16 acquires weather information regarding the weather in the area where the vehicle on which the device operating device 1 is mounted is traveling via the network. The acquisition unit 16 outputs the acquired position information, time information, and weather information to the determination unit 12.

The output unit 17 is connected to an ECU (Electronic Control Unit) (not shown) via, for example, CAN (Control Area Network). The output unit 17 outputs the equipment setting information output by the image generation unit 14 to the ECU via the CAN.

The ECU controls the equipment based on the equipment setting information acquired from the equipment operating device 1.

The components of the device operating device 1 are realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components are LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), GPU (Graphics Circuit), GPU (Graphics Circuit), etc. It may be realized by a circuit (including a circuit), or it may be realized by the cooperation of software and hardware. The program may be stored in advance in a storage device (a storage device including a non-transient storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or a removable storage such as a DVD or a CD-ROM. It is stored in a medium (non-transient storage medium) and may be installed by mounting the storage medium in a drive device.

<Example of information stored by the storage unit 13>
Next, an example of information stored by the storage unit 13 will be described. FIG. 2 is a diagram showing an example of information stored by the storage unit 13 according to the present embodiment. As shown in FIG. 2, the storage unit 13 stores the operation target in association with the environment expression information. The environmental expression information is, for example, information on the weather, time, temperature, the number of people around the vehicle, the terrain, and the like. For example, the headlight of the operation target is associated with the dusk of the environment target. In addition, the headlights and wipers to be operated are associated with the night and rain of the environmental expression information. As described above, the environmental expression information may be two or more. Further, the operation target may be two or more.

<Example of calculation method for vehicle image data and background image data>
Next, an example of a calculation method for vehicle image data and background image data will be described. FIG. 3 is a diagram showing an example of a calculation method for vehicle image data and background image data according to the present embodiment.

As shown by reference numeral g1, the image generation unit 14 calculates the vehicle image data of the 3D image of the own vehicle by using the data of the own vehicle and the equipment provided in the own vehicle stored in the vehicle data storage unit 131. Further, the image generation unit 14 may perform shading processing for expressing the metallicity of the image data of the own vehicle by using the technique of a physically-based Rendering shader, for example.

As shown by the reference numeral g2, the image generation unit 14 calculates the background image data based on the background data stored in the background data storage unit 132 and the information indicating the initial environment or the environment expression information. When calculating the background image data, the image generation unit 14 uses HDR (Hi) using the environment texture in addition to the method of pasting the background texture on the dome-shaped or cylindrical polygon data to switch the transition of the environment and the state. -Dynamix Range) The background image data may be calculated by using the method of the environment map.

As shown by reference numeral g3, the image generation unit 14 synthesizes the calculated vehicle image data and the calculated background image data.

In this embodiment, the vehicle image data of the 3D image of the own vehicle is calculated from the vehicle image data as polygon data, and the physical base shader processing is also performed. Further, in the present embodiment, the background image data is pasted on the dome-shaped or cylindrical polygon data with the background texture to switch the transition of the environment and the state, and the background image data is calculated by using the method of the HDR environment map. As a result, in the present embodiment, the surrounding environment (time, weather, season, terrain, etc.) of the vehicle is expressed by the graphic expression for the purpose of setting the vehicle function, and the environmental expression and the equipment provided in the vehicle are linked. I tried to express it.

Thereby, according to the present embodiment, the image of the vehicle and the background can be reproduced more realistically by CG (computer graphic). As a result, the user can confirm the effect of setting the equipment of the vehicle by the displayed image.

The method for calculating the vehicle image data and the background image data shown in FIG. 3 is an example, and the calculation method is not limited to this, and other image generation methods may be used for the calculation.

<Top menu screen example>
Next, an example of the top menu screen displayed on the display unit 15 will be described. FIG. 4 is a diagram showing an example of a top menu screen according to the present embodiment. Reference numeral g10 is an image example of the top menu screen. Reference numeral g101 is vehicle image data of the own vehicle on which the device operating device 1 is mounted. Reference numeral g102 is a selection button image for selecting "dusk" as environment expression information. Reference numeral g103 is a selection button image for selecting "night" as environment expression information. Reference numeral g104 is a selection button image for selecting "rain" as environmental expression information. Reference numeral g105 is a selection button image for selecting "snow" as environmental expression information. Reference numeral g106 is an explanatory image when the vehicle image data is rotated and displayed. Reference numeral g107 is background image data.

On the top menu screen of FIG. 4, when the user touches and selects, for example, the selection button image of the reference numeral g102, the determination unit 12 determines that "dusk" is selected as the environmental expression information. In the example shown in FIG. 4, as an example of the vehicle image data, an example of the state in which the own vehicle is viewed from the front is shown, but the image data may be from a direction in which the operation target can be selected, for example, diagonally. It may be in a state seen from the front.

FIG. 5 is a diagram showing another example of the top menu screen according to the present embodiment. Reference numeral g20 is another example of the image of the top menu screen. Reference numeral g201 is a selection button image when the environmental expression information is “dusk”. Reference numeral g202 is a selection button image when the environmental expression information is "rain". Reference numeral g203 is a selection button image when the environmental expression information is “night”. Reference numeral g204 is a selection button image when the environmental expression information is “snow”. As described above, the top menu screen may be a selection button image including icon image data representing environment expression information. As shown in FIG. 5, the vehicle image data may not be displayed on the top menu screen.

<Example of image data displayed on the display unit 15 when dusk is selected as environment expression information>
Next, an example of image data displayed on the display unit 15 when dusk is selected as the environment expression information will be described. FIG. 6 is a diagram showing an example of image data displayed on the display unit 15 when dusk is selected as the environmental expression information according to the present embodiment. Reference numeral g30 is image data displayed on the display unit 15 when dusk is selected as the environmental expression information. Reference numeral g301 represents a state in which "dusk" is selected as environmental expression information. The symbols g302 to g304 represent a state in which the tourist information is not selected. The selection button image of the selected environmental expression information, such as the reference numerals g301 to g304, is displayed so as to be different from the display of other environmental expression information.

Reference numeral g305 is an explanatory image when the vehicle image data is rotated and displayed.
Reference numeral g306 is vehicle image data. Reference numeral g307 is icon image data indicating that the headlight is an operation target. As shown in FIG. 6, in the present embodiment, the icon image data indicating the operation target is displayed at the position corresponding to the operation target in the vehicle image data. The icon image data may be at least one of illustrations, images, and texts according to the operation target.

Reference numeral g308 is an operation image for controlling the brightness of the headlight. The operation image includes an image g3081 for adjusting the brightness of the headlight and a button image g3082 selected at the time of determination.

Reference numeral g309 is an image in which the headlight is lit. The image g309 in the state where the headlight is lit changes according to the setting of the reference numeral g308.
Reference numeral g310 is background image data. The background image data g310 changes according to the change in the setting of the reference numeral g308. The image data is changed by the image generation unit 14.

Reference numeral g311 is an image of a selection button to be operated. This selection button image is selected when the determination unit 12 wants to operate equipment different from the operation target selected according to the environmental expression information. Reference numeral g312 is an image of options displayed when the selection button image to be operated is selected (touched).

The adjustment of the headlight may be such that the brightness is minimized when it is detected that the region corresponding to the minimum is touched, for example, in the reference numeral g3081. Alternatively, the headlight may be adjusted, for example, by sliding the image of a point between the minimum and the maximum in the reference numeral g3081. In the example shown in FIG. 6, the operation image for manipulating the brightness of the headlight includes the decision button image g3082, but the decision button image g3082 may not be present. In this case, the determination unit 12 may acquire the adjustment value when the image g3081 for adjusting the brightness of the headlight is touched or when the slider is slid.

In the example of FIG. 6, when the headlight is the operation target, the wiper and the interior light are not the operation target. Therefore, the image generation unit 14 expresses the state in which the wiper is not operating and the state in which the interior light is not lit in the vehicle image data.

Further, although an example of brightness adjustment has been described as the adjustment of the headlight described above, the present invention is not limited to this. To adjust the headlights, set the sensitivity to the auto light control (the function that automatically turns on the lights when the surroundings become dark), that is, set how dark the surroundings of the vehicle (environmental expression) should turn the headlights on. It may be an operation or the like. In this case, the image displayed on the display unit 15 is an auto light control setting screen. As described above, the image displayed on the display unit 15 may be a setting screen according to the setting target.

<Example of image data displayed on the display unit 15 when rain is selected as environmental expression information>
Next, an example of image data displayed on the display unit 15 when rain is selected as the environmental expression information will be described. FIG. 7 is a diagram showing an example of image data displayed on the display unit 15 when rain is selected as the environmental expression information according to the present embodiment. Reference numeral g40 is image data displayed on the display unit 15 when rain is selected as the environmental expression information. Reference numeral g403 represents a state in which "rain" is selected as environmental representation information. The reference numerals g401, g402, and g404 represent states that are not selected as environmental representation information. The selection button image of the selected environmental expression information, such as the reference numerals g401 to g404, is displayed so as to be different from the display of other environmental expression information.

Reference numeral g405 is an explanatory image when the vehicle image data is rotated and displayed.
Reference numeral g406 is vehicle image data. Reference numeral g407 is icon image data indicating that the wiper is an operation target. The icon image data indicating the operation target is displayed at a position corresponding to the operation target in the vehicle image data.

Reference numeral g408 is an operation image for manipulating the strength of the operation of the wiper. The operation image includes an image g4081 that adjusts the strength of the wiper operation, and a button image g4082 that is selected at the time of determination.

Reference numeral g409 is an image in which the wiper is operating. The image g409 in the state where the wiper is operating changes according to the change in the setting of the reference numeral g408.
Reference numeral g410 is background image data. The background image data g410 changes according to the change in the setting of the reference numeral g408. The image data is changed by the image generation unit 14.

Reference numeral g411 is an image of a selection button to be operated. This selection button image is selected when the determination unit 12 wants to operate equipment different from the operation target selected according to the environmental expression information. Reference numeral g412 is an image of options displayed when the selection button image to be operated is selected (touched).

Reference numeral g413 is background image data that can be seen from inside the vehicle, for example, from the driver's seat through the windshield. This image includes the image g409a of the wiper. The image g409a of the wiper changes according to the setting of the reference numeral g408. The image data is changed by the image generation unit 14.

The operation of the wiper may be adjusted to minimize the speed of operation when, for example, it is detected that the region corresponding to the minimum is touched in the reference numeral g4081. Alternatively, the wiper may be adjusted, for example, by sliding the image of a point between the minimum and the maximum at the reference numeral g4081. In the example shown in FIG. 7, the operation image for operating the operation of the wiper includes the determination button image g4082, but the determination button image g4082 may not be present. In this case, the determination unit 12 may acquire the adjustment value when the image g4071 for adjusting the strength of the operation of the wiper is touched or when the slider is slid.

Note that FIG. 7 shows an example in which the background image data g413 passed through the windshield is displayed in a separate frame, but the present invention is not limited to this. The image generation unit 14 may display the background image data g40a as shown in FIG. FIG. 8 is a diagram showing another example of image data displayed on the display unit 15 when rain is selected as the environmental expression information according to the present embodiment. In this case, the image generation unit 14 may display the reference numerals g401 to g404, g408, g409a, g411, g412 and the like in the background image data g40a as shown in FIG. Further, the image generation unit 14 may switch between the image display of FIG. 7 and the image display of FIG. 8 for display. In this way, by displaying the image seen from the inside of the vehicle as shown in FIG. 8, the user can see the scenery through the windshield according to the strength of the movement of the wiper in the environment (weather, time, number of people, etc.). You can check what it looks like according to the terrain, etc.).

As described above, in the present embodiment, the image outside the vehicle and the image outside the vehicle are displayed at the same time or switched to be displayed. Thereby, according to the present embodiment, the user can know the effect seen from the outside of the vehicle or the inside of the vehicle according to the operation target.

<Example of image data displayed on the display unit 15 when night and snow are selected as environmental expression information>
Next, an example of image data displayed on the display unit 15 when night and snow are selected as environmental expression information will be described. FIG. 9 is a diagram showing an example of image data displayed on the display unit 15 when night and snow are selected as the environmental expression information according to the present embodiment. Reference numeral g50 is image data displayed on the display unit 15 when night and snow are selected as environmental expression information. Reference numeral g502 represents a state in which "night" is selected as environmental representation information. Reference numeral g504 represents a state in which "snow" is selected as environmental expression information. Reference numerals g501 and g503 represent states that are not selected as environmental representation information. The selected environmental expression information selection button image, such as the reference numerals g501 to g504, is displayed so as to be different from the display of other environmental expression information.

Reference numeral g405 is an explanatory image when the vehicle image data is rotated and displayed.
Reference numeral g506 is vehicle image data. Reference numeral g507 is icon image data indicating that the wiper is an operation target. Reference numeral g508 is icon image data indicating that the headlight is an operation target.
Reference numeral g308 is an operation image for manipulating the brightness of the headlight as in FIG. Reference numeral g408 is an operation image for manipulating the strength of the wiper as in FIG. 7.

Reference numeral g509 is an image in which the headlight is lit. The image g509 in the state where the headlight is lit changes according to the change in the setting of the reference numeral g308. Reference numeral g510 is an image in which the wiper is operating. The image g510 in the state where the wiper is operating changes according to the setting of the reference numeral g408. Further, reference numeral g511 is background image data. The background image data g511 changes according to the setting of the reference numerals g308 and g408. The image data is changed by the image generation unit 14.

Reference numeral g511 is an image of a selection button to be operated. This selection button image is selected when the determination unit 12 wants to operate equipment different from the operation target selected according to the environmental expression information. Reference numeral g512 is an image of options displayed when the selection button image to be operated is selected (touched).

As shown in FIG. 9, the environmental expression information may be two or more. In such a case, as shown in FIG. 9, the image generation unit 14 displays the icon image data (g507, g508) and the operation image (g308, g408) corresponding to the environmental expression information. In addition, also in FIG. 9, the image generation unit 14 may display the background image data passed through the windshield in a separate frame as in FIG. Alternatively, the image generation unit 14 may switch between the image of FIG. 9 and the image (FIG. 8) in which the background image data passed through the windshield is displayed in a separate frame.

As shown in FIG. 9, when displaying a plurality of operation images (g308, g408), the image generation unit 14 blocks these operation images from an image (for example, g509) expressing the effect of the operation target. It is preferable to generate the display image data so that the display image data is arranged in a non-position.

As described with reference to FIGS. 6 to 9, in the present embodiment, the operation target associated with the environment expression information is selected according to the change of the environment expression, and the image data for adjusting the selected operation target is adjusted. And, the image data of the environment expression is displayed. Thereby, according to the present embodiment, the user can appropriately know the effect of the state in which the equipment corresponding to the environmental expression is operating. Further, in the present embodiment, the vehicle image data is changed according to the change for the operation target. Thereby, according to the present embodiment, the user can appropriately know the effect when the state of the operation target changes.

<Example of processing procedure performed by the device operating device 1>
Next, an example of the processing procedure performed by the device operating device 1 will be described. FIG. 10 is a flowchart of processing performed by the device operating device 1 according to the present embodiment.

The image generation unit 14 displays the top menu screen (for example, FIG. 4) on the display unit 15 (step S1). The determination unit 12 acquires the environment expression information based on the operation result output by the operation unit 11 (step S2).

The determination unit 12 selects an operation target associated with the environment expression information (step S3).

The image generation unit 14 selects vehicle image data from the information stored in the vehicle data storage unit 131, or calculates vehicle image data using the information stored in the vehicle data storage unit 131. Next, the image generation unit 14 generates icon image data of the operation target at a position corresponding to the operation target portion in the vehicle image data based on the operation target (step S4).

The image generation unit 14 selects background image data from the information stored in the background data storage unit 132 based on the selected environmental expression information, or calculates background image data using the information stored in the background data storage unit 132. (Step S5).

The image generation unit 14 synthesizes vehicle image data, background image data, and icon image data. The image generation unit 14 arranges the icon image data at a position associated with the equipment to be operated (step S6). The image generation unit 14 displays the generated image data on the display unit 15 (step S7).

The determination unit 12 determines whether or not there has been a change instruction (step S8). The change instruction is a change instruction for the environment expression information or a change instruction for the operation target. The change instruction for the environmental expression is, for example, one of dusk, night, night view, light rain, normal, downpour, light snow, and heavy snow. The change instruction for the investigation information is, for example, one of the strength of the operation of the wiper, the brightness of the headlight, and the brightness of the interior light. When the determination unit 12 determines that there is no change instruction (step S8; NO), the determination unit 12 proceeds to the process of step S11.

When the image generation unit 14 determines that the change instruction has been given (step S8; YES), the image generation unit 14 changes the background image data or the vehicle image data based on the change instruction. For example, when the change instruction is an instruction to change the strength of the wiper from the minimum to the middle, the image generation unit 14 changes the vehicle image data so that the movement of the wiper image becomes faster (step S9).

The image generation unit 14 changes the background image data based on the change instruction. For example, when the change instruction is an instruction to change the strength of the wiper from the minimum to the middle, the image generation unit 14 changes the background image data in the background image data according to the movement of the wiper image (step S10).

The image generation unit 14 determines whether or not the decision button image (for example, g3082 in FIG. 6) is pressed (selected) (step S11). When the image generation unit 14 determines that the decision button image has not been pressed (step S11; NO), the image generation unit 14 returns to the process of step S8.

When the image generation unit 14 determines that the decision button image has been pressed (step S11; YES), the image generation unit 14 outputs the set equipment setting information to the output unit 17. Next, the output unit 17 outputs the equipment setting information to the ECU via the CAN (step S12). The ECU controls the equipment based on the equipment setting information acquired from the equipment operating device 1.

The image generation unit 14 may change the vehicle image data and the background image data at least one of them. Further, the image generation unit 14 may determine in step S8 that the setting has been determined when there is no change instruction for a predetermined time, and proceed to the process of step S12.

As described above, in the present embodiment, the surrounding environment (time, weather, season, terrain, etc.) of the vehicle is expressed by the graphic expression for the purpose of setting the vehicle function, and the environmental expression and the equipment provided in the vehicle are linked. I tried to express it. Thereby, according to the present embodiment, the user can know the effect when the equipment of the vehicle is set.

Although the embodiments for carrying out the present invention have been described above using the embodiments, the present invention is not limited to these embodiments, and various modifications and substitutions are made without departing from the gist of the present invention. Can be added.

1 ... Equipment operating device,
11 ... Operation unit,
12 ... Judgment unit,
13 ... Memory,
14 ... Image generator,
15 ... Display section,
16 ... Acquisition department,
17 ... Output section,
131 ... Vehicle data storage unit,
132 ... Background data storage unit

Claims (9)

An acquisition unit that acquires environmental expression information that indicates the state of the environment,
A determination unit that selects an operation target associated with the acquired environment expression information, and a determination unit.
An image generation unit that displays environmental image data corresponding to the environmental expression information and article image data of an article having the selected operation target.
Equipped with
The article image data is image data of the appearance of the article or image data in the article.
The image generation unit is a device operating device that selects image data of the appearance of the article or image data in the article based on the operation target . The acquisition unit
Acquires the current environmental representation information of the article,
The device operating device according to claim 1. The image generation unit
The selected icon image data of the operation target is generated, and the generated icon image data is placed at a position associated with the operation target.
The device operating device according to claim 1 or 2. The environmental expression information is
An expression based on at least one of weather, time, terrain, and the number of people outside the article.
The device operating device according to any one of claims 1 to 3. The acquisition unit
Obtain the change instruction for the operation target and
The image generation unit
The article image data is changed based on the change instruction for the operation target.
The device operating device according to any one of claims 1 to 4. The image generation unit
For the article image data, the article image data of the 3D image of the own vehicle is calculated from the polygon data, and the shader processing is performed.
The environmental image data is calculated by pasting a background texture on dome-shaped or cylindrical polygon data, switching the image data, and using the HDR environment map method.
The device operating device according to any one of claims 1 to 5. The article is a vehicle
The operation target is
At least one of the headlights, wipers, and interior lights included in the article.
The device operating device according to any one of claims 1 to 6 . Acquires environmental expression information indicating the state of the environment,
Select the operation target associated with the acquired environment expression information, and select
The environmental image data corresponding to the environmental expression information and the article image data of the article including the selected operation target are displayed .
The article image data is image data of the appearance of the article or image data in the article.
Image data of the appearance of the article or image data in the article is selected based on the operation target.
Device operation method. For computers equipped with equipment operating devices
Acquires environmental expression information indicating the state of the environment
The operation target associated with the acquired environment expression information is selected, and the operation target is selected.
The environmental image data corresponding to the environmental expression information and the article image data of the article including the selected operation target are displayed .
The article image data is image data of the appearance of the article or image data in the article.
Image data of the appearance of the article or image data in the article is selected based on the operation target.
program.

Images