JP2019139805A - Display device, display method, and program - Google Patents

Abstract

To provide an image processing device for preventing selection forgetting and selection error of an operation of an image for an operation.SOLUTION: An image processing device includes: a display part; an operation part which accepts an operation from an operator through an image for an operation displayed on the display part; an image processing part which displays a predetermined image for display or another image for an operation on the display part on the basis of an operation of the image for an operation; a storage part which holds the image for an operation and the image for display; and a control part which controls the display part, the operation part, the image processing part, and the storage part. When an operation of the image for an operation satisfies a predetermined operation condition, the control part displays the image for display indicating that the operation is valid in place of the image for an operation on the image processing part, for a predetermined period of time and then, displays the image for an operation indicating that the operation is established.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a display device and the like.

  An image processing apparatus having a GUI (Graphical User Interface) using a touch panel is installed indoors and used, for example, an ATM (automated teller machine) such as a bank or a post office, or an automatic ticket sale such as a station premises. And multifunctional terminals at convenience stores. On the other hand, examples of devices used outdoors include portable devices such as portable terminals such as smartphones, portable music players, portable game machines, and digital cameras. In recent years, for example, refueling order machines installed in self-service gas stations, information boards for commercial facilities, digital signage (digital signage), and other outdoor-installed image processing devices that have a touch panel function are also frequently seen. It is getting to be.

  By the way, in an image processing apparatus having these touch panel functions, a button image as an operation image to be operated by an operator (operator) is different from a physical push button having unevenness, and is a plane displayed on a display. Since this is a typical image, there is a problem that the unevenness of the button image cannot be recognized by the tactile sense of the operator. Therefore, conventionally, when the operator presses the button image with a finger, as shown in the example of FIG. 8, the button image is changed or the operation of the button image is effective by producing a sound. I was informed.

FIG. 8 is an explanatory diagram showing an image processing method when button image operation of a conventional image processing apparatus is validated.
In FIG. 8A, when the button image shaded in a convex shape is displayed as an initial image and the operator touches (presses) the button image with a finger, FIG. As shown in (B), the button image is changed to a “no x” button image shaded in a concave shape. Subsequently, in the state shown in FIG. 8B, when the operator releases (releases) the finger from the button image, as shown in FIG. The button image is changed to "No".
In this way, shadowing the uneven shape represents the three-dimensional effect of the button image, and the operator can recognize whether or not the operation has become effective by recognizing the change of the button image shadowed to the uneven shape. Can know.

As another image processing method, in FIG. 8D, in the state where the button image shaded in a convex shape is displayed as the initial image, the operator taps the button image with a finger. When the button is pressed (released immediately after being pressed), as shown in FIG. 8E, the button image is changed to another “Yes” button image shaded in a convex shape.
In this way, in addition to expressing the three-dimensional effect of the button image by shading the uneven shape, the operator can recognize the change to another button image different from the button image in the initial state, and the operation is effective. You can know whether or not.
In addition to the above image processing method, an operation sound such as a buzzer may be emitted. When such an operation sound is adopted, when the button image is activated by being pressed, the operation sound is generated simultaneously with the replacement of the initial image with the button image indicating that the button image has been activated. By sounding the operation sound in this way, the operator can know that the operation has become effective not only by the change of the button image but also by the operation sound.

  On the other hand, as another image processing method, for example, when a display on which two (first and second) touch panels are touched is touched, the display can be switched according to the state in which the two touch panels detect touch. The display in the state where the first touch panel is touched and the display in the state where the second touch panel is touched are made different so that the display contents such as the displayed operation buttons can be easily recognized and operated. A display device with a touch panel and a display method capable of enhancing the performance are known (see, for example, Patent Document 1).

JP 2003-5912

By the way, in the image processing method shown in FIGS. 8A to 8C, the operator determines whether or not the button image has become valid from the difference in shading that represents the unevenness of the button image. Depending on the situation, it may not be easy to determine whether or not the operation is valid. In particular, when an image processing apparatus having a touch panel function is widely used outdoors, such a problem is more noticeable. For example, when an image processing device is installed in a bright outdoor place, such as a gas station refueling order machine, it is easy to distinguish the change from the shadow of the button image depending on the light reflection of the display. However, there is a problem that it is difficult to determine whether the operation is valid.
Similarly, in the image processing method shown in FIGS. 8D and 8E, it may be difficult to determine whether or not the button has been switched to another button image due to the influence of light reflection of the display in the outdoor environment. is there.
In the case of a method of notifying that the button image operation is effective by an operation sound, it may be difficult to hear an operation sound such as a touch sound when used in an environment with a high ambient noise such as a gas station. On the other hand, even when used in a quiet environment, problems may arise when it is prohibited to sound an operation sound or when it is desired to use a portable device in a manner state.

  On the other hand, an image processing method using an image processing apparatus having a display on which two touch panels are overlaid uses an image processing apparatus having two touch panels, so that a conventional image processing apparatus having one touch panel is used as it is. Since it cannot be used and a new image processing apparatus is required, there is a problem that costs increase.

  In view of such circumstances, there has been a demand for a display device or the like that allows an operator to easily determine whether or not an operation is effective even when operating an operation image in a bright place such as outdoors.

In view of the above-described problems, the display device of the present invention is
An operation image display unit for displaying an operation image;
A reception unit that receives an operation input for the operation image;
An input reception image display unit for displaying an input reception image indicating that an operation input by the reception unit has been received;
An input confirmed image display unit for displaying an input confirmed image indicating that the operation input is confirmed;
It is characterized by having.

The display method of the present invention includes:
An operation image display step for displaying the operation image;
A reception step of receiving an operation input for the operation image; an input reception image display step of displaying an input reception image indicating that the operation input by the reception step has been received;
An input confirmation image display step for displaying an input confirmation image indicating that the operation input has been confirmed;
It is characterized by including.

The program of the present invention
On the computer,
An operation image display function for displaying an operation image;
A reception function for receiving an operation input for the operation image;
An input reception image display function for displaying an input reception image indicating that an operation input by the reception function has been received;
An input confirmed image display function for displaying an input confirmed image indicating that the operation input is confirmed;
It is characterized by realizing.

  According to the present invention, when the operation condition of the operation image is satisfied, the predetermined display image is displayed for a predetermined time before the operation image is changed. It is possible for the operator to easily determine whether or not an operation image is operated in a bright place such as outdoors. .

1 is a block diagram illustrating a schematic configuration of an image processing apparatus according to a first embodiment of the present invention. It is explanatory drawing of the control data of the button image stored in the memory | storage part shown in FIG. It is a flowchart which shows the effective display process of button image operation of the display part of the image processing apparatus which concerns on 1st Embodiment of this invention. 4 is a flowchart showing details of button image operation processing of the display unit of the image processing apparatus shown in FIG. 3. It is explanatory drawing which shows the specific example of an effective display process when button image operation of the image processing apparatus shown in FIG. 1 becomes effective. It is explanatory drawing which shows the effective display process of button image operation of the display part of the image processing apparatus which concerns on 1st Embodiment of this invention. It is explanatory drawing which shows the modification of the effective display process shown in FIG. It is explanatory drawing which shows the image processing method when the button image operation of the conventional image processing apparatus becomes effective.

  The present invention relates to a display unit, an operation unit that receives an operation from an operator through the operation image displayed on the display unit, a display image that is predetermined based on the operation of the operation image, or the other operation. An image processing unit that displays a display image on the display unit, a storage unit that holds the operation image and the display image, and a control that controls the display unit, the operation unit, the image processing unit, and the storage unit The control unit determines the display image indicating that the operation is effective instead of the operation image when the operation of the operation image satisfies a predetermined operation condition. The image processing apparatus is characterized by displaying the operation image indicating that the operation is confirmed after being displayed on the image processing unit for a predetermined time.

The “operation image” is an image for an operator to operate through an image displayed on the display unit, for example, an icon image displayed on a touch panel.
“Operation” is an operation through an operation image displayed on the display unit, for example, when the operation image is a button image, an operation in which the operator touches (presses) the button image with a fingertip or taps ( Press and release).
The “image processing apparatus” is an apparatus such as an information processing apparatus having a GUI, a portable terminal, or a vending / service machine, and may be either a portable type or a stationary type. Further, in the case of the installation type, the apparatus is not limited to an apparatus installed outdoors, and may be an apparatus installed indoors.

  In the image processing apparatus of the present invention, the control unit indicates that the operation is effective instead of the operation image when the operation of the first operation image satisfies a predetermined operation condition. After the first display image is displayed on the image processing unit for a predetermined time, the second operation image indicating that the operation is confirmed is displayed, and the second operation image is displayed. When the operation satisfies a predetermined operation condition, the second image for display indicating that the operation is valid is displayed on the image processing unit for a predetermined time instead of the operation image. Thereafter, the first operation image indicating that the operation is confirmed may be displayed, and the first and second display images may be different from each other.

  In this way, since the display image for displaying which operation image is valid when selecting the operation image is different, the operation of the first operation image and the second operation image is different. Because it is easy for the operator to determine which operation is enabled, even if the operation image is operated multiple times in a bright place such as outdoors, it is possible to prevent forgetting to select an operation or making an incorrect selection. be able to.

  In the image processing apparatus according to the present invention, the display section displays at least two operation images, and the operation section selectively selects one operation image from the operation images. The control unit indicates that the operation is effective instead of the selected operation image when the operation of the selected one operation image satisfies a predetermined operation condition. After the display image is displayed on the image processing unit for a predetermined time, the operation image indicating that the operation is confirmed is displayed and selected in place of the other operation images that have not been selected. The operation image indicating that the operation has not been performed may be displayed.

  In this way, even when one operation image is selected from at least two operation images, a display image indicating that the operation is effective only for one operation image selected by the operator is displayed. On the other hand, an operation image in a non-selected state is displayed instead of the operation image that has not been selected, so that selection errors can be prevented.

  Furthermore, in the image processing apparatus according to the present invention, the display image indicating that the operation of the operation image is effective is a check mark image, an image obtained by enlarging or reducing the operation image, or an image of the operation image. It may have at least one of the images whose colors have been changed.

In this way, when the operation image is operated in a bright place such as outdoors, the display image indicating that the operation is effective is a check mark image or an image obtained by changing the color of the operation image. In addition, it is possible for the operator to easily determine whether or not the operation is valid, and it is possible to prevent forgetting to select the operation image operation and selection error.
In addition, when the operation image displayed on the display unit of the downsized image processing apparatus is operated by making the operation image an enlarged or reduced image, the operation image is hidden behind a finger and cannot be seen. Even so, the operator can easily determine whether or not the operation has become effective, and it is possible to prevent forgetting to select an operation for the operation image or a selection error.

  Further, in the display image indicating that the operation is effective, the contrast between the brightness value, the saturation difference, and the hue difference of the color between the operation images displayed before and after is strengthened so that the image can be viewed outdoors. It becomes possible to improve the nature. In addition, visibility may be improved by applying a dynamic change such as blinking a display image.

  Furthermore, in the image processing apparatus of the present invention, the operation image is a button image operated by contact with an indicator, and the control unit detects contact of the indicator with the button image. Alternatively, a predetermined operation condition may be satisfied when the detachment of the indicator from the button image is detected after the contact.

  In this way, when the button image is pressed and enabled, even when operating the button image in a bright place such as outdoors, the operator can easily determine whether the operation is enabled, It is possible to prevent forgetting operations due to insufficient pressing of button images and selection errors of button images displayed close to each other.

The “indicator” is a pointer for instructing (selecting) and operating an operation image to be operated by the operator, such as the fingertip of the operator or the pen tip of a touch pen.
“Contact” means that the indicator is within a predetermined distance from the display surface even when the indicator is not in physical contact with the display surface displaying the operation image. It may indicate a state.
“Leaving” means “contact” with the display surface as a result of the indicator moving in a direction away from the display surface from the state of “contact” with the display surface in the region of the operation image displayed on the display surface. It is a change that does not happen. On the other hand, as a case that does not correspond to “detachment”, for example, there is a case where the indicator slides on the display surface and moves out of the region of the operation image while the indicator is “contacting”.

  Furthermore, in the image processing apparatus according to the present invention, the operation image is a button image operated by contact with an indicator, and the control unit, after the indicator touches the button image, When the button goes out of the area of the button image while maintaining contact with the display unit, a predetermined operation condition may not be satisfied.

  In this way, after the operator's finger touches the button image, leaving the button image as an effective condition for the button image operation, the button image region remains in contact with the button image. Even if an unauthorized operation such as a finger sliding outside the screen occurs, the button returns to the initial state. It becomes possible to prevent selection mistakes due to selection of.

[First Embodiment]
<Configuration of image processing apparatus>
First, the configuration of the image processing apparatus 100 according to the first embodiment of the present invention will be described with reference to FIG.
FIG. 1 is a block diagram showing a schematic configuration of an image processing apparatus 100 according to the first embodiment of the present invention.

  As shown in FIG. 1, an image processing apparatus 100 according to the present invention includes a control unit 10 that supervises the control of each unit of the image processing apparatus 100, and a display unit for rendering a GUI such as an icon image for operation to the operator. 11, a storage unit 12 that stores operation icon image data and the like, and an operation unit 13 for performing an input operation from a GUI such as an operation icon image. In addition, as an option 101, the image processing apparatus 100 informs the operator that the operation has become effective by sounding a sound having a predetermined frequency for a predetermined time when the operation of the operator becomes effective. The sound reproduction unit 14, the vibration unit 15 that informs the operator that the operation has become effective by generating vibration (vibration) for a predetermined time when the operation becomes valid, and the operation result externally The communication part 16 for transmitting to can also be provided.

  In the first embodiment, the “image processing unit” of the present invention is realized by the control unit 10.

Hereinafter, each component shown in FIG. 1 will be described.
The control unit 10 is a circuit mainly composed of a microprocessor, and is an arithmetic device that performs control processing of various devices, processing of an operating system, application software, and the like. In addition, the peripheral circuit may include an ASIC (Application Specific Integrated Circuit) that is an integrated circuit designed and manufactured for a specific application, and a circuit having other arithmetic functions.

  The display unit 11 includes, for example, a CRT display, a liquid crystal display, an EL display, and the like, and is a display device such as a monitor or a line display for displaying electronic data such as a processing state by an operating system or application software. The display surface of these displays is covered with a touch panel, and the position of the operator's fingertip or the like that has touched the display unit 11 is detected to perform the touch panel operation. The position detection method includes a resistive film method that detects voltage, a capacitance method that detects changes in capacitance, an optical method that detects by blocking infrared light, an ultrasonic method that detects ultrasonic waves, and an electronic pen. Any method such as an electromagnetic induction method using as a pointer may be used. Further, a method in which the position of a fingertip or the like can be detected without contact using infrared rays or the like may be used.

The storage unit 12 stores control programs for various devices, operating systems, programs and data such as application software, non-volatile storage devices such as hard disks and flash memories, control processing for various devices, operating systems, application software, etc. This is a storage device such as a main storage device in which the programs and data are stored.
The operation unit 13 controls the operator's input operation such as an application processing instruction and information input by operating an electronic icon on the operating system and application software, and other physical button image operations. It is a device that tells.

The audio reproducing unit 14 is a speaker that notifies the operator by making a buzzer sound or the like.
The vibration unit 15 is a vibration device such as a vibration motor that generates vibration (vibration) and notifies the operator.
The communication unit 16 is a device for wirelessly communicating with an external network system. As a wireless communication standard, for example, a standard such as W-CDMA or CDMA2000 conforming to the IMT-2000 standard, or IEEE802.11a, IEEE802.11b, IEEE802.11g, or IEEE802.11n, which are wireless LAN standards. Examples include standards.

  In the first embodiment, an operation button image is described as an example of the operation image, but the same applies to other icon images.

<Data structure of storage unit>
Next, the configuration of the button image control data stored in the storage unit of FIG. 1 will be described with reference to FIG.
FIG. 2 is an explanatory diagram of button image control data stored in the storage unit 12 shown in FIG. 1.

As shown in FIG. 2, the control data of the button image according to the first embodiment is roughly divided into “basic”, “display”, “sound”, “vibration”, “sound attribute”, and “vibration attribute”. ”, But may have other sections.
Hereinafter, details will be described for each section.

“Basic” includes four items of “display position”, “button image rectangular size”, “button image operation effective condition”, and “effective display type”, but may have other items.
The “display position” is composed of two types of data “X direction” and “Y direction”, and each data length is 2 bytes. The unit is expressed in pixels.
The “button image rectangular size” is composed of two types of data of “horizontal length” and “vertical length” of the button image, and each data length is 2 bytes. The unit is expressed in pixels. If the button image is not rectangular, a size corresponding to the shape is defined. For example, the size of a circular button image is defined by its radius.
The “button image operation valid condition” defines a reference time when the button image operation is valid. In the example shown in the table of FIG. 2, it is composed of two types of data, “time when released: 0” and “time when pressed: 1”, and the data length is 1 bit. In the setting of the effective condition, by selecting 0 or 1, the reference time when the button image operation is effective is the time when the indicator (such as the fingertip of the operator) is released from the button image, or the button image It is determined whether the point in time is pressed.
“Effective display type” consists of four or more types of data, “standard display: 0”, “enlarged display: 1”, “reverse display: 2”, “other: 3”, and the data length is 1 byte. is there.
By selecting any of 0 to 3 in the setting of the effective display type, the effective display becomes a standard display, an enlarged (zoom-up) display, a reverse display, or other display. It will be decided.

When a check mark image is registered as a standard display image, the check mark image is displayed when the button image operation is enabled by setting the effective display type to 0. As the standard display image, for example, an effective image 201 with a check mark shown in FIG.
Further, as an enlarged display image, for example, as shown in FIG. 5B, an enlarged image 202 in which a button image in an initial state is enlarged (zoomed up) with reference to the center position of the button image can be cited.
Further, as an inverted display image, for example, as shown in FIG. 5C, an inverted image 203 in which the color of the button image in the initial state is inverted and displayed.
Moreover, as another display image, the decoration display image etc. which can raise an operator's vision are mentioned, for example.

“Display” is composed of four items, “initial”, “valid”, “confirmed”, and “operation error”, but may have other items.
“Initial” is “display image data” in an initial state, and the data length is the size of the rectangular size of the button image. Further, it is displayed in an image data format such as a bitmap (BMP) image.
The “valid” is composed of two types of data, “display image data” when valid and “display time (ms)”. The data length of the display image data is the rectangular size of the button image, and the data length of the display time is 2 bytes. The “display image data” is displayed in an image data format such as a bitmap image. When the display time (ms) is set to 0 (ms), it is assumed that “display image data” is not displayed when it is valid.
“At the time of determination” is “display image data” at the time of determination, and the data length is the same as the rectangular size of the button image. Further, it is displayed in an image data format such as a bitmap image.
The “operation error” is composed of two types of data, “display image data” at the time of the operation error and “display time (ms)”. The data length of the display image data is the rectangular size of the button image, and the data length of the display time is 2 bytes. The “display image data” is displayed in an image data format such as a bitmap image. When the display time (ms) is set to 0 (ms), it is assumed that “display image data” is not displayed when it is valid.

“Voice” consists of two items, “at the time of confirmation” and “at the time of operation error”, but may have other items.
The data length of “playback time (ms)” for “when confirmed” and “operation error” is 2 bytes, and when the playback time is set to 0 (ms), the playback sound is not played back. To do.

“Vibration” consists of two items, “at the time of confirmation” and “at the time of operation error”.
The data length of “vibration time (ms)” for “when confirmed” and “when an operation error occurs” is 2 bytes. When the vibration time is set to 0 (ms), no vibration occurs.

The “speech attribute” is composed of three items “sound”, “sound file”, and “BEEP sound”, but may have other items.
“Voice” is composed of two types of data, “Voice: 0” and “BEEP sound: 1”, and the data length is 1 bit. At the time of setting, by selecting either 0 or 1, it is determined whether to notify by voice or BEEP sound. In addition, you may set so that both a sound and a BEEP sound can be selected like "Combination of a sound and a BEEP sound: 2".
The “voice file” is “voice data”, and its data length is 16 bytes. The “audio file” is displayed in an audio data format such as WAV.
The “BEEP sound” is composed of two types of data of “frequency (Hz)” and “duration (ms)”, and the data length is 2 bytes. When the display time (ms) is set to 0 (ms), the BEEP sound is not displayed.

The “vibration attribute” has an item of “vibration strength”, but may have other items.
“Vibration strength” sets the strength of vibration. In the case of vibration due to the rotation of the vibration motor, the strength thereof is determined by the data of “rotation speed (rpm)”. The data length is 1 byte.

<Effective display processing for button image operations>
Next, the effective display process of the button image operation of the display unit 11 of the image processing apparatus 100 according to the first embodiment of the present invention will be described based on FIG.
FIG. 3 is a flowchart showing an effective display process of button image operation of the display unit 11 of the image processing apparatus 100 according to the first embodiment of the present invention.

  First, in step S101, the control unit 10 pre-registers button image control data (FIG. 2) in the storage unit 12 (step S101). The button image control data may be registered as data common to all button images or may be registered for each button image. However, when registered for each button image, the effective display operation is changed for each button image. Can do.

  Next, in step S102, after registering the control data of the button image, the control unit 10 activates an application that performs a target process (step S102). The control unit 10 causes the activated application to execute processing for displaying data and an input screen on the display unit 11 for a user interface (User Interface) with the operator.

  Here, the “UI input operation” refers to the general input operation by the operator regardless of the CUI (Character User Interface) using a character string as an operation target or the GUI using a visual element other than the character string. Shall point to.

  Subsequently, in step S103, the control unit 10 executes image display processing (step S103). As the image display processing, for example, when a button image is arranged on the screen of the display, the control unit 10 uses the button image control data (FIG. 2) registered in the storage unit 12 to display the button image in the initial state. The display position, the rectangular size, and the display image are acquired, and the initial image of the button image is displayed on the display unit 11. This corresponds to a state in which the installation designation screen of the car wash machine system is displayed on the display unit 11 in FIG.

Next, in step S104, the control unit 10 stands by until there is an input operation (UI input operation) from the operator (step S104).
In step S104, when there is a UI input operation from the operator through the operation unit 13, the control unit 10 proceeds to step S105.

In step S105, the control unit 10 determines whether or not the UI input operation corresponds to a button image operation process (step S105).
In step S105, when the UI input operation is a button image operation (when the determination in step S105 is Yes), the control unit 10 proceeds to step S106 and executes button image operation processing (step S106). Details of the button image operation processing will be described later in the description of FIG.
On the other hand, when the UI input operation is not a button image operation in Step S105 (when the determination in Step S105 is No), the control unit 10 proceeds to Step S107.
Examples of UI input operations other than button image operations include text, list, scroll input, and the like.

Next, in step S107, the control unit 10 determines whether or not the UI input operation corresponds to a screen switching operation (step S107).
In step S107, when the UI input operation is a screen switching operation (when the determination in step S107 is Yes), the control unit 10 returns to step S103 and executes image display processing (step S103).
On the other hand, when the UI input operation is not a screen switching operation in step S107 (when the determination in step S107 is No), the control unit 10 proceeds to step S108.

Finally, in step S108, when the UI input operation is a process end operation (when the determination in step S108 is Yes), the control unit 10 ends the processing application.
On the other hand, when the UI input operation is not a process end operation in Step S108 (when the determination in Step S108 is No), the control unit 10 returns to Step S104 and waits until there is another UI input operation from the operator. (Step S104).

<Button image operation processing>
Next, a button image operation process of the display unit 11 of the image processing apparatus 100 according to the first embodiment of the present invention will be described with reference to FIG.
FIG. 4 is a flowchart showing details of the button image operation processing of the display unit 11 of the image processing apparatus 100 shown in FIG. FIG. 5 is an explanatory diagram illustrating a specific example of the effective display process when the button image operation of the image processing apparatus 100 illustrated in FIG. 1 is enabled. FIG. 6 is an explanatory diagram showing an effective display process of button image operation of the display unit 11 of the image processing apparatus 100 according to the first embodiment of the present invention.

First, in step S201, the control unit 10 refers to the button image operation valid condition (FIG. 2) in the control data of the button image, and whether the button image operation valid condition is set to the time when the button image is pressed. It is determined whether or not (step S201).
In step S201, when the button image operation valid condition is set when the button image is pressed (when the determination in step S201 is Yes), the control unit 10 proceeds to step S202.
On the other hand, in step S201, when the button image operation valid condition is not set when the button image is pressed (when the determination in step S201 is No), the control unit 10 proceeds to step S206.

  Next, in step S202, the control unit 10 acquires the display type, display image data, and display time (FIG. 2) at the time of registration registered in the control data of the button image from the storage unit 12, and during the display time The effective image display of the button image is displayed on the display unit 11 (step S202).

  Examples of the effective image display include an effective image 201 or 302 with a check mark as shown in FIG. 5 (A) or FIG. 6 (B). These examples are examples in which the effective display type of the control data of the button image is set to the standard display type. However, as shown in FIGS. 5B and 5C, the center position of the button image is used as a reference. Even if the enlarged image 202 displayed in an enlarged manner, the inverted image 203 obtained by inverting the color of the button image in the initial state, or a decoration display image that can enhance the visual perception of the operator, may be displayed on the display unit 11. Good.

  In subsequent step S203, the control unit 10 obtains display image data (FIG. 2) at the time of confirmation from the control data of the button image from the storage unit 12, and the display unit 11 displays the original button image at the position where the original button image was displayed. A display image at the time of confirmation is displayed (step S203).

Subsequently, in step S204, the control unit 10 acquires, from the storage unit 12, the reproduction time of the sound at the time of confirmation and the sound attribute (FIG. 2) from the control data of the button image in order to reproduce the sound indicating the button confirmation. During the reproduction time, the audio reproduction unit 14 reproduces the audio data (step S204). Thereafter, the control unit 10 proceeds to step S205. When the reproduction time is set to 0 (ms), the control unit 10 proceeds to step S205 without causing the audio reproduction unit 14 to reproduce the audio data.
In addition, the control unit 10 acquires the vibration time of the vibration at the time of determination and the vibration attribute (FIG. 2) from the storage unit 12 or generates the vibration time from the vibration unit 15 in order to generate vibration instead of sound. The vibrating unit 15 may be vibrated. In this case, when the vibration time is set to 0 (ms), the control unit 10 proceeds to step S205 without causing the vibration unit 15 to vibrate.

  Here, as an example of the display image at the time of confirmation, for example, a confirmed image 303 in FIG.

  Finally, in step S205, the control unit 10 executes application processing associated with the confirmation of the button image after the button image confirmation display, sound reproduction, or vibration generation ends (step S205). Thereafter, the process returns to step S104 and waits until the operator performs another UI input operation (step S104).

Next, in step S206, the control unit 10 determines whether or not the indicator has moved out of the display area of the button image while the button image is being pressed (step S206).
In step S206, when the indicator is out of the button image display area while the button image is being pressed (when the determination in step S206 is Yes), the control unit 10 proceeds to step S207.
On the other hand, in step S206, when the button image is pressed and the indicator does not deviate from the button image display area (when the determination in step S206 is No), the control unit 10 proceeds to step S210.

  Next, in step S207, the control unit 10 controls the button on the display unit 11 during the display time based on the display image data at the time of an operation error registered in the control data of the button image and the display time (FIG. 2). An error image of the image is displayed (step S207).

In subsequent step S208, the control unit 10 acquires the playback time of the sound at the time of the operation error and the sound attribute (FIG. 2) from the storage unit 12 from the button image control data in order to play back the sound at the time of the operation error. During the reproduction time, the audio reproduction unit 14 is caused to reproduce the audio data (step S208). Thereafter, the control unit 10 proceeds to step S209. When the reproduction time is set to 0 (ms), the control unit 10 proceeds to step S209 without causing the audio reproduction unit 14 to reproduce the audio data.
In addition, the control unit 10 obtains vibration time and vibration attribute (FIG. 2) at the time of an operation error from the storage unit 12 or generates vibration time from the vibration unit 15 in order to generate vibration instead of sound. In the meantime, the vibrating unit 15 may be vibrated. In this case, when the vibration time is set to 0 (ms), the control unit 10 proceeds to step S209 without causing the vibration unit 15 to vibrate.

  Finally, in step S209, the control unit 10 controls the button image control data (FIG. 2) in order to return the display content of the button image to the initial state after the operation error display of the button image, the sound reproduction, and the vibration generation are completed. The button image is displayed on the display unit 11 with reference to the display position of the button image, the button rectangle size, and the initial display image of the button image (step S209). Thereafter, the control unit 10 returns to step S104 and waits until there is another UI input operation from the operator (step S104).

Next, in step S210, the control unit 10 determines whether or not the indicator has moved away from the button image (step S210).
In step S210, when the indicator is separated from the button image (when the determination in step S210 is Yes), the control unit 10 proceeds to step S211.
On the other hand, when the indicator is not separated from the button image in Step S210 (when the determination in Step S210 is No), the control unit 10 returns to Step S206 and continues the button operation determination (Step S206).

Finally, in step S211, the control unit 10 refers to the button image operation effective condition (FIG. 2) of the control data of the button image, and sets the button image operation effective condition at the time when the indicator leaves the button image. It is determined whether or not it has been performed (step S211).
In step S211, when the button image operation valid condition is set at the time when the indicator is separated from the button image (when the determination in step S211 is Yes), the control unit 10 returns to step S202.
On the other hand, in step S211, if the button image operation valid condition is not set at the time when the indicator is released from the button image (when the determination in step S211 is No), the control unit 10 returns to step S104.

  Thus, in a series of button image operation processes, the control unit 10 determines whether or not the button image has been pressed (determination in step S105), and the indicator remains in the button image area while the button image is being pressed. It is checked in order whether it has come off (determination in step S206) and whether the indicator has left the button image (determination in step S210), and processing of the button image according to each determination result is performed. As a result, a determination is made according to whether or not the button image operation condition is appropriate. When the button image operation condition is appropriate, an effective image such as a check mark is displayed. It can be easily determined whether or not it has become effective.

<Specific example of effective display of button image operation>
Next, a specific example of the effective display of the button image operation of the image processing apparatus 100 will be described with reference to FIGS.

  First, as shown in FIG. 6, an example of effective display when the switching of the button images of “Yes” and “No” cannot be configured with two buttons on the screen layout, taking the example of the specification of the mounted product of the car wash machine system. explain.

As shown in FIG. 6A, the operator selects an initial image 301 of the center “grill guard” button among the three types of button images “rear camera escape”, “grill guard”, and “rear mirror” with the finger. Assume a situation where you want to select by pressing.
In the initial state, only the “rear camera escape” button image at the left end is in the “selected” state, and the remaining two button images (ie, the “grill guard” button image at the center and the “rear mirror” button image at the right end) ) Are in a state of “no selection”.

  In the initial state shown in FIG. 6A, when the operator presses the center “grill guard” button with a finger and the operation of the button image is valid, the button is pressed as shown in FIG. 6B. An effective image 302 with a check mark having the same size as the button image is displayed on the screen at the position of the initial image 301.

Specifically, an effective image with a check mark of the same size as the entire initial image 301 is displayed at the position where the initial image 301 of the “grill guard” button was present. The visual display continues for a predetermined time and alerts the operator.
Instead of the effective image 302, an enlarged image 202 as shown in FIG. 5B or a reverse image 203 as shown in FIG. 5C may be displayed.

  Subsequently, as shown in FIG. 6C, a confirmed image 303 is displayed. In FIG. 6C, the final image 303 is an image in which the image of the center “Grill guard” button is in a “◯ selected” state. In addition, in order to notify the operator that the operation of the button image is effective through hearing or touch, the display of the effective image 302 or the confirmed image 303 and the reproduction of sound or generation of vibration may be executed. Good.

  In this way, if two different button images of “○ selected” and “× not selected” cannot be displayed side by side due to screen layout restrictions, the button image is changed before and after selection. Since the effective image is displayed, the operator can easily determine whether or not the operation is effective, and it is possible to prevent forgetting to select the operation image and mistaken selection.

Finally, a modified example of the effective display of the image processing apparatus 100 according to the first embodiment will be described with reference to FIG.
FIG. 7 is an explanatory diagram showing a modification of the effective display process shown in FIG.

  Here, an example of effective display in the case where switching of button images of “Yes” and “No” on the screen layout can be configured with two buttons will be described by taking a topping addition scene of the car wash machine system as an example.

  As shown in FIG. 7A, the operator presses one of the two types of button images of “Yes” and “No” with the finger for adding “high pressure spray” as a topping of the car wash course. Assuming that “Yes” or “No” is selected.

  With regard to the selection of “high pressure spray”, in the initial state in which the image of the “no x” button is selected, an initial image 401 of “Yes” arranged by the operator adjacent to the image of the “no x” button is displayed. When pressed with a finger, as shown in FIG. 7B, an effective image 402 with a check mark of the same size as the button image is displayed on the screen at the position of the pressed initial image 401. The

Specifically, an effective image 402 with a check mark having the same size as the entire initial image 401 is displayed at the position where the initial image 401 of the “Yes” button was located. The visual display continues for a predetermined time and alerts the operator.
Instead of the effective image 402, an image corresponding to the enlarged image 202 as shown in FIG. 5B or an image corresponding to the reverse image 203 as shown in FIG. 5C may be displayed. Good.

  Subsequently, as shown in FIG. 7C, a confirmed image 403 is displayed. In FIG. 7C, the final image 403 is an image of the “Yes” button shaded in the concave shape from the initial image 401 of the “Yes” button shaded in the convex shape.

In addition, when two types of switching operations of “Yes” and “No” are performed with two corresponding button images, the button image that has not been selected is displayed as an image indicating a non-selected state (for example, gray color). You may replace and display.
Further, in order to notify the operator that the operation of the button image is effective through hearing or touch, the display of the effective image 402 or the confirmed image 403 and the reproduction of sound or generation of vibration may be executed. Good. In this case, different sounds may be reproduced or different vibrations may be generated depending on whether the “Yes” button image is pressed or the “No” button image is pressed.

  Thus, even when two different button images of “Yes” and “No” are displayed side by side on the screen, the operator can easily determine whether or not the operation is valid. This makes it possible to prevent forgotten selection or wrong selection of operation for the image.

  Note that the above processing is merely an example, and does not limit the processing of the image processing apparatus 100 of the present invention.

DESCRIPTION OF SYMBOLS 10: Control part 11: Display part 12: Memory | storage part 13: Operation part 14: Sound reproduction part 15: Vibration part 16: Communication part 100: Image processing apparatus 101: Option 201,302,402: Effective image 202: Enlarged image 203 : Reverse image 301, 401: Initial image 303, 403: Final image

Claims (2)

A display unit;
A storage unit for storing image information to be displayed on the display unit;
An operation unit that receives an operation on the image displayed on the display unit,
The image information includes an initial image, a confirmed image after receiving the operation, and an effective image to be displayed when reception of the operation unit is enabled,
When the operation accepting unit accepts an operation on the initial image, the initial image is switched to the effective image and then displayed, and then the effective image is switched to the confirmed image and displayed.   The display device according to claim 1, wherein the effective image is either an image obtained by enlarging the initial image or a reverse image obtained by inverting the initial screen.