JP6480738B2 - Display operation device, image forming device, and electronic blackboard device - Google Patents

Description

  The present invention relates to a display operation device, an image forming apparatus, and an electronic blackboard device, and in particular, a display operation device having a display surface for displaying user interface (UI) parts, and an image forming apparatus and an electronic blackboard including the display operation device. Relates to the device.

  2. Description of the Related Art Conventionally, an information device equipped with an operation panel configured by overlapping a display panel and a touch panel is known. In such an operation panel, the user can issue a desired process start instruction or the like by touching a software key displayed as a UI component on the display panel.

  In recent years, image forming apparatuses (typically copiers) have been introduced into many offices (company, office, etc.) as one type of information equipment. In such offices, there are many cases where an image forming apparatus having a print function or a copy function is connected to a network and used by a plurality of users. When an image forming apparatus is used by a plurality of users, for example, when a setting or the like is changed by a certain user, another user who uses the image forming apparatus may not notice the change of the setting or the like.

  With respect to such a problem, Patent Document 1 described later discloses a technique for notifying a change in setting by voice. In Patent Document 1, such a technique is applied to a camera. In the camera of Patent Document 1, when the setting is changed to a shooting condition different from the initial setting, when the setting confirmation button is pressed by the user, the changed shooting condition is notified by voice. For example, when the light emission mode of the auxiliary light is set to a light emission prohibition mode different from the initial setting, a voice guidance such as “It is an auxiliary light emission prohibition mode” is output from the speaker of the camera when the setting confirmation button is pressed. As described above, the notified voice is registered in advance in the camera at the time of manufacturing the camera.

JP 2009-117947 A

  If the technique described in Patent Document 1 is applied to an image forming apparatus, it is possible to make a user who uses the image forming apparatus aware of a change in setting. However, in this case, since the voice guidance registered (prepared) is only reproduced, for example, when there is other information to be transmitted to other users when changing the setting, such information cannot be transmitted. There is an inconvenience. Therefore, it is difficult to call attention carefully. Furthermore, in the technique described in Patent Document 1, the voice guidance is not reproduced unless the setting confirmation button is pressed. Since the setting confirmation button is not always pressed, there is a disadvantage that it is not possible to sufficiently alert other users. As described above, the technique described in Patent Document 1 has a problem that necessary information cannot be effectively transmitted. Note that the same problem as described above may also occur in an electronic blackboard device, which is another type of information equipment.

  SUMMARY An advantage of some aspects of the invention is that a display operation apparatus, an image forming apparatus, and an electronic blackboard apparatus capable of effectively transmitting necessary information are provided. Is to provide.

  A display operation device according to a first aspect of the present invention includes a display-integrated operation panel having a display surface, UI component display means for displaying an image of a user interface (UI) component on the display surface, and a display surface In response to accepting a user operation on the UI component displayed on the screen, a process activation unit for activating a process associated with the UI component, and a UI component displayed on the display surface In response to accepting a predetermined operation different from the above operation, recording start means for starting voice recording, and satisfying a predetermined condition after voice recording is started by the recording start means In response, a recording end means for ending the recording of the voice, and a storage means for storing the recorded voice data in association with the UI component after the recording of the voice is ended by the recording end means. In response to accepting the user's operation for the UI component, it is determined whether or not the voice data associated with the UI component is stored in the storage means, and in response to the determination result being affirmative, Reproduction means for reproducing audio data stored in association with the UI component when the process activation means is activated.

  The UI component display means displays an image of the UI component on the display surface of the display-integrated operation panel. When receiving a user operation on the UI component displayed on the display surface, the process activation unit activates a process associated with the UI component. When a predetermined operation different from the above operation is accepted for the UI component, the recording start means starts recording the voice. When the predetermined condition is satisfied after the recording is started, the recording end means ends the recording of the voice. The recorded voice data is stored in the storage means in association with the operated UI component. When the display operation device accepts a user operation on the UI component, the display operation device determines whether or not audio data associated with the UI component is stored in the storage unit. If the determination result is affirmative, that is, it is determined that audio data is stored, the reproduction means reproduces the audio data stored in association with the UI component when the process activation means is activated.

  As described above, since voice can be recorded by operating the UI component, information to be transmitted to other users can be flexibly registered as voice data. For example, when the setting is changed, in addition to the setting being changed, other information can be transmitted to other users. As a result, it is possible to give a detailed alert to other users. In addition to notifications such as setting changes, various information can be transmitted to other users according to the recording contents. Furthermore, the recorded voice is reproduced by operating the UI component operated during recording. If you record the voice by operating the UI component related to the information you want to convey, when another user operates the UI component, the UI component is activated along with the start of the process associated with the UI component. Audio data of related information is reproduced. When a process associated with a UI component is activated, the UI component is operated, so that the sound recorded by the operation of the UI component is reproduced. Thereby, necessary information can be effectively transmitted to other users.

  Preferably, the recording start unit displays an image of the recording start UI component that receives a recording start instruction on the display surface in response to receiving a predetermined operation on the UI component displayed on the display surface. Recording start UI display means for performing recording, and voice recording for starting voice recording in response to receiving a user operation on the recording start UI component displayed on the display surface by the recording start UI display means And a recording end means, in response to receiving a user operation on the recording start UI component, displays an image of the recording end UI component on the display surface instead of the image of the recording start UI component. In response to receiving the user's operation on the recording end UI display means for recording and the recording end UI component displayed on the display surface by the recording end UI display means, the voice recording is ended. Of and a voice recording termination means.

  More preferably, the recording end means includes a voice recording end means for ending the voice recording in response to a lapse of a predetermined time after the voice recording is started by the recording start means.

  More preferably, the display operation device further includes a user authentication unit for authenticating the user, and a user designation unit for designating a user who is permitted to reproduce the voice data recorded from the users who can be authenticated by the user authentication unit. And validating means for validating the reproduction processing of the audio data stored in association with the UI component in response to the user designated by the user designating means being authenticated by the user authenticating means. .

  More preferably, in response to accepting a predetermined operation on the UI component, the display operation device further determines whether or not audio data associated with the UI component is stored in the storage unit, In response to the determination result being affirmative, it includes a reproducing means for reproducing the audio data stored in association with the UI component without starting the process by the process starting means.

  More preferably, the UI component display means includes icon display means for displaying an icon image on the display surface as the UI component image.

  A display operation device according to a second aspect of the present invention includes a display-integrated operation panel having a display surface, character display means for displaying characters as an image of a UI component on the display surface, and display on the display surface In response to accepting the user's operation on the recorded character, recording start means for starting voice recording, and responding that a predetermined condition is satisfied after the voice recording is started by the recording start means A recording end means for ending the recording of the voice, a storage means for storing the recorded voice data in association with the character after the recording of the voice is ended by the recording end means, and a user for the character In response to accepting the operation, it is determined whether voice data associated with the character is stored in the storage means, and in response to the determination result being affirmative, And a reproducing means for reproducing the audio data being 憶.

  An image forming apparatus according to a third aspect of the present invention is connected to the display operation device according to the first aspect and the display operation device, and reads an original in accordance with an instruction from the display operation device to perform image data. A document reading device for converting the image data into the display, a display operation device and a document reading device, storing image data output from the document reading device, and responding to an output instruction from the display operation device in response to an image of the image data And an image forming unit for forming the image on the recording paper.

  An electronic blackboard device according to a fourth aspect of the present invention includes the display operation device according to the first aspect.

  An electronic blackboard device according to a fifth aspect of the present invention includes the display operation device according to the second aspect.

  Preferably, the display-integrated operation panel displays a document image including the character on the display surface, and the electronic blackboard device is further connected to the display operation device, communicates with an external device, and is displayed on the display surface. A communication device that transmits the data of the existing document image to the external device together with the voice data associated with the character included in the document image.

  As described above, according to the present invention, it is possible to obtain a display operation device, an image forming device, and an electronic blackboard device that can effectively transmit necessary information.

1 is an external view of an image forming apparatus according to a first embodiment of the present invention. FIG. 2 is a control block diagram illustrating a hardware configuration of the image forming apparatus illustrated in FIG. 1. FIG. 2 is a diagram illustrating an example of a home screen displayed on an operation panel of the image forming apparatus illustrated in FIG. 1. 2 is a flowchart showing a control structure of a program executed by the image forming apparatus shown in FIG. 2 is a flowchart showing a control structure of a program executed by the image forming apparatus shown in FIG. 2 is a flowchart showing a control structure of a program executed by the image forming apparatus shown in FIG. FIG. 2 is a diagram for explaining an operation when recording sound in the image forming apparatus shown in FIG. 1. FIG. 2 is a diagram for explaining an operation when recording sound in the image forming apparatus shown in FIG. 1. FIG. 2 is a diagram for explaining an operation when recording sound in the image forming apparatus shown in FIG. 1. FIG. 2 is a diagram for explaining an operation when playing back recorded sound in the image forming apparatus shown in FIG. 1. FIG. 10 is a diagram illustrating an example of a setting screen displayed on an operation panel of an image forming apparatus according to a third embodiment of the present invention. It is a figure which shows the example of the registration audio | voice list screen displayed on the operation panel of the image forming apparatus which concerns on the 4th Embodiment of this invention. It is a figure which shows the external appearance of the electronic blackboard apparatus which concerns on the 5th Embodiment of this invention. It is a control block diagram which shows the hardware constitutions of the electronic blackboard apparatus shown in FIG. It is a figure which shows the electronic blackboard apparatus which concerns on the 6th Embodiment of this invention. It is a flowchart which shows the control structure of the program performed with the electronic blackboard apparatus shown in FIG. It is a figure for demonstrating operation | movement of the electronic blackboard apparatus shown in FIG. It is a figure for demonstrating operation | movement of the electronic blackboard apparatus shown in FIG.

  In the following embodiments, the same parts are denoted by the same reference numerals. Their functions and names are also the same. Therefore, detailed description thereof will not be repeated.

(First embodiment)
Referring to FIG. 1, image forming apparatus 100 according to the present embodiment includes a plurality of operation modes such as a copy mode, a print mode, a scanner mode, and a facsimile (hereinafter referred to as “FAX”) mode. It is a multifunction peripheral (MFP: Multifunction Peripheral). The image forming apparatus 100 has a so-called laser (electrophotographic) printing function that uses laser light for exposure. However, other types of printing functions may be provided.

[overall structure]
The image forming apparatus 100 forms a multicolor or single color image on a predetermined sheet (recording paper) based on the image data. The image forming apparatus 100 acquires a job including image data by an input from the outside or by an image reading function provided in the image forming apparatus 100, and executes the acquired job.

  On the upper part of the image forming apparatus 100, a document placing table 102 made of a transparent glass plate on which a document is placed is provided. A document cover 104 is disposed above the document table 102. The document cover 104 is attached to the apparatus main body so as to be openable and closable. An operation unit 120 is installed in front of (on the near side of) the document table 102. The operation unit 120 includes an operation panel 122 for a user to input an instruction to the image forming apparatus 100. The operation panel 122 includes a touch panel display for inputting instructions and displaying information. On operation panel 122, a user interface screen including an icon for starting a predetermined process is displayed.

  A document reading unit 130 that reads image information of a document is arranged below the document table 102. Below the document reading unit 130, an image forming unit 150 for printing an image indicated by the image data on a recording sheet is provided. A paper feeding unit 160 for feeding recording paper to the image forming unit 150 is provided below the image forming unit 150. The paper feed unit 160 includes a plurality of paper feed trays 162 to 168 that store recording paper. Each of the paper feed trays 162 to 168 is provided with a paper feed roller (not shown), and the recording paper is continuously fed in units of one sheet by the paper feed roller.

  The image forming apparatus 100 according to the present embodiment has a recording function for recording sound and a reproduction function for reproducing the recorded sound. Sound recording is performed by operating an icon displayed on the operation panel 122. Specifically, when the user performs a long press operation on an icon, a recording menu is displayed near the icon. When the user operates the recording menu, sound is recorded. The “long press operation” means an operation of pressing an icon or the like for a predetermined time or longer. The recorded voice data is stored in association with the icon operated at the time of recording (hereinafter sometimes referred to as “sound is registered in the icon”). When the user performs a touch operation (for example, a single touch operation) on the icon, a process associated with the icon is activated. When audio data is associated with the operated icon, the audio data is reproduced when the process is started.

  The image forming apparatus 100 further has a user authentication function for authenticating a user and permitting login to the image forming apparatus 100. Login to the image forming apparatus 100 is permitted for a regular user registered in advance. The image forming apparatus 100 has a function of selecting (designating) a user who is permitted to reproduce audio data from among users registered in advance. In this case, only the selected user can reproduce the recorded voice.

[Hardware configuration]
Referring to FIG. 2, the image forming apparatus 100 includes a control unit 110, an image processing unit 140, a user authentication device 170, in addition to the operation unit 120, the document reading unit 130, the image forming unit 150, and the paper feeding unit 160. A FAX communication unit 180, a NIC (Network Interface Card) 182 and a speaker 190 are included.

  The control unit 110 is substantially a computer, and includes a CPU (Central Processing Unit) 112 that controls the entire image forming apparatus 100, a ROM (Read-Only Memory) 114 for storing programs, and a volatile storage device. A RAM (Random Access Memory) 116 and a storage device 118. The storage device 118 is a non-volatile storage device that retains data even when power is turned off, and includes, for example, a hard disk drive (HDD) and a flash memory. A BUS line 106 is connected to the CPU 112, and a ROM 114, a RAM 116, and a storage device 118 are electrically connected to the BUS line 106.

  The CPU 112 executes various computer programs in accordance with instructions from the operation unit 120 and the like, thereby executing desired processing such as the operation of each unit of the image forming apparatus 100 and communication with an external device such as a personal computer (PC). To do. The various computer programs are stored in advance in the ROM 114 or the storage device 118, and are read from the ROM 114 or the storage device 118 and transferred to the RAM 116 when desired processing is executed. The CPU 112 reads and interprets a program instruction from an address in the RAM 116 specified by a value stored in a register called a program counter (not shown) in the CPU 112. The CPU 112 also reads data necessary for the operation from the address specified by the read instruction, and executes an operation corresponding to the instruction on the data. The execution result is also stored in an address specified by an instruction, such as a register in the RAM 116, the storage device 118, and the CPU 112.

  The ROM 114 or the storage device 118 stores a computer program for realizing a general operation or the like of the image forming apparatus 100 and a computer program for realizing a sound recording process and a reproduction process. This computer program is written in the ROM 114 or the storage device 118 when the image forming apparatus 100 is manufactured. The computer program may be provided from an external device or the like via the NIC 182. Further, the computer program may be provided by a storage medium such as a DVD on which the computer program is recorded. That is, for example, a DVD as a computer program recording medium is loaded into a DVD drive (not shown) built in the image forming apparatus 100, and the computer program is read from the DVD and installed in the storage device 118. Also good.

  The BUS line 106 further includes an operation unit 120, a document reading unit 130, an image processing unit 140, an image forming unit 150, a paper feeding unit 160, a FAX communication unit 180, a user authentication device 170, a NIC 182, and a speaker 190. Connected to.

  The operation unit 120 receives an operation by a user. The operation unit 120 communicates with the CPU 112 via an input / output interface (not shown). The operation unit 120 includes the operation panel 122 and a recording device 124.

  The operation panel 122 includes a display panel constituted by a liquid crystal panel and the like, and a touch panel that is disposed on the display panel and detects a touched position. That is, the operation panel 122 includes a touch panel display that is a touch panel integrated display device. The display panel includes, for example, a home screen for selecting a desired operation mode from various operation modes that can be executed by the image forming apparatus 100 and a basic screen for changing settings of various functions in the basic operation mode. Is displayed. Here, the basic operation mode is an operation mode for executing image data print processing, transmission processing, and the like, and in this embodiment, indicates a copy mode, a FAX mode, a scanner mode, and the like.

  The operation of the operation panel 122 is controlled by the CPU 112. For example, a software key is displayed on a screen displayed on the display panel. When the user presses this software key with a finger, the touch panel detects the pressed position. The CPU 112 collates the display position of the software key with the position where the touch panel is pressed on the program, and selects an operation mode, changes various function settings, and instructs an operation based on the collation result.

  Referring to FIG. 3, home screen 200 displayed on operation panel 122 (display panel) includes software keys for selecting the basic operation mode described above. On the home screen 200, an icon image as a software key is displayed. The icons displayed on the home screen 200 include a copy icon 210, a fax icon 212, an E-mail icon 214, an FTP / Desktop icon 216, a shared folder icon 218, an address book icon 220, a document filing icon 222, and a scan save icon 224. including. The copy icon 210 is an icon for selecting a copy mode, and the fax icon 212 is an icon for selecting a fax mode. The E-mail icon 214 is an icon for selecting a mail transmission mode in which an image of a scanned document is attached to an email and transmitted, and the FTP / Desktop icon 216 is an FTP server of a designated FTP server. An icon for selecting a transmission mode for transmitting to a designated folder of a computer connected to a directory or a network, and a shared folder icon 218 is an icon for selecting a transmission mode for transmitting an image of a scanned document to a shared folder. It is. The document filing icon 222 and the scan saving icon 224 are both icons for selecting a scan mode. The address book icon 220 is an icon for displaying an address book. When any of the icons 210 to 224 is touched by the user, a process of shifting to an operation mode associated with the touched icon is executed.

  Referring again to FIG. 2, the recording device 124 includes a microphone (not shown). The recording device 124 records sound under the control of the CPU 112 and stores the recorded sound data in the storage device 118 in association with the icon operated at the time of recording. When a user who is permitted to reproduce audio data is selected, the recording device 124 stores user information for identifying the user in further association with the audio data.

  Document reading unit 130 includes a scanner and a CCD (Charge-Coupled Device) line sensor (none of which is shown). The scanner forms on the CCD line sensor a reflected light image obtained by irradiating light from a light source (not shown) onto the image surface of the document placed on the document placement table 102, and the light source is turned on. Scan the document while moving it. The CCD line sensor sequentially photoelectrically converts the formed reflected light image and outputs it to the image processing unit 140 as image data. In other words, the document reading unit 130 reads image information from a document placed on the document placing table 102 by a scanner when the document is copied or scanned, and converts the read image information into an electrical signal by a CCD line sensor. The data is output to the image processing unit 140 as data.

  The image processing unit 140 includes an MPU (Micro Processing Unit, not shown). The image processing unit 140 performs various processes including predetermined image processing such as rasterization processing on the image data received from the document reading unit 130 or an external device, and outputs print data with predetermined gradation. Created and output to the image forming unit 150.

  The image forming unit 150 prints an image indicated by image data on a recording sheet in color or single color, and includes, for example, a photosensitive drum, a charging device, a laser scanning unit (LSU), a developing device, a transfer device, and a cleaning device. A device, a fixing device, a static eliminator, and the like. For example, the image forming unit 150 is provided with a conveyance path, and the recording paper fed from the paper feeding unit 160 is conveyed along the conveyance path.

  The paper feed unit 160 includes a plurality of paper feed trays 162 to 168. The sheet feeding unit 160 pulls out the recording sheets stored in the sheet feeding trays 162 to 168 one by one and sends the recording sheets to the conveyance path of the image forming unit 150. While the recording paper is being transported along the transport path of the image forming unit 150, the recording paper passes between the photosensitive drum and the transfer device, and further passes through the fixing device to perform printing on the recording paper. It is.

  The photosensitive drum rotates in one direction, and its surface is cleaned by a cleaning device and a static eliminator and then uniformly charged by a charging device. The laser scanning unit modulates the laser beam based on the image data to be printed, and repeatedly scans the surface of the photosensitive drum in the main scanning direction with this laser beam to form an electrostatic latent image on the surface of the photosensitive drum. To do. The developing device supplies toner to the surface of the photosensitive drum to develop the electrostatic latent image, and forms a toner image on the surface of the photosensitive drum. The transfer device transfers the toner image on the surface of the photosensitive drum to a recording sheet passing between the transfer device and the photosensitive drum.

  The fixing device includes a heating roller for heating the recording paper and a pressure roller for pressing the recording paper. The recording paper is heated by the heating roller and pressed by the pressure roller, whereby the toner image transferred onto the recording paper is fixed on the recording paper. The recording paper discharged (printed) from the fixing device is discharged to a paper discharge tray.

  The user authentication device 170 executes authentication processing for the user under the control of the CPU 112. User authentication device 170 includes a card reading unit (not shown) that reads information stored in an authentication card. The authentication card is a card capable of storing information such as an IC card, and is distributed to users who use the image forming apparatus 100. In the authentication card, user information (for example, a user ID or the like) that identifies a user who possesses the authentication card is stored in advance. The card reading unit reads the user information stored in the authentication card when the authentication card is held over by the user. The user authentication device 170 performs an authentication process based on the user information read by the card reading unit. If the authentication process determines that the user is a regular user, the user authentication device 170 permits the user to log in to the image forming apparatus 100. On the operation panel 122, an operation screen (not shown) after login is displayed.

  The FAX communication unit 180 is connected to the telephone line network 60 and is an interface for performing facsimile communication via the telephone line network 60. The image forming apparatus 100 can perform FAX transmission / reception with an external facsimile apparatus (not shown) via the FAX communication unit 180 and the telephone line network 60.

  The NIC 182 interfaces with the network 50. The image forming apparatus 100 can perform data communication according to a predetermined communication protocol with an information processing apparatus or the like on the network 50 via the NIC 182. The image forming apparatus 100 can receive a command signal for instructing execution of various processes such as a print job from a PC or the like via the NIC 182.

  The speaker 190 is a device that converts an electrical signal into sound. The speaker 190 converts the sound data stored in the storage device 118 into sound and outputs the sound.

Software configuration
With reference to FIG. 4 to FIG. 6, a control structure of a computer program executed in the image forming apparatus 100 in order to record and reproduce sound will be described. This program starts when the screen after login is displayed.

  Referring to FIG. 4, this program determines whether or not an icon touch operation (for example, a single touch operation) has been performed, and branches the control flow according to the determination result. Step S1010 is executed when it is determined that the touch operation is not performed, and it is determined whether or not a long press operation of the icon has been performed. In steps S1010 and S1010, the control flow is branched according to the determination result. Step S1020 is executed when it is determined that a long press operation is performed, and a recording menu is displayed on the operation panel 122. If it is determined in step S1010 that the icon has not been long pressed, control returns to step S1000.

  This program is further executed after step S1020 to determine whether or not the “recording start” key included in the recording menu has been pressed (touch operation) and to branch the control flow according to the determination result; This is executed when it is determined in step S1030 that the “recording start” key has not been pressed, and it is determined whether or not a predetermined time has elapsed since the recording menu was displayed, and control is performed according to the determination result. Step S1040 for branching the flow. If it is determined in step S1040 that the predetermined time has not elapsed, control returns to step S1030. On the other hand, if it is determined in step S1040 that the predetermined time has elapsed, control returns to step S1000.

  This program is further executed when it is determined in step S1030 that the “recording start” key has been pressed, and is executed after step S1050 for causing the recording device 124 to start voice recording, and after step S1050. Step S1060 for displaying a “recording end” key instead of the key, and a step executed after step S1060 to determine whether or not the “recording end” key is pressed, and to branch the control flow according to the determination result This is executed when it is determined in S1070 and Step S1070 that the “recording end” key has not been pressed, and it is determined whether or not a predetermined time has elapsed since the “recording end” key was displayed. And step S1080 for branching the flow of control according to the above. If it is determined in step S1080 that the predetermined time has not elapsed, control returns to step S1070. On the other hand, if it is determined in step S1080 that the predetermined time has elapsed, control returns to step S1000.

  Referring to FIG. 5, this program is further executed in step S1070 (see FIG. 4) when it is determined that the “recording end” key is pressed, and the recording device 124 ends the voice recording step S1090. , Executed after step S1090, in place of the recording menu, displaying on the operation panel 122 a target user selection screen for selecting a target user who is permitted to reproduce the sound, and after step S1100, executed after step S1100. It is determined whether or not the selection is completed, and the process waits until the selection is completed. In step S1110, when it is determined that the selection of the target user is completed, the recorded voice (voice data) is recorded. , Associated with the icon operated during recording and user information of the selected target user Stored in the storage device 118 and a step S1120. When the process of step S1120 ends, control returns to step S1000 of FIG.

  Referring to FIG. 6, this program is further executed in step S1000 (see FIG. 4) when it is determined that an icon touch operation has been performed, and whether there is audio data associated with the touched icon. This is executed when it is determined that there is audio data associated with the touch-operated icon in step S1130 for determining whether or not, and branching the control flow according to the determination result, and in step S1130. It is determined whether or not the login user is the target user in step S1140 for determining whether or not the user is the target user, and branching the flow of control according to the determination result. Step S1150 for reproducing (starting reproduction) the corresponding audio data that has been saved; If it is determined in step S1130 that there is no audio data associated with the touch-operated icon, if it is determined in step S1140 that the login user is not the target user, or after step S1150, the touch is performed. Step S1160 for starting the process associated with the operated icon. When the process of step S1160 ends, control returns to step S1000 of FIG.

[Operation]
Image forming apparatus 100 according to the present embodiment operates as follows. In the following description, only the part related to the present invention in the operation of the image forming apparatus 100 will be described. Other operations are the same as those of the conventional image forming apparatus.

<Recording operation>
In the following, for example, an operation at the time of recording will be described by taking as an example a case where a user who has changed the setting of the paper feed tray notifies other users of this.

  On the operation panel 122, a home screen 200 (see FIG. 3) is displayed. If another user does not realize that the paper feed tray setting has been changed when executing copy printing, there is a possibility that copy printing will not be performed on the intended paper. When the copy icon 210 for selecting the copy mode is touch-operated in order for the other user to notice that the setting of the paper feed tray has been changed before the other user performs copy printing. Further, for example, it is preferable that a message having a content for calling attention is set to be reproduced.

  To make this setting, the user performs a long press operation on the copy icon 210 (YES in step S1010 shown in FIG. 4). Referring to FIG. 7, a recording menu 240 including a “recording start” key 230 is displayed on operation panel 122 (step S1020). When a predetermined time has elapsed with recording menu 240 displayed (NO in step S1030 and YES in step S1040), recording menu 240 is deleted. If the “recording start” key 230 is pressed by the user before the predetermined time has elapsed (YES in step S1030), the recording device 124 starts voice recording (step S1050). On the operation panel 122, a “recording end” key 232 (see FIG. 8) is displayed instead of the “recording start” key 230 (step S1060). When a user utters a message that he / she wants to convey to another user (for example, “Tray settings have been changed, please be careful when printing.”), The message is recorded.

  Referring to FIG. 8, when voice recording is started, a recording menu 242 including a “recording end” key 232 is displayed on operation panel 122 instead of recording menu 240. In the recording menu 242, the recording time is counted and displayed in addition to the “recording end” key 232. When a predetermined time elapses with recording menu 242 displayed (NO in step S1070 and YES in step S1080), recording menu 242 is deleted. The predetermined time is, for example, about 30 seconds. When this time elapses, the recording content is not saved and the recording is restarted. If “recording end” key 232 is pressed by the user before the predetermined time has elapsed (YES in step S1070), recording device 124 ends the voice recording (step S1090 shown in FIG. 5). Instead of the recording menu 242, a target user selection screen 250 (see FIG. 9) is displayed on the operation panel 122.

  Referring to FIG. 9, target user selection screen 250 includes an area 252 for displaying a list of previously registered users, a check box 254 for checking when selecting, and a “decision” key 256. The user displayed in the area 252 is a user registered in advance for user authentication. A group may be displayed in the region 252 by grouping a plurality of users. When any of the check boxes 254 is checked and the “OK” key 256 is operated, the selection of the target user ends (YES in step S1110 shown in FIG. 5). The target user selection screen 250 is deleted from the operation panel 122.

  When the selection of the target user is completed, the recording device 124 stores the recorded voice (sound data) in the storage device 118 in association with the copy icon 210 operated at the time of recording and the user information of the selected target user (step). S1120).

《Playback operation》
Assume that another user selected as the target user logs in to the image forming apparatus 100. The CPU 112 determines whether or not audio data associated with the user information is stored in the storage device 118 using the user information acquired at the time of user authentication. When audio data associated with the user information of the logged-in user is stored, a speaker icon 260 (see FIG. 10) indicating that audio can be reproduced is displayed near the icon associated with the audio data. Is done.

  Referring to FIG. 10, when home screen 200 is displayed on operation panel 122, speaker icon 260 is displayed in the vicinity of copy icon 210 on home screen 200. It is assumed that another user has touched the copy icon 210 to shift to the copy mode (YES in step S1000 shown in FIG. 4). The CPU 112 determines whether audio data associated with the copy icon 210 is stored in the storage device 118. The CPU 112 determines that the audio data associated with the copy icon 210 is stored in the storage device 118, and further determines that another user who is a login user is selected by the target user (shown in FIG. 6). YES in step S1130 and YES in step S1140). The image forming apparatus 100 reproduces the recorded sound (step S1150) and activates a process associated with the copy icon 210 (step S1160). In other words, the image forming apparatus 100 shifts to the copy mode while operating the copy mode basic screen while playing a recorded message (for example, “Tray settings have been changed, so be careful when printing.”). Display on panel 122. Other users who listen to the replayed message notice that the settings for the paper feed tray have been changed before the copy printing is performed.

  The sound registered in the icon can be deleted by a user operation. For example, when the speaker icon 260 is pressed and operated, a delete key (not shown) is displayed, and the registered voice is deleted by operating the delete key.

  When another user not selected as the target user logs in to the image forming apparatus 100, the CPU 112 determines that the audio data associated with the user information of the logged-in user is not stored in the storage device 118. In this case, when the home screen 200 is displayed on the operation panel 122, the speaker icon 260 is not displayed near the copy icon 210 on the home screen 200. When the copy icon 210 is touched by another user, the CPU 112 determines that the audio data associated with the copy icon 210 is stored in the storage device 118, while the login user is selected by the target user. (No in step S1140 shown in FIG. 6). Therefore, even if another user who is not selected as the target user touches the copy icon 210, the message is not reproduced. In this case, the message is not reproduced and the mode is shifted to the copy mode.

[Effects of the present embodiment]
As is clear from the above description, the following effects can be obtained by using the image forming apparatus 100 according to the present embodiment.

  When a touch operation is performed on an icon displayed on the operation panel 122, a process associated with the icon is activated. When an operation different from the touch operation is performed on the icon displayed on the operation panel 122, voice recording is started. Specifically, when the icon is long pressed, a “recording start” key 230 is displayed, and when the “recording start” key 230 is operated, voice recording is started. When voice recording is started, a “recording end” key 232 is displayed instead of the “recording start” key 230, and when the “recording end” key 232 is operated, the voice recording is ended. The recorded voice data is stored in the storage device 118 in association with the icon operated at the time of recording. As described above, since voice can be recorded by operating the icon, information to be transmitted to other users can be flexibly registered in the icon as voice data. For example, when the setting is changed, in addition to the setting being changed, other information can be transmitted to other users. As a result, it is possible to give a detailed alert to other users. In addition to notifications such as setting changes, various information can be transmitted to other users according to the recording contents.

  When the image forming apparatus 100 accepts a user's touch operation on an icon, the image forming apparatus 100 determines whether or not audio data associated with the icon is stored in the storage device 118. If the determination result is affirmative, that is, it is determined that audio data is stored, the audio data stored in association with the icon is reproduced when the process associated with the icon is activated. Thus, the recorded sound is reproduced by operating the icon operated at the time of recording. If you record (register) audio by operating the icon related to the information you want to convey, when another user operates the icon, the process associated with that icon is started and related to that icon. Message is played. When the process associated with the icon is activated, the icon is operated, so that a message recorded by the operation of the icon is reproduced. Thereby, necessary information can be effectively transmitted to other users.

Furthermore, by selecting (designating) a target user who is permitted to play back audio, it is possible to limit users who want to transmit information. Thereby, it is possible to call attention more flexibly.
For example, when the address information of a specific person registered in the address book is changed, it is possible to notify only the user who is related to the specific person that the address information has been changed. Furthermore, for example, when there is a goal of reducing the number of printed sheets in the group to which the user belongs, it can be communicated to only the users of the group that the effort is made to reduce the number of printed sheets. For example, the group users can be notified to use an aggregation function (for example, a 2 in 1 function) to reduce the number of printed sheets.

(Second Embodiment)
The image forming apparatus according to the present embodiment is based on the first embodiment in that the sound registered in the icon can be reproduced without activating the process associated with the icon. This is different from the image forming apparatus 100. In other respects, the image forming apparatuses have the same configuration.

  As in the first embodiment, when sound is registered in an icon, a speaker icon 260 (see FIG. 10) is displayed near the icon. In the present embodiment, when the speaker icon 260 is touch-operated, the process associated with the icon is not activated, and only the audio reproduction process is executed. Thereby, only registered messages can be listened to. When the speaker icon 260 is touch-operated, the display mode of the icon in which sound is registered may be changed.

(Third embodiment)
The image forming apparatus according to the present embodiment is different from the image forming apparatus 100 according to the first embodiment in that sound recording conditions and playback conditions can be set. In other respects, the image forming apparatuses have the same configuration.

  In the present embodiment, as a recording condition setting, it is possible to set whether or not to permit registration of a new voice for an icon when the voice has already been registered for the icon. As the setting of the playback condition, it is possible to set a limit on the number of playbacks. These conditions are set via a setting screen 300 (see FIG. 11) displayed on the operation panel 122.

  Referring to FIG. 11, setting screen 300 is used to select “permit recording start” or “prohibit recording start” as the recording permission setting when there is already registered audio. The radio button 302 is included. When “Allow recording start” is selected, “Overwrite” or “Continue recording” can be selected for a voice that has already been registered in a pop-up screen (not shown). . When a plurality of sounds are registered in one icon, “Play all sounds” or “Play only selected sounds” can be selected during playback. When “Prohibit recording start” is selected and this setting is valid, new audio cannot be registered until the registered audio is deleted.

  The setting screen 300 further includes a radio button 304 for selecting “no restriction” or “with restriction” as a restriction setting for the number of times of recording and reproduction, and an input for inputting the number of reproductions when “with restriction” is selected. Column 306. When the “unlimited” setting is enabled, sound is played each time an icon is touched. When the “restricted” setting is valid, the sound is reproduced as many times as input in the input field 306. If, for example, 3 times is input as the number of times of reproduction in the input field 306, the sound is not reproduced even if the icon is touched after the fourth time.

  As described above, by setting the sound recording condition and the reproduction condition, the sound can be recorded and reproduced more flexibly.

(Fourth embodiment)
The image forming apparatus according to the present embodiment is different from the image forming apparatus 100 according to the first embodiment in that the registered voice can be edited. In other respects, the image forming apparatuses have the same configuration.

  Editing of the registered voice is performed via a registered voice list screen 310 displayed on the operation panel 122. Referring to FIG. 12, a registered voice list screen 310 is a screen for deleting or editing a voice registered by itself. The registered voice list screen 310 displays a list of icon names, target users, and recorded voices that were operated during recording. When an icon name is touched, an icon image is displayed. The user can confirm the image of the target icon. When “Play” is touched, the recorded sound is played. The user can check the recorded voice.

  The registered voice list screen 310 further includes a “delete” key 312 for deleting the registered voice and an “edit” key 314 for editing each item of the registered voice. By operating the “edit” key 314, the icon, the target user, and the voice can be edited. In audio editing, for example, re-recording is executed.

  The logged-in user can delete the voice even if the voice is registered by another user.

(Fifth embodiment)
[overall structure]
Referring to FIG. 13, an electronic blackboard device 400 according to the present embodiment is a display input device using a large-screen touch panel display 410. The electronic blackboard device 400 can activate various application software, and realizes a function corresponding to the activated application software. The application software includes pen software that realizes drawing (handwriting input) using a touch pen (not shown), which is a main function of the electronic blackboard device 400.

  When the pen software is activated, the screen 500 is displayed on the display surface of the touch panel display 410. The display surface of the touch panel display 410 is divided into a drawing area 510 where drawing by the user is possible and a function button area 520 for designating a function used by the user. A plurality of function buttons are displayed in the function button area 520. Each function button is displayed as an icon.

  As with the image forming apparatus 100 according to the first embodiment, the electronic blackboard device 400 has a recording function for recording voice and a playback function for playing back the recorded voice. Sound recording is performed by operating an icon displayed on the touch panel display 410. That is, the registration of the sound to the icon and the reproduction of the registered sound are performed in the same manner as in the first embodiment.

[Hardware configuration]
Referring to FIG. 14, the electronic blackboard device 400 includes a large-screen touch panel display 410 and a control device 450 including a computer.

  The control device 450 executes a predetermined program to store a CPU 452 for realizing overall control of the electronic blackboard device 400 and a program read by the CPU 452 when the electronic blackboard device 400 is powered on. A read-only memory (ROM) 454, a random access memory (RAM) 456 used as a work memory by the CPU 452, and a recording unit capable of holding a record when the electronic blackboard device 400 is powered off 458 and an input processing unit 460 for determining processing contents based on information (coordinate data) obtained from the touch panel display 410 (input detection device 430 described later), and display of an image on the touch panel display 410 according to the control of the CPU 452 A display control unit 462 for controlling the touch panel and a touch panel display 410, a video memory (video RAM) 464 that holds an image to be displayed, a network device 466 that provides a connection of the electronic blackboard device 400 to the network 50, a recording device 468 for recording sound, and a speaker 470. And a bus 472 that connects them together and allows communication of data and control signals between them.

  The ROM 454 stores a program and data that are executed by the CPU 452 when the electronic blackboard device 400 is turned on to set the entire electronic blackboard device 400 so that the electronic blackboard device 400 performs a predetermined operation. A program for realizing the operation of the electronic blackboard device 400 is also stored in the ROM 454. The recording unit 458 is a non-volatile storage device that retains data even when power is turned off, and is, for example, a hard disk drive or a flash memory. The recording unit 458 may be detachable from the electronic blackboard device 400. The recording unit 458 can also store a part of a program executed by the CPU 452. During normal operation, the CPU 452 loads a program from the ROM 454 or the recording unit 458 onto the RAM 456 via the bus 472, and sequentially reads and executes instructions from an address specified by a program counter (not shown). The CPU 452 controls each part of the electronic blackboard device 400 in accordance with programs stored in the ROM 454 and the recording unit 458.

  Furthermore, the recording unit 458 stores an image displayed on the touch panel display 410 as image data under the control of the CPU 452. When the image indicated by the display data and the drawing image by the touch pen are displayed on the touch panel display 410, the image indicated by the display data and the image including the drawing image can be stored as image data.

  The network device 466 transmits / receives image data and the like to / from an external device connected to the network 50 under the control of the CPU 452. Image data received from the outside by the electronic blackboard device 400 via the network device 466 is recorded in the RAM 456 or the recording unit 458.

  The recording device 468 includes a microphone (not shown). The microphone is provided at the edge of the touch panel display 410, for example. The recording device 468 records the sound under the control of the CPU 452 and stores the recorded sound data in the recording unit 458 in association with the icon operated at the time of recording. The speaker 470 is a device that converts an electrical signal into sound. The speaker 470 converts the sound data stored in the recording unit 458 into sound and outputs the sound.

  The touch panel display 410 detects a display output device 420 including a display unit 422 that displays an image on a predetermined display surface and which position on the display surface of the image of the display unit 422 is touched by the user at predetermined time intervals. And an input detection device 430 that outputs the position coordinates of the position to the control device 450. The input detection device 430 has a function of detecting a touch and outputting a signal indicating that the touch has been detected, and a function of outputting coordinate data indicating the touch position at that time.

  The display unit 422 is a display panel such as a liquid crystal display panel capable of full color display, and displays an image stored in the video RAM 464 on the display surface under the control of the display control unit 462. The display control unit 462 includes a drive unit for driving the display unit 422, reads image data stored in the video RAM 464 at a predetermined timing, and displays a signal for causing the display unit 422 to display an image on the display unit 422. Output. The image data to be displayed is generated by the CPU 452 from information on the RAM 456 and information recorded in the recording unit 458 and transmitted to an address corresponding to each display pixel on the video RAM 464.

  The input detection device 430 includes a contact sensing unit 432 that detects a touch operation by a user, and a microcomputer 434 that controls the contact sensing unit 432. The microcomputer 434 includes a CPU 434a and an external output unit 434b that outputs information (coordinate data) detected by the contact sensing unit 432 to the outside (input processing unit 460).

  When the pen software is activated in the electronic blackboard device 400, the display unit 422 displays a screen 500 shown in FIG. A user can draw in a drawing area 510 of the screen 500 by a touch operation. The XY coordinates of the touched point are detected at predetermined intervals by the input detection device 430 and transmitted to the control device 450. The control device 450 (CPU 452) writes a predetermined value in a memory address corresponding to the detected position on an area provided in the RAM 456 corresponding to the video RAM 464 according to the received coordinate data. Although the detected image data may be recorded on the video RAM 464, here, in addition to the area for storing the image data in the video RAM 464, the RAM 456 is provided with an area for storing drawing data. Suppose.

  Functions assigned to the function buttons in the function button area 520 include, for example, a drawing function by touch operation (selectable pen type), a function to open a saved file (image data), and an eraser to delete drawing in a predetermined area. A function for displaying image data and display data stored in the RAM 456 or the recording unit 458, a function for saving the displayed image data, a function for printing the displayed image data, and the like. Processing for executing these functions is started by touching an icon as each function button.

[Action / Effect]
The electronic blackboard apparatus 400 according to the present embodiment has the same effects as the image forming apparatus 100 according to the first embodiment.

(Sixth embodiment)
Referring to FIG. 15, the electronic blackboard apparatus 600 according to the present embodiment is capable of registering voices in the characters displayed on the display surface, and thus the electronic blackboard according to the fifth embodiment. Different from the device 400. In other respects, each electronic blackboard device has the same configuration.

  The electronic blackboard device 600 is communicably connected to information processing terminals 700a to 700c (hereinafter collectively referred to as the information processing terminal 700) as external devices via the network 50. Each of the information processing terminals 700a to 700c includes a personal computer.

  A document image is displayed on the display surface of touch panel display 410. The document image includes characters that can be selected (operated) by a user's touch operation. When a character displayed on the display surface is pressed and pressed by the user, a recording menu for recording voice is displayed as in the first embodiment. Voice recording is performed by the user operating the displayed recording menu. The recorded voice data is stored in the recording unit 458 (see FIG. 14) in association with the character operated at the time of recording and the document data including the character.

  The electronic blackboard device 600 can transmit the document data of the document image displayed on the display surface to the information processing terminal 700 via the network device 466 (see FIG. 14) and the network 50. Recorded audio data is attached to the transmitted document data. The information processing terminal 700 receives the document data transmitted from the electronic blackboard device 600. In the information processing terminal 700, application software capable of reading received document data is installed in advance. This application software has a function of reproducing audio data. The information processing terminal 700 displays the received document data on a display according to a user operation. The displayed document image includes characters in which sound is registered. When the character is operated by the user, sound data associated with the character is reproduced.

  In addition, when transmitting the document data to the information processing terminal 700, specific information for specifying a storage location of the voice data may be attached to the document data instead of the voice data. Thereby, it is possible to suppress an increase in communication load during transmission of document data. The voice data may be stored in the recording unit 458 of the electronic blackboard device 600 or may be stored in an external server device.

Software configuration
Referring to FIG. 16, a control structure of a computer program executed by electronic blackboard apparatus 600 for recording sound will be described. This program starts in response to power being supplied to the electronic blackboard device 600.

  This program determines whether or not a long press operation has been performed on a selectable character, and waits until the long press operation is performed. When it is determined in step S2000 that a long press operation has been performed, Step S2010 that is executed and displays the recording menu on the touch panel display 410, and is executed after Step S2010, and it is determined whether or not the “recording start” key included in the recording menu is pressed (touch operation). In response to branching of the control flow accordingly, in step S2020, it is executed if it is determined that the “recording start” key has not been pressed, and whether or not a predetermined time has elapsed since the recording menu was displayed. And step S2030 for branching the control flow according to the determination result. If it is determined in step S2030 that the predetermined time has not elapsed, control returns to step S2020. On the other hand, if it is determined in step S2030 that the predetermined time has elapsed, control returns to step S2000.

  This program is further executed when it is determined in step S2020 that the “recording start” key has been pressed, and is executed after step S2040 for causing the recording device 468 (see FIG. 14) to start voice recording and after step S2040. In step S2050 for displaying the “recording end” key instead of the “recording start” key, and after step S2050, it is determined whether or not the “recording end” key has been pressed. In steps S2060 and S2060 for branching the flow, it is executed when it is determined that the “recording end” key is not pressed, and whether or not a predetermined time has elapsed since the “recording end” key was displayed. And step S2070 for branching the flow of control according to the determination result. If it is determined in step S2070 that the predetermined time has not elapsed, control returns to step S2060. On the other hand, if it is determined in step S2070 that the predetermined time has elapsed, control returns to step S2000.

  This program is further executed in step S2060 when it is determined that the “recording end” key is pressed, and is executed after step S2080 for causing the recording device 468 to end the voice recording, and after step S2080. The voice data) is stored in the recording unit 458 in association with the character operated at the time of recording and the document data including the character. When the process of step S2090 ends, control returns to step S2000.

[Operation]
The electronic blackboard device 600 according to the present embodiment operates as follows. In the following description, only the portion related to the present invention in the operation of the electronic blackboard device 600 will be described. Other operations are the same as those of the conventional electronic blackboard device.

  It is assumed that the electronic blackboard device 600 is used in the meeting. On the touch panel display 410 of the electronic blackboard device 600, a document image as a presentation material is displayed. Referring to FIG. 17, the document image displayed on the display surface includes, for example, character 610 that can be selected by a touch operation. When the user performs a long press operation on character 610 (YES in step S2000 shown in FIG. 16), recording menu 630 including “recording start” key 620 is displayed on touch panel display 410 (step S2010). When a predetermined time elapses with recording menu 630 displayed (NO in step S2020 and YES in step S2030), recording menu 630 is erased. If “recording start” key 620 is pressed by the user before the predetermined time has elapsed (YES in step S2020), recording device 468 starts voice recording (step S2040). The speech at the meeting is recorded. For example, if there is a remark such as “I want to proceed with ... regarding the case of XX, I would like to hear your opinions”, the remark is recorded. The touch panel display 410 displays a recording menu (not shown) including a “recording end” key similar to the “recording end” key 232 shown in FIG. 8 instead of the “recording start” key 620 (see FIG. 8). Step S2050).

  When a predetermined time elapses with the “recording end” key displayed (NO in step S2060 and YES in step S2070), the recording menu including the “recording end” key is deleted. The predetermined time is, for example, about 30 seconds. When this time elapses, the recording content is not saved and the recording is restarted. If the “recording end” key is pressed by the user before the predetermined time has elapsed (YES in step S2060), recording device 468 ends the voice recording (step S2080). The recording device 468 stores the recorded voice (voice data) in the recording unit 458 in association with the character 610 operated at the time of recording and the document data including the character 610 (step S2090). Thereby, the voice is registered in the operated character 610.

  Referring to FIG. 18, when a voice is registered in character 610, speaker icon 640 indicating that the voice can be reproduced is displayed in the vicinity of character 610. When the character 610 is touched (for example, a single touch operation), the electronic blackboard device 600 may proceed with the voice registered in the character 610 (for example “ I would like to hear your opinions ”).

  The document data of the document image displayed on the electronic blackboard device 600 can be transmitted to the information processing terminal 700 as a minutes after the meeting is over. When the voice is registered in the characters included in the document data, the electronic blackboard apparatus 600 transmits the document data to the information processing terminal 700 with the voice data or specific information specifying the storage location of the voice data. .

[Action / Effect]
As described above, the electronic blackboard apparatus 600 according to the present embodiment can register a voice in characters in a document. The document data including the characters in which the voice is registered can be transmitted to the information processing terminal 700 connected to the network 50 as a minutes, for example. Thereby, for example, necessary information can be effectively transmitted to a user who could not participate in the conference.

(Modification)
In the above embodiment, an example in which the present invention is applied to a multifunction peripheral (MFP), which is an example of an image forming apparatus, has been described, but the present invention is not limited to such an embodiment. The image forming apparatus may be a printer, a facsimile machine, or the like other than the multifunction machine. The present invention can be applied to apparatuses other than the image forming apparatus or the electronic blackboard apparatus as long as the apparatus is used by a plurality of users.

  In the said embodiment, although the example which displays a recording menu by the long press operation of an icon or a character was shown, this invention is not limited to such an embodiment. The operation for displaying the recording menu may be an operation other than the long press operation. For example, the recording menu may be displayed by double touch of an icon or a character. Furthermore, the recording may be started or stopped without displaying the recording menu. For example, recording may be started by double touch of an icon or a character. Thereafter, the recording may be terminated by, for example, a single touch on the icon or character.

  In the above-described embodiment, an example in which user authentication is performed when the image forming apparatus is used has been described. However, the present invention is not limited to such an embodiment. A configuration in which user authentication is not performed when the image forming apparatus is used may be employed. In this case, the target user who is permitted to reproduce the recording is not selected.

  In the above-described embodiment, an example in which recording is ended by pressing the “recording end” key is shown, but the present invention is not limited to such an embodiment. For example, the recording may be ended when a predetermined time elapses without pressing the “recording end” key after the recording is started. In this case, the recorded content is saved even when a predetermined time has elapsed.

  In the above-described embodiment, an example in which sound is registered in the icon on the home screen has been described, but the present invention is not limited to such an embodiment. The icon to which the sound is registered is not limited to the home screen icon. For example, it is possible to register a voice in an icon displayed on the basic screen of the operation mode. Various contents are assumed for the registered voice (message). For example, when the network setting is changed, it is conceivable to inform the other user of that fact. Various contents such as what you want to convey to other users, what you want to request, and precautions can be registered by voice.

  In the above-described embodiment, an example in which a sound is reproduced without touching a process by touch operation on a speaker icon has been described. However, the present invention is not limited to such an embodiment. For example, the sound may be played back without starting the process by double touching the icon in which the sound is registered.

  In the above embodiment, the voice registered only by the administrator may be deleted.

  Embodiments obtained by appropriately combining the techniques disclosed above are also included in the technical scope of the present invention.

  The embodiment disclosed herein is merely an example, and the present invention is not limited to the embodiment described above. The scope of the present invention is indicated by each claim of the claims after taking into account the description of the detailed description of the invention, and all modifications within the meaning and scope equivalent to the wording described therein are included. Including.

100 Image forming apparatus 112, 452 CPU
114, 454 ROM
116, 456 RAM
118 Storage Device 122 Operation Panel 124, 468 Recording Device 130 Document Reading Unit 140 Image Processing Unit 150 Image Forming Unit 170 User Authentication Device 210-224 Icon 230, 620 “Recording Start” Key 232 “Recording End” Key 250 Target User Selection Screen 400, 600 Electronic blackboard device 410 Touch panel display 450 Control device 458 Recording unit 466 Network device 610 Character 700 Information processing terminal

Claims (8)

A display-integrated operation panel having a display surface;
UI component display means for displaying an image of a user interface (UI) component on the display surface;
In response to accepting a user operation on the UI component displayed on the display surface, a process activation unit for activating a process associated with the UI component;
In response to receiving a predetermined operation different from the operation on the UI component displayed on the display surface, recording start means for starting recording of voice;
In response to satisfying a predetermined condition after voice recording is started by the recording start means, recording end means for ending voice recording;
Storage means for storing the recorded voice data in association with the UI component after the recording of voice is ended by the recording end means;
In response to accepting a user operation on the UI component, it is determined whether audio data associated with the UI component is stored in the storage unit, and the determination result is affirmative. And a reproducing means for reproducing audio data stored in association with the UI component when the process is activated by the process activation means. The recording start means is
Recording for displaying an image of a recording start UI component that receives a recording start instruction on the display surface in response to receiving the predetermined operation on the UI component displayed on the display surface Start UI display means;
Voice recording start means for starting voice recording in response to accepting a user operation on the recording start UI component displayed on the display surface by the recording start UI display means;
The recording end means is
In response to accepting a user operation on the recording start UI component, a recording end UI display means for displaying an image of the recording end UI component on the display surface instead of the image of the recording start UI component; ,
Voice recording ending means for ending voice recording in response to receiving a user's operation on the recording end UI component displayed on the display surface by the recording end UI display means. Item 4. The display operation device according to Item 1.   The recording end means includes a voice recording end means for ending a voice recording in response to a lapse of a predetermined time from the start of voice recording by the recording start means. The display operation device described. The display operation device further includes
User authentication means for authenticating the user;
A user designating unit for designating a user who is allowed to reproduce the voice data recorded from the users who can be authenticated by the user authentication unit;
In response to the user specified by the user specifying means being authenticated by the user authenticating means, validating means for validating the reproduction processing of the audio data stored in association with the UI component; The display operation device according to any one of claims 1 to 3, further comprising:   In response to receiving a predetermined operation on the UI component, the display operation device further determines whether audio data associated with the UI component is stored in the storage unit, and determines 2. Reproducing means for reproducing audio data stored in association with the UI component without activating the process by the process activating means in response to a positive result. The display operation device according to claim 4.   The display operation device according to claim 1, wherein the UI component display unit includes an icon display unit for displaying an icon image on the display surface as the UI component image. The display operation device according to any one of claims 1 to 6,
A document reading device connected to the display operation device for reading a document in accordance with an instruction from the display operation device and converting the document into image data;
Connected to the display operation device and the document reading device, accumulates image data output from the document reading device, and forms an image of the image data on a recording sheet in response to an output instruction from the display operation device. An image forming apparatus including an image forming unit.   An electronic blackboard device comprising the display operation device according to claim 1.

Images