JP2015080120A - Image processing system, image processing device, and mobile terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing system capable of preventing leakage of confidential information given by voice, and the like when an image processing device is operated by voice input from a mobile terminal device.SOLUTION: When a user gives an operation instruction by voice input from a mobile terminal device 2, it is determined whether a setting value related to an operation corresponding to the operation instruction is set as confidential information. When determined that such a setting value is set as confidential information, any one of the mobile terminal device 2 and an image processing device 1: brings the setting value obtained from the other device together with the setting value held by itself; replaces each setting value to another identification information; and associates the replaced identification information with the setting value before the replacement so as to display them on display means 42 of the mobile terminal device 2. When the user inputs the replaced identification information from the mobile terminal device 2, the setting value corresponding to the identification information is specified so that the operation corresponding to the operation instruction inputted by voice is performed by using this specified setting value.

Description

  The present invention provides an image processing apparatus such as an MFP (Multi Function Peripherals) which is a multifunction digital multi-function peripheral, and a mobile terminal apparatus such as a smartphone or a tablet terminal capable of remotely operating the image processing apparatus by voice input. The present invention relates to a processing system, an image processing device, and a mobile terminal device.

  A technique for remotely operating an image processing apparatus such as the MFP wirelessly connected from a mobile terminal apparatus such as a smartphone or a tablet terminal is already known.

  Recently, a technique for operating an image processing apparatus by giving an operation instruction by voice input to a mobile terminal apparatus without operating a touch panel or the like has been considered.

  However, when voice input is performed, the contents of the sound can be heard in the surroundings, and if the contents of the sound are related to confidential information, the confidential information may be leaked.

  Patent Document 1 proposes a system for converting voice input data so that confidential information does not leak to the surroundings when voice input is performed.

JP 2006-178203 A

  However, since the technique described in Patent Document 1 is not a technique for remotely operating an image processing apparatus such as the MFP that is wirelessly connected from a portable terminal apparatus, it is possible to prevent leakage of confidential information on the portable terminal apparatus side. I couldn't.

  The present invention has been made in view of such a situation, and an image capable of preventing leakage of confidential information by emitting confidential information as sound when the image processing apparatus is remotely operated from a portable terminal device by voice input. It is an object to provide a processing system, an image processing device, and a mobile terminal device.

The above problem is solved by the following means.
(1) An image processing system including an image processing device and a portable terminal device capable of remotely operating the image processing device by voice input, the voice input means provided in the portable terminal device, and the image processing device Provided in at least one of the mobile terminal device or the image processing device and corresponding to the operation instruction. Determining means for determining whether or not a setting value related to the operation to be performed is set as confidential information; and at least one of the portable terminal device or the image processing device, and the setting value is set as confidential information If it is determined that one of the portable terminal device or the image processing device has the set value acquired from the other and the own device The setting values that are included, and a replacement unit that replaces each setting value with different identification information and the portable terminal device are provided, and the replaced identification information is displayed in association with the setting value before replacement. A specification that is provided in at least one of the display unit and the portable terminal device or the image processing device, and that specifies a setting value corresponding to the identification information from the identification information that is voice-input by the voice input unit of the portable terminal device And an execution unit that is provided in the image processing apparatus and executes an operation corresponding to the operation instruction inputted by voice using the specified set value. system.
(2) The image processing system according to item 1, wherein at least one of the portable terminal device or the image processing device includes a setting unit that sets the setting value to be releasable as confidential information based on a user operation.
(3) The image processing system according to (1) or (2), wherein the identification information is changed every time operation information is input by a user or every fixed time.
(4) An image processing apparatus used in the image processing system according to any one of items 1 to 3.
(5) A mobile terminal device used in the image processing system according to any one of items 1 to 3.

  According to the invention described in item (1), when a user gives an operation instruction by voice input from the mobile terminal device, it is determined whether or not a setting value related to the corresponding operation is set as confidential information. When it is determined that it is set as confidential information, one of the mobile terminal device or the image processing device summarizes the setting value acquired from the other and the setting value held by the own device, and each setting value Is replaced with another identification information, and the replaced identification information is displayed on the display means of the portable terminal device in association with the set value before the replacement.

  When the user inputs voice of the replaced identification information from the mobile terminal device, a setting value corresponding to the identification information is specified, and an operation corresponding to the operation instruction input by voice is executed using the specified setting value. Is done.

  As described above, when the setting value is confidential information, one of the mobile terminal device or the image processing device summarizes the setting value acquired from the other and the setting value held by the own device, and sets each setting value. Since it is replaced with another identification information, the user only has to input the replaced identification information by voice, so even if the voice leaks to the surroundings, the confidential information itself will not leak, preventing leakage of security and ensuring security. It can be an excellent system.

  According to the invention described in item (2), the user can set whether or not the setting value is handled as confidential information.

  According to the invention described in item (3) above, since the identification information replaced with the setting value, which is confidential information, is changed every time the operation information is input by the user or every fixed time period, Can be more reliably prevented.

  According to the invention described in item (4) above, when the user remotely operates the image processing apparatus by voice input from the portable terminal apparatus, it is possible to prevent the leakage of confidential information and to make the image processing apparatus excellent in security.

  According to the invention described in the above item (5), when the user remotely operates the image processing device by voice input from the portable terminal device, it is possible to prevent the leakage of confidential information and to make the portable terminal device excellent in security.

1 is a configuration diagram of an image processing system according to an embodiment of the present invention. It is a block diagram which shows the structure of the principal part of an image processing apparatus and a portable terminal device. It is a voice input standby top screen of a portable terminal device. It is a voice input standby top screen of the image processing apparatus. 6 is a confidential information setting screen displayed on the image processing apparatus for setting confidential information. It is a table | surface which shows an example of a mail transmission destination replacement table. This is a mail address list screen displayed on the image processing device when the user inputs "mail" from the mobile terminal device. It is a screen displayed on a portable terminal device after receiving a mail transmission destination replacement table from the image processing device. It is a table | surface which shows an example of a file name substitution table. This is a screen of a list of file names displayed on the image processing device when the user inputs “file” by voice from the mobile terminal device. It is a screen displayed on a portable terminal device after receiving a file name replacement table from the image processing device. It is a flowchart which shows operation | movement of a portable terminal device. It is a flowchart which shows the subroutine of the task execution process according to the audio | voice input of FIG.12 S13. It is a flowchart which shows operation | movement of an image processing apparatus. It is a flowchart which shows the subroutine of the task execution process according to the audio | voice input of step S29 of FIG.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a configuration diagram of an image processing system according to an embodiment of the present invention. This system has an image processing device 1 and a portable terminal device 2, which can be connected by wireless communication.

  The image processing apparatus 1 may be connected to the wireless access point 3 as shown in FIG. 1 (A) and communicate with the portable terminal device 2 via the wireless access point 3, or as shown in FIG. 1 (B). When the image processing apparatus is equipped with a wireless local area network (LAN) function, it may be directly connected to the mobile terminal device 2 for communication.

  In this embodiment, the above-described MFP having a copy function, a print function, a scan function, a facsimile function and the like is used as the image processing apparatus 1. Hereinafter, the image processing apparatus is also referred to as an MFP. The mobile terminal device is also referred to as a mobile terminal. For the mobile terminal 2, a smartphone, a tablet terminal, electronic paper, or the like is used.

  FIG. 2 is a block diagram showing a configuration of main parts of the MFP 1 and the portable terminal 2.

  The MFP 1 and the mobile terminal 2 include a system control unit 41, a display output unit 42, a network control unit 43, a voice input unit 44, a voice recognition unit 45, a confidential information setting unit 46, a replacement table generation unit 47, and a replacement data comparison unit 48, respectively. A task execution unit 49 and the like.

  When it is necessary to distinguish between the constituent members of the MFP 1 and the portable terminal 2, M (component member of the MFP) or K (constituent member of the portable terminal) is appended to the number of each constituent member. For example, the display output unit of the MFP 1 is indicated by 42M, and the display output unit of the portable terminal 2 is indicated by 42K.

  The system control unit 41 controls the MFP 1 or the portable terminal 2 as its own device, and includes a CPU (not shown), a ROM storing a CPU operation program, and the like when the CPU operates according to the operation program. A RAM or the like for providing a work area is provided. In addition to the basic OS, the MFP 1 and the portable terminal 2 are each installed with an application for operating the MFP 1 by voice from the portable terminal 2.

  The display output unit 42 displays a screen, a message, the state of the device, and the like, and includes a liquid crystal display device with a touch panel.

  The network control unit 43 controls the communication state with the network. The voice input unit 44 is for inputting a user's voice and is composed of a microphone or the like. The voice recognition unit 45 is for recognizing voice data input by the voice input unit.

  The confidential information setting unit 46 is used by the user to set whether the stored information is handled as confidential. If it is set to be handled as confidential, it can be canceled.

  The replacement table generation unit 47 generates a replacement table in which each set value is replaced with another identification information when an operation to set information set to be handled as confidential is instructed. At this time, the replacement table generating unit 47 combines the set values acquired from the partner device and the set values in the own device, and replaces each set value with different identification information.

  When the user inputs identification information by voice, the replacement data comparison unit 48 compares the replacement table generated by the replacement table generation unit 47 with the identification information, and specifies a setting value corresponding to the identification information. .

  The task execution unit 49 uses the specified set value to execute an operation for the operation instruction input by voice.

  Although not shown, each of the MFP 1 and the portable terminal 2 includes a storage unit configured by a hard disk device or the like, and stores, for example, files with a plurality of mail transmission destinations and file names.

  Next, the operation of the image processing system will be described.

  FIG. 3 is a voice input standby top screen of the mobile terminal 2. When the user designates the MFP 1 that the user wants to use on the portable terminal 2 and activates the voice input mode, the portable terminal 2 sets its own device in the voice input mode and sends a voice input mode activation message including its own identification number to the MFP 1. Send. The identification number may be a simple integer or a character string such as a MAC address.

  FIG. 4 is a voice input standby top screen of the MFP 1. When the MFP 1 receives the voice input mode activation message from the portable terminal 2, the MFP 1 activates the voice input mode and transmits a response message including its own identification number to the portable terminal 2. The identification number may be a simple integer or a character string such as a MAC address.

  FIG. 5 is a confidential information setting screen displayed on the display output unit of the MFP 1 in order to set confidential information. The user can select which setting value is treated as confidential information. It can also be set invalid so that it is not treated as confidential information.

  In this embodiment, a valid button for validating the setting contents, an invalid button for invalidating the setting contents, a mail transmission destination button, an FTP transmission destination button, an SMB transmission destination button as types of setting values that can be set, A file name button, a cancel button, an OK button, and the like are displayed. The buttons and setting values indicated by hatching indicate that they are selected, and an effective button, a mail transmission destination button, and a file name button are selected. Pressing the OK button confirms the selection, and pressing the cancel button cancels the selection.

  Note that whether to treat as confidential information or which setting value to treat as confidential information may be set from the mobile terminal 2.

  When the user gives an operation instruction by voice input from the portable terminal 2, the voice recognition unit recognizes this and transmits voice data to the MFP 1.

  The MFP 1 determines whether the instructed operation is a setting value setting operation in which confidential information is set. When it is determined that the setting operation for setting the confidential information is performed, the setting value held by the portable terminal 2 is acquired from the portable terminal 2, and the acquired setting value and the confidential information held by the own device are acquired. Are combined and combined, and each setting value is replaced with another identification information to generate a replacement table.

  For example, when the user inputs “mail” by voice on the mobile terminal 2, the MFP 1 and the mobile terminal 2 recognize the user's voice. The portable terminal 2 transmits its mail destination information as a setting value set as confidential information to the MFP 1 based on a request from the MFP 1. The MFP 1 collects its own mail destination information as a setting value set as confidential information and the mail destination information received from the mobile terminal 2, replaces each mail destination information with different identification information, and any of the devices. By adding information indicating whether the destination information is held, one mail destination replacement table is generated, and the generated destination replacement table is transmitted to the mobile terminal 2.

  FIG. 6 is a table showing an example of the mail destination replacement table.

  For example, the mail transmission destination “Abe” is replaced with the identification information “Atesaki1”, which indicates that the setting value is retained in the MFP 1. In addition, the mail transmission destination “Andou” is replaced with identification information “Receiver 1”, which indicates that the setting value is held in the mobile terminal 2.

  The character string of the identification information after replacement may be generated using the creation date / time or the update date / time, or may be a random character string. Further, the identification information may be changed every time operation information is input by the user or every fixed time. For example, when a transition is made to another screen by voice input and then a transition is made to the mail destination screen again, or when a certain time has elapsed, the screen is replaced again. The MFP 1 transmits the generated replacement table to the mobile terminal 2. In this way, by changing the identification information that is replaced with the setting value that is confidential information, it is possible to more reliably prevent confidential leakage.

  FIG. 7 is a mail destination list screen displayed on the display output unit of the MFP 1 when the user inputs “mail” from the mobile terminal 2, and a mail transmission destination replacement table is transmitted to the mobile terminal 2. Therefore, the destination list is not displayed, and a message “Displaying on the mobile terminal” is displayed. However, nothing may be displayed.

  FIG. 8 shows a screen displayed on the portable terminal 2 after receiving the mail transmission destination replacement table from the MFP 1. This screen displays the mail transmission destinations before and after replacement of the replacement table received from the MFP 1.

  When the user says, for example, “Receiver 1”, the MFP 1 and the portable terminal 2 recognize the voice, search for a corresponding mail transmission destination from the replacement table, and specify “Andou” as a destination corresponding to “Receiver 1”. Since this mail transmission destination is information (setting value) held by the mobile terminal 2, the mobile terminal 2 sets “Andou” as the mail transmission destination.

  Next, the user speaks “file” to input a voice to designate a file to be sent by mail. The portable terminal 2 recognizes voice, and the MFP 1 recognizes voice data transmitted from the portable terminal 2. The mobile terminal 2 transmits information on the file name stored in itself to the MFP 1, and the MFP 1 receives information on the file name stored in the box that is a storage area of its own storage device and the file name received from the mobile terminal 2. Summarize information, replace each file name information as a setting value with another identification information, add information indicating which file name information is held by one device, and create one file name replacement table The generated file name replacement table is transmitted to the portable terminal 2.

  FIG. 9 is a table showing an example of the file name replacement table.

  For example, the file name “Suzuki Giken Outsourcing.xls” is replaced with the identification information “aaa”, which indicates that the setting value is held in the mobile terminal 2. In addition, the file name “presentation material.ppt” is replaced with identification information “bbb”, which indicates that the setting value is retained in the MFP 1.

  FIG. 10 is a file name list screen displayed on the display output unit of the MFP 1 when the user inputs a voice “file” from the mobile terminal 2. The file name replacement table is transmitted to the mobile terminal 2. Therefore, the file name list is not displayed, and the message “Displaying on the mobile terminal” is displayed. However, nothing may be displayed.

  FIG. 11 shows a screen displayed on the portable terminal 2 after receiving the file name replacement table from the MFP 1. On this screen, the file names before and after replacement of the replacement table received from the MFP 1 are displayed.

  For example, when the user says “bbb”, the MFP 1 and the portable terminal 2 recognize the voice, search the replacement table for the corresponding file name, and specify “presentation material.ppt” as the file name corresponding to “bbb”. To do. Since the file with this file name is a file (setting value) held by the MFP 1, the MFP 1 sets “presentation material.ppt” as a mail transmission file. Before this, the portable terminal 2 that has been set as the mail destination transmits the set destination information to the MFP 1.

  After that, when the user says “Send”, the MFP 1 sends “Mail” with “Presentation material.ppt” to “Andou”.

  As described above, in this embodiment, when the setting value is confidential information, the setting value acquired by the MFP 1 from the portable terminal 2 and the setting value held by the own apparatus are combined and each setting value is set separately. Since the information is replaced with the identification information, the user only has to input the replaced identification information by voice. If the voice leaks to the surroundings, the surrounding third party cannot understand the content. Therefore, the confidential information itself is not leaked, and it is possible to provide a system, MFP 1 and portable terminal 2 with excellent security by preventing the leakage of confidential information.

  FIG. 12 is a flowchart showing the operation of the mobile terminal 2.

  The portable terminal 2 broadcasts to the network using the MAC address of the MFP 1 selected by the user in step S1, and checks whether there is a response in step S2. If there is no response (NO in step S2), the fact that an error has occurred is displayed on the screen in step S14, and the process ends. If there is a response (YES in step S2), it is determined that the communication connection with MFP 1 is established, and in step S3, a voice input mode activation command signal is input based on a user operation (NO in step S3). .

  When the voice input mode activation command signal is input (YES in step S3), after the voice input mode is activated in step S4, a voice input mode activation message including its own identification number is transmitted to the MFP 1 in step S5. .

  In step S6, it is determined whether or not there is a response from the MFP 1 within a predetermined time. If not (NO in step S6), an error is displayed in step S14, and the process ends. If there is a response from the MFP 1 (YES in step S6), a voice input is waited for in step S7.

  In step S8, it is determined whether a replacement table has been transmitted from MFP1. If it is transmitted (YES in step S8), the contents of the replacement table are displayed on the screen in step S9, and then the process proceeds to step S10. If the replacement table is not transmitted (NO in step S8), the process proceeds directly to step S10.

  In step S10, it is determined whether or not a voice is input. If not input (NO in step S10), the process returns to step S8. When the replacement table is received again from the MFP 1 in this state, the display of the replacement table is updated.

  When a voice is input (YES in step S10), after the voice is recognized in step S11, it is determined in step S12 whether or not the user has instructed the end of the operation.

  If the operation end is not instructed (NO in step S12), a task execution process corresponding to the voice input is performed in step S13, and the process returns to step S8. When the operation end is instructed (YES in step S12), the process ends.

  FIG. 13 is a flowchart showing a subroutine of task execution processing corresponding to the voice input in step S13 of FIG.

  In step S131, it is determined whether or not the instruction of the input voice is to shift to the confidential screen, in other words, whether or not an operation that needs to set a setting value that is confidential information is instructed. If the instruction of the input voice does not shift to the confidential screen (NO in step S131), the corresponding process is executed in step S138, the subroutine is terminated, and the process returns to the flowchart of FIG.

  If the input voice instruction is to shift to a confidential screen (YES in step S131), after transitioning to the corresponding screen in step S132, a message is received from MFP 1, and in step S134, the message is classified as confidential information. Check if the message requests the set value. If the message requests a setting value set as confidential information (YES in step S134), after transmitting the confidential setting value to MFP 1 in step S135, in step S136, a replacement table is received from MFP 1 and displayed on the screen. After displaying, this subroutine is terminated.

  If the message is not a message requesting a setting value set as confidential information (NO in step S134), the process proceeds to the corresponding screen in step S137, and then this subroutine is terminated.

  FIG. 14 is a flowchart showing the operation of the MFP 1.

  In step S21, the MFP 1 waits for reception of a voice input mode activation message from the portable terminal 2 (NO in step S21).

  When the voice input mode activation message is received (YES in step S21), after the voice input mode is activated in step S22, a response message including its own identification number is transmitted to the portable terminal 2 in step S23. Next, in step S24, the process waits for voice input.

  Until the replacement table is generated, the process of step S25 is not executed, and it is determined in step S26 whether or not a voice is input. If it is not input (NO in step S26), the process returns to step S25.

  When a voice is input (YES in step S26), after the voice is recognized in step S27, it is determined in step S28 whether or not the user has instructed the end of the operation.

  If the operation end is not instructed (NO in step S28), task execution processing corresponding to the voice input is performed in step S29, and the process returns to step S5. When the operation end is instructed (YES in step S28), the process ends.

  If a replacement table is generated by the task execution process in step S29, it is determined in step S25 whether a fixed time has elapsed after the generation of the replacement table. When a certain time has elapsed (YES in step S25), in step S30, a replacement table is generated again and transmitted to the portable terminal 2, and then the process proceeds to step S26. If the predetermined time has not elapsed since the generation of the replacement table (NO in step S25), the process proceeds directly to step S26.

  FIG. 15 is a flowchart showing a subroutine of task execution processing corresponding to the voice input in step S29 of FIG.

  In step S2901, it is determined whether or not the input voice instruction shifts to the confidential screen, in other words, whether or not an operation that requires setting of a setting value that is confidential information is instructed. If the instruction of the input voice does not shift to the confidential screen (NO in step S2901), the corresponding process is executed in step S2910, the subroutine is terminated, and the process returns to the flowchart of FIG.

  If the instruction of the input voice is to shift to the confidential screen (YES in step S2901), after transitioning to the corresponding screen in step S2902, it is determined in step S2903 whether the confidential setting is valid.

  If the confidential setting is valid (YES in step S2903), in step S2904, a message “displaying a list on the portable terminal” is displayed, and then in step S2905, a request message for the setting value of confidential information is displayed in portable terminal 2. And proceeds to step S2906.

  In step S2906, it is checked whether or not the setting value has been transmitted from the portable terminal 2 within a predetermined time. If it has been transmitted (YES in step S2906), a replacement table is generated in step S2907 and transmitted to the portable terminal 2. After that, this subroutine is finished and the process returns to the flowchart in the figure. If the set value is not transmitted from the portable terminal 2 within a predetermined time (NO in step S2906), the fact that an error has occurred is displayed on the screen in step S2908, and then this subroutine is terminated.

  If the confidential setting is not valid in step S2903 (NO in step S2903), after transitioning to the corresponding screen in step S2909, after transmitting a message not to transmit the replacement table to the portable terminal 2 in step S2910, This subroutine ends.

  Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment.

  For example, although the case where the replacement table is generated by the MFP 1 is shown, the replacement table may be generated by the portable terminal 2. In this case, the MFP 1 transmits the set value as confidential information held by the portable terminal 2, and the portable terminal 2 summarizes the received setting value of the MFP 1 and the set value held by the own apparatus. Replace with other identification information.

  Further, although the MFP 1 determines whether or not the setting value related to the operation corresponding to the operation instruction is set as confidential information, it may be performed by the portable terminal 2.

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 2 Portable terminal device 41 System control part 42 Display output part 43 Network control part 44 Voice input part 45 Voice recognition part 46 Confidential information setting part 47 Replacement table generation part 48 Replacement data comparison part 49 Task execution part

Claims (5)

An image processing system comprising an image processing device and a portable terminal device capable of remotely operating the image processing device by voice input,
Voice input means provided in the portable terminal device;
A receiving unit that is provided in the image processing device and receives an operation instruction voice-input by a user from a voice input unit of the portable terminal device;
A determination unit that is provided in at least one of the portable terminal device and the image processing device and determines whether a setting value related to an operation corresponding to the operation instruction is set as confidential information;
Provided in at least one of the mobile terminal device or the image processing device, and when it is determined that the set value is set as confidential information, one of the mobile terminal device or the image processing device is the other The setting value acquired from the above and the setting value held by the device itself are combined, and a replacement unit that replaces each setting value with different identification information;
Display means provided in the portable terminal device, and displaying the replaced identification information in correspondence with the setting value before replacement;
A specifying unit that is provided in at least one of the mobile terminal device or the image processing device, and that specifies a setting value corresponding to the identification information from the identification information that is voice-input by a voice input unit of the mobile terminal device;
An execution unit that is provided in the image processing device and executes an operation corresponding to the operation instruction input by voice using the specified setting value;
An image processing system comprising:   The image processing system according to claim 1, wherein at least one of the portable terminal device or the image processing device includes a setting unit that sets the setting value to be releasable as confidential information based on a user operation.   The image processing system according to claim 1, wherein the identification information is changed every time operation information is input by a user or every fixed time.   An image processing apparatus used in the image processing system according to claim 1.   The portable terminal device used for the image processing system in any one of Claims 1-3.

Images