US20180324316A1 - Image processing apparatus, and remote operation system for image processing apparatus - Google Patents

Image processing apparatus, and remote operation system for image processing apparatus Download PDF

Info

Publication number
US20180324316A1
US20180324316A1 US16/023,966 US201816023966A US2018324316A1 US 20180324316 A1 US20180324316 A1 US 20180324316A1 US 201816023966 A US201816023966 A US 201816023966A US 2018324316 A1 US2018324316 A1 US 2018324316A1
Authority
US
United States
Prior art keywords
image processing
processing apparatus
terminal device
functions
wireless communication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/023,966
Inventor
Takeshi Tani
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp Corp
Original Assignee
Sharp Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Corp filed Critical Sharp Corp
Priority to US16/023,966 priority Critical patent/US20180324316A1/en
Publication of US20180324316A1 publication Critical patent/US20180324316A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00281Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal
    • H04N1/00307Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal with a mobile telephone apparatus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/00411Display of information to the user, e.g. menus the display also being used for user input, e.g. touch screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/00413Display of information to the user, e.g. menus using menus, i.e. presenting the user with a plurality of selectable options
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00493Particular location of the interface or console
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00962Input arrangements for operating instructions or parameters, e.g. updating internal software
    • H04N1/00973Input arrangements for operating instructions or parameters, e.g. updating internal software from a remote device, e.g. receiving via the internet instructions input to a computer terminal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32609Fault detection or counter-measures, e.g. original mis-positioned, shortage of paper
    • H04N1/32646Counter-measures
    • H04N1/32651Indicating or reporting
    • H04N1/32662Indicating or reporting remotely, e.g. to the transmitter from the receiver
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/0008Connection or combination of a still picture apparatus with another apparatus
    • H04N2201/0034Details of the connection, e.g. connector, interface
    • H04N2201/0048Type of connection
    • H04N2201/0055By radio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/0008Connection or combination of a still picture apparatus with another apparatus
    • H04N2201/0074Arrangements for the control of a still picture apparatus by the connected apparatus
    • H04N2201/0075Arrangements for the control of a still picture apparatus by the connected apparatus by a user operated remote control device, e.g. receiving instructions from a user via a computer terminal or mobile telephone handset
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/0077Types of the still picture apparatus
    • H04N2201/0094Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception

Definitions

  • the present invention relates to an image processing apparatus configured to be capable of being remotely operated by a terminal device via a wireless communication line, and to a remote operation system for such an image processing apparatus.
  • an image processing apparatus is configured to be capable of not only being operated by a body operation unit mounted in the image processing apparatus but also being remotely operated by a portable type terminal device such as a smartphone and a tablet terminal device, via a wireless communication line (see Japanese Patent Laid-Open publication No. 2011-103572, for example).
  • an image processing apparatus having been proposed, the image processing apparatus being configured so as to disable a touch operation with respect to the specific operation key of the terminal device to cause the image processing apparatus to execute the above described specific action when the user is far from the image processing apparatus, (see Japanese Patent Laid-Open publication No. 2013-000985, for example).
  • the user is not required to pay attention so as not to operate the specific operation key when being far from the image processing apparatus, which improves the operability of the terminal device.
  • the user who is operating the terminal device gets confused due to a failure to cause the image processing apparatus to execute an action intended by the user, which may cause a risk of reducing the operability of the user who is operating the terminal device.
  • An object of the present invention is to provide an image processing apparatus capable of improving operability even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time, and to provide a remote operation system for such an image processing apparatus.
  • An image processing apparatus is configured to be capable of being remotely operated by a terminal device via a wireless communication line.
  • the image processing apparatus is equipped with a body operation unit, a positional relationship acquisition unit, and a control unit.
  • the body operation unit is capable of displaying a plurality of operation keys and capable of receiving a touch operation with respect to each of the plurality of operation keys.
  • the positional relationship acquisition unit is used in order to acquire a positional relationship between the terminal device and the image processing apparatus.
  • the control unit is configured so as to acquire the positional relationship between the terminal device and the image processing apparatus by using the positional relationship acquisition unit and, when determining that the terminal device is located close to the image processing apparatus, disable a touch operation with respect to a specific operation key among the plurality of operation keys on the body operation unit.
  • the touch operation with respect to a specific operation key on the body operation unit is disabled, which can prevent the image processing apparatus from executing an action unintended by the user of the terminal device and can also improve the operability of the user of the terminal device.
  • a user of the body operation unit from the fact that the specific operation key is disabled, can recognize that the terminal device is located close to the image processing apparatus and the image processing apparatus is about to execute an action instructed by the user of the terminal device or is executing the action, so that the user of the body operation unit can be prevented from getting confused.
  • operability can be improved even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time.
  • a remote operation system for an image processing apparatus is equipped with a terminal device and an image processing apparatus configured to be capable of being remotely operated by the terminal device via a wireless communication line.
  • the image processing apparatus is equipped with a body operation unit, a first positional relationship acquisition unit, and a body control unit.
  • the body operation unit is capable of displaying a plurality of operation keys and capable of receiving a touch operation with respect to each of the plurality of operation keys.
  • the first positional relationship acquisition unit is used in order to acquire a positional relationship between the terminal device and the image processing apparatus.
  • the body control unit is configured so as to acquire the positional relationship between the terminal device and the image processing apparatus by using the first positional relationship acquisition unit, and, when determining that the terminal device is located close to the image processing apparatus, disable a touch operation with respect to a specific operation key among the plurality of operation keys on the body operation unit.
  • the touch operation with respect to the specific operation key on the body operation unit is disabled, which can prevent the image processing apparatus from executing an action unintended by a user of the terminal device and can also improve the operability of the user of the terminal device.
  • a user of the body operation unit from the fact that the specific operation key is disabled, can recognize that the terminal device is located close to the image processing apparatus and the image processing apparatus executes an action instructed by the user of the terminal device, so that the user of the body operation unit can be prevented from getting confused. According to the present invention, operability can be improved even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time.
  • FIG. 1 is a block diagram showing a schematic configuration of a remote operation system including an image processing apparatus according to a first preferred embodiment of the present invention.
  • FIG. 2 is a flow chart showing process steps in the image processing apparatus.
  • FIG. 3 is a flow chart showing process steps in a terminal device.
  • FIG. 4A to FIG. 4C are views showing exemplary displays of operation units in a case in which the terminal device is located close to the image processing apparatus:
  • FIG. 4A shows an exemplary display of a body operation unit equipped in the image processing apparatus
  • FIG. 4B shows an exemplary display when a disabled operation key of the body operation unit is operated
  • FIG. 4C shows an exemplary display of a terminal operation unit equipped in the terminal device.
  • FIG. 5A to FIG. 5C are views showing exemplary displays of operation units in a case in which the terminal device is located far from the image processing apparatus: FIG. 5A shows an exemplary display of the body operation unit, FIG. 5B shows an exemplary display of the terminal operation unit, and FIG. 5C shows an exemplary display when a disabled operation key of the terminal operation unit is operated.
  • FIG. 6A to FIG. 6C are views showing exemplary displays of an error message on operation units in a case in which the terminal device is located close to the image processing apparatus, in a remote operation system including an image processing apparatus according to a second preferred embodiment of the present invention:
  • FIG. 6A shows an exemplary display of a body operation unit
  • FIG. 6B shows an exemplary display of a terminal operation unit
  • FIG. 6C shows an exemplary display of an error message when application software other than application software for remote operation of the image processing apparatus is being operated in the terminal device.
  • FIG. 7A and FIG. 7B are views showing exemplary displays of an error message on operation units in a case in which the terminal device is located far from the image processing apparatus, in the remote operation system including the image processing apparatus according to the second preferred embodiment of the present invention:
  • FIG. 7A shows an exemplary display of the body operation unit
  • FIG. 7B shows an exemplary display of the terminal operation unit.
  • FIG. 8A and FIG. 8B are views showing exemplary displays in a terminal operation unit of a terminal device located far from an image processing apparatus, in a remote operation system including the image processing apparatus according to a third preferred embodiment of the present invention:
  • FIG. 8A shows an exemplary display of a message indicating that a video captured by a camera can be displayed
  • FIG. 8B shows an exemplary display of the video captured by the camera.
  • a remote operation system 1 including an image processing apparatus 10 includes one or more terminal devices 20 in addition to the image processing apparatus 10 .
  • the image processing apparatus 10 is a multifunctional machine that has various functions, such as a printer function, a copy function, a facsimile function, and a Scan to E-Mail function.
  • the terminal device 20 may be a portable type terminal device that has a wireless communication function, such as a smartphone and a tablet terminal device.
  • application software for remote operation of the image processing apparatus 10 is installed.
  • the image processing apparatus 10 is equipped with a body control unit 11 , a Local Area Network (LAN) interface 12 , a body operation unit 13 , and an image processing unit 14 .
  • LAN Local Area Network
  • the LAN interface 12 is connected to a router 31 arranged near the image processing apparatus 10 , and enables Internet connection via the router 31 .
  • the router 31 and the image processing apparatus 10 are arranged in the same room.
  • the body operation unit 13 is capable of displaying various operation screens including a plurality of operation keys and receives an input operation, that is, a touch operation of a user, with respect to each of the plurality of operation keys.
  • a liquid crystal touch panel is used as the body operation unit 13 .
  • the image processing unit 14 includes an image reading unit that reads an image of a document and generates image data, and an image forming unit that forms an image on a sheet of paper based on the image data. While, as an example, the image forming unit 14 executes an electrophotographic image forming process, the image forming unit 14 may be made to execute other image forming processes such as an inkjet process.
  • the body control unit 11 when receiving an input of an action instruction from the terminal device 20 through the body operation unit 13 or the LAN interface 12 , acts in accordance with the action instruction. For example, the body control unit 11 executes the copy function in which an image read from a document in the image processing unit 14 is copied onto a sheet of paper.
  • the body control unit 11 is configured to control each unit of the image processing apparatus 10 in an integrated manner.
  • the image processing apparatus 10 is configured to be capable of being remotely operated by the terminal device 20 via a wireless communication line.
  • the terminal device 20 is equipped with a terminal control unit 21 , a mobile communication interface 22 , a wireless LAN interface 23 , and a terminal operation unit 24 .
  • the mobile communication interface 22 enables internet connection by a mobile communication line that is commonly called as 3G, 4G, LTE (Long Term Evolution), and the like, through a mobile base station 32 .
  • the mobile communication interface 22 is used for communication by the mobile communication line.
  • the wireless LAN interface 23 performs wireless communication with a wireless access point (hereinafter will be referred to as “wireless AP”) 33 , and further enables wireless communication with the body control unit 11 of the image processing apparatus 10 through the router 31 and the LAN interface 12 .
  • the wireless LAN interface 23 is used for communication by a wireless LAN line. It is to be noted that, in place of the router 31 and the wireless AP 33 , a wireless LAN router in which both are integrated can be used.
  • the terminal operation unit 24 is capable of displaying various operation screens including a plurality of operation keys and receives an input operation, that is, a touch operation of a user, with respect to each of the plurality of operation keys.
  • a liquid crystal touch panel is used as the terminal operation unit 24 .
  • the terminal control unit 21 when receiving an input of an action instruction from the terminal operation unit 24 , acts in accordance with the action instruction. For example, in a state in which the application software for remote operation of the image processing apparatus 10 is activated, if an input operation for executing the copy function of the image processing apparatus 10 is performed, an action instruction for executing the copy function of the image processing apparatus 10 is transmitted to the image processing apparatus 10 via the mobile communication line or the wireless LAN line.
  • the wireless communication via the wireless AP 33 is preferentially used.
  • the router 31 assigns an IP address to the terminal device 20 .
  • the image processing apparatus 10 when a network address derived from the IP address of the terminal device 20 serving as a communication destination is the same as a network address of the network to which the image processing apparatus 10 belong, can determine that the terminal device 20 serving as the communication destination belongs to the same network as the image processing apparatus 10 , that is, the wireless communication is wireless communication via the wireless AP 33 .
  • the wireless communication is determined as wireless communication via the wireless AP 33 .
  • the mobile base station 32 assigns an IP address to the terminal device 20 . Therefore, since a network address derived from the IP address of the terminal device 20 serving as a communication destination is different from a network address of the network to which the image processing apparatus 10 belong, both the image processing apparatus 10 and the terminal device 20 determine that the wireless communication between the image processing apparatus 10 and the terminal device 20 is wireless communication via the mobile base station 32 .
  • the terminal device 20 exists in a predetermined region in which communication by the wireless LAN line can be performed with the wireless AP 33 arranged near the image processing apparatus 10 , so that the terminal device 20 can be determined to be located close to the image processing apparatus 10 .
  • the terminal device 20 is more unlikely to exist in the predetermined region in which communication by the wireless LAN line can be performed, so that the terminal device 20 can be determined to be located far from the image processing apparatus 10 .
  • the determination by a type of a wireless communication line as to whether the terminal device 20 is close to or far from the image processing apparatus 10 can simplify a process and equipment for determination.
  • the LAN interface 12 , the mobile communication interface 22 , and the wireless LAN interface 23 are equivalent to a positional relationship acquisition unit that is used in order to acquire a positional relationship between the image processing apparatus 10 and the terminal device 20 .
  • FIG. 2 shows an example of the process steps in the body control unit 11 of the image processing apparatus 10
  • FIG. 3 shows an example of the process steps in the terminal control unit 21 of the terminal device 20 .
  • the body control unit 11 determines whether or not the terminal device 20 that activates the application software for remote operation of the image processing apparatus 10 and is about to remotely operate the image processing apparatus 10 is located close to the image processing apparatus 10 (S 1 ). Similarly, also in the terminal device 20 that activates the application software for remote operation of the image processing apparatus 10 and is about to remotely operate the image processing apparatus 10 , the terminal control unit 21 determines whether or not the terminal device 20 itself is located close to the image processing apparatus 10 (S 11 ).
  • the specific operation keys 41 to 43 may preferably be operation keys that receive an operation for causing the image processing apparatus 10 to execute an action required for handling a document by a user.
  • the specific operation keys 41 to 43 may include a copy key 41 for executing the copy function, an E-Mail key 42 for executing the SCAN to E-Mail function, and a facsimile key 43 for executing the facsimile function.
  • the activation of the application software for remote operation makes it possible to display an operation screen 60 similar to the operation screen 40 displayed on the body operation unit 13 .
  • the operation key 41 on the body operation unit 13 and the operation key 61 in the terminal operation unit 24 are operation keys to which the functions equal to each other are assigned.
  • the operation keys 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , and 50 on the body operation unit 13 and the operation keys 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , and 70 in the terminal operation unit 24 are operation keys to which the functions equal to each other are assigned, respectively.
  • the terminal device 20 in the case in which the terminal device 20 is located close, a touch operation with respect to the specific operation keys 61 to 63 is enabled (S 12 ), and, if any of the specific operation keys 61 to 63 is touch operated (S 13 ), an action assigned to the operation key that has been touch operated is executed (S 14 ).
  • the operation key 61 which is the most frequently used among the specific operation keys 61 to 63 , may be made to flash more than the other operation keys, for example, and can be made distinct from the other operation keys.
  • a touch operation with respect to the specific operation keys 41 to 43 on the body operation unit 13 is disabled, which can prevent the image processing apparatus 10 from executing an action unintended by a user of the terminal operation unit 24 and can also improve the operability of the user of the terminal operation unit 24 .
  • a user of the body operation unit 13 from the fact that the specific operation keys 41 to 43 are disabled, can recognize that the terminal device 20 is located close to the image processing apparatus 10 and the image processing apparatus 10 is about to execute an action instructed by the user of the terminal operation unit 24 or is executing the action, so that the user of the body operation unit 13 can be prevented from getting confused.
  • the present invention can improve operability even when a user who operates the terminal operation unit 24 and a user who operates the body operation unit 13 exist at the same time.
  • the specific operation keys 61 to 63 are grayed out and displayed, and a touch operation with respect to these specific operation keys 61 to 63 is disabled (S 15 ). If these disabled specific operation keys 61 to 63 are touch operated (S 16 ), as shown in FIG. 5C , an error message 52 is displayed (S 17 ). The error message 52 at this time is displayed as, for example, “Due to the necessity of reading a document, the operation cannot be executed from a remote place.”
  • the operation for causing the image processing apparatus 10 to execute a specific action required for handling a document by a user is not generally performed in the terminal operation unit 24 . Therefore, even if the specific operation keys 41 to 43 on the body operation unit 13 become enabled, a possibility that the operation from the body operation unit 13 and the operation from the terminal operation unit 24 conflict is very low. Accordingly, the operability of the user of the terminal operation unit 24 and the user of the body operation unit 13 is not lowered.
  • disabling the touch operation with respect to the specific operation keys 61 to 63 in the terminal operation unit 24 can prevent the image processing apparatus 10 from executing an action unintended by a user of the body operation unit 13 , can prevent the user of the body operation unit 13 from getting confused, and can also improve the operability of the user of the body operation unit 13 .
  • the user of the terminal operation unit 24 can be suppressed by the disabled specific operation keys 61 to 63 from causing an incorrect operation and can be released from the need to pay too much attention to an input operation, which can improve the operability of the user of terminal operation unit 24 .
  • a remote operation system 1 including the image processing apparatus 10 according to a second preferred embodiment of the present invention is configured in the same manner as the remote operation system 1 including the image processing apparatus 10 according to the first preferred embodiment of the present invention, except for changing a method of displaying an error message of the error that requires maintenance of the image processing apparatus 10 based on the positional relationship between the image processing apparatus 10 and the terminal device 20 .
  • the error that requires maintenance of the image processing apparatus 10 includes: out of paper, a paper jam, toner low, fully stacked sheets of paper on a paper output tray, and a document forgotten to be taken from a document platen.
  • an error message 53 may preferably be displayed in a smaller size on the body operation unit 13 .
  • the error message 53 is displayed as a specific icon at the end of the operation screen 40 .
  • the terminal operation unit 24 displays an error message 54 in a large size.
  • the error message 54 at this time is displayed as, for example, “No A4 paper is in Tray 3. Load A4 paper in Tray 3.”
  • the terminal operation unit 24 displays an error message 55 in a comparatively small size.
  • the error message 55 is displayed in one line in the lateral direction at the upper end of the operation screen 60 .
  • the error message 55 is displayed as, for example, “Load A4 paper in Tray 3 of the nearby image processing apparatus MFP-XXX (model number).”
  • an error message 56 may preferably be displayed in a larger size on the body operation unit 13 .
  • the error message 56 at this time is displayed as, for example, “No A4 paper is in Tray 3. Load A4 paper in Tray 3.”
  • the terminal device 20 in the case in which the terminal device 20 is located far from the image processing apparatus 10 , as shown in FIG. 7B , the error message of the error that requires manual maintenance of the image processing apparatus 10 is not displayed.
  • the specific operation keys 41 to 43 of the body operation unit 13 and the specific operation keys 61 to 63 of the terminal operation unit 24 are switched between enabled and disabled. This switches a user who can operate the image processing apparatus 10 between the user of the body operation unit 13 and the user of the terminal operation unit 24 . Therefore, an error message is displayed so as to be more noticeable to a user having a high need of the error message and so as not to obstruct other displays, to a user having a low need of the error message. This makes it possible to easily convey the error message to the user having a high need of the error message, and to improve the operability of operations other than the specific operation keys 41 to 43 for the user having a low need of the error message.
  • the user of the terminal operation unit 24 may be suitable for handling errors including: out of paper, out of toner, a paper jam, and a document jam. Therefore, the user of the terminal operation unit 24 has a higher need of an error message. Accordingly, as compared with an error message displayed on the body operation unit 13 , an error message is displayed in a larger size on the terminal operation unit 24 . On the other hand, since the user of the body operation unit 13 has a lower need of such an error message, the error message is displayed in a small size, which improves the operability of the body operation unit 13 .
  • An image processing apparatus 10 according to a third preferred embodiment of the present invention is configured in the same manner as the image processing apparatus 10 according to the first preferred embodiment of the present invention, except for further including a camera 15 (see FIG. 1 ) as a capturing device and being configured so that captured data obtained by the camera 15 is transmitted to the terminal device 20 in the case in which the terminal device 20 in which the application software for remote operation of the image processing apparatus 10 is installed is located far from the image processing apparatus 10 .
  • the captured data may be image data or video data.
  • the peripheral surroundings of the image processing apparatus 10 is captured by the camera 15 , and captured data obtained by the camera 15 is transmitted only to the terminal device 20 located far from the image processing apparatus 10 . To the terminal device 20 located close to the image processing apparatus 10 and having a low need of such data, the captured data is not transmitted.
  • the operation screen 60 of the terminal operation unit 24 may preferably display a message 57 that an image or video captured by the camera 15 can be displayed.
  • the message 57 is displayed, at intervals of a first predetermined time period, for a second predetermined time period.
  • the terminal operation unit 24 displays an error message 57 in a comparatively small size.
  • the error message 57 is displayed in one line in the lateral direction at the upper end of the operation screen 60 .
  • the message 57 is displayed as, for example, “Capturing is in progress with the camera of the image processing apparatus MFP-XXX (model number). Touch here to check.”
  • the terminal device 20 if a predetermined spot is touch operated, as shown in FIG. 8B , an image or video captured by the camera 15 is displayed in the terminal operation unit 24 .
  • the terminal operation unit 24 may preferably display live feed.
  • the image processing apparatus 10 may preferably further include a microphone, acquire audio data around the image processing apparatus 10 , and transmit the audio data together with the captured data to the terminal device 20 located far from the image processing apparatus 10 .
  • captured data obtained by the camera 15 may preferably be configured to be recorded.
  • the present invention can also be configured so that: the positional relationship acquisition unit that is used in order to acquire a positional relationship between the image processing apparatus 10 and the terminal device 20 may preferably include a GPS (Global Positioning System) or a three dimensional position sensor; the GPS or the three dimensional position sensor senses a distance between the image processing apparatus 10 and the terminal device 20 ; the image processing apparatus 10 and the terminal device 20 are determined to be located far from each other when the distance is equal to and more than a predetermined value; and the image processing apparatus 10 and the terminal device 20 are determined to be located close to each other when the distance is less than the predetermined value. Moreover, the present invention can also be configured so that whether the image processing apparatus 10 and the terminal device 20 are determined to be located far from or close to each other, with the antenna intensity of transmission and reception between both the image processing apparatus 10 and the terminal device 20 .
  • GPS Global Positioning System
  • the image processing apparatus 10 is not limited to being a multifunctional machine, and the present invention can also be applied to an image forming device such as a copying machine, a printer, a facsimile machine, and an image reading device such as a scanner, and, even if it is a case in which a user of the terminal device and a user of the body operation unit exist at the same time, the effect that operability can be improved can be achieved.
  • an image forming device such as a copying machine, a printer, a facsimile machine, and an image reading device such as a scanner

Abstract

An image processing apparatus is configured to be capable of being remotely operated by a terminal device via a wireless communication line. The image processing apparatus is equipped with a body control unit, a LAN interface, and a body operation unit. The body operation unit is capable of displaying a plurality of operation keys and capable of receiving a touch operation with respect to each of the plurality of operation keys. The LAN interface is used in order to acquire a positional relationship between the terminal device and the image processing apparatus. The body control unit, when determining that the terminal device is located close to the image processing apparatus, disables a touch operation with respect to a specific operation key among the plurality of operation keys on the body operation unit.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application is a Divisional of copending U.S. application Ser. No. 15/421,810, filed on Feb. 1, 2017 which is a Continuation of application Ser. No. 15/081,099, filed Mar. 25, 2017 (now U.S. Pat. No. 9,596,373 issued Mar. 14, 2017), which is a Continuation of application Ser. No. 14/561,316, filed on Dec. 5, 2014 (now U.S. Pat. No. 9,325,873 issued Apr. 26, 2016), and which claims priority under 35 U.S.C. § 119(a) on Patent Application No. 2013-265700 filed in Japan on Dec. 24, 2013, the entire contents of which are hereby incorporated by reference.
  • BACKGROUND OF THE INVENTION
  • The present invention relates to an image processing apparatus configured to be capable of being remotely operated by a terminal device via a wireless communication line, and to a remote operation system for such an image processing apparatus.
  • Of image processing apparatuses such as image forming devices and image reading devices, an image processing apparatus is configured to be capable of not only being operated by a body operation unit mounted in the image processing apparatus but also being remotely operated by a portable type terminal device such as a smartphone and a tablet terminal device, via a wireless communication line (see Japanese Patent Laid-Open publication No. 2011-103572, for example).
  • In image processing apparatuses, since operations that cause the image processing apparatuses to execute a specific action required for handling a document, such as copy start and scan start involve work of a user, including placement of a document, such operations are generally performed when the user is close to the image processing apparatus.
  • In view of the foregoing, an image processing apparatus has been proposed, the image processing apparatus being configured so as to disable a touch operation with respect to the specific operation key of the terminal device to cause the image processing apparatus to execute the above described specific action when the user is far from the image processing apparatus, (see Japanese Patent Laid-Open publication No. 2013-000985, for example). In this image processing apparatus, the user is not required to pay attention so as not to operate the specific operation key when being far from the image processing apparatus, which improves the operability of the terminal device.
  • However, in the conventional image processing apparatuses described in Japanese Patent Laid-Open publication No. 2011-103572 and Japanese Patent Laid-Open publication No. 2013-000985, the operation keys of the body operation unit of the image processing apparatus have not been switched between enabled and disabled, according to the positional relationship between the image processing apparatus and the terminal device.
  • Therefore, in a state in which there is a user who is operating the terminal device to cause the image processing apparatus to execute the above described specific action and there is another user who has operated the body operation unit to cause the image processing apparatus to execute the above described specific action, the user who is operating the terminal device gets confused due to a failure to cause the image processing apparatus to execute an action intended by the user, which may cause a risk of reducing the operability of the user who is operating the terminal device.
  • In the same manner, in a state in which there is a user who is operating the body operation unit to cause the image processing apparatus to execute the above described specific action and there is another user who has operated the terminal device to cause the image processing apparatus to execute the above described specific action, the user who is operating the body operation unit gets confused due to an unexpected behavior of the image processing apparatus, which may cause a risk of reducing the operability of the user who is operating the body operation unit.
  • An object of the present invention is to provide an image processing apparatus capable of improving operability even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time, and to provide a remote operation system for such an image processing apparatus.
  • SUMMARY OF THE INVENTION
  • An image processing apparatus according to preferred embodiments of the present invention is configured to be capable of being remotely operated by a terminal device via a wireless communication line. The image processing apparatus is equipped with a body operation unit, a positional relationship acquisition unit, and a control unit. The body operation unit is capable of displaying a plurality of operation keys and capable of receiving a touch operation with respect to each of the plurality of operation keys. The positional relationship acquisition unit is used in order to acquire a positional relationship between the terminal device and the image processing apparatus. The control unit is configured so as to acquire the positional relationship between the terminal device and the image processing apparatus by using the positional relationship acquisition unit and, when determining that the terminal device is located close to the image processing apparatus, disable a touch operation with respect to a specific operation key among the plurality of operation keys on the body operation unit.
  • With this configuration, in a case in which the terminal device is located close to the image processing apparatus, the touch operation with respect to a specific operation key on the body operation unit is disabled, which can prevent the image processing apparatus from executing an action unintended by the user of the terminal device and can also improve the operability of the user of the terminal device. In addition, a user of the body operation unit, from the fact that the specific operation key is disabled, can recognize that the terminal device is located close to the image processing apparatus and the image processing apparatus is about to execute an action instructed by the user of the terminal device or is executing the action, so that the user of the body operation unit can be prevented from getting confused. According to the present invention, operability can be improved even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time.
  • A remote operation system for an image processing apparatus according to preferred embodiments of the present invention is equipped with a terminal device and an image processing apparatus configured to be capable of being remotely operated by the terminal device via a wireless communication line. The image processing apparatus is equipped with a body operation unit, a first positional relationship acquisition unit, and a body control unit. The body operation unit is capable of displaying a plurality of operation keys and capable of receiving a touch operation with respect to each of the plurality of operation keys. The first positional relationship acquisition unit is used in order to acquire a positional relationship between the terminal device and the image processing apparatus. The body control unit is configured so as to acquire the positional relationship between the terminal device and the image processing apparatus by using the first positional relationship acquisition unit, and, when determining that the terminal device is located close to the image processing apparatus, disable a touch operation with respect to a specific operation key among the plurality of operation keys on the body operation unit.
  • With this configuration, in a case in which the terminal device is located close to the image processing apparatus, the touch operation with respect to the specific operation key on the body operation unit is disabled, which can prevent the image processing apparatus from executing an action unintended by a user of the terminal device and can also improve the operability of the user of the terminal device. In addition, a user of the body operation unit, from the fact that the specific operation key is disabled, can recognize that the terminal device is located close to the image processing apparatus and the image processing apparatus executes an action instructed by the user of the terminal device, so that the user of the body operation unit can be prevented from getting confused. According to the present invention, operability can be improved even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time.
  • The foregoing and other features and attendant advantages of the present invention will become more apparent from the reading of the following detailed description of the invention in conjunction with the accompanying drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram showing a schematic configuration of a remote operation system including an image processing apparatus according to a first preferred embodiment of the present invention.
  • FIG. 2 is a flow chart showing process steps in the image processing apparatus.
  • FIG. 3 is a flow chart showing process steps in a terminal device.
  • FIG. 4A to FIG. 4C are views showing exemplary displays of operation units in a case in which the terminal device is located close to the image processing apparatus: FIG. 4A shows an exemplary display of a body operation unit equipped in the image processing apparatus, FIG. 4B shows an exemplary display when a disabled operation key of the body operation unit is operated, and FIG. 4C shows an exemplary display of a terminal operation unit equipped in the terminal device.
  • FIG. 5A to FIG. 5C are views showing exemplary displays of operation units in a case in which the terminal device is located far from the image processing apparatus: FIG. 5A shows an exemplary display of the body operation unit, FIG. 5B shows an exemplary display of the terminal operation unit, and FIG. 5C shows an exemplary display when a disabled operation key of the terminal operation unit is operated.
  • FIG. 6A to FIG. 6C are views showing exemplary displays of an error message on operation units in a case in which the terminal device is located close to the image processing apparatus, in a remote operation system including an image processing apparatus according to a second preferred embodiment of the present invention: FIG. 6A shows an exemplary display of a body operation unit, FIG. 6B shows an exemplary display of a terminal operation unit, and FIG. 6C shows an exemplary display of an error message when application software other than application software for remote operation of the image processing apparatus is being operated in the terminal device.
  • FIG. 7A and FIG. 7B are views showing exemplary displays of an error message on operation units in a case in which the terminal device is located far from the image processing apparatus, in the remote operation system including the image processing apparatus according to the second preferred embodiment of the present invention: FIG. 7A shows an exemplary display of the body operation unit, and FIG. 7B shows an exemplary display of the terminal operation unit.
  • FIG. 8A and FIG. 8B are views showing exemplary displays in a terminal operation unit of a terminal device located far from an image processing apparatus, in a remote operation system including the image processing apparatus according to a third preferred embodiment of the present invention: FIG. 8A shows an exemplary display of a message indicating that a video captured by a camera can be displayed, and FIG. 8B shows an exemplary display of the video captured by the camera.
  • DETAILED DESCRIPTION OF THE INVENTION
  • As shown in FIG. 1, a remote operation system 1 including an image processing apparatus 10 according to a first preferred embodiment of the present invention includes one or more terminal devices 20 in addition to the image processing apparatus 10. As an example, the image processing apparatus 10 is a multifunctional machine that has various functions, such as a printer function, a copy function, a facsimile function, and a Scan to E-Mail function. The terminal device 20 may be a portable type terminal device that has a wireless communication function, such as a smartphone and a tablet terminal device. In the terminal device 20, application software for remote operation of the image processing apparatus 10 is installed.
  • The image processing apparatus 10 is equipped with a body control unit 11, a Local Area Network (LAN) interface 12, a body operation unit 13, and an image processing unit 14.
  • The LAN interface 12 is connected to a router 31 arranged near the image processing apparatus 10, and enables Internet connection via the router 31. As an example, the router 31 and the image processing apparatus 10 are arranged in the same room.
  • The body operation unit 13 is capable of displaying various operation screens including a plurality of operation keys and receives an input operation, that is, a touch operation of a user, with respect to each of the plurality of operation keys. For example, as the body operation unit 13, a liquid crystal touch panel is used.
  • The image processing unit 14 includes an image reading unit that reads an image of a document and generates image data, and an image forming unit that forms an image on a sheet of paper based on the image data. While, as an example, the image forming unit 14 executes an electrophotographic image forming process, the image forming unit 14 may be made to execute other image forming processes such as an inkjet process.
  • The body control unit 11, when receiving an input of an action instruction from the terminal device 20 through the body operation unit 13 or the LAN interface 12, acts in accordance with the action instruction. For example, the body control unit 11 executes the copy function in which an image read from a document in the image processing unit 14 is copied onto a sheet of paper. The body control unit 11 is configured to control each unit of the image processing apparatus 10 in an integrated manner.
  • Thus, the image processing apparatus 10 is configured to be capable of being remotely operated by the terminal device 20 via a wireless communication line.
  • The terminal device 20 is equipped with a terminal control unit 21, a mobile communication interface 22, a wireless LAN interface 23, and a terminal operation unit 24.
  • The mobile communication interface 22 enables internet connection by a mobile communication line that is commonly called as 3G, 4G, LTE (Long Term Evolution), and the like, through a mobile base station 32. In other words, the mobile communication interface 22 is used for communication by the mobile communication line.
  • The wireless LAN interface 23 performs wireless communication with a wireless access point (hereinafter will be referred to as “wireless AP”) 33, and further enables wireless communication with the body control unit 11 of the image processing apparatus 10 through the router 31 and the LAN interface 12. In other words, the wireless LAN interface 23 is used for communication by a wireless LAN line. It is to be noted that, in place of the router 31 and the wireless AP 33, a wireless LAN router in which both are integrated can be used.
  • The terminal operation unit 24 is capable of displaying various operation screens including a plurality of operation keys and receives an input operation, that is, a touch operation of a user, with respect to each of the plurality of operation keys. For example, as the terminal operation unit 24, a liquid crystal touch panel is used.
  • The terminal control unit 21, when receiving an input of an action instruction from the terminal operation unit 24, acts in accordance with the action instruction. For example, in a state in which the application software for remote operation of the image processing apparatus 10 is activated, if an input operation for executing the copy function of the image processing apparatus 10 is performed, an action instruction for executing the copy function of the image processing apparatus 10 is transmitted to the image processing apparatus 10 via the mobile communication line or the wireless LAN line.
  • When the terminal device 20 is in a region in which both the wireless communication via the wireless AP 33 and the wireless communication via the mobile base station 32 can be performed, the wireless communication via the wireless AP 33 is preferentially used.
  • In the remote operation system 1, in a case in which the terminal device 20 performs wireless communication with the image processing apparatus 10 via the wireless AP 33, the router 31 assigns an IP address to the terminal device 20. The image processing apparatus 10, when a network address derived from the IP address of the terminal device 20 serving as a communication destination is the same as a network address of the network to which the image processing apparatus 10 belong, can determine that the terminal device 20 serving as the communication destination belongs to the same network as the image processing apparatus 10, that is, the wireless communication is wireless communication via the wireless AP 33. Similarly, also in the terminal device 20, since the network address is the same as the network address of the image processing apparatus 10, the wireless communication is determined as wireless communication via the wireless AP 33.
  • On the other hand, in a case in which the terminal device 20 performs wireless communication with the image processing apparatus 10 via the mobile base station 32, the mobile base station 32 assigns an IP address to the terminal device 20. Therefore, since a network address derived from the IP address of the terminal device 20 serving as a communication destination is different from a network address of the network to which the image processing apparatus 10 belong, both the image processing apparatus 10 and the terminal device 20 determine that the wireless communication between the image processing apparatus 10 and the terminal device 20 is wireless communication via the mobile base station 32.
  • In a case in which a type of the wireless communication line between the image processing apparatus 10 and the terminal device 20 is a wireless LAN line, the terminal device 20 exists in a predetermined region in which communication by the wireless LAN line can be performed with the wireless AP 33 arranged near the image processing apparatus 10, so that the terminal device 20 can be determined to be located close to the image processing apparatus 10. On the other hand, in a case in which a type of the wireless communication line between the image processing apparatus 10 and the terminal device 20 is a mobile communication line, the terminal device 20 is more unlikely to exist in the predetermined region in which communication by the wireless LAN line can be performed, so that the terminal device 20 can be determined to be located far from the image processing apparatus 10. Thus, the determination by a type of a wireless communication line as to whether the terminal device 20 is close to or far from the image processing apparatus 10 can simplify a process and equipment for determination. It should be noted that the LAN interface 12, the mobile communication interface 22, and the wireless LAN interface 23 are equivalent to a positional relationship acquisition unit that is used in order to acquire a positional relationship between the image processing apparatus 10 and the terminal device 20.
  • FIG. 2 shows an example of the process steps in the body control unit 11 of the image processing apparatus 10, and FIG. 3 shows an example of the process steps in the terminal control unit 21 of the terminal device 20.
  • In the image processing apparatus 10, the body control unit 11 determines whether or not the terminal device 20 that activates the application software for remote operation of the image processing apparatus 10 and is about to remotely operate the image processing apparatus 10 is located close to the image processing apparatus 10 (S1). Similarly, also in the terminal device 20 that activates the application software for remote operation of the image processing apparatus 10 and is about to remotely operate the image processing apparatus 10, the terminal control unit 21 determines whether or not the terminal device 20 itself is located close to the image processing apparatus 10 (S11). It is to be noted that it is possible to configure so that the determination as to whether or not the terminal device 20 that activates the application software for remote operation of the image processing apparatus 10 and is about to remotely operate the image processing apparatus 10 is located close to the image processing apparatus 10 is performed by one of the image processing apparatus 10 or the terminal device 20 and a determination result is transmitted to the other.
  • In the image processing apparatus 10, in a case in which the terminal device 20 is located close, specific operation keys 41 to 43 among a plurality of operation keys 41, 42, 43, 44, 45, 46, 47, 48, 49, and 50 that are displayed on an operation screen 40 of the body operation unit 13 are grayed out and displayed, for example, as shown in FIG. 4A, and the touch operation with respect to these specific operation keys 41 to 43 is disabled (S2). If these disabled specific operation keys 41 to 43 are touch operated (S3), as shown in FIG. 4B, an error message 51 is displayed (S4). The error message 51 at this time is displayed as, for example, “Due to the ongoing operation from the mobile terminal, the operation from the main body cannot be executed.”
  • The specific operation keys 41 to 43 may preferably be operation keys that receive an operation for causing the image processing apparatus 10 to execute an action required for handling a document by a user. For example, the specific operation keys 41 to 43 may include a copy key 41 for executing the copy function, an E-Mail key 42 for executing the SCAN to E-Mail function, and a facsimile key 43 for executing the facsimile function.
  • In the terminal device 20, the activation of the application software for remote operation makes it possible to display an operation screen 60 similar to the operation screen 40 displayed on the body operation unit 13. The operation key 41 on the body operation unit 13 and the operation key 61 in the terminal operation unit 24 are operation keys to which the functions equal to each other are assigned. Similarly, the operation keys 42, 43, 44, 45, 46, 47, 48, 49, and 50 on the body operation unit 13 and the operation keys 62, 63, 64, 65, 66, 67, 68, 69, and 70 in the terminal operation unit 24 are operation keys to which the functions equal to each other are assigned, respectively.
  • In the terminal device 20, in the case in which the terminal device 20 is located close, a touch operation with respect to the specific operation keys 61 to 63 is enabled (S12), and, if any of the specific operation keys 61 to 63 is touch operated (S13), an action assigned to the operation key that has been touch operated is executed (S14). In such a case, as shown in FIG. 4C, on the operation screen 60 of the terminal operation unit 24, the operation key 61, which is the most frequently used among the specific operation keys 61 to 63, may be made to flash more than the other operation keys, for example, and can be made distinct from the other operation keys.
  • In the case in which the terminal device 20 is located close to the image processing apparatus 10, a touch operation with respect to the specific operation keys 41 to 43 on the body operation unit 13 is disabled, which can prevent the image processing apparatus 10 from executing an action unintended by a user of the terminal operation unit 24 and can also improve the operability of the user of the terminal operation unit 24. In addition, a user of the body operation unit 13, from the fact that the specific operation keys 41 to 43 are disabled, can recognize that the terminal device 20 is located close to the image processing apparatus 10 and the image processing apparatus 10 is about to execute an action instructed by the user of the terminal operation unit 24 or is executing the action, so that the user of the body operation unit 13 can be prevented from getting confused. Thus, the present invention can improve operability even when a user who operates the terminal operation unit 24 and a user who operates the body operation unit 13 exist at the same time.
  • Subsequently, a description is directed to a case in which the terminal device 20 that activates the application software for remote operation of the image processing apparatus 10 and is about to remotely operate the image processing apparatus 10 is located far from the image processing apparatus 10.
  • In the image processing apparatus 10, in a case in which the terminal device 20 is located far (No in S1), as shown in FIG. 5A, a touch operation with respect to the specific operation keys 41 to 43 is enabled (S5), and, if any of the specific keys 41 to 43 is touch operated (S6), an action assigned to the operation key that has been operated is executed (S7).
  • On the other hand, in the terminal device 20, in a case in which the terminal device 20 is located far from the image processing apparatus 10 (No in S11), the specific operation keys 61 to 63, as shown in FIG. 5B, for example, are grayed out and displayed, and a touch operation with respect to these specific operation keys 61 to 63 is disabled (S15). If these disabled specific operation keys 61 to 63 are touch operated (S16), as shown in FIG. 5C, an error message 52 is displayed (S17). The error message 52 at this time is displayed as, for example, “Due to the necessity of reading a document, the operation cannot be executed from a remote place.”
  • In the case in which the terminal device 20 is located far from the image processing apparatus 10, the operation for causing the image processing apparatus 10 to execute a specific action required for handling a document by a user is not generally performed in the terminal operation unit 24. Therefore, even if the specific operation keys 41 to 43 on the body operation unit 13 become enabled, a possibility that the operation from the body operation unit 13 and the operation from the terminal operation unit 24 conflict is very low. Accordingly, the operability of the user of the terminal operation unit 24 and the user of the body operation unit 13 is not lowered. On the other hand, in the case in which the terminal device 20 is located close to the image processing apparatus 10, a possibility that the user of the terminal operation unit 24 performs an operation for causing the image processing apparatus 10 to execute the above described specific action is high, so that disabling the touch operation with respect to the specific operation keys 41 to 43 on the body operation unit 13 can improve the operability of the user of the terminal operation unit 24 and the user of the body operation unit 13.
  • Moreover, in the case in which the terminal device 20 is located far from the image processing apparatus 10, disabling the touch operation with respect to the specific operation keys 61 to 63 in the terminal operation unit 24 can prevent the image processing apparatus 10 from executing an action unintended by a user of the body operation unit 13, can prevent the user of the body operation unit 13 from getting confused, and can also improve the operability of the user of the body operation unit 13. Furthermore, the user of the terminal operation unit 24 can be suppressed by the disabled specific operation keys 61 to 63 from causing an incorrect operation and can be released from the need to pay too much attention to an input operation, which can improve the operability of the user of terminal operation unit 24.
  • A remote operation system 1 including the image processing apparatus 10 according to a second preferred embodiment of the present invention is configured in the same manner as the remote operation system 1 including the image processing apparatus 10 according to the first preferred embodiment of the present invention, except for changing a method of displaying an error message of the error that requires maintenance of the image processing apparatus 10 based on the positional relationship between the image processing apparatus 10 and the terminal device 20.
  • The error that requires maintenance of the image processing apparatus 10 includes: out of paper, a paper jam, toner low, fully stacked sheets of paper on a paper output tray, and a document forgotten to be taken from a document platen.
  • In the image processing apparatus 10, in the case in which the terminal device 20 that activates the application software for remote operation of the image processing apparatus 10 and is about to remotely operate the image processing apparatus 10 is located close to the image processing apparatus 10, as compared with an error message in the case in which the terminal device 20 is located far from the image processing apparatus 10, as shown in FIG. 6A, an error message 53 may preferably be displayed in a smaller size on the body operation unit 13. For example, the error message 53 is displayed as a specific icon at the end of the operation screen 40.
  • In the terminal device 20, when being located close to the image processing apparatus 10, as shown in FIG. 6B, the terminal operation unit 24 displays an error message 54 in a large size. The error message 54 at this time is displayed as, for example, “No A4 paper is in Tray 3. Load A4 paper in Tray 3.”
  • Additionally, in the terminal device 20, even when being located close to the image processing apparatus 10, as shown in FIG. 6C, in a case in which application software other than application software for remote operation of the image processing apparatus 10 is being operated, the application software for remote operation of the image processing apparatus 10 runs in the background, and the terminal operation unit 24 displays an error message 55 in a comparatively small size. For example, the error message 55 is displayed in one line in the lateral direction at the upper end of the operation screen 60. The error message 55 is displayed as, for example, “Load A4 paper in Tray 3 of the nearby image processing apparatus MFP-XXX (model number).”
  • On the other hand, in the image processing apparatus 10, in the case in which the terminal device 20 is located far from the image processing apparatus 10, as compared with an error message in the case in which the terminal device 20 is located close to the image processing apparatus 10, as shown in FIG. 7A, an error message 56 may preferably be displayed in a larger size on the body operation unit 13. The error message 56 at this time is displayed as, for example, “No A4 paper is in Tray 3. Load A4 paper in Tray 3.”
  • In the terminal device 20, in the case in which the terminal device 20 is located far from the image processing apparatus 10, as shown in FIG. 7B, the error message of the error that requires manual maintenance of the image processing apparatus 10 is not displayed.
  • Thus, according to the positional relationship between the image processing apparatus 10 and the terminal device 20, the specific operation keys 41 to 43 of the body operation unit 13 and the specific operation keys 61 to 63 of the terminal operation unit 24 are switched between enabled and disabled. This switches a user who can operate the image processing apparatus 10 between the user of the body operation unit 13 and the user of the terminal operation unit 24. Therefore, an error message is displayed so as to be more noticeable to a user having a high need of the error message and so as not to obstruct other displays, to a user having a low need of the error message. This makes it possible to easily convey the error message to the user having a high need of the error message, and to improve the operability of operations other than the specific operation keys 41 to 43 for the user having a low need of the error message.
  • Specifically, in the case in which the terminal device 20 is located close to the image processing apparatus 10, since the specific operation keys 41 to 43 on the body operation unit 13 are disabled and the user of the terminal operation unit 24 eventually operates the image processing apparatus 10, the user of the terminal operation unit 24 may be suitable for handling errors including: out of paper, out of toner, a paper jam, and a document jam. Therefore, the user of the terminal operation unit 24 has a higher need of an error message. Accordingly, as compared with an error message displayed on the body operation unit 13, an error message is displayed in a larger size on the terminal operation unit 24. On the other hand, since the user of the body operation unit 13 has a lower need of such an error message, the error message is displayed in a small size, which improves the operability of the body operation unit 13.
  • An image processing apparatus 10 according to a third preferred embodiment of the present invention is configured in the same manner as the image processing apparatus 10 according to the first preferred embodiment of the present invention, except for further including a camera 15 (see FIG. 1) as a capturing device and being configured so that captured data obtained by the camera 15 is transmitted to the terminal device 20 in the case in which the terminal device 20 in which the application software for remote operation of the image processing apparatus 10 is installed is located far from the image processing apparatus 10. The captured data may be image data or video data.
  • In the image processing apparatus 10 according to the third preferred embodiment of the present invention, the peripheral surroundings of the image processing apparatus 10 is captured by the camera 15, and captured data obtained by the camera 15 is transmitted only to the terminal device 20 located far from the image processing apparatus 10. To the terminal device 20 located close to the image processing apparatus 10 and having a low need of such data, the captured data is not transmitted.
  • In the terminal device 20, the operation screen 60 of the terminal operation unit 24 may preferably display a message 57 that an image or video captured by the camera 15 can be displayed. For example, the message 57 is displayed, at intervals of a first predetermined time period, for a second predetermined time period.
  • As shown in FIG. 8A, in the terminal device 20, in the case in which application software other than the application software for remote operation of the image processing apparatus 10 is being operated, the application software for remote operation of the image processing apparatus 10 runs in the background, and the terminal operation unit 24 displays an error message 57 in a comparatively small size. For example, the error message 57 is displayed in one line in the lateral direction at the upper end of the operation screen 60. The message 57 is displayed as, for example, “Capturing is in progress with the camera of the image processing apparatus MFP-XXX (model number). Touch here to check.”
  • In the terminal device 20, if a predetermined spot is touch operated, as shown in FIG. 8B, an image or video captured by the camera 15 is displayed in the terminal operation unit 24. The terminal operation unit 24 may preferably display live feed. It should be noted that the image processing apparatus 10 may preferably further include a microphone, acquire audio data around the image processing apparatus 10, and transmit the audio data together with the captured data to the terminal device 20 located far from the image processing apparatus 10.
  • Since the user of the terminal device 20 located far from the image processing apparatus 10 can know the peripheral surroundings of the image processing apparatus 10 through an image or a video, security can be improved. Therefore, the crime prevention of the installation location of the image processing apparatus 10, such as an office, can be enhanced. In addition, captured data obtained by the camera 15 may preferably be configured to be recorded.
  • It is to be noted that the present invention can also be configured so that: the positional relationship acquisition unit that is used in order to acquire a positional relationship between the image processing apparatus 10 and the terminal device 20 may preferably include a GPS (Global Positioning System) or a three dimensional position sensor; the GPS or the three dimensional position sensor senses a distance between the image processing apparatus 10 and the terminal device 20; the image processing apparatus 10 and the terminal device 20 are determined to be located far from each other when the distance is equal to and more than a predetermined value; and the image processing apparatus 10 and the terminal device 20 are determined to be located close to each other when the distance is less than the predetermined value. Moreover, the present invention can also be configured so that whether the image processing apparatus 10 and the terminal device 20 are determined to be located far from or close to each other, with the antenna intensity of transmission and reception between both the image processing apparatus 10 and the terminal device 20.
  • The image processing apparatus 10 is not limited to being a multifunctional machine, and the present invention can also be applied to an image forming device such as a copying machine, a printer, a facsimile machine, and an image reading device such as a scanner, and, even if it is a case in which a user of the terminal device and a user of the body operation unit exist at the same time, the effect that operability can be improved can be achieved.
  • It is also conceivable that new preferred embodiments may be configured by combining respective technical features of the above described preferred embodiments one another.
  • The foregoing preferred embodiments are to be considered in all respects as illustrative and not restrictive. The scope of the present invention is defined by the following claims, not by the foregoing preferred embodiments. Further, the scope of the present invention is intended to include the scopes of the claims and all possible changes and modifications within the senses and scopes of equivalents.

Claims (15)

1. A remote operating system comprising a terminal device and an image processing apparatus which is capable of communicating with the terminal device via a wireless communication line,
wherein the image processing apparatus comprises a main body controlling unit configured to selectively enable or disable at least a part of functions of the image processing apparatus in accordance with a type of the wireless communication line, and
wherein the main body controlling unit disables the part of the functions of the image processing apparatus in a case where the type of the wireless communication line used is a wireless local area network line.
2. The remote operating system according to claim 1,
wherein the terminal device comprises a terminal controlling unit configured to selectively enable or disable at least a part of functions of the terminal device in accordance with a type of the wireless communication line, and
wherein the terminal device controlling unit enables the part, which corresponds to the part of the functions of the image processing apparatus which is disabled, of the functions of the terminal device in a case where the type of the wireless communication line used is the wireless local area network line.
3. The remote operating system according to claim 1,
wherein the main body controlling unit enables the part of the functions of the image processing apparatus and the terminal device controlling unit disables the part of the functions of the terminal device in a case where the type of the wireless communication line used is other than the wireless local area network line.
4. The remote operating system according to claim 3,
wherein the part of the functions of the terminal device which is disabled is different from the part of the functions of the image processing apparatus which is enabled in a case where the type of the wireless communication line used is other than the wireless local area network line.
5. The remote operating system according to claim 1,
wherein, when the wireless local area network line which has been established between the image processing apparatus and the terminal device is disconnected, the main body controlling unit enables the part of the functions of the image processing apparatus which has been disabled while the wireless local area network line which has been established.
6. A method for controlling a remote operating system in which a terminal device and an image processing apparatus are capable of communicating with each other via a wireless communication line, comprising the steps of:
causing the image processing apparatus to selectively enable or disable at least a part of the functions of the image processing apparatus; and
causing the image processing apparatus to disable the part of the functions of the image processing apparatus in a case where the type of the wireless communication line used is a wireless local area network line.
7. The method for controlling the remote operating system according to claim 6, further comprising the steps of:
causing the terminal device to selectively enable or disable at least a part of functions of the terminal device in accordance with a type of the wireless communication line, and
causing the terminal device to enable the part, which corresponds to the part of the functions of the image processing apparatus which is disabled, of the functions of the terminal device in a case where the type of the wireless communication line used is the wireless local area network line.
8. The method for controlling the remote operating system according to claim 6,
wherein the part of the functions of the image processing apparatus is enabled and the part of the functions of the terminal device is disabled in a case where the type of the wireless communication line used is other than the wireless local area network line.
9. The method for controlling the remote operating system according to claim 8,
wherein the part of the functions of the terminal device which is disabled is different from the part of the functions of the image processing apparatus which is enabled in a case where the type of the wireless communication line used is other than the wireless local area network line.
10. The method for controlling the remote operating system according to claim 6, further comprising the step of, when the wireless local area network line which has been established between the image processing apparatus and the terminal device is disconnected, enabling the part of the functions of the image processing apparatus which has been disabled while the wireless local area network line which has been established.
11. An image processing apparatus which is capable of communicating with a terminal device via a wireless communication line, comprising:
a main body controlling unit configured to selectively enable or disable at least a part of functions of the image processing apparatus in accordance with a type of the wireless communication line,
wherein the main body controlling unit disables the part of the functions of the image processing apparatus, while the part of the functions of the terminal device is enabled, in a case where the type of the wireless communication line used is a wireless local area network line.
12. The image processing apparatus according to claim 11,
wherein the part of functions of the image processing apparatus which is disabled corresponds to the part of the functions of the terminal device which is enabled in a case where the type of the wireless communication line used is a wireless local area network line.
13. The image processing apparatus according to claim 11,
wherein the main body controlling unit enables the part of the functions of the image processing apparatus, while the part of the functions of the terminal device is disabled, in a case where the type of the wireless communication line used is other than the wireless local area network line.
14. The image processing apparatus according to claim 13,
wherein the part of the functions of the image processing apparatus which is enabled is different from the part of the functions of the terminal device which is disabled in a case where the type of the wireless communication line used is other than the wireless local area network line.
15. The remote operating system according to claim 11,
wherein, when the wireless local area network line which has been established between the image processing apparatus and the terminal device is disconnected, the main body controlling unit enables the part of the functions of the image processing apparatus which has been disabled while the wireless local area network line which has been established.
US16/023,966 2013-12-24 2018-06-29 Image processing apparatus, and remote operation system for image processing apparatus Abandoned US20180324316A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/023,966 US20180324316A1 (en) 2013-12-24 2018-06-29 Image processing apparatus, and remote operation system for image processing apparatus

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP2013265700A JP5985462B2 (en) 2013-12-24 2013-12-24 Image processing apparatus and remote control system for image processing apparatus
JP2013-265700 2013-12-24
US14/561,316 US9325873B2 (en) 2013-12-24 2014-12-05 Image processing apparatus, and remote operation system for image processing apparatus
US15/081,099 US9596373B2 (en) 2013-12-24 2016-03-25 Image processing apparatus, and remote operation system for image processing apparatus
US15/421,810 US10038809B2 (en) 2013-12-24 2017-02-01 Image processing apparatus, and remote operation system for image processing apparatus
US16/023,966 US20180324316A1 (en) 2013-12-24 2018-06-29 Image processing apparatus, and remote operation system for image processing apparatus

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US15/421,810 Division US10038809B2 (en) 2013-12-24 2017-02-01 Image processing apparatus, and remote operation system for image processing apparatus

Publications (1)

Publication Number Publication Date
US20180324316A1 true US20180324316A1 (en) 2018-11-08

Family

ID=53401479

Family Applications (4)

Application Number Title Priority Date Filing Date
US14/561,316 Active US9325873B2 (en) 2013-12-24 2014-12-05 Image processing apparatus, and remote operation system for image processing apparatus
US15/081,099 Active US9596373B2 (en) 2013-12-24 2016-03-25 Image processing apparatus, and remote operation system for image processing apparatus
US15/421,810 Active US10038809B2 (en) 2013-12-24 2017-02-01 Image processing apparatus, and remote operation system for image processing apparatus
US16/023,966 Abandoned US20180324316A1 (en) 2013-12-24 2018-06-29 Image processing apparatus, and remote operation system for image processing apparatus

Family Applications Before (3)

Application Number Title Priority Date Filing Date
US14/561,316 Active US9325873B2 (en) 2013-12-24 2014-12-05 Image processing apparatus, and remote operation system for image processing apparatus
US15/081,099 Active US9596373B2 (en) 2013-12-24 2016-03-25 Image processing apparatus, and remote operation system for image processing apparatus
US15/421,810 Active US10038809B2 (en) 2013-12-24 2017-02-01 Image processing apparatus, and remote operation system for image processing apparatus

Country Status (3)

Country Link
US (4) US9325873B2 (en)
JP (1) JP5985462B2 (en)
CN (2) CN104735286B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6244861B2 (en) * 2013-12-04 2017-12-13 株式会社リコー Information processing system, information processing apparatus, information processing method, and program
JP6405741B2 (en) * 2014-06-24 2018-10-17 ブラザー工業株式会社 Image processing apparatus, display method, and storage medium
JP6493041B2 (en) * 2015-07-08 2019-04-03 株式会社リコー Information processing apparatus, image processing apparatus, program, and method
JP6686968B2 (en) * 2017-05-30 2020-04-22 京セラドキュメントソリューションズ株式会社 Mobile terminals and electronic systems
JP2019028508A (en) * 2017-07-25 2019-02-21 富士ゼロックス株式会社 Information processing apparatus and program
JP2019097091A (en) * 2017-11-27 2019-06-20 シャープ株式会社 Electronic apparatus, image formation device, control method of the same, and program
JP7103008B2 (en) * 2018-07-19 2022-07-20 富士フイルムビジネスイノベーション株式会社 Image forming device and program
CN114095599B (en) * 2020-07-03 2023-03-03 华为技术有限公司 Message display method and electronic equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130329253A1 (en) * 2012-06-12 2013-12-12 Ricoh Company, Ltd. Image processing apparatus, screen data providing method, and computer-readable recording medium
US20140253949A1 (en) * 2013-03-05 2014-09-11 Brother Kogyo Kabushiki Kaisha Communication apparatus and communication system

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005321944A (en) * 2004-05-07 2005-11-17 Konica Minolta Business Technologies Inc Image forming system
JP2006115101A (en) * 2004-10-13 2006-04-27 Murata Mach Ltd Pictorial communication equipment
JP4182946B2 (en) * 2004-12-09 2008-11-19 ブラザー工業株式会社 MANAGEMENT SYSTEM, RADIO COMMUNICATION DEVICE, PROGRAM, AND RADIO COMMUNICATION DEVICE MANAGEMENT METHOD
JP4345749B2 (en) * 2006-01-31 2009-10-14 コニカミノルタビジネステクノロジーズ株式会社 Image transmission device
JP4287456B2 (en) 2006-10-26 2009-07-01 株式会社東芝 Server apparatus, method and program for preventing denial of service attacks
JP2008109463A (en) * 2006-10-26 2008-05-08 Murata Mach Ltd Information processor
JP2008193265A (en) * 2007-02-01 2008-08-21 Canon Inc Image processing system, information processor, image processor, control method therefor, and computer program
JP2010041238A (en) * 2008-08-01 2010-02-18 Ricoh Co Ltd Image forming device, screen display method, image forming system, program and storage medium
US8872775B2 (en) * 2008-10-27 2014-10-28 Nec Corporation Information processing apparatus
JP5240170B2 (en) * 2009-03-18 2013-07-17 株式会社リコー Image forming apparatus, program, and information processing system
JP2011061702A (en) * 2009-09-14 2011-03-24 Konica Minolta Business Technologies Inc Image forming apparatus and method of controlling the same, and control program for the image forming apparatus
JP2011103527A (en) * 2009-11-10 2011-05-26 Sharp Corp Control apparatus
JP2011103572A (en) 2009-11-11 2011-05-26 Canon Inc User interface of image processor
US20120075663A1 (en) * 2010-09-29 2012-03-29 Sharp Laboratories Of America, Inc. Providing image information to a remote device
US9071709B2 (en) * 2011-03-31 2015-06-30 Nokia Technologies Oy Method and apparatus for providing collaboration between remote and on-site users of indirect augmented reality
JP5806009B2 (en) 2011-06-17 2015-11-10 シャープ株式会社 Operation display device and image processing device
JP5573814B2 (en) * 2011-10-26 2014-08-20 コニカミノルタ株式会社 Device having display unit for displaying screen, user interface control method, and user interface control program
JP5961012B2 (en) * 2012-02-29 2016-08-02 キヤノン株式会社 Image forming apparatus and control method thereof
JP5686125B2 (en) * 2012-10-25 2015-03-18 コニカミノルタ株式会社 Set value input device, image forming apparatus, set value input method, and set value input program
JP5716732B2 (en) * 2012-12-19 2015-05-13 コニカミノルタ株式会社 Control program, control device, image processing system, and control method
JP6431257B2 (en) * 2013-10-21 2018-11-28 キヤノン株式会社 NETWORK SYSTEM, NETWORK DEVICE MANAGEMENT METHOD, NETWORK DEVICE, ITS CONTROL METHOD AND PROGRAM, AND MANAGEMENT SYSTEM

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130329253A1 (en) * 2012-06-12 2013-12-12 Ricoh Company, Ltd. Image processing apparatus, screen data providing method, and computer-readable recording medium
US20140253949A1 (en) * 2013-03-05 2014-09-11 Brother Kogyo Kabushiki Kaisha Communication apparatus and communication system

Also Published As

Publication number Publication date
CN104735286B (en) 2019-03-15
CN104735286A (en) 2015-06-24
US20170149993A1 (en) 2017-05-25
US9325873B2 (en) 2016-04-26
CN110062124B (en) 2021-04-16
US9596373B2 (en) 2017-03-14
CN110062124A (en) 2019-07-26
US20160212290A1 (en) 2016-07-21
JP5985462B2 (en) 2016-09-06
US20150181069A1 (en) 2015-06-25
US10038809B2 (en) 2018-07-31
JP2015122643A (en) 2015-07-02

Similar Documents

Publication Publication Date Title
US10038809B2 (en) Image processing apparatus, and remote operation system for image processing apparatus
US20200133606A1 (en) Communication apparatus, control method, and program
US9621748B2 (en) Information processing system, information processing apparatus, and information processing method
JP5974779B2 (en) Wireless communication system, wireless communication device, and communication control program
US9497342B2 (en) Non-transitory storage medium storing instructions executable by communication terminal having display capable of displaying image with touch screen control of a processing apparatus, communication terminal having the same, and processing apparatus
JP2014179927A (en) Communication device and method of controlling the same, communication system, and program
US10237426B2 (en) Information processing apparatus that executes a desired wireless communication, control method of information processing apparatus, and storage medium
JP2015055902A (en) Compound machine
JP2019018371A (en) Image formation apparatus and program
US9678596B2 (en) Non-transitory storage medium storing instructions executable by communication terminal, communication terminal, and processing apparatus
US20120182577A1 (en) Display control apparatus and control method thereof, and storage medium
JP2015143940A (en) Display system, image forming apparatus, program, and display state control method
US20180159993A1 (en) Composite apparatus
JP2013254037A (en) Operation system of image formation device
US20170279987A1 (en) Screen Display System, Screen Display Method, Image Processing Apparatus, and Recording Medium
JP6321867B2 (en) Remote operation system, control method therefor, and image processing apparatus
JP6190013B2 (en) Image processing apparatus and control method thereof
US20140126017A1 (en) Image forming apparatus remotely operated by external terminal, method for controlling image forming apparatus, recording medium, and image forming system including image forming apparatus
JP6564103B2 (en) Remote operation system, control method therefor, and image processing apparatus
US11240394B2 (en) Information processing apparatus for invalidating an operation setting from a second device
US9013737B2 (en) Image reading device and non-transitory computer readable medium storing image reading control program
US9635193B2 (en) Document reading device
JP2014103562A (en) Operation terminal, information processing system using operation terminal, information processing method, program
JP7009082B2 (en) Mobile terminals and programs
JP2018027634A (en) Image forming apparatus, control method thereof, and program

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION