US20180324316A1 - Image processing apparatus, and remote operation system for image processing apparatus - Google Patents
Image processing apparatus, and remote operation system for image processing apparatus Download PDFInfo
- Publication number
- US20180324316A1 US20180324316A1 US16/023,966 US201816023966A US2018324316A1 US 20180324316 A1 US20180324316 A1 US 20180324316A1 US 201816023966 A US201816023966 A US 201816023966A US 2018324316 A1 US2018324316 A1 US 2018324316A1
- Authority
- US
- United States
- Prior art keywords
- image processing
- processing apparatus
- terminal device
- functions
- wireless communication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
- H04N1/00281—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal
- H04N1/00307—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal with a mobile telephone apparatus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/0035—User-machine interface; Control console
- H04N1/00405—Output means
- H04N1/00408—Display of information to the user, e.g. menus
- H04N1/00411—Display of information to the user, e.g. menus the display also being used for user input, e.g. touch screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/0035—User-machine interface; Control console
- H04N1/00405—Output means
- H04N1/00408—Display of information to the user, e.g. menus
- H04N1/00413—Display of information to the user, e.g. menus using menus, i.e. presenting the user with a plurality of selectable options
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/0035—User-machine interface; Control console
- H04N1/00493—Particular location of the interface or console
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00962—Input arrangements for operating instructions or parameters, e.g. updating internal software
- H04N1/00973—Input arrangements for operating instructions or parameters, e.g. updating internal software from a remote device, e.g. receiving via the internet instructions input to a computer terminal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32609—Fault detection or counter-measures, e.g. original mis-positioned, shortage of paper
- H04N1/32646—Counter-measures
- H04N1/32651—Indicating or reporting
- H04N1/32662—Indicating or reporting remotely, e.g. to the transmitter from the receiver
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
- H04N2201/0008—Connection or combination of a still picture apparatus with another apparatus
- H04N2201/0034—Details of the connection, e.g. connector, interface
- H04N2201/0048—Type of connection
- H04N2201/0055—By radio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
- H04N2201/0008—Connection or combination of a still picture apparatus with another apparatus
- H04N2201/0074—Arrangements for the control of a still picture apparatus by the connected apparatus
- H04N2201/0075—Arrangements for the control of a still picture apparatus by the connected apparatus by a user operated remote control device, e.g. receiving instructions from a user via a computer terminal or mobile telephone handset
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
- H04N2201/0077—Types of the still picture apparatus
- H04N2201/0094—Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception
Definitions
- the present invention relates to an image processing apparatus configured to be capable of being remotely operated by a terminal device via a wireless communication line, and to a remote operation system for such an image processing apparatus.
- an image processing apparatus is configured to be capable of not only being operated by a body operation unit mounted in the image processing apparatus but also being remotely operated by a portable type terminal device such as a smartphone and a tablet terminal device, via a wireless communication line (see Japanese Patent Laid-Open publication No. 2011-103572, for example).
- an image processing apparatus having been proposed, the image processing apparatus being configured so as to disable a touch operation with respect to the specific operation key of the terminal device to cause the image processing apparatus to execute the above described specific action when the user is far from the image processing apparatus, (see Japanese Patent Laid-Open publication No. 2013-000985, for example).
- the user is not required to pay attention so as not to operate the specific operation key when being far from the image processing apparatus, which improves the operability of the terminal device.
- the user who is operating the terminal device gets confused due to a failure to cause the image processing apparatus to execute an action intended by the user, which may cause a risk of reducing the operability of the user who is operating the terminal device.
- An object of the present invention is to provide an image processing apparatus capable of improving operability even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time, and to provide a remote operation system for such an image processing apparatus.
- An image processing apparatus is configured to be capable of being remotely operated by a terminal device via a wireless communication line.
- the image processing apparatus is equipped with a body operation unit, a positional relationship acquisition unit, and a control unit.
- the body operation unit is capable of displaying a plurality of operation keys and capable of receiving a touch operation with respect to each of the plurality of operation keys.
- the positional relationship acquisition unit is used in order to acquire a positional relationship between the terminal device and the image processing apparatus.
- the control unit is configured so as to acquire the positional relationship between the terminal device and the image processing apparatus by using the positional relationship acquisition unit and, when determining that the terminal device is located close to the image processing apparatus, disable a touch operation with respect to a specific operation key among the plurality of operation keys on the body operation unit.
- the touch operation with respect to a specific operation key on the body operation unit is disabled, which can prevent the image processing apparatus from executing an action unintended by the user of the terminal device and can also improve the operability of the user of the terminal device.
- a user of the body operation unit from the fact that the specific operation key is disabled, can recognize that the terminal device is located close to the image processing apparatus and the image processing apparatus is about to execute an action instructed by the user of the terminal device or is executing the action, so that the user of the body operation unit can be prevented from getting confused.
- operability can be improved even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time.
- a remote operation system for an image processing apparatus is equipped with a terminal device and an image processing apparatus configured to be capable of being remotely operated by the terminal device via a wireless communication line.
- the image processing apparatus is equipped with a body operation unit, a first positional relationship acquisition unit, and a body control unit.
- the body operation unit is capable of displaying a plurality of operation keys and capable of receiving a touch operation with respect to each of the plurality of operation keys.
- the first positional relationship acquisition unit is used in order to acquire a positional relationship between the terminal device and the image processing apparatus.
- the body control unit is configured so as to acquire the positional relationship between the terminal device and the image processing apparatus by using the first positional relationship acquisition unit, and, when determining that the terminal device is located close to the image processing apparatus, disable a touch operation with respect to a specific operation key among the plurality of operation keys on the body operation unit.
- the touch operation with respect to the specific operation key on the body operation unit is disabled, which can prevent the image processing apparatus from executing an action unintended by a user of the terminal device and can also improve the operability of the user of the terminal device.
- a user of the body operation unit from the fact that the specific operation key is disabled, can recognize that the terminal device is located close to the image processing apparatus and the image processing apparatus executes an action instructed by the user of the terminal device, so that the user of the body operation unit can be prevented from getting confused. According to the present invention, operability can be improved even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time.
- FIG. 1 is a block diagram showing a schematic configuration of a remote operation system including an image processing apparatus according to a first preferred embodiment of the present invention.
- FIG. 2 is a flow chart showing process steps in the image processing apparatus.
- FIG. 3 is a flow chart showing process steps in a terminal device.
- FIG. 4A to FIG. 4C are views showing exemplary displays of operation units in a case in which the terminal device is located close to the image processing apparatus:
- FIG. 4A shows an exemplary display of a body operation unit equipped in the image processing apparatus
- FIG. 4B shows an exemplary display when a disabled operation key of the body operation unit is operated
- FIG. 4C shows an exemplary display of a terminal operation unit equipped in the terminal device.
- FIG. 5A to FIG. 5C are views showing exemplary displays of operation units in a case in which the terminal device is located far from the image processing apparatus: FIG. 5A shows an exemplary display of the body operation unit, FIG. 5B shows an exemplary display of the terminal operation unit, and FIG. 5C shows an exemplary display when a disabled operation key of the terminal operation unit is operated.
- FIG. 6A to FIG. 6C are views showing exemplary displays of an error message on operation units in a case in which the terminal device is located close to the image processing apparatus, in a remote operation system including an image processing apparatus according to a second preferred embodiment of the present invention:
- FIG. 6A shows an exemplary display of a body operation unit
- FIG. 6B shows an exemplary display of a terminal operation unit
- FIG. 6C shows an exemplary display of an error message when application software other than application software for remote operation of the image processing apparatus is being operated in the terminal device.
- FIG. 7A and FIG. 7B are views showing exemplary displays of an error message on operation units in a case in which the terminal device is located far from the image processing apparatus, in the remote operation system including the image processing apparatus according to the second preferred embodiment of the present invention:
- FIG. 7A shows an exemplary display of the body operation unit
- FIG. 7B shows an exemplary display of the terminal operation unit.
- FIG. 8A and FIG. 8B are views showing exemplary displays in a terminal operation unit of a terminal device located far from an image processing apparatus, in a remote operation system including the image processing apparatus according to a third preferred embodiment of the present invention:
- FIG. 8A shows an exemplary display of a message indicating that a video captured by a camera can be displayed
- FIG. 8B shows an exemplary display of the video captured by the camera.
- a remote operation system 1 including an image processing apparatus 10 includes one or more terminal devices 20 in addition to the image processing apparatus 10 .
- the image processing apparatus 10 is a multifunctional machine that has various functions, such as a printer function, a copy function, a facsimile function, and a Scan to E-Mail function.
- the terminal device 20 may be a portable type terminal device that has a wireless communication function, such as a smartphone and a tablet terminal device.
- application software for remote operation of the image processing apparatus 10 is installed.
- the image processing apparatus 10 is equipped with a body control unit 11 , a Local Area Network (LAN) interface 12 , a body operation unit 13 , and an image processing unit 14 .
- LAN Local Area Network
- the LAN interface 12 is connected to a router 31 arranged near the image processing apparatus 10 , and enables Internet connection via the router 31 .
- the router 31 and the image processing apparatus 10 are arranged in the same room.
- the body operation unit 13 is capable of displaying various operation screens including a plurality of operation keys and receives an input operation, that is, a touch operation of a user, with respect to each of the plurality of operation keys.
- a liquid crystal touch panel is used as the body operation unit 13 .
- the image processing unit 14 includes an image reading unit that reads an image of a document and generates image data, and an image forming unit that forms an image on a sheet of paper based on the image data. While, as an example, the image forming unit 14 executes an electrophotographic image forming process, the image forming unit 14 may be made to execute other image forming processes such as an inkjet process.
- the body control unit 11 when receiving an input of an action instruction from the terminal device 20 through the body operation unit 13 or the LAN interface 12 , acts in accordance with the action instruction. For example, the body control unit 11 executes the copy function in which an image read from a document in the image processing unit 14 is copied onto a sheet of paper.
- the body control unit 11 is configured to control each unit of the image processing apparatus 10 in an integrated manner.
- the image processing apparatus 10 is configured to be capable of being remotely operated by the terminal device 20 via a wireless communication line.
- the terminal device 20 is equipped with a terminal control unit 21 , a mobile communication interface 22 , a wireless LAN interface 23 , and a terminal operation unit 24 .
- the mobile communication interface 22 enables internet connection by a mobile communication line that is commonly called as 3G, 4G, LTE (Long Term Evolution), and the like, through a mobile base station 32 .
- the mobile communication interface 22 is used for communication by the mobile communication line.
- the wireless LAN interface 23 performs wireless communication with a wireless access point (hereinafter will be referred to as “wireless AP”) 33 , and further enables wireless communication with the body control unit 11 of the image processing apparatus 10 through the router 31 and the LAN interface 12 .
- the wireless LAN interface 23 is used for communication by a wireless LAN line. It is to be noted that, in place of the router 31 and the wireless AP 33 , a wireless LAN router in which both are integrated can be used.
- the terminal operation unit 24 is capable of displaying various operation screens including a plurality of operation keys and receives an input operation, that is, a touch operation of a user, with respect to each of the plurality of operation keys.
- a liquid crystal touch panel is used as the terminal operation unit 24 .
- the terminal control unit 21 when receiving an input of an action instruction from the terminal operation unit 24 , acts in accordance with the action instruction. For example, in a state in which the application software for remote operation of the image processing apparatus 10 is activated, if an input operation for executing the copy function of the image processing apparatus 10 is performed, an action instruction for executing the copy function of the image processing apparatus 10 is transmitted to the image processing apparatus 10 via the mobile communication line or the wireless LAN line.
- the wireless communication via the wireless AP 33 is preferentially used.
- the router 31 assigns an IP address to the terminal device 20 .
- the image processing apparatus 10 when a network address derived from the IP address of the terminal device 20 serving as a communication destination is the same as a network address of the network to which the image processing apparatus 10 belong, can determine that the terminal device 20 serving as the communication destination belongs to the same network as the image processing apparatus 10 , that is, the wireless communication is wireless communication via the wireless AP 33 .
- the wireless communication is determined as wireless communication via the wireless AP 33 .
- the mobile base station 32 assigns an IP address to the terminal device 20 . Therefore, since a network address derived from the IP address of the terminal device 20 serving as a communication destination is different from a network address of the network to which the image processing apparatus 10 belong, both the image processing apparatus 10 and the terminal device 20 determine that the wireless communication between the image processing apparatus 10 and the terminal device 20 is wireless communication via the mobile base station 32 .
- the terminal device 20 exists in a predetermined region in which communication by the wireless LAN line can be performed with the wireless AP 33 arranged near the image processing apparatus 10 , so that the terminal device 20 can be determined to be located close to the image processing apparatus 10 .
- the terminal device 20 is more unlikely to exist in the predetermined region in which communication by the wireless LAN line can be performed, so that the terminal device 20 can be determined to be located far from the image processing apparatus 10 .
- the determination by a type of a wireless communication line as to whether the terminal device 20 is close to or far from the image processing apparatus 10 can simplify a process and equipment for determination.
- the LAN interface 12 , the mobile communication interface 22 , and the wireless LAN interface 23 are equivalent to a positional relationship acquisition unit that is used in order to acquire a positional relationship between the image processing apparatus 10 and the terminal device 20 .
- FIG. 2 shows an example of the process steps in the body control unit 11 of the image processing apparatus 10
- FIG. 3 shows an example of the process steps in the terminal control unit 21 of the terminal device 20 .
- the body control unit 11 determines whether or not the terminal device 20 that activates the application software for remote operation of the image processing apparatus 10 and is about to remotely operate the image processing apparatus 10 is located close to the image processing apparatus 10 (S 1 ). Similarly, also in the terminal device 20 that activates the application software for remote operation of the image processing apparatus 10 and is about to remotely operate the image processing apparatus 10 , the terminal control unit 21 determines whether or not the terminal device 20 itself is located close to the image processing apparatus 10 (S 11 ).
- the specific operation keys 41 to 43 may preferably be operation keys that receive an operation for causing the image processing apparatus 10 to execute an action required for handling a document by a user.
- the specific operation keys 41 to 43 may include a copy key 41 for executing the copy function, an E-Mail key 42 for executing the SCAN to E-Mail function, and a facsimile key 43 for executing the facsimile function.
- the activation of the application software for remote operation makes it possible to display an operation screen 60 similar to the operation screen 40 displayed on the body operation unit 13 .
- the operation key 41 on the body operation unit 13 and the operation key 61 in the terminal operation unit 24 are operation keys to which the functions equal to each other are assigned.
- the operation keys 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , and 50 on the body operation unit 13 and the operation keys 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , and 70 in the terminal operation unit 24 are operation keys to which the functions equal to each other are assigned, respectively.
- the terminal device 20 in the case in which the terminal device 20 is located close, a touch operation with respect to the specific operation keys 61 to 63 is enabled (S 12 ), and, if any of the specific operation keys 61 to 63 is touch operated (S 13 ), an action assigned to the operation key that has been touch operated is executed (S 14 ).
- the operation key 61 which is the most frequently used among the specific operation keys 61 to 63 , may be made to flash more than the other operation keys, for example, and can be made distinct from the other operation keys.
- a touch operation with respect to the specific operation keys 41 to 43 on the body operation unit 13 is disabled, which can prevent the image processing apparatus 10 from executing an action unintended by a user of the terminal operation unit 24 and can also improve the operability of the user of the terminal operation unit 24 .
- a user of the body operation unit 13 from the fact that the specific operation keys 41 to 43 are disabled, can recognize that the terminal device 20 is located close to the image processing apparatus 10 and the image processing apparatus 10 is about to execute an action instructed by the user of the terminal operation unit 24 or is executing the action, so that the user of the body operation unit 13 can be prevented from getting confused.
- the present invention can improve operability even when a user who operates the terminal operation unit 24 and a user who operates the body operation unit 13 exist at the same time.
- the specific operation keys 61 to 63 are grayed out and displayed, and a touch operation with respect to these specific operation keys 61 to 63 is disabled (S 15 ). If these disabled specific operation keys 61 to 63 are touch operated (S 16 ), as shown in FIG. 5C , an error message 52 is displayed (S 17 ). The error message 52 at this time is displayed as, for example, “Due to the necessity of reading a document, the operation cannot be executed from a remote place.”
- the operation for causing the image processing apparatus 10 to execute a specific action required for handling a document by a user is not generally performed in the terminal operation unit 24 . Therefore, even if the specific operation keys 41 to 43 on the body operation unit 13 become enabled, a possibility that the operation from the body operation unit 13 and the operation from the terminal operation unit 24 conflict is very low. Accordingly, the operability of the user of the terminal operation unit 24 and the user of the body operation unit 13 is not lowered.
- disabling the touch operation with respect to the specific operation keys 61 to 63 in the terminal operation unit 24 can prevent the image processing apparatus 10 from executing an action unintended by a user of the body operation unit 13 , can prevent the user of the body operation unit 13 from getting confused, and can also improve the operability of the user of the body operation unit 13 .
- the user of the terminal operation unit 24 can be suppressed by the disabled specific operation keys 61 to 63 from causing an incorrect operation and can be released from the need to pay too much attention to an input operation, which can improve the operability of the user of terminal operation unit 24 .
- a remote operation system 1 including the image processing apparatus 10 according to a second preferred embodiment of the present invention is configured in the same manner as the remote operation system 1 including the image processing apparatus 10 according to the first preferred embodiment of the present invention, except for changing a method of displaying an error message of the error that requires maintenance of the image processing apparatus 10 based on the positional relationship between the image processing apparatus 10 and the terminal device 20 .
- the error that requires maintenance of the image processing apparatus 10 includes: out of paper, a paper jam, toner low, fully stacked sheets of paper on a paper output tray, and a document forgotten to be taken from a document platen.
- an error message 53 may preferably be displayed in a smaller size on the body operation unit 13 .
- the error message 53 is displayed as a specific icon at the end of the operation screen 40 .
- the terminal operation unit 24 displays an error message 54 in a large size.
- the error message 54 at this time is displayed as, for example, “No A4 paper is in Tray 3. Load A4 paper in Tray 3.”
- the terminal operation unit 24 displays an error message 55 in a comparatively small size.
- the error message 55 is displayed in one line in the lateral direction at the upper end of the operation screen 60 .
- the error message 55 is displayed as, for example, “Load A4 paper in Tray 3 of the nearby image processing apparatus MFP-XXX (model number).”
- an error message 56 may preferably be displayed in a larger size on the body operation unit 13 .
- the error message 56 at this time is displayed as, for example, “No A4 paper is in Tray 3. Load A4 paper in Tray 3.”
- the terminal device 20 in the case in which the terminal device 20 is located far from the image processing apparatus 10 , as shown in FIG. 7B , the error message of the error that requires manual maintenance of the image processing apparatus 10 is not displayed.
- the specific operation keys 41 to 43 of the body operation unit 13 and the specific operation keys 61 to 63 of the terminal operation unit 24 are switched between enabled and disabled. This switches a user who can operate the image processing apparatus 10 between the user of the body operation unit 13 and the user of the terminal operation unit 24 . Therefore, an error message is displayed so as to be more noticeable to a user having a high need of the error message and so as not to obstruct other displays, to a user having a low need of the error message. This makes it possible to easily convey the error message to the user having a high need of the error message, and to improve the operability of operations other than the specific operation keys 41 to 43 for the user having a low need of the error message.
- the user of the terminal operation unit 24 may be suitable for handling errors including: out of paper, out of toner, a paper jam, and a document jam. Therefore, the user of the terminal operation unit 24 has a higher need of an error message. Accordingly, as compared with an error message displayed on the body operation unit 13 , an error message is displayed in a larger size on the terminal operation unit 24 . On the other hand, since the user of the body operation unit 13 has a lower need of such an error message, the error message is displayed in a small size, which improves the operability of the body operation unit 13 .
- An image processing apparatus 10 according to a third preferred embodiment of the present invention is configured in the same manner as the image processing apparatus 10 according to the first preferred embodiment of the present invention, except for further including a camera 15 (see FIG. 1 ) as a capturing device and being configured so that captured data obtained by the camera 15 is transmitted to the terminal device 20 in the case in which the terminal device 20 in which the application software for remote operation of the image processing apparatus 10 is installed is located far from the image processing apparatus 10 .
- the captured data may be image data or video data.
- the peripheral surroundings of the image processing apparatus 10 is captured by the camera 15 , and captured data obtained by the camera 15 is transmitted only to the terminal device 20 located far from the image processing apparatus 10 . To the terminal device 20 located close to the image processing apparatus 10 and having a low need of such data, the captured data is not transmitted.
- the operation screen 60 of the terminal operation unit 24 may preferably display a message 57 that an image or video captured by the camera 15 can be displayed.
- the message 57 is displayed, at intervals of a first predetermined time period, for a second predetermined time period.
- the terminal operation unit 24 displays an error message 57 in a comparatively small size.
- the error message 57 is displayed in one line in the lateral direction at the upper end of the operation screen 60 .
- the message 57 is displayed as, for example, “Capturing is in progress with the camera of the image processing apparatus MFP-XXX (model number). Touch here to check.”
- the terminal device 20 if a predetermined spot is touch operated, as shown in FIG. 8B , an image or video captured by the camera 15 is displayed in the terminal operation unit 24 .
- the terminal operation unit 24 may preferably display live feed.
- the image processing apparatus 10 may preferably further include a microphone, acquire audio data around the image processing apparatus 10 , and transmit the audio data together with the captured data to the terminal device 20 located far from the image processing apparatus 10 .
- captured data obtained by the camera 15 may preferably be configured to be recorded.
- the present invention can also be configured so that: the positional relationship acquisition unit that is used in order to acquire a positional relationship between the image processing apparatus 10 and the terminal device 20 may preferably include a GPS (Global Positioning System) or a three dimensional position sensor; the GPS or the three dimensional position sensor senses a distance between the image processing apparatus 10 and the terminal device 20 ; the image processing apparatus 10 and the terminal device 20 are determined to be located far from each other when the distance is equal to and more than a predetermined value; and the image processing apparatus 10 and the terminal device 20 are determined to be located close to each other when the distance is less than the predetermined value. Moreover, the present invention can also be configured so that whether the image processing apparatus 10 and the terminal device 20 are determined to be located far from or close to each other, with the antenna intensity of transmission and reception between both the image processing apparatus 10 and the terminal device 20 .
- GPS Global Positioning System
- the image processing apparatus 10 is not limited to being a multifunctional machine, and the present invention can also be applied to an image forming device such as a copying machine, a printer, a facsimile machine, and an image reading device such as a scanner, and, even if it is a case in which a user of the terminal device and a user of the body operation unit exist at the same time, the effect that operability can be improved can be achieved.
- an image forming device such as a copying machine, a printer, a facsimile machine, and an image reading device such as a scanner
Abstract
Description
- This application is a Divisional of copending U.S. application Ser. No. 15/421,810, filed on Feb. 1, 2017 which is a Continuation of application Ser. No. 15/081,099, filed Mar. 25, 2017 (now U.S. Pat. No. 9,596,373 issued Mar. 14, 2017), which is a Continuation of application Ser. No. 14/561,316, filed on Dec. 5, 2014 (now U.S. Pat. No. 9,325,873 issued Apr. 26, 2016), and which claims priority under 35 U.S.C. § 119(a) on Patent Application No. 2013-265700 filed in Japan on Dec. 24, 2013, the entire contents of which are hereby incorporated by reference.
- The present invention relates to an image processing apparatus configured to be capable of being remotely operated by a terminal device via a wireless communication line, and to a remote operation system for such an image processing apparatus.
- Of image processing apparatuses such as image forming devices and image reading devices, an image processing apparatus is configured to be capable of not only being operated by a body operation unit mounted in the image processing apparatus but also being remotely operated by a portable type terminal device such as a smartphone and a tablet terminal device, via a wireless communication line (see Japanese Patent Laid-Open publication No. 2011-103572, for example).
- In image processing apparatuses, since operations that cause the image processing apparatuses to execute a specific action required for handling a document, such as copy start and scan start involve work of a user, including placement of a document, such operations are generally performed when the user is close to the image processing apparatus.
- In view of the foregoing, an image processing apparatus has been proposed, the image processing apparatus being configured so as to disable a touch operation with respect to the specific operation key of the terminal device to cause the image processing apparatus to execute the above described specific action when the user is far from the image processing apparatus, (see Japanese Patent Laid-Open publication No. 2013-000985, for example). In this image processing apparatus, the user is not required to pay attention so as not to operate the specific operation key when being far from the image processing apparatus, which improves the operability of the terminal device.
- However, in the conventional image processing apparatuses described in Japanese Patent Laid-Open publication No. 2011-103572 and Japanese Patent Laid-Open publication No. 2013-000985, the operation keys of the body operation unit of the image processing apparatus have not been switched between enabled and disabled, according to the positional relationship between the image processing apparatus and the terminal device.
- Therefore, in a state in which there is a user who is operating the terminal device to cause the image processing apparatus to execute the above described specific action and there is another user who has operated the body operation unit to cause the image processing apparatus to execute the above described specific action, the user who is operating the terminal device gets confused due to a failure to cause the image processing apparatus to execute an action intended by the user, which may cause a risk of reducing the operability of the user who is operating the terminal device.
- In the same manner, in a state in which there is a user who is operating the body operation unit to cause the image processing apparatus to execute the above described specific action and there is another user who has operated the terminal device to cause the image processing apparatus to execute the above described specific action, the user who is operating the body operation unit gets confused due to an unexpected behavior of the image processing apparatus, which may cause a risk of reducing the operability of the user who is operating the body operation unit.
- An object of the present invention is to provide an image processing apparatus capable of improving operability even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time, and to provide a remote operation system for such an image processing apparatus.
- An image processing apparatus according to preferred embodiments of the present invention is configured to be capable of being remotely operated by a terminal device via a wireless communication line. The image processing apparatus is equipped with a body operation unit, a positional relationship acquisition unit, and a control unit. The body operation unit is capable of displaying a plurality of operation keys and capable of receiving a touch operation with respect to each of the plurality of operation keys. The positional relationship acquisition unit is used in order to acquire a positional relationship between the terminal device and the image processing apparatus. The control unit is configured so as to acquire the positional relationship between the terminal device and the image processing apparatus by using the positional relationship acquisition unit and, when determining that the terminal device is located close to the image processing apparatus, disable a touch operation with respect to a specific operation key among the plurality of operation keys on the body operation unit.
- With this configuration, in a case in which the terminal device is located close to the image processing apparatus, the touch operation with respect to a specific operation key on the body operation unit is disabled, which can prevent the image processing apparatus from executing an action unintended by the user of the terminal device and can also improve the operability of the user of the terminal device. In addition, a user of the body operation unit, from the fact that the specific operation key is disabled, can recognize that the terminal device is located close to the image processing apparatus and the image processing apparatus is about to execute an action instructed by the user of the terminal device or is executing the action, so that the user of the body operation unit can be prevented from getting confused. According to the present invention, operability can be improved even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time.
- A remote operation system for an image processing apparatus according to preferred embodiments of the present invention is equipped with a terminal device and an image processing apparatus configured to be capable of being remotely operated by the terminal device via a wireless communication line. The image processing apparatus is equipped with a body operation unit, a first positional relationship acquisition unit, and a body control unit. The body operation unit is capable of displaying a plurality of operation keys and capable of receiving a touch operation with respect to each of the plurality of operation keys. The first positional relationship acquisition unit is used in order to acquire a positional relationship between the terminal device and the image processing apparatus. The body control unit is configured so as to acquire the positional relationship between the terminal device and the image processing apparatus by using the first positional relationship acquisition unit, and, when determining that the terminal device is located close to the image processing apparatus, disable a touch operation with respect to a specific operation key among the plurality of operation keys on the body operation unit.
- With this configuration, in a case in which the terminal device is located close to the image processing apparatus, the touch operation with respect to the specific operation key on the body operation unit is disabled, which can prevent the image processing apparatus from executing an action unintended by a user of the terminal device and can also improve the operability of the user of the terminal device. In addition, a user of the body operation unit, from the fact that the specific operation key is disabled, can recognize that the terminal device is located close to the image processing apparatus and the image processing apparatus executes an action instructed by the user of the terminal device, so that the user of the body operation unit can be prevented from getting confused. According to the present invention, operability can be improved even when a user who operates a terminal device and a user who operates a body operation unit exist at the same time.
- The foregoing and other features and attendant advantages of the present invention will become more apparent from the reading of the following detailed description of the invention in conjunction with the accompanying drawings.
-
FIG. 1 is a block diagram showing a schematic configuration of a remote operation system including an image processing apparatus according to a first preferred embodiment of the present invention. -
FIG. 2 is a flow chart showing process steps in the image processing apparatus. -
FIG. 3 is a flow chart showing process steps in a terminal device. -
FIG. 4A toFIG. 4C are views showing exemplary displays of operation units in a case in which the terminal device is located close to the image processing apparatus:FIG. 4A shows an exemplary display of a body operation unit equipped in the image processing apparatus,FIG. 4B shows an exemplary display when a disabled operation key of the body operation unit is operated, andFIG. 4C shows an exemplary display of a terminal operation unit equipped in the terminal device. -
FIG. 5A toFIG. 5C are views showing exemplary displays of operation units in a case in which the terminal device is located far from the image processing apparatus:FIG. 5A shows an exemplary display of the body operation unit,FIG. 5B shows an exemplary display of the terminal operation unit, andFIG. 5C shows an exemplary display when a disabled operation key of the terminal operation unit is operated. -
FIG. 6A toFIG. 6C are views showing exemplary displays of an error message on operation units in a case in which the terminal device is located close to the image processing apparatus, in a remote operation system including an image processing apparatus according to a second preferred embodiment of the present invention:FIG. 6A shows an exemplary display of a body operation unit,FIG. 6B shows an exemplary display of a terminal operation unit, andFIG. 6C shows an exemplary display of an error message when application software other than application software for remote operation of the image processing apparatus is being operated in the terminal device. -
FIG. 7A andFIG. 7B are views showing exemplary displays of an error message on operation units in a case in which the terminal device is located far from the image processing apparatus, in the remote operation system including the image processing apparatus according to the second preferred embodiment of the present invention:FIG. 7A shows an exemplary display of the body operation unit, andFIG. 7B shows an exemplary display of the terminal operation unit. -
FIG. 8A andFIG. 8B are views showing exemplary displays in a terminal operation unit of a terminal device located far from an image processing apparatus, in a remote operation system including the image processing apparatus according to a third preferred embodiment of the present invention:FIG. 8A shows an exemplary display of a message indicating that a video captured by a camera can be displayed, andFIG. 8B shows an exemplary display of the video captured by the camera. - As shown in
FIG. 1 , aremote operation system 1 including animage processing apparatus 10 according to a first preferred embodiment of the present invention includes one or moreterminal devices 20 in addition to theimage processing apparatus 10. As an example, theimage processing apparatus 10 is a multifunctional machine that has various functions, such as a printer function, a copy function, a facsimile function, and a Scan to E-Mail function. Theterminal device 20 may be a portable type terminal device that has a wireless communication function, such as a smartphone and a tablet terminal device. In theterminal device 20, application software for remote operation of theimage processing apparatus 10 is installed. - The
image processing apparatus 10 is equipped with abody control unit 11, a Local Area Network (LAN)interface 12, abody operation unit 13, and animage processing unit 14. - The
LAN interface 12 is connected to arouter 31 arranged near theimage processing apparatus 10, and enables Internet connection via therouter 31. As an example, therouter 31 and theimage processing apparatus 10 are arranged in the same room. - The
body operation unit 13 is capable of displaying various operation screens including a plurality of operation keys and receives an input operation, that is, a touch operation of a user, with respect to each of the plurality of operation keys. For example, as thebody operation unit 13, a liquid crystal touch panel is used. - The
image processing unit 14 includes an image reading unit that reads an image of a document and generates image data, and an image forming unit that forms an image on a sheet of paper based on the image data. While, as an example, theimage forming unit 14 executes an electrophotographic image forming process, theimage forming unit 14 may be made to execute other image forming processes such as an inkjet process. - The
body control unit 11, when receiving an input of an action instruction from theterminal device 20 through thebody operation unit 13 or theLAN interface 12, acts in accordance with the action instruction. For example, thebody control unit 11 executes the copy function in which an image read from a document in theimage processing unit 14 is copied onto a sheet of paper. Thebody control unit 11 is configured to control each unit of theimage processing apparatus 10 in an integrated manner. - Thus, the
image processing apparatus 10 is configured to be capable of being remotely operated by theterminal device 20 via a wireless communication line. - The
terminal device 20 is equipped with aterminal control unit 21, amobile communication interface 22, awireless LAN interface 23, and aterminal operation unit 24. - The
mobile communication interface 22 enables internet connection by a mobile communication line that is commonly called as 3G, 4G, LTE (Long Term Evolution), and the like, through amobile base station 32. In other words, themobile communication interface 22 is used for communication by the mobile communication line. - The
wireless LAN interface 23 performs wireless communication with a wireless access point (hereinafter will be referred to as “wireless AP”) 33, and further enables wireless communication with thebody control unit 11 of theimage processing apparatus 10 through therouter 31 and theLAN interface 12. In other words, thewireless LAN interface 23 is used for communication by a wireless LAN line. It is to be noted that, in place of therouter 31 and thewireless AP 33, a wireless LAN router in which both are integrated can be used. - The
terminal operation unit 24 is capable of displaying various operation screens including a plurality of operation keys and receives an input operation, that is, a touch operation of a user, with respect to each of the plurality of operation keys. For example, as theterminal operation unit 24, a liquid crystal touch panel is used. - The
terminal control unit 21, when receiving an input of an action instruction from theterminal operation unit 24, acts in accordance with the action instruction. For example, in a state in which the application software for remote operation of theimage processing apparatus 10 is activated, if an input operation for executing the copy function of theimage processing apparatus 10 is performed, an action instruction for executing the copy function of theimage processing apparatus 10 is transmitted to theimage processing apparatus 10 via the mobile communication line or the wireless LAN line. - When the
terminal device 20 is in a region in which both the wireless communication via thewireless AP 33 and the wireless communication via themobile base station 32 can be performed, the wireless communication via thewireless AP 33 is preferentially used. - In the
remote operation system 1, in a case in which theterminal device 20 performs wireless communication with theimage processing apparatus 10 via thewireless AP 33, therouter 31 assigns an IP address to theterminal device 20. Theimage processing apparatus 10, when a network address derived from the IP address of theterminal device 20 serving as a communication destination is the same as a network address of the network to which theimage processing apparatus 10 belong, can determine that theterminal device 20 serving as the communication destination belongs to the same network as theimage processing apparatus 10, that is, the wireless communication is wireless communication via thewireless AP 33. Similarly, also in theterminal device 20, since the network address is the same as the network address of theimage processing apparatus 10, the wireless communication is determined as wireless communication via thewireless AP 33. - On the other hand, in a case in which the
terminal device 20 performs wireless communication with theimage processing apparatus 10 via themobile base station 32, themobile base station 32 assigns an IP address to theterminal device 20. Therefore, since a network address derived from the IP address of theterminal device 20 serving as a communication destination is different from a network address of the network to which theimage processing apparatus 10 belong, both theimage processing apparatus 10 and theterminal device 20 determine that the wireless communication between theimage processing apparatus 10 and theterminal device 20 is wireless communication via themobile base station 32. - In a case in which a type of the wireless communication line between the
image processing apparatus 10 and theterminal device 20 is a wireless LAN line, theterminal device 20 exists in a predetermined region in which communication by the wireless LAN line can be performed with thewireless AP 33 arranged near theimage processing apparatus 10, so that theterminal device 20 can be determined to be located close to theimage processing apparatus 10. On the other hand, in a case in which a type of the wireless communication line between theimage processing apparatus 10 and theterminal device 20 is a mobile communication line, theterminal device 20 is more unlikely to exist in the predetermined region in which communication by the wireless LAN line can be performed, so that theterminal device 20 can be determined to be located far from theimage processing apparatus 10. Thus, the determination by a type of a wireless communication line as to whether theterminal device 20 is close to or far from theimage processing apparatus 10 can simplify a process and equipment for determination. It should be noted that theLAN interface 12, themobile communication interface 22, and thewireless LAN interface 23 are equivalent to a positional relationship acquisition unit that is used in order to acquire a positional relationship between theimage processing apparatus 10 and theterminal device 20. -
FIG. 2 shows an example of the process steps in thebody control unit 11 of theimage processing apparatus 10, andFIG. 3 shows an example of the process steps in theterminal control unit 21 of theterminal device 20. - In the
image processing apparatus 10, thebody control unit 11 determines whether or not theterminal device 20 that activates the application software for remote operation of theimage processing apparatus 10 and is about to remotely operate theimage processing apparatus 10 is located close to the image processing apparatus 10 (S1). Similarly, also in theterminal device 20 that activates the application software for remote operation of theimage processing apparatus 10 and is about to remotely operate theimage processing apparatus 10, theterminal control unit 21 determines whether or not theterminal device 20 itself is located close to the image processing apparatus 10 (S11). It is to be noted that it is possible to configure so that the determination as to whether or not theterminal device 20 that activates the application software for remote operation of theimage processing apparatus 10 and is about to remotely operate theimage processing apparatus 10 is located close to theimage processing apparatus 10 is performed by one of theimage processing apparatus 10 or theterminal device 20 and a determination result is transmitted to the other. - In the
image processing apparatus 10, in a case in which theterminal device 20 is located close,specific operation keys 41 to 43 among a plurality ofoperation keys operation screen 40 of thebody operation unit 13 are grayed out and displayed, for example, as shown inFIG. 4A , and the touch operation with respect to thesespecific operation keys 41 to 43 is disabled (S2). If these disabledspecific operation keys 41 to 43 are touch operated (S3), as shown inFIG. 4B , anerror message 51 is displayed (S4). Theerror message 51 at this time is displayed as, for example, “Due to the ongoing operation from the mobile terminal, the operation from the main body cannot be executed.” - The
specific operation keys 41 to 43 may preferably be operation keys that receive an operation for causing theimage processing apparatus 10 to execute an action required for handling a document by a user. For example, thespecific operation keys 41 to 43 may include acopy key 41 for executing the copy function, anE-Mail key 42 for executing the SCAN to E-Mail function, and afacsimile key 43 for executing the facsimile function. - In the
terminal device 20, the activation of the application software for remote operation makes it possible to display anoperation screen 60 similar to theoperation screen 40 displayed on thebody operation unit 13. The operation key 41 on thebody operation unit 13 and the operation key 61 in theterminal operation unit 24 are operation keys to which the functions equal to each other are assigned. Similarly, theoperation keys body operation unit 13 and theoperation keys terminal operation unit 24 are operation keys to which the functions equal to each other are assigned, respectively. - In the
terminal device 20, in the case in which theterminal device 20 is located close, a touch operation with respect to thespecific operation keys 61 to 63 is enabled (S12), and, if any of thespecific operation keys 61 to 63 is touch operated (S13), an action assigned to the operation key that has been touch operated is executed (S14). In such a case, as shown inFIG. 4C , on theoperation screen 60 of theterminal operation unit 24, theoperation key 61, which is the most frequently used among thespecific operation keys 61 to 63, may be made to flash more than the other operation keys, for example, and can be made distinct from the other operation keys. - In the case in which the
terminal device 20 is located close to theimage processing apparatus 10, a touch operation with respect to thespecific operation keys 41 to 43 on thebody operation unit 13 is disabled, which can prevent theimage processing apparatus 10 from executing an action unintended by a user of theterminal operation unit 24 and can also improve the operability of the user of theterminal operation unit 24. In addition, a user of thebody operation unit 13, from the fact that thespecific operation keys 41 to 43 are disabled, can recognize that theterminal device 20 is located close to theimage processing apparatus 10 and theimage processing apparatus 10 is about to execute an action instructed by the user of theterminal operation unit 24 or is executing the action, so that the user of thebody operation unit 13 can be prevented from getting confused. Thus, the present invention can improve operability even when a user who operates theterminal operation unit 24 and a user who operates thebody operation unit 13 exist at the same time. - Subsequently, a description is directed to a case in which the
terminal device 20 that activates the application software for remote operation of theimage processing apparatus 10 and is about to remotely operate theimage processing apparatus 10 is located far from theimage processing apparatus 10. - In the
image processing apparatus 10, in a case in which theterminal device 20 is located far (No in S1), as shown inFIG. 5A , a touch operation with respect to thespecific operation keys 41 to 43 is enabled (S5), and, if any of thespecific keys 41 to 43 is touch operated (S6), an action assigned to the operation key that has been operated is executed (S7). - On the other hand, in the
terminal device 20, in a case in which theterminal device 20 is located far from the image processing apparatus 10 (No in S11), thespecific operation keys 61 to 63, as shown inFIG. 5B , for example, are grayed out and displayed, and a touch operation with respect to thesespecific operation keys 61 to 63 is disabled (S15). If these disabledspecific operation keys 61 to 63 are touch operated (S16), as shown inFIG. 5C , anerror message 52 is displayed (S17). Theerror message 52 at this time is displayed as, for example, “Due to the necessity of reading a document, the operation cannot be executed from a remote place.” - In the case in which the
terminal device 20 is located far from theimage processing apparatus 10, the operation for causing theimage processing apparatus 10 to execute a specific action required for handling a document by a user is not generally performed in theterminal operation unit 24. Therefore, even if thespecific operation keys 41 to 43 on thebody operation unit 13 become enabled, a possibility that the operation from thebody operation unit 13 and the operation from theterminal operation unit 24 conflict is very low. Accordingly, the operability of the user of theterminal operation unit 24 and the user of thebody operation unit 13 is not lowered. On the other hand, in the case in which theterminal device 20 is located close to theimage processing apparatus 10, a possibility that the user of theterminal operation unit 24 performs an operation for causing theimage processing apparatus 10 to execute the above described specific action is high, so that disabling the touch operation with respect to thespecific operation keys 41 to 43 on thebody operation unit 13 can improve the operability of the user of theterminal operation unit 24 and the user of thebody operation unit 13. - Moreover, in the case in which the
terminal device 20 is located far from theimage processing apparatus 10, disabling the touch operation with respect to thespecific operation keys 61 to 63 in theterminal operation unit 24 can prevent theimage processing apparatus 10 from executing an action unintended by a user of thebody operation unit 13, can prevent the user of thebody operation unit 13 from getting confused, and can also improve the operability of the user of thebody operation unit 13. Furthermore, the user of theterminal operation unit 24 can be suppressed by the disabledspecific operation keys 61 to 63 from causing an incorrect operation and can be released from the need to pay too much attention to an input operation, which can improve the operability of the user ofterminal operation unit 24. - A
remote operation system 1 including theimage processing apparatus 10 according to a second preferred embodiment of the present invention is configured in the same manner as theremote operation system 1 including theimage processing apparatus 10 according to the first preferred embodiment of the present invention, except for changing a method of displaying an error message of the error that requires maintenance of theimage processing apparatus 10 based on the positional relationship between theimage processing apparatus 10 and theterminal device 20. - The error that requires maintenance of the
image processing apparatus 10 includes: out of paper, a paper jam, toner low, fully stacked sheets of paper on a paper output tray, and a document forgotten to be taken from a document platen. - In the
image processing apparatus 10, in the case in which theterminal device 20 that activates the application software for remote operation of theimage processing apparatus 10 and is about to remotely operate theimage processing apparatus 10 is located close to theimage processing apparatus 10, as compared with an error message in the case in which theterminal device 20 is located far from theimage processing apparatus 10, as shown inFIG. 6A , anerror message 53 may preferably be displayed in a smaller size on thebody operation unit 13. For example, theerror message 53 is displayed as a specific icon at the end of theoperation screen 40. - In the
terminal device 20, when being located close to theimage processing apparatus 10, as shown inFIG. 6B , theterminal operation unit 24 displays anerror message 54 in a large size. Theerror message 54 at this time is displayed as, for example, “No A4 paper is inTray 3. Load A4 paper inTray 3.” - Additionally, in the
terminal device 20, even when being located close to theimage processing apparatus 10, as shown inFIG. 6C , in a case in which application software other than application software for remote operation of theimage processing apparatus 10 is being operated, the application software for remote operation of theimage processing apparatus 10 runs in the background, and theterminal operation unit 24 displays anerror message 55 in a comparatively small size. For example, theerror message 55 is displayed in one line in the lateral direction at the upper end of theoperation screen 60. Theerror message 55 is displayed as, for example, “Load A4 paper inTray 3 of the nearby image processing apparatus MFP-XXX (model number).” - On the other hand, in the
image processing apparatus 10, in the case in which theterminal device 20 is located far from theimage processing apparatus 10, as compared with an error message in the case in which theterminal device 20 is located close to theimage processing apparatus 10, as shown inFIG. 7A , anerror message 56 may preferably be displayed in a larger size on thebody operation unit 13. Theerror message 56 at this time is displayed as, for example, “No A4 paper is inTray 3. Load A4 paper inTray 3.” - In the
terminal device 20, in the case in which theterminal device 20 is located far from theimage processing apparatus 10, as shown inFIG. 7B , the error message of the error that requires manual maintenance of theimage processing apparatus 10 is not displayed. - Thus, according to the positional relationship between the
image processing apparatus 10 and theterminal device 20, thespecific operation keys 41 to 43 of thebody operation unit 13 and thespecific operation keys 61 to 63 of theterminal operation unit 24 are switched between enabled and disabled. This switches a user who can operate theimage processing apparatus 10 between the user of thebody operation unit 13 and the user of theterminal operation unit 24. Therefore, an error message is displayed so as to be more noticeable to a user having a high need of the error message and so as not to obstruct other displays, to a user having a low need of the error message. This makes it possible to easily convey the error message to the user having a high need of the error message, and to improve the operability of operations other than thespecific operation keys 41 to 43 for the user having a low need of the error message. - Specifically, in the case in which the
terminal device 20 is located close to theimage processing apparatus 10, since thespecific operation keys 41 to 43 on thebody operation unit 13 are disabled and the user of theterminal operation unit 24 eventually operates theimage processing apparatus 10, the user of theterminal operation unit 24 may be suitable for handling errors including: out of paper, out of toner, a paper jam, and a document jam. Therefore, the user of theterminal operation unit 24 has a higher need of an error message. Accordingly, as compared with an error message displayed on thebody operation unit 13, an error message is displayed in a larger size on theterminal operation unit 24. On the other hand, since the user of thebody operation unit 13 has a lower need of such an error message, the error message is displayed in a small size, which improves the operability of thebody operation unit 13. - An
image processing apparatus 10 according to a third preferred embodiment of the present invention is configured in the same manner as theimage processing apparatus 10 according to the first preferred embodiment of the present invention, except for further including a camera 15 (seeFIG. 1 ) as a capturing device and being configured so that captured data obtained by thecamera 15 is transmitted to theterminal device 20 in the case in which theterminal device 20 in which the application software for remote operation of theimage processing apparatus 10 is installed is located far from theimage processing apparatus 10. The captured data may be image data or video data. - In the
image processing apparatus 10 according to the third preferred embodiment of the present invention, the peripheral surroundings of theimage processing apparatus 10 is captured by thecamera 15, and captured data obtained by thecamera 15 is transmitted only to theterminal device 20 located far from theimage processing apparatus 10. To theterminal device 20 located close to theimage processing apparatus 10 and having a low need of such data, the captured data is not transmitted. - In the
terminal device 20, theoperation screen 60 of theterminal operation unit 24 may preferably display a message 57 that an image or video captured by thecamera 15 can be displayed. For example, the message 57 is displayed, at intervals of a first predetermined time period, for a second predetermined time period. - As shown in
FIG. 8A , in theterminal device 20, in the case in which application software other than the application software for remote operation of theimage processing apparatus 10 is being operated, the application software for remote operation of theimage processing apparatus 10 runs in the background, and theterminal operation unit 24 displays an error message 57 in a comparatively small size. For example, the error message 57 is displayed in one line in the lateral direction at the upper end of theoperation screen 60. The message 57 is displayed as, for example, “Capturing is in progress with the camera of the image processing apparatus MFP-XXX (model number). Touch here to check.” - In the
terminal device 20, if a predetermined spot is touch operated, as shown inFIG. 8B , an image or video captured by thecamera 15 is displayed in theterminal operation unit 24. Theterminal operation unit 24 may preferably display live feed. It should be noted that theimage processing apparatus 10 may preferably further include a microphone, acquire audio data around theimage processing apparatus 10, and transmit the audio data together with the captured data to theterminal device 20 located far from theimage processing apparatus 10. - Since the user of the
terminal device 20 located far from theimage processing apparatus 10 can know the peripheral surroundings of theimage processing apparatus 10 through an image or a video, security can be improved. Therefore, the crime prevention of the installation location of theimage processing apparatus 10, such as an office, can be enhanced. In addition, captured data obtained by thecamera 15 may preferably be configured to be recorded. - It is to be noted that the present invention can also be configured so that: the positional relationship acquisition unit that is used in order to acquire a positional relationship between the
image processing apparatus 10 and theterminal device 20 may preferably include a GPS (Global Positioning System) or a three dimensional position sensor; the GPS or the three dimensional position sensor senses a distance between theimage processing apparatus 10 and theterminal device 20; theimage processing apparatus 10 and theterminal device 20 are determined to be located far from each other when the distance is equal to and more than a predetermined value; and theimage processing apparatus 10 and theterminal device 20 are determined to be located close to each other when the distance is less than the predetermined value. Moreover, the present invention can also be configured so that whether theimage processing apparatus 10 and theterminal device 20 are determined to be located far from or close to each other, with the antenna intensity of transmission and reception between both theimage processing apparatus 10 and theterminal device 20. - The
image processing apparatus 10 is not limited to being a multifunctional machine, and the present invention can also be applied to an image forming device such as a copying machine, a printer, a facsimile machine, and an image reading device such as a scanner, and, even if it is a case in which a user of the terminal device and a user of the body operation unit exist at the same time, the effect that operability can be improved can be achieved. - It is also conceivable that new preferred embodiments may be configured by combining respective technical features of the above described preferred embodiments one another.
- The foregoing preferred embodiments are to be considered in all respects as illustrative and not restrictive. The scope of the present invention is defined by the following claims, not by the foregoing preferred embodiments. Further, the scope of the present invention is intended to include the scopes of the claims and all possible changes and modifications within the senses and scopes of equivalents.
Claims (15)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/023,966 US20180324316A1 (en) | 2013-12-24 | 2018-06-29 | Image processing apparatus, and remote operation system for image processing apparatus |
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013265700A JP5985462B2 (en) | 2013-12-24 | 2013-12-24 | Image processing apparatus and remote control system for image processing apparatus |
JP2013-265700 | 2013-12-24 | ||
US14/561,316 US9325873B2 (en) | 2013-12-24 | 2014-12-05 | Image processing apparatus, and remote operation system for image processing apparatus |
US15/081,099 US9596373B2 (en) | 2013-12-24 | 2016-03-25 | Image processing apparatus, and remote operation system for image processing apparatus |
US15/421,810 US10038809B2 (en) | 2013-12-24 | 2017-02-01 | Image processing apparatus, and remote operation system for image processing apparatus |
US16/023,966 US20180324316A1 (en) | 2013-12-24 | 2018-06-29 | Image processing apparatus, and remote operation system for image processing apparatus |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/421,810 Division US10038809B2 (en) | 2013-12-24 | 2017-02-01 | Image processing apparatus, and remote operation system for image processing apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180324316A1 true US20180324316A1 (en) | 2018-11-08 |
Family
ID=53401479
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/561,316 Active US9325873B2 (en) | 2013-12-24 | 2014-12-05 | Image processing apparatus, and remote operation system for image processing apparatus |
US15/081,099 Active US9596373B2 (en) | 2013-12-24 | 2016-03-25 | Image processing apparatus, and remote operation system for image processing apparatus |
US15/421,810 Active US10038809B2 (en) | 2013-12-24 | 2017-02-01 | Image processing apparatus, and remote operation system for image processing apparatus |
US16/023,966 Abandoned US20180324316A1 (en) | 2013-12-24 | 2018-06-29 | Image processing apparatus, and remote operation system for image processing apparatus |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/561,316 Active US9325873B2 (en) | 2013-12-24 | 2014-12-05 | Image processing apparatus, and remote operation system for image processing apparatus |
US15/081,099 Active US9596373B2 (en) | 2013-12-24 | 2016-03-25 | Image processing apparatus, and remote operation system for image processing apparatus |
US15/421,810 Active US10038809B2 (en) | 2013-12-24 | 2017-02-01 | Image processing apparatus, and remote operation system for image processing apparatus |
Country Status (3)
Country | Link |
---|---|
US (4) | US9325873B2 (en) |
JP (1) | JP5985462B2 (en) |
CN (2) | CN104735286B (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6244861B2 (en) * | 2013-12-04 | 2017-12-13 | 株式会社リコー | Information processing system, information processing apparatus, information processing method, and program |
JP6405741B2 (en) * | 2014-06-24 | 2018-10-17 | ブラザー工業株式会社 | Image processing apparatus, display method, and storage medium |
JP6493041B2 (en) * | 2015-07-08 | 2019-04-03 | 株式会社リコー | Information processing apparatus, image processing apparatus, program, and method |
JP6686968B2 (en) * | 2017-05-30 | 2020-04-22 | 京セラドキュメントソリューションズ株式会社 | Mobile terminals and electronic systems |
JP2019028508A (en) * | 2017-07-25 | 2019-02-21 | 富士ゼロックス株式会社 | Information processing apparatus and program |
JP2019097091A (en) * | 2017-11-27 | 2019-06-20 | シャープ株式会社 | Electronic apparatus, image formation device, control method of the same, and program |
JP7103008B2 (en) * | 2018-07-19 | 2022-07-20 | 富士フイルムビジネスイノベーション株式会社 | Image forming device and program |
CN114095599B (en) * | 2020-07-03 | 2023-03-03 | 华为技术有限公司 | Message display method and electronic equipment |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130329253A1 (en) * | 2012-06-12 | 2013-12-12 | Ricoh Company, Ltd. | Image processing apparatus, screen data providing method, and computer-readable recording medium |
US20140253949A1 (en) * | 2013-03-05 | 2014-09-11 | Brother Kogyo Kabushiki Kaisha | Communication apparatus and communication system |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005321944A (en) * | 2004-05-07 | 2005-11-17 | Konica Minolta Business Technologies Inc | Image forming system |
JP2006115101A (en) * | 2004-10-13 | 2006-04-27 | Murata Mach Ltd | Pictorial communication equipment |
JP4182946B2 (en) * | 2004-12-09 | 2008-11-19 | ブラザー工業株式会社 | MANAGEMENT SYSTEM, RADIO COMMUNICATION DEVICE, PROGRAM, AND RADIO COMMUNICATION DEVICE MANAGEMENT METHOD |
JP4345749B2 (en) * | 2006-01-31 | 2009-10-14 | コニカミノルタビジネステクノロジーズ株式会社 | Image transmission device |
JP4287456B2 (en) | 2006-10-26 | 2009-07-01 | 株式会社東芝 | Server apparatus, method and program for preventing denial of service attacks |
JP2008109463A (en) * | 2006-10-26 | 2008-05-08 | Murata Mach Ltd | Information processor |
JP2008193265A (en) * | 2007-02-01 | 2008-08-21 | Canon Inc | Image processing system, information processor, image processor, control method therefor, and computer program |
JP2010041238A (en) * | 2008-08-01 | 2010-02-18 | Ricoh Co Ltd | Image forming device, screen display method, image forming system, program and storage medium |
US8872775B2 (en) * | 2008-10-27 | 2014-10-28 | Nec Corporation | Information processing apparatus |
JP5240170B2 (en) * | 2009-03-18 | 2013-07-17 | 株式会社リコー | Image forming apparatus, program, and information processing system |
JP2011061702A (en) * | 2009-09-14 | 2011-03-24 | Konica Minolta Business Technologies Inc | Image forming apparatus and method of controlling the same, and control program for the image forming apparatus |
JP2011103527A (en) * | 2009-11-10 | 2011-05-26 | Sharp Corp | Control apparatus |
JP2011103572A (en) | 2009-11-11 | 2011-05-26 | Canon Inc | User interface of image processor |
US20120075663A1 (en) * | 2010-09-29 | 2012-03-29 | Sharp Laboratories Of America, Inc. | Providing image information to a remote device |
US9071709B2 (en) * | 2011-03-31 | 2015-06-30 | Nokia Technologies Oy | Method and apparatus for providing collaboration between remote and on-site users of indirect augmented reality |
JP5806009B2 (en) | 2011-06-17 | 2015-11-10 | シャープ株式会社 | Operation display device and image processing device |
JP5573814B2 (en) * | 2011-10-26 | 2014-08-20 | コニカミノルタ株式会社 | Device having display unit for displaying screen, user interface control method, and user interface control program |
JP5961012B2 (en) * | 2012-02-29 | 2016-08-02 | キヤノン株式会社 | Image forming apparatus and control method thereof |
JP5686125B2 (en) * | 2012-10-25 | 2015-03-18 | コニカミノルタ株式会社 | Set value input device, image forming apparatus, set value input method, and set value input program |
JP5716732B2 (en) * | 2012-12-19 | 2015-05-13 | コニカミノルタ株式会社 | Control program, control device, image processing system, and control method |
JP6431257B2 (en) * | 2013-10-21 | 2018-11-28 | キヤノン株式会社 | NETWORK SYSTEM, NETWORK DEVICE MANAGEMENT METHOD, NETWORK DEVICE, ITS CONTROL METHOD AND PROGRAM, AND MANAGEMENT SYSTEM |
-
2013
- 2013-12-24 JP JP2013265700A patent/JP5985462B2/en active Active
-
2014
- 2014-12-05 US US14/561,316 patent/US9325873B2/en active Active
- 2014-12-24 CN CN201410815343.3A patent/CN104735286B/en active Active
- 2014-12-24 CN CN201910128695.4A patent/CN110062124B/en active Active
-
2016
- 2016-03-25 US US15/081,099 patent/US9596373B2/en active Active
-
2017
- 2017-02-01 US US15/421,810 patent/US10038809B2/en active Active
-
2018
- 2018-06-29 US US16/023,966 patent/US20180324316A1/en not_active Abandoned
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130329253A1 (en) * | 2012-06-12 | 2013-12-12 | Ricoh Company, Ltd. | Image processing apparatus, screen data providing method, and computer-readable recording medium |
US20140253949A1 (en) * | 2013-03-05 | 2014-09-11 | Brother Kogyo Kabushiki Kaisha | Communication apparatus and communication system |
Also Published As
Publication number | Publication date |
---|---|
CN104735286B (en) | 2019-03-15 |
CN104735286A (en) | 2015-06-24 |
US20170149993A1 (en) | 2017-05-25 |
US9325873B2 (en) | 2016-04-26 |
CN110062124B (en) | 2021-04-16 |
US9596373B2 (en) | 2017-03-14 |
CN110062124A (en) | 2019-07-26 |
US20160212290A1 (en) | 2016-07-21 |
JP5985462B2 (en) | 2016-09-06 |
US20150181069A1 (en) | 2015-06-25 |
US10038809B2 (en) | 2018-07-31 |
JP2015122643A (en) | 2015-07-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10038809B2 (en) | Image processing apparatus, and remote operation system for image processing apparatus | |
US20200133606A1 (en) | Communication apparatus, control method, and program | |
US9621748B2 (en) | Information processing system, information processing apparatus, and information processing method | |
JP5974779B2 (en) | Wireless communication system, wireless communication device, and communication control program | |
US9497342B2 (en) | Non-transitory storage medium storing instructions executable by communication terminal having display capable of displaying image with touch screen control of a processing apparatus, communication terminal having the same, and processing apparatus | |
JP2014179927A (en) | Communication device and method of controlling the same, communication system, and program | |
US10237426B2 (en) | Information processing apparatus that executes a desired wireless communication, control method of information processing apparatus, and storage medium | |
JP2015055902A (en) | Compound machine | |
JP2019018371A (en) | Image formation apparatus and program | |
US9678596B2 (en) | Non-transitory storage medium storing instructions executable by communication terminal, communication terminal, and processing apparatus | |
US20120182577A1 (en) | Display control apparatus and control method thereof, and storage medium | |
JP2015143940A (en) | Display system, image forming apparatus, program, and display state control method | |
US20180159993A1 (en) | Composite apparatus | |
JP2013254037A (en) | Operation system of image formation device | |
US20170279987A1 (en) | Screen Display System, Screen Display Method, Image Processing Apparatus, and Recording Medium | |
JP6321867B2 (en) | Remote operation system, control method therefor, and image processing apparatus | |
JP6190013B2 (en) | Image processing apparatus and control method thereof | |
US20140126017A1 (en) | Image forming apparatus remotely operated by external terminal, method for controlling image forming apparatus, recording medium, and image forming system including image forming apparatus | |
JP6564103B2 (en) | Remote operation system, control method therefor, and image processing apparatus | |
US11240394B2 (en) | Information processing apparatus for invalidating an operation setting from a second device | |
US9013737B2 (en) | Image reading device and non-transitory computer readable medium storing image reading control program | |
US9635193B2 (en) | Document reading device | |
JP2014103562A (en) | Operation terminal, information processing system using operation terminal, information processing method, program | |
JP7009082B2 (en) | Mobile terminals and programs | |
JP2018027634A (en) | Image forming apparatus, control method thereof, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |