JP2018165938A - Application program and information processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an application program that can accurately transmit, to a target compound machine, instructions to execute functions desired by a user and information used for execution of the functions, and an information processing system.SOLUTION: When an ordering application is started up, an application under execution screen is displayed on a touch panel 11 (display part 12) of a portable terminal 2. For example, objects 31, and icons 32 indicating functions associated with the position of the portable terminal 2 with respect to a compound machine 3 are displayed on the application under execution screen. When a transmission instruction operation to instruct transmission of information corresponding to the object 31 displayed on the application under execution screen, for example, a flick operation to move the finger pressing the object 31 to the icon 32 is performed, instructions to execute a function associated with the information corresponding to the object 31 and the position of the portable terminal 2 with respect to the compound machine 3 by using the information corresponding to the object 31 are transmitted from the portable terminal 2 to the compound machine 3.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an application program and an information processing system.

  In recent years, mobile terminals equipped with touch panels, such as smartphones and tablets, have become widespread. In a mobile terminal equipped with a touch panel, an intuitive input operation is possible by a touch operation on the touch panel. If this is utilized, information can be transmitted from a portable terminal to a multifunction device or the like by an intuitive input operation.

  For example, in the configuration disclosed in Patent Document 1, a plurality of auxiliary lines that assist the image of the multifunction device and swipe operation (operation to move a finger while touching the surface of the touch panel) on the touch panel screen of the mobile terminal. An image obtained by combining and is displayed. When a swipe operation is performed along one of the auxiliary lines, a job that uses the functions corresponding to the auxiliary line (print function, fax function, scan function, and mail function) is transmitted from the portable terminal to the multifunction device. The

Japanese Patent Laid-Open No. 2006-66347

  However, when a plurality of auxiliary lines are dense (see FIG. 19 of Patent Document 1), the swipe operation along the auxiliary lines may be an erroneous operation.

  An object of the present invention is to provide an application program and an information processing system capable of accurately transmitting an instruction for executing a function desired by a user and information used for executing the function to a target multifunction peripheral.

  In order to achieve the above object, an application program according to one aspect of the present invention includes a display unit that displays an image, a touch panel that includes an output unit that outputs a signal corresponding to the contact or approach of an object to the display unit, and An application program installed in a computer of a mobile terminal equipped with a wireless communication unit that wirelessly communicates with a multi-function device having a plurality of functions, the computer specifying a process for specifying the position of the mobile terminal relative to the multi-function device, and an object Display on the display unit, detection processing for detecting a transmission instruction operation for instructing transmission of information corresponding to the object from a signal output from the output unit, information corresponding to the object, and the multifunction device Among the multiple functions, the function linked to the position of the mobile terminal The instructions and be performed using information corresponding to the object, so as to transmit to the MFP in response to the detection of the transmission instruction operation to execute a transmission process of controlling the wireless communication unit.

  According to this configuration, when a transmission instruction operation for instructing transmission of information corresponding to an object displayed on the display unit of the mobile terminal is performed, the information corresponding to the object is associated with the position of the mobile terminal with respect to the multifunction device. An instruction to execute the attached function using information corresponding to the object is transmitted to the multi-function peripheral. Therefore, when the user adjusts the position of the portable terminal with respect to the multifunction peripheral, the execution instruction of the function desired by the user and information used for executing the function can be accurately transmitted to the target multifunction peripheral.

  Note that the present invention can be realized not only in the form of an application program but also in the form of an information processing system including, for example, a portable terminal and a multifunction peripheral having a plurality of functions.

  In this information processing system, the mobile terminal includes a display unit that displays an image, a touch panel that includes an output unit that outputs a signal corresponding to the contact or approach of an object to the display unit, and a wireless communication unit that performs wireless communication with the multifunction device. The control unit, and by installing the application program, the control unit specifies the position of the mobile terminal relative to the multifunction device, the object display process for displaying the object on the display unit, and the transmission of information corresponding to the object A function associated with the position of the portable terminal with respect to the multifunction device among the plurality of functions of the multifunction device. Is transmitted to the multifunction device in response to detection of a transmission instruction operation. So that, to perform a transmission processing of controlling the wireless communication unit.

  According to the present invention, when the user adjusts the position of the mobile terminal with respect to the multifunction device, the execution instruction of the function desired by the user and the information used for executing the function can be accurately transmitted to the target multifunction device. it can.

It is a figure which shows the structure of the information processing system which concerns on one Embodiment of this invention. It is a block diagram which shows the electric constitution of a portable terminal. FIG. 3 is a block diagram illustrating an electrical configuration of the multifunction machine. It is a flowchart which shows the flow of an information acquisition process. 6 is a diagram illustrating an example of position information, unique information, and function information stored in a non-volatile memory of a multifunction peripheral. FIG. It is a flowchart which shows the flow of an icon display process. It is a figure which shows the example (the 1) of an application running screen. It is a figure which shows the example (the 2) of an application running screen. It is a figure which shows the example (the 3) of an application running screen. It is a figure which shows the example (the 4) of a screen during application execution. It is a flowchart which shows the flow of a function execution instruction | indication process. It is a figure which shows an example of the goods name and order quantity of each goods of order object preserve | saved at the non-volatile memory of a portable terminal, and the name and address of the supplier of an order place. It is a figure which shows the example of the screen during application execution which concerns on a modification.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

<System configuration>
An information processing system 1 shown in FIG. 1 includes a mobile terminal 2 and a plurality of multi-function peripherals (MFPs) 3.

  The portable terminal (mobile device) 2 is a portable terminal device, for example, a smartphone or a tablet terminal.

  The MFP 3 has a print function (image forming function) for printing an image related to image data on a sheet such as print paper, a facsimile function for transmitting / receiving image data via a public telephone line, and an e-mail transmission / reception via a computer network. It is a terminal device having a plurality of functions such as a mail function.

  The portable terminal 2 and the multifunction device 3 have a BT (Bluetooth (registered trademark)) communication function. The BT communication is a communication of the IEEE “IEEE 802.15.1” standard in IEEE (Eye Triple E), and uses a 2.4 GHz band radio wave and communicates at a maximum speed of 24 Mbps.

<Electric configuration of portable terminal>
As shown in FIGS. 1 and 2, the mobile terminal 2 includes a touch panel 11. The touch panel 11 is, for example, a capacitive touch panel, and includes a display unit 12 and an output unit 13.

  The display part 12 consists of a liquid crystal display, for example.

  The output unit 13 is provided on the display unit 12 in an overlapping manner. The output unit 13 includes, for example, an insulator film and an electrode layer. When an object that conducts electricity, such as a finger, approaches or touches the surface of the touch panel 11, the capacitance of the electrode near the object changes. The output unit 13 detects a position where the object approaches or contacts based on the change in capacitance, and outputs a signal corresponding to the position.

  In the following, a case where the touch panel 11 is operated with a finger is taken as an example. The flick operation, which is one of the operation methods of the touch panel 11, includes not only an operation of moving an object such as a finger while touching the surface of the touch panel 11 from a specific point on the touch panel 11 on the touch panel 11. For example, an operation of moving an object such as an object without touching the surface of the touch panel 11 without moving the object is also included.

  The mobile terminal 2 includes a BT communication unit 14 (an example of a wireless communication unit) and a wireless LAN communication unit 15.

  The BT communication unit 14 includes a BT module incorporating an antenna and an IC chip for BT communication.

  The wireless LAN communication unit 15 includes a wireless LAN module incorporating an antenna and an IC chip for wireless LAN (Local Area Network) communication.

  Furthermore, the portable terminal 2 includes a computer including a CPU 16 (an example of a control unit), a ROM 17 and a RAM 18. The CPU 16 controls the touch panel 11 and the BT communication unit 14 by executing a program stored in the ROM 17. When the control (program) is executed by the CPU 16, the RAM 18 is used as a work area. The RAM 18 includes a nonvolatile memory such as an NVRAM (Non Volatile RAM).

<Electric configuration of MFP>
As illustrated in FIG. 3, the multifunction machine 3 includes an operation panel 21, an image forming unit 22, an image reading unit 23, a BT communication unit 24, and a network communication unit 25.

  The operation panel 21 includes, for example, a display unit made up of a liquid crystal display and a touch key unit made up of a capacitive touch key, for inputting various settings and instructions and displaying various types of information. Is provided.

  The image forming unit 22 performs printing (color printing or monochrome printing) based on image data, and forms an image on a sheet. The image forming method may be an electrophotographic method or an inkjet method.

  The image reading unit 23 includes an image sensor, an AFE (Analog Front End), and the like. In the image reading unit 23, the image of the original is read by the image sensor, an analog image signal is output from the image sensor, and the analog image signal is converted into digital image data by the AFE.

  The BT communication unit 24 includes a BT module incorporating an antenna and an IC chip for BT communication.

  The network communication unit 25 includes a circuit for communication via a computer network. The communication speed of the network communication unit 25 is faster than the communication speed of BT communication.

  The multifunction machine 3 includes an ASIC (Application Specific Integrated Circuit) 26, a ROM 27, a RAM 28, and the like.

  The ASIC 26 incorporates a CPU 29. The ASIC 26 receives data received by the BT communication unit 24 and the network communication unit 25, a signal indicating the content of the operation on the operation panel 21, and the like. The CPU 29 controls the operation panel 21, the image forming unit 22, the BT communication unit 24, and the network communication unit 25 by executing a program stored in the ROM 27 based on a signal input to the ASIC 26. When the control (program) is executed by the CPU 29, the RAM 28 is used as a work area. The RAM 28 includes a nonvolatile memory such as NVRAM.

<Information acquisition process>
The portable terminal 2 is installed with an application program (hereinafter referred to as “ordering application”) that can easily perform an ordering operation for products at restaurants and retail stores. For example, an ordering application icon is registered on the home screen of the touch panel 11 (display unit 12) of the portable terminal 2, and activation of the ordering application can be instructed by a tap operation in which the icon is lightly touched with a finger. it can. When the ordering application is activated in response to this instruction, the CPU 16 executes an information acquisition process shown in FIG.

  In the information acquisition process, the CPU 16 first displays a login screen on the touch panel 11 in order to authenticate that the ordering application is activated by a user having usage authority. On the login screen, input of a preset password is required. When the password is correctly entered on the login screen, the CPU 16 determines that the login is successful (S11: YES), and proceeds with the information acquisition process thereafter. On the other hand, when the password is not correctly input on the login screen, the CPU 16 determines that the login has failed (S11: NO), and forcibly ends the information acquisition process. Due to the forced termination of the information acquisition process, the ordering application is also forcibly terminated, and the login screen is deleted from the touch panel 11.

  If login authentication (for example, password input) is required when the mobile terminal 2 starts to be used (when the touch panel 11 is turned on) by the function of the mobile terminal 2, the login operation by the user is duplicated. The login authentication may be omitted. In this case, although security against unauthorized use of the ordering application is reduced, the convenience of the ordering application can be improved.

  When the information acquisition process proceeds to the next, the CPU 16 acquires position information including the position and orientation of the mobile terminal 2 (self device) with which the CPU 16 is provided (S12). For example, a GPS (Global Positioning System) receiver and an electronic compass mounted on the portable terminal 2 are used to acquire the position information of the portable terminal 2. In an environment where radio waves from a GPS satellite can be received, the position of the mobile terminal 2 is acquired by GPS positioning technology, and in an environment where radio waves from the GPS satellite cannot be received, the position of the mobile terminal 2 is acquired by indoor positioning technology. . In an example of the indoor positioning technique, the position of the mobile terminal 2 is estimated by triangulation from the radio wave intensity or propagation time received by the mobile terminal 2 from a plurality of access points of the wireless LAN. Further, the orientation of the mobile terminal 2 is acquired from the signal output from the electronic compass.

  After acquiring the position information of the mobile terminal 2, the CPU 16 searches for the multifunction peripheral 3 around the mobile terminal 2 (S13). Specifically, the CPU 16 transmits a command to the BT communication unit 14 and causes the BT communication unit 14 to output an “Inquiry” signal. When the multifunction device 3 exists within the BT communication range of the BT communication unit 14, a response is transmitted in response to the multifunction device 3 receiving the “Inquiry” signal. Based on the response from the multifunction device 3, the CPU 16 creates a list of multifunction devices 3 around the mobile terminal 2.

  Next, the CPU 16 acquires the number (N) of the multifunction peripherals 3 around the portable terminal 2 from the list (S14).

  Further, the CPU 16 sets 1 to the value (n) of the information acquisition counter provided in the RAM 18 (S15).

  Then, the CPU 16 determines whether or not the value (n) of the information acquired counter exceeds the number (N) of the multifunction peripherals 3 around the portable terminal 2 (S16).

  When the value (n) of the information acquired counter is equal to or less than the number (N) (S16: NO), the CPU 16 determines the nth multifunction device 3 in the list of multifunction devices 3 around the BT communication unit 14 and the portable terminal 2. The BT communication unit 14 transmits a signal instructing the multifunction device 3 to transmit various information. As shown in FIG. 5, latitude, longitude, and altitude are stored as position information, and an IP (Internet Protocol) address is stored as unique information in the non-volatile memory of the multifunction machine 3. The non-volatile memory of the multifunction device 3 stores information on functions that can be executed by the multifunction device 3. In response to receiving the command from the BT communication unit 14, the nth multifunction device 3 transmits the position information, unique information, and function information stored in the nonvolatile memory. Then, when the BT communication unit 14 receives the position information, the unique information, and the function information, the CPU 16 acquires the position information, the unique information, and the function information of the nth multifunction device 3 (S17).

  Thereafter, the CPU 16 increments the value (n) of the information acquisition counter (S18), and the value (n) of the information acquisition counter after the increment indicates the number (N) of the multifunction peripherals 3 around the portable terminal 2. It is determined again whether or not it has been exceeded (S16). Then, until the value (n) of the information acquisition completed counter exceeds the number (N), the CPU 16 acquires the position information, unique information, and function information of the nth multifunction device 3 (S17).

  When the value (n) of the incremented information acquisition counter exceeds the number (N) of multifunction peripherals 3 around the mobile terminal 2 (S16: YES), the CPU 16 ends the information acquisition process.

<Icon display processing>
Following the information acquisition process, the CPU 16 executes an icon display process shown in FIG. When the login authentication is successful and the information acquisition process is completed, the touch panel 11 of the mobile terminal 2 has an object 31 indicating a product that can be ordered by the ordering application and the mobile terminal 2 as shown in FIGS. An application executing screen including icons 32 (32P, 32M, 32F) indicating the functions of the MFP 3 at the closest position is displayed. The icon display process is a process for displaying the icon 32 on the screen during application execution.

  In the icon display process, the CPU 16 determines whether the function associated with the position of the mobile terminal 2 with respect to the multifunction device 3 is set to be distinguished from other functions by the orientation of the mobile terminal 2 with respect to the multifunction device 3. (S21).

  In the ordering application, the position of the portable terminal 2 relative to the multifunction device 3 can be switched depending on the setting, depending on the orientation of the portable terminal 2 relative to the multifunction device 3 or the distance between the portable terminal 2 and the multifunction device 3.

  After executing the information acquisition process, the CPU 16 associates each function indicated by the function information of the MFP 3 acquired in the information acquisition process with the position of the mobile terminal 2 with respect to the MFP 3 and stores the function in the RAM 18 of the mobile terminal 2. . At this time, when the position of the portable terminal 2 with respect to the multifunction device 3 is set to be distinguished by the orientation of the portable terminal 2 with respect to the multifunction device 3, the orientation (absolute direction) of the portable terminal 2 acquired in the information acquisition process is determined. The orientation (relative orientation) of the portable terminal 2 with respect to the multifunction device 3 is obtained, and each function of the multifunction device 3 is stored in the RAM 18 of the portable terminal 2 in association with the orientation of the portable terminal 2 with respect to the multifunction device 3. . Further, when the position of the portable terminal 2 with respect to the multifunction device 3 is set to be distinguished by the distance between the portable terminal 2 and the multifunction device 3, each function of the multifunction device 3 is stored in the RAM 18 of the portable terminal 2. Are stored in association with the distance from the MFP 3.

  The orientation of the mobile terminal 2 with respect to the multifunction device 3 is the orientation of the touch panel 11 with respect to the multifunction device 3. Specifically, when the mobile terminal 2 is equipped with the vertically long touch panel 11, Which of the short side 33, the lower short side 34, the left long side 35, and the right long side 36 is directed to the multifunction device 3. When the mobile terminal 2 is a smartphone, the side on which the reception speaker 37 is disposed with respect to the touch panel 11 is the upper side.

  When it is set to be distinguished by the direction (S21: YES), the CPU 16 displays the icon 32 indicating the function associated with the direction of the portable terminal 2 with respect to the multifunction device 3 with the object 31 and the touch panel 11 on the application executing screen. Is displayed in an area between one side of the MFP 3 (S22).

  Further, when the other side of the touch panel 11 is directed toward the multifunction machine 3, an icon 32 indicating a function associated with the direction is displayed in an area between the object 31 and the other side on the application execution screen. It is displayed (S22).

  The icon 32 indicating the function associated with the direction of the mobile terminal 2 with respect to the multifunction device 3 is displayed with emphasis over the other icons 32. Each icon 32 includes a character representing the function indicated by the icon 32, and is displayed so that the upper side of the character faces each side of the touch panel 11 on the application execution screen.

  For example, the print function of the multifunction device 3 is associated with the orientation in which the upper short side 33 of the touch panel 11 is directed toward the multifunction device 3 side. Further, the mail function of the multifunction device 3 is associated with the orientation in which the left long side 35 of the touch panel 11 is directed toward the multifunction device 3, and the facsimile function of the multifunction device 3 is such that the right long side 36 of the touch panel 11 is the multifunction device 3. It is tied to the direction facing the side.

  As shown in FIG. 7, in a state where the upper short side 33 of the touch panel 11 is directed to the multifunction device 3, an icon 32 </ b> P indicating the print function associated with the orientation of the mobile terminal 2 at that time is being executed. It is displayed in the area between the object 31 and the upper short side 33 on the screen. An icon 32F indicating the facsimile function is displayed in an area between the object 31 and the right long side 36 on the application execution screen, and an icon 32M indicating the mail function is displayed in an area between the object 31 and the right long side 36. Is displayed. The icon 32P indicating the print function is displayed with emphasis on the icon 32F indicating the facsimile function and the icon 32M indicating the mail function by shading.

  In addition, a message for guiding a function switching method such as “the function is switched when rotated 90 °” is displayed in a partial area of the application execution screen. Thereby, the user can easily know the function switching method.

  When it is not set to distinguish the position of the portable terminal 2 with respect to the multifunction device 3 (S21: NO), that is, when it is set to distinguish the position of the portable terminal 2 with respect to the multifunction device 3 by the distance, the CPU 16 Then, the distance between the portable terminal 2 and the multifunction device 3 is acquired from the position information of the portable terminal 2 and the multifunction device 3 (S23).

  After acquiring the distance between the portable terminal 2 and the multifunction device 3, the CPU 16 displays an icon 32 indicating the function associated with the distance between the object 31 on the application executing screen and the upper short side 33 of the touch panel 11. A relatively large size is displayed at a position closest to the object 31 in the area, in other words, a position closest to the user operating the mobile terminal 2 (S24).

  In addition, the CPU 16 displays an icon 32 indicating a function not associated with the acquired distance in the area between the object 31 and the upper short side 33 of the touch panel 11 on the application executing screen and the mobile terminal 2 and the multifunction device 3. Is displayed in a relatively small size at a position farther from the object 31 than the icon 32 indicating the function associated with the distance (S25).

  The icon 32 indicating the function associated with the distance between the mobile terminal 2 and the multifunction device 3 is displayed in a size larger than the other icons 32 at a position closest to the object 31, thereby making the icon 32 larger than the other icons 32. It is highlighted.

  For example, as shown in FIG. 9, when the distance between the portable terminal 2 and the multifunction device 3 is within a predetermined range RA, an icon 32P indicating the print function associated with that distance (range RA) is being executed. A relatively large size is displayed at a position closest to the object 31 in an area between the object 31 on the screen and the upper short side 33 of the touch panel 11. Further, the icon 32F indicating the facsimile function other than the print function and the icon 32M indicating the mail function are displayed in a relatively small size in this order at a position farther from the object 31 than the icon 32P indicating the print function on the application execution screen. Is done.

  After displaying the icon 32, the CPU 16 once ends the icon display process, but then executes the icon display process again. Therefore, when the position of the mobile terminal 2 with respect to the multifunction device 3 changes, the icon display process is executed, so that the application execution screen is switched to a display corresponding to the position of the mobile terminal 2 after the change.

  For example, when the mobile terminal 2 is rotated 90 ° counterclockwise from the state shown in FIG. 7 and the right long side 36 of the touch panel 11 is directed to the multifunction device 3, as shown in FIG. An icon 32F indicating the facsimile function associated with the orientation of the mobile terminal 2 is displayed between the object 31 and the right long side 36 on the application executing screen, and the icon 32F is shaded. Also in this application execution screen, the icon 32P indicating the print function is displayed in an area between the object 31 and the upper short side 33, and the icon 32M indicating the mail function is an area between the object 31 and the left long side 35. Is displayed. That is, when the portable terminal 2 is rotated from the state shown in FIG. 7 to the state shown in FIG. 8, the display of the object 31 is changed so that the upper side of the object 31 faces the multifunction device 3 side. The icon 32F indicating is shaded.

  When the mobile terminal 2 is rotated 90 ° clockwise from the state shown in FIG. 7 and the left long side 35 of the touch panel 11 is directed to the multifunction machine 3, the mobile terminal 2 at that time is not shown. An icon 32M indicating the mail function associated with the direction is displayed between the object 31 and the left long side 35 on the application executing screen, and the icon 32M is shaded. Also on the application execution screen, the icon 32P indicating the print function is displayed in an area between the object 31 and the upper short side 33, and the icon 32F indicating the facsimile function is an area between the object 31 and the right long side 36. Is displayed.

  Further, when the portable terminal 2 is brought closer to the multifunction device 3 from the state shown in FIG. 9 and the distance between the portable terminal 2 and the multifunction device 3 is within the predetermined range RB as shown in FIG. The icon 32F indicating the facsimile function associated with the range RB) is displayed in a relatively large size at a position closest to the object 31 in an area between the object 31 and the upper short side 33 of the touch panel 11 on the application executing screen. Is done. Further, the icon 32P indicating the print function other than the facsimile function and the icon 32M indicating the mail function are displayed in a relatively small size in this order at a position farther from the object 31 than the icon 32F indicating the facsimile function on the application executing screen. Is done.

<Function execution instruction processing>
Following the icon display process, the CPU 16 executes a function execution instruction process shown in FIG. The function execution instruction process detects an operation instructing execution of the function of the multifunction device 3 on the application executing screen, and when the operation is detected, the function execution instruction and information necessary for executing the function are displayed. It is a process for transmitting to.

  In the function execution instruction process, the CPU 16 determines whether or not the start and end of the flick operation on the application execution screen has been detected (S31).

  On the application executing screen, the object 31 indicating the product that the user wants to order from the supplier is pressed with a finger, and the icon 32 indicating the function associated with the position of the portable terminal 2 with respect to the multifunction device 3 while holding the object 31 is held. By moving, that is, by moving the object 31 indicating the product that the user wants to order from the merchant to the highlighted icon 32 by flick operation, information necessary for ordering the product indicated by the object 31 from the merchant is received from the portable terminal 2. It can be transmitted to the multifunction device 3. In order to be able to place an order with this supplier, as shown in FIG. 12, in the ordering application, for each object 31, the product name and order quantity of each product to be ordered (the product indicated by each object 31), the product It is necessary to register in advance the name and address (FAX number, e-mail address) of the supplier of the order. The registered contents are stored in the nonvolatile memory of the portable terminal 2 in association with each other (linked).

  When the CPU 16 detects the start and end of the flick operation on the application executing screen (S31: YES), it is determined whether or not the flick operation is a transmission instruction operation instructing transmission of information from the portable terminal 2 to the multifunction device 3. That is, it is determined whether or not the operation is one of moving the object 31 to the icon 32 indicating the function associated with the position of the portable terminal 2 with respect to the multifunction device 3 (S32).

  When the flick operation is not a transmission instruction operation (S32: NO), the CPU 16 ends the function execution instruction process.

  When the flick operation is a transmission instruction operation (S32: YES), the CPU 16 moves to the transmission instruction using the function linked to the position of the portable terminal 2 with respect to the multifunction device 3 as the transmission method, and moves to the icon 32 indicating the function. The transmission data indicating the product name and the ordered quantity corresponding to the object 31 and the transmission destination information indicating the name and address of the supplier of the ordering party corresponding to the object 31 are transmitted from the BT communication unit 14 to the multifunction device 3 (S33). ).

  When the BT communication unit 24 of the multifunction device 3 receives the transmission instruction, the transmission data, and the destination information, in the multifunction device 3, an acceptance message indicating that the order has been accepted is sent from the BT communication unit 24 to the portable terminal 2 by the CPU 29. Sent. Further, the CPU 29 appropriately processes the transmission data received from the mobile terminal 2 and transmits the transmission data to the transmission destination (ordering party) indicated by the transmission destination information by the function indicated by the transmission method. Of course, the transmission data is transmitted by the function selected by the flick operation (the function indicated by the icon 32 to which the object 31 is moved by the flick operation) is a facsimile function or a mail function. This is a case where the condition that there is a corresponding supplier address is satisfied.

  For example, in the application executing screen shown in FIG. 10, when the object 31 indicating “10 tomatoes” is moved to the icon 32F indicating the facsimile function by a flick operation, the “facsimile function” is determined from the correspondence shown in FIG. A transmission instruction with the transmission method as the transmission method, transmission data indicating the order product name “tomato” and the order quantity “10”, and transmission indicating the name “xx store” of the supplier and the FAX number “052-824-xxx1” The previous information is transmitted from the BT communication unit 14 to the multifunction device 3. Then, in the MFP 3, a FAX order form in which the name of the supplier of the ordering party “xx store”, the ordering product name “Tomato”, and the order quantity “10” is created, and the FAX order form has the FAX number “ Facsimile transmission to “052-824-xxx1”. This completes the ordering of the “10 tomatoes” to the supplier.

  In response to the reception message transmitted from the multifunction machine 3 being received by the BT communication unit 14 (S34), the CPU 16 displays the reception message on the touch panel 11 (S35) and ends the function execution instruction process.

<Effect>
As described above, when the ordering application is activated, an application executing screen is displayed on the touch panel 11 (display unit 12) of the mobile terminal 2. When a transmission instruction operation for instructing transmission of information corresponding to the object 31 displayed on the application execution screen is performed, information corresponding to the object 31 (transmission data, transmission destination information), and a portable terminal for the multifunction machine 3 An instruction to execute the function associated with the position 2 using information corresponding to the object 31 is transmitted to the multifunction device 3. Therefore, when the user adjusts the position of the portable terminal 2 with respect to the multifunction device 3, the execution instruction of the function desired by the user and information used for the execution of the function can be accurately transmitted to the target multifunction device 3. .

  The function associated with the position of the portable terminal 2 with respect to the multifunction machine 3 is displayed on the application executing screen with an icon 32 that is different for each function. The display position of the icon 32 is a position closer to the multifunction device 3 than the display position of the object 31, and the transmission instruction operation is a flick operation for moving the finger holding the object 31 to the icon 32. By executing an intuitive flick operation for moving the object 31 to the multifunction device 3 side, information corresponding to the object 31 and an instruction for executing the function indicated by the icon 32 can be transmitted to the multifunction device 3.

<Modification>
As mentioned above, although one Embodiment of this invention was described, this invention can also be implemented with another form.

  For example, in the above-described embodiment, it is assumed that the print function is associated with the multifunction device 3 at a relatively far distance and the facsimile function is associated with a relatively close distance. To this end, if the user operating the portable terminal 2 indicates execution of the print function (execution of printing) at a location away from the multifunction device 3, the printing proceeds while the user goes to the side of the multifunction device 3, and printing is performed. There is an advantage that the waiting time of the user until completion is shortened.

  On the other hand, the facsimile function may be associated with a distance that the mobile terminal 2 is relatively far from the multifunction device 3, and the print function may be associated with a relatively close distance. Since it is not necessary for the user to go to the multifunction device 3 to execute the facsimile function, the convenience of the facsimile function can be achieved by allowing the portable terminal 2 located away from the multifunction device 3 to instruct the execution of the facsimile function. Can be increased. Further, since the user is in the vicinity of the multi-function device 3 when executing the print function, the security of the printed matter can be ensured.

  On the application execution screen, an icon 32 indicating a function associated with the distance between the mobile terminal 2 and the multifunction device 3 is displayed in a relatively large size at a position closest to the object 31, and is combined with the mobile terminal 2. The arrangement order of the icons 32 changes according to the distance from the machine 3. Instead, the display position of each icon 32 is fixed, and the icon 32 indicating the function associated with the distance between the mobile terminal 2 and the multifunction device 3 is displayed in a size larger than the other icons 32. Also good.

  On the application executing screen, a message for guiding a transmission instruction operation, that is, a flick operation for moving the object 31 to the position of the icon 32 may be displayed.

  Further, a message such as “information has been sent” may be displayed on the application executing screen in response to the transmission instruction operation being performed. This message may be deleted, for example, when a predetermined time elapses or when an “OK button” displayed on the touch panel 11 is pressed.

  Further, in the above-described embodiment, the ordering application that can easily perform the ordering operation of products in restaurants and retail stores has been taken up. However, the present invention is an application that can easily print images and documents. You may apply to the print application which is a program. On the application executing screen of the print application, for example, as shown in FIG. 13, a thumbnail 41 such as an image stored in the nonvolatile memory of the mobile terminal 2 is displayed, and the multifunction device 3 is displayed around the thumbnail 41. Icons 32 indicating the respective functions (an icon 32P indicating a print function, an icon 32F indicating a facsimile function, and an icon 32M indicating a mail function) are displayed.

  In the print application, when one of the thumbnails 41 is moved to the position of the icon 32P indicating the print function by a flick operation, the image of the thumbnail 41 or the like is printed by the multifunction device 3. Further, when one of the thumbnails 41 is moved to the position of the icon 32F indicating the facsimile function by the flick operation, the image of the thumbnail 41 and the like are transmitted by facsimile from the multifunction device 3 to a transmission destination registered in advance. When one of the thumbnails 41 is moved to the position of the icon 32M indicating the mail function by the flick operation, a file such as an image of the thumbnail 41 is attached to the e-mail from the multifunction device 3 to the destination registered in advance. Sent.

  In addition, various design changes can be made to the above-described configuration within the scope of the matters described in the claims.

1: Information processing system 2: Mobile terminal 3: Multifunction machine 11: Touch panel 12: Display unit 13: Output unit 14: BT communication unit 16: CPU (control unit)
17: ROM
18: RAM

Claims (17)

Mobile phone equipped with a display unit for displaying an image, a touch panel having an output unit for outputting a signal corresponding to the contact or approach of an object to the display unit, and a wireless communication unit for wirelessly communicating with a multi-function device having a plurality of functions An application program installed on a terminal computer,
In the computer,
A specifying process for specifying the position of the mobile terminal with respect to the multifunction device;
An object display process for displaying an object on the display unit;
A detection process for detecting a transmission instruction operation for instructing transmission of information corresponding to the object from a signal output by the output unit;
Information corresponding to the object, and an instruction to execute a function associated with the position of the mobile terminal with respect to the multifunction device among the plurality of functions of the multifunction device using the information corresponding to the object An application program for executing transmission processing for controlling the wireless communication unit so as to transmit to the multi-function device in response to detection of the transmission instruction operation. An application program according to claim 1,
In the computer,
An application program for executing a function display process for causing the display unit to display a function associated with the position of the portable terminal with respect to the multifunction device. An application program according to claim 2,
In the computer,
In the function display process, an application program that displays a function associated with the position of the portable terminal with respect to the multifunction device at a position closer to the multifunction device than the display position of the object in the display unit. An application program according to claim 3,
In the computer,
In the function display processing, an application program that displays a function associated with a position of the mobile terminal with respect to the multifunction machine with a different icon for each function. An application program according to claim 4,
The transmission instruction operation is an operation in which the starting point of the movement of the object on the display unit is on the object, and the moving direction of the object from the starting point coincides with the direction from the display position of the object to the display position of the icon. And an application program. An application program according to any one of claims 2 to 5,
In the computer,
An application program for executing a display switching process for switching the display of the display unit to a display of a function associated with the position after the change when the position of the portable terminal with respect to the multifunction peripheral changes. An application program according to any one of claims 2 to 6,
In the computer,
An application for executing a message display process for displaying on the display unit a message to the effect that the function executed using information corresponding to the object in the multifunction device is changed when the position of the portable terminal with respect to the multifunction device is changed. program. An application program according to any one of claims 2 to 7,
In the computer,
Search for the multifunction device within the wireless communicable range by the wireless communication unit, and execute a function information reception process for controlling the wireless communication unit to receive information indicating the function of the corresponding multifunction device,
An application program for causing the display unit to display a function indicated in the information received from the multifunction device in the function display process. An application program according to claim 8, wherein
In the computer,
In the function information receiving process, the wireless communication unit is controlled to receive information indicating all the functions of the multifunction device,
In the function display process, an application program that causes the display unit to display functions that the multifunction device has and that are not associated with the position of the portable terminal with respect to the multifunction device. An application program according to claim 9,
In the computer,
In the function display process, an application program that emphasizes and displays a function associated with the position of the portable terminal with respect to the multifunction device with respect to a function not associated with the position of the portable terminal. An application program according to claim 10,
In the computer,
In the function display processing, an application program that causes a function corresponding to the position of the portable terminal to the multifunction device to be displayed at a position closer to the object than a display position of a function not associated with the position of the portable terminal. It is an application program as described in any one of Claims 2-11,
In the computer,
In the function display process, when the multifunction device has a fax function and a print function, an application for causing the display unit to display the fax function when the distance between the multifunction device and the portable terminal is a first distance. program. An application program according to claim 12,
In the computer,
An application program for causing the display unit to display the print function when a distance between the multifunction device and the portable terminal is a second distance shorter than the first distance in the function display process. An application program according to claim 12,
In the computer,
An application program for causing the display unit to display the print function when a distance between the multifunction device and the portable terminal is a third distance longer than the first distance in the function display process. An application program according to claim 10,
In the computer,
In the function display process, the function associated with the position of the portable terminal with respect to the multifunction device is displayed at a position corresponding to one side of the multifunction device with respect to the display position of the object in the display unit, and the display An application program for displaying a function that is not associated with the position of the mobile terminal at a position corresponding to a side different from the one side in the unit. An application program according to claim 15,
In the computer,
In the function display process, when the orientation of the portable terminal is changed so that a side different from the one side in the display unit is located on the multifunction device side with respect to the display position of the object, the multifunction device side An application program that displays a function that is not associated with the position of the mobile terminal so that the function is not associated with the position of the mobile terminal. An information processing system including a portable terminal and a multifunction device having a plurality of functions,
The portable terminal is
A touch panel having a display unit for displaying an image and an output unit for outputting a signal corresponding to the contact or approach of an object to the display unit;
A wireless communication unit that wirelessly communicates with the multifunction device;
A control unit,
The controller is
A specifying process for specifying the position of the mobile terminal with respect to the multifunction device;
An object display process for displaying an object on the display unit;
A detection process for detecting a transmission instruction operation for instructing transmission of information corresponding to the object from a signal output by the output unit;
Information corresponding to the object, and an instruction to execute a function associated with the position of the mobile terminal with respect to the multifunction device among the plurality of functions of the multifunction device using the information corresponding to the object An information processing system that executes transmission processing for controlling the wireless communication unit so as to transmit to the multi-function peripheral in response to detection of the transmission instruction operation.

Images