JP2017001394A - Program, information processing method, and portable terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique that allows a user to select whether to make print settings or not without performing a special operation such as a key operation or a button operation when information held by a portable terminal is to be printed with a printing device.SOLUTION: When a portable terminal detects that the portable terminal is positioned in an NFC coverage, the portable terminal establishes NFC communication, exchanges information in preparation for transition to BT communication, receives information on a subject of printing via the BT communication, and prints the BT communication. In this process, the portable terminal displays a menu for detailed settings related to printing only when an establishment state continues for a prescribed time after the establishment of the NFC communication.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a device control technique between wireless communication apparatuses that perform close proximity wireless communication.

  In recent years, multifunctional mobile phones equipped with a camera function, a network browser function, a wireless communication function, and an application execution function such as mail in addition to a mobile phone function called a smart phone have been put on the market. As a wireless communication function, in addition to telephone communication, a WLAN (Wireless Local Area Network), Bluetooth (registered trademark BT communication), an IC (Integrated Circuit) card system, and the like are mounted on the smartphone. In the IC card system among them, when another IC card called a target approaches a device called an initiator that transmits an RF (Radio Frequency) field (magnetic field), the IC card is supplied with power by electromagnetic induction, Perform data transfer. Near Field Communication (NFC communication) has been formulated as a communication protocol for IC card systems. On the other hand, in data transfer between devices with multiple communication protocols like this, device identification and authentication and communication protocol determination are performed by the IC card system, and BT communication is performed for large-capacity actual data rather than NFC. A method of performing communication by switching to another protocol capable of higher speed communication (handover) is disclosed (for example, Patent Document 1).

  In addition, when applied to image printing from a mobile terminal such as a smartphone as described above to a multi-function printer (MFP) having multiple functions such as copying and scanning, the user selects an image to be printed in the application on the mobile terminal side. Then, NFC communication is used to identify the MFP and exchange authentication keys in other protocols such as BT communication, and the image data is handed over and transmitted by WLAN or BT communication. The MFP analyzes the sent image data and prints it on a medium such as paper. By applying such a system configuration, the user can obtain image data printed by a simple operation.

JP 2004-364145 A

  The MFP is configured to allow a plurality of settings relating to printing. In the above-described configuration, the user cannot make detailed settings for printing, so it is necessary to set the paper size, paper type, print quality, etc. in advance on the MFP side. There may be no problem for users who print with the same print setting conditions every time, but in order to respond to requests such as sometimes wanting to print in large format, the setting must be changed prior to communication The problem remains. In particular, in an environment where a large number of unspecified users use one printing apparatus, since each user's preference or purpose for printing is different, this problem cannot be ignored.

  The present invention has been made in view of the above problems, and when printing information held by a mobile terminal with a printing apparatus, settings related to printing without special operations such as key operations and button operations. The present invention provides a technique that can select whether to perform or not.

In order to solve this problem, for example, a program according to the present invention comprises the following arrangement. That is,
A program executed by a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication),
When the image to be printed is selected by the user's instruction and the first NFC unit is in a state where it can communicate with the second NFC unit included in the printer, the portable terminal device displays a predetermined display item. A display control process to be displayed on the display unit,
A transmission control step of transmitting image data corresponding to the image to be printed to the printer by a communication method different from NFC;
Is executed by the mobile terminal device,
After the NFC communication between the first NFC unit and the second NFC unit is performed when the image to be printed is selected, the first NFC unit communicates with the second NFC unit. In a state where communication is not possible, the predetermined display item is not displayed,
The predetermined display item is displayed in the display control step, and the image data is printed by the printer when the user gives an instruction to the display unit on which the predetermined display item is displayed. It is characterized by.

  According to the present invention, when printing the information held in the mobile terminal with the printing apparatus, it is possible to select whether or not to perform the setting related to printing without special operation such as key operation or button operation. Thus, printing can be performed under this convenience.

Control flow of MFP apparatus (representative diagram). FIG. The external view of a portable communication terminal device. 1 is an external view of an MFP apparatus. The figure which shows the example of a display of a portable communication terminal device. The processing sequence chart figure of 1st Embodiment. FIG. 4 is a diagram showing an example of a display screen of the MFP. The block diagram of a portable communication terminal device. 1 is a block diagram of an MFP apparatus. NFC unit detailed explanatory drawing. The figure which shows the example of a display of a portable communication terminal device. Sequence chart of the second embodiment The figure which shows the return example of Capability. Flow of portable communication terminal device. Flow until operating as an initiator. Communication sequence in passive mode. Communication sequence in active mode. Target state transition.

  Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Note that the relative arrangement of components, the display screen, and the like described in the present embodiment are not intended to limit the scope of the present invention only to those unless otherwise specified.

[First Embodiment]
In the first embodiment, an example will be described in which authentication is performed by the low-speed communication unit using the proximity wireless communication method, and then the print data is transmitted by switching to the high-speed communication unit of the wireless communication. More specifically, a printing method using a handover technique in which authentication is performed by short-range wireless communication such as NFC (Near Field Communication) and communication is taken over by wireless communication of another communication method will be described.

  FIG. 2 of the first embodiment is a diagram showing the configuration of the wireless communication system. A portable communication terminal device 200 and a multifunction printer (hereinafter referred to as MFP) 300 are connected. The portable communication terminal apparatus 200 is an apparatus having at least two types of wireless communication means with different authentication methods and communication speeds. Any device capable of handling a file to be printed, such as a personal information terminal such as a PDA (Personal Digital Assistant), a mobile phone, or a digital camera may be used. The MFP 300 has a printing function using a printing unit such as an ink jet printer, and includes a display device and an operation panel capable of various settings. In addition, a reading function for reading a document by placing the document on a document table, a FAX function, and a telephone function may be provided.

  FIG. 3 is a diagram showing the appearance of the portable communication terminal device 200. In this embodiment, a smart phone is taken as an example. A smart phone is a multi-function mobile phone equipped with a camera, a network browser, a mail function, etc. in addition to the functions of a mobile phone. The NFC unit 201 is a part that performs communication using NFC, and communication can be performed by actually bringing the NFC unit 201 closer to the counterpart NFC unit within about 10 cm. The BT unit 202 is a unit for performing communication by Bluetooth and is arranged in the apparatus. The display unit 203 is a display having an LCD display mechanism. The operation unit 204 includes an electrostatic touch panel type transparent operation mechanism that covers the display screen of the display unit 203, and detects user operation information. A typical operation method is that the display unit 203 performs button-like display, and when the user touches the operation unit 204, an event associated with the button portion is issued and processing is executed. A power key 205 is used to turn the power on and off.

  4A and 4B are an external perspective view and a top view of the MFP 300, respectively. A document table 301 is a glassy transparent table and is used when a document is placed and read by a scanner. A document cover 302 is a cover for preventing reading light from leaking to the outside when reading by the scanner. A printing paper insertion port 303 is an insertion port for setting paper of various sizes. The paper set here is conveyed to the printing unit one by one, and is printed out from the printing paper discharge port 304 after performing desired printing. An operation unit 305 and an NFC unit 306 are disposed above the document cover 302. The operation display unit 305 includes keys for performing various operations and an information display unit using an LCD method, and is configured to be able to perform operations and settings related to the MFP 300. The NFC unit 306 is a unit for performing close proximity wireless communication, and is a place to be actually brought close to. About 10 cm from the NFC unit 306 is an effective contact distance. The BT unit 307 is embedded with a communication module and an antenna for performing BT communication.

  FIG. 8 is a block diagram of the portable communication terminal device 200 (in the embodiment, a smart phone) in the embodiment.

  The portable communication terminal apparatus 200 includes a main board 801 that performs main control of the apparatus, a WLAN unit 817 that performs WLAN communication, an NFC unit 818 that performs NFC communication, and a BT unit 821 that performs Bluetooth (registered trademark) communication.

  In the main board 801, the CPU 802 is a system control unit and controls the entire portable communication terminal device 200. The ROM 803 stores a control program executed by the CPU 802, an embedded operating system (OS) program, and the like. In the present embodiment, each control program stored in the ROM 803 performs software control such as scheduling and task switching under the management of the embedded OS stored in the ROM 803.

  The RAM 804 is configured by SRAM (static RAM) or the like, stores program control variables and the like, stores setting values registered by the user, management data of the portable communication terminal device 200, and the like, and has various work buffer areas. Is provided.

  The image memory 805 is configured by a DRAM (dynamic RAM) or the like, and temporarily stores image data received via the communication unit and image data read from the data storage unit 812 for processing by the CPU 802. The nonvolatile memory 822 is configured by a flash memory or the like, and stores data that is to be stored even after the power is turned off. For example, there are phone book data and device information connected in the past. Note that such a memory configuration is not limited to this. For example, the image memory 805 and the RAM 804 may be shared, or data backup or the like may be performed in the data storage unit 812. In this embodiment, a DRAM is used. However, this is not the case because a hard disk, a nonvolatile memory, or the like may be used.

  A data conversion unit 806 performs analysis such as page description language (PDL) and data conversion such as color conversion and image conversion. The telephone unit 807 controls the telephone line and processes voice data input / output via the speaker unit 813 to realize telephone communication. The operation unit 808 controls the signal of the operation unit 204 described with reference to FIG. A GPS (Global Positioning System) 809 acquires the current latitude and longitude. A display unit 810 electronically controls the display content of the display unit 203 described with reference to FIG. 2, and can perform various input operations, display of the operation status and status status of the MFP 300, and the like.

  The camera unit 811 has a function of electronically recording and encoding an image input via a lens. An image photographed by the camera unit 811 is stored in the data storage unit 812. The speaker unit 813 realizes a function of inputting or outputting voice for a telephone function, and other functions such as alarm notification. The power supply unit 814 controls a portable battery and its control. The power state includes a battery exhausted state with no remaining battery power, a power off state in which the power key 205 is not pressed, a normal starting state, and a power saving state in which the power is activated but is in a power saving state. is there.

  As described above, the portable communication terminal apparatus 200 according to the embodiment has three types of WLAN, NFC, and Bluetooth (registered trademark) as means for wireless communication, and any of these can perform wireless communication. it can. When performing data communication with other devices such as an MFP, these convert data into packets and perform packet transmission to other devices. Conversely, a packet from another external device is converted into data and transmitted to the CPU 101. The WLAN unit 817, the NFC unit 818, and the BT unit 821 are each connected by a bus cable or the like. The WLAN unit 817, the NFC unit 818, and the BT unit 821 are units for realizing communication conforming to the standard. Details of the NFC unit 818 will be described later with reference to FIG.

  The components 803 to 814, 817, 818, 821, and 822 are connected to each other via a system bus 819 managed by the CPU 802.

  FIG. 9 is a block diagram illustrating a schematic configuration of the MFP 300. The MFP 300 includes a main board 901 that performs main control of the apparatus, a WLAN unit 917 that performs WLAN communication, an NFC unit 918 that performs NFC communication, and a BT unit 919 that performs Bluetooth (registered trademark) communication.

  In the main board 901, a CPU 902 is a system control unit and controls the entire MFP 300. The ROM 903 stores a control program executed by the CPU 902, an embedded operating system (OS) program, and the like. In the present embodiment, each control program stored in the ROM 903 performs software control such as scheduling and task switching under the management of the embedded OS stored in the ROM 903.

  The RAM 904 is configured by SRAM (static RAM) or the like, stores program control variables and the like, stores setting values registered by the user, management data of the MFP 300, and the like, and has various work buffer areas. The non-volatile memory 905 is configured by a flash memory or the like, and stores data that the user wants to retain even when the power is turned off. Specifically, network connection information, user data, and the like. The image memory 906 is configured by a DRAM (dynamic RAM) or the like, and receives image data received via each communication unit, image data processed by the encoding / decoding processing unit 912, and an image acquired via the memory card controller 516. Accumulate data. Further, like the memory configuration of the portable communication terminal apparatus 200, such a memory configuration is not limited to this. A data conversion unit 907 performs analysis of a page description language (PDL) or the like, or converts image data into print data.

  The reading control unit 908 will be described. The reading unit 910 optically reads a document with a CIS image sensor (contact image sensor). Next, the image signal converted into electrical image data is subjected to various image processing such as binarization processing and halftone processing via an image processing control unit (not shown), and high-definition image data is output.

An operation unit 909 and a display unit 911 represent the operation display unit 105 described with reference to FIG.
An encoding / decoding processing unit 912 performs encoding / decoding processing and enlargement / reduction processing on image data (JPEG, PNG, etc.) handled by the MFP 300.

  A paper feed unit 915 is a part that can hold paper for printing. Paper can be fed from the paper feed unit 915 under the control of the recording control unit 916. In particular, the paper feeding unit can prepare a plurality of paper feeding units in order to hold a plurality of types of paper in one apparatus. The recording control unit 916 can control from which paper feeding unit the paper is fed.

  The recording control unit 916 performs various image processing such as smoothing processing, recording density correction processing, and color correction on the image data to be printed via an image processing control unit (not shown), and converts the image data into high-definition image data. To the recording unit 915. The recording control unit 916 also plays a role of periodically reading out information from the printing unit and updating information in the RAM 904. Specifically, the remaining amount of the ink tank, the state of the print head, and the like are updated.

  Similar to the portable communication terminal apparatus 200, the MFP 300 is also equipped with three means for wireless communication, and the functions are the same, and thus description thereof is omitted. The components 902 to 919 are connected to each other via a system bus 923 managed by the CPU 902.

  FIG. 10 is a diagram for explaining the details of the NFC unit used in the NFC unit 818 and the NFC unit 918. The configuration of the NFC unit 1000 will be described with reference to FIG. The NFC unit 1000 includes an NFC controller unit 1001, an antenna unit 1002, an RF unit 1003, a transmission / reception control unit 1004, an NFC memory 1005 (consisting of a rewritable nonvolatile memory), a power source 1006, and a device connection Part 1007. The antenna unit 1002 receives radio waves and carriers from other NFC devices, and transmits radio waves and carriers to other NFC devices. The RF unit 1003 has a function of modulating / demodulating an analog signal into a digital signal. The RF unit 103 includes a synthesizer, identifies the frequency of the band and channel, and controls the band and channel based on the frequency allocation data. The transmission / reception control unit 1004 performs control related to transmission / reception such as assembly and disassembly of transmission / reception frames, addition and detection of preambles, and frame identification. The transmission / reception control unit 1004 also controls the NFC memory 1005 to read / write various data and programs. When operating as an active mode, power is supplied via the power source 1006 (the main power source of the smart phone or MFP), and communication with the device via the device connection unit 1007 or carrier transmitted / received via the antenna unit 1001 is performed. Communicate with other NFC devices within the communicable range. On the other hand, when operating as a passive mode, a carrier is received from another NFC device via an antenna, wireless power is supplied from the other NFC device by electromagnetic induction, and the carrier is modulated with the other NFC device. Communicate between each other and send and receive data.

  FIG. 15 is a flowchart for the NFC unit to operate as an initiator.

  First, in the initial stage of step S2001, the NFC unit operates as a target and waits for a command from the initiator. In step S2002, the NFC unit can switch to an initiator in response to a request from an application that controls communication according to the NFC standard. When the NFC unit responds to the request for switching to the initiator, in step S2003, the application needs to select either the active mode or the passive mode and determine the transmission rate. In step S2004, the initiator detects the presence of an RF field output by a device other than itself. If there is an external RF field, the initiator does not generate its own RF field. If there is no external RF field, the process proceeds to step S2005, and the initiator generates its own RF field. Through the above steps, the NFC unit starts operating as an initiator.

  FIG. 16 shows a sequence for exchanging data in the passive mode. Here, a case where the first NFC unit 2101 operates as an initiator and the second NFC unit 2102 operates as a target will be described.

  First, in step S2101, the first NFC unit 2101 performs single device detection and identifies the second NFC unit 2102. In step S2102, the first NFC unit 2101 transmits its own identifier, transmission / reception bit transmission rate, effective data length, and the like as an attribute request. The attribute request has a general-purpose byte and can be arbitrarily selected and used. When receiving a valid attribute request, the second NFC unit 2102 transmits an attribute response as step S2103. Here, transmission from the second NFC unit 2102 is performed by load modulation, and in the figure, data transmission by load modulation is represented by dotted arrows.

  After confirming the valid attribute response, the first NFC unit 2101 can change the parameters of the subsequent transmission protocol by sending a parameter selection request in step S2104. Parameters included in the parameter selection request are a transmission rate and an effective data length. When receiving a valid parameter selection request, the second NFC unit 2102 transmits a parameter selection response in step S2105 to change the parameter. Note that steps S2104 and S2105 may be omitted if no parameter change is performed.

  In step S2106, the first NFC unit 2101 and the second NFC unit 2102 exchange data in accordance with a data exchange request and a data exchange response. The data exchange request and response can be transmitted as information on the application of the communication partner as data, and can also be divided and transmitted when the data size is large.

  When the data exchange ends, the process proceeds to step S2107, and the first NFC unit 2101 transmits either a selection release request or a release request. When the selection cancellation request is transmitted, the second NFC unit 2102 transmits a selection cancellation response in step S2108. Upon receiving the selection cancellation response, the first NFC unit 2101 releases the attribute indicating the second NFC unit 2102 and returns to step S2101. When the release request is transmitted, the second NFC unit 2102 transmits a release response in step S2108 and returns to the initial state. If the first NFC unit 2101 receives the release response, the target is completely released and may return to the initial state.

  FIG. 17 shows a sequence for exchanging data in the active mode. Here, a case where the first NFC unit 2201 operates as an initiator and the second NFC unit 2202 operates as a target will be described.

  First, in step S2201, the first NFC unit 2201 transmits its own identifier, transmission / reception bit transmission rate, effective data length, and the like as an attribute request. When receiving a valid attribute request, the second NFC unit 2202 transmits an attribute response in step S2202. Here, the transmission from the second NFC unit 2202 is performed by the RF field generated by itself. For this reason, the first and second NFC units stop outputting the RF field when the data transmission is completed.

  After confirming the valid attribute response, the first NFC unit 2201 can change the parameters of the transmission protocol by sending a parameter selection request in step S2203. Parameters included in the parameter selection request are a transmission rate and an effective data length. When receiving a valid parameter selection request, the second NFC unit 2202 transmits a parameter selection response in step S2204 to change the parameter. As in the passive mode, steps S2203 and S2204 may be omitted if no parameter change is performed.

  In step S2205, the first NFC unit 2201 and the second NFC unit 2202 exchange data in accordance with a data exchange request and a data exchange response. The data exchange request and response can be transmitted as information on the application or the like as data, and can be transmitted separately when the data size is large.

  When the data exchange ends, the process proceeds to step S2206, and the first NFC unit 2201 transmits either a selection release request or a release request. When the selection cancellation request is transmitted, the second NFC unit 2202 transmits a selection cancellation response in step S2207. Upon receiving the selection cancellation response, the first NFC unit 2201 releases the attribute indicating the second NFC unit 2202. Thereafter, in step S2208, the first NFC unit 2201 transmits an activation request to another target whose identifier is known. The target that has received the activation request transmits an activation response in step S2209 and returns to step S2201. When the release request is transmitted, the second NFC unit 2102 transmits a release response in step S2108 and returns to the initial state. If the first NFC unit 2101 receives the release response, the target is completely released and may return to the initial state.

  FIG. 18 shows the state transition of the target in NFC.

  The POWER-OFF state S2301 represents a power-off state. In this state S2301, when the target is placed in the magnetic field H larger than the threshold value Hmin, the state shifts to the SENSE state S2302. In the SENSE state S2302, the target is waiting for an instruction from the initiator. When the target receives a detection request or an all-device activation request, the target shifts to the RESOLUTION state S2303 and returns a detection response. If another command is received, the SENSE state S2302 remains unchanged. In the RESOLUTION state S2303, single device detection is used. When a valid selection request is received as a result of single device detection, the target returns a selection response to the initiator and enters the SELECTED state S2304. If another command is received, the process returns to the SENSE state S2302.

  In the SELECTED state S2304, the target recognizes an attribute request, a parameter selection request, or a valid proprietary instruction. When the target receives a valid sleep request or deselection request, it enters SLEEP state S2305. If any other command is received, the process returns to the SENSE state S2302.

  When the target in the SLEEP state S2305 receives an all-device activation request, the target returns to the RESOLUTION * state S2306 after returning a detection response. If another command is received, the SLEEP state S2305 remains. The RESOLUTION * state S2306 is substantially the same as the RESOLUTION state S2303, and single device detection is used. If a valid selection request is received, the target transitions to the SELECTED * state S2307. If any other command is received, the process returns to the SLEEP state S2305. The SELECTED * state S2307 is substantially the same as the SELECTED state S2304, and the target recognizes an attribute request, a parameter selection request, or a valid proprietary instruction. When a valid sleep request or selection cancel request is received, the state transits to the SLEEP state. If any other command is received, it falls back to the SLEEP state.

  In the above, the NFC unit in the embodiment and the communication procedure between the NFC units have been described. The NFC unit 818 included in the portable communication terminal device 200 and the NFC unit 918 included in the MFP 300 execute the above.

  Based on the above, a specific example in the case where the image data included in the portable communication terminal device 200 according to the first embodiment is applied to a printing process for printing by the MFP 300 will be described in detail below.

  FIG. 5 shows an example of an image printing application that runs on the portable communication terminal apparatus 200. When the application is started, first, the thumbnail 501 of the image data is displayed on the touch panel display screen 203 on the image selection screen in FIG. 5A, and the user can select a desired image. The selected image is focused 502 (in the figure, a thick frame) so that it can be distinguished from other images that are not in focus. In this application, in addition to image selection, an image can be enlarged / reduced and image information such as a shooting date can be confirmed (not shown). The user selects one or a plurality of images, touches the displayed print start key 503, and when instructed, searches the MFP by an Inquiry Request via the BT unit 202, and a list of searched MFP names is displayed on the display unit. It is displayed on the display screen 203. The printer selection screen shown in FIG. 5B shows a display example of the searched printer. On the other hand, an RF field is formed around the antenna of the NFC unit 201 (818) for NFC communication simultaneously with the printer search by BT communication, and the target (NFC unit 918 on the MFP in the embodiment) is searched. By disposing portable communication terminal device 200 in the vicinity of MFP 300, when a target MFP is found by NFC communication, device search by Inquiry Request of BT communication is stopped, communication by NFC communication protocol is started, and BT communication is started. Get the information you need. The portable communication terminal device 200 connects by BT communication to the MFP 300 searched for as a target based on data received by NFC communication, and transfers image data. In order to indicate image data transmission to the user, the print status display screen shown in FIG. 5C including print image information and data transfer status information is displayed. In the description of the present embodiment, an example in which the portable communication terminal device 200 becomes an NFC communication initiator and communicates in the passive mode is described. However, the connection method in which the MFP side becomes the initiator and the communication mode becomes both active modes. The object of the present invention can also be achieved by the method.

  Next, the NFC communication protocol and the BT communication protocol between the portable communication terminal device 200 and the MFP 300 will be described in detail with reference to the sequence chart of FIG.

  The portable communication terminal device 200 performs polling by NFC communication in order to search for a device that transmits an image (S601). When a response from the MFP 300 is returned in response to polling (S602), the portable communication terminal apparatus 200 determines that a target has been found, and makes an NFC ID request including its own NFC ID (S603). The MFP 300 receives this request and transmits its own NFC ID as a response to the request (S604). As described above, the portable communication terminal device 200 and the MFP 300 each specify a communication partner based on the received NFC ID. Thereafter, an authentication request (S605) and an authentication response (S606) by exchanging keys between the mutual devices are performed, and mutual authentication is established and subsequent communication is encrypted.

  Next, a request for information relating to another protocol that can be used from the portable communication terminal apparatus 200 is made (S607). Upon receiving this request, the MFP 300 returns a response S608 with information (including BT communication) regarding other protocols that the MFP 300 can use. Based on the received protocol information, the portable communication terminal device 200 selects BT communication at a speed higher than that of NFC as a protocol suitable for image data transmission. Next, the portable communication terminal device 200 requests information on the Bluetooth Device Address (BD_ADDR), pass key, and link key necessary for BT communication connection with the MFP 300 (S609), and is necessary for BT communication connection by the response from the MFP 300. Information is received (S610).

  The portable communication terminal device 200 issues a BT connection request S611 by the BT communication unit 202 based on the received information, and the MFP 300 responds to the connection request (S612), thereby establishing a BT link connection. The portable communication terminal apparatus 200 transmits the selected image data to the MFP 300 by BT communication (S615, S616). On the other hand, the NFC communication unit of the portable communication terminal apparatus 200 continues to send polling regardless of BT communication (S613, S617), and the MFP 300 returns responses to polling (S614, S618). When the response to polling (S619) is not returned, it is detected that the physical distance between portable communication terminal apparatus 200 and MFP 300 is increased. Since this polling command is issued to confirm that the portable communication terminal apparatus 200 is in the vicinity of the MFP 300, the object of the present invention can also be achieved by transmitting another command. Further, the object of the present invention can also be achieved by continuously forming an RF field without transmitting a command from the portable communication terminal device 200 and continuously detecting the RF field by the MFP 300. In this embodiment, the procedure for transmitting image data by the so-called push type by BT communication is described. However, a method for acquiring data from the MFP side by a pull type, a protocol other than BT communication such as WLAN connection is used. The object of the present invention is such as a method of transmitting image data and a method in which image data is stored on a server on the Internet, and the MFP receives URL information of image data to be printed and directly retrieves the image data from the server. Achieved.

  Next, communication control in the MFP 300 will be described in detail with reference to the flowchart of FIG. 1 and the screen display example of FIG.

  When the portable communication terminal device 200 formed with the RF field approaches the MFP 300 and the MFP 300 detects the RF field (S101), it responds to an ID request, an authentication request, etc. by NFC communication (S102). Next, the MFP 300 transmits / receives usable communication protocol information and information necessary for the communication processing (S103). The portable communication terminal device 200 and the MFP 300 establish BT communication based on information exchanged by communication (S104). A process similar to the communication process (first communication control process) of the MFP 300 is also performed in the portable communication terminal device 200 (second communication control process).

  When the establishment of the BT communication is successful, the user is notified of the screen display with a sound output such as a message or a buzzer sound (not shown).

  When the BT communication is established, the MFP 300 detects the polling from the portable communication terminal device 200 described with reference to FIG. 6 via the NFC unit 918 (S613, S617). It is detected whether the communication terminal device 200 is still located (S105). When the NFC unit 918 of the MFP 300 does not detect polling, that is, when the portable communication terminal device 200 moves out of the communication range of the NFC unit 918 of the MFP 300, printing of image data transmitted in the PUSH format by BT communication (S109). The settings relating to printing at this time are performed in accordance with the default settings set in advance on the MFP side (first print control process).

  On the other hand, when the NFC unit 918 detects polling immediately after BT communication is established, the MFP 300 determines whether or not the period during which polling is detected continues for a preset threshold value or more (S105). . If not, as long as polling is detected, S105 and S106 are looped. During this time, if the user moves the portable communication terminal device 200 out of the NFC communication area (when the period during which the BT communication is established is less than the threshold), the NFC communication is interrupted. No, the process proceeds to S109, and printing is performed according to the default setting.

  On the other hand, if it is determined that the user keeps holding the portable communication terminal device 200 over the NFC unit 918 of the MFP 300 for two seconds or more after the establishment of the BT communication, the MFP 300 displays the detailed setting screen (FIG. )) Is displayed on the display unit 911 (S107). Further, a notification with a buzzer sound is given to notify that detailed setting is possible (not shown). For detecting the period of 2 seconds, it is possible to detect the passage of time by measuring the time with the timer of the MFP or counting the number of polling. In the detailed setting screen shown in FIG. 7A, items such as paper size, paper type, print quality, border setting, photo correction, and red-eye correction related to the image printing of the MFP 300 are arranged, and each can be set by the user. (Not shown). Accordingly, even if the L size is specified as the paper size by default, it is possible to specify the 2L size. When the user completes the various settings, the user selects the illustrated determination button 701. When the selection (touch) of the determination button 701 is detected, the MFP 300 prints (or prints) set by the user in S107 in order to print the image data transmitted from the portable communication terminal device 200 in S104. The printing process according to (condition) is performed (S109) (second printing control process).

  As described above, according to the first embodiment, the user operates the portable communication terminal device 200 to select an image file to be printed, and in a state where a print instruction is given, the NFC unit of the MFP 300 When the portable communication terminal device 200 is placed over the wireless communication terminal 918 (positioned within the NFC communication range), information exchange for performing BT communication between the portable communication terminal device 200 and the MFP 300 is performed through authentication using NFC. After this, communication by BT communication is performed and printing can be performed, and NFC communication is not essential. Such a point (a point that has reached the first stage) is notified to the user by either display or sound. Therefore, after confirming that, even if the portable communication terminal device 200 is separated from the NFC unit 918 of the MFP 300, the image file can be normally transmitted as long as it is within the communication range of the BT communication. Thus, a printed matter can be obtained. However, the settings related to printing in this case are printed according to the default settings set in advance in the MFP 300. On the other hand, if the user keeps holding the portable communication terminal device 200 over the NFC unit 918 of the MFP 300 for a predetermined time (2 seconds in the embodiment) or more after the start of BT communication, it is considered that the second stage has been reached. In order to allow the user to make detailed settings related to printing, a screen related to the detailed settings related to printing is automatically displayed on the display unit 911 of the MFP 300. Then, printing is performed after waiting for the setting completion instruction. Usually, since an MFP is literally a multifunctional device, a large number of setting menus are managed in a hierarchical structure. Accordingly, in order to reach the detailed setting menu related to printing, it is necessary to perform many operations. In this regard, according to the first embodiment, the portable communication terminal device 200 is held over the NFC unit 918 of the MFP 300, and the state is maintained for a predetermined time (2 seconds in the embodiment) after BT communication is established. By simply doing, it is possible to shift to the display of the detailed setting screen (menu) for printing, and the operability can be greatly improved.

  In the above-described example, the transmission example in the data transmission method by the so-called push type transmission in which the image data is transmitted and the printing is started in the step S104 has been described. However, the object of the present invention is achieved even in the pull type transmission form. Is possible. The image data information for printing is transmitted at the time of starting the BT communication in S104. The image information includes image file name and path name information. Step S105 If the NFC communication continuation determination based on the threshold value causes the MFP to move out of the NFC communication area without satisfying the threshold value, a channel connection request for data reception is made from the MFP side, and printing is performed according to the image data information received earlier. Request reception of necessary image data (pull reception). When the NFC communication continues beyond the threshold value, after completing the detailed setting, a channel connection request for data reception is made in the same manner as when moving immediately, and image data pull reception is performed. By performing pull-type reception as compared with the push-type, it is possible to obtain print image data as appropriate, and there are advantages such as reduction of restrictions on the reception buffer on the MFP side.

[Second Embodiment]
In the first embodiment, the detailed setting for printing is performed by the MFP 300. In the second embodiment, a method for performing the detailed printing setting by the portable communication terminal device 200 will be described in detail.

  First, the user operation procedure of the image printing application of the portable communication terminal device 200 will be described with reference to the display screen examples of FIGS. When the application is activated, an image selection screen shown in FIG. 5A is displayed and an image can be selected. When an image is selected and the print start key 503 is selected, the MFP is searched by the Inquiry Request via the BT unit 202, and the searched MFP is displayed on the display screen. FIG. 5B shows a display example of the searched printer. The searched MFP is displayed on the display unit 203. On the other hand, an RF field is formed around the antenna of the NFC unit 201 for NFC communication simultaneously with the printer search by BT communication, and a nearby target is searched. The user locates (holds) the portable communication terminal device in the vicinity of the NFC unit 918 of the MFP 300, thereby finding the target MFP by NFC communication. When the user moves the portable communication terminal device away from the MFP immediately after the target is found, BT communication is started and data transmission is started, and printing is started with the default print settings of the MFP device. When the user keeps portable communication terminal apparatus 200 close to MFP 300 for a predetermined period or longer (2 seconds), portable communication terminal apparatus 200 acquires Capability information from MFP 300 through NFC communication, and based on the acquired value. A detailed setting screen 1100 (see FIG. 11) is displayed on the portable communication terminal device. The detailed setting screen 1100 is configured such that various print settings of the MFP 300 can be changed by operating a detailed setting unit 1101. When the detailed setting is completed and the print start button 1102 is touched, the setting selected by the user and the image data are transmitted, and the MFP apparatus starts printing. When printing is started, a printing screen 5 (c) is displayed.

  Next, the NFC communication protocol and BT communication protocol between the portable communication terminal apparatus 200 and the MFP 300 will be described in detail with reference to the sequence chart of FIG.

  The portable communication terminal device 200 performs polling by NFC communication in order to search for a device that transmits an image (S1201). When the response S1202 from the MFP 300 is returned in response to the polling, the portable communication terminal apparatus 200 determines that the target has been found and makes an NFC ID request including its own NFC ID (S1203). The MFP 300 receives this request and returns a response by transmitting its own NFC ID (S1204). The portable communication terminal device 200 and the MFP 300 each specify a communication partner based on the received NFC ID. Thereafter, an authentication request (S1205) and an authentication response (S1206) are performed by exchanging keys between the mutual devices, the mutual authentication is established, and the subsequent communication is encrypted.

  Next, the portable communication terminal device 200 requests the MFP 300 for information regarding other available protocols (S1207). Upon receiving this request, the MFP 300 responds with information (including BT communication) regarding other protocols that can be used by the MFP 300 (S1208). Based on the received protocol information, the portable communication terminal device 200 selects the BT communication returned as a protocol suitable for image data transmission. Next, the portable communication terminal device 200 requests information on the Bluetooth Device Address (BD_ADDR), pass key, and link key necessary for BT communication connection with the MFP 300 (S1209), and is necessary for BT communication connection by a response from the MFP 300. Information is received (S1210). The portable communication device 200 continues polling by NFC communication and transmits a plurality of times (S1211, S1213), and the MFP 300 returns a polling response (S1212, S1214). The portable communication apparatus 200 measures the time during which the polling response is continued. For example, when the MFP 300 detects that the MFP 300 is in the vicinity (NFC communication area) for 2 seconds or longer, the function information of the MFP 300 is obtained using NFC communication. The described Capability information is requested (S1215). In response to this request, the MFP 300 transmits Capability information (S1216). FIG. 13 shows an example of Capability information request (FIG. 13 (a)) and an example of Capability information (FIG. 13 (b)) described in XML format. As shown in the figure, Capability information includes information such as a paper size that can be loaded, a paper type, and a format of an image that can be printed. Based on the received Capability information, the portable information terminal device 200 displays a print setting details screen on its display unit 810 so that the user can make settings. When the user setting is completed and the print start button is touched, a BT connection request is made to the MFP 300 (S1217), and the connection is established by a response S1218 from the MFP 300. Next, the portable information terminal device 200 transmits the image data by BT communication together with the selected setting information (S1219). The MFP 300 returns a response (S1220), and starts printing based on the set information.

  FIG. 14 is a diagram showing a communication control processing flow of the portable communication terminal apparatus 200 in the second embodiment. An RF field is started to search for a nearby target (S1401), and the process waits until the target MFP 300 is detected (S1402). When the target is detected, commands such as an ID request and an authentication request are transmitted / received by NFC communication (S1403). Next, the MFP 300 is requested for available protocol information and the information is acquired (S1404). When the protocol information is obtained, it is possible to shift to the BT communication, so the user is notified of the determination with a buzzer sound (not shown). In next step S1405, polling is continued in NFC communication to detect whether the MFP 300 is in the vicinity. If the polling response is interrupted before a certain time (2 seconds in the embodiment) elapses, connection to the MFP 300 by BT communication is started based on the acquired protocol information, and image data is transmitted in S1410 ( First transmission control process). In this case, printing is performed according to the default print setting contents.

  On the other hand, when the duration of the polling response is detected (S1406) and, for example, a time longer than a certain time (2 seconds) is detected, the function information (Capability information) of the MFP 300 is transmitted to the MFP 300 by NFC communication. Is requested and acquired (S1407). If this acquisition is successful, the portable communication terminal device 200 notifies the user with a buzzer sound and displays a setting screen related to printing on the operation screen based on the acquired Capability information so that the user can make print settings. (S1408). When the user completes the print settings and selects the print start button (S1409), the MFP 300 starts connection with the BT communication based on the determined protocol information, and proceeds to S1410 to print settings describing the set print conditions. Transmission of image data together with information is started (second transmission control process).

  As can be seen from the above description, in the second embodiment, the flow of images from the portable communication terminal apparatus 200 to the MFP 300 is the PUSH type. Further, although the portable communication terminal apparatus 200 transmits and receives Capability information by NFC communication, the object of the present invention can be achieved even by transmitting and receiving by other communication protocols. In addition, the polling commands (S1211, S1213) in the embodiment are issued to confirm that the portable communication terminal device is in the vicinity of the MFP, so this command can also be transmitted by sending other commands. The object of the invention can be achieved. Further, the object of the present invention can also be achieved by continuously forming an RF field without transmitting a command from the portable communication terminal device and continuously detecting the RF field by the MFP. In this embodiment, the procedure for transmitting image data by the so-called push type by BT communication is described. However, a method of acquiring link data by acquiring link data from the MFP side by pull type, other than BT communication such as WLAN connection, etc. A method of transmitting image data using the protocol of the above, or a method in which the image data is stored in a server on the Internet, and the MFP receives the URL information of the image data to be printed and goes directly to the server from the MFP Thus, the object of the present invention is achieved.

  As described above, even in the printing system according to the second embodiment, there is a simple operation difference between when the user wants to perform printing with the default settings of the MFP from the portable communication terminal device and when he wants to perform detailed settings. It becomes possible to isolate the processing operation of the portable communication terminal device.

  In the embodiment, it has been described that when NF communication is established, information for BT communication is exchanged and BT communication is established. However, the present invention is not limited to BT communication, and may be shifted to WLAN communication.

  Moreover, although the said embodiment demonstrated on the assumption that a portable communication terminal device was a smart phone, it communicated faster and faster than the 1st communication means which performs near field communication, and the said 1st communication means Any type of mobile phone, digital camera, PDA, portable PC, etc. can be used as long as it is a portable terminal having a plurality of communication hardware including the second communication means having a long distance. In particular, in the case of a smart phone, PDA, and PC, the portable communication terminal device 200 shown in the above embodiment can be realized by an application program executed by an internal processor thereof. Therefore, the present invention also includes a computer program. It is clear that this is the category. Furthermore, since the computer program is usually stored in a computer-readable storage medium such as a CD-ROM, it is obvious that such a computer-readable storage medium also falls within that category.

200: Portable communication terminal device, 300 ... MFP

  In the apparatus for performing communication as in the above prior art, further improvement in operability has been desired.

In order to solve this problem, for example, a program according to the present invention comprises the following arrangement. That is,
A program executed by a mobile terminal device including a first communication unit that performs communication by short-range wireless communication ,
If the image to be printed by the user's instruction has been selected, the and the communication capable state with the second communication unit the first communication unit and a printer is provided is continued, in the portable terminal device A display control step of displaying a set print setting and displaying a screen for a user to issue a print instruction on a display unit included in the mobile terminal device;
A transmission control step of transmitting image data corresponding to the image to be printed to the printer by a communication method different from the short-range wireless communication ;
Is executed by the mobile terminal device,
Wherein and the image to be printed is selected, and the first communication unit and the second of said short-range wireless communication by the first communication unit without being continued communication is ready with the communication unit In a state where communication with the second communication unit is disabled, the screen is not displayed,
The image data is printed by the printer according to the print settings when a user print instruction is given to the display unit on which the screen is displayed in the display control step.

Claims (21)

A program executed by a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication),
When the image to be printed is selected by the user's instruction and the first NFC unit is in a state where it can communicate with the second NFC unit included in the printer, the portable terminal device displays a predetermined display item. A display control process to be displayed on the display unit,
A transmission control step of transmitting image data corresponding to the image to be printed to the printer by a communication method different from NFC;
Is executed by the mobile terminal device,
After the NFC communication between the first NFC unit and the second NFC unit is performed when the image to be printed is selected, the first NFC unit communicates with the second NFC unit. In a state where communication is not possible, the predetermined display item is not displayed,
The predetermined display item is displayed in the display control step, and the image data is printed by the printer when the user gives an instruction to the display unit on which the predetermined display item is displayed. A program characterized by A program executed by a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication),
When the image to be printed is selected by the user's instruction and the first NFC unit is in a state where it can communicate with the second NFC unit included in the printer, the portable terminal device displays a predetermined display item. A display control process to be displayed on the display unit,
In the display control step, when there is a user instruction to the display unit on which the predetermined display item is displayed, image data corresponding to the image to be printed is transferred to the printer by a communication method different from NFC. A transmission control process for transmitting;
Is executed by the mobile terminal device,
After the NFC communication between the first NFC unit and the second NFC unit is performed when the image to be printed is selected, the first NFC unit is connected to the second NFC unit. The program, wherein the predetermined display item is not displayed in a state where communication is disabled. A program executed by a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication),
When an image to be printed is selected by a user instruction and the second NFC unit included in the printer is within a predetermined range of the first NFC unit, the portable terminal device displays a predetermined display item. A display control process to be displayed on the display unit,
A transmission control step of transmitting image data corresponding to the image to be printed to the printer by a communication method different from NFC;
Is executed by the mobile terminal device,
In a state where the second NFC unit is not within the predetermined range after the image to be printed is selected and the second NFC unit is within the predetermined range, the predetermined N Is not displayed,
The predetermined display item is displayed in the display control step, and the image data is printed by the printer when the user gives an instruction to the display unit on which the predetermined display item is displayed. A program characterized by A program executed by a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication),
When an image to be printed is selected by a user instruction and the second NFC unit included in the printer is within a predetermined range of the first NFC unit, the portable terminal device displays a predetermined display item. A display control process to be displayed on the display unit,
In the display control step, when there is a user instruction to the display unit on which the predetermined display item is displayed, image data corresponding to the image to be printed is transferred to the printer by a communication method different from NFC. A transmission control process for transmitting;
Is executed by the mobile terminal device,
In a state where the second NFC unit is not within the predetermined range after the image to be printed is selected and the second NFC unit is within the predetermined range, the predetermined N The display item is not displayed. The mobile terminal device includes a touch panel as the display unit,
In the display control step, the predetermined display items are displayed on the touch panel,
The program according to any one of claims 1 to 4, wherein the instruction is a user instruction to the touch panel. Causing the portable end device to further execute a second display control step of causing the display unit to display a selection screen for selecting an image;
The program according to any one of claims 1 to 5, wherein the image to be printed is selected in accordance with a user instruction to the selection screen displayed in the second display control step. .   In the display control step, when the time during which NFC communication between the first NFC unit and the second NFC unit is established is equal to or greater than a preset threshold, the predetermined display item is displayed. The program according to any one of claims 1 to 6, wherein the program is displayed on a screen.   8. The display control step according to claim 7, wherein a setting screen including the predetermined display item and capable of print setting for printing the image data by the printer is displayed on the display unit. program.   9. The transmission control process according to claim 1, wherein the image data is transmitted with setting information corresponding to a print setting for printing the image data by the printer. program.   The program according to claim 9, wherein the print setting includes at least one of a paper type and a paper size.   11. The program according to claim 1, wherein the first NFC unit operates as an initiator in NFC and detects the second NFC unit operating as a target in the NFC. Connection information for connecting to the printer by the communication method different from NFC is acquired from the second NFC unit by the first NFC unit,
The program according to any one of claims 1 to 11, wherein, in the transmission control step, the image data is transmitted by the communication method different from NFC based on the connection information. A search step for searching for a printer by the communication method different from NFC;
A third display control step for displaying information indicating the printer searched in the search step on the display unit;
The program according to claim 1, further causing the mobile terminal device to execute the program.   The program according to any one of claims 1 to 13, wherein the communication system different from NFC is WLAN.   The program according to claim 1, wherein the mobile terminal device is a smartphone. A program executed by a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication),
When an image to be printed is selected according to a user instruction and the first NFC unit is in a state in which the first NFC unit can communicate with a second NFC unit provided in a printer, A reception process for receiving a print instruction based on communication by NFC;
A transmission control step of transmitting image data corresponding to the image to be printed to the printer by a communication method different from NFC;
Is executed by the mobile terminal device,
After the NFC communication between the first NFC unit and the second NFC unit is performed when the image to be printed is selected, the first NFC unit communicates with the second NFC unit. In a state where communication is no longer possible, printing instructions based on NFC communication are not accepted,
The program in which the image data is printed by the printer when the printing instruction is received in the receiving step. A program executed by a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication),
When an image to be printed is selected according to a user instruction and the first NFC unit is in a state in which the first NFC unit can communicate with a second NFC unit provided in a printer, A reception process for receiving a print instruction based on communication by NFC;
A transmission control step of transmitting image data corresponding to the image to be printed to the printer by a communication method different from NFC when the print instruction is received in the reception step;
Is executed by the mobile terminal device,
After the NFC communication between the first NFC unit and the second NFC unit is performed when the image to be printed is selected, the first NFC unit communicates with the second NFC unit. A program that does not accept printing instructions based on NFC communications when communication is no longer possible. A program executed by a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication),
When an image to be printed is selected by a user instruction and the second NFC unit included in the printer is within a predetermined range of the first NFC unit, the display unit included in the mobile terminal device is provided. A reception process for receiving a print instruction based on communication by NFC;
A transmission control step of transmitting image data corresponding to the image to be printed to the printer by a communication method different from NFC;
Is executed by the mobile terminal device,
After the state where the image to be printed is selected and the second NFC unit is in the predetermined range, the state in which the second NFC unit is not in the predetermined range is determined by NFC. Printing instructions based on communication are not accepted,
The program in which the image data is printed by the printer when the printing instruction is received in the receiving step. A program executed by a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication),
When an image to be printed is selected by a user instruction and the second NFC unit included in the printer is within a predetermined range of the first NFC unit, the display unit included in the mobile terminal device is provided. A reception process for receiving a print instruction based on communication by NFC;
A transmission control step of transmitting image data corresponding to the image to be printed to the printer by a communication method different from NFC when the print instruction is received in the reception step;
Is executed by the mobile terminal device,
After the state where the image to be printed is selected and the second NFC unit is in the predetermined range, the state in which the second NFC unit is not in the predetermined range is determined by NFC. A program that does not accept printing instructions based on communications. An information processing method using a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication) and a printer including a second NFC unit that performs communication by NFC,
When an image to be printed is selected according to a user instruction, and the first NFC unit is in a state where it can communicate with a second NFC unit included in a printer, the portable terminal device displays a predetermined display item. A display control process to be displayed on the display unit;
A transmission control step in which the portable terminal device transmits image data corresponding to the image to be printed to the printer by a communication method different from NFC;
Print control in which the printer prints the image data when the predetermined display item is displayed in the display control step and the user gives an instruction to the display unit on which the predetermined display item is displayed Process,
Have
After the NFC communication between the first NFC unit and the second NFC unit is performed when the image to be printed is selected, the first NFC unit communicates with the second NFC unit. The information processing method, wherein the predetermined display item is not displayed in a state where communication is disabled. An information processing method using a portable terminal device including a first NFC unit that performs communication by NFC (Near Field Communication) and a printer including a second NFC unit that performs communication by NFC,
When an image to be printed is selected by a user instruction and the second NFC unit included in the printer is within a predetermined range of the first NFC unit, the portable terminal device displays a predetermined display item. A display control process to be displayed on the display unit;
A transmission control step in which the portable terminal device transmits image data corresponding to the image to be printed to the printer by a communication method different from NFC;
Print control in which the printer prints the image data when the predetermined display item is displayed in the display control step and the user gives an instruction to the display unit on which the predetermined display item is displayed Process,
Have
In the display control step, the second NFC unit is not in the predetermined range after the image to be printed is selected and the second NFC unit is in the predetermined range. The information processing method, wherein the predetermined display item is not displayed in the state.

Images