JP2013020412A - Image processing device, transfer method, and transfer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing device that enables work for exchanging data between plural devices by an intuitive and easy operation.SOLUTION: An image processing device, when receiving a first operation (S12, S14) including a drag operation to a predetermined area on a touch panel in a state where an object displayed on the touch panel is designated, transfers at least data indicating the object to another device (S13, S15).

Description

  The present invention relates to an image processing device, a transfer method, and a transfer program, and more particularly to an image processing device having a touch panel, a transfer method, and a transfer program.

  In recent years, touch panels have been widely adopted as operation input devices for cellular phones, image forming apparatuses, and the like.

Various input operations using a touch panel have been proposed.
For example, Japanese Patent Application Laid-Open No. 2002-123369 discloses a technique for scrolling display contents on a screen when a preset operation that is distinguished from normal input is performed.

  Japanese Patent Application Laid-Open No. 2003-319244 discloses a technique for assigning a specific operation to a locus of a touch position on a touch panel.

  Such a touch panel operation is intuitive and has an advantage that even a user unfamiliar with the apparatus can easily perform the operation.

  There is a growing need to use such touch panel operations in work for exchanging data between a plurality of devices.

JP 2002-123369 A JP 2003-319244 A

  However, in the conventional exchange of data between devices having a touch panel, the touch panel operation is possible in each device, but at the time of transfer, transmission operation is performed in one device, and reception operation and storage are performed in the other device. There has been a problem that the operation becomes complicated because each device needs to be operated independently.

  The present invention has been made in view of such problems, and provides an image processing apparatus, a transfer method, and a transfer program that enable an operation of exchanging data between a plurality of apparatuses by an intuitive and easy operation. The purpose is to do.

  In order to achieve the above object, according to one aspect of the present invention, an image processing device is a communication unit for transmitting / receiving data to / from another device, a touch panel, and a process corresponding to an operation on the touch panel. And processing means for executing. When the processing unit receives a first operation including a drag operation to a predetermined area on the touch panel in a state where the object displayed on the touch panel is specified, at least data indicating the object is transferred to another device. .

  Preferably, the processing means transmits data indicating the object and information specifying a predetermined area to a server as another device.

  Preferably, when the processing means receives a request for storing information including at least data indicating the object and information specifying the predetermined area and a request for transferring the data indicating the object from another device, the processing means is included in the request. Using the information and the stored information, a process for authenticating whether or not the data indicating the object can be transferred is executed, and a process for transferring the data indicating the object to another device when the authentication is successful.

  More preferably, the other device has a touch panel, and the request from the other device includes information for specifying the operation position on the touch panel of the other device, and the authentication performed by the processing means is the predetermined dragged This includes authentication as to whether or not the relationship between the area and the operation position is a predefined relationship.

  Preferably, the request from the other device includes information for identifying the other device, and the authentication performed by the processing unit is based on a correspondence relationship between the predetermined dragged predetermined area and the other device. It includes authentication of whether or not the dragged predetermined area corresponds to another device.

  Preferably, when the processing unit accepts the second operation on the touch panel, the processing unit outputs a signal for requesting data transfer, and displays the object indicated by the transferred data at the position designated for the second operation. And a process of inserting the object at a position corresponding to the position where the object of the data to be processed is received when the third operation on the touch panel is accepted while the object is displayed on the touch panel. .

  According to another aspect of the present invention, a communication means for transmitting / receiving data to / from another apparatus, an image processing apparatus, a touch panel, and a processing means for executing a process according to an operation on the touch panel With. When the processing unit accepts the first operation on the touch panel, the processing unit outputs a signal for requesting data transfer to another device, and the object indicated by the data transferred from the other device is processed by the first operation. When the second operation on the touch panel is accepted while the object is displayed on the touch panel and the object is displayed at the position specified in, the object is inserted at the position corresponding to the position where the object of the data to be processed is displayed. The process to perform is performed.

  According to still another aspect of the present invention, the transfer method is a method for transferring data between a first device and a second device each having a touch panel, and an object displayed on the touch panel of the first device. When a first operation including a drag operation to a predetermined area on the touch panel is received with the touch panel being specified, the data indicating the object is specified as the data to be transferred, and the information including the data to be transferred is stored. And a step of outputting a signal requesting transfer of data to be transferred when receiving a second operation on the touch panel of the second device, and information included in the requested signal and stored information are used. And authenticating whether or not the data indicating the object can be transferred, and if the authentication is successful, The data indicating the data is transferred, the object indicated by the transferred data is displayed at the position designated by the second operation of the touch panel of the second device, and the object is displayed on the touch panel of the second device. When a third operation is received on the touch panel of the second device in the state of being performed, a step of inserting an object at a position corresponding to the position where the object of the data to be processed is displayed is provided.

  According to still another aspect of the present invention, the transfer program is a program for causing a computer to execute a data transfer process from a first device having a touch panel, and an object displayed on the touch panel of the first device is By receiving a first operation including a drag operation to a predetermined area on the touch panel in a specified state, at least data indicating an object and information specifying the predetermined area are transmitted from the first device. An object using a step of receiving information, a step of receiving a request to transfer data indicating an object from the second device, and information included in the request from the second device and information from the first device. And authenticating whether or not the data indicating the transfer can be transferred to the second device. To perform the steps on a computer for transferring data indicating the object from the first device Te.

  According to still another aspect of the present invention, a transfer program is a program for causing a device having a touch panel to execute a data transfer process. When a first operation on the touch panel is received, the data is transferred to another device. A step of outputting a signal requesting transfer, a step of receiving an object indicated by data transferred from another device, and a step of displaying the object indicated by the received data at a position designated in the first operation. When the second operation on the touch panel is received while the object is displayed on the touch panel, the apparatus is caused to execute the step of inserting the object at a position corresponding to the position where the object of the data to be processed is displayed.

  According to the present invention, it is possible to perform an operation of exchanging data between a plurality of devices by an intuitive and easy operation using a touch panel.

It is a figure which shows the specific example of a structure of the image processing system concerning embodiment. 2 is a diagram illustrating a specific example of a hardware configuration of an MFP included in an image processing system. It is a figure which shows the specific example of the hardware constitutions of the portable terminal contained in an image processing system. It is a figure which shows the specific example of the hardware constitutions of the server contained in an image processing system. It is a figure for demonstrating "pinch" operation. It is a figure for demonstrating "release" operation. It is a figure showing the example of a screen in the portable terminal as a 1st apparatus. FIG. 6 is a diagram illustrating an example of a screen on an MFP as a second device. It is a figure showing the flow of operation | movement in an image processing system. It is a block diagram which shows the specific example of a function structure of a portable terminal. 2 is a block diagram illustrating a specific example of a functional configuration of an MFP. FIG. It is a block diagram which shows the specific example of a function structure of a server. It is a figure which shows the specific example of the relationship between the drag | end terminal position in a transfer origin apparatus, and the touch position in a transfer destination apparatus. It is a flowchart showing the flow of operation | movement with a portable terminal. 3 is a flowchart showing an operation flow in the MFP. It is a flowchart showing the flow of operation | movement in a server. It is a figure which shows the specific example of the relationship between the drag | end terminal position in the transfer origin apparatus in a 1st modification, and a transfer destination apparatus. It is a figure which represents typically the relationship between a drag | end terminal position and a transfer destination apparatus.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same.

<System configuration>
FIG. 1 is a diagram showing a specific example of the configuration of the image processing system according to the present embodiment.

  Referring to FIG. 1, an image processing system according to the present embodiment includes an MFP (Multi-Function Peripheral) 100 as an example of an image processing apparatus, a portable terminal 300 as a terminal device, and a server 500. Are connected by a network such as a LAN (Local Area Network).

  The network may be wired or wireless. As an example, as shown in FIG. 1, MFP 100 and server 500 are connected to a wired LAN, wireless LAN access point 700 is further included in the wired LAN, and portable terminal 300 is connected to wireless LAN access point 700 and wireless LAN. An example of connection is given.

  The image processing apparatus is not limited to the MFP as long as it has a touch panel as a configuration for receiving operation input, and may be any image processing apparatus. As other examples, a copying machine, a printer, a facsimile machine, or the like may be used.

  The portable terminal 300 may be any device as long as it has a touch panel as a configuration for receiving operation input. For example, it may be a mobile phone equipped with a touch panel, a personal computer, a PDA (Personal Digital Assistants), or an image processing apparatus such as an MFP.

<Configuration of MFP>
FIG. 2 is a diagram illustrating a specific example of the hardware configuration of the MFP 100.

  Referring to FIG. 2, MFP 100 includes a CPU (Central Processing Unit) 10 that is an arithmetic device for overall control, a ROM (Read Only Memory) 11 for storing a program executed by CPU 10, and the like. A RAM (Random Access Memory) 12 for functioning as a work area when the CPU 10 executes the program, a scanner 13 for optically reading a document placed on a document table (not shown), and obtaining image data; A printer 14 for fixing the image data on the printing paper, an operation panel 15 including a touch panel for displaying information and receiving an operation input to the MFP 100, and a memory for storing the image data as a file 16 and a network controller for controlling communication via the network And a 7.

  The operation panel 15 includes a touch panel (not shown) and an operation key group. The touch panel is configured by overlapping a display device such as a liquid crystal display device and a position indicating device such as an optical touch panel or a capacitive touch panel, and displays an operation screen to specify an indicated position on the operation screen. CPU10 displays an operation screen on a touchscreen based on the data for displaying the screen memorize | stored beforehand.

  The specified position (touched position) on the touch panel and the operation signal indicating the pressed key are input to the CPU 10. The CPU 10 specifies the operation content from the pressed key or the displayed operation screen and the designated position, and executes processing based on the operation content.

<Configuration of mobile terminal>
FIG. 3 is a diagram illustrating a specific example of the hardware configuration of the mobile terminal 300.

  Referring to FIG. 3, portable terminal 300 includes a CPU 30 that is an arithmetic device for overall control, a ROM 31 for storing a program executed by CPU 30, and a work area when the CPU 30 executes the program. A RAM 32 for functioning as a memory, a memory 33 for storing image data as a file or other information, and a touch panel for displaying information or accepting an operation input to the mobile terminal 300 It includes an operation panel 34, a communication controller 35 for controlling communication via a telephone line by communicating with a base station (not shown), and a network controller 36 for controlling communication via the network.

  Operation panel 34 may have the same configuration as operation panel 15 of MFP 100. That is, as an example, a touch panel configured by overlapping a display device such as a liquid crystal display device and a position indicating device such as an optical touch panel or a capacitive touch panel is included.

  CPU30 displays an operation screen on a touchscreen based on the data for displaying the screen memorize | stored beforehand. On the touch panel, an indicated position on the operation screen is specified, and an operation signal indicating the position is input to the CPU 30. The CPU 30 specifies the operation content from the displayed operation screen and the indicated position, and executes processing based on the operation content.

<Server configuration>
FIG. 4 is a diagram illustrating a specific example of the hardware configuration of the server 500.

  Referring to FIG. 4, server 500 is configured by a general computer or the like as described above. As an example, CPU 50 that is an arithmetic device for overall control, a program executed by CPU 50, and the like. ROM 51 for storing data, RAM 52 for functioning as a work area when CPU 50 executes a program, HD (Hard Disk) 53 for storing files, etc., and communication via the network are controlled. Network controller 54.

<Overview of operation>
In the image processing system, a range of a document that is being edited between the MFP 100 and the portable terminal 300 is designated by a “pinch” operation, dragged, and a “release” operation is performed, whereby a document in a range designated between the devices. Data moves.

  Specifically, in the first device of MFP 100 and portable terminal 300, the user specifies a range to be transferred as document data by dragging to the screen edge after specifying the range with the “pinch” operation in the document being edited. To do. When the user touches a predetermined position on the document editing screen of the second device, the document data specified by the “pinch” operation is displayed at the touch position on the document editing screen of the second device. By dragging from the touch position to a desired position, the document data moves according to the drag. Then, when the user performs a “release” operation at a desired position, the document data is inserted at that position.

Here, the above-described pinching operation and releasing operation will be described.
FIG. 5 is a diagram for explaining the “pinch” operation. Referring to FIG. 5, “pinch” operation refers to, for example, specifying two points P1 and P2 on the operation panel using two fingers and the like, and then moving the finger linearly or substantially linearly from that position. Is an operation of releasing two fingers from the operation panel at two points P′1 and P′2 that are close to each other.

  The CPU is instructed at two points P1 and P2 on the operation panel at the same time, and further, the position changes continuously or linearly from each position, with an interval shorter than the interval between the original two points. When it is detected that both designations are canceled at two points P′1 and P′2 almost simultaneously, it is detected that the “pinch” operation has been performed.

  FIG. 6 is a diagram for explaining the “release” operation. Referring to FIG. 6, the “release” operation refers to, for example, specifying two points Q1 and Q2 on the operation panel using two fingers and the like, and then moving the finger linearly or substantially linearly from that position. Is an operation in which two fingers are separated from the operation panel at two points Q′1 and Q′2, which are positions apart from each other.

  The CPU is instructed at two points Q1 and Q2 on the operation panel at the same time, and further, the position is continuously changed from the respective positions to a straight line or a substantially straight line at intervals longer than the original two points. When it is detected that both designations are released almost simultaneously at two certain points Q′1 and Q′2, it is detected that the “release” operation has been performed.

  FIG. 7 is a diagram illustrating an example of a screen on the mobile terminal 300 as the first device. FIG. 8 is a diagram illustrating a screen example on MFP 100 as the second apparatus. The operation flow in the image processing system will be described with reference to FIGS.

  Referring to FIG. 7, when a notepad application, which is a document editing application, is executed on portable terminal 300, the touch position continuously changes with respect to the display position of, for example, the character string “AAAA” on the display screen. The character string “AAAA” is designated by performing the operation (tracing operation) or the like (FIG. 7A).

  When a pinch operation is performed in this state, the designated character string “AAAA” is determined as transfer data (FIG. 7B).

  Then, when the display position of the designated character string “AAAA” is dragged to the end of the screen, the character string “AAAA” is copied to that position (FIG. 7C).

  After that, when a document editing application such as Word (registered trademark) is executed in the MFP 100, when the screen edge corresponding to the dragged screen edge is touched on the mobile terminal 300, as shown in FIG. The character string “AAAA” designated by the portable terminal 300 is displayed at that position. When dragging with the position as a base point, the character string “AAAA” is moved to the position and displayed (FIG. 8B).

  When a release operation is performed after dragging, the character string “AAAA” is inserted and displayed at the data position corresponding to the dragging end position on the display screen of the document editing application (FIG. 8C). .

  FIG. 9 is a diagram showing the flow of operations in the image processing system. The flow of operations in the image processing system will be described with reference to FIG.

  Referring to FIG. 9, while editing a document in first apparatus (for example, portable terminal 300) of MFP 100 and portable terminal 300, an area in a sentence is designated in step S11, and the operation is pinched in step S12. In step S13, the document data in the area specified in step S11 is determined as transfer data.

  The designation of the area in step S11 may be performed by, for example, an operation of moving the touch position continuously (tracing operation) on the operation panel 34, or an input device such as a key (not shown) is provided in the portable terminal 300. In such a case, the operation may be performed using the input device.

  Further, the pinching operation in step S12 may be performed within a specified range, or may be performed at an unrelated position. Here, it is only necessary to detect an operation to pinch while the designation in step S11 is valid.

  In step S14, when an operation for dragging the area determined as transfer data in step S13 to the screen edge is detected, the transfer data and the position of the dragged screen edge are represented in step S15. Information including information and user information that performed the operation is transmitted from portable terminal 300 to server 500.

  The user information may be user information about a user who logs in to the mobile terminal 300 when the above operation is performed. If the user information is associated with the mobile terminal 300 in advance, the user information is the user information. There may be.

  The drag in step S14 may be to move the two touch positions continuously from the pinch operation in step S12. In addition to the pinch operation in step S12, the drag position is newly determined and the drag is performed. It may be made from the touch position.

  In the following description, information transmitted from the mobile terminal 300 to the server 500 in conjunction with detection of a pinch operation on the mobile terminal 300 and a drag operation to the screen edge is also referred to as “pinch information”. The pinching information includes the transfer data, the information indicating the position of the dragged screen edge, and the user information that performed the operation as described above, and information that specifies the date and time when the pinching operation is detected. May be included.

  The server that has received the pinch information transmitted from the mobile terminal 300 stores the pinch information in a predetermined area of the memory 55 or the HD 53 in step S21.

  When a touch is detected on the operation panel 15 of the second device (in this example, MFP 100) of MFP 100 and portable terminal 300 in step S31, MFP 100 performs the operation on the server in step S32. The user information and the information specifying the touch position are transmitted to request transfer of transfer data. The other information may include information for specifying an application being executed in MFP 100 when the touch is detected.

  The user information may be user information regarding a login user to MFP 100 when the above operation is performed, or may be user information obtained by performing login processing when this operation is detected. Good.

  Upon receiving this request, the server 500 performs an authentication process in step S22. In the authentication process, at least the user information included in the pinch information matches the user information included in the request, and the drag position specified by the pinch information and the touch position included in the request are defined in advance. That they are in a relationship. As another authentication, it may be authenticated whether or not the transfer data included in the information pinched in the application executed on the MFP 100 can be handled.

  If the authentication is successful, the transfer data is transferred from the server 500 to the MFP 100 in step S23. When the transfer is completed, the server 500 may delete the pinch information stored in step S21.

  In step S33, document data as transfer data is displayed at a position corresponding to the touch position in step S31 on operation panel 15 of MFP 100. In step S34, when an operation of dragging based on the position where the document data is displayed is detected, the display on the operation panel 15 is updated so that the document data is displayed in the position dragged in step S35.

  The drag in step S34 may be performed continuously from the touch in step S31, or may be performed again from the touch position by defining a touch position separately from the touch in step S31. .

  If an operation of releasing after dragging is detected in step S36, document data as transfer data is inserted into a position corresponding to the final position of the dragging of data being processed in MFP 100 in step S37.

<Functional configuration>
FIG. 10 is a block diagram illustrating a specific example of a functional configuration of the mobile terminal 300 for performing the above operation. Each function shown in FIG. 10 is a function mainly formed on the CPU 30 when the CPU 30 reads a program stored in the ROM 31 and executes it on the RAM 32. However, at least some of the functions may be processed by the hardware configuration shown in FIG.

  Referring to FIG. 10, CPU 30 of portable terminal 300 has an input unit 301 for receiving an input of an operation signal indicating an instruction on operation panel 34, an operation for designating an area based on the operation signal, and the above-described pinch. A detection unit 302 for detecting an operation, a dragging operation, and the like, a pinching operation and a specifying unit 303 for specifying the above-mentioned pinching information in response to detection of a dragging operation to the screen edge, and a pinching operation and dragging A display unit 304 for executing a process of updating the display on the operation panel 34 according to an operation, and a method for transmitting to the server 500 pinching information specified by storing access information to the server 500 in advance. A transmission unit 305.

  When the detection unit 302 detects that the above-described pinching operation has been performed on the operation panel 34, the specifying unit 303 is executing a document creation application such as Notepad or Word (registered trademark). Check if the document data is specified by performing a trace operation on the display screen. If document data is designated, the document data is specified as transfer data.

  When the drag operation is detected by the detection unit 302 in a state where the transfer data is specified, the display unit 304 updates the display position of the document data specified as the transfer data according to the drag.

  When the detection unit 302 detects an operation of dragging to the screen edge while the transfer data is specified, the specifying unit 303 specifies the information including the transfer data. The screen edge here may be within a predetermined range from the edge of the display screen.

  As described above, the pinching information includes at least transfer data, information indicating the position of the dragged screen edge, and user information for performing the operation. The information indicating the position of the dragged screen edge corresponds to information specifying the side of the screen closest to the end of the drag when the display screen is rectangular. As the user information, for example, information related to the login user may be acquired from an authentication unit (not shown).

  FIG. 11 is a block diagram showing a specific example of a functional configuration of MFP 100 for executing the above operation. Each function shown in FIG. 11 is a function mainly formed on the CPU 30 when the CPU 10 reads a program stored in the ROM 11 and executes it on the RAM 12. However, at least some of the functions may be processed by the hardware configuration shown in FIG.

  Referring to FIG. 11, CPU 10 of MFP 100 has input unit 101 for receiving an input of an operation signal indicating an instruction on operation panel 15, an operation of touching based on the operation signal, the above-described release operation, dragging And detecting user information and information for specifying the touched position to the server 500 via the network controller 17 in response to detection of an operation for touching the screen edge. A request unit 103 for requesting transfer of transfer data, a receiving unit 104 for receiving transfer data transmitted from the server 500 via the network controller 17, and transfer according to detection of a drag operation and a release operation Identifies the position where data is to be inserted, and executes processing to insert transfer data at that position. It includes a processing unit 106 for, and a display unit 105 for performing the processing for updating the display on the operation panel 15 of the transfer data in response to the detection of the operation of dragging.

  For example, when a document creation application such as a memo pad or a word (registered trademark) is being executed and the detection unit 102 detects a touch operation at the end of the display screen, the request unit 103 detects Information to be identified and user information are transmitted to the server 500. The screen edge here may be within a predetermined range from the edge of the display screen.

  When the detecting unit 102 detects an operation of releasing the transfer data after the drag operation, the processing unit 106 detects the end position of the drag on the data to be processed in the application being executed based on the display content of the operation panel 15. The position corresponding to is specified, and the process of inserting the transfer data at that position is executed.

  FIG. 12 is a block diagram showing a specific example of a functional configuration of the server 500 for executing the above operation. Each function shown in FIG. 12 is a function mainly formed on the CPU 50 when the CPU 50 reads out a program stored in the ROM 51 and executes it on the RAM 52. However, at least some of the functions may be processed by the hardware configuration shown in FIG.

  Referring to FIG. 12, the CPU 50 of the server 500 receives an input unit 501 for receiving input of pinch information transmitted from the mobile terminal 300 via the network controller 54, and stores the input pinch information in a predetermined area of the memory 55. A storage unit 502 for storing data, a request receiving unit 503 for receiving a transfer data transfer request from the MFP 100 via the network controller 54, and information included in the information included in the information included in the request. An authentication unit 504 for performing authentication processing using, and a transfer unit 505 for transferring transfer data included in information pinched when authentication is successful to the MFP 100 via the network controller 54.

  As described above, the pinching information includes information indicating the position of the dragged screen edge and user information for performing the operation together with the transfer data. Further, as described above, the transfer data request from MFP 100 includes user information and information for specifying the touch position.

The authentication unit 504 uses these pieces of information to perform user authentication and transfer propriety authentication.
As an example of user authentication in the authentication unit 504, the user authentication may be successful when the users indicated in the user information match, or the user indicated by the user information included in the pinch information and the user included in the request for transfer data The user authentication may be successful when the group to which the user indicated by the information belongs belongs to the same group stored in advance. In addition, general user authentication may be used.

  As authentication for transfer propriety, the authentication unit 504 defines in advance the position of the dragged screen edge indicated by the information included in the pinching information and the position of the touched screen edge indicated by the information included in the request for transfer data. It is determined whether or not the positional relationship is established. If the positional relationship is defined in advance, the authentication is successful.

  In order to perform this authentication, the authentication unit 504 has a relationship between the position of the dragged screen edge indicated by the information included in the pinching information and the position of the touched screen edge indicated by the information included in the transfer data request, that is, transfer. Information preliminarily defining the relationship between the drag end position on the source device and the touch position on the transfer destination device is stored.

  The authentication unit 504 authenticates that the request for the transfer data is made within a predetermined period from the date and time, for example, when other information includes information specifying the date and time when the pinch operation is performed. You may make it do. If the transfer data is not requested within a predetermined period from the above date and time, the CPU 50 may delete the pinch information stored in the memory 55.

  FIG. 13 is a diagram illustrating a specific example of the relationship between the drag end position on the transfer source device and the touch position on the transfer destination device. In the example shown in FIG. 13, when the transfer data is dragged to the left end of the screen at the transfer source device and the right end of the screen of the transfer destination device is touched, the transfer data is displayed at the right end of the screen of the transfer destination device. Has been. Further, it is shown that when the transfer data is dragged to the right end of the screen at the transfer source device and the left end of the screen of the transfer destination device is touched, the transfer data is displayed at the left end of the screen of the transfer destination device. Further, it is shown that when the transfer data is dragged to the upper end of the screen at the transfer source device and the upper end of the screen of the transfer destination device is touched, the transfer data is displayed at the upper end of the screen of the transfer destination device. Further, it is shown that when the transfer data is dragged to the lower end of the screen at the transfer source device and the lower end of the screen of the transfer destination device is touched, the transfer data is displayed at the lower end of the screen of the transfer destination device.

  The example of FIG. 13 is an example, but by defining such a relationship, it is possible to perform an operation in a positional relationship such that the display screens of the two devices are continuous.

  In the authentication unit 504, the position of the dragged screen edge indicated by the information included in the pinching information and the position of the touched screen edge indicated by the information included in the request for transfer data satisfy the relationship of FIG. 13 as an example. If the authentication is successful, the transfer success / failure authentication is assumed to be successful.

  If both user authentication and transfer propriety authentication are successful, the transfer unit 505 transfers the transfer data included in the pinching information to the MFP 100.

<Operation flow>
FIG. 14 is a flowchart showing an operation flow in portable terminal 300. The operation shown in the flowchart of FIG. 14 is realized by the CPU 30 reading out a program stored in the ROM 31 and executing it on the RAM 32 to exhibit the functions shown in FIG.

  Referring to FIG. 14, when CPU 30 detects that an operation of pinching on operation panel 34 has been performed (YES in step S101), a document creation application such as a notepad or word (registered trademark) is being executed. It is confirmed whether or not at least a part of the document data to be processed is in a specified state.

  If document data is specified when a pinch operation is detected (YES in step S103), in step S105, the CPU 30 identifies the specified portion of the document data as data to be transferred.

  If an operation of dragging the specified display position of the document data as a starting point is performed on the operation panel 34 (YES in step S107), the CPU 30 displays the specified document data at the touch position in step S109. As described above, the screen display on the operation panel 34 is updated.

  If it is detected that the drag has progressed to reach the screen edge (YES in step S111), in step S113, the CPU 30 identifies the specified document data, information indicating the screen edge that is the end of the drag, and the user who performed the operation. The information including the information is specified and transmitted to the server 500.

  FIG. 15 is a flowchart showing an operation flow in MFP 100. The operation shown in the flowchart of FIG. 15 is realized by causing the PCU 10 to read out a program stored in the ROM 11 and execute it on the RAM 12 to exhibit the functions shown in FIG.

  Referring to FIG. 15, when a document creation application such as Notepad or Word (registered trademark) is being executed and a touch operation on operation panel 15 on which the display screen is displayed is detected (step In step S203, the CPU 10 requests the server 500 for transfer data. At this time, the CPU 10 transmits information specifying the touch position and information specifying the user who performed the operation to the server 500.

  When document data is transferred from the server 500 in response to this request (YES in step S205), in step S207, the CPU 10 displays the transferred data at the touch position.

  If the document creation application is not executed when a touch operation is detected, the application may be automatically activated in response to detection of the touch operation. Alternatively, the document creation application may be activated at the timing when the document data is transferred from the server 500. If user authentication is not performed when a touch operation is detected, user authentication may be performed by displaying an input screen at that timing, for example.

  When an operation of dragging from the display position of the transfer data is performed (YES in step S209), in step S211, the CPU 10 updates the screen display on the operation panel 15 so that the transfer data is displayed at the touch position. To do.

  When it is detected that the release operation is performed on the screen during execution of the application (YES in step S213), in step S215, the CPU 10 transfers the transfer data on the document data to be processed by the application in step S207. Alternatively, it is inserted at a position corresponding to the display position in step S211.

  Note that when the release operation is detected in step S213, the CPU 10 may notify the server 500 that the release operation has been performed. Using this notification as a trigger, information pinched in the server 500 can be deleted as will be described later.

  FIG. 16 is a flowchart showing an operation flow in server 500. The operation shown in the flowchart of FIG. 16 is realized by causing the PCU 50 to read out a program stored in the ROM 51 and execute it on the RAM 52 to exhibit the functions shown in FIG.

  Referring to FIG. 16, when pinching information is received from portable terminal 300 (YES in step S <b> 301), CPU 50 stores the pinching information in a predetermined area of memory 55 in step S <b> 303.

  Thereafter, when a transfer data request is received from MFP 100 (YES in step S305), in step S307, CPU 50 extracts target pinch information from memory 55 based on the information included in the request and includes the pinch information in the pinch information. Authentication processing is performed using the information to be received.

  Here, as an example, FIG. 13 shows the positional relationship between the screen edge that is the end of the drag on portable terminal 300 and the edge of the screen that is the touch position on MFP 100, as the users indicated by these information match. Check whether the relationship is satisfied.

  If the authentication in step S307 is successful (YES in step S309), the CPU 50 transfers the transfer data included in the pinching information to the MFP 100 in step S311.

  Thereafter, when it is notified that an operation of releasing from MFP 100 has been detected (YES in step S313), CPU 50 deletes the pinching information including the data transferred in step S311 from the predetermined area of memory 55 in step S315. This deletion may be performed after the data is transferred in step S311 or may be automatically performed after a predetermined period after the information pinched in step S303 is stored in the memory 55.

<Effect of Embodiment>
By performing the above operations in the image processing system, data can be exchanged between a plurality of devices by an intuitive and easy operation using an operation panel.

  In particular, by using the positional relationship as shown in FIG. 13, it is possible to transfer and paste data with continuous and intuitive operations so that the display screens of a plurality of devices are on one screen. Can be done.

<Modification 1>
In the above example, when the authentication based on the positional relationship between the user information and the touch position in the server 500 is successful, the designated data is transferred to any device.

  As another example in which the end of dragging in the operation of dragging to the screen edge after the pinching operation is used for authentication, the terminal and the transfer destination device may be associated with each other.

  In this case, the server 500 stores the relationship shown in FIG. 17 instead of the relationship shown in FIG. FIG. 17 is a diagram illustrating a specific example of the relationship between the drag end position in the transfer source device and the transfer destination device in the first modification. FIG. 18 is a diagram schematically illustrating the relationship between the drag end position and the transfer destination device.

  In the example shown in FIGS. 17 and 18, when transfer data is dragged to the left end of the screen at the transfer source device, the device 2 is specified as the transfer destination. Further, it is indicated that when the transfer data is dragged to the right end of the screen at the transfer source device, the device 4 is specified as the transfer destination. Further, it is indicated that when the transfer data is dragged to the upper end of the screen by the transfer source device, the device 3 is specified as the transfer destination. Further, it is indicated that when the transfer data is dragged to the lower end of the screen by the transfer source device, the device 5 is specified as the transfer destination.

  When the relationship between the end position of the drag indicated in the pinch information and the device that requested the transfer data satisfies the relationship shown in FIGS. 17 and 18, the server 500 stores the data included in the pinch information as successful authentication. Is transferred to the device. In this case, user authentication may not be performed.

  This also makes it possible to easily specify the transfer destination device and exchange data between the plurality of devices by an intuitive and easy operation using the operation panel.

  In addition, you may combine the relationship of FIG. 17 shown by the modification 1, and the relationship of FIG. 13 demonstrated above. That is, when a corresponding position of a designated device is touched, data may be transferred and displayed at that position. In this way, data can be transferred more intuitively.

<Modification 2>
In the above example, the transfer source device is described as the portable terminal 300 and the transfer destination device is the MFP 100 as an example, but the reverse, that is, the transfer source device is the MFP 100 and the transfer destination device is the mobile device. The terminal 300 may be used. Alternatively, it may be performed between two different portable terminals or between two different MFPs.

  Further, in the above description, it is assumed that transfer data is transferred between two devices via the server 500. However, if any device has the function of the server 500, data is transferred only between the two devices. May be forwarded. As an example, MFP 100 may include the function of server 500.

  In the above description, the screen edge is used as the drag end point and the touch position as an example, but the present invention is not limited to the screen edge, and a specific area on the screen may be used. As another example, a corner or near the center may be used.

  Further, it is possible to provide a program for causing MFP 100, portable terminal 300, and server 500 to execute the above-described operation. Such a program is recorded on a computer-readable recording medium such as a flexible disk attached to the computer, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. You can also Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  A program according to the present invention is a program module that is provided as a part of an operating system (OS) of a computer and that executes necessary processes by calling necessary modules in a predetermined arrangement at a predetermined timing. Also good. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

  The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  10, 30, 50 CPU, 11, 31, 51 ROM, 12, 32, 52 RAM, 13 Scanner, 14 Printer, 15, 34 Operation panel, 16, 33, 55 Memory, 17, 36, 54 Network controller, 35 Communication Controller, 101, 301, 501 input unit, 100 MFP, 102, 302 detection unit, 103 request unit, 104 reception unit, 105, 304 display unit, 106 processing unit, 300 portable terminal, 303 identification unit, 305 transmission unit, 500 Server, 502 storage unit, 503 request reception unit, 504 authentication unit, 505 transfer unit, 700 access point.

Claims (10)

Communication means for sending and receiving data to and from other devices;
A touch panel;
Processing means for executing processing according to the operation on the touch panel,
When the processing means receives a first operation including a drag operation to a predetermined area on the touch panel in a state where an object displayed on the touch panel is specified, at least data indicating the object is transmitted to the other device. An image processing device that transfers to   The image processing apparatus according to claim 1, wherein the processing unit transmits data indicating the object and information specifying the predetermined area to a server as the other apparatus. The processing means includes
A process of storing information including at least data indicating the object and information specifying the predetermined area;
When receiving a request to transfer data indicating the object from the other device, a process of authenticating whether transfer of data indicating the object is possible using information included in the request and the stored information;
The image processing apparatus according to claim 1, wherein when the authentication is successful, a process of transferring data indicating the object to the other apparatus is executed. The other device has a touch panel,
The request from the other device includes information for specifying an operation position on the touch panel of the other device,
The image processing apparatus according to claim 3, wherein the authentication performed by the processing unit includes authentication as to whether or not a relationship between the dragged predetermined area and the operation position is a predetermined relationship. The request from the other device includes information identifying the other device,
The authentication performed by the processing means is authentication of whether or not the dragged predetermined area corresponds to the other apparatus based on a correspondence relationship between the predetermined dragged predetermined area and the other apparatus. The image processing apparatus according to claim 3 or 4, comprising: The processing means includes
When receiving a second operation on the touch panel, a process of outputting a signal for requesting data transfer;
Processing to display the object indicated by the transferred data at the position designated in the second operation;
When a third operation on the touch panel is received while the object is displayed on the touch panel, a process of inserting the object at a position corresponding to the position where the object of the data to be processed is displayed is further executed. The image processing apparatus according to claim 1. Communication means for sending and receiving data to and from other devices;
A touch panel;
Processing means for executing processing according to the operation on the touch panel,
When the processing means receives a first operation on the touch panel, the processing means outputs a signal requesting data transfer to the other device;
A process of displaying an object indicated by data transferred from the other device at a position designated in the first operation;
When a second operation on the touch panel is received in a state where the object is displayed on the touch panel, a process of inserting the object at a position corresponding to the position where the object of the data to be processed is displayed is executed. , Image processing device. A method of transferring data between a first device and a second device each having a touch panel,
When a first operation including a drag operation to a predetermined area on the touch panel is received on the touch panel in a state where an object displayed on the touch panel of the first device is specified, data indicating the object is transferred And storing information including the data to be transferred,
When a second operation is received on the touch panel of the second device, outputting a signal requesting transfer of the data to be transferred;
Using the information contained in the requested signal and the stored information to authenticate the transferability of the data indicating the object;
If the authentication is successful, data indicating the object is transferred to the second device;
Displaying an object indicated by the transferred data at a position designated by the second operation on the touch panel of the second device;
When a third operation is received on the touch panel of the second device in a state where the object is displayed on the touch panel of the second device, the object of the data to be processed is positioned at a position corresponding to the position where the object is displayed. And a step of inserting an object. A program for causing a computer to execute data transfer processing from a first device having a touch panel,
Sent from the first device by receiving a first operation including a drag operation up to a predetermined area on the touch panel in a state where an object displayed on the touch panel of the first device is specified. Receiving information including at least data indicating the object and information identifying the predetermined area;
Receiving a data transfer request indicating the object from a second device;
Authenticating whether or not transfer of data indicating the object is possible using information included in the request from the second device and information from the first device;
A transfer program causing the computer to execute a step of transferring data indicating the object from the first device to the second device when the authentication is successful. A program for causing a device having a touch panel to execute data transfer processing,
Receiving a first operation on the touch panel, outputting a signal requesting data transfer to another device;
Receiving an object indicated by data transferred from the other device;
Displaying an object indicated by the received data at a position designated in the first operation;
Receiving the second operation on the touch panel in a state where the object is displayed on the touch panel, and inserting the object at a position corresponding to the position where the object of the data to be processed is displayed A transfer program to be executed.

Images