JP2023026892A - Information processing device and information processing program - Google Patents

Abstract

To provide an information processing device and an information processing program that enable a first touch panel 1 of an information processing device 10 to be operated through a second touch panel 2 of a portable terminal 20 without being restricted even by a difference in size that the first touch panel 1 and second touch panel 2 have.SOLUTION: There is provided an information processing apparatus that comprises a processor, which establishes radio communication between the apparatus and a portable terminal that a user owns, and associates a second touch panel of the portable terminal as a pointer moving device used to move a pointer on a screen of a first touch panel of the apparatus.SELECTED DRAWING: Figure 1

Description

The technology of the present invention relates to an information processing device and an information processing program.

There is a technology for operating a touch panel terminal from another touch panel terminal.

In Patent Document 1, touch operation information relating to an operation to touch a touch panel terminal is received from a first touch panel terminal and a second touch panel terminal, and the first touch panel terminal is specified based on the touch operation information. When the operation rhythm and the operation rhythm of the second touch panel terminal are similar, the touch panel terminal linking device is characterized by linking the first touch panel terminal and the second touch panel terminal, is disclosed.

Patent Document 2 discloses a reading start instruction for instructing the start of reading an image, and transmission destination information, which is information used to send image data obtained by reading the image to the own device. A wireless portable terminal characterized by having a terminal-side communication unit for transmitting to an image reading device is disclosed.

JP 2015-115032 A JP 2015-106344 A

An unspecified number of users may directly operate a touch panel of an information processing apparatus by hand. As such an information processing apparatus, for example, there is a multi-copier installed in a convenience store or the like. Here, users who are concerned about surface hygiene hesitate to directly touch and operate the touch panel of the information processing apparatus.

In relation to this, there is a technique in which an image of a touch panel of an information processing device is displayed on a touch panel of a mobile terminal owned by a user, and the information processing device is operated indirectly according to an operation of the touch panel of the mobile terminal.

However, even with the above technique, if there is a difference in size between the touch panel of the mobile terminal and the touch panel of the information processing apparatus, there will be restrictions due to the difference in size. For example, if the touch panel of the mobile terminal is smaller, the display of the touch panel of the information processing device may be reduced or part of the display may not fit on the screen.

Even if there is a difference in size between the first touch panel of the information processing device and the second touch panel of the portable terminal, the present invention is not restricted by the difference in size, and the second touch panel can be used. It is an object of the present invention to provide an information processing device and an information processing program capable of operating a first touch panel through a device.

An information processing apparatus according to a first aspect includes a processor, the processor establishes wireless communication between the apparatus and a mobile terminal owned by a user, and controls the second touch panel of the mobile terminal to the The pointer on the screen of the first touch panel of the own device is linked as a pointer moving device capable of moving operation.

An information processing apparatus according to a second aspect is the information processing apparatus according to the first aspect, wherein the processor moves the pointer displayed on the screen of the first touch panel by tracing the surface of the second touch panel with a finger. The mobile terminal and the own device are linked so that they can be operated.

An information processing apparatus according to a third aspect is the information processing apparatus according to the first aspect or the second aspect, wherein the processor reads a readable identification code displayed on the second touch panel, and reads the read identification code. establishes wireless communication between the self-device and the mobile terminal according to the information contained in the device.

An information processing apparatus according to a fourth aspect is the information processing apparatus according to the third aspect or the fourth aspect, wherein the processor displays a readable identification code on the first touch panel, and the mobile terminal displays the identification code. The information obtained by reading the code is used to establish wireless communication.

An information processing apparatus according to a fifth aspect is the information processing apparatus according to the first aspect or the second aspect, wherein the readable identification code is displayed as a two-dimensional barcode.

An information processing program according to a sixth aspect causes a computer to function as an information processing apparatus according to any one of the first to third aspects.

According to the first aspect and the sixth aspect, even if there is a difference in size between the first touch panel and the second touch panel, the information processing apparatus is operated without being restricted by the size difference. be able to.

According to the second aspect, the information processing apparatus can be operated by tracing the second touch panel of the mobile terminal with a finger.

According to the third aspect, the information processing device can be operated without touching the first touch panel.

According to the fourth aspect, wireless communication can be established using the barcode reader of the mobile terminal.

According to the fifth aspect, wireless communication can be established using the two-dimensional barcode.

1 is a schematic configuration diagram of an information processing system according to the present disclosure; FIG. 1 is a block diagram showing the hardware configuration of a multi-copier according to this embodiment; FIG. 1 is a block diagram showing a functional configuration of a multi-copier according to this embodiment; FIG. 5 is a flow chart showing the flow of cooperative processing of the multi-copier according to the present embodiment; It is an example showing a screen before pairing establishment of the multi-copier according to the present embodiment. It is an example showing a screen during establishment of pairing of the multi-copier according to the present embodiment. It is an example showing a screen after pairing establishment of the multi-copier according to the present embodiment. It is an example showing a touch operation information table without tapping of the multi-copier according to the present embodiment. It is an example showing a touch operation information table with a tap of the multi-copier according to the present embodiment. It is a block diagram which shows the hardware constitutions of the smart phone which concerns on this embodiment. It is a block diagram showing a functional configuration of a smart phone according to the present embodiment. 6 is a flowchart showing the flow of cooperation processing of a smartphone according to the embodiment; It is an example which shows the screen before pairing establishment of the smart phone which concerns on this embodiment. It is an example which shows the screen during establishment of pairing of the smart phone which concerns on this embodiment. It is an example which shows the screen after pairing establishment of the smart phone which concerns on this embodiment.

An example of an embodiment of the technique of the present invention will be described below with reference to the drawings. In each drawing, the same or equivalent components and portions are given the same reference numerals. Also, the dimensional ratios in the drawings are exaggerated for convenience of explanation, and may differ from the actual ratios.

FIG. 1 is a schematic configuration diagram of an information processing system of the present disclosure. FIG. 1 shows how communication is established between an information processing device 10 and a mobile terminal 20 . In this embodiment, a case where a multi-copier is used as the information processing apparatus 10 will be described, and reference numeral 10 is used for the multi-copier. Similarly, in this embodiment, a case where a smart phone is used as the mobile terminal 20 will be described, and reference number 20 is used for the smart phone.

The multi-copier 10 is an image forming apparatus capable of executing processes such as printing, copying, scanning, facsimile, etc. by user's operation. The multi-copier 10 includes a first touch panel 1 and receives user operations via the first touch panel 1 . That is, the multi-copier 10 accepts a touch operation on the first touch panel 1 and executes processing according to the coordinates of the touch operation. The multi-copier 10 establishes communication including wireless communication with the smart phone 20 described later.

The smartphone 20 is a terminal device owned by a user. As the mobile terminal 20, for example, a tablet terminal, a notebook computer, or the like may be used. The smartphone 20 includes a second touch panel 2 and receives user operations via the second touch panel 2 . As will be described later, the multi-copier 10 is operated by operating the second touch panel of the smartphone 20 .

FIG. 2 is a block diagram showing the hardware configuration of the multi-copier 10. As shown in FIG. The multi-copier 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a storage 14, an input section 15, a display section 16, and a communication interface (communication I/F) 17. and an image forming unit 18 . Each component is communicatively connected to each other via a bus 19 .

The CPU 11 is a central processing unit that executes various programs and controls each section. That is, the CPU 11 reads a program from the ROM 12 or the storage 14 and executes the program using the RAM 13 as a work area. The CPU 11 performs control of the above components and various arithmetic processing according to programs recorded in the ROM 12 or the storage 14 . In this embodiment, the ROM 12 or the storage 14 stores an information processing program to be linked.

The ROM 12 stores various programs and various data. The RAM 13 temporarily stores programs or data as a work area. The storage 14 is configured by a HDD (Hard Disk Drive) or SSD (Solid State Drive), and stores various programs including an operating system and various data.

The input unit 15 includes a pointing device such as a mouse and a keyboard, and is used for various inputs. The input unit 15 is, for example, a barcode reader capable of reading a two-dimensional barcode or the like.

The display unit 16 is, for example, a liquid crystal display, and displays various information. The display unit 16 is the first touch panel 1 and may function as the input unit 15 .

The communication interface 17 is an interface for communicating with other equipment such as a database, and uses standards such as Ethernet (registered trademark), FDDI, and Wi-Fi (registered trademark), for example.

The image forming unit 18 forms print data on a recording medium such as paper. As a method for forming an image, an electrophotographic method, an inkjet method, or the like is adopted.

FIG. 3 is a block diagram showing an example of the functional configuration of the multi-copier 10. As shown in FIG. The multi-copier 10 has a terminal information reading section 101, a touch operation information receiving section 102, a print data receiving section 103, a print data management section 104, and a print data output section 105 as functional configurations. Each functional configuration is realized by the CPU 11 reading an information processing program stored in the ROM 12 or the storage 14, developing it in the RAM 13, and executing it.

Terminal information reading unit 101 reads pairing information from a readable identification code. A readable identification code is, for example, a two-dimensional barcode including a QR code (registered trademark). Pairing is to perform mutual authentication between two devices and establish wireless communication. Pairing information is information used to establish pairing. Note that in the present embodiment, pairing is used as one method of establishing wireless communication. That is, in the present embodiment, wireless communication is established between the multi-copier 10 and the smartphone 20 by pairing.

The touch operation information receiving unit 102 receives touch operation information including coordinates and presence/absence of tapping. As a specific example of the touch operation information, a touch operation information table will be described later with reference to FIGS. 8 and 9. FIG.

The print data receiving unit 103 receives print data in the smart phone. Print data is data used for processing such as printing, copying, scanning, and facsimile.

A print data management unit 104 manages print data in the multi-copier.

A print data output unit 105 outputs print data in the multi-copier.

Next, operation of the multi-copier 10 will be described.
FIG. 4 is a flow chart showing the flow of cooperative processing by the multi-copier 10. As shown in FIG. The cooperation process is performed by the CPU 11 reading out the cooperation program from the ROM 12 or the storage 14, developing it in the RAM 13, and executing it.

In step S110, the CPU 11 causes the multi-copier 10 to read the two-dimensional barcode of the smart phone. For example, the CPU 11 causes the first touch panel 1 to display a screen before pairing is established, as shown in FIG. Then, the CPU 11 may display the procedure and leads for reading the two-dimensional barcode on the screen before pairing is established. For example, the CPU 11 displays the location and procedure for reading the two-dimensional barcode on the screen before pairing is established. The CPU 11 proceeds to step S111.

In step S<b>111 , the CPU 11 determines whether or not there are 0 paired smartphones 20 . A paired smartphone 20 is a smartphone 20 that has established pairing with the multi-copier 10 . When determining that the number of paired smartphones is 0 (step S111: YES), the CPU 11 proceeds to step S112. When determining that the number of paired smartphones is not 0 (step S111: NO), the CPU 11 terminates the cooperation process.

In step S112, the CPU 11 establishes pairing. That is, the CPU 11 establishes pairing using information obtained by reading the two-dimensional barcode. Further, when there is a smartphone with which pairing has already been established, the CPU 11 does not establish pairing with another smartphone in steps S111 and S112. Thereby, the CPU 11 prevents the already established pairing from being deleted or overwritten by another smartphone operation or the like. For example, the CPU 11 causes the first touch panel 1 to display a pairing establishment screen as shown in FIG. The CPU 11 proceeds to step S113.

At step S<b>113 , the CPU 11 displays the pointer 5 on the touch panel of the multi-copier 10 . For example, the CPU 11 causes the first touch panel 1 to display a screen after the pairing is established, as shown in FIG. Here, the pointer is information indicating the position of the operation target. In this embodiment, the pointer 5 indicates the coordinates on the screen of the first touch panel 1 with a hand mark. The CPU 11 proceeds to step S114.

In step S114, the CPU 11 causes the multi-copier 10 to receive the touch operation information from the smart phone. For example, the CPU 11 receives touch operation information described in the touch operation information table as shown in FIGS. 8 and 9 . The touch operation information table has a pairing identifier item, an X coordinate item, a Y coordinate item, and a tap item. The CPU 11 proceeds to step S115.
Here, the pairing identifier is information used to establish pairing. The pairing identifier item is, for example, a value for identifying connection, a value for identifying device, or an item indicating a pairing identifier such as a password. The X-coordinate item and the Y-coordinate item are items that indicate the position on the horizontal axis and the position on the vertical axis, respectively, on the touch panel. The tap item is an item that indicates 1 when the touch panel is tapped, and indicates 0 when the touch panel is not tapped. FIG. 8 is a touch operation information table without tapping, and FIG. 9 is a touch operation information table with tapping.

At step S115, the CPU 11 moves the pointer 5 on the first touch panel 1 of the multi-copier 10 by the coordinates. For example, when the CPU 11 receives "100" as the X coordinate item and "100" as the Y coordinate item, as shown in FIG. 100”, move to Y coordinate “100”. The CPU 11 proceeds to step S116.
Note that the X and Y coordinates may be coordinates relative to the current position of the pointer 5 . That is, when the CPU 11 receives "100" for the X coordinate item and "100" for the Y coordinate item, for example, the CPU 11 moves the pointer 5 on the first touch panel 1 of the multi-copier 10 rightward from the current position. "100" may be moved leftward to "100". Note that the unit of movement may be pixels, millimeters, or the like. Also, calculations may be performed on the received X-coordinates and Y-coordinates. For example, the X coordinate and the Y coordinate may be multiplied by a value corresponding to the size ratio between the first touch panel 1 of the multi-copier 10 and the second touch panel 2 of the smartphone 20 .

In step S116, the CPU 11 determines whether or not there is a tap in the touch operation information. When determining that there is a tap in the touch operation information (step S116: YES), the CPU 11 proceeds to step S117. When determining that there is no tap in the touch operation information (step S116: NO), the CPU 11 proceeds to step S118.
It should be noted that the CPU 11 may convert to a predetermined action when there are multiple types of taps. For example, the CPU 11 converts a double tap on the smart phone 20 into a single click.

In step S117, the CPU 11 clicks the pointer 5 on the touch panel of the multi-copier 10. FIG. That is, a process corresponding to the coordinates of the pointer 5 on the first touch panel 1 of the multi-copier 10 is executed. The CPU 11 proceeds to step S118.

In step S118, the CPU 11 determines whether to end the pairing. When determining to end the pairing (step S118: YES), the CPU 11 ends the cooperation process. When determining not to end the pairing (step S118: NO), the CPU 11 proceeds to step S114.
That is, the CPU 11 receives the touch operation information while establishing the pairing in steps S114 to S118, and executes processing corresponding to the touch operation information.

Through the above processing, the pointer on the screen of the first touch panel 1 of the multi-copier 10 is operated using the second touch panel 2 of the smartphone 20 . That is, the second touch panel 2 of the smart phone 20 is linked as a pointer movement device capable of moving the first touch panel 1 of the multi-copier 10 .

FIG. 10 is a block diagram showing the hardware configuration of smartphone 20. As shown in FIG. The smartphone 20 includes a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, a storage 24, an input unit 25, a display unit 26, and a communication interface (communication I/F) 27. have a configuration. Each component is communicatively connected to each other via a bus 29 .

The CPU 21 is a central processing unit that executes various programs and controls each section. That is, the CPU 21 reads a program from the ROM 22 or the storage 24 and executes the program using the RAM 23 as a work area. The CPU 21 performs control of the above components and various arithmetic processing according to programs recorded in the ROM 22 or the storage 24 . In this embodiment, the ROM 22 or the storage 24 stores an information processing program to be linked.

The ROM 22 stores various programs and various data. The RAM 23 temporarily stores programs or data as a work area. The storage 24 is composed of an HDD or SSD and stores various programs including an operating system and various data.

The input unit 25 includes a pointing device such as a mouse and a keyboard, and is used for various inputs. The input unit 25 is, for example, a barcode reader capable of reading a two-dimensional barcode or the like. A barcode reader uses, for example, a camera-related application to read a two-dimensional barcode.

The display unit 26 is, for example, a liquid crystal display, and displays various information. The display unit 26 is the second touch panel 2 and may function as the input unit 25 .

The communication interface 27 is an interface for communicating with other equipment such as a database, and uses standards such as Ethernet (registered trademark), FDDI, and Wi-Fi (registered trademark), for example.

FIG. 11 is a block diagram showing an example of the functional configuration of the smartphone 20. As shown in FIG. The smartphone 20 has a terminal information display unit 201, a touch operation information transmission unit 202, and a print data transmission unit 203 as functional configurations. Each functional configuration is realized by the CPU 21 of the smart phone 20 reading an information processing program stored in the ROM 22 or storage, developing it in the RAM 23 and executing it.
A terminal information display unit 201 displays pairing information including a two-dimensional barcode. The touch operation information transmission unit 202 transmits touch operation information. Specific examples of the touch operation information are shown in FIGS. 8 and 9 described above. A print data transmission unit 203 transmits print data in the smartphone 20 to the multi-copier.

Next, actions of the smartphone 20 will be described.
FIG. 12 is a flowchart showing the flow of cooperation processing by the smartphone 20. As shown in FIG. The cooperation process is performed by the CPU 21 reading out the cooperation program from the ROM 22 or the storage 24, developing it in the RAM 23, and executing it.

At step S210, the CPU 21 generates a pairing identifier. CPU21 transfers to step S211.

At step S211, the CPU 21 generates a two-dimensional barcode. For example, the CPU 21 causes the second touch panel 2 to display a screen before pairing is established, as shown in FIG. The CPU 21 displays a QR code (registered trademark) including pairing identifier information on the screen before pairing is established. Further, for example, the CPU 21 may display a place where the smartphone 20 is held over in order to read the QR code (registered trademark) on the screen before pairing is established. CPU21 transfers to step S212.

In step S212, the CPU 21 determines whether pairing with the multi-copier 10 is possible. If it is determined that pairing with the multi-copier 10 is possible (step S212: YES), the CPU 21 proceeds to step S213. When determining that pairing with the multi-copier 10 is possible (step S212: NO), the CPU 21 proceeds to step S216.

In step S213, the CPU 21 establishes pairing. For example, the CPU 21 may cause the second touch panel 2 to display a pairing establishment screen as shown in FIG. 14 while performing the process of establishing the pairing. CPU21 transfers to step S214.

In step S214, the CPU 21 displays the touch operation area. For example, the CPU 21 displays a screen after the pairing is established on the second touch panel 2, as shown in FIG. And CPU21 makes all or one part of the screen after pairing establishment a touch operation area. The CPU 21 may set, for example, a shape similar to the shape of the first touch panel 1 of the multi-copier 10 as the touch operation area. The CPU 21 may display an icon 6 to indicate the touch operation area. Also, the CPU 21 may use the icon 6 as a pointer. CPU21 transfers to step S215.

In step S<b>215 , the CPU 21 transmits touch operation information to the multi-copier 10 . CPU21 transmits the touch operation in the touch operation area|region as touch operation information. For example, the CPU 21 transmits touch operation information described in the touch operation information table as described above with reference to FIGS. 8 and 9 . For example, the CPU 21 receives an operation of tracing the surface of the second touch panel 2 by the user with a finger, and stores the operation information in the touch operation information table. Then, the CPU 21 transmits the operation information stored in the touch operation information table. CPU21 transfers to step S216.

In step S216, the CPU 21 determines whether to end the pairing. When determining to end the pairing (step S216: YES), the CPU 21 ends the cooperation process. When determining not to end the pairing (step S216: NO), the CPU 21 proceeds to step S215.
That is, the CPU 21 accepts a touch operation by the user and transmits touch operation information corresponding to the touch operation while pairing is being established in steps S114 to S118.

Through the above processing, the pointer on the screen of the first touch panel 1 of the multi-copier 10 is operated using the second touch panel 2 of the smartphone 20 . That is, the second touch panel 2 of the smart phone 20 is linked as a pointer movement device capable of moving the first touch panel 1 of the multi-copier 10 .

[Modification]
The multi-copier 10 of the first embodiment has been described above. However, the present disclosure is not limited to the above embodiments. Various improvements or modifications are possible.

The multi-copier 10 may generate a pairing identifier and display a two-dimensional barcode containing the pairing identifier. Then, the smartphone 20 may read the two-dimensional barcode displayed by the multi-copier 10 to establish pairing. Thereby, even if the multi-copier 10 does not have a barcode reader, pairing can be established using the barcode reader that the smartphone 20 has.

The smartphone 20 may switch screens after performing a predetermined operation. For example, when the touchpad 2 of the smartphone 20 is used to click the "print" function of the multi-copier 10 as shown in FIG. 7, the display unit 26 of the smartphone 20 transitions from the touchpad screen to the print data selection screen. Let

The smartphone 20 may display a software keyboard on the display unit 26 and cooperate as a keyboard of the multi-copier 10 . That is, the smart phone 20 transmits the input value of the software keyboard to the multi-copier 10 . Then, the multi-copier 10 executes processing using the transmitted software keyboard input values as keyboard input values.

The information processing apparatus according to the present disclosure may be, for example, a self-order terminal for restaurants, a Denmoku (electronic table of contents) for karaoke shops, an ATM (AUTOMATIC TELLER MACHINE), or the like. When the information processing device is a self-ordering terminal for a restaurant or a Denmoku for a karaoke shop, the CPU 11 does not need to execute the processing of step 111 in FIG. That is, the information processing device may cooperate with a plurality of smartphones 20 .

The above processing can also be realized by a dedicated hardware circuit. In this case, it may be executed by one piece of hardware, or may be executed by a plurality of pieces of hardware.

In the above-described embodiment, the processor refers to a processor in a broad sense, and includes general-purpose processors (eg, CPU: Central Processing Unit, etc.) and dedicated processors (eg, GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, Programmable Logic Device, etc.).

Further, the operation of the processor in the present embodiment may be performed not only by a single processor but also by cooperation of a plurality of physically separated processors. Also, the order of each operation of the processor is not limited to the order described in the present embodiment, and may be changed as appropriate.

In addition, the program for operating the multi-copier 10 may be provided by a computer-readable recording medium such as a USB (Universal Serial Bus) memory, a flexible disk, a CD-ROM (Compact Disc Read Only Memory), or via the Internet. may be provided online through a network such as In this case, the program recorded on the computer-readable recording medium is usually transferred and stored in a memory, storage, or the like. Further, this program may be provided, for example, as independent application software, or may be incorporated into the software of each device as one function of the multi-copier 10 .

1 first touch panel 2 second touch panel 5 pointer 6 icon 10 multi-copier 20 smartphone

Claims (6)

with a processor
The processor
establishing wireless communication between the device and a mobile terminal owned by the user;
An information processing apparatus that cooperates with the second touch panel of the mobile terminal as a pointer moving device capable of moving a pointer on the screen of the first touch panel of the own apparatus. The processor
2. The information processing apparatus according to claim 1, wherein the mobile terminal and the own apparatus are linked so that a pointer displayed on the screen of the first touch panel can be moved by tracing the surface of the second touch panel with a finger. . The processor
reading a readable identification code displayed on the second touch panel;
3. The information processing apparatus according to claim 1, wherein wireless communication between the own apparatus and the mobile terminal is established based on information included in the read identification code. The processor
displaying a readable identification code on the first touch panel;
3. The information processing apparatus according to claim 1, wherein the mobile terminal establishes wireless communication using information obtained by reading the identification code. 5. The information processing apparatus according to claim 3, wherein said readable identification code is displayed as a two-dimensional bar code. An information processing program for causing a computer to function as the information processing apparatus according to any one of claims 1 to 5.

Images