JP2014165652A - Data conversion device, data providing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable content displayed on a display unit to be easily reutilized.SOLUTION: A data conversion device comprises: display means that selectably displays data on a screen; selection means that selects predetermined data from the data displayed on the screen; extraction means that extracts data corresponding to display content on the screen related to the selected predetermined data; and communication means that transmits the extracted data.

Description

  The present invention relates to a data conversion device, a data providing method, and a program.

  For example, the image forming apparatus is provided with a display unit that displays internal image data, text data, or data obtained from an external device via a network. Various services have been proposed using data displayed on the display unit.

  For example, Patent Document 1 discloses a configuration in which character input to a multifunction device is performed using a mobile phone or a portable terminal or remote control is performed for the purpose of improving character input efficiency when the panel of the multifunction device is small. ing.

  Also, in Patent Document 2, a portable terminal and a multifunction device are provided for the purpose of sending the contents displayed on the portable terminal to the multifunction device for printing, or sending a file in the multifunction device to the portable device. A cooperating configuration is disclosed.

  Further, Patent Document 3 discloses a configuration in which a portable terminal and a multifunction peripheral cooperate in order to send address book data stored in the multifunction peripheral to the portable terminal.

  However, the above proposal has a problem that the content displayed on the display unit cannot be used for purposes other than display.

  For example, in Patent Documents 1 to 3, there is no use other than visually recognizing the contents displayed on the multifunction peripheral or the contents to be informed to the user through the display.

  In one aspect, it is an object to easily reuse data displayed on a display unit.

According to one aspect,
A display means for selectively displaying data on the screen;
Selecting means for selecting predetermined data from the data displayed on the screen;
Extraction means for extracting data corresponding to the display content of the screen related to the selected predetermined data;
A communication means for transmitting the extracted data;
There is provided a data conversion device characterized by comprising:

  According to one proposal, the contents displayed on the display unit can be easily reused.

An example of a display unit of a multifunction machine. An example of using the display unit of a multifunction device. An example of using the display unit of a multifunction device. Example 1 of using data displayed on a display unit of a multifunction peripheral according to an embodiment. Example 2 of using data displayed on a display unit of a multifunction peripheral according to an embodiment. 2 is an internal configuration example of a multifunction peripheral according to an embodiment. The flowchart for performing the data provision process which concerns on one Embodiment. The flowchart for performing the initialization process which concerns on one Embodiment. 6 is a flowchart for executing selection / transmission processing according to an embodiment. The specific example of the selection / transmission process which concerns on one Embodiment. The specific example of the selection / transmission process which concerns on one Embodiment. The specific example of the selection / transmission process which concerns on one Embodiment. The specific example of the selection / transmission process which concerns on one Embodiment. The specific example of the selection / transmission process which concerns on one Embodiment. An example in which display data and identification data according to an embodiment are stored in association with each other. The specific example of the selection / transmission process which concerns on one Embodiment. The information acquisition example of the data format which concerns on one Embodiment. The hardware structural example of the data converter which concerns on one Embodiment.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described with reference to the accompanying drawings. In addition, in this specification and drawing, about the substantially same structure, the duplicate description is abbreviate | omitted by attaching | subjecting the same code | symbol.

<Introduction>
Usually, an image forming apparatus is provided with an operable display unit. FIG. 1 shows a display unit 11 of a multifunction machine 10 as an example of an image forming apparatus. The display unit 11 displays internal image data, text data, or data obtained from an external device via a network.

  However, even if useful data exists on the displayed screen, if it cannot be received as data, its value as information is scarce. One example will be described with reference to FIG. It is assumed that the telephone number of the order destination is displayed on the display unit 11 when the toner runs out of the multifunction device 10. In the figure, telephone numbers, URLs, e-mail addresses, and what toner has run out are displayed as useful data. However, in order to utilize this data, the user U looks at the telephone number of the display unit 11 and inputs the telephone number to the mobile device such as the smartphone 12a or a mobile phone (not shown), and what toner has run out. You have to decipher and order. That is, the user U cannot easily reuse the data displayed on the display unit 11.

  In addition, as shown in FIG. 3, when the website is displayed on the display unit 11, when the user U makes a store reservation, information such as a telephone number must be visually input. . That is, the user U cannot easily reuse data as useful information displayed on the display unit 11.

  Therefore, in the image forming apparatus according to the present embodiment, in a state where information that can be used by the user is displayed on the display unit, the information is displayed so as to be selectable by the user. It can be easily transferred to the destination device. Thereby, the data displayed on the display unit can be easily reused in the transmission destination device. Specific examples of use are shown below.

(Usage example 1)
As usage example 1, useful information is displayed on the screen of the display unit 11 as shown in FIG. In this state, the user U performs an operation of transferring to a destination device such as the smartphone 12a, in this case, a flick. For example, when the user U selects and flicks the telephone number portion, the telephone number is transferred to the smartphone 12a. If the object to be flicked by the user U is a URL, the URL is transferred to the smartphone 12a.

  Further, when the user U flicks “please order” shown in FIG. 4, information including a command (request) to send out the toner and paper information in a lump in a batch is transferred to the smartphone 12a. .

(Usage example 2)
As Usage Example 2, as shown in FIG. 5, information that the user U determines is useful information is selected from the screen of the display unit 11, and a flick operation is performed. In this way, the user U can pass information to a destination device (hereinafter also referred to as an external device) such as a mobile device by a simple operation of “selection” and “flick”. Note that the operation of transmitting information to the external device is not limited to a flick, and may be a double tap or other operations, for example.

  As described above, in the present embodiment, information selected by the user U can be easily transferred to the transmission destination device in a state in which the data that the user U wants to use is selectably displayed on the display unit 11. Thereby, the data displayed on the display unit can be easily reused in the transmission destination device. Thus, for example, in the past, when the toner out occurred, when the telephone number, URL, or mail address of the ordering party is displayed, the displayed contents are visually checked, and a memo is manually entered or data is input. However, in this embodiment, it can be easily accessed by specifying the displayed data and transmitting it as electronic data to a smartphone or tablet. Hereinafter, the image forming apparatus according to the present exemplary embodiment will be described in detail with the MFP 10 as an example.

[Internal configuration of MFP]
First, an internal configuration of the multifunction machine 10 according to an embodiment will be described with reference to FIG. FIG. 6 shows an internal configuration of the multifunction peripheral according to the embodiment.

  The multifunction machine 10 includes a display unit 21, an operation unit 22, a control unit 23, an image input unit 24, an image output unit 25, an editing unit 26, a primary storage unit 27, a secondary storage unit 28, a conversion unit 29, and an electronic determination. Means 30, communication means 31, selection means 32, and extraction means 33 are provided.

  The display means 21 displays data selectably on the screen of the display unit 11 provided in the multifunction machine 10.

  The operation means 22 controls input / output to / from a touch panel type operation screen stacked on the display unit 11. The user operates the operation unit 22 to select data to be extracted from the display data, and requests transmission to an external device such as a smartphone.

  The control means 23 makes a control request to each means. For example, the control unit 23 makes a control request to the selection unit 32 and the extraction unit 33. The selection means 32 selects predetermined data from the data displayed on the screen. The extracting means 33 extracts data corresponding to the display content of the screen related to the selected predetermined data.

  The control means 23 performs extraction control of the extracted data. The control unit 23 adds a request process to the external device. The control means 23 acquires a data format that can be supported by an external device that is a destination device. The control means 23 performs conversion control so as to be compatible with external devices. The control means 23 performs control for determining the identification data. The control means 23 identifies that the data is in accordance with the displayed alert to the user, and controls data transmission in accordance with the data.

  The image input unit 24 inputs an image. The image output means 25 outputs an image.

  The editing unit 26 performs editing operations such as enlargement / reduction, rotation, printing, and image composition on the image.

  The primary storage unit 27 temporarily stores storage for image processing and processing control. The primary storage means 27 holds setting data and primary data. The primary storage means 27 is also used during image conversion.

  The secondary storage means 28 is used to keep holding images and setting related data. The secondary storage means 28 is also used to hold a compatible data format.

  The conversion means 29 converts the extracted data into a designated data format. The conversion means 29 converts the data into a data format that can be processed by the external device.

  The digitization determination means 30 determines which digitization is possible for the extracted data or which digitization is appropriate for the extracted data. The computerization determination means 30 determines appropriate command data suitable for the destination device from the selected data. The computerization determination unit 30 determines appropriate data conversion according to the destination device. The computerization determination unit 30 determines data conversion in accordance with the displayed instruction information.

  The communication unit 31 communicates with an external device, and transmits selected data and extracted data. The communication means 31 exchanges data in a data format that can be processed by an external device. For example, the communication unit 31 transmits or receives digitized data to and from the smartphone 12a, the multifunction device 12b, the tablet device 12c, the PC 12d connected via the Internet, and the like as an example of the external device. The smartphone 12a, the multifunction machine 12b, and the like are examples of external devices that transmit or receive digitized data, and any device that has a communication function can be an external device.

  The multifunction machine 12b receives from the multifunction machine 10 data that can be processed by the multifunction machine 12b by transmitting image format data that can be handled by the multifunction machine 12b itself and identification data of the multifunction machine 12b to the multifunction machine 10. can do.

  The tablet device 12c combines the data that can be processed by the tablet device 12c by transmitting image format data that can be handled by the tablet device 12c itself and identification data of the tablet device 12c itself to the multifunction device 10. Can be received from the machine 10.

  The smartphone 12 a can receive data that can be processed by the smartphone 12 a by transmitting image format data that the smartphone 12 a itself can handle and identification data of the smartphone 12 a itself to the multifunction device 10.

  The PC 12d connected to the Internet transmits image format data that can be handled by the smartphone 12a, the multifunction device 12b, and the tablet device 12c to the multifunction device 10. Thereby, data which can be processed by the smartphone 12a, the multifunction machine 12b, and the tablet device 12c can be created and transmitted to each machine.

[Data provision processing]
Next, data providing processing according to the present embodiment will be described with reference to FIG. FIG. 7 is a flowchart showing data providing processing according to the present embodiment. In the data providing process according to the present embodiment, first, an initialization process is performed (step S10). Details of the initialization process will be described later with reference to FIG.

  Next, a selection / transmission process is performed (step S12), and this process ends. Details of the selection / transmission process will be described later with reference to FIG.

  Note that the data selected or extracted by the above processing can be transmitted to an external device. Thereby, the data displayed on the display unit 11 so as to be selectable can be easily used in devices other than the multifunction machine 10.

(Initialization process)
Details of the initialization process in step S10 will be described with reference to FIG. In the initialization process, first, the control means 23 determines whether or not to add command data corresponding to text data automatically (step S101). When it is determined that the instruction data is added, the control unit 23 performs control for adding the instruction (step S103). The extraction means 33 extracts data corresponding to the content of the data selected from the screen and adds it to the selected data. If it is determined that no instruction data is added, the process proceeds to step S103.

  Next, the control means 23 determines whether to acquire a data format corresponding to an external device such as the smartphone 12a to be connected (step S103). When it is determined that the data format is to be acquired, the conversion unit 29 acquires and holds the corresponding data format from the external device (step S104), and ends this process. If it is determined that the data format is not acquired, this processing is terminated.

(Selection and transmission processing)
Next, details of the selection and transmission processing in step S12 will be described with reference to FIG. First, the display means 21 displays data on the screen of the display unit 11 (step S121). Data on the screen is stored in association with identification data.

  Next, the selection means 32 determines whether display data has been selected (step S122). If it is determined that no display data has been selected, the process returns to step S121. If it is determined that display data has been selected, the process proceeds to step S123.

  Next, the extraction unit 33 determines the type of the selected data (step S123). If it is determined that the selected data type is text, the process proceeds to step S124. If the selected data type is an image, the process proceeds to step S127. If the selected data type is an instruction, step S129 is performed. Proceed to

  Processing for determining the type of the selected data will be specifically described with reference to FIGS. Here, browsing data displayed on the display unit 11 is taken as an example. In the case of browsing, display processing is performed using html tag information. For this reason, the selected data is associated with the tag information. This makes it possible to distinguish the selected data from text data, images, or URLs.

  In FIG. 10, the data selected by the touch operation Ab by the user U is associated with the tag information Bb. In the tag information Bb, the selected data “complete private room all-you-can-drink 2000 yen course” is the html tag information (wrapped with a body tag), and therefore the selected data is determined to be text data.

  In FIG. 11, the data selected by the touch operation Ab by the user U is associated with the tag information Bc. In the tag information Bc, since the selected data is html tag information (included in an imgh tag), it is determined that the selected data is image data.

  When the type of data selected in step S123 is text, the extraction unit 33 determines the type of text data (step S124). Next, the extracting unit 33 determines whether or not to add an instruction to the destination device such as the smartphone 12a that matches the type of text data to the selected data (step S125).

  As a specific determination method, for example, the format of text data is identification of a data format such as a telephone number, a URL, or an e-mail address. When the display unit 11 is an operation screen or a warning screen, it is possible to identify what type of text data, even text data, by looking at the attribute data. For example, even if it is determined that the text data is a telephone number if the text data is composed only of numbers and the leading number matches the station-specific or toll-free (for example, “0120-1234-567”) number. Good.

  Also, for example, if it contains “@” and consists only of alphanumeric characters that are accepted in the email address (for example, “abc@defg.com”), or if it contains data such as “@” in full-width, The text data may be determined to be an email address.

  For example, if the text data starts with http or http: // (for example, “http://abc.com”), the text data may be determined to be a URL.

  However, since browsing does not add attributes to text data, the type of text data is identified from the contents of the text data.

  If it is determined in step S125 that an instruction to the destination device is not added to the selected text data, the process proceeds to step S130. On the other hand, if it is determined to be added, the extraction unit 33 adds a request to the destination device that matches the type of text data to the selected text data (step S126), and proceeds to step S130.

  When the type of the selected data is an image, the conversion unit 29 determines whether the selected data (image data) can be used by the connected device (step S127). If it is not available, the conversion means 29 converts the selected image data into an appropriate image format in accordance with the stored data format (step S128), and proceeds to step S130. If it is available, the process proceeds to step S130.

  If the type of the selected data is an instruction, the conversion means 29 converts the data into request data that matches the selected instruction data (step S129), and proceeds to step S130.

  In step S130, the communication unit 31 transmits the selected data or the converted data to the connected device, and ends this process.

(Specific display example 1)
A specific display example to the external equipment value will be described with reference to FIG. Here, in the case where the type of data selected in step S123 is text, and it is determined in step S125 that an instruction to the destination device is not added, the selected data is transferred to the external device. A description will be given with an example displayed.

  A part of the data displayed on the display unit 11 of the multifunction machine 10 is selected and the transmission process is executed. Here, the user U selects the telephone number A of the display unit 11 displayed on the WEB browser, and executes the flick operation B toward the smartphone 12a. As a result, data (here, a telephone number) selected by the connected external device, here the smartphone 12a, is transmitted. In this example, since the transmission is only executed, the telephone number is transmitted to the smartphone 12a as text data.

  An example of the selection method of the display unit 11 will be described with reference to FIG. Here, the user U performs the long press operation Aa once at the display location to be selected, and then selects the desired range again by the touch operation Ab. Here, a selection process is performed by designating a range of text data (phone number).

  Another example of the selection method of the display unit 11 will be described with reference to FIG. There is a hard key 13 as an operation unit adjacent to the display unit 11, and a button 13 a for holding a selected state is provided in the hard key 13. By performing the operation Ac in which the user U presses the button 13a, it is possible to make a selection from a desired position by the touch operation Ab. Alternatively, if the hard key 13 is kept pressed, the selection mode is set, and when the user U touches the touch panel, the touched portion may be selected.

(Specific display example 2)
A specific display example for the external equipment value will be described with reference to FIGS. 15 and 16. Here, a warning screen for running out of toner in the operation screen is taken as an example. In browsing, display data is constructed based on html tag information for using the Internet, but the display data to be displayed on the display unit 11 is not necessarily text data even if it is recognized as a character when viewed by the user.

  Therefore, identification data is associated with each display data displayed on the display unit 11 and stored in the primary storage unit 27 or the secondary storage unit 28. This association may be performed by a method similar to that of the html tag or by an original processing method. As a result, if a portion that appears as “character” is selected from the display unit 11, the text is displayed. Further, data indicating “instruction” can be handled as “instruction” data. That is, the determination for step S123 in FIG. 9 can select one or a plurality of data types.

  For example, in FIG. 15, identification data I <b> 1 to I <b> 14 associated with the display data P <b> 1 to P <b> 14 are stored in the secondary storage unit 28 for each display data P <b> 1 to P <b> 14 of the display unit 11.

  As shown in FIG. 15, the identification data I <b> 1 to I <b> 14 includes data indicating what attributes the display data P <b> 1 to P <b> 14 indicates as well as the types of the display data P <b> 1 to P <b> 14. Therefore, for example, when “please order” of the display data P2 is selected, the attribute data of the identification data I2 associated with the display data P2 is “instruction”, so the process of step S129 of FIG. Is executed. That is, the conversion unit 29 performs control to extract necessary data from the data displayed on the display unit 11, and generates data to be transmitted to an external device such as the smartphone 12a.

  In FIG. 16, from the displayed data, AC / AK, which is a Cyan / Black toner model for which toner has run out, and e-mail address information as the order destination are transmitted to the smartphone 12a. Generated as data. If a request to the smartphone 12a is necessary, a command for requesting activation of an application of the mail service is also transmitted at the same time as data transmitted to the smartphone 12a. Thereby, on the smartphone 12a side, an application of the mail service is activated in response to the transmitted command, the order destination is set as the transmission destination, for example, “toner order <information on the MFP”> is displayed in the subject, An e-mail in which the model number of the broken toner is written can be sent.

  As for conversion of a data format that can be used by an external device, for example, as shown in FIG. 17, the multifunction device 10 receives a data format that can be processed by the external device when connected. It is stored in the next storage means 28.

  For example, the smartphone 12a can receive data in a data format of Jpeg, Gif, MP3, and MP4. The multifunction machine 12b can receive data in the data format of TIFF and Jpeg. The tablet device 12c can receive data in a data format of Jpeg, Gif, Png, MP1, MP3, and MP4.

  The multifunction device 10 can also receive a data format from data of each external device provided from the Internet.

  As described above, according to the image forming apparatus according to the present embodiment, the data displayed on the display unit 1 can be used immediately on the external device. For example, according to the image forming apparatus according to the present embodiment, the contents of selected data or extracted data can be identified. Thereby, it is possible to perform pre-transmission processing by identifying whether the extracted data is text or image.

  Further, according to the image forming apparatus according to the present embodiment, it is possible to automatically add a request to an external device in accordance with the selected data. As a result, when it is determined that the telephone number is to be transmitted, the telephone application can be activated on the external device accordingly.

  Further, the image forming apparatus according to the present embodiment holds a data format that can be processed by an external device. Therefore, the selected data can be converted into a data format that can be used by the external device according to the data format that can be processed. For example, when the image forming apparatus according to the present embodiment selects and transmits a Png image as a photographic image on the Web, and the data format is not processable by the external device, for example, a Jpeg image that can be processed by the external device. It can be converted to and sent.

  In addition, according to the image forming apparatus according to the present embodiment, data that can identify the type of display data is stored in the storage unit in association with the data displayed on the display unit 11. Thereby, since the data displayed on the display unit 11 are not necessarily text as text, the type of display data can be identified.

  Further, according to the image forming apparatus according to the present embodiment, when the selected display data is the instruction information, the optimum information along the instruction information is transmitted to the external device. As a result, if the screen is out of toner, the data displayed on the display unit 1 can be used immediately by an external device, such as text information on toner out, etc., and ordering by mail immediately.

  In the above-described embodiment, a multifunction peripheral is described as an example of an image forming apparatus. However, the image forming apparatus is an example of a data conversion apparatus. The data conversion apparatus is not limited to a multifunction peripheral, and is a printer or a FAX apparatus. Any device that has a communication function in a multifunction peripheral, an information processing apparatus, or the like may be used.

[Hardware configuration example]
Finally, a hardware configuration example of the data conversion apparatus according to the embodiment will be described with reference to FIG. The data conversion apparatus according to the present embodiment has a CPU 106 built therein. A program for realizing each function executed by the CPU 106 (computer) may be stored in advance in storage means such as the ROM 104, the RAM 105, or the HDD 108. The storage means of the primary storage means 27 or the secondary storage means 28 is realized by the RAM 104 or the HDD 108, and may store display data and identification data.

  The program may be recorded on a recording medium such as a CD-ROM or a non-volatile recording medium (memory) such as a flexible disk, SRAM, EEPROM, or memory card.

  The function of the data conversion apparatus according to the present embodiment can be realized by causing the CPU 106 to execute a program recorded in a storage unit such as the ROM 104 or the HDD 108. The functions of the control unit 23, the editing unit 26, the conversion unit 29, the computerization determination unit 30, the selection unit 32, and the extraction unit 33 can be realized as functions of the CPU 106.

  Furthermore, the program can be downloaded from an external device connected to the IP network 110 using the function of the communication circuit 103 and having a recording medium recording the program or an external device storing the program in a storage means. The function of the communication unit 31 can be realized as a function of the communication circuit 103.

  The keyboard 101 is an example of an input device, and is used to input each operation signal to each device. The input device can use a mouse or a touch panel instead of the keyboard 101. The operation means 22 and the image input means 24 can be realized as functions of an input device.

  The display 102 (corresponding to the display unit 11) is an example of a display device, and displays a processing result by each device. The display means 21 can be realized as a function of the display device.

  The speaker 107 is an example of an output device, and is used to output each operation signal to each device. A display device such as the display 102 is an example of an output device.

  The preferred embodiments of the data conversion apparatus, the data providing method, and the program according to the present invention have been described in detail above with reference to the accompanying drawings, but the technical scope of the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present invention can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it belongs to the technical scope of the data conversion device, data providing method and program according to the present invention. In addition, when there are a plurality of the above-described embodiments and modifications, they can be combined within a consistent range.

  For example, the means for extracting the data corresponding to the display content of the screen related to the selected predetermined data may extract the data on the screen related to the selected data, or the related display Content data may be extracted. The extracting means may extract the selected data itself, or may extract data for ordering the selected data. Moreover, those combinations may be sufficient.

  10: MFP, 11: display unit, 12a: smartphone, 12b: MFP, 21: display unit, 22: operation unit, 23: control unit, 24: image input unit, 25: image output unit, 26: editing unit 27: primary storage means, 28: secondary storage means, 29: conversion means, 30: digitization determination means, 31: communication means, 32: selection means, 33: extraction means

JP 2012-93877 A Japanese Patent No. 3977392 JP 2006-211142 A

Claims (9)

A display means for selectively displaying data on the screen;
Selecting means for selecting predetermined data from the data displayed on the screen;
Extraction means for extracting data corresponding to the display content of the screen related to the selected predetermined data;
A communication means for transmitting the extracted data;
A data conversion device comprising: The extraction means extracts data according to the content of the selected predetermined data and adds it to the selected data.
The data conversion apparatus according to claim 1, wherein the communication unit transmits the selected data with the extracted data added thereto. Furthermore, it has conversion means for converting the extracted data into a data format that can be processed by the destination device,
The data conversion apparatus according to claim 1, wherein the communication unit transmits the converted data.   4. The data conversion apparatus according to claim 3, wherein the conversion unit acquires a data format that can be processed by the transmission destination device from the transmission destination device.   The said extraction means transmits the starting request | requirement of the application for utilizing the said extracted data to the said apparatus of the transmission destination with the said extracted data, The Claim 1 characterized by the above-mentioned. The data converter described. And storage means for storing information for identifying the type of the selected data in association with the selected data.
The extraction means adds data according to the selected predetermined data type.
The data conversion device according to any one of claims 2 to 4, wherein The selection means selects a part of the data displayed on the screen,
The data conversion apparatus according to claim 1, wherein the data conversion apparatus is a data conversion apparatus. Processing to display data selectably on the screen;
A process of selecting predetermined data from the data displayed on the screen;
A process of extracting data corresponding to the display content of the screen related to the selected predetermined data;
A process of transmitting the extracted data;
A data providing method executed by a computer. Processing to display data selectably on the screen;
A process of selecting predetermined data from the data displayed on the screen;
A process of extracting data corresponding to the display content of the screen related to the selected predetermined data;
A process of transmitting the extracted data;
A program that causes a computer to execute.

Images