JP4978415B2 - Information selection acquisition system, information processing apparatus, information selection acquisition method, and information selection acquisition program - Google Patents

Description

  The present invention relates to an information selection / acquisition system, an information selection / acquisition method, and an information selection / acquisition program for designating part or all of information stored in an information processing apparatus and obtaining designated information.

When a user of a mobile terminal device acquires data stored in a personal computer (hereinafter referred to as “PC”) or the like with a mobile terminal device, it is common to specify and acquire desired data in units of files.
Here, for example, when it is desired to obtain a part of file data such as image data or text data stored in the PC, the file data is processed and edited in advance and only the necessary data portion is extracted. It was necessary to prepare.

  Also, for example, when the file data stored in the PC is file data written in a markup language such as an HTML file, file data generated by cutting out a part of the file data output and displayed on the display is generated. At the same time, when the file data is acquired by the portable terminal device and displayed on the portable terminal device, the displayed screen configuration may change from the original output display screen configuration.

  On the other hand, as a method for extracting and acquiring a part of the file data contents without changing the screen structure of the file data, a screen of information output and displayed on the display (hereinafter referred to as “output display information”) is a portable terminal. A method of acquiring a part of the contents of the file data as a photographed image by directly photographing with a camera built in the apparatus is conceivable.

  In addition, as a technique related to the above technique, a part of the screen of the display is photographed with a video camera, so that the screen area of the photographed display is designated as the content display area and is set in advance in the designated content display area. A technique for displaying the video content is disclosed (Patent Document 1).

JP-A-2005-242603

  However, as described above, when the data content of the file data displayed by directly photographing the display screen is acquired, the file data content displayed on the display is optically captured. Data cannot be acquired with the same quality as the data, and it is particularly difficult to avoid deterioration in the image quality of the acquired data.

Further, when the camera is photographing, there is a problem that the content of the original file data cannot be determined from the image information captured on the mobile terminal device side due to out-of-focus or camera shake.
Further, in this case, the content output and displayed on the display is captured as image information. Therefore, even if the content output and displayed on the display is text data, the text data is captured as image data and captured. The generated image data has a disadvantage that it becomes very large data as compared with the text information of the original file data.

  In addition, a part of the display screen of file data described in a markup language such as HTML is taken in by the mobile terminal device without destroying the configuration. This is difficult, and there is a disadvantage that a large burden is generated in creating and displaying file data in which necessary portions are extracted.

  The method disclosed in Patent Document 1 is a method for effectively designating an area for outputting and displaying video content on a display. Information stored in a PC and a part thereof are stored by this method. It cannot be acquired.

[Object of invention]
The present invention improves an inconvenience of the related technology, and an information selection acquisition system, an information processing apparatus, and information selection acquisition that can easily select and specify data desired by a user and efficiently acquire the selected and specified data. It is an object of the present invention to provide a method and an information selection acquisition program.

In order to achieve the above object, an information selection / acquisition system according to the present invention includes an information processing apparatus connected to a display and outputting text information and image information stored in advance in a data storage unit on the display, and the display. A portable terminal device having camera photographing means for photographing a part or the whole of the output displayed information and transmitting image data of a part or the whole of the information photographed by the camera photographing means to the information processing apparatus; An information selection / acquisition system comprising: the information processing device specifying an information display region that matches the image data sent from the portable terminal device within a display region of the information output and displayed on the display The specified information display area from the display area of the information output and displayed on the display The cut, create transmission means for transmitting text information or image information corresponding to the information output displayed to the cut-out information display area on the data from the storage unit as the region selection information the portable terminal device It has a configuration with.

The information processing apparatus according to the present invention outputs and displays text information and image information previously connected to a display and stored in a data storage unit on the display, and a part of the information output and displayed on the display or An information processing apparatus that communicates with a portable terminal device that includes a camera photographing unit for photographing the whole, and is sent from the portable terminal device within a display area of the information output and displayed on the display Specifying means for specifying an information display area that matches the image data, and cutting out the specified information display area from the display area of the information output and displayed on the display, and outputting and displaying in the extracted information display area said portable text information or image information corresponding to the information that is in the read out area selection information from the data storage unit It is characterized in that a creation transmitting means for transmitting to the end device.

The information selection and acquisition method according to the present invention includes an information processing apparatus that outputs and displays text information and image information stored in advance in a data storage unit on a display, and a mutual communication between the information processing apparatus having camera photographing means. An information selection and acquisition system comprising a mobile terminal device that performs information, and in the information selection and acquisition method in which the mobile terminal device acquires part or all of the information, the information output and displayed on the display is captured by a camera And a shooting transfer step of transferring the shot image information generated by the shooting to the information processing device, a shooting region specifying step of specifying an information region in the information that matches the shot image information, and the specified information region selection to the area selection information text information or image information corresponding to the information output displayed in the area is read out from the data storage unit A broadcast generating step, characterized in that the generated area selection information and a region selection information transfer step of transferring to the mobile terminal device.

The information selection / acquisition program according to the present invention further includes an information processing apparatus that outputs and displays text information and image information stored in advance in a data storage unit on a display, and a mutual communication between the information processing apparatus having camera photographing means. In the information selection acquisition program for the mobile terminal device to acquire part or all of the information, the captured image information generated by capturing the output displayed information with a camera A captured image information acquisition function for acquiring information, a shooting region specifying function for specifying an information region that matches the captured image information in the information output and displayed on the display, and information output and displayed in the specified information region region selection information generating function to an area selection information corresponding text information and image information is read from the data storage unit, the raw Region transferring area selection information to the portable terminal device selection information transfer function, the is characterized by causing a computer to execute provided in the information processing terminal.

  Since the present invention is configured and functions as described above, part or all of the information output and displayed on the display can be easily selected and specified, and the data content selected and specified is equivalent to the corresponding part in the original information. Data quality and data structure.

[Embodiment]
As shown in FIG. 1, the embodiment of the present invention includes a portable terminal device 1 incorporating a camera means 19 and an information processing device (hereinafter referred to as “PC”) connected to the portable terminal device 1 via a signal line D1. 2) and a display device (display) 3 that is connected to the PC 2 via the signal line D2 and outputs and displays information stored in the PC 2 in advance.

  Here, the signal line D1 is a data transmission path through which the portable terminal 1 such as USB or BlueTooth is interconnected and communicated. The signal line D2 is also a data transmission path through which data communication is performed by connecting the PC 2 and the display 3 to each other. Further, the display 3 may be built in the PC 2.

  The PC 2 controls the communication interface unit 23 that performs mutual communication with the mobile terminal 1 via the signal line D1, and controls communication and information processing operations in the information processing apparatus 2. The control unit includes a central processing unit 21 to be controlled, and a data storage unit data storage unit 22 that is connected to the central processing unit 21 and stores preset information (file information).

  Further, the central processing unit 21 specifies an image area specifying means 211 (information display area) for specifying a specified area (information display area) in information output and displayed on the display device 3 based on information (image data) sent from the mobile terminal device 1. (Identification means), area selection information generation means 212 (creation transmission means) for generating area selection information obtained by cutting out the specified information display area, and the image area identification means 211 and the display device 3 are relayed and connected. Image output display control means 213 for outputting and displaying the file information stored in the data storage unit 22 on the display device 3 is provided.

This will be described in detail below.
The image area specifying unit 211 receives the captured image information sent from the portable terminal device 1 and compares the captured image information with file information output and displayed on the display device 3 (hereinafter referred to as “output display information”). Thus, it has a photographing area specifying function for specifying a matching information area (information display area).
The image area specifying unit 211 compares the captured image information with each information (file information) stored in the data storage unit 22 when an information area that matches the captured image information is not found in the output display information. Thus, a function for specifying the matching information area may be provided.
Thereby, even if the information (output display information) displayed on the display device 3 is switched to other information, the information (output display information) displayed on the display at the time when the mobile terminal device 1 was photographed. Can be found from the data storage unit 22, and the information area designated by the user can be specified.

The area selection information generating unit 212 has an area selection information generation function for cutting out the information display area specified in the output display information from the file information and generating area selection information including the cut out information display area. .
Further, the area selection information generation unit 212 is an information type determination function (corresponding to a determination unit) that determines whether the information extracted from the file information includes image information, text information, or both image information and text information. Based on the determination, image information and text information are extracted from the corresponding file information, and region selection information that maintains the display configuration displayed on the display 3 is generated.

Further, the region selection information generating unit 212 has a region selection information transfer function for transmitting the generated region selection information to the mobile terminal device 1 via the communication interface unit 23.
Note that the area selection information generation means 212 is used when the specified information display area (designated area) is the entire file information, that is, when the captured image includes all the file information. Transmits the corresponding file information to the mobile terminal device 1 without cutting out the information display area.

The area selection information generating unit 212 has a conversion function for converting and processing the generated area selection information prior to executing the area selection information transfer function.
Thereby, the area selection information generation unit 212 can convert or process the generated area selection information into a format corresponding to the mobile terminal device 1 that is the transmission destination.

The image output display control unit 213 outputs a file information output execution function for outputting and displaying the file information stored in the data storage unit 22 in advance on the screen of the display device 3, and an output display for controlling the output display of the file information on the display device 3. Control function.
The image area specifying unit 211 has an output display image transfer function for transferring file information (output display image) output and displayed on the display device 3 to the image area specifying unit 211 when the imaging area specifying function is executed. .

Next, the configuration of the mobile terminal device 1 will be described.
As shown in FIG. 2, the mobile terminal device 1 includes a button 18 for input by a user, a button input interface 11 for acquiring a pressed state of the button 18, an input signal sent from the button input interface 11, and a mobile terminal A bus 16 through which information and signals are communicated in the apparatus 1 is provided.
In addition, a central processing unit (hereinafter referred to as “CPU”) 10 connected to the communication bus 16 and controlling information processing operations in the mobile terminal device 1 is connected to the CPU 10 via the bus 16 and executes information processing of the CPU 10. A ROM (Read only memory) 13 having various control programs for receiving the data and a RAM (Random Access Memory) 14 for receiving and temporarily storing information and signals sent via the bus 16.

Furthermore, the mobile terminal device 1 captures video information via the lens and stores the video information in the RAM 14 via the bus 16, and uses the video captured via the camera module 15 as a preview screen. The LCD module 17 for output display and the external communication interface 12 that relay-connects the bus 16 and the signal line D1 are provided.
The camera module 19 is constituted by the camera module 15 and the LCD module 17.

This will be described in detail below.
The central processing unit 10 is connected to peripheral circuits in the mobile terminal device 1, camera means 19, and memory via a bus 16, and has a central processing function for controlling the operations thereof.
In addition, the central processing unit 10 has a captured image transmission function for transmitting captured image information generated from video captured via the camera module 15 to the PC 2 and a communication control function performed via the external communication interface 12. I have.

The external communication interface 12 is an interface unit connected to a signal line D1 for exchanging signals with an external device, and has a communication execution function for executing communication between the mobile terminal device 1 and the PC 2. Yes.
The RAM 14 is constituted by a random access memory, and is temporarily required when the central processing unit 10 executes a program, a captured video and a captured image captured by the camera module 15, and the PC 2. It has a selection information acquisition function for storing the sent area selection information.

The camera module 15 includes an engineering unit such as a lens and a diaphragm, an image sensor such as a CCD or CMOS that converts light into an electrical signal, a mechanism such as a shutter, and a controller, and a video that captures video information via the lens. It has an information acquisition function and a captured image generation function for generating a captured image from the captured video information. Note that the shutter button for photographing with the camera module 15 is included in the button 18.
The bus 16 is a communication transmission path for communication between circuits and units connected to the bus 16.

  The LCD module 17 includes a liquid crystal display unit provided in advance in the mobile terminal device 1, and has a video display function for outputting and displaying video information captured via the camera module 15. Here, the video information output and displayed on the LCD module 17 is taken in from the camera module 15 at the time of camera shooting, and is then stored once in the RAM 14 via the shooting video data bus 16, and then again on the LCD via the bus 16. This is video information sent to the module 17.

  The button 18 and the button input interface 11 constitute a man-machine interface input circuit that acquires a pressing state of the button 18 by the user of the mobile terminal device 1 and notifies the central processing unit 10 of an input signal sent from the button input interface 11. is doing.

  The mobile terminal device 1 has the above-described configuration, so that the user captures a portion (information area) that the user wants to capture in the output display image with the camera unit 19 built in the mobile terminal device 1. By transferring, the information area (designated area) that the user wants to capture can be designated to the information processing apparatus 2.

[Description of Operation of Embodiment]
Next, the operation of the information selection acquisition system in the above embodiment will be described.

  First, the mobile terminal device 1 shoots information (output display information) output and displayed on the display device 3 with a camera and transfers photographic image information generated by the camera shoot to the information processing device 2 (shooting transfer step). Subsequently, the information processing apparatus 2 specifies a corresponding area in the output display information corresponding to the captured image information (imaging area specifying step), and generates area selection information including information on the specified area (Region selection information generation step), and the generated region selection information is transferred to the mobile terminal device 1 (region selection information transfer step). Finally, the mobile terminal device 1 acquires the specific area image information sent from the information processing device 2.

Here, the execution contents of the photographing area specifying process, the area selection information generation process, and the area selection information transfer process may be programmed and executed by a computer.
In addition, the information processing apparatus 2 has a captured image information acquisition function for acquiring captured image information obtained by capturing and generating part or all of the file information output and displayed on the display device 3 by the camera unit 19, and its execution contents May be programmed and executed by a computer included in the information processing apparatus 2.

  Next, the operation of the information selection / acquisition system of the above embodiment will be described based on the sequence chart of FIG.

  The file information stored in the data storage unit 22 of the PC 2 is displayed on the display device 3 (step S101). Here, the user of the mobile terminal device 1 captures a portion of the screen of file information (output display information) output to the display 3 using the camera means 19 built in the mobile terminal device 1 to be acquired (step S102). ). As a result, the user can specify an area to be acquired in the file information.

Next, the mobile terminal device 1 transfers the captured image information generated by the camera imaging to the PC 2 via the signal line D1 (step S103). Next, based on the received captured image information, the PC 2 identifies which region (portion) in the file information is the portion designated by the user in the output and displayed file information (step S104).
Here, the PC 2 specifies whether the photographed image information is obtained by photographing this region of the file information, that is, an information region common to the photographed image information.

  Next, area selection information obtained by cutting out the specified area from the previously stored file information is generated (step S105), and the area selection information generated via the signal line D1 is transferred to the mobile terminal device 1 ( Step S106). The mobile terminal device 1 receives this area selection information and stores it in the RAM (step S107). Accordingly, as described above, the user can specify an information area desired to be acquired on the display screen by camera shooting, and can acquire information (area selection information) obtained by cutting out the specified area.

  Next, the operation of the central processing unit 21 of the information processing apparatus 2 will be described based on the flowcharts of FIGS. 4 (A) and 4 (B). That is, here, the operation of the central processing unit 21 corresponding to the processing steps shown in steps S104 to S106 will be described in detail.

  First, a captured image is sent from the mobile terminal device 1 to the image area specifying unit 211 of the central processing unit 21 (step S201). The image area specifying unit 211 receives the captured image and executes a shooting area specifying function to specify a matching area (hereinafter referred to as a “specific information area”) with the captured image information in the output display information (step “step”). S202). Next, the area selection information generation unit 212 determines whether the specific information area is configured by image information, text information (text information), or includes image and text information. (Step S203).

Here, when both the image information and the character information are included in the specific information area, it is determined whether or not the specific information area is the entire file information (step S204).
If the specific information area is (including) the entire file information, the file information is transferred to the mobile terminal apparatus 1 as area selection information (step S209).

  On the other hand, if the specific information area is a part of the file information, the specific information area is cut out from the file information (step S205), and the text information in the specific information area is extracted from the original file information (step S205). Next, the image information in the specific information area is extracted from the original file information (step S207). Next, the region selection information generating unit 212 generates region selection information based on the image configuration of the specific information region (step S208) and transfers it to the mobile terminal device 1 (step S209).

On the other hand, when it is determined in step S203 that either the image information or the character information is included in the specific information area [FIG. 4 (B)], the area selection information generation unit 212 determines that the specific information area is based on the image information. It is determined whether or not it is configured (whether image information is included) (step S210).
Here, when the specific information area is configured by image information, it is determined whether or not the specific information area is the entire file information (step S211).
Here, when the area of the specific information area is the entire file information, the original file information is transferred to the mobile terminal apparatus 1 as area selection information (step S219).

On the other hand, when the specific information area is a part of the file information, the specific information area is cut out from the file information (step S212), and the image information in the specific information area is extracted from the original file information (step S212). S213). Next, the region selection information generating unit 212 generates region selection information including image information based on the image configuration of the specific information region (step S214), and transfers it to the mobile terminal device 1 (step S219).

Further, when image information is not included in the specific information area in step S210, that is, when the specific information area is composed of character information, it is determined whether or not the area of the specific information area is the entire file information (step S215). ).
Here, when the area of the specific information area is the entire file information, the original file information is transferred to the mobile terminal apparatus 1 as area selection information (step S219).

On the other hand, if the specific information area is a part of the file information, the specific information area is cut out from the file information (step S216), and the image information in the specific information area is extracted from the original file information (step S216). S217). Next, the region selection information generating unit 212 creates region selection information composed of text information based on the image configuration of the specific information region (step S218), and transfers it to the mobile terminal device 1 (step S219).

[Modification]
Next, in this modification, the following additional functions are added to some of the components in the above-described embodiment.

  First, the central processing unit 10 of the mobile terminal device 1 displays a preview video displayed on the LCD module 17 when performing camera shooting when the user designates a range to be captured using the mobile terminal device 1. (PC) You may have the preview image transmission function transferred to 2.

Further, the image output display control means 213 of the PC 2 matches the preview video information sent from the information terminal device 1 on the file information screen (hereinafter referred to as “output display information”) displayed on the display device 3. An area indicator output function (corresponding to indicator output display means) for outputting and displaying an indicator in the area may be provided.
Other configurations are the same as those of the above-described embodiment.

It should be noted that the video data capture and video data output display to the LCD module 17 and the video transfer to the PC 2 are continuously performed.
Further, the PC 2 selects which area the user has selected and designated for the content (output display information) displayed on the display device 3 based on the transmitted video data, that is, the camera means is photographing. And an indicator indicating the area selected and designated as the corresponding area on the screen of the display device 3, that is, the area where the user is photographing with the camera means 19 is displayed.

As a result, the user can easily select and specify the desired information area because the indicator is displayed so as to overlap the on-screen file information (output display information) of the display device 3 when shooting the range to be captured. it can.
For this reason, the user can adjust the direction of the lens of the camera so that the indicator surrounds the desired image data and text data, and can press the button 18 at an appropriate place.

When the button 18 for instructing activation of the preview video transmission function is pressed, the central processing unit 10 is notified of the activation instruction for the preview video transmission function via the button input interface 11 and the bus 16, and the activation instruction is received. The central processing unit 10 may be configured to notify the central processing unit 21 of the PC 2 of the activation request for the area indicator output function via the external communication interface signal 12.
Accordingly, the image output display control means 213 that has received the activation request displays an indicator, and the image area specifying means 211 that has received a designation instruction for the specific area specifies the area within the range of the indicator at that time. By setting as an area, area selection information can be generated and transferred to the mobile terminal device 1 in the same manner as in the above embodiment.

  As described above, in the present invention, the user wants to specify an area that the user wants to acquire in the file information by performing camera shooting, and the mobile terminal device 1 can acquire area selection information including the specified area.

For this reason, only the part required by the user is cut out from the file information including image data and text data and brought to the mobile terminal device, so the data capacity is reduced compared to transferring the data (file information) as it is. can do.
In addition, since the contents displayed on the screen of the display 3 are selected by a simple method of photographing with a camera having a built-in portion that the portable terminal device wants to bring, the user's operation can be simplified.

Furthermore, since the information processing device that holds the original data and the portable terminal device that is the destination of the data can be connected by a wired or wireless connection without using a medium such as a memory, the configuration is simple. be able to.
In addition, by photographing only the range required by the user among the contents displayed on the display 3, only the portion required by the user is cut out and transferred to the mobile terminal device, so that the user processes the data. This saves you time and effort.

  The present invention can be applied to a data communication service between information terminals having camera photographing means.

It is a schematic block diagram which shows the whole of one Example of the information selection acquisition system by this invention. It is a block diagram which shows schematic structure of the portable terminal device in the information selection acquisition system disclosed in FIG. It is the sequence chart which showed the operation | movement process step in the information selection acquisition system disclosed in FIG. 3 is a flowchart showing operation processing steps in the information processing apparatus of the information selection acquisition system disclosed in FIG. 1. 3 is a flowchart showing operation processing steps in the information processing apparatus of the information selection acquisition system disclosed in FIG. 1.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Mobile terminal device 2 Information processing device 3 Display device 10 Central processing unit 11 Button input interface 12 External communication interface 13 ROM
14 RAM
DESCRIPTION OF SYMBOLS 15 Camera module 16 Bus module 17 LCD module 18 Button 19 Camera means 21 Central processing part 22 Data storage part 23 Communication interface part 211 Image area specification means 212 Area selection information generation means 213 Image output display control means

Claims (10)

An information processing apparatus connected to a display and displaying text information and image information preliminarily stored in a data storage unit on the display, and camera photographing means for photographing part or all of the information output and displayed on the display An information selection and acquisition system comprising: a portable terminal device that transmits image data of a part or the whole of the information captured by the camera photographing unit to the information processing device;
The information processing device is output and displayed on the display, specifying means for specifying an information display region that matches the image data sent from the portable terminal device within a display region of the information output and displayed on the display The specified information display area is cut out from the information display area, and text information and image information corresponding to the information output and displayed in the cut out information display area is read out from the data storage unit and the area is selected. information selection acquisition system characterized by comprising a creation transmitting means for transmitting to said portable terminal device and an information. In the information selection acquisition system according to claim 1,
The information selection / acquisition system characterized in that the creation / transmission means of the information processing apparatus has a conversion processing function for converting / processing the created region selection information prior to transmission to the portable terminal device. In the information selection acquisition system according to claim 1 or 2 ,
In the information processing apparatus, when the area selection information is created, information corresponding to information output and displayed in the extracted information display area includes image information, text information, or information including an image and text. Determination means for determining whether the information is within the cut-out information display area is only image information or text information. or create a region selection information only read text information, also, the image information and text information when the information of the cut out the display area is determined to be the information having image information and text information information selection acquisition system characterized by having a function of a and read respectively creating a region selection information of the same screen structure as the original information display area of. In the information selection acquisition system according to any one of claims 1 to 3 ,
The portable terminal device shoots part or all of the information output and displayed on the display via the camera photographing means, acquires preview video information thereof, and transmits the preview video information to the information processing device. Preview image information transmitting means for transmitting to the information processing apparatus, wherein the specifying means of the information processing device specifies which portion of the display area of the information output and displayed on the display matches the transmitted preview video information An information selection / acquisition system having a preview video specifying function and a region indicator output display means for outputting and displaying an indicator at the specified portion. A portable device provided with a camera photographing means for photographing text information or image information that is connected to a display and stored in the data storage unit in advance on the display, and that captures part or all of the information that is output and displayed on the display. An information processing apparatus that communicates with a terminal device,
From the display area of the information output and displayed on the display, the specifying means for specifying the information display area that matches the image data sent from the portable terminal device within the display area of the information output and displayed on the display the cut out specified information display areas, the mobile terminal text information or image information corresponding to the information output displayed to the cut-out information display area in the read out area selection information from the data storage unit An information processing apparatus comprising: creation transmission means for transmitting to the apparatus. The information processing apparatus according to claim 5 ,
An information processing apparatus comprising: a conversion processing function for converting and processing the generated region selection information prior to transmitting the generated region selection information to the mobile terminal device. In the information processing apparatus according to claim 5 or 6 ,
The information corresponding to the information output and displayed in the cut out information display area when creating the area selection information is either image information, text information, or information having an image and text. Determination means for determining whether the information in the extracted information display area is only image information or text information, and reads only the image information or text information. out to create an area selection information, also, to read each of the image information and text information when the information of the cut out the display area is determined to be the information having image information and text information An information processing apparatus having a function of creating area selection information having the same screen configuration as that in an original information display area. The information processing apparatus according to any one of the claims 5 to 7,
A preview video specifying function for acquiring preview video information in which a part or all of the information output and displayed on the display is photographed and specifying which part in the display area of the information matches with the specifying unit; And an area indicator output display means for outputting and displaying an indicator at the specified portion. Information selection and acquisition comprising: an information processing device that outputs and displays text information and image information stored in advance in a data storage unit; and a portable terminal device that has camera photographing means and performs mutual communication with the information processing device In the system, in the information selection acquisition method in which the mobile terminal device acquires part or all of the information,
Shooting and transferring the information output and displayed on the display by the camera and transferring the shot image information generated by the shooting to the information processing apparatus, and specifying the information area in the information that matches the shot image information An imaging region specifying step to perform , an area selection information generating step for reading out text information and image information corresponding to information output and displayed in the specified information region from the data storage unit, and making the region selection information, and the generation And a region selection information transfer step of transferring the region selection information transferred to the portable terminal device. An information processing device that outputs and displays text information and image information stored in a data storage unit in advance on a display; and a portable terminal device that has camera photographing means and performs mutual communication with the information processing device. In the information selection acquisition program for the device to acquire part or all of the information,
A captured image information acquisition function for acquiring captured image information obtained by capturing and generating a part or all of the output displayed information by the camera photographing means, and matches the captured image information in the information output and displayed on the display An imaging area specifying function for specifying an information area , an area selection information generating function for reading out text information and image information corresponding to information output and displayed in the specified information area from the data storage unit, and making the area selection information; An information selection acquisition program for causing a computer provided in the information processing terminal to execute an area selection information transfer function for transferring the generated area selection information to the portable terminal device.

Images