JP3994962B2 - Image data storage system or portable terminal device - Google Patents

Description

  The present invention relates to an image data storage system that performs predetermined processing on input data, and more particularly to a system that causes a host device to process image data input using a portable terminal device.

  When storing image data in the host device, the image data taken by a portable terminal device such as an electronic camera is temporarily stored in a personal computer connected to the electronic camera via a cable, and then has no relation to the portable terminal device. In addition, the host device is accessed via a communication network using a personal computer.

The host device stores image data in response to a request from the accessed personal computer regardless of the portable terminal device.

However, there is a case where a simpler user interface is required for the processing as described above. For example, there are many users who want to immediately store image data captured by a mobile terminal device in a host device. When storing in the host device, it is troublesome to require a complicated operation procedure as in the case of accessing using a personal computer. In addition, there are many users who want to perform the above-described image data storage process “anytime and anywhere” using a mobile terminal device.
An object of the present invention is to improve the user interface in storing image data in a host device using a portable terminal device.

An image data storage system according to the present invention is a means for displaying a designation screen for obtaining image data obtained by photographing and designation for storing the photographed image data in a portable terminal device or designation for storage in a host device. And when the designation operation for storing in the portable terminal device is performed on the designation screen, the image data photographed by the photographing means is stored in the portable terminal device, and stored in the host device by the designation screen. Means for generating transmission data comprising a service code corresponding to the designation operation, image data photographed by the photographing means, and terminal identification information of the mobile terminal device photographing the image data when the designation operation is performed A portable terminal device having transmission means for transmitting the generated transmission data to a host device via a communication network;
Receiving means for receiving the transmission data transmitted from the portable terminal device via a communication network, and whether the data received by the receiving means includes a service code indicating storage of image data in the host device A host having determination means for determining, and storage means for storing image data of the received data in association with terminal identification information of the received data when it is determined that the service code is included It consists of a device.

  The portable terminal device of the present invention includes a photographing unit that acquires image data by photographing, a unit that displays a designation screen for performing designation for storing the photographed image data in the portable terminal device or for storing in the host device. When the designation operation for storing in the portable terminal device is performed on the designation screen, the unit stores the image data captured by the photographing unit in the portable terminal device, and the designation stored in the host device by the designation screen Means for generating transmission data comprising a service code corresponding to the designation operation, image data photographed by the photographing means, and terminal identification information of the mobile terminal device photographing the image data when the operation is performed; And transmitting means for transmitting the generated transmission data to a host device via a communication network.

  According to the present invention, the mobile terminal device can select whether the captured image data is stored in the mobile terminal device or stored in the host device as necessary. When storage to the host device is designated, the mobile terminal device stores the image data. Since the included transmission data is generated and transmitted to the host device, a complicated operation for transmission is unnecessary.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a system configuration diagram of this embodiment. The portable terminal 1 has a communication function, and can request data processing from another device connected to the network 2 and receive and display the result. The mobile terminal 1 wirelessly transmits / receives data via the nearest base station, transmits / receives data to / from an apparatus (optical link unit) having a communication function by Ir (infrared) communication, or wired And connected to the network 2 by a method of transmitting and receiving data.

  The network 2 accommodates a host terminal 3. The host terminal 3 is a server machine and executes data processing according to the request transferred from the mobile terminal 1. Further, the host terminal 3 requests processing from other servers (translation server 4, search server 5, etc.) as necessary. Then, the host terminal 3 transfers the processing result to a predetermined terminal (mainly, the mobile terminal 1 that has issued the processing request) or stores the processing result in the host terminal 3. The network 2 accommodates many other terminals (such as personal PCs 6), and the host terminal 3 can be accessed from these other terminals.

  FIG. 2 is an overall flowchart of the system according to this embodiment. The system of the present embodiment transfers image data captured using a camera in the mobile terminal 1 to the host terminal 3 for analysis (pattern recognition, character recognition), and provides a predetermined service to the analysis result to provide the mobile terminal. 1 is returned.

  In step S1, image data is read using a camera built in the portable terminal 1 (or connected to the portable terminal 1). Here, it is assumed that a memo handwritten on paper or a part of a printed document is read. In step S2, a service is designated. As the service, for example, translation of characters (words, phrases, sentences) included in the image data read in step S1, database search using the characters as keywords, and the like are designated. In step S3, the image data read in step S1 is transmitted to the host terminal 3, and the service designated in step S2 is requested.

  When the host terminal 3 receives the image data and the service request from the portable terminal 1 in step S4, the host terminal 3 starts an application program for processing the received image data in step S5. In step S6, pattern recognition processing is executed on the received image data to recognize characters included therein. In step S7, the service designated in the portable terminal 1 is executed. That is, the host terminal 3 translates the characters included in the image data or searches the database using the characters as keywords while requesting the translation server 4 and the search server 5 to perform processing as necessary. . In step S <b> 8, the host terminal 3 transmits the processing result in step S <b> 7 to the mobile terminal 1.

  When the portable terminal 1 receives the processing result from the host terminal 3 in step S9, the portable terminal 1 displays the processing result on its display unit in step S10. As described above, in the system of this embodiment, when it is desired to perform translation or search, a recording surface including a desired character (character to be processed) is simply photographed by the camera and transmitted to the host terminal 3 as image data. Good. Therefore, the user can receive a translation service and a search service simply by taking a note of a desired character on paper or the like and photographing it with a camera. Moreover, since the portable terminal 1 should just be provided with the function to take in image data, the communication function, and the function to display data as composition requirements for receiving the above services, weight reduction and cost reduction are achieved. I can measure.

  FIG. 3 is an external view of the mobile terminal 1. The mobile terminal 1 includes an LCD display unit 11, a camera 12, an IC card slot 13, and a wireless communication antenna 14. In order to support other communication methods, a socket for Ir communication, a socket for wired communication, and the like are also provided. The LCD display unit 11 has a touch panel configuration, and the mobile terminal 1 can process handwritten input information.

  FIG. 4 is a configuration diagram of the mobile terminal 1. The CPU 21 executes a program stored in the storage device 22 (ROM and RAM). The CPU 21 and the storage device 22 are connected to each other via a bus 23.

  The storage device 22 includes a semiconductor memory, a magnetic recording medium, or an optical recording medium, and stores programs, data, and the like. The storage device 22 may be fixed to the mobile terminal 1 or may be detachably mounted.

  The recording medium driver 24 is connected to the bus 23 and reads data stored in a portable recording medium (including a semiconductor memory, a magnetic disk, an optical disk, and a magneto-optical disk) 25 or a portable recording medium 25. It is a device that writes data to the. As an example of the portable recording medium 25, an IC card is assumed. The CPU 21 can also execute a program stored in the portable recording medium 25.

  The program and data to be recorded in the storage device 22 may be configured to be received and recorded from another device connected via a communication line or the like, and the CPU 21 is provided on the other device side. You may make it use the program, data, etc. which are stored in the memory | storage device via a communication line etc.

  The unit corresponding to the LCD display unit 11 includes a liquid crystal display (LCD) 31, a memory 32 for storing information to be displayed on the liquid crystal display 31, and information stored in the memory 32 according to control of the LCD control unit 34. The LCD driver 33 that outputs to the memory, the LCD 32 that controls the memory 32 and the LCD driver 33, the touch panel unit 35, and the touch panel control unit 36 that notifies the CPU 21 of input information detected by the touch panel unit 35.

  The camera 12 is, for example, a CCD camera, and its output is converted into digital data in a bitmap format by the A / D converter 37 and written into the memory 38. The camera control unit 39 outputs the image data held in the memory 38 to the bus 23 in accordance with an instruction from the CPU 21.

  When transmitting data from the mobile terminal 1, the communication control unit 40 generates a transmission packet according to an instruction from the CPU 21 and passes it to the wireless transceivers 41 and 42 or the wired transceiver 43. When data is received, the data stored in the packet received via the wireless transceivers 41 and 42 or the wired transceiver 43 is output onto the bus 24. The wireless transceiver 41 is connected to the wireless communication antenna 14 shown in FIG. 3 and exchanges wireless data with the wireless base station 4. The wireless transceiver 42 is a transceiver for performing Ir communication, and the wired transceiver 43 is a modem, for example. The wireless transceiver 42 and the wired transceiver 43 are optionally attached and detached. Note that the mobile terminal 1 further includes a clock 44.

  FIG. 5 is a flowchart of a process for requesting a desired service by transferring the image data captured by the camera shooting in the portable terminal 1 to the host terminal 3, and shows details of steps S1 to S3 in FIG. A program for realizing each function shown in the flowchart is stored in the storage device 22 in the form of a program code readable by the CPU 21.

  The following flowchart shows processing after the mobile terminal 1 detects some input in the input waiting state. In this embodiment, an example will be described in which characters taken by a user are taken with a camera.

  In step S11, it is checked whether or not the detected input is an input from the camera 12. If the input is from the camera 12, the processing from step S12 is executed, and if it is another input, the input corresponds to the input in step S23. Perform other processing. As described above, when the user captures an image using the camera 12 of the mobile terminal 1, the processing after step S12 is started. When there is a camera input, the time information that is the output of the clock 44 is held.

  In step S 12, the image data captured by the camera 12 is displayed on the LCD display unit 11. That is, the image data captured by the camera 12 is written into the memory 32 of the LCD display unit 11 and the image data is displayed on the liquid crystal display 31. As a result, the user can view the captured image on the spot. FIG. 6A is a display example of image data captured by the user through camera photography. Here, an example is shown in which the user writes down “PHS” and “ISDN” on paper or the like and shoots them with a camera. Note that “end of correction” at the lower right of the display screen is a button for an input instruction.

  Here, an example of the user's operation when the screen shown in FIG. 6A is displayed by the process of step S12 will be described. When the user wants to correct the contents of the display screen, the user inputs the correction contents by handwriting on the LCD display unit 11 using a handwriting pen. For example, when only the term “PHS” is to be processed, a frame surrounding “PHS” is handwritten on the LCD display unit 11 using a handwriting pen as shown in FIG. . Alternatively, as shown in FIG. 6 (c), a deletion mark is handwritten with a handwriting pen for an unnecessary display (“ISDN” is unnecessary when “PHS” is a processing target). The processing target refers to a character string to be translated or a character string to be a keyword for search. When the correction is completed, the user presses the correction end button with the handwriting pen.

  Steps S13 and S14 are executed in accordance with the user's operation. If it is detected in step S13 that the correction end button has been pressed, the process proceeds to step S14. When the user presses the correction end button without correcting the image data displayed on the LCD display unit 11, step S14 is skipped and the process proceeds to step S15.

  In step S14, the image data is updated in accordance with a pen input instruction from the user. That is, the locus pattern pressed on the LCD display unit 11 by pen input is overwritten in the memory 32 as bitmap format data. At this time, since the image data currently displayed on the LCD display unit 11 is stored in the memory 32, the image data captured by the camera photographing and the locus pattern written by the pen input are combined.

  In step S15, a screen for allowing the user to specify a desired service is displayed on the LCD display unit 11. At this time, the image data stored in the memory 32 is saved in the RAM of the storage device 22. Then, screen image data for allowing the user to specify a desired service is read from the ROM of the storage device 22 and written to the memory 32. An example of a screen for allowing the user to specify a desired service is shown in FIG. The portable terminal 1 then transitions to a state of waiting for an instruction from the user.

  Here, a procedure for a user to specify a service will be described. The service designation screen has six buttons as shown in FIG. 7 (a). These six buttons are used to designate processing for the image data displayed in FIG.

  “Translation” is a button for designating a service for translating characters and the like included in image data into a predetermined language. “Search” is a button for designating a service for performing a database search or the like using characters or the like included in image data as keywords. “Recognition” is a button for designating a service for performing character recognition by analyzing image data. Translation services and search services include recognition services. “Image” is a button for designating a service for storing image data captured by the mobile terminal 1 in the host terminal 3. “Save” is a button for designating that the image data captured by the portable terminal 1 is saved on the portable terminal 1 side. “Cancel” is a button for designating discarding of image data. The user presses one of the six buttons.

  When the translation button is pressed, a language designation screen shown in FIG. 7B is displayed on the LCD display unit 11. When the user designates a desired translation language, a display designation screen shown in FIG. 7 (c) is displayed. The display designation screen is a screen for allowing the user to designate whether or not to display the translation result requested of the host terminal 3 on the portable terminal 1.

  When the search button is pressed, a search destination designation screen shown in FIG. 7 (d) is displayed on the LCD display unit 11. When the user designates a desired search destination in this state, the display designation screen shown in FIG. 7C is also displayed in this case.

  Thus, the user designates a service according to the display screen of the LCD display unit 11. When the user designates a service as described above, the processing in step S16 and subsequent steps is executed. First, in step S16, the service code is recognized. This process is to detect which button the user has pressed on the service designation screen of FIG. In step S17, it is determined whether the designated service code is “translation”, “search”, “recognition”, or “image storage”. Since these four services are requests for processing from the host terminal 3, step S17 is substantially a step of determining whether or not it is necessary to request processing from the host terminal 3.

  If it is necessary to request processing from the host terminal 3 (step S17: Yes), a packet is created in step S18, and the packet is sent to the host terminal 3 in step S19. If it is not necessary to request processing from the host terminal 3 (step S17: No), it is determined in step S20 whether the user has pressed the save button. If the user presses the save button, the image data is saved on the portable terminal 1 side in step S21. On the other hand, if the user has not pressed the save button, it is assumed that the user has pressed the cancel button, and the image data is discarded in step S22.

  FIG. 8 is a diagram illustrating a structure of a packet transmitted from the mobile terminal 1. This packet is created in step S18 shown in FIG. Each packet is composed of a header part and a data part. The header part stores a source address, a destination address, and the like. The address system of which address system is stored as the source address and the destination address depends on the network configuration to which this embodiment is applied. For example, in TCP / IP communication, an IP address is stored.

  The data portion stores application identification information, terminal ID, image data, service code, additional information, display flag, time information, and the like. The application identification information is information for identifying an application program to be started in the terminal of the destination (here, the host terminal 3). In the present embodiment, information for identifying an image data analysis / recognition program is set. The application identification information is specified as a port number in TCP / IP communication.

  The terminal ID is an identification number of the mobile terminal 1. The image data is image data captured by camera shooting, and is compressed when stored in a packet. When writing is performed with a handwritten pen as shown in FIG. 6B or 6C, the trace pattern of the pen input is also synthesized as image data.

  The service code is 8-bit information as shown in FIGS. 9A and 9B, for example, and identifies “translation”, “search”, “recognition”, or “image storage”. The additional information is information for specifying the details of each service in detail as shown in FIGS. 9 (a), (c) and (d). For example, in the case of a translation service, the translation language is identified. In the case of a search service, the search destination is identified. As a search destination, in addition to various databases open to the public, a personal database created by each user can also be accessed. The display flag is 1-bit information for designating whether or not the processing result in the host terminal 3 is displayed on the portable terminal 1. For example, when “Yes” is selected on the screen of FIG. “1” is set. The time information is information representing the time when the image data sent to the host terminal 3 was captured by the camera.

  FIG. 10 is a detailed flowchart of the packet creation processing in step S18 shown in FIG. In step S31, the image data transferred to the host terminal 3 is compressed and stored in the data portion. In step S32, time information representing the time at which the image data was captured by the camera is set. In steps S33 to S35, as shown in FIG. 9, the service code, the additional information, and the display flag are set in predetermined areas of the data part. In step S36, information for identifying the image data analysis / recognition program is set as the application identification information. In step S37, the terminal ID is set as information for identifying the portable terminal 1 (information for identifying the own device). Furthermore, a header part is created in step S38. In the header part, at least the address of the portable terminal 1 (the address of the own device) is set as the source address, and the address of the host terminal 3 is set as the destination address.

  The packet created as described above is sent to the network 2. The network 2 transfers the packet to the host terminal 3 according to the destination address of the packet. Below, the host terminal 3 which receives and processes this packet is demonstrated.

  FIG. 11 is a configuration diagram of the host terminal 3. The storage device 51 is composed of a semiconductor memory, a magnetic recording medium, or an optical recording medium, and stores programs, data, and the like. The storage device 51 may be fixedly provided on the host terminal 3 or may be detachably mounted.

  The recording medium driver 52 is a device that reads data stored in a portable recording medium (including a semiconductor memory, magnetic disk, optical disk, magneto-optical disk, etc.) 53 or writes data to the portable recording medium 53. . The communication control unit 54 is a unit that controls data exchange with the network. Transmission and reception of packets with each portable terminal is also controlled here.

  The CPU 55 loads a program or the like from the storage device 51 or the portable recording medium 53 to the memory 56 and executes it. Note that the program, data, and the like recorded in the storage device 51 may be those written in the portable recording medium 53, or from other devices on the network via a communication line or the like. You may make it the structure which receives and records. Further, the CPU 55 may use a program and data stored in another storage device provided on the network via a communication line or the like.

  FIG. 12 is a flowchart for explaining the processing of the host terminal 3, and shows details of steps S4 to S8 in FIG. Here, an operation will be described in which the host terminal 3 receives a packet transmitted from the portable terminal 1 (a packet created by the process of the flowchart of FIG. 5) and processes the image data according to the information set in the data portion thereof. To do.

  When the packet is received at step S41, the terminal ID set in the packet is checked at step S42 to recognize the terminal that sent the packet. Here, it is assumed that the mobile terminal 1 is recognized. Subsequently, in step S43, the application program is started according to the application designation information set in the received packet. As a result, a program for analyzing and recognizing image data is started.

  Step S44 and subsequent steps are processing by an image data analysis / recognition program. In step S44, the service code set in the received packet is recognized. In step S45, it is checked whether the service code is “translation”, “search”, or “recognition”. If the service code is “translation”, “search”, or “recognition”, the process from step S46 is executed, and if not, the process proceeds to step S54.

  In step S46, the image data stored in the received packet is decompressed. In step S47, pattern recognition processing is performed on the decompressed image data to recognize characters contained therein. In step S48, the character recognized in step S47 is converted into a character code.

  In step S49, it is checked whether the service code is “translation”. If it is “translation”, the translation processing shown in FIG. 13 is executed. In step S50, it is checked whether the service code is “search”. If “search”, the search process shown in FIG. 14 is executed. If not “search”, the process proceeds to step S51. In step S51, it is checked whether the service code is “recognition”. If it is “recognition”, the processing results in steps S47 and S48 are stored in a predetermined area of the storage device 51 in association with the terminal ID in step S52. If not, the process proceeds to step S53 to execute error processing.

  In step S54, it is checked whether the service code is “image storage”. If it is “image storage”, the image data stored in the packet in step S55 is stored in a predetermined area of the storage device 51 in association with the terminal ID. . On the other hand, if it is not “image storage”, the process proceeds to step S56 to execute processing corresponding to the set service code.

  FIG. 13 is a flowchart of the translation process. In step S61, the host terminal 3 requests translation processing by transferring the character code obtained in step S48 and the additional information (translation type) set in the received packet to the translation server 4. The following steps S62 to S65 are processes of the translation server 4.

  In step S62, the translation type is recognized from the additional information. That is, the source language and the target language are recognized. Subsequently, in step S63, words are cut out from one or more character codes (character strings), and in step S64, translation is performed by a known method. In step S65, the translation result is passed to the host terminal 3.

  In step S66, the host terminal 3 checks the display flag set in the received packet. If the display flag is set to “display”, the translation result is stored in a packet in step S67, and the packet is sent to the portable terminal 1 in step S68. Thereby, the mobile terminal 1 receives the translation result of the characters included in the image data captured by the camera 12 built in the mobile terminal 1. The portable terminal 1 displays the translation result on the LCD display unit 11. On the other hand, if the display flag is set to “not display”, the translation result is stored in a predetermined area of the storage device 51 in association with the terminal ID in step S69.

  FIG. 14 is a flowchart of the search process. In step S71, the host terminal 3 requests the search process by transferring the character code obtained in step S48 and the additional information (search destination) set in the received packet to the search server 5. The following steps S72 to S74 are processing of the search server 5.

  In step S72, the search destination database is recognized from the additional information. That is, it recognizes which database is accessed. Subsequently, in step S73, a database search is executed by a known method using the received character string as a keyword. In step S74, the search result is passed to the host terminal 3.

  In step S75, the host terminal 3 checks the display flag set in the received packet. If the display flag is set to “display”, the search result is stored in a packet in step S76, and the packet is sent to the portable terminal 1 in step S77. As a result, the mobile terminal 1 receives the search result of the database search using the characters included in the image data captured by the camera 12 built in the mobile terminal 1 as keywords. The mobile terminal 1 displays the search result on the LCD display unit 11. On the other hand, if the display flag is set to “not display”, the search result is stored in a predetermined area of the storage device 51 in association with the terminal ID in step S78.

  The pattern recognition process in step S47 shown in FIG. 12 uses a known method, but as shown in FIG. 6B, characters existing in the area inside the frame-like pattern written with the handwriting pen. In the case of a method that targets only processing, the processing of the flowchart shown in FIG. 15 is executed as the pattern recognition processing.

  In step S81, a frame-like pattern surrounding a predetermined area is searched for in the image data stored in the received packet. In step S82, it is determined whether or not a frame-like pattern exists. If it exists, in step S83, image recognition processing is executed only for the image data in the frame-like pattern to recognize characters. On the other hand, if there is no frame-like pattern, recognition processing is executed for all image data. By adopting the above method, characters unnecessary for translation processing or search processing can be easily excluded from image data captured by camera photography. Further, in the case of a deletion mark, the deletion mark is detected and characters are recognized except for the character corresponding to the deletion mark. In addition, although the process which excludes from recognition object is performed on the host side, these processes may be performed on the terminal side and the data which should be recognized may be transmitted to the host side.

  FIG. 16 is a diagram schematically illustrating data stored for each terminal ID. These data are stored in a predetermined area of the storage device 51 through steps S52 and S55 in FIG. 12, step S69 in FIG. 13, and step S78 in FIG. At this time, the data may be stored in order of photographing time using the time information set in the received packet. The data can be accessed not only from the mobile terminal 1 but also from other terminals (such as personal PC 6) connected to the network 2.

  By the way, although the said embodiment picked up and demonstrated the notebook type thing with a handwriting input function as shown in FIG. 3 as a portable terminal, this invention is not limited to this form, For example, FIG. A wristwatch type terminal device as shown in FIG.

  As shown in FIG. 17, the portable terminal 61 includes a camera 62 and can take, for example, a memo handwritten with a pen 64 on a paper surface 63 or a part of a printed document as image data. The portable terminal 61 has a communication function, and transmits / receives data to / from the host terminal 3 via the network 2 shown in FIG. The configuration of the form terminal 61 is basically the same as that shown in FIG.

  Considering its size, it is difficult for the portable terminal 61 to have a pen input function or the like as in the portable terminal 1 shown in FIG. For this reason, in the notebook-type portable terminal 1, the designation of the service (designation of what kind of processing is to be performed on the image data captured by the camera shooting) is displayed on the screen as shown in FIG. In the portable terminal 61, it is difficult to specify a service in the same procedure. In consideration of this point, in the portable terminal 61, the service type requested to the host terminal 3 together with the characters to be translated or searched is captured by the camera 62 as image data, and the host terminal 3 recognizes the pattern of the image data. The host terminal 3 recognizes the service type designated by the user.

  FIG. 18 is a diagram illustrating an example of a service designation method. Here, an example in which the word “broadcast communication” is translated into the host terminal 3 will be described. In the method shown in FIG. 18A, the user writes “broadcast communication” on the paper 63 and “translation” as the service type requested to the host terminal 3. Further, in order to distinguish between the character to be translated and the service type character, both ends of the character specifying the service type are surrounded by symbols such as []. Then, these characters and symbols are collected together as image data using the camera 62 and transferred to the host terminal 3.

  In the method shown in FIG. 18B, “broadcast communication” and “translation” are written on the paper 63 in this case as well, but color information is used to identify the character to be translated and the service type character. That is, here, the service type is entered in red or the like, and the translation target is entered in black. Also in this case, these characters and the like are collected together as image data using the camera 62 and transferred to the host terminal 3.

  FIG. 19 is an operation flowchart of the mobile terminal 61. Here, the minimum functions for capturing image data and requesting processing (requesting a service) from the host terminal 3 are shown. A program for realizing each function shown in this flowchart is stored in the storage device 22 in the form of a program code readable by the CPU 21.

  When an input is detected in the input waiting state, it is checked in step S91 whether the input is from the camera 62, and if it is a camera input, a packet is created in step S92, and the packet is sent to the host terminal 3 in step S93. On the other hand, if the input is other than the camera input, a process corresponding to the input is executed in step S94. The packet created in step S92 is basically the same as that shown in FIG. 8, but the service code and the like are included in the image data.

  FIG. 20 is a flowchart for explaining the processing of the host terminal 3 when the service type is designated by the method shown in FIG. 18A or 18B on the mobile terminal side. Here, an operation will be described in which the host terminal 3 receives a packet transmitted from the portable terminal 61 (a packet created by the processing of the flowchart of FIG. 19) and processes the image data according to the information set in the data portion. To do.

  Steps S101 to S103 are the same as steps S41 to S43 shown in FIG. In step S104, pattern recognition processing is executed on the image data stored in the data portion of the received packet, and a specific symbol or color is detected from the pattern recognition processing. In step S105, a character recognition process is executed for the image data or a specific color in the area inside the detected symbol, and the service designated by the user is recognized. In the example shown in FIG. 18 (a) or FIG. 18 (b), the character “translation” is detected to recognize that the user is requesting the translation service.

  In step S106, processing according to the recognized service is executed. Note that the processing in step S106 corresponds to the processing in and after step S48 in FIGS. As a result, for example, when the image data captured by the portable terminal 61 is the character shown in FIG. 18 (a) or FIG. 18 (b), “broadcast communication” is translated into “multi-cast communication”. . In step S107, the processing result is stored in a packet and sent to the portable terminal 61.

  When the portable terminal 61 receives a packet in which the processing result by the host terminal 3 is stored, the portable terminal 61 displays the processing result. As described above, the portable terminal 61 can display a result (in this example, a translation result) obtained by applying a predetermined service to the image data captured by the camera 62.

  In the above embodiment, a processing program executed in the host terminal 3, that is, a program for realizing each function shown in the flowcharts of FIGS. 12 to 15 and 20, and a command transferred from the portable terminal 1 or 61 Is stored in the storage device 51 or the portable recording medium 53 in the form of a program code that can be read by the CPU 55. Or what is stored in the other apparatus connected via a network is utilized.

  In the above embodiment, a configuration has been described in which image data is captured using a camera. However, the present invention is not limited to this configuration, and for example, image data read using an image scanner may be transferred to a host terminal. May be.

  As described above, the image data processing system of this embodiment is configured to transfer image data captured by a portable terminal to a host terminal, and the host terminal recognizes and processes characters included in the image data. For this reason, the portable terminal only needs to have a function of capturing image data and transferring it to the host terminal, a function of requesting processing to the host terminal 3, and a function of displaying data transferred from the host terminal. . That is, the mobile terminal does not need to perform high-precision pattern recognition processing and various types of processing that require high-speed processing. For this reason, the portable terminal can obtain an advanced image processing result without providing a large-capacity memory or a high-performance processor.

It is a system configuration figure of this embodiment. It is a whole flowchart of the system of this embodiment. It is an external view of a portable terminal. It is a block diagram of a portable terminal. 10 is a flowchart of processing for requesting a desired service by transferring image data captured by camera photographing in a portable terminal to a host terminal. (a) is an example in which image data captured by a camera is displayed on a display unit of a mobile terminal, and (b) and (c) are diagrams for explaining an operation example for correcting image data on the mobile terminal. It is a figure which shows the example of a screen for making a user designate desired service. It is a figure which shows the structure of the packet transmitted from a portable terminal. It is a figure explaining the various information set to a packet. It is a detailed flowchart of a packet creation process. It is a block diagram of a host terminal. It is a flowchart explaining the process of a host terminal. It is a flowchart of a translation process. It is a flowchart of a search process. It is a flowchart of one Example of a pattern recognition process. It is a figure which shows typically the data stored for every terminal ID. It is an external view of a wristwatch type portable terminal. It is a figure which shows the example of the service designation | designated method. It is an operation | movement flowchart of the portable terminal shown in FIG. 19 is a flowchart for explaining processing of a host terminal corresponding to the service designation method shown in FIG. 18 (a) or FIG. 18 (b).

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,61 Portable terminal 2 Network 3 Host terminal 4 Translation server 5 Search server 11 LCD display part 12, 62 Camera 21 CPU
DESCRIPTION OF SYMBOLS 22 Memory | storage device 23 Bus 24 Recording medium driver 25 Portable recording medium 31 Liquid crystal display 35 Touch panel part 40 Communication control part 41, 42 Wireless transceiver 43 Wired transceiver 44 Clock 51 Storage device 52 Recording medium driver 53 Portable recording medium 54 Communication control part 55 CPU
56 memory

Claims (2)

Photographing means for acquiring image data by photographing;
Means for displaying a designation screen for performing designation for saving the captured image data in the portable terminal device or designation for storage in the host device;
Means for storing, in the portable terminal device, image data taken by the photographing means when a designation operation for storing in the portable terminal device is performed by the designation screen;
When a designation operation for storing in the host device is performed on the designation screen, a service code corresponding to the designation operation, image data photographed by the photographing means, and terminal identification of the mobile terminal device that photographed the image data Means for generating transmission data comprising information;
A portable terminal device comprising: transmission means for transmitting the generated transmission data to a host device via a communication network;
Receiving means for receiving the transmission data transmitted from the portable terminal device via a communication network;
Determining means for determining whether the data received by the receiving means includes a service code indicating storage of image data in the host device;
When it is determined that the service code is included, image data formed by a host device having storage means for storing image data of the received data in association with terminal identification information of the received data Storage system. Photographing means for acquiring image data by photographing;
Means for displaying a designation screen for performing designation for saving the captured image data in the portable terminal device or designation for storage in the host device;
Means for storing, in the portable terminal device, image data taken by the photographing means when a designation operation for storing in the portable terminal device is performed by the designation screen;
When a designation operation for storing in the host device is performed on the designation screen, a service code corresponding to the designation operation, image data photographed by the photographing means, and terminal identification of the mobile terminal device that photographed the image data Means for generating transmission data comprising information;
A portable terminal device comprising: a transmission unit configured to transmit the generated transmission data to a host device via a communication network.

Images