JP6813090B2 - Programs, information processing devices, and information processing methods - Google Patents

Description

The present invention relates to a program, an information processing device, and an information processing method.

Conventionally, for example, when searching for a facility such as a store or a property, the user first inputs information about the geographical location of the facility to be searched, such as the name of the nearest station, in a predetermined input field, and then the search target. There is known a technique that enables a search to be executed by inputting a facility keyword in a predetermined input field and pressing a search button.

Further, for example, the user first performs an operation of displaying a map including the geographical location of the facility to be searched on the screen, then inputs the keyword of the facility to be searched in a predetermined input field, and presses the search button. A technique is known that enables a search to be executed when pressed.

JP-A-2007-257431

However, in the prior art, as described above, when searching for a facility related to a geographical location, there is a problem that the operation for performing the search is relatively complicated.

Therefore, on one aspect, it is an object of the present invention to provide a technique capable of simplifying a predetermined input operation.

In one proposal, when a computer receives handwritten input on a screen on which a map is displayed , if the range of the handwritten input includes at least a part of a predetermined object on the map, the handwritten input in the map is included. A program for executing a process for acquiring information on a predetermined object area and facilities related to character information corresponding to the handwriting of the handwriting input is provided.

According to one aspect, a predetermined input operation can be made simpler.

It is a figure which shows the structural example of the information processing system which concerns on embodiment. It is a figure which shows the hardware configuration example of the information processing apparatus which concerns on embodiment. It is a figure which shows an example of the functional block diagram of the information processing apparatus which concerns on 1st Embodiment, and a server apparatus. It is a figure which shows an example of the search data. It is a sequence diagram which shows an example of the processing of the information processing system which concerns on 1st Embodiment. It is a figure explaining an example of the display screen in the information processing apparatus which concerns on 1st Embodiment. It is a figure explaining an example of the display screen in the information processing apparatus which concerns on 1st Embodiment. It is a figure explaining an example of the display screen in the information processing apparatus which concerns on 1st Embodiment. It is a flowchart which shows an example of the processing of the information processing apparatus which concerns on 1st Embodiment. It is a figure explaining an example of the display screen when the range of a plurality of search targets and a keyword for one search is specified. It is a figure explaining an example of a display screen when a handwritten character is input to a predetermined object on a map. It is a figure explaining an example of the display screen when a plurality of search keywords are specified. It is a figure which shows an example of the functional block diagram of the information processing apparatus which concerns on 2nd Embodiment. It is a flowchart which shows an example of the processing of the information processing apparatus which concerns on 2nd Embodiment. It is a figure which shows an example of the question data. It is a figure which shows an example of the display screen of the information processing apparatus which concerns on 2nd Embodiment. It is a figure which shows an example of the functional block diagram of the information processing apparatus which concerns on 3rd Embodiment. It is a flowchart which shows an example of the processing of the information processing apparatus which concerns on 3rd Embodiment. It is a figure which shows an example of translation data. It is a figure which shows an example of the display screen of the information processing apparatus which concerns on 3rd Embodiment. It is a figure which shows an example of the display screen of the information processing apparatus which concerns on 3rd Embodiment. It is a flowchart which shows an example of the processing of the server apparatus which concerns on 4th Embodiment. It is a figure which shows an example of the display screen of the information processing apparatus which concerns on 4th Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
<Overall configuration>
FIG. 1 is a diagram showing a configuration example of the information processing system 1 according to the embodiment. In FIG. 1, the information processing system 1 refers to the information processing devices 10-1, 10-2, 10-3, ... (Hereinafter, when it is not necessary to distinguish between them, it is simply referred to as "information processing device 10". It has a server device 20.

The information processing device 10 is, for example, a tablet PC (Personal Computer), a smartphone, a notebook PC, or the like.

The server device 20 is, for example, an information processing device for a server.

The information processing device 10 and the server device 20 are connected via, for example, a network 50 such as the Internet, a mobile phone network, or a wireless LAN (Local Area Network).

The information processing device 10 receives a handwriting input operation from the user and transmits a search request based on the input data to the server device 20. Further, the information processing device 10 displays the search result received from the server device 20 on the screen.

The server device 20 extracts search results from within a predetermined geographical position range (area) in response to a search request received from the information processing device 10, and transmits the extracted search results to the information processing device 10.

<Hardware configuration>
FIG. 2 is a diagram showing a hardware configuration example of the information processing device 10 according to the embodiment. The information processing device 10 of FIG. 2 includes a drive device 100, an auxiliary storage device 102, a memory device 103, a CPU 104, an interface device 105, a display device 106, an input device 107, and the like, which are connected to each other by a bus B, respectively.

The information processing program that realizes the processing in the information processing apparatus 10 is provided by the recording medium 101. When the recording medium 101 on which the information processing program is recorded is set in the drive device 100, the information processing program is installed in the auxiliary storage device 102 from the recording medium 101 via the drive device 100. However, the information processing program does not necessarily have to be installed from the recording medium 101, and may be downloaded from another computer via the network. The auxiliary storage device 102 stores the installed information processing program and also stores necessary files, data, and the like.

The memory device 103 reads and stores the program from the auxiliary storage device 102 when the program is instructed to start. The CPU 104 realizes the function related to the information processing device 10 according to the program stored in the memory device 103. The interface device 105 is used as an interface for connecting to a network. The display device 106 displays a programmatic GUI (Graphical User Interface) or the like. The input device 107 is composed of a touch panel, buttons, and the like, and is used for inputting various operation instructions.

An example of the recording medium 101 is a portable recording medium such as a CD-ROM, a DVD disc, or a USB memory. Further, as an example of the auxiliary storage device 102, an HDD (Hard Disk Drive), a flash memory, or the like can be mentioned. Both the recording medium 101 and the auxiliary storage device 102 correspond to computer-readable recording media.

The hardware configuration of the server device 20 may be the same as the hardware configuration of the information processing device 10.

<Functional configuration>
Next, with reference to FIG. 3, the functional configurations of the information processing device 10 and the server device 20 according to the first embodiment will be described. FIG. 3 is a diagram showing an example of a functional block diagram of the information processing device 10 and the server device 20 according to the first embodiment.

≪Information processing device≫
The information processing device 10 includes an input unit 11, a position determination unit 12, a character recognition unit 13, an acquisition unit 14, a display control unit 15, and a communication unit 16. Each of these parts is realized by a process in which one or more programs installed in the information processing device 10 are executed by the CPU 104 of the information processing device 10.

The input unit 11 accepts a user's input of characters by handwriting with a finger, a stylus pen, or the like on the screen on which the map information is displayed. Further, the input unit 11 has coordinates indicating the geographical position determined by the position determination unit 12 and

The position determination unit 12 determines at which position on the map the handwritten characters input to the input unit 11 are input. For example, the position determination unit 12 stores the coordinates of the pixels on the screen in association with the coordinates such as the geographical latitude and longitude on the screen, and stores the coordinates of the pixels on the screen hand-input. Convert the coordinates to coordinates that indicate the geographical position (position on the map). The position on the map is a geographical position associated with each position on the map, and may be data represented by coordinates such as latitude and longitude. Alternatively, for example, data represented by three-dimensional coordinates such as latitude, longitude, and height may be used.

The character recognition unit 13 recognizes the handwriting of the handwritten characters input to the input unit 11 and generates character information (text information) as a result of the character recognition.

The acquisition unit 14 acquires the search result based on the character information of the result recognized by the character recognition unit 13 and the position on the map determined by the position determination unit 12 from the server device 20.

The display control unit 15 displays the search result acquired by the acquisition unit 14 at a position corresponding to the search result on the screen on which the map information is displayed.

The communication unit 16 communicates with the server device 20 and the like.

≪Server device≫
The server device 20 has a storage unit 21. The storage unit 21 is realized by using, for example, an auxiliary storage device or the like. The storage unit 21 stores the search data 211. FIG. 3B is a diagram showing an example of the search data 211. The search data 211 stores data such as the name of the facility, a keyword group for searching the facility, and the location of the facility in association with the ID of the facility.

Further, the server device 20 includes an input unit 22, a search unit 23, an acquisition unit 24, a display control unit 25, and a communication unit 26. Each of these parts is realized by a process in which one or more programs installed in the server device 20 are executed by the CPU of the server device 20.

The input unit 22 inputs data related to characters input by a handwriting operation from the user from the information processing device 10. The input unit 22 inputs, for example, a position on the map in which the handwritten character is input, character information as a result of recognizing the handwritten character, and the like.

The search unit 23 refers to the search data 211 and searches for a facility that matches the conditions of the position input by the input unit 22 and the character information.

The acquisition unit 24 acquires the search result by the search unit 23.

The display control unit 25 displays the search result acquired by the acquisition unit 24 on the screen of the information processing device 10.

The communication unit 26 communicates with the information processing device 10 and the like.

<Processing>
Next, the processing of the information processing system 1 according to the first embodiment will be described with reference to FIG. FIG. 4 is a sequence diagram showing an example of processing of the information processing system 1 according to the first embodiment.

In step S1, the input unit 11 of the information processing device 10 accepts an operation for starting a search from the user.

Subsequently, the communication unit 16 of the information processing device 10 transmits a map information acquisition request to the server device 20 (step S2). Here, the communication unit 16 of the information processing device 10 requests, for example, the acquisition of map information around the current position acquired by GPS (Global Positioning System). The map information is not limited to a map according to the actual latitude and longitude, but may be, for example, a route map or a schematic map schematically showing roads and landmarks. In this case, the position on the route map or the schematic map may be replaced with the actual latitude and longitude, and the search and the search result may be displayed.

Subsequently, the communication unit 26 of the server device 20 transmits the requested map information to the information processing device 10 (step S3).

Subsequently, the display control unit 15 of the information processing device 10 displays the received map information on the screen (step S4).

Subsequently, the input unit 11 of the information processing device 10 accepts the input of characters by handwriting from the user on the screen displaying the map (step S5). Here, the information processing apparatus 10 may wait for a predetermined time (for example, 3 seconds) after the handwritten input operation, and if there is no next input operation within the predetermined time, proceed to the subsequent processing.

Subsequently, the position determination unit 12 of the information processing device 10 acquires the position on the map in which the handwritten character is input (step S6).

Subsequently, the character recognition unit 13 of the information processing device 10 recognizes the handwritten character and acquires character information (step S7). Here, even if the character recognition unit 13 of the information processing device 10 acquires a predetermined number of recognition candidates or recognition candidates having a score equal to or higher than a predetermined threshold value in the order of the score of the certainty of recognition when the handwritten character is recognized. Good. Thereby, for example, when it is unknown whether the handwritten character string is "ramen" or "ramen", the search results by both keywords can be acquired and displayed. In this case, since it is considered that the number of cases extracted according to the erroneously recognized "rameso" is relatively small, relatively good search results can be obtained even if the accuracy of handwritten character recognition is relatively low.

Subsequently, the communication unit 16 of the information processing device 10 transmits the position information on the map into which the handwritten character is input and the character information as a result of recognizing the handwritten character to the server device 20 (step S8).

Subsequently, the search unit 23 of the server device 20 refers to the search data 211 and extracts the search result based on the received position information on the map and the character information (step S9). Here, the search unit 23 of the server device 20 uses the received characters as keywords to search, for example, data on a website on the Internet, and searches for the name of the facility or the like and the location (address or the like) of the facility or the like. .. The server device 20 stores the name, description, type, and location in advance in the database in association with the ID (identification information) of each facility, etc., and stores the name, description, type, and location in the database in advance. Facilities and the like that include the received keyword may be extracted.

Then, the search unit 23 of the server device 20 extracts the search result based on the received position on the map and the position of the facility or the like. Here, for example, facilities and the like located within the range of the received positions on the map are extracted. Alternatively, a facility or the like in which the sum of the score of the degree of matching based on the keyword and the score of the degree of matching based on the position is equal to or higher than a predetermined threshold value may be extracted.

Subsequently, the display control unit 25 of the server device 20 transmits the search result to the information processing device 10 (step S10). Here, the search result may include, for example, the name of each facility or the like extracted in step S9, the type of each facility, and the location information of each facility.

Subsequently, the display control unit 15 of the information processing device 10 displays the received search result on the map (step S11). Here, the information processing apparatus 10 may display, for example, an icon indicating the type of each facility and the name of each facility at the position of each received facility on the map screen.

5A to 5C are diagrams for explaining an example of a display screen in the information processing apparatus 10 according to the first embodiment. In the example of FIG. 5A, when the character 501 of "sushi" is input by handwriting, the names of the facilities 503A to 503D located within the range 502 of the position on the map where the handwritten characters are input, and each facility. An icon indicating a restaurant, which is the type of, is displayed. As a result, the position and the keyword can be specified by one handwriting input operation, as compared with the case where the operation of specifying the position and the operation of specifying the keyword are performed as in the prior art. it can.

Here, the area including the handwritten character 501 is defined as the range 502 of the position on the map in which the handwritten character is input. The range 502 used for the search may be, for example, a rectangular area circumscribing the handwritten character, or a square area having the center position at the same position as the rectangle. Alternatively, it may be a rectangular area in which the center position is the same as the rectangle and the length of each side of the rectangle is enlarged by a predetermined magnification. Alternatively, it may be a circular or oval area containing handwritten characters.

In the example of FIG. 5B, on the screen of FIG. 5A, for example, a display screen when the map is enlarged by a pinch-out operation for widening the distance between two fingers from the user is shown. When the display control unit 15 of the information processing device 10 receives an operation to enlarge or reduce the map on the screen, the map is enlarged or reduced, and the handwritten characters 501 on the map are also enlarged or reduced according to the map. ..

In the example of FIG. 5C, on the screen of FIG. 5B, for example, a pinch-in operation for narrowing the distance between two fingers and a swipe operation for sliding the fingertips reduce and move the handwritten character 501 on the map. The display screen when it is displayed is shown. When the display control unit 15 of the information processing device 10 accepts an operation of enlarging / reducing the handwritten character 501 on the map, the map is not enlarged / reduced, but only the handwritten character 501 on the map is enlarged / reduced. Further, when the display control unit 15 of the information processing device 10 receives the operation of moving the handwritten character 501 on the map, the display control unit 15 does not move the map but moves only the handwritten character 501 on the map.

When the acquisition unit 14 of the information processing device 10 accepts an operation of enlarging or moving the handwritten characters on the map, the position information in step S8, according to the position of the handwritten characters on the map according to the operation, And the process of transmitting the character information to the server device 20 is performed again. As a result, the search result corresponding to the position of the handwritten character on the map corresponding to the operation is acquired again, and the acquired search result is displayed on the map. In the example of FIG. 5C, the name of each facility 503E located within the range 502C of the position on the map after the handwritten character 501 is reduced and moved, and the icon indicating the restaurant which is the type of each facility are displayed. Has been done. As a result, the handwritten characters once entered can be reused by changing the search position.

The operation of moving the handwritten characters on the map can be performed by, for example, pressing and holding the area of the handwritten characters on the map, selecting with two fingers, or selecting with the stylus pen. You may. Further, the operation with two fingers may be determined as the operation of enlarging, reducing, and moving the map, and the operation with one finger may be determined as the operation of moving the handwritten characters on the map.

≪Processing of information processing equipment≫
Next, with reference to FIGS. 6 to 9, the processing when the information processing apparatus 10 according to the first embodiment searches for a facility or the like by handwritten characters input on the map will be described. FIG. 6 is a flowchart showing an example of a process of searching the facilities of the information processing apparatus 10 according to the first embodiment.

In step S101, the input unit 11 receives an input by a handwriting operation from the user on the screen displaying the map.

Subsequently, the acquisition unit 14 determines whether or not the input data is data that specifies the position of the search target (step S102). Here, when the data input by the user by handwriting operation is predetermined data such as an ellipse, a rectangle, a cross mark, etc., it is determined that the data specifies the range to be searched.

When the input data is the data that specifies the position of the search target (YES in step S102), the acquisition unit 14 determines the next handwritten character and the designated position of one or more search targets. Based on the above, the search result is acquired, displayed by the display control unit 15 (step S103), and the process is terminated.

FIG. 7 is a diagram illustrating an example of a display screen when a plurality of search target ranges and one search keyword are specified. In the example of FIG. 7, the search target ranges 601 and 602 are designated by the ellipse, and the search keyword 603 "ramen" is designated. In this case, facilities and the like located within the search target ranges 601 and 602 are searched based on the search keyword 603. As a result, in the example of FIG. 7, facilities 604A and 604B are displayed within the range 601 and facilities 604C are displayed within the range 602.

On the other hand, when the input data is not the data that specifies the position to be searched (NO in step S102), the acquisition unit 14 determines whether or not the handwritten character is input to a predetermined object on the map. (Step S104). Here, in the acquisition unit 14, for example, when the position of the first character of the input handwritten character string is on the position of the predetermined object, the handwritten character is transmitted to the predetermined object on the map. It may be determined that the input has been made. Alternatively, in the acquisition unit 14, when at least a part of the rectangle including the input handwritten character string is on the position of the predetermined object, the handwritten character is input to the predetermined object on the map. It may be determined that the object is.

When the handwritten character is input to a predetermined object on the map (YES in step S104), the acquisition unit 14 searches based on the handwritten character and the position of the predetermined object on the map. The result is acquired and displayed by the display control unit 15 (step S105), and the process ends. FIG. 8 is a diagram illustrating an example of a display screen when handwritten characters are input to a predetermined object on the map. In the example of FIG. 8, the search keyword 701 "1LDK" is input on the track on the map. In this case, the acquisition unit 14 causes the property of "1LDK" to be searched within a predetermined range 702 including the area along the track, and displays the search results 703A to 703C. It should be noted that a preset search keyword may be used for each predetermined object on the map. For example, when the character string "N" is handwritten on the railroad track, the acquisition unit 14 may search for a newly built property within a predetermined range 702 including the line along the railroad track. Further, for example, when the character string "5 minutes" is handwritten on the railroad track, the acquisition unit 14 may search for the property within a 5-minute walk or less from each station along the railroad track. Good.

The predetermined object on the map described above is not limited to the railroad track, but may be a facility such as a commercial facility or an amusement park. In this case, for example, when "shoes" are handwritten on a predetermined shopping mall, the acquisition unit 14 may search for and display each shoe store included in the predetermined shopping mall.

In addition, when the acquisition unit 14 inputs each handwritten character string and each predetermined object on the map, the handwritten input character string and the position of each predetermined object on the map The search results may be acquired and displayed based on the above. For example, if the character strings "5 minutes" for station A and "10 minutes" for station B on the map are handwritten, the property within a 5-minute walk from station A and B It may be possible to search for each property within a 10-minute walk from the station.

When the handwritten character is input to a predetermined object on the map, the acquisition unit 14 weights the score of the match degree based on the position in the search by a predetermined weight, and sets the score and the match degree score based on the keyword. A facility or the like whose total value of is equal to or greater than a predetermined threshold value may be displayed as a search result. As a result, in a normal search, for example, if you search for the keyword "shoes", only shoe stores are displayed, but if you search for a given object, sporting goods stores and clothing stores that handle shoes are also displayed. Can be done.

On the other hand, when the handwritten character is not input to a predetermined object on the map (NO in step S104), the acquisition unit 14 determines each character string input by hand and the position on the map input by hand. Based on the above, each search result is acquired and displayed by the display control unit 15 (step S106), and the process ends. Here, when there are a plurality of character strings input by handwriting, the acquisition unit 14 acquires and displays the search results for each character string based on the character and the position. FIG. 9 is a diagram illustrating an example of a display screen when a plurality of search keywords are specified. In the example of FIG. 9, when the character 501 of "sushi" (an example of "first handwritten character") and the character 801 of "ramen" (an example of "second handwritten character") are input by hand. At the same time as the search result by the character 501 of "sushi" in FIG. 5A described above, each facility 803A to 803C located within the range 802 of the position on the map in which the character 801 of "ramen" is input is displayed.

In the prior art, when searching with a plurality of different keywords, it was necessary to search for each keyword. On the other hand, according to the present embodiment, the search results can be displayed at once with a plurality of different keywords. This makes it possible to search for each facility along the planned travel route of the day, for example, when making a sightseeing schedule, such as a shrine in area A, a meal in area B, and a hotel in area C. ..

In addition, the acquisition unit 14 simultaneously displays the character string newly handwritten on the map, the new search result by the character string, and each past search result at the position included in the map on the map. It may be displayed in. In this case, for example, the history of the search result by each character string input by hand is stored, and among the character string stored as the history and each search result by each character string, it is displayed on the map screen. Each character string within the range and each search result may be displayed together.

[Second Embodiment]
Next, the second embodiment will be described. In the first embodiment, an example of searching a facility on a map by handwriting has been described. In the second embodiment, an example will be described in which a predetermined name can be input in a place related to the name by handwriting. According to the second embodiment, as in the first embodiment, the user can specify the character and the position by inputting the handwritten character in one operation.

Since the second embodiment is the same as the first embodiment except for a part, the description thereof will be omitted as appropriate. In the following, the parts common to the first embodiment will be omitted, and only the different parts will be described. The contents described in the second embodiment can also be applied to the first embodiment.

<Functional configuration>
Next, with reference to FIG. 10, the functional configuration of the information processing apparatus 10 according to the second embodiment will be described. FIG. 10 is a diagram showing an example of a functional block diagram of the information processing apparatus 10 according to the second embodiment.

≪Information processing device≫
The information processing device 10 according to the second embodiment has a storage unit 17. The storage unit 17 is realized by using, for example, an auxiliary storage device or the like. The storage unit 17 stores the question data 171 described later.

In addition, the information processing device 10 according to the second embodiment further includes a correct answer determination unit 18. Each of these parts is realized by a process in which one or more programs installed in the information processing device 10 are executed by the CPU 104 of the information processing device 10.

The correct answer determination unit 18 displays the question sentence included in the question data 171. In addition, the correct answer determination unit 18 determines whether or not the answer is correct based on the handwritten characters from the user for the question sentence.

<Processing>
Next, the processing of the information processing system 1 according to the second embodiment will be described with reference to FIG. FIG. 11 is a flowchart showing an example of processing of the information processing apparatus 10 according to the second embodiment.

In step S201, the correct answer determination unit 18 displays the question sentence stored in advance on the screen. FIG. 12 is a diagram showing an example of question data 171. In the question data 171, the question sentence, the position of the correct answer, and the characters of the correct answer are stored in association with the question ID. The question ID is identification information of the question (question). The problem sentence is a sentence indicating the problem shown to the user. The position of the correct answer is information indicating the geographical position of the correct answer to the problem, for example, a set of coordinates indicating latitude and longitude. The correct letter is the correct sentence for the question.

Subsequently, the input unit 11 accepts the input of characters indicating the answer to the question sentence from the user by handwriting on the map screen (step S202).

Subsequently, the position determination unit 12 acquires the position on the map in which the handwritten character is input (step S203).

Subsequently, the character recognition unit 13 recognizes the handwritten character and acquires character information (step S204).

Subsequently, the correct answer determination unit 18 matches the position on the map where the handwritten character is input and the character as a result of recognizing the handwritten character with the correct answer position and the character associated with the question sentence. It is determined whether or not to do so (step S205).

If the positions and characters match (YES in step S205), the correct answer determination unit 18 displays "correct answer" on the screen (step S206), and ends the process.

If the positions and characters do not match (YES in step S205), the correct answer determination unit 18 displays "incorrect answer" on the screen (step S207), and the position and characters of the correct answer associated with the question sentence. Is displayed on the map screen (step S208), and the process ends.

FIG. 13 is a diagram showing an example of a display screen of the information processing apparatus 10 according to the second embodiment. In the example of FIG. 13, in response to the question sentence "What is the position of Aomori prefecture and the fruit with the highest yield in Japan in Aomori prefecture?" For the question ID of "001" in the question data 171 of FIG. Characters such as are input by hand at the position of Aomori prefecture, and are displayed as "correct answer" by the process of step S206. In this case, for example, when the center of the area including the character such as "apple" is included in the area of Aomori prefecture, it may be determined that the character is input at the position of Aomori prefecture.

[Third Embodiment]
Next, a third embodiment will be described. In the third embodiment, a language to be translated and an example in which characters can be input by handwritten characters will be described. According to the third embodiment, as in the first embodiment, the user can specify the character and the position by inputting the handwritten character in one operation.

Since the third embodiment is the same as the first embodiment except for a part, the description thereof will be omitted as appropriate. In the following, the parts common to the first embodiment will be omitted, and only the different parts will be described. The contents described in the third embodiment can also be applied to the first embodiment and the second embodiment.

<Functional configuration>
Next, with reference to FIG. 14, the functional configurations of the information processing device 10 and the server device 20 according to the third embodiment will be described. FIG. 14 is a diagram showing an example of a functional block diagram of the information processing device 10 and the server device 20 according to the third embodiment.

The storage unit 21 of the server device 20 according to the third embodiment stores the translation data 212.

The server device 20 further includes a translation unit 27. The translation unit 27 is realized by a process of causing the CPU of the server device 20 to execute one or more programs installed in the server device 20.

The translation unit 27 refers to the translation data 212 and translates the handwritten characters into a language according to the position of the handwritten characters.

Further, the acquisition unit 24 of the server device 20 according to the third embodiment acquires the translation result by the translation unit 27, and the display control unit 25 displays the acquired translation result on the screen of the information processing device 10.

<Processing>
Next, the process of the information processing system 1 according to the third embodiment will be described with reference to FIG. FIG. 15 is a sequence diagram showing an example of processing of the information processing system 1 according to the third embodiment.

In step S301, the display control unit 15 of the information processing device 10 displays the map information on the screen.

Subsequently, the input unit 11 of the information processing device 10 accepts the input of characters by handwriting from the user on the map screen (step S302).

Subsequently, the position determination unit 12 of the information processing device 10 acquires the position on the map in which the handwritten character is input (step S303).

Subsequently, the character recognition unit 13 of the information processing device 10 recognizes the handwritten character and acquires character information (step S304).

Subsequently, the communication unit 16 of the information processing device 10 transmits the position information on the map into which the handwritten character is input and the character information as a result of recognizing the handwritten character to the server device 20 (step S305).

Subsequently, the translation unit 27 of the server device 20 refers to the translation data 212 and extracts the translation result based on the received position information on the map and the character information (step S306). FIG. 16 is a diagram showing an example of translation data 212. In the translation data 212, the position and the language are stored in association with the country ID. The country ID is country, state, or region identification information. The location is information indicating the location of the country or the like related to the country ID. The language is information on the language used in the country or the like related to the country ID.

Subsequently, the display control unit 25 of the server device 20 transmits the translation result acquired from the translation unit 27 by the acquisition unit 24 to the information processing device 10 (step S307).

Subsequently, the display control unit 15 of the information processing apparatus 10 displays the received translation result on the map (step S308).

FIG. 17 is a diagram showing an example of a display screen of the information processing apparatus 10 according to the third embodiment. In the example of FIG. 17, when it is handwritten character 901 of "hello" to the position of the United States, the character 902 "Hello" is a translation result to the position of the United States is displayed. In addition, if it is handwritten input character 903 of "hello" to the Mexican position, character 904 that it is the translation results to the Mexican position "Hola" is displayed.

<Modification example>
The translation unit 27 of the server device 20 may extract the translation result according to the facility on the map and display it on the information processing device 10. For example, if there is a facility related to a predetermined country on the map, the handwritten characters are translated into the language of the predetermined country, and the translation result is displayed at a position corresponding to the facility. FIG. 18 is a diagram showing an example of a display screen of the information processing apparatus 10 according to the third embodiment. In the example of FIG. 18, when it is handwritten character 911 of "Hello", US Embassy, and translation result to the position of the Nigerian Embassy "Hello" of the character 912A, 912B are respectively displayed. In addition, the character "Hola" 913, which is the translation result, is displayed at the position of the Spanish embassy. Facilities related to a given country may be, for example, embassies, restaurants, schools, and the like. This allows, for example, a user to greet a clerk in Chinese when entering a Chinese restaurant.

In the prior art, when translating characters, the user must first specify the translation language, select a text box or the like, enter the characters, and press the translate button. In this case, the translation language cannot be specified without knowing the language of the desired country.

On the other hand, according to the third embodiment, the user can perform translation by displaying the country to be translated on the map screen and performing handwriting input.

[Fourth Embodiment]
Next, a fourth embodiment will be described. In the fourth embodiment, an example in which a search range, a language to be translated, and characters can be input by handwritten characters will be described.

Since the fourth embodiment is the same as the third embodiment except for a part, the description thereof will be omitted as appropriate. In the following, the description of the common parts with the third embodiment will be omitted, and only the different parts will be described. The contents described in the fourth embodiment can also be applied to the first embodiment to the third embodiment.

The search unit 23 of the server device 20 according to the fourth embodiment uses both the character indicated by the handwritten character and the character resulting from the translation of the character into the translation unit 27 as keywords, and is a facility related to the position of the handwritten character. To search for. Further, the search unit 23 of the server device 20 according to the fourth embodiment performs an information processing device for the name of the searched facility and the characters obtained by translating the name into the language indicated by the handwritten character (user's native language). It is displayed on the map screen of 10.

<Processing>
Next, the processing of the information processing system 1 according to the fourth embodiment will be described with reference to FIG. FIG. 19 is a flowchart showing an example of processing of the server device 20 according to the fourth embodiment.

In step S401, the search unit 23 refers to the search data 211 and extracts the search result based on the received position information on the map and the character information. This process is the same as the process of step S9 described above.

Subsequently, the translation unit 27 refers to the translation data 212 and extracts the translation result based on the received position information on the map and the character information (step S402). This process is the same as the process of step S306 described above.

Subsequently, the search unit 23 refers to the search data 211 and extracts the search result based on the received position information on the map and the character information of the translation result extracted by the translation unit 27 in the process of step S401. (Step S403).

Subsequently, the translation unit 27 translates the character information of the search result extracted by the search unit 23 in the processes of steps S401 and S403 (step S404).

Subsequently, the display control unit 25 transmits the extracted search result and the translation result to the information processing device 10 (step S405).

FIG. 20 is a diagram showing an example of a display screen of the information processing apparatus 10 according to the fourth embodiment. In the example of FIG. 20, when the character 921 "ramen" is handwritten at a predetermined position in the United States, the character "Ramen" 922, which is the translation result, is displayed at the position in the United States. In addition, the English name 924A of the facility located within the range 923 of the position on the map in which the character "ramen" 921 is input to the Japanese name 924B which is the native language of the user are displayed.

<Modification example>
In the above, an example of searching for a facility name or the like has been described, but as a search target, for example, a menu or the like provided at a restaurant may be searched. In this case, for example, when the user inputs "fried rice" in handwritten characters, "fried rice" is translated as "fried rice", and the characters "fried rice" are placed at the position of the Chinese restaurant on the map including "fried rice" in the menu. May be displayed.

Although the examples of the present invention have been described in detail above, the present invention is not limited to such specific embodiments, and various modifications are made within the scope of the gist of the present invention described in the claims.・ Can be changed.

Each functional unit of the information processing device 10 and the server device 20 may be realized by cloud computing composed of, for example, one or more computers. In this case, for example, the search unit 23 of the server device 20 may be realized by an external search server. Further, the information processing device 10 and the server device 20 may be configured as an integrated device. The server device 20 may have at least a part of each functional unit of the information processing device 10. The information processing device 10 may have at least a part of each functional unit of the server device 20.

The acquisition units 14 and 24 are examples of a "first acquisition unit", a "second acquisition unit", and a "third acquisition unit". The display control units 15 and 25 are examples of a "first display control unit", a "second display control unit", and a "third display control unit".

1 Information processing system 10 Information processing device 11 Input unit 12 Position determination unit 13 Character recognition unit 14 Acquisition unit 15 Display control unit 16 Communication unit 17 Storage unit 171 Question data 18 Correct answer determination unit 20 Server device 21 Storage unit 211 Search data 212 Translation Data 22 Input unit 23 Search unit 24 Acquisition unit 25 Display control unit 26 Communication unit 27 Translation unit

Claims (15)

On the computer
When you receive handwriting input on the screen where the map is displayed,
When the range of the handwriting input includes at least a part of the area of the predetermined object on the map, the area of the predetermined object on the map and the facility related to the character information corresponding to the handwriting of the handwriting input . Get information,
A program that executes processing. On the computer
When you receive handwriting input on the screen where the map is displayed,
The first handwritten input indicating the first search target and the second handwritten input indicating the second search target different from the first search target are acquired.
The range of the first handwritten input on the map and the information of the first facility related to the character information indicated by the first handwritten input are acquired.
The range of the second handwritten input on the map and the information of the second facility related to the character information indicated by the second handwritten input are acquired.
The positions of the first facility and the second facility are simultaneously displayed on the screen.
A program that executes processing . On the computer
When you receive handwriting input on the screen where the map is displayed,
The character information corresponding to the handwriting of the handwriting input acquires the information translated into the language related to the position of the handwriting input on the map.
Display the translated information on the screen.
A program that executes processing . Among the facility information associated with the position within the range including the handwritten input position on the map, the facility information related to the acquired character information is acquired.
Based on the acquired information on the facility, information indicating the location of the facility is displayed on the screen.
The program according to any one of claims 1 to 3 . The handwriting of the handwriting input is displayed at the position on the screen where the handwriting is input.
When the handwriting of the handwriting input is enlarged, reduced, or moved, the range of the handwriting input after the operation on the map and the facility information related to the character information are acquired again.
The program according to any one of claims 1 to 4 . When the range of the handwritten input includes at least a part of the area of the predetermined object on the map, the area of the predetermined object on the map and the information of the facility related to the character information are acquired.
The program according to any one of claims 1 to 5 . The first character information and the second character information indicated by the handwriting input are acquired, respectively .
With respect to the first character information, the range of the handwritten input of the first character information on the map and the information of the facility related to the character information indicated by the handwritten input of the first character information are acquired.
Regarding the second character information, the range of the handwritten input of the second character information on the map and the information of the facility related to the character information indicated by the handwritten input of the second character information are acquired.
The position of the facility related to the first character information and the position of the facility related to the second character information are simultaneously displayed on the screen.
The program according to any one of claims 1 to 6 . Obtain multiple character information candidates indicated by the handwritten input, and obtain
For each of the plurality of character information candidates, the range of the handwritten input on the map and the facility information related to the character information indicated by the handwritten input are acquired.
The location of the facility related to each of the plurality of character information candidates is simultaneously displayed on the screen.
The program according to any one of claims 1 to 7 . Obtain information indicating the range of the search target position handwritten on the screen on which the map is displayed.
Acquire the range of the position of the search target and the facility information related to the character information, and obtain the information.
The location of the facility on the map is displayed on the screen.
The program according to any one of claims 1 to 8 . The computer
When handwritten input is received on the screen on which the map is displayed, if the range of the handwritten input includes at least a part of the area of the predetermined object on the map, the area of the predetermined object on the map and the area of the predetermined object are described. Acquire facility information related to text information according to the handwriting of handwriting input ,
An information processing method that executes processing. The computer
When you receive handwriting input on the screen where the map is displayed,
Acquire the first handwritten input indicating the first search target and the second handwritten input indicating the second search target different from the first search target.
The range of the first handwritten input on the map and the information of the first facility related to the character information indicated by the first handwritten input are acquired.
The range of the second handwritten input on the map and the information of the second facility related to the character information indicated by the second handwritten input are acquired.
The positions of the first facility and the second facility are simultaneously displayed on the screen.
An information processing method that executes processing. The computer
When you receive handwriting input on the screen where the map is displayed,
The character information corresponding to the handwriting of the handwriting input acquires the information translated into the language related to the position of the handwriting input on the map.
Display the translated information on the screen.
An information processing method that executes processing. When handwritten input is received on the screen on which the map is displayed, if the range of the handwritten input includes at least a part of the area of the predetermined object on the map, the area of the predetermined object on the map and the area of the predetermined object are described. An information processing device having an acquisition unit that acquires facility information related to character information according to the handwriting of handwriting input. When you receive handwriting input on the screen where the map is displayed,
Acquire the first handwritten input indicating the first search target and the second handwritten input indicating the second search target different from the first search target.
The range of the first handwritten input on the map and the information of the first facility related to the character information indicated by the first handwritten input are acquired.
An acquisition unit that acquires information on the range of the second handwriting input on the map and information on the second facility related to the character information indicated by the second handwriting input.
An information processing device including a display control unit that simultaneously displays the positions of the first facility and the second facility on the screen. When you receive handwriting input on the screen where the map is displayed,
An acquisition unit that acquires information in which character information corresponding to the handwriting of the handwriting input is translated into a language related to the position of the handwriting input on the map.
An information processing device having a display control unit for displaying translated information on the screen.

Images