JP2016139342A - Information input method through coordination between apparatuses, information processing apparatus, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce an operation load on a user when the user inputs information to a digital camera.SOLUTION: A digital camera 51 transmits, to a smartphone 52, information, including a captured image on a display screen 53 and an item input through a user's touch operation to be displayed on a display screen 54. The smartphone 52 transmits input information received through the display of the information to the digital camera 51. The digital camera 51 inputs the input information to an item input through a touch operation.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an information input method, an information processing apparatus, and a computer program for reducing an operation burden such as character input by cooperation of a plurality of information processing apparatuses held by a user.

  In recent years, some devices such as a digital camera and a video camera are equipped with a function of inputting arbitrary characters such as a title and a file name from an operation screen for a photographed image. Furthermore, for the purpose of improving the convenience of the user, there is a conventional technique for inputting characters to a device such as a digital camera using a portable terminal that is familiar to the user (see Patent Document 1).

  In such a conventional technique, the user focuses on the character input area on the screen on the device side, switches the operation mode on the portable terminal side to the character input mode, and inputs characters. When the mode is switched to the character input mode, an application is started on the mobile terminal side, a character input area is displayed on the screen, and character input using a keyboard or the like becomes possible.

JP 2010-198489 A

  In the prior art, information on the device side such as a digital camera is not displayed on the screen on the mobile terminal side. Therefore, when the user inputs characters to the mobile terminal, it is necessary to check the contents of the screen display on the device side, such as which part of which device he / she is inputting characters, which is complicated. there were. Such a problem occurs in common when two or more information processing apparatuses are linked to input characters.

  It is a main object of the present invention to provide a technique for reducing a user's operation burden when inputting information by linking two or more information processing apparatuses.

  According to the present invention, a plurality of information processing devices each having a display screen for inputting information are connected via a communication path, and the screen information of the display screen of any one of the first information processing devices is transferred to another second information processing. There is provided an information input method by device cooperation, in which input information displayed on the display screen of an apparatus and input information received by the second information processing apparatus through the display of the screen information is input to the first information processing apparatus.

  According to the present invention, since the information on the display screen of the first information processing device is displayed on the display screen of the second information processing device, when information is input from the second information processing device to the first information processing device. The operation burden on the user can be reduced.

The block diagram which shows the hardware constitutions of information processing apparatus. The functional block diagram of information processing apparatus. (A), (b) is processing-process explanatory drawing by 1st Example. Explanatory drawing which shows the specific processing content of 1st Example. Processing procedure explanatory drawing by 2nd Example. The example of a screen which shows the specific processing content by 2nd Example. The flowchart which shows the process sequence by information processing apparatus. Explanatory drawing which shows the specific processing content of information processing apparatus. (A), (b) is processing-process explanatory drawing by 3rd Example. Explanatory drawing of the process sequence by 4th Example. (A), (b) is processing-process explanatory drawing by 4th Example.

Hereinafter, embodiments of the present invention will be described.
FIG. 1 is a hardware configuration diagram of the information processing apparatus according to the present embodiment. A hardware configuration example common to a plurality of information processing apparatuses to be described later is shown. The information processing apparatus 1 includes a controller unit 11, an interface unit 12, a touch panel display 13, and a hard disk 14. The controller unit 11 is a computer including a CPU 15, a ROM 16, and a RAM 17. A CPU (Central Processing Unit) 15 controls the operation of the entire apparatus by executing a computer program. This computer program includes an application program for realizing individual functions such as a program for a touch sensor, in addition to a basic program for controlling the operation of the entire apparatus. These programs are stored in a ROM (Read Only Memory) 16 and a hard disk 14. Then, it is appropriately read out to a RAM (Random Access Memory) 17 as a temporary storage area. That is, the RAM 17 is a work area used when the CPU 15 executes each process. The RAM 17 also temporarily stores data input by the user. The hard disk 14 stores UI data for realizing a UI (User Interface) operation in addition to the above computer program (part). The UI data includes, for example, UI operation items such as operation buttons and input items operated by the user, a display screen layout, a character input area, a dedicated character input area, a software keyboard, and the like. The software keyboard is a known information input tool displayed on the touch panel display 13 and capable of inputting and converting characters by a touch operation or the like.

  The touch panel display 13 has a GUI (Graphical User Interface) serving as a display screen. The GUI operation items and the like are displayed on the GUI as appropriate. The touch panel display 13 also accepts an input operation to an input item that is one of UI operation items. That is, the touch panel display 13 includes a touch sensor, and a signal detected by the touch sensor is processed by a touch sensor program stored in the ROM 16. Then, a touch position by the user is calculated as a coordinate value on the touch panel display 13. The correspondence between the calculated coordinate value and the coordinate value of the UI operation item displayed on the touch panel display 13 indicates what type of UI operation item the user operated and what type of operation. Is detected. Moreover, a required process can be executed based on the detection result.

  For example, assume that the user touches an input item displayed on the display screen once. In this case, the input item and the operation content that is touched once are detected. When a character input area is touched among input items, a virtual keyboard such as a software keyboard is automatically activated. Thus, when a specific function is assigned to the input item, a function corresponding to the operation content can be executed. The information processing apparatus 1 is connected to the same type of external apparatus via the interface unit 12 via a communication path, and transmits and receives various data.

  FIG. 2 is a functional configuration diagram when inputting characters by linking two information processing apparatuses that can be connected via a communication path. Here, an example in which one information processing apparatus is mounted on a digital camera and another information processing apparatus is mounted on a smartphone is shown. The information processing device mounted on the digital camera is referred to as the first information processing device 2, and the information processing device mounted on the smartphone is referred to as the second information processing device 4. The digital camera itself is a device that can input characters. Here, an example in which characters are input by a smartphone that can input information relatively easily will be described. The first information processing device 2 and the second information processing device 4 each have the hardware configuration shown in FIG. 1 and are connected to each other via the network 3. Note that “characters” include symbols, numbers, phrases, and the like in addition to narrowly-defined characters. Other components mounted on digital cameras and smartphones are omitted.

  The first information processing apparatus 2 mounted on the digital camera operates as the control unit 21 and the communication unit 31 when the CPU executes the first computer program of the present invention. The control unit 21 functions as a control unit that comprehensively controls the entire function of the digital camera. The control unit 21 also functions as an operation detection unit 25, a connection determination unit 26, a screen capture unit 27, an operation item analysis unit 28, a virtual keyboard display unit 29, and a data display unit 30. The operation item is the UI operation item described above. A virtual keyboard is an information input tool such as a software keyboard. On the other hand, the second information processing apparatus 4 mounted on the smartphone operates as the control unit 41 and the communication unit 48 when the CPU executes the second computer program. The control unit 41 functions as a control unit that comprehensively controls the entire function of the smartphone. The control unit 41 also functions as an information analysis unit 43, a data display unit 44, a virtual keyboard display unit 45, an operation detection unit 46, and a state determination unit 47.

  The function of each part of the first information processing apparatus 2 will be described in detail. For the hardware to be used, refer to what is shown in FIG. 1 as appropriate. Of the control unit 21, the operation detection unit 25 functions as a detection unit that detects the operation content of the touch panel display 13. Specifically, an operation signal representing the operation content for any of a plurality of input items displayed on the display screen of the touch panel display 13 is received, and the operation content is detected. If the operated input item is a character input area (UI operation item for character input), it is detected that it is a character input instruction. The connection determination unit 26 determines the presence or absence of an external device connected in the communication path, in this example, the second information processing device 4. The screen capture unit 27 functions as a capture unit that captures the display content of the touch panel display 13 and generates a captured image. “Capture” means capturing a display screen and saving it as image data. The operation item analysis unit 28 analyzes the operation item and operation content detected by the operation detection unit 25. For example, when the input item touched is a character input area, the type of the character input area, the size of the display screen, the display position of the character input area on the display screen, and the like are specified. The identification is performed based on the UI data stored in the hard disk 14. The virtual keyboard display unit 29 displays a software keyboard and the like. The data display unit 30 functions as a display unit that displays UI parts, character data, and the like on the touch panel display 13. The communication unit 31 transmits the captured image generated by the screen capture unit 27, the analysis result of the operation item analysis unit 28, and the like to the second information processing apparatus 4 via the network 3 that forms a communication path. The communication unit 31 also functions as an acquisition unit that acquires information transmitted from the second information processing device 4.

  The configuration of each part of the second information processing device 4 will be described in detail. The communication unit 48 functions as an acquisition unit that acquires information such as a captured image and an analysis result transmitted from the first information processing apparatus 2. Further, the input information is transmitted to the first information processing apparatus 2. Of the control unit 41, the information analysis unit 43 analyzes the information received from the first information processing apparatus 2. For example, when the input item touched by the first information processing apparatus 2 is a character input area, the type of the character input area, the size of the display screen, the display position of the character input area, and the like are stored in advance. Identify based on data. Based on the analysis result of the information analysis unit 43, the data display unit 44 performs a superimposed display of a captured image and a character input area on the captured image. For example, UI operation items such as a character input area of the second information processing apparatus 4 itself are superimposed and displayed on the captured image. The virtual keyboard display unit 45 displays a software keyboard and the like. The operation detection unit 46 detects the operation content on the touch panel display 13 of the own device. For example, a character selected (input) on the software keyboard is detected. The state determination unit 47 monitors the operation state on the second information processing device 4 side. For example, it is determined whether or not character input has been completed.

[Information input method]
Next, an embodiment of an information input method based on device cooperation performed by each of the information processing devices 2 and 4 configured as described above will be described. In this information input method, first, the screen information of the display screen of the first information processing device 2 is transmitted to the second information processing device 4 and displayed on the display screen of the second information processing device 4. The input information received by the second information processing device 4 through the display of the screen information is transmitted from the second information processing device 4 to the first information processing device 2. That is, an input is made to the first information processing apparatus 2. The first information processing apparatus 2 is mounted on a digital camera that captures at least one of a still image and a moving image, for example. The second information processing device 4 is mounted on a smartphone whose information input is relatively easier than a digital camera. The communication path is formed by wireless communication such as WiFi.
Hereinafter, as an example of information input, an embodiment in which characters related to an image taken with a digital camera are input will be described. The digital camera has a server function and is connected to a smartphone via a communication path.

[First embodiment]
FIG. 3 is an explanatory diagram of the procedure of the first embodiment of the information input method. (A) is a procedure example on the first information processing device 2 side, and (b) is a procedure example on the second information processing device 4 side. Referring to FIG. 3A, the operation detection unit 25 of the first information processing apparatus 2 detects an operation on the character input area of the display screen of the touch panel display 13 (S101). The connection determination unit 26 determines whether or not the second information processing device 4 is connected via a communication path when an operation is detected by the operation detection unit 25 (S102). When the second information processing device 4 is connected (S102: YES), the screen capture unit 27 captures the display content of the touch panel display 13 and stores it as a captured image (S103). Next, the operation item analysis unit 28 analyzes the information related to the character input area designated by the touch operation detected in S1 (S104). “Character input area related information” includes, for example, the type of character input area (information that distinguishes it from other character input areas), the size of the display screen, and the position of the character input area on the display screen. For example, the coordinate value shown. The analysis is a process for identifying such information. Subsequently, the communication unit 31 uses the captured image and the analysis result in S104 as screen information, and transmits (transmits) the screen information to the second information processing apparatus 4 through the communication path (S105). The communication unit 31 also waits for input information input on the second information processing apparatus 4 side, for example, character data, to be transmitted from the apparatus 4, and receives (acquires) when it is transmitted (S106). In S102, when the second information processing apparatus 4 is not connected (S102: NO), the virtual keyboard display unit 29 displays, for example, a software keyboard of the first information processing apparatus 2 itself. Then, input of character data by the first information processing apparatus 2 itself is enabled (S107). Thus, the data display unit 30 stores the character data received in S106 or the character data input from the software keyboard in S107 in the RAM 17 in association with the character input area. Then, this character data is displayed in the character input area of the display screen (S108), and the process is finished.

  Next, a procedure example of processing performed by the second information processing apparatus 4 will be described with reference to FIG. In the second information processing device 4, the communication unit 48 acquires screen information from the first information processing device 2 side. In this example, the captured image and the information related to the character input area are received as screen information and stored in the RAM 17 (S109). Then, the information analysis unit 43 analyzes the received screen information (S110). Specifically, the type of the character input area, the size of the display screen, the coordinate value indicating where the character input area is arranged on the display screen, and the like are specified. Subsequently, the data display unit 44 displays the captured image on the display screen based on the information analyzed in S110, and the character input area prepared on the second information processing device 4 side is displayed at the position of the character input area. The images are displayed in an overlapping manner (S111). For example, the <input type = “text”> element, which is an HTML component for character input, is specified and overlapped on the character input area of the captured image serving as the background image. Thereby, the character input to the said character input area in the 2nd information processing apparatus 4 side is attained. Thereafter, the virtual keyboard display unit 45 displays the software keyboard of the second information processing apparatus 4 itself (S112). And the operation detection part 46 detects the touch operation with respect to the software keyboard by a user, and receives a character input (S113). The state determination unit 47 determines whether or not the character input by the user on the second information processing device 4 side is completed (S114). When the character input is not completed (S114: NO), the process returns to S113. On the other hand, when the character input is completed (S114: YES), the communication unit 48 transmits the character data input on the second information processing device 4 side to the first information processing device 2 (S115), and performs the process. Finish.

  Thus, in the first embodiment, the screen information of the display screen of the first information processing device 2 is displayed on the display screen of the second information processing device 4, and the input received on the second information processing device 4 side through this display. Information is input to the display screen on the first information processing apparatus 2 side. For this reason, the second information processing apparatus 4 side can intuitively understand which part of the first information processing apparatus 2 side is used for information input, thereby reducing an operation burden when information is input through device cooperation. .

  FIG. 4 specifically explains the state of information input according to the first embodiment. A display screen 53 is provided on the back of the digital camera 51. In addition to the photographed image (Photo01), the display screen 53 displays a character input area such as a title, a comment, and a tag regarding the photographed image. That is, the digital camera 51 can accept input of a title, a comment, or a tag for the captured image. Here, it is assumed that a touch operation is performed on the comment input item 53a which is one of the character input areas. Then, the digital camera 51 transmits instruction information indicating that a character input to the capture image and comment input item 53a on the display screen 53 is instructed to the connection destination smartphone 52 (# 1). The image title, comment, and tag are examples of character information that can be input by the digital camera 51, and are not limited thereto. As long as it is character information associated with an image as attribute information, for example, a file name of image data, other identification information, or the like may be input.

  The smartphone 52 activates a web browser, an application program, and the like, and displays information received from the digital camera 51 on the display screen 54. Then, based on the received information, the position where the character input is instructed in the captured image is analyzed, and its own character input UI part (character input area) 54a is superimposed and displayed. In addition, the software keyboard 55 is displayed to accept character input from the user. When the digital camera 51 receives an input to a character input area of a title and a tag instead of a comment, the smartphone 52 also receives the input of these character data. When the input is completed, the input information is stored in association with the display screen 54. Further, this input information is transmitted to the digital camera 51 (# 2). The digital camera 51 that has received the input information (such as character data) stores the input information in association with the display screen 53. Character data is displayed in the comment input item 53a. Thereby, the operation load at the time of inputting information (character data) to the digital camera 51 can be reduced.

[Second Embodiment]
Next, a second embodiment of the information input method will be described. In the second embodiment, the first information processing apparatus 2 acquires the size or resolution of the display screen included in the second information processing apparatus 4, and determines the area to be captured from the display screen of the own apparatus based on the acquired information. An example of the case will be described. The description of the same parts as those in the first embodiment is omitted. For convenience, the operation of the first information processing device 2 will be described as the operation of a digital camera, and the operation of the second information processing device 4 will be described as the operation of a smartphone.

  FIG. 5 is an explanatory diagram of the procedure of processing performed on the digital camera (first information processing apparatus 2) side. On the digital camera side, a touch operation on the character input area of the display screen is detected (S201). The touch operation is an operation representing a character input instruction in this example. On the digital camera side, it is also determined whether a smartphone is connected (S202). When connected (S202: YES), the screen information of the display screen of the smartphone is acquired and analyzed (S203). “Screen information” is information such as the vertical and horizontal sizes and resolution of the display screen, for example, and is requested from the digital camera side (screen capture unit 27) when connected to a smartphone. This information may be acquired and stored in advance. Subsequently, the digital camera generates a capture image corresponding to the screen information on the smartphone side (S204). For example, the screen is cut out centering on a character input area in which character input is instructed so as to match the vertical and horizontal sizes of the display screen of a smartphone, and this is used as a captured image. At this time, in addition to the vertical and horizontal sizes, the captured image may be easier to see on the smartphone side in consideration of the resolution. The subsequent processing from S205 to S209 is the same as the processing from S104 to S108 in FIG.

  Next, with reference to FIG. 6, the state of information input for device cooperation according to the second embodiment will be described in detail. FIG. 6A shows a state on the smartphone 52 side. An area 61 is a range in which a captured image from the digital camera 51 can be displayed on the display screen 54, and is transmitted to the digital camera 51 as an example of “display screen information”. A software keyboard 62 is also displayed on the display screen 54. FIG. 6B shows the state of the digital camera 51. The digital camera 51 that has received the information on the area 61 analyzes which area of the display screen 54 should be cut and captured. In this example, a capture image is generated with an area 64 having the same size as the area 61 around the touch location 63 as a capture area. FIG. 6C shows an example of a captured image 65 generated by the digital camera 51. FIG. 6D is an example in which an information input image 66 based on the capture image 65 is displayed on the display screen 54 on the smartphone 52 side. In the example shown in the drawing, the UI operation component in the character input area is displayed superimposed on the captured image 65, and character input is accepted.

  Thus, in the second embodiment, the digital camera 51 acquires information (size, resolution) of the display screen of the smartphone 52, and determines the capture area of its own display screen according to this information. Therefore, a capture image having a minimum amount of information is transmitted to the smartphone 52, and the load during communication can be reduced compared to the capture image of the entire screen.

[Third embodiment]
Next, a description will be given of a third embodiment of the information input method. In the third embodiment, an example in which a smartphone on which the second information processing device 4 is mounted can recognize in advance as a character input area a portion for which information input has been instructed. A description of the same parts as those in the first embodiment will be omitted. The operation of the first information processing device 2 will be described as the operation of a digital camera, and the operation of the second information processing device 4 will be described as the operation of a smartphone.

  FIG. 7 is an explanatory diagram of the procedure on the smartphone side. The smartphone receives the captured image and information related to the character input area from the digital camera (S301). The received screen information is analyzed (S302). After that, an index indicating a character input area instructed to input information, for example, a mark such as an arrow, is superimposed and displayed in the captured image (S303). Thereby, in a smart phone, information input to an input item specified by an index is enabled. Specifically, the smartphone's own software keyboard and a dedicated character input area are displayed (S304). The dedicated character input area is, for example, a character input area that is always displayed at the same position regardless of the application. The processing of S305 to S307 is the same as S113 to S115 of FIG.

  Next, the state of information input according to the third embodiment will be described in detail with reference to FIG. The description of the same part as in FIG. 6 is omitted. The smartphone 52 receives screen information including the captured image and displays it on the display screen 54. Also, a dedicated character input area 81 is displayed, and an index (arrow) 82 indicating which input item of the captured image is input is displayed. Therefore, a user who performs character input using the smartphone 52 can intuitively grasp which input item on the captured image is input by referring to the index 82.

  As described above, according to the third embodiment, by providing the dedicated character input area 81 and the index 82, the operation load when inputting characters from an external device using a smartphone to the digital camera is further reduced. Can be made.

[Fourth embodiment]
Next, a description will be given of a fourth embodiment of the information input method. In the fourth embodiment, an example will be described in which an image of an input item other than the input item specified by the index described in the third embodiment is included in a captured image generated by a digital camera. In this case, in addition to the input item specified by the index, the smartphone allows information input to other input items. The description of the same parts as those in the first to third embodiments is omitted. The operation of the first information processing device 2 will be described as the operation of a digital camera, and the operation of the second information processing device 4 will be described as the operation of a smartphone.

  FIG. 9 is an explanatory diagram of the processing procedure of the fourth embodiment, where (a) is a digital camera side, and (b) is a smartphone side processing example. In FIG. 9A, steps S401 to S404 are the same as the processes of S101 to S104 in FIG. In the fourth embodiment, after these processes, the digital camera determines whether or not the captured image includes another character input area that is not instructed to input information (S405). If included (S405: YES), the digital camera also analyzes the information related to the other character input area (S406). “Character input area-related information” is, for example, the type of the other character input area, a coordinate value indicating where the other character input area is arranged on the display screen, and the like. In this way, the digital camera includes other information related to the character input area that is not instructed to input information in the character input area that is instructed to transmit the character input to the smartphone side (S407). If it is determined in S405 that no other character input area is included (S405: NO), the process immediately proceeds to S407. The subsequent processing of S408 to S410 is the same as the processing of S106 to S108 in FIG.

  In FIG.9 (b), S411-S415 are the same as the process of S301-S305 of FIG. In the fourth embodiment, after these processes, it is determined whether or not a plurality of character input areas are included in the captured image (S416). If included (S416: YES), the smartphone determines whether there is a touch operation to another character input area (S417). When the touch operation is to another character input area (S417: YES), the process returns to S413. The processing when a plurality of character input areas are not included in S416 (S416: NO) and when there is no touch operation in S417 (S417: NO) is the same as S306 to S307 in FIG. 7 (S418, S419). .

  Thus, according to the fourth embodiment, it is possible to input characters on the smartphone side even in a character input area where no information input is instructed on the digital camera side. And since all the character data input with the smart phone can be transmitted toward a digital camera from a smart phone, the operation burden of the user at the time of character input is reduced.

[Fifth embodiment]
Next, a description will be given of a fifth embodiment of the information input method. In the fifth embodiment, an example is shown in which character input is performed using a dedicated character input area on the smartphone side. The description of the same parts as those in the first to third embodiments is omitted. The operation of the first information processing device 2 will be described as the operation of a digital camera, and the operation of the second information processing device 4 will be described as the operation of a smartphone.

  FIG. 10 is an explanatory diagram of the processing procedure on the smartphone side in the fifth embodiment. The processing of S501 to S502 is the same as the processing of S301 to S302 in FIG. In the fifth embodiment, after these processes, the smartphone determines whether to use the dedicated character input area to input characters when the user inputs characters (S503). The dedicated character input area is, for example, an area 81 in FIG. When inputting characters using the dedicated character input area (S503: YES), processing similar to S303 to S304 in FIG. 7 is performed (S504, S505). When character input is not performed using the dedicated character input area (S503: NO), processing similar to S111 to S112 in FIG. 3B is performed (S506, S507). The subsequent processing of S508 to S510 is the same as the processing of S305 to S307 in FIG.

  Thus, according to 5th Example, the content of a process can be switched by the smart phone side according to whether a character input is performed using an exclusive character input area. This increases the degree of freedom in selecting the input method.

[Sixth embodiment]
Next, a description will be given of a sixth embodiment of the information input method. In the sixth embodiment, on the digital camera side, the vertical size and horizontal size of the area to be captured are compared, and recommended screen orientation information indicating the recommended display screen orientation when displaying the captured image is displayed according to the comparison result. An example in the case of determination will be described. In this case, the determined recommended screen orientation information is included in the screen information and transmitted to the smartphone. The description of the same parts as those in the first embodiment is omitted.

  FIG. 11 is an explanatory diagram of the processing procedure of the sixth embodiment, where (a) is an example on the digital camera side and (b) is an example on the smartphone side. In FIG. 11A, the processing in S601 to 603 is the same as the processing in S401 to S403 in FIG. In the sixth embodiment, after these processes, the digital camera acquires the vertical and horizontal sizes of the captured image (S604). Then, the vertical size and horizontal size of the acquired captured image are compared (S605). When the horizontal size is equal to or larger than the vertical size (S605: YES), the recommended screen orientation of the smartphone is determined horizontally (S606). If the horizontal size is not equal to or larger than the vertical size (S605: NO), the recommended screen orientation is determined to be vertical (S607). Thereafter, the information related to the character input area in which the information input is designated is analyzed (S608). Further, the captured image, the information related to the character input area, and the determined recommended screen direction information are transmitted to the smartphone (S609). The subsequent processing of S610 to S612 is the same as S408 to S410 of FIG.

  On the smartphone side, processing is performed according to the procedure shown in FIG. That is, the captured image, the information related to the character input area, and the recommended screen orientation information are received (S613). Subsequently, the received captured image, the information related to the character input area and the information about the recommended screen are analyzed (S614). For example, the type of the character input area, the coordinate value indicating where the character input area is arranged on the display screen, and the recommended screen orientation is vertical or horizontal. Then, it is determined whether the current screen orientation of the smartphone itself is different from the recommended screen orientation analyzed in S614 (S615). If the recommended screen orientation is not different (S615: NO), the process proceeds to S618. If they are different (S615: YES), for example, an arrow indicating the rotation direction (information prompting the change) is displayed over the information currently displayed on the screen, and the user is prompted to change the orientation of the smartphone to the recommended screen direction. (S616). Note that the method of prompting the change is not limited to the above example. Then, it is determined whether the current screen orientation of the smartphone itself and the analyzed recommended screen orientation are the same (S617). If the recommended screen orientation is not the same (S617: NO), the process returns to S616. If the recommended screen orientations are the same (S617: YES), the process proceeds to S618. The processing of S618 to S622 is the same as S506 to S510 of FIG.

  As described above, according to the sixth embodiment, the vertical and horizontal sizes of the captured images are compared on the digital camera side, and when the horizontal size is equal to or larger than the vertical size, the recommended screen orientation information is determined to be horizontal. If the horizontal size is not greater than the vertical size, the recommended screen orientation information is determined vertically. Then, the recommended screen orientation information is associated with the captured image and the analyzed information on the operation item for character input, and transmitted to the smartphone side. On the other hand, on the smartphone side, information that prompts the user to change to the direction of the recommended screen orientation of the user is displayed based on the recommended screen orientation information. Therefore, when a notification of a character input instruction is received from the digital camera, the captured image is displayed larger on the smartphone side, so that it is easy to see and the convenience during character input is improved.

[Modification]
In the present embodiment and example, the example in which the first information processing device 2 and the second information processing device 4 are connected via the network 3 has been described. However, in the present invention, a plurality of information processing apparatuses each having a display screen for inputting information are connected via a communication path, and the screen information on the display screen of any one information processing apparatus is displayed on the other information processing apparatus. The present invention can also be implemented in a form that is displayed on the screen.
Moreover, although the 1st information processing apparatus 2 was mounted in the digital camera and the example in case the 2nd information processing apparatus 4 was mounted in the smart phone was demonstrated in the 1st-6th Example, these mounted devices are these. It is not limited to examples. The digital camera may be a tablet terminal or a mobile terminal. The smartphone may also be a tablet terminal or a personal computer.

  The present invention can also be implemented in a form in which the computer program of the present invention is supplied to an information processing apparatus via a network or a portable storage medium, and the CPU reads and executes the computer program. The present invention can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Claims (15)

A plurality of information processing apparatuses each having a display screen for inputting information are connected via a communication channel, and the display information of the display screen of any one of the first information processing apparatuses is displayed on the display of the other second information processing apparatus. Displaying on the screen and inputting the input information received by the second information processing apparatus through the display of the screen information to the first information processing apparatus;
Information input method by device cooperation. The screen information includes a captured image obtained by capturing a display screen of the first information processing apparatus, and instruction information representing an input item in which information input is instructed in the display screen.
The information input method according to claim 1. The screen information further includes an index for specifying the input item,
The second information processing apparatus enables information input to an input item specified by the index;
The information input method according to claim 2. The captured image includes an image of an input item other than the input item specified by the index,
The second information processing apparatus enables information input to other input items in addition to the input item specified by the index.
The information input method according to claim 3. The second information processing apparatus displays a character input area corresponding to the input item on a display screen of the own apparatus, and stores information input through the display in association with the input item.
The information input method according to claim 3 or 4. The second information processing apparatus causes a character input area corresponding to the input item to be displayed so as to overlap an input item instructed to input information in the captured image.
The information input method according to claim 5. The first information processing apparatus acquires a size of a display screen included in the second information processing apparatus, and determines a region to be captured from the display screen of the own apparatus based on the acquired size.
The information input method according to any one of claims 2 to 6. The first information processing apparatus acquires the resolution of the display screen of the second information processing apparatus, and determines a region to be captured from the display screen of the own apparatus based on the acquired resolution.
The information input method according to any one of claims 2 to 7. The first information processing apparatus compares a vertical size and a horizontal size of the area to be captured, and recommends screen direction information indicating a recommended display screen direction when displaying the captured image according to the comparison result. The recommended screen orientation information determined is included in the screen information and transmitted to the second information processing device.
The information input method according to any one of claims 5 to 7. The second information processing apparatus determines whether the recommended screen orientation specified by the received recommended screen orientation information is different from the orientation of the display screen of the second information processing device. Display information prompting the user to change the orientation on the display screen,
The information input method according to claim 9. The first information processing apparatus is mounted on a digital camera that captures still images or moving images,
The second information processing apparatus receives input of attribute information given to an image captured by the digital camera;
The information input method according to claim 1. An information processing device that can be connected to an external device via a communication path,
Display means for displaying a first display screen for inputting information;
Detecting means for detecting an input item instructed to input information on the first display screen;
Capture means for capturing display contents of the first display screen when the input item is detected;
The screen information including the display content and the input item is transmitted to the external device, the input information input by the external device is acquired from the external device through the transmitted screen information, and the acquired input information is detected. A control means for storing in association with the input item,
An information processing apparatus comprising: An information processing apparatus connectable to an external apparatus having a first display screen for information input via a communication path,
Obtaining means for obtaining, from the external device, screen information including display contents of the first display screen and input items instructed to input information on the first display screen;
The display content of the acquired screen information is displayed on the second display screen for information input in the own device, and UI operation items for information input of the own device are displayed in a portion corresponding to the input item, and the display Control means for transmitting the input information inputted based on the external device,
An information processing apparatus comprising: A computer program for operating a computer as an information processing device connectable to an external device via a communication path,
The computer,
Display means for displaying a first display screen for information input;
Detecting means for detecting an input item instructed to input information on the first display screen;
Capture means for capturing display content of the first display screen when the input item is detected;
The screen information including the display content and the input item is transmitted to the external device, the input information input by the external device is acquired from the external device through the transmitted screen information, and the acquired input information is detected. Control means for storing in association with the input item
A computer program that functions as a computer program. A computer program for operating a computer as an information processing apparatus connectable to an external apparatus having a first display screen for information input via a communication path,
The computer,
Acquisition means for acquiring screen information including display contents of the first display screen and input items instructed to input information on the first display screen from the external device;
The display content of the acquired screen information is displayed on the second display screen for information input in the own device, and UI operation items for information input of the own device are displayed in a portion corresponding to the input item, and the display Control means for transmitting input information input based on the external device,
A computer program that functions as a computer program.

Images