JP2015032934A - Control device, control method, transmission terminal, transmission method, reception terminal, reception method, and control system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique capable of reducing a time required for storing desired data in a terminal.SOLUTION: A control device 300 comprises: an information acquisition unit 311 that acquires information of a display image displayed by one terminal of a transmission terminal 100 and a reception terminal 200, and information of a captured image captured by the other terminal; a comparison unit 312 that compares the information of the display image with the information of the captured image to obtain a comparison result; and a transmission control unit 313 that controls whether to allow data transmission from the transmission terminal 100 to the reception terminal 200 in accordance with the comparison result.

Description

  The present disclosure relates to a control device, a control method, a transmission terminal, a transmission method, a reception terminal, a reception method, and a control system.

  In recent years, there are increasing opportunities for users to see images in various places such as stations and stores. The types of images that the user sees include images displayed by a display device such as digital signage and images printed on paper for advertisement. When a user finds an image of interest in a certain place, the user may want to view data displayed by the terminal by storing data related to the image in the terminal carried by the user.

  For example, when a two-dimensional barcode is attached to an image, the user recognizes the two-dimensional barcode from the captured image when the user moves the terminal so that the two-dimensional barcode is within the imaging range. Thus, it is possible to receive data corresponding to the two-dimensional barcode. Various techniques for recognizing a two-dimensional barcode are disclosed (for example, see Patent Document 1).

Japanese Patent Laid-Open No. 2000-082108

  However, when a two-dimensional barcode is recognized from the captured image, it takes time to recognize the two-dimensional barcode. In addition, it takes time to specify data corresponding to the two-dimensional barcode. Therefore, it is desirable to realize a technique capable of reducing the time required to store desired data in the terminal.

  According to the present disclosure, an information acquisition unit that acquires information of a display image displayed by one terminal of a transmission terminal and a reception terminal and information of a captured image captured by the other terminal; A comparison unit that compares information and information of the captured image to obtain a comparison result, and a transmission control unit that controls whether or not data transmission from the transmission terminal to the reception terminal is performed according to the comparison result; A control device is provided.

  Further, according to the present disclosure, acquiring information on a display image displayed by one terminal of the transmission terminal and the reception terminal and information on a captured image captured by the other terminal; and Including comparing information and information of the captured image to obtain a comparison result, and controlling whether to perform data transmission to the transmission terminal and the reception terminal according to the comparison result. A control method is provided.

  Further, according to the present disclosure, the comparison result between the information of the display image displayed by one terminal of the own terminal and the receiving terminal and the information of the captured image captured by the other terminal is identical or similar. A transmission terminal is provided, which includes a communication control unit that causes the communication unit to perform data communication with the reception terminal when it is determined that.

  Further, according to the present disclosure, the comparison result between the information of the display image displayed by one terminal of the own terminal and the receiving terminal and the information of the captured image captured by the other terminal is identical or similar. If it is determined, a transmission method is provided that includes causing a communication unit to perform data communication with the receiving terminal.

  Further, according to the present disclosure, the comparison result between the display image information displayed by one terminal of the terminal and the transmission terminal and the captured image information captured by the other terminal is identical or similar. When it is determined, a receiving terminal is provided that includes a communication control unit that causes the communication unit to receive data from the transmitting terminal.

  Further, according to the present disclosure, the comparison result between the display image information displayed by one terminal of the terminal and the transmission terminal and the captured image information captured by the other terminal is identical or similar. If it is determined that the data is received from the transmitting terminal, a communication method is provided.

  Further, according to the present disclosure, there is provided a control system including a control device, a transmission terminal, and a reception terminal, wherein the control device displays a display image displayed by one of the transmission terminal and the reception terminal. An information acquisition unit that acquires information and information of a captured image captured by the other terminal, a comparison unit that compares the information of the display image and the information of the captured image, and obtains a comparison result; and And a transmission control unit that controls whether or not data transmission from the transmission terminal to the reception terminal is performed, and the transmission terminal determines that the comparison result indicates coincidence or similarity A communication control unit that causes a communication unit to perform data communication with the receiving terminal, and the receiving terminal communicates data reception from the transmitting terminal when it is determined that the comparison result is identical or similar Part A communication control unit to perform, the control system is provided.

  As described above, according to the present disclosure, it is possible to provide a technique capable of reducing the time required to store desired data in a terminal.

It is a figure for demonstrating the functional outline | summary of a general control system. It is a sequence diagram which shows the operation example (example in which a transmission terminal selects a connection other party) of a general control system. It is a sequence diagram which shows the operation example (example in which a receiving terminal selects a connection other party) of a general control system. It is a figure for demonstrating the function outline | summary of the control system which concerns on 1st Embodiment of this indication. FIG. 3 is a diagram illustrating a functional configuration example of a transmission terminal according to the first embodiment of the present disclosure. FIG. 3 is a diagram illustrating a functional configuration example of a reception terminal according to the first embodiment of the present disclosure. It is a sequence diagram which shows the operation example (example which a transmission terminal selects a connection other party) of the control system which concerns on 1st Embodiment of this indication. 7 is a sequence diagram illustrating an operation example (an example in which a receiving terminal selects a connection partner) of the control system according to the first embodiment of the present disclosure. FIG. 6 is a sequence diagram illustrating an operation example (an example in which a transmission terminal images) of a control system according to the first embodiment of the present disclosure. 6 is a sequence diagram illustrating an operation example (an example in which a video and an application are transmitted in parallel) of the control system according to the first embodiment of the present disclosure. FIG. FIG. 6 is a sequence diagram illustrating an operation example (an example of switching a data transmission path) of the control system according to the first embodiment of the present disclosure. It is a figure which shows the function structural example of the transmission terminal which concerns on 2nd Embodiment of this indication. It is a figure showing an example of functional composition of a receiving terminal concerning a 2nd embodiment of this indication. It is a sequence diagram which shows the operation example (example in which a transmission terminal selects a connection other party) of the control system which concerns on 2nd Embodiment of this indication. It is a sequence diagram which shows the operation example (example in which a receiving terminal selects a connection other party) of the control system which concerns on 2nd Embodiment of this indication. It is a figure which shows the function structural example of the transmission terminal which concerns on 3rd Embodiment of this indication. It is a figure showing an example of functional composition of a receiving terminal concerning a 3rd embodiment of this indication. It is a figure which shows the function structural example of the server apparatus which concerns on 3rd Embodiment of this indication. It is a sequence diagram showing an example of operation of a control system concerning a 3rd embodiment of this indication. It is a figure which shows the hardware structural example of each of the transmission terminal and receiving terminal which concern on embodiment of this indication. It is a figure which shows the hardware structural example of the server apparatus which concerns on embodiment of this indication.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

  In the present specification and drawings, a plurality of constituent elements having substantially the same functional configuration may be distinguished by attaching different alphabets or numbers after the same reference numeral. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given.

Further, the “DETAILED DESCRIPTION OF THE INVENTION” will be described according to the following item order.
0. General technology 1. First embodiment 1-1. Functional overview of control system 1-2. Functional configuration example of transmission terminal 1-3. Functional configuration example of receiving terminal 1-4. Operation example of control system Second embodiment 2-1. Functional configuration example of transmission terminal 2-2. Functional configuration example of receiving terminal 2-3. 2. Operation example of control system Third Embodiment 3-1. Functional configuration example of transmission terminal 3-2. Functional configuration example of receiving terminal 3-3. Functional configuration example of server device 3-4. 3. Example of control system operation 4. Hardware configuration example Conclusion

<< 0. General technology >>
First, a general technique will be described before describing an embodiment of the present disclosure. FIG. 1 is a diagram for explaining a functional outline of a general control system 90. As shown in FIG. 1, the control system 90 includes a transmission terminal 700 and a reception terminal 800. An application is executed in the transmission terminal 700, and a video Im1 is displayed as an execution result of the application. Here, it is assumed that when the user sees the video Im1, the user wants to display the video Im1 also on the receiving terminal 800.

  In such a case, when the user brings the receiving terminal 800 close to the transmitting terminal 700, connection processing between the transmitting terminal 700 and the receiving terminal 800 is started. When the connection process between the transmission terminal 700 and the reception terminal 800 is completed, a window D93 indicating that the video Im1 of the transmission terminal 700 is displayed is displayed on the reception terminal 800. Thereafter, the video Im1 is transmitted from the transmission terminal 700 to the reception terminal 800, and the reception terminal 800 displays the video Im1.

  Next, a general technique will be further described with reference to a sequence diagram. In the following sequence diagram, as an example, an example in which the control system 90 operates in accordance with Wi-Fi Direct (registered trademark) is shown.

  FIG. 2 is a sequence diagram illustrating an operation example of a general control system 90. In particular, the example illustrated in FIG. 2 corresponds to an example in which the transmission terminal 700 selects a connection partner. First, each of the transmission terminal 700 and the reception terminal 800 transmits a detection signal for detecting surrounding terminals (S901). If there is a receiving terminal 800 that has received the detection signal, the transmitting terminal 700 displays a window D91 asking whether to send a connection request to the receiving terminal 800 (S902).

  When receiving an operation from the user indicating that a connection request is to be transmitted to the receiving terminal 800 (S903), the transmitting terminal 700 transmits the connection request to the receiving terminal 800 (S904). When receiving the connection request from the transmission terminal 700, the reception terminal 800 displays a window D92 asking whether to accept the connection request from the transmission terminal 700 (S905). Receiving terminal 800 receives an operation indicating acceptance of a connection request from a user (S906), transmits a connection response to transmitting terminal 700 (S907), and transmitting terminal 700 transmits a confirmation message to receiving terminal 800 (S908). ).

  Subsequently, authentication, WPS (registered trademark), and association are performed between the transmission terminal 700 and the reception terminal 800 (S909, S910, S911), and RTP (Real-Time Transport Protocol) in RTSP (Real Time Streaming Protocol). When the session is established (S912), the receiving terminal 800 displays a window D93 indicating that the video Im1 of the transmitting terminal 700 is displayed (S913). Thereafter, the transmitting terminal 700 transmits the video Im1 to the receiving terminal 800 by RTP (S914). When the receiving terminal 800 receives the video Im1 from the transmitting terminal 700, the transmitting terminal 700 displays the video Im1 (S915).

  FIG. 3 is a sequence diagram illustrating an operation example of a general control system 90. In particular, the example illustrated in FIG. 3 corresponds to an example in which the receiving terminal 800 selects a connection partner. First, each of the transmission terminal 700 and the reception terminal 800 transmits a detection signal for detecting surrounding terminals (S901). If there is a transmitting terminal 700 that has received the detection signal, the receiving terminal 800 displays a window D91 asking whether or not to transmit a connection request to the transmitting terminal 700 (S902).

  When receiving an operation indicating that a connection request is transmitted to the transmission terminal 700 from the user (S903), the reception terminal 800 transmits the connection request to the transmission terminal 700 (S904). When receiving the connection request from the receiving terminal 800, the transmitting terminal 700 displays a window D92 asking whether to accept the connection request from the receiving terminal 800 (S905). When the transmission terminal 700 receives an operation indicating that the connection request is accepted from the user (S906), the transmission terminal 700 transmits a connection response to the reception terminal 800 (S907), and the reception terminal 800 transmits a confirmation message to the transmission terminal 700 (S908). ).

  Subsequently, authentication, WPS (registered trademark), and association are performed between the transmission terminal 700 and the reception terminal 800 (S909, S910, S911), and RTP (Real-Time Transport Protocol) in RTSP (Real Time Streaming Protocol). When the session is established (S912), the receiving terminal 800 displays a window D93 indicating that the video Im1 of the transmitting terminal 700 is displayed (S913). Thereafter, the transmitting terminal 700 transmits the video Im1 to the receiving terminal 800 by RTP (S914). When the receiving terminal 800 receives the video Im1 from the transmitting terminal 700, the transmitting terminal 700 displays the video Im1 (S915).

  The general technique has been described above. In such a general technique, since the user is requested to perform an operation indicating that the connection request is transmitted, the operation may be complicated for the user. On the other hand, if the connection request is transmitted without waiting for an operation from the user, the complexity of the operation given to the user is reduced, but erroneous transmission of data from the transmission terminal 700 to the reception terminal 800 is performed. There is a risk of being done. The present specification proposes a technique for reducing the possibility of erroneous data transmission from the transmission terminal 700 to the reception terminal 800 while reducing the complexity of the operation given to the user.

  Further, in such a general technique, a window D93 indicating that the video Im1 of the transmission terminal 700 is displayed is displayed, and the video Im1 is suddenly displayed following the window D93. While the connection process is being performed, a progress bar indicating the progress of the connection process may also be displayed. However, even if such a display is made, it is difficult for the user to intuitively understand what processing is being executed. The present specification proposes a technique that makes it easy for the user to intuitively understand what processing is being executed.

  A case where a two-dimensional barcode is attached to the video Im1 displayed by the transmission terminal 700 is also assumed. In such a case, when the user moves the receiving terminal 800 so that the two-dimensional barcode is within the imaging range and captures an image, the receiving terminal 800 recognizes the two-dimensional barcode from the captured image and corresponds to the two-dimensional barcode. Im1 can be received. However, when a two-dimensional barcode is recognized from the captured image, it takes time to recognize the two-dimensional barcode. In addition, it takes time to specify data corresponding to the two-dimensional barcode. The present specification proposes a technique capable of reducing the time required to store desired data in the receiving terminal 800.

<< 1. First Embodiment >>
First, the first embodiment of the present disclosure will be described. In the first embodiment of the present disclosure, a control device 300 that controls data transmission from the transmission terminal 100 to the reception terminal 200 is incorporated in the reception terminal 200. However, as will be described in other embodiments, the control device 300 does not necessarily have to be incorporated in the receiving terminal 200.

<1-1. Overview of control system functions>
First, the functional outline of the control system 10 according to the first embodiment of the present disclosure will be described. FIG. 4 is a diagram for describing a functional outline of the control system 10 according to the first embodiment of the present disclosure. As shown in FIG. 4, the control system 10 includes a transmission terminal 100 and a reception terminal 200. An application is executed in the transmission terminal 100, and a video Im1 is displayed as an execution result of the application. Here, it is assumed that the user wants to display the video Im1 on the receiving terminal 200 when the user sees the video Im1.

  In this case, when the user moves the receiving terminal 200 so that part or all of the video Im1 is within the imaging range of the receiving terminal 200, the captured video Im0 is displayed by the receiving terminal 200. Here, for example, when the feature amount of the image displayed by the transmission terminal 100 and the feature amount of the image captured by the reception terminal 200 are similar or coincide with each other, between the transmission terminal 100 and the reception terminal 200, for example. The connection process may be started. When the connection process between the transmission terminal 700 and the reception terminal 800 is completed, the transmission terminal 700 may transmit the video Im1 to the reception terminal 800, and the reception terminal 800 may display the video Im1.

  The feature amount extracted from the image is not particularly limited. For example, it may be a histogram showing the color distribution of the image or a histogram showing the luminance distribution. Further, the feature amount extracted from the image may be an object region recognized from the image or a face region recognized from the image.

  In this embodiment, the transmission terminal 100 and the reception terminal 200 are connected via, for example, a wireless LAN (Local Area Network), and communicate between the transmission terminal 100 and the reception terminal 200 via the wireless LAN. A case where the above can be performed will be described as an example. However, the communication between the transmission terminal 100 and the reception terminal 200 may be wireless communication (for example, infrared communication) that does not pass through the wireless LAN, or may be wired communication.

  4 shows the case where the transmission terminal 100 is a television device and the reception terminal 200 is a tablet terminal, the terminal types of the transmission terminal 100 and the reception terminal 200 are not particularly limited. For example, the type of each of the transmission terminal 100 and the reception terminal 200 may be a video camera, a smartphone, or a PDA (Personal Digital Assistant). Alternatively, the terminal type of each of the transmission terminal 100 and the reception terminal 200 may be a PC (Personal Computer), a mobile phone, a portable music playback device, or a mobile phone. It may be a video image processing device or a portable game device.

  The functional overview of the control system 10 according to the first embodiment of the present disclosure has been described above.

<1-2. Functional configuration example of transmitting terminal>
Subsequently, a functional configuration example of the transmission terminal 100 according to the first embodiment of the present disclosure will be described. FIG. 5 is a diagram illustrating a functional configuration example of the transmission terminal 100 according to the first embodiment of the present disclosure. As illustrated in FIG. 5, the transmission terminal 100 includes a control unit 110, an input unit 120, an imaging unit 130, a detection unit 140, a storage unit 150, a communication unit 160, and a display unit 170.

  The control unit 110 corresponds to a processor such as a CPU (Central Processing Unit), for example. The control unit 110 exhibits various functions of the control unit 110 by executing a program stored in the storage unit 150 or another storage medium. The control unit 110 includes a display control unit 111, a captured image acquisition unit 112, and a communication control unit 113. Each of these functional units included in the control unit 110 will be described later.

  The input unit 120 has a function of accepting an operation from the user. The input unit 120 outputs an operation received from the user to the control unit 110. The operation can be used to execute a program. In addition, for example, the input unit 120 can accept an operation for starting activation of a program from the user. In addition, for example, the input unit 120 can accept an operation for ending the execution of the program from the user. In the example illustrated in FIG. 5, the input unit 120 is incorporated in the transmission terminal 100, but the input unit 120 may exist outside the transmission terminal 100.

  The imaging unit 130 acquires a captured image by imaging the imaging range, and outputs the captured image to the control unit 110. The imaging unit 130 performs imaging with an imaging magnification set according to an operation input to the input unit 120. The adjustment of the imaging magnification can be realized by a zoom function, but this zoom function is not particularly limited, and may be an optical zoom function or an electronic zoom function. In the example illustrated in FIG. 5, the imaging unit 130 is integrated with the transmission terminal 100, but the imaging unit 130 may be configured separately from the transmission terminal 100.

  The detection unit 140 detects predetermined sensor data and outputs it to the control unit 110. The detection unit 140 has a GPS (Global Positioning System) antenna, and detects GPS data (latitude and longitude of the current position of the transmission terminal 100) using a GPS signal received by the GPS antenna. The sensor data detected by the detection unit 140 may be other than GPS data. In the example illustrated in FIG. 5, the detection unit 140 is integrated with the transmission terminal 100, but the detection unit 140 may be configured separately from the transmission terminal 100.

  The storage unit 150 stores a program for operating the control unit 110 using a storage medium such as a semiconductor memory or a hard disk. In addition, for example, the storage unit 150 can store various data (for example, various setting information and content) used by the program. In the example illustrated in FIG. 5, the storage unit 150 is integrated with the transmission terminal 100, but the storage unit 150 may be configured separately from the transmission terminal 100.

  The communication unit 160 can communicate with the receiving terminal 200. The communication format by the communication unit 160 is not particularly limited, and the communication by the communication unit 160 may be wireless communication or wired communication. In the example illustrated in FIG. 5, the communication unit 160 is integrated with the transmission terminal 100, but the communication unit 160 may be configured separately from the transmission terminal 100.

  The display unit 170 displays various information according to control by the control unit 110. For example, the display unit 170 may include an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence) display device. Alternatively, the display unit 170 may include an audio output device such as a speaker and headphones. In the example illustrated in FIG. 5, the display unit 170 is integrated with the transmission terminal 100, but the display unit 170 may be configured separately from the transmission terminal 100.

  When the communication control unit 113 indicates that the comparison result between the display image information displayed by one of the transmission terminal 100 and the reception terminal 200 and the information of the captured image captured by the other terminal is identical or similar. When it is determined, the communication unit 160 performs data communication with the receiving terminal 200. According to the function of the communication control unit 113, it is possible to reduce the possibility of erroneous data transmission from the transmission terminal 700 to the reception terminal 800 while reducing the complexity of the operation given to the user. Become. Data transmitted to the receiving terminal 200 is not particularly limited, and may include at least an image or at least an application.

  Each of the display image information and the captured image information is not particularly limited. For example, the display image information may include a feature amount extracted from the display image, and the captured image information may include a feature amount extracted from the captured image. In such a case, it takes time to extract the feature value from the image. However, before the connection process between the transmission terminal 100 and the reception terminal 200 is completed, it is better to transmit the feature value than to transmit the image itself. May be appropriate from a security perspective.

  However, the display image information may include part or all of the display image, and the captured image information may include part or all of the captured image. In the following, the case where the feature amount of the display image is used as the display image information and the feature amount of the captured image is used as the captured image information will be mainly described. However, the display image information is the feature amount of the display image. The information on the captured image is not limited to the feature amount of the captured image.

  When the video is transmitted from the transmission terminal 100 to the reception terminal 200, the transmitted video may be any video, but may include at least the video Im1 displayed by the transmission terminal 100. In this case, when the user is interested in the video Im1 displayed by the transmission terminal 100, the video Im1 itself can be stored in the reception terminal 200.

  When an application is transmitted from the transmission terminal 100 to the reception terminal 200, the application to be transmitted may be any application, but may include at least an application executed by the transmission terminal 100. In such a case, when the user is interested in an application executed by the transmission terminal 100, the application itself can be stored in the reception terminal 200.

  In addition, the display control unit 111 may have the same function as the display control unit 211. The control device 300 includes an information acquisition unit 311, a comparison unit 312, and a transmission control unit 313. The information acquisition unit 311 acquires the feature amount of the display image displayed by one of the transmission terminal 100 and the reception terminal 200 and the feature amount of the captured image captured by the other terminal. Then, the comparison unit 312 compares the feature amount of the display image with the feature amount of the captured image to obtain a comparison result.

  Further, the transmission control unit 313 controls whether or not data transmission from the transmission terminal 100 to the reception terminal 200 is performed according to the comparison result. For example, the transmission control unit 313 may perform data transmission from the transmission terminal 100 to the reception terminal 200 when the comparison result indicates a match or similarity between the feature amount of the display image and the feature amount of the captured image.

  Heretofore, the functional configuration example of the transmission terminal 100 according to the first embodiment of the present disclosure has been described.

<1-3. Example of functional configuration of receiving terminal>
Subsequently, a functional configuration example of the receiving terminal 200 according to the first embodiment of the present disclosure will be described. FIG. 6 is a diagram illustrating a functional configuration example of the reception terminal 200 according to the first embodiment of the present disclosure. As illustrated in FIG. 6, the receiving terminal 200 includes a control unit 210, an input unit 220, an imaging unit 230, a detection unit 240, a storage unit 250, a communication unit 260, and a display unit 270.

  The control unit 210 corresponds to a processor such as a CPU (Central Processing Unit), for example. The control unit 210 exhibits various functions of the control unit 210 by executing a program stored in the storage unit 250 or another storage medium. The control unit 210 includes a display control unit 211, a captured image acquisition unit 212, and a communication control unit 213. Each of these functional units included in the control unit 210 will be described later.

  The input unit 220 has a function of accepting an operation from the user. The input unit 220 outputs an operation received from the user to the control unit 210. The operation can be used to execute a program. For example, the input unit 220 can also accept an operation for starting the program from the user. Further, for example, the input unit 220 can also accept an operation for ending the execution of the program from the user. In the example illustrated in FIG. 6, the input unit 220 is incorporated in the receiving terminal 200, but the input unit 220 may exist outside the receiving terminal 200.

  The imaging unit 230 acquires a captured image by imaging the imaging range, and outputs the captured image to the control unit 210. The imaging unit 230 performs imaging with an imaging magnification set according to an operation input to the input unit 220. The adjustment of the imaging magnification can be realized by a zoom function, but this zoom function is not particularly limited, and may be an optical zoom function or an electronic zoom function. In the example illustrated in FIG. 6, the imaging unit 230 is integrated with the receiving terminal 200, but the imaging unit 230 may be configured separately from the receiving terminal 200.

  The detection unit 240 detects predetermined sensor data and outputs it to the control unit 210. The detection unit 240 has a GPS (Global Positioning System) antenna, and detects GPS data (latitude and longitude of the current position of the receiving terminal 200) using a GPS signal received by the GPS antenna. The sensor data detected by the detection unit 240 may be other than GPS data. In the example illustrated in FIG. 6, the detection unit 240 is integrated with the reception terminal 200, but the detection unit 240 may be configured separately from the reception terminal 200.

  The storage unit 250 stores a program for operating the control unit 210 using a storage medium such as a semiconductor memory or a hard disk. In addition, for example, the storage unit 250 can store various data (for example, various setting information, content, and the like) used by the program. In the example illustrated in FIG. 6, the storage unit 250 is integrated with the reception terminal 200, but the storage unit 250 may be configured separately from the reception terminal 200.

  The communication unit 260 can communicate with the transmission terminal 100. The communication format by the communication unit 260 is not particularly limited, and the communication by the communication unit 260 may be wireless communication or wired communication. In the example illustrated in FIG. 6, the communication unit 260 is integrated with the receiving terminal 200, but the communication unit 260 may be configured separately from the receiving terminal 200.

  The display unit 270 displays various information according to control by the control unit 210. For example, the display unit 270 may include an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence) display device. Alternatively, the display unit 270 may include an audio output device such as a speaker and headphones. In the example illustrated in FIG. 6, the display unit 270 is integrated with the receiving terminal 200, but the display unit 270 may be configured separately from the receiving terminal 200.

  The communication control unit 213 determines that the comparison result between the feature amount of the display image displayed by one of the receiving terminal 200 and the transmission terminal 100 matches the feature amount of the captured image captured by the other terminal. When it is determined that the data is to be displayed, the communication unit 260 receives data from the transmission terminal 100. According to the function of the communication control unit 213, it is possible to reduce the possibility of erroneous data transmission from the transmission terminal 700 to the reception terminal 800 while reducing the complexity of the operation given to the user. Become. The display control unit 211 causes the display unit 270 to display an image based on the data received from the transmission terminal 100.

  Heretofore, the functional configuration example of the receiving terminal 200 according to the first embodiment of the present disclosure has been described.

<1-4. Example of control system operation>
Subsequently, an operation example of the control system 10 according to the first embodiment of the present disclosure will be described. FIG. 7 is a sequence diagram illustrating an operation example of the control system 10 according to the first embodiment of the present disclosure. In particular, the example illustrated in FIG. 7 corresponds to an example in which the transmission terminal 100 selects a connection partner. The example illustrated in FIG. 7 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and data transmitted from the transmission terminal 100 to the reception terminal 200 is the video Im1. It corresponds to an example.

  First, in the transmission terminal 100, the communication control unit 113 transmits a detection signal for detecting surrounding terminals, and in the receiving terminal 200, the communication control unit 213 transmits a detection signal for detecting surrounding terminals ( S101). The communication control unit 213 controls the communication unit 260 so that surrounding terminals are notified that the connection to the camera is possible (S102). Note that it is not always necessary to notify that the camera can be connected.

  Subsequently, when the display control unit 111 displays an image on the display unit 170 (S103) and extracts the feature amount of the display image (S104), the communication control unit 113 transmits the feature amount of the display image to surrounding terminals. The communication unit 160 is controlled as described above (S108). On the other hand, an image is captured by the imaging unit 230 (S105), a feature amount of the captured image is extracted by the captured image acquisition unit 212 (S107), and a feature amount of the display image and a feature amount of the captured image are acquired by the information acquisition unit 311. When acquired, the comparison unit 312 compares the feature amounts (S110).

  Subsequently, when there is a receiving terminal 200 that has received the detection signal, the transmission control unit 313 controls the communication unit 160 so that a connection request is transmitted to the receiving terminal 200 (S109). When the communication control unit 213 controls the communication unit 260 so that a connection request is received from the transmission terminal 100, a connection response is transmitted to the transmission terminal 100 when it is determined that the comparison result matches or is similar. The communication unit 260 is controlled as described above (S111), and the communication control unit 113 controls the communication unit 160 so that the confirmation message is transmitted to the receiving terminal 200 (S112).

  Subsequently, authentication, WPS (registered trademark), and association are performed between the transmission terminal 100 and the reception terminal 200 (S113, S114, S115), and RTP (Real-Time Transport Protocol) in RTSP (Real Time Streaming Protocol). When the session is established (S116), the communication control unit 113 controls the communication unit 160 so that the video Im1 is transmitted to the receiving terminal 200 by RTP (S117), and the communication control unit 213 receives from the transmitting terminal 100. When the communication unit 260 is controlled so that the video Im1 is received, the display control unit 211 causes the display unit 270 to display the video Im1.

  In the above example, an image is captured by the imaging unit 230, but as illustrated in FIG. 7, the display control unit 211 may cause the display unit 270 to display the image Im0 captured by the imaging unit 230. . In this case, when data is received from the transmission terminal 100, the display control unit 211 displays the display on the display unit 270 from the image Im0 captured by the imaging unit 230 and the video Im1 based on the data received from the transmission terminal 100. You may make a transition to.

  In the above-described general technique, the video Im1 based on the data received from the transmission terminal 100 is suddenly displayed, so that it is difficult for the user to intuitively understand what processing is executed. It was. Compared with such a general technique, if an image displayed by the transmission terminal 100 is captured and displayed at the reception terminal 200, data transmission from the transmission terminal 100 to the reception terminal 200 is intuitively performed by the user. It becomes easy to grasp that.

  The display image displayed by the transmission terminal 100 and the captured image captured by the reception terminal 200 may be a still image or a moving image. Here, it is assumed that a certain amount of time is required from when the display image is displayed until the captured image is captured. Therefore, when the display image and the captured image are moving images, the comparison unit 312 displays the display image when the difference between the time when the display image is acquired and the time when the captured image is acquired is within a predetermined range. And the feature amount of the captured image may be compared.

  In addition, the application may be executed from the beginning in the receiving terminal 200, but may not be executed from the beginning in the receiving terminal 200 if it is already being executed halfway in the transmitting terminal 100. Therefore, the data transmitted to the receiving terminal 200 may include at least an application execution state in the transmitting terminal 100 and a file generated by application execution. In such a case, it is possible to execute the application in the receiving terminal 200 from the continuation of the execution of the application in the transmitting terminal 100 based on the application execution state and the file. Note that when executing an application, the application execution state is stored in the RAM 803, and a file generated by executing the application is stored in the storage device 811.

  The display by the receiving terminal 200 may be changed depending on whether or not communication via the wireless LAN is possible between the transmitting terminal 100 and the receiving terminal 200. For example, when the data received from the transmission terminal 100 includes at least a video, an application execution state, and a file generated by application execution, the display control unit 211 determines that the distance between the transmission terminal 100 and the reception terminal 200 is predetermined. When the distance becomes larger than the distance, the display on the display unit 270 may be switched from the video to the application execution result based on the application execution state and the file. According to such a configuration, even when communication via a wireless LAN becomes impossible, video display can be resumed from the middle at the receiving terminal 200.

  FIG. 8 is a sequence diagram illustrating an operation example of the control system 10 according to the first embodiment of the present disclosure. In particular, the example illustrated in FIG. 8 corresponds to an example in which the receiving terminal 200 selects a connection partner. The example illustrated in FIG. 8 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and data transmitted from the transmission terminal 100 to the reception terminal 200 is the video Im1. It corresponds to an example.

  S101 to S108 and S110 shown in FIG. 8 can be executed in the same manner as S101 to S108 and S110 shown in FIG. Further, S113 to S117 shown in FIG. 8 can be executed in the same manner as S113 to S117 shown in FIG. Therefore, here, S109, S111, and S112 shown in FIG. 8 will be mainly described.

  When the comparison between the feature amounts by the comparison unit 312 is completed, the transmission control unit 313 determines that there is a transmitting terminal 100 that has received the detection signal and that the comparison result of the feature amounts indicates coincidence or similarity. If the communication unit 260 is received, the communication unit 260 is controlled so that the connection request is transmitted to the transmission terminal 100 (S109). When the communication control unit 113 controls the communication unit 160 so that a connection request is received from the receiving terminal 200, the communication control unit 113 controls the communication unit 160 so that a connection response is transmitted to the receiving terminal 200 (S111). 213 controls the communication unit 260 so that the confirmation message is transmitted to the transmission terminal 100 (S112).

  FIG. 9 is a sequence diagram illustrating an operation example of the control system 10 according to the first embodiment of the present disclosure. In particular, the example illustrated in FIG. 9 corresponds to an example in which the transmission terminal 100 captures an image and the reception terminal 200 displays an image. In addition, the example illustrated in FIG. 9 corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is the video Im1.

  S101 and S102 shown in FIG. 9 can be executed in the same manner as S101 and S102 shown in FIG. 7 or FIG. Further, S108 to S117 shown in FIG. 9 can be executed in the same manner as S108 to S117 shown in FIG. 7 or FIG. Therefore, here, S103 to S107 shown in FIG. 9 will be mainly described.

  In the example shown in FIG. 9, the display control unit 211 displays an image on the display unit 270 (S103), and extracts the feature amount of the display image (S104). On the other hand, when an image is picked up by the image pickup unit 130 (S105), and a feature amount of the picked-up image is extracted by the picked-up image acquisition unit 112 (S107), the communication control unit 113 sets the feature amount of the picked-up image to surrounding terminals. The communication unit 160 is controlled so as to be transmitted (S108).

  In the above example, an image is displayed on the display unit 270. However, as illustrated in FIG. 9, the display control unit 211 may cause the display unit 270 to display a predetermined image Im2. The image Im2 may be any image, but as illustrated in FIG. 9, it may be an image obtained by imaging some terminal. In this case, when data is received from the transmission terminal 100, the display control unit 211 may cause the display by the display unit 270 to transition from the image Im2 to the video Im1 based on the data received from the transmission terminal 100.

  FIG. 10 is a sequence diagram illustrating an operation example of the control system 10 according to the first embodiment of the present disclosure. In particular, the example illustrated in FIG. 10 corresponds to an example in which a video and an application are transmitted in parallel. In the example shown in FIG. 10, S101 to S117 shown in FIGS. 7 to 9 have already been executed, and operations that can be additionally performed after that will be mainly described.

  A video can be transmitted from the transmission terminal 100 to the reception terminal 200 (S117, S122), but an application, an application execution state, and a file generated by application execution are also transmitted from the transmission terminal 100 to the reception terminal 200 in parallel with the transmission of the video. (S121). In such a case, the display control unit 211 determines the distance between the transmission terminal 100 and the reception terminal 200 (S123), and displays when the distance between the transmission terminal 100 and the reception terminal 200 is greater than a predetermined distance. The display by the unit 270 may be changed from the video to the execution result of the application based on the application execution state and the file (S124).

  As in this example, when the data received from the transmission terminal 100 includes at least the video, the application, the application execution state, and the file generated by the application execution, the display control unit 211 displays the video. 270 prepares to display the execution result of the application based on the application execution state and the file while being displayed on 270, and displays the display by the display unit 270 from the video when the predetermined timing arrives. You may switch to. According to such a configuration, even when communication via the wireless LAN becomes impossible, video display can be continued smoothly at the receiving terminal 200.

  FIG. 11 is a sequence diagram illustrating an operation example of the control system 10 according to the first embodiment of the present disclosure. In particular, the example shown in FIG. 11 corresponds to an example of switching the data transmission path. In the example shown in FIG. 11, S101 to S117 shown in FIGS. 7 to 9 have already been executed, and operations that can be additionally performed after that will be mainly described.

  It is assumed that communication via the wireless LAN becomes impossible while data is being transmitted from the transmission terminal 100 to the reception terminal 200 via the wireless LAN. Therefore, the display control unit 211 determines the distance between the transmission terminal 100 and the reception terminal 200 (S131), and when the distance between the transmission terminal 100 and the reception terminal 200 becomes larger than a predetermined distance, the transmission path switching is performed. The instruction may be transmitted to the transmission terminal 100 (S132). In addition, when the transmission terminal 100 receives the transmission path switching instruction, the transmission terminal 100 may switch the transmission path to perform data transmission via the public wireless network (S133, S134).

  As in this example, when the distance between the transmission terminal 100 and the reception terminal 200 becomes larger than a predetermined distance, the communication control unit 113 sets the transmission path of data transmitted by the communication unit 160 from the wireless LAN. You may switch to a public wireless network. According to this configuration, it is possible to continue data transmission from the transmission terminal 100 to the reception terminal 200 even when communication via the wireless LAN becomes impossible. Note that video can be transmitted from the transmission terminal 100 to the reception terminal 200, but an application, an application execution state, and a file generated by application execution are also transmitted from the transmission terminal 100 to the reception terminal 200 in parallel with the transmission of the video. May be. The display control unit 211 prepares to display the execution result of the application based on the application execution state and the file while displaying the video on the display unit 270, and displays the display unit when a predetermined timing comes. The display by 270 may be switched from the video to the execution result of the application. According to such a configuration, even when communication via the wireless LAN becomes impossible, video display can be continued smoothly at the receiving terminal 200.

  The operation example of the control system 10 according to the first embodiment of the present disclosure has been described above.

<< 2. Second Embodiment >>
Subsequently, a second embodiment of the present disclosure will be described. In the second embodiment of the present disclosure, a control device 300 that controls data transmission from the transmission terminal 100 to the reception terminal 200 is incorporated in the transmission terminal 100. However, as described in other embodiments, the control device 300 does not necessarily have to be incorporated in the transmission terminal 100. Hereinafter, description of the same configuration in the first embodiment and the second embodiment will be omitted, and different configurations in the first embodiment and the second embodiment will be mainly described.

<2-1. Functional configuration example of transmitting terminal>
First, a functional configuration example of the transmission terminal 100 according to the second embodiment of the present disclosure will be described. FIG. 12 is a diagram illustrating a functional configuration example of the transmission terminal 100 according to the second embodiment of the present disclosure. As illustrated in FIG. 12, the transmission terminal 100 includes a control unit 110, an input unit 120, an imaging unit 130, a detection unit 140, a storage unit 150, a communication unit 160, and a display unit 170. Furthermore, the transmission terminal 100 includes a control device 300.

  Heretofore, the functional configuration example of the transmission terminal 100 according to the second embodiment of the present disclosure has been described.

<2-2. Example of functional configuration of receiving terminal>
Subsequently, a functional configuration example of the reception terminal 200 according to the second embodiment of the present disclosure will be described. FIG. 13 is a diagram illustrating a functional configuration example of the reception terminal 200 according to the second embodiment of the present disclosure. As illustrated in FIG. 13, the receiving terminal 200 includes a control unit 210, an input unit 220, an imaging unit 230, a detection unit 240, a storage unit 250, a communication unit 260, and a display unit 270. As described above, in the second embodiment of the present disclosure, the transmission terminal 100 includes the control device 300 instead of the reception terminal 200.

  The function configuration example of the receiving terminal 200 according to the second embodiment of the present disclosure has been described above.

<2-3. Example of control system operation>
Subsequently, an operation example of the control system 10 according to the second embodiment of the present disclosure will be described. FIG. 14 is a sequence diagram illustrating an operation example of the control system 10 according to the second embodiment of the present disclosure. In particular, the example illustrated in FIG. 14 corresponds to an example in which the transmission terminal 100 selects a connection partner. The example illustrated in FIG. 14 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and data transmitted from the transmission terminal 100 to the reception terminal 200 is the video Im1. It corresponds to an example.

  S101 to S107 shown in FIG. 14 can be executed in the same manner as S101 to S107 shown in FIG. Further, S113 to S117 shown in FIG. 14 can be executed in the same manner as S113 to S117 shown in FIG. Therefore, here, S108 to S112 shown in FIG. 14 will be mainly described.

  Subsequently, the display control unit 111 displays an image on the display unit 170 (S103), and extracts a feature amount of the display image (S104). On the other hand, when the image is picked up by the image pickup unit 230 (S105), and the feature amount of the picked-up image is extracted by the picked-up image acquisition unit 212 (S107), the communication control unit 213 sends the feature amount of the picked-up image to surrounding terminals. The communication unit 260 is controlled so as to be transmitted (S108). On the other hand, when the feature amount of the display image and the feature amount of the captured image are acquired by the information acquisition unit 311, the comparison unit 312 compares the feature amounts (S 110).

  When the comparison between the feature amounts by the comparison unit 312 is finished, the transmission control unit 313 determines that there is a receiving terminal 200 that has received the detection signal, and that the comparison result of the feature amounts indicates coincidence or similarity. If the communication unit 160 is received, the communication unit 160 is controlled so that the connection request is transmitted to the receiving terminal 200 (S109). When the communication control unit 213 controls the communication unit 260 so that a connection request is received from the transmission terminal 100, the communication control unit 213 controls the communication unit 260 so that a connection response is transmitted to the transmission terminal 100 (S111). 113 controls the communication unit 160 so that the confirmation message is transmitted to the receiving terminal 200 (S112).

  FIG. 15 is a sequence diagram illustrating an operation example of the control system 10 according to the second embodiment of the present disclosure. In particular, the example illustrated in FIG. 15 corresponds to an example in which the receiving terminal 200 selects a connection partner. The example illustrated in FIG. 15 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and data transmitted from the transmission terminal 100 to the reception terminal 200 is the video Im1. It corresponds to an example.

  S101 to S108 and S110 shown in FIG. 15 can be executed in the same manner as S101 to S108 and S110 shown in FIG. Further, S113 to S117 shown in FIG. 15 can be executed in the same manner as S113 to S117 shown in FIG. Therefore, here, S109, S111, and S112 shown in FIG. 15 will be mainly described.

  If there is a transmission terminal 100 that has received the detection signal, the transmission control unit 313 controls the communication unit 260 so that a connection request is transmitted to the transmission terminal 100 (S109). When the communication control unit 113 controls the communication unit 160 so that a connection request is received from the receiving terminal 200, a connection response is transmitted to the receiving terminal 200 when it is determined that the comparison result is identical or similar. The communication unit 160 is controlled as described above (S111), and the communication control unit 213 controls the communication unit 260 so that the confirmation message is transmitted to the transmission terminal 100 (S112).

  The operation example of the control system 10 according to the second embodiment of the present disclosure has been described above.

<< 3. Third Embodiment >>
Subsequently, a third embodiment of the present disclosure will be described. In the third embodiment of the present disclosure, a control device 300 that controls data transmission from the transmission terminal 100 to the reception terminal 200 is incorporated in a server device 400 that is different from the transmission terminal 100 and the reception terminal 200. However, as will be described in other embodiments, the control device 300 does not necessarily have to be incorporated in the server device 400. Hereinafter, the description of the same configuration in the third embodiment and the other embodiments will be omitted, and the configuration different between the third embodiment and the other embodiments will be mainly described.

<3-1. Functional configuration example of transmitting terminal>
First, a functional configuration example of the transmission terminal 100 according to the third embodiment of the present disclosure will be described. FIG. 16 is a diagram illustrating a functional configuration example of the transmission terminal 100 according to the third embodiment of the present disclosure. As illustrated in FIG. 16, the transmission terminal 100 includes a control unit 110, an input unit 120, an imaging unit 130, a detection unit 140, a storage unit 150, a communication unit 160, and a display unit 170. As described above, in the third embodiment of the present disclosure, the server device 400 includes the control device 300 instead of the transmission terminal 100 or the reception terminal 200.

  The function configuration example of the transmission terminal 100 according to the third embodiment of the present disclosure has been described above.

<3-2. Example of functional configuration of receiving terminal>
Subsequently, a functional configuration example of the receiving terminal 200 according to the third embodiment of the present disclosure will be described. FIG. 17 is a diagram illustrating a functional configuration example of the reception terminal 200 according to the third embodiment of the present disclosure. As illustrated in FIG. 17, the reception terminal 200 includes a control unit 210, an input unit 220, an imaging unit 230, a detection unit 240, a storage unit 250, a communication unit 260, and a display unit 270. As described above, in the third embodiment of the present disclosure, the server device 400 includes the control device 300 instead of the transmission terminal 100 or the reception terminal 200.

  Heretofore, the functional configuration example of the receiving terminal 200 according to the third embodiment of the present disclosure has been described.

<3-3. Functional configuration example of server device>
Subsequently, a functional configuration example of the server apparatus 400 according to the third embodiment of the present disclosure will be described. FIG. 18 is a diagram illustrating a functional configuration example of the server device 400 according to the third embodiment of the present disclosure. As illustrated in FIG. 18, the server device 400 includes a control unit 410, a storage unit 450, and a communication unit 460. As described above, in the third embodiment of the present disclosure, the server device 400 includes the control device 300 instead of the transmission terminal 100 or the reception terminal 200.

  The control unit 410 corresponds to a processor such as a CPU (Central Processing Unit), for example. The control unit 410 exhibits various functions of the control unit 410 by executing a program stored in the storage unit 450 or another storage medium.

  The storage unit 450 stores a program for operating the control unit 410 using a storage medium such as a semiconductor memory or a hard disk. Further, for example, the storage unit 450 can also store various data (for example, various setting information, content, etc.) used by the program. In the example illustrated in FIG. 18, the storage unit 450 is integrated with the server device 400, but the storage unit 450 may be configured separately from the server device 400.

The communication unit 460 can communicate with the transmission terminal 100 and the reception terminal 200. The communication format by the communication unit 460 is not particularly limited, and the communication by the communication unit 460 may be wireless communication or wired communication. In the example illustrated in FIG. 18, the communication unit 460 is integrated with the server device 400, but the communication unit 460 may be configured separately from the server device 400.
3).

  Heretofore, the functional configuration example of the server apparatus 400 according to the third embodiment of the present disclosure has been described.

<3-4. Example of control system operation>
Subsequently, an operation example of the control system 10 according to the third embodiment of the present disclosure will be described. FIG. 19 is a sequence diagram illustrating an operation example of the control system 10 according to the third embodiment of the present disclosure. In particular, the example illustrated in FIG. 19 corresponds to an example in which the transmission terminal 100 selects a connection partner. The example illustrated in FIG. 19 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and data transmitted from the transmission terminal 100 to the reception terminal 200 is the video Im1. It corresponds to an example.

  S113 to S117 shown in FIG. 19 can be executed in the same manner as S113 to S117 shown in FIG. Therefore, here, S101 to S112 shown in FIG. 19 will be mainly described.

  First, in the transmission terminal 100, the communication control unit 113 transmits a detection signal for detecting surrounding terminals, and in the receiving terminal 200, the communication control unit 213 transmits a detection signal for detecting surrounding terminals ( S101). The communication control unit 213 controls the communication unit 260 so that surrounding terminals are notified that the connection to the camera is possible (S102). Note that it is not always necessary to notify that the camera can be connected.

  Subsequently, when the display control unit 111 displays an image on the display unit 170 (S103) and extracts the feature amount of the display image (S104), the communication control unit 113 displays the feature amount of the display image and the additional information as the server device. The communication unit 160 is controlled so as to be transmitted to 400 (S108A). On the other hand, when the image is picked up by the image pickup unit 230 (S105), and the feature amount of the picked-up image is extracted by the picked-up image acquisition unit 212 (S107), the communication control unit 213 receives the feature amount of the picked-up image and the additional information as a server. The communication unit 160 is controlled so as to be transmitted to the device 400 (S108B).

  Here, the additional information is information that is additionally used in addition to the feature amount, and may be sensor data (for example, position information, radio wave reception intensity, feature amount of audio data) detected by the detection unit 140. It may be an IP address.

  As described above, when the information acquisition unit 311 acquires the additional information from the transmission terminal 100 and the additional information from the reception terminal 200, the comparison unit 312 is acquired from the additional information acquired from the transmission terminal 100 and the reception terminal 200. The additional information may be further compared. According to such a configuration, it is possible to further reduce the possibility of erroneous data transmission from the transmission terminal 100 to the reception terminal 200 as compared with the case where only the feature value is a comparison target. Become.

  Note that the additional information is information that is additionally used in addition to the feature amount, and thus is not information that must be provided. When the information acquisition unit 311 acquires the feature amount and additional information from the transmission terminal 100 and the feature amount and additional information from the reception terminal 200, the comparison unit 312 compares the feature amounts with each other and adds the additional information. Compare each other (S110).

  Subsequently, when there is a receiving terminal 200 that has received the detection signal, the transmission control unit 313 controls the communication unit 160 so that a connection request is transmitted to the receiving terminal 200 (S109). When the communication control unit 213 controls the communication unit 260 so that the connection request is received from the transmission terminal 100, the comparison result between the feature amounts indicates the same or similar, and the comparison result between the additional information indicates the same or similar. The communication unit 260 is controlled so that a connection response is transmitted to the transmitting terminal 100 (S111), and the communication control unit 113 controls the communication unit 160 so that a confirmation message is transmitted to the receiving terminal 200. Control is performed (S112).

  The operation example of the control system 10 according to the third embodiment of the present disclosure has been described above.

<< 4. Hardware configuration example >>
Subsequently, a hardware configuration example of the transmission terminal 100 according to the embodiment of the present disclosure will be described. FIG. 20 is a diagram illustrating a hardware configuration example of the transmission terminal 100 according to the embodiment of the present disclosure. However, the hardware configuration example illustrated in FIG. 20 is merely an example of the hardware configuration of the transmission terminal 100. Therefore, the hardware configuration of the transmission terminal 100 is not limited to the example shown in FIG. The hardware of the receiving terminal 200 can also be configured similarly to the hardware of the transmitting terminal 100.

  As shown in FIG. 20, the transmission terminal 100 includes a CPU (Central Processing Unit) 801, a ROM (Read Only Memory) 802, a RAM (Random Access Memory) 803, a sensor 804, an input device 808, and an output. A device 810, a storage device 811, a drive 812, an imaging device 813, and a communication device 815 are provided.

  The CPU 801 functions as an arithmetic processing device and a control device, and controls the overall operation in the transmission terminal 100 according to various programs. Further, the CPU 801 may be a microprocessor. The ROM 802 stores programs used by the CPU 801, calculation parameters, and the like. The RAM 803 temporarily stores programs used in the execution of the CPU 801, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus including a CPU bus.

  The sensor 804 includes a sensor for detecting the state of the transmission terminal 100 and its peripheral circuits. Examples of the sensor 804 include a GPS antenna, an inclination sensor, an acceleration sensor, an orientation sensor, a temperature sensor, a humidity sensor, and an illuminance sensor. Sensor data detected by the sensor 804 is sent to the CPU 801. Thereby, the CPU 801 can know the state (current position, tilt, acceleration, direction, temperature, humidity, illuminance, etc.) of the transmission terminal 100.

  The input device 808 includes an input unit for a user to input information, such as a mouse, a keyboard, a touch panel, a button, a microphone, a switch, and a lever, and an input control circuit that generates an input signal based on the input by the user and outputs the input signal to the CPU 801 Etc. The user of the transmission terminal 100 can input various data and instruct processing operations to the transmission terminal 100 by operating the input device 808.

  The output device 810 includes a display device such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, and a lamp. Furthermore, the output device 810 includes an audio output device such as a speaker and headphones. For example, the display device displays a captured image or a generated image. On the other hand, the audio output device converts audio data or the like into audio and outputs it.

  The storage device 811 is a data storage device configured as an example of a storage unit of the transmission terminal 100. The storage device 811 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 811 stores programs executed by the CPU 801 and various data.

  The drive 812 is a storage medium reader / writer, and is built in or externally attached to the transmission terminal 100. The drive 812 reads out information recorded on a removable storage medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 803. The drive 812 can also write information in a removable storage medium.

  The imaging device 813 includes an imaging optical system such as a photographing lens and a zoom lens that collects light, and a signal conversion element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The imaging optical system collects light emitted from the subject and forms a subject image in the signal conversion unit, and the signal conversion element converts the formed subject image into an electrical image signal.

  The communication device 815 is a communication interface configured with, for example, a communication device for connecting to a network. The communication device 815 may be a wireless LAN (Local Area Network) compatible communication device, an LTE (Long Term Evolution) compatible communication device, or a wire communication device that performs wired communication. The communication device 815 can communicate with other devices via a network, for example.

  Heretofore, the hardware configuration example of the transmission terminal 100 according to the embodiment of the present disclosure has been described.

  Subsequently, a hardware configuration example of the server device 400 according to the embodiment of the present disclosure will be described. FIG. 21 is a diagram illustrating a hardware configuration example of the server device 400 according to the embodiment of the present disclosure. However, the hardware configuration example illustrated in FIG. 21 is merely an example of the hardware configuration of the server device 400. Therefore, the hardware configuration of the server apparatus 400 is not limited to the example illustrated in FIG.

  As illustrated in FIG. 21, the server apparatus 400 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a storage apparatus 911, a drive 912, and a communication. A device 915.

  The CPU 901 functions as an arithmetic processing device and a control device, and controls the overall operation in the server device 400 according to various programs. Further, the CPU 901 may be a microprocessor. The ROM 902 stores programs used by the CPU 901, calculation parameters, and the like. The RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus including a CPU bus.

  The storage device 911 is a data storage device configured as an example of a storage unit of the server device 400. The storage device 911 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 911 stores programs executed by the CPU 901 and various data.

  The drive 912 is a storage medium reader / writer, and is built in or externally attached to the server apparatus 400. The drive 912 reads information recorded on a mounted removable storage medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 903. The drive 912 can also write information on a removable storage medium.

  The communication device 915 is a communication interface configured with, for example, a communication device for connecting to a network. The communication device 915 may be a wireless LAN (Local Area Network) compatible communication device, an LTE (Long Term Evolution) compatible communication device, or a wire communication device that performs wired communication. The communication device 915 can communicate with other devices via a network, for example.

<< 5. Conclusion >>
As described above, according to the embodiment of the present disclosure, the display image information displayed by one terminal of the transmission terminal 100 and the reception terminal 200 and the information of the captured image captured by the other terminal are obtained. The information acquisition unit 311 to be acquired, the comparison unit 312 that compares the display image information and the captured image information to obtain a comparison result, and causes the transmission terminal 100 to transmit data to the reception terminal 200 according to the comparison result. And a transmission control unit 313 for controlling whether or not the control device 300 is provided.

  According to this configuration, it is possible to reduce the possibility of erroneous data transmission from the transmission terminal 700 to the reception terminal 800 while reducing the complexity of the operation given to the user. Further, according to this configuration, it is possible to reduce the time required to store desired data in the receiving terminal 800.

  In addition, although preferred embodiment of this indication was described in detail, referring an accompanying drawing, the technical scope of this indication is not limited to this example. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

  In addition, it is possible to create a program for causing hardware such as a CPU, ROM, and RAM incorporated in a computer to exhibit functions equivalent to the functions of the transmission terminal 100 described above. Also, a computer-readable recording medium that records the program can be provided. In addition, it is possible to create a program for causing hardware such as a CPU, ROM, and RAM incorporated in a computer to exhibit functions equivalent to the functions of the receiving terminal 200 described above. Also, a computer-readable recording medium that records the program can be provided.

  In addition, it is possible to create a program for causing hardware such as a CPU, ROM, and RAM incorporated in a computer to exhibit functions equivalent to the functions of the control device 300 described above. Also, a computer-readable recording medium that records the program can be provided. In addition, it is possible to create a program for causing hardware such as a CPU, ROM, and RAM incorporated in a computer to exhibit functions equivalent to the functions of the server device 400 described above.

The following configurations also belong to the technical scope of the present disclosure.
(1)
An information acquisition unit that acquires information of a display image displayed by one terminal of the transmission terminal and the reception terminal and information of a captured image captured by the other terminal;
A comparison unit that compares the information of the display image and the information of the captured image to obtain a comparison result;
A transmission control unit for controlling whether to perform data transmission from the transmission terminal to the reception terminal according to the comparison result;
A control device comprising:
(2)
The data transmitted from the transmitting terminal to the receiving terminal includes at least video.
The control device according to (1) above.
(3)
The video transmitted from the transmitting terminal to the receiving terminal includes at least the video displayed by the transmitting terminal.
The control device according to (2).
(4)
The data transmitted from the transmitting terminal to the receiving terminal includes at least an application.
The control device according to any one of (1) to (3).
(5)
The application transmitted from the transmitting terminal to the receiving terminal includes at least an application executed by the transmitting terminal,
The control device according to (4).
(6)
The data transmitted from the transmitting terminal to the receiving terminal includes at least an application execution state and a file generated by application execution in the transmitting terminal.
The control device according to any one of (1) to (5).
(7)
The transmission control unit causes the transmission terminal to perform data transmission when the comparison result indicates coincidence or similarity between the information of the display image and the information of the captured image.
The control device according to any one of (1) to (6).
(8)
The information on the display image includes a feature amount extracted from the display image, and the information on the captured image includes a feature amount extracted from the captured image.
The control device according to any one of (1) to (7).
(9)
The display image information includes part or all of the display image, and the captured image information includes part or all of the captured image.
The control device according to any one of (1) to (7).
(10)
The information acquisition unit acquires additional information from the transmitting terminal and acquires additional information from the receiving terminal,
The comparison unit further compares the additional information acquired from the transmitting terminal with the additional information acquired from the receiving terminal;
The control device according to any one of (1) to (9).
(11)
The comparison unit compares the information of the display image and the information of the captured image when the difference between the time when the display image is acquired and the time when the captured image is acquired is within a predetermined range.
The control device according to any one of (1) to (10).
(12)
The control device is incorporated in the transmission terminal,
The control device according to any one of (1) to (11).
(13)
The control device is incorporated in the receiving terminal,
The control device according to any one of (1) to (11).
(14)
The control device is incorporated in a server device different from the transmission terminal and the reception terminal,
The control device according to any one of (1) to (11).
(15)
Obtaining information of a display image displayed by one terminal of a transmission terminal and a reception terminal and information of a captured image captured by the other terminal;
Comparing the information of the display image and the information of the captured image to obtain a comparison result;
Controlling whether to perform data transmission to the transmitting terminal and the receiving terminal according to the comparison result;
Including a control method.
(16)
When it is determined that the comparison result between the information of the display image displayed by one terminal of the terminal and the receiving terminal and the information of the captured image captured by the other terminal is identical or similar, A communication control unit that causes the communication unit to perform data communication to the receiving terminal;
A transmitting terminal comprising:
(17)
The data transmitted to the receiving terminal includes at least video.
The transmission terminal according to (16).
(18)
The data transmitted to the receiving terminal includes at least an application.
The transmission terminal according to (16) or (17).
(19)
The data transmitted to the receiving terminal includes at least an application execution state in the transmitting terminal.
The transmission terminal according to any one of (16) to (18).
(20)
The communication control unit switches a transmission path of data transmitted by the communication unit from a wireless LAN to a public wireless network when the distance to the receiving terminal is larger than a predetermined distance.
The transmission terminal according to any one of (16) to (19).
(21)
When it is determined that the comparison result between the information of the display image displayed by one terminal of the terminal and the receiving terminal and the information of the captured image captured by the other terminal is identical or similar, Causing the communication unit to perform data communication to the receiving terminal;
Including transmission method.
(22)
When it is determined that the comparison result between the display image information displayed by one terminal of the terminal and the transmission terminal and the information of the captured image captured by the other terminal is identical or similar, A communication control unit that causes the communication unit to receive data from the transmitting terminal;
A receiving terminal.
(23)
The receiving terminal is
A display control unit configured to display a video based on data received from the transmission terminal on a display unit;
The receiving terminal according to (22).
(24)
When the display control unit receives data from the transmission terminal, the display control unit shifts the display by the display unit from an image captured by the imaging unit to a video based on the data received from the transmission terminal.
The receiving terminal according to (23).
(25)
The data received from the transmitting terminal includes at least a video and an application execution state and a file generated by application execution,
The display control unit switches the display by the display unit from the video to an application execution result based on the application execution state and the file when the distance to the transmission terminal is larger than a predetermined distance.
The receiving terminal according to any one of (23) and (24).
(26)
The data received from the transmitting terminal includes at least a video and an application, an application execution state, and a file generated by application execution,
The display control unit prepares to display the execution result of the application while displaying the video on the display unit, and displays the display by the display unit from the video when a predetermined timing arrives. Switch to the execution result of the application based on the application execution state and the file,
The receiving terminal according to any one of (23) to (25).
(27)
When it is determined that the comparison result between the display image information displayed by one terminal of the terminal and the transmission terminal and the information of the captured image captured by the other terminal is identical or similar, Causing the communication unit to receive data from the sending terminal;
Including a receiving method.
(28)
A control system comprising a control device, a transmission terminal, and a reception terminal,
The controller is
An information acquisition unit that acquires information of a display image displayed by one terminal of the transmission terminal and the reception terminal and information of a captured image captured by the other terminal;
A comparison unit that compares the information of the display image and the information of the captured image to obtain a comparison result;
A transmission control unit that controls whether to perform data transmission from the transmission terminal to the reception terminal according to the comparison result,
The transmitting terminal is
A communication control unit that causes a communication unit to perform data communication to the receiving terminal when it is determined that the comparison result indicates coincidence or similarity;
The receiving terminal is
A communication control unit that causes a communication unit to perform data reception from the transmission terminal when it is determined that the comparison result indicates coincidence or similarity;
Control system.

DESCRIPTION OF SYMBOLS 10 Control system 100 Transmission terminal 110 Control part 111 Display control part 112 Captured image acquisition part 113 Communication control part 120 Input part 130 Imaging part 140 Detection part 150 Storage part 160 Communication part 170 Display part 200 Receiving terminal 210 Control part 211 Display control part 212 captured image acquisition unit 213 communication control unit 220 input unit 230 imaging unit 240 detection unit 250 storage unit 260 communication unit 270 display unit 300 control device 311 information acquisition unit 312 comparison unit 313 transmission control unit 400 server device 410 control unit 450 storage unit 460 Communication Department

Claims (28)

An information acquisition unit that acquires information of a display image displayed by one terminal of the transmission terminal and the reception terminal and information of a captured image captured by the other terminal;
A comparison unit that compares the information of the display image and the information of the captured image to obtain a comparison result;
A transmission control unit for controlling whether to perform data transmission from the transmission terminal to the reception terminal according to the comparison result;
A control device comprising: The data transmitted from the transmitting terminal to the receiving terminal includes at least video.
The control device according to claim 1. The video transmitted from the transmitting terminal to the receiving terminal includes at least the video displayed by the transmitting terminal.
The control device according to claim 2. The data transmitted from the transmitting terminal to the receiving terminal includes at least an application.
The control device according to claim 1. The application transmitted from the transmitting terminal to the receiving terminal includes at least an application executed by the transmitting terminal,
The control device according to claim 4. The data transmitted from the transmitting terminal to the receiving terminal includes at least an application execution state and a file generated by application execution in the transmitting terminal.
The control device according to claim 1. The transmission control unit causes the transmission terminal to perform data transmission when the comparison result indicates coincidence or similarity between the information of the display image and the information of the captured image.
The control device according to claim 1. The information on the display image includes a feature amount extracted from the display image, and the information on the captured image includes a feature amount extracted from the captured image.
The control device according to claim 1. The display image information includes part or all of the display image, and the captured image information includes part or all of the captured image.
The control device according to claim 1. The information acquisition unit acquires additional information from the transmitting terminal and acquires additional information from the receiving terminal,
The comparison unit further compares the additional information acquired from the transmitting terminal with the additional information acquired from the receiving terminal;
The control device according to claim 1. The comparison unit compares the information of the display image and the information of the captured image when the difference between the time when the display image is acquired and the time when the captured image is acquired is within a predetermined range.
The control device according to claim 1. The control device is incorporated in the transmission terminal,
The control device according to claim 1. The control device is incorporated in the receiving terminal,
The control device according to claim 1. The control device is incorporated in a server device different from the transmission terminal and the reception terminal,
The control device according to claim 1. Obtaining information of a display image displayed by one terminal of a transmission terminal and a reception terminal and information of a captured image captured by the other terminal;
Comparing the information of the display image and the information of the captured image to obtain a comparison result;
Controlling whether to perform data transmission to the transmitting terminal and the receiving terminal according to the comparison result;
Including a control method. When it is determined that the comparison result between the information of the display image displayed by one terminal of the terminal and the receiving terminal and the information of the captured image captured by the other terminal is identical or similar, A communication control unit that causes the communication unit to perform data communication to the receiving terminal;
A transmitting terminal comprising: The data transmitted to the receiving terminal includes at least video.
The transmission terminal according to claim 16. The data transmitted to the receiving terminal includes at least an application.
The transmission terminal according to claim 16. The data transmitted to the receiving terminal includes at least an application execution state in the transmitting terminal.
The transmission terminal according to claim 16. The communication control unit switches a transmission path of data transmitted by the communication unit from a wireless LAN to a public wireless network when the distance to the receiving terminal is larger than a predetermined distance.
The transmission terminal according to claim 16. When it is determined that the comparison result between the information of the display image displayed by one terminal of the terminal and the receiving terminal and the information of the captured image captured by the other terminal is identical or similar, Causing the communication unit to perform data communication to the receiving terminal;
Including transmission method. When it is determined that the comparison result between the display image information displayed by one terminal of the terminal and the transmission terminal and the information of the captured image captured by the other terminal is identical or similar, A communication control unit that causes the communication unit to receive data from the transmitting terminal;
A receiving terminal. The receiving terminal is
A display control unit configured to display a video based on data received from the transmission terminal on a display unit;
The receiving terminal according to claim 22. When the display control unit receives data from the transmission terminal, the display control unit shifts the display by the display unit from an image captured by the imaging unit to a video based on the data received from the transmission terminal.
The receiving terminal according to claim 23. The data received from the transmitting terminal includes at least a video and an application execution state and a file generated by application execution,
The display control unit switches the display by the display unit from the video to an application execution result based on the application execution state and the file when the distance to the transmission terminal is larger than a predetermined distance.
The receiving terminal according to claim 23. The data received from the transmitting terminal includes at least a video and an application, an application execution state, and a file generated by application execution,
The display control unit prepares to display the execution result of the application while displaying the video on the display unit, and displays the display by the display unit from the video when a predetermined timing arrives. Switch to the execution result of the application based on the application execution state and the file,
The receiving terminal according to claim 23. When it is determined that the comparison result between the display image information displayed by one terminal of the terminal and the transmission terminal and the information of the captured image captured by the other terminal is identical or similar, Causing the communication unit to receive data from the sending terminal;
Including a receiving method. A control system comprising a control device, a transmission terminal, and a reception terminal,
The controller is
An information acquisition unit that acquires information of a display image displayed by one terminal of the transmission terminal and the reception terminal and information of a captured image captured by the other terminal;
A comparison unit that compares the information of the display image and the information of the captured image to obtain a comparison result;
A transmission control unit that controls whether to perform data transmission from the transmission terminal to the reception terminal according to the comparison result,
The transmitting terminal is
A communication control unit that causes a communication unit to perform data communication to the receiving terminal when it is determined that the comparison result indicates coincidence or similarity;
The receiving terminal is
A communication control unit that causes a communication unit to perform data reception from the transmission terminal when it is determined that the comparison result indicates coincidence or similarity;
Control system.

Images