JP6532342B2 - Communication apparatus, control method and program - Google Patents

Description

  The present invention relates to a communication apparatus, control method, and program capable of performing video transmission with another communication apparatus.

BACKGROUND In recent years, video transmission technology for displaying a screen image of a small terminal such as a smartphone on a large screen of another terminal is widely used. Specifically, the video signal of the screen image of the small terminal is encoded, and the encoded video signal is transmitted to another terminal having a large screen. Then, in the other terminal that has received the video signal, the received video signal is decoded, and the screen image of the small terminal is mirrored on the large screen.
As such video transmission technology, there is a Display service of “Wi-Fi (registered trademark) CERTIFIED Display” (hereinafter, WFD) or “Peer to Peer Services” (hereinafter, P2Ps) which is a technology newer than WFD. The P2Ps Display service is backward compatible with WFD.
In order to perform video transmission using these techniques, it is necessary to search for a device capable of providing a video transmission service on the network. Patent Document 1 discloses a technique for searching for a device capable of providing a designated service on a network and connecting according to the user's selection.

JP, 2014-165594, A

However, it is cumbersome for the user to select whether to perform a search specifying a Display service in P2Ps or a search specifying a WFD. When the user does not make the selection, it is conceivable that the search for P2Ps and the search for WFD are performed in parallel. In this case, when the two search results are displayed side by side, two types of display as the search result of P2Ps and the display as the search result of the WFD search are displayed although they are the same device. It is difficult for the user to understand.
Furthermore, even if the partner device is compatible with the new technology P2Ps, if the partner device is selected from the search result of the WFD search, there is a possibility that WFD connection is made.
The present invention has been made in view of the above problems, and, even in an environment in which devices complying with a plurality of video transmission procedures coexist, when searching for and connecting to another communication device with which video transmission is to be performed. The purpose is to improve the convenience of

In order to solve the above problems, one aspect of a communication apparatus according to the present invention is a communication apparatus, and the first transmission means for executing video transmission conforming to a first communication method; preferentially executed from video transmission conforming to the first communication method, and second transmission means for performing a video transmission that complies with the second communication method, and selecting means for selecting the another communication device, wherein Determining means for determining whether the other communication device selected by the selecting means can execute both video transmission conforming to the first communication method and video transmission conforming to the second communication method And when it is determined by the determination unit that the other communication apparatus can execute both video transmission compliant with the first communication scheme and video transmission compliant with the second communication scheme. Accept user operations Ku and a control means for controlling to perform image transmission by the other communication device the second transmission means.

  According to the present invention, it is possible to improve the convenience when searching for and connecting to another communication device with which video transmission is to be performed.

FIG. 2 is a diagram showing an example of a hardware functional block of the mirroring device 100. It is a system configuration figure which each apparatus of this embodiment constitutes. It is a sequence diagram showing the example of the processing between the communication apparatuses of this embodiment. It is a sequence diagram between communication apparatuses following FIG. It is a flowchart which shows operation | movement of P2Ps apparatus 200-U. It is a flowchart of operation | movement of P2Ps apparatus 200-U following FIG. It is a flowchart which shows the processing operation of the control part 101 in WFD connection. It is a flowchart which shows the processing operation of the control part 101 in P2Ps connection.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
The embodiment described below is an example as a realization means of the present invention, and it should be appropriately corrected or changed according to the configuration of the apparatus to which the present invention is applied and various conditions. It is not limited to the embodiment of the invention.
Prior to describing each embodiment of the present invention, the terms, abbreviations, functional blocks, and the like common to each embodiment will be described in the present specification.
In this specification, with regard to wireless communication, "IEEE 802.11 std. Compliant communication", "Wi-Fi communication", "wireless LAN (Local Area Network) communication", "WLAN (Wireless LAN) communication", etc. are synonymous. In terms of
"Video" is a term that includes either "moving image" or "still image" or both.

A "source device" refers to a device that transmits video data via a communication medium. When the source device transmits video data, encoding for data amount compression may be performed. For example, in WFD and “Display” services of P2Ps (hereinafter referred to as “P2Ps Display”), H.264, which is a standard of ITU-T or ISO / IEC, is used. The H.264 coding scheme is used. P2Ps is backward compatible with WFD.
The “sink device” is a device that receives the transmitted video data, decodes it as necessary, and displays it.
In the sink device, even in a configuration in which the communication unit / decoding unit and the display unit are separate housings, and they are connected by an HDMI (registered trademark) (High-Definition Multimedia Interface) cable or other wired / wireless communication. Good.
The “mirroring device” is a generic name of these source devices and sink devices, and is a video transmission device.
Note that both WFD and P2Ps Display communicate their control information by RTSP (Real Time Streaming Protocol). Further, the display content (content) is communicated by RTP (Real Time Transport Protocol).

(Hardware configuration of mirroring device)
FIG. 1 shows a general configuration of hardware functional blocks of the mirroring device 100. As shown in FIG.
In order to simplify the description, FIG. 1 shows the source device and the sink device in common. In fact, among tablet terminals and smart devices, there are devices that have both a source function and a sink function and can operate as a source device and a sink device. On the other hand, there is also a device such as a television receiver that has only a sink function and operates only as a sink device.
In FIG. 1, the mirroring device 100 includes a housing 110, a display device 108, and an input device 109. In the mirroring device 100, the case 110, the display device 108 (display means), and the input device 109 may be integrally configured in the same case.

As shown in FIG. 1, the mirroring device 100 includes a control unit 101, a storage unit 102, an encoding / decoding unit 103, a wireless LAN unit 104, a display control unit 105, and the like in a housing 110. And a control unit 106. The control unit 101 includes a CPU or the like that executes a control program stored in the storage unit 102.
The storage unit 102 holds a control program executed by the control unit 101, and stores data necessary for control. Specifically, the storage unit 102 may be configured by a non-volatile ROM, a volatile RAM, or the like. As described later, various controls performed by the mirroring device 100 are performed by the control unit 101 (CPU) executing a control program stored in the storage unit 102.
Further, by combining the control unit 101 and the storage unit 102, it is possible to realize a timer function and a clocking function. Instead of this, hardware that realizes a timer function and a clocking function may be provided. Also, for example, a timer service provided through the Internet may be used.

The encoding / decoding unit 103 performs encoding and / or decoding of the video data on the storage unit 102. A wireless LAN unit 104 manages the function of the wireless LAN. The mirroring device 100 can communicate with other surrounding devices via the wireless LAN unit.
The display control unit 105 is a display interface (output interface) for connecting the display device 108 in a housing different from the housing 110. The input control unit 106 is an input interface for connecting the input device 109 in a housing different from the housing 110.
The bus 107 is a bus which mutually connects each part inside the housing 110, and may be a control bus, a data bus, a power supply line, or the like. The power supply unit to the mirroring device 100 is omitted in FIG. 1 and not shown.
The display device 108 is a variety of displays, a projector that projects an image, or the like, and may include a touch panel, a pressure-sensitive display, or the like. The input device 109 is an input device including a mouse, a keyboard, and the like.

(System configuration)
FIG. 2 is a block diagram of a video transmission system according to the present embodiment, showing respective software functional blocks of the WFD device and the P2Ps device, and their connection relationship. In FIG. 2, the P2Ps device 200-U is a device capable of executing two types of video transmission procedures, a WFD procedure and a P2Ps procedure. The P2Ps device 200-B corresponds to the P2Ps procedure, and the WFD device 200-A corresponds to the WFD procedure. In FIG. 2, the P2Ps device 200-U is shown as a video transmission side, and the WFD device 200-A and the P2Ps device 200-B are shown as a video reception side.

Next, each software functional block shown in FIG. 2 will be described.
First, the P2Ps device 200-U includes a Wi-Fi Display function unit 201-U that executes the WFD function, a P2Ps Display function unit 202-U, and an ASP function unit 203-P that is P2Ps-based. Here, ASP is an abbreviation for Application Service Platform. The P2Ps device 200-U also includes a Peer-to-Peer function unit 204-U that performs wireless direct communication without an access point, such as Wi-Fi Direct (registered trademark).
The configuration of the P2Ps device 200-B is also similar to the configuration of the P2Ps device 200-U, and the Wi-Fi Display function unit 201-B, the P2Ps Display function unit 202-B, and the P2Ps-based ASP function unit 203-B. Equipped with
On the other hand, the WFD device 200-A includes a Wi-Fi Display function unit 201-A that executes a WFD function, and a Peer-to-Peer function unit 204-A that performs wireless direct communication.

Note that the Peer-to-Peer function units 204-A, 204-B, and 204-U do not use Wi-Fi Direct (registered trademark) that performs wireless communication directly between communication devices without using a dedicated access point. It is the part to execute.
In addition, the ASP function units 203-B and 203-U realize the aforementioned "Send", "Print", "Play", "Display" and other services of P2Ps described above on wireless direct communication by Wi-Fi Direct. Functional block.
The hardware that executes the software can be common to the P2Ps devices 200-A and 200-U and the WFD device 200-B.
Arrows in FIG. 2 represent connection relations. The solid-line arrows in the example of FIG. 2 indicate that the P2Ps device 200-U operating as a source device and the P2Ps device 200-B operating as a sink device are connected in the P2Ps video transmission procedure. On the other hand, the broken arrow in FIG. 2 indicates that the P2Ps device 200-U operating as a source device and the WFD device 200-A operating as a sink device are connected in the WFD video transmission procedure.

(Video transmission process of this embodiment)
FIGS. 3 and 4 are sequence diagrams showing an example of video transmission processing between the P2Ps device 200-U on the source side and the WFD device 200-A and P2Ps device 200-B on the sink side of FIG.
In addition, in the example of FIG. 3, in order to clarify the distinction between the process of the user (user) and the process of the device, the lines of the sequence related to the P2Ps device 200-U are represented by two lines for convenience. One line shows the operation of the user of the P2Ps device 200-U and the display presented to the user, and the other line shows the process of the control unit 101 of the P2Ps device 200-U.
Each processing operation shown in the example of FIG. 3 is achieved by the CPU of the control unit 101 of the mirroring device 100 shown in FIG. 1 executing a program except for the operation of the user.

First, in step S301, the control unit 101 of the P2Ps device 200-U controls the display control unit 105 to cause the service menu to be displayed. Specifically, the CPU of the control unit 101 controls the display control unit 105 by executing a program stored in, for example, the storage unit 102 or the like.
In S302, the display control unit 105 causes the display device 108 to display a service menu that can be executed by the P2Ps device 200-U. The user selects a desired service from this service menu.
In S303, the user of the P2Ps device 200-U selects the "Display" service from the service menu displayed on the screen of the P2Ps device 200-U, and executes the operation for activating the "Display" service. It shall be. This operation may be, for example, an operation of touching or clicking a button of “Display” service on the screen, or may be an operation of pressing a predetermined key of the keyboard.

In S304, the control unit 101 of the P2Ps device 200-U detects an operation (input) for activating the "Display" service of the user via the input device 109 and the input control unit 106.
In step S305, after detecting the user's operation, the control unit 101 of the device 200-U first searches for a plurality of video transmission procedures (hereinafter, also simply referred to as "procedures") WFD procedure search request "probe request""Is issued. Specifically, the control unit 101 of the device 200 -U controls the wireless LAN unit 104 (first transmission unit) to transmit a (first) search request “probe request” to the surroundings.
In S306, the WFD device 200-A receives the search request "probe request" and transmits a response (based on) the WFD procedure to the P2Ps device 200-U in response to the "probe request". .
In S307, the P2Ps device 200-B similarly transmits a response according to the WFD procedure to the P2Ps device 200-U.

(Search operation in WFD procedure)
Here, the outline of the search operation of the WFD procedure in S305 to S307 of FIG. 3 will be described.
The search for the WFD procedure mainly consists of two procedures of “Device Discovery” and “Service Discovery”.
First, the procedure of “device discovery” is a procedure of finding specific information in each frame of “beacon (beacon: broadcast signal)”, “probe request”, and “probe response”.
The “WFD Device Information Subelement” of the “WFD IE” in these frames includes information such as “WFD Device Type bits” and “WFD Support bit”. Here, IE is an abbreviation of Information Element.
Among these, "WFD Device Type bits" indicates the type of the device. The type is, for example, a source, a primary sink, a secondary sink, and both functions.

Also, “WFD Support bit” is a bit (information) indicating the presence or absence of support for “WFD Service Discovery” (service discovery). Here, in the WFD standard, the support for WFD Service Discovery (service discovery) is not a requirement but an option. Therefore, some WFD devices can not exchange information by WFD Service Discovery.
Therefore, in the source device compatible with the WFD procedure, when searching for the WFD device, the user is given the device name of the device whose “WFD Device Type bits” found in the procedure of “device discovery” indicates a sink. Display against.

Returning to FIG. 3, in step S308, the control unit 101 and the display control unit 105 of the P2Ps device 200-U perform display control based on the response content received in step S306 or S307, and perform predetermined display on the display device 108. Let
In S309, the display device 108 displays a list of device names for which a response has been returned, under the control of the display control unit 105. The device name displayed here is the “Device Name” of “Wi-Fi Peer-to-Peer” defined in “Wi-Fi Peer-to-Peer (P2P) Technical Specification Version 1.5”. The display of S309 is a display prompting the user to select a device to be connected.

In S310, the user selects a desired device to be connected from the display of S309. In FIG. 2, the user selects either the WFD device 200 -A or the P2Ps device 200 -B.
In step S311, the control unit 101 acquires (recognizes) the input of the selection operation. That is, the control unit 101 is a selection unit (first selection unit) that receives a selection input. In the case where the user's selection operation is the WFD device 200-A, a sequence of a dashed frame A in FIG. 4A, and in the case of the P2Ps device 200-B, a sequence of a two-dot chain line B in FIG. move on. A plurality of connection destination devices may be selected.
FIG. 4A is a sequence diagram showing processing when the user selects the WFD device 200-A. The operation illustrated in FIG. 4A is achieved mainly by the CPU of the control unit 101 of the P2Ps device 200-U and the WFD device 200-A executing a program.

In step S412, first, the control unit 101 of the P2Ps device 200-U performs a search according to the video transmission procedure of P2Ps. This search is to add a hash value corresponding to the P2Ps Display service to the search request "probe request" and transmit it. The transmission is performed by the wireless LAN unit 104 (second transmission unit). The destination of the search request “probe request” may be a unicast address or a broadcast address addressed to the P2Ps device 200-A. As in the former case, when the search request specified in the P2Ps procedure is transmitted using unicast, efficient use of available bandwidth can be made.
The control unit 101 starts the response timer simultaneously with the transmission of the search request. The response timer is a timer that times out after a predetermined response time has elapsed since it was started.

In the video transmission system shown in FIG. 2, the WFD device 200-A does not return a response "probe response" (predetermined response) to the search request "probe request". As shown in FIG. 2, the WFD device 200 -A does not have a function corresponding to P2Ps.
For this reason, in S413, the response timer times out after a predetermined response time has elapsed.
In step S414, when the response timer times out, the control unit 101 of the P2Ps device 200-U controls the display control unit 105 to cause the display device 108 to perform predetermined display.
In S415, the display device 108 displays “WFD connection OK?” By display control of the display control unit 105 of the P2Ps device 200-U. This display requests the user to grant the WFD connection to the selected WFD device 200-A.
In S416, the user who has seen this display performs an operation as to whether to permit the WFD connection or not to permit the WFD connection.

In S417, the control unit 101 (second selection unit) of the P2Ps device 200-U acquires (recognizes) the user's operation input in S316. In FIG. 4A, the control unit 101 recognizes that the user has granted a WFD connection.
In S418, the control unit 101 of the P2Ps device 200-U proceeds with the connection procedure (connection process) in accordance with the WFD video transmission procedure with the WFD device 200-A. That is, the control unit 101 is a setting unit that sets a video transmission procedure. The control unit 101 is a connection unit that performs WFD connection processing with the WFD device 200 -A.

In step S419, the control unit 101 of the P2Ps device 200-U connected to the WFD device 200-A according to the WFD procedure controls the display control unit 105 to cause the display device 108 to perform predetermined display.
In S420, the display device 108 of the P2Ps device 200-U displays, for example, "during WFD connection: WFD stop becomes disconnection". This display is intended to inform the user of the WFD connection and to draw attention in the WFD connection. That is, the termination of WFD communication indicates that a common communication link layer (common link) that can also be used by various services of P2Ps may be disconnected. By this display, if the video display by mirroring is ended, the user may be aware that there is a risk that other services of the P2Ps device using the communication link layer may be terminated unexpectedly due to the disconnection of the communication link layer. Can be alerted.

In step S421, the control unit 101 of the P2Ps device 200-U performs transmission control so that the display content displayed in step S420 is added to the mirroring information and transmitted. That is, the above-mentioned display is transmitted to the other communication device (WFD device 200-A) which is the transmission destination of the video as the additional information to the mirroring information forming the content of the video transmission.
As a result, the WFD device 200 -A that has received the mirroring information and the additional information causes the display device 108 of the own device to display “WFD connected: WFD stop will be disconnected” based on the additional information. be able to. Thereby, the user of the WFD device 200 -A is notified of which video transmission procedure is used for video transmission.

On the other hand, returning to S416, there is also a case where the user operation does not permit the WFD connection. In this case, the control unit 101 of the P2Ps device 200-U may return to S412 or may terminate the start processing of the “Display” service itself.
Further, in the sequence of FIG. 4A, the control unit 101 may not perform steps S414 to S417 for asking the user to confirm the connection in the WFD procedure. In this case, immediately after the sequence S311 in FIG. 3, the connection processing by the WFD procedure from S418 in FIG. 4A is executed.

Next, the sequence in the case where the user selects the P2Ps device 200-B in the device selection of S310 in FIG. 3 will be described.
FIG. 4B is a sequence diagram showing processing when the user selects the P2Ps device 200-B. The operation shown in FIG. 4 (2) is mainly achieved by the CPU of the control unit 101 of the P2Ps device 200-U or P2Ps device 200-B executing a program.
In step S422, the control unit 101 first performs search processing according to the P2Ps video transmission procedure, as in step S412. However, when the control unit 101 transmits by unicast the search frame to be transmitted via the wireless LAN unit 104, the destination is the address of the P2Ps device 200-B.

  In S423, the P2Ps device 200-B returns a response in accordance with the P2Ps procedure. This response depends on the role of each device. In this embodiment, an example in which the role of the P2Ps device 200-U is "Seeker" for searching / requesting a service and the role of the P2Ps device 200-B is "Advertiser" for notifying / providing a service will be described. Do. When each device has such a role, the P2Ps device 200-B extracts the hash value included in the search request "probe request" transmitted from the P2Ps device 200-U. Subsequently, the ASP function unit 203-B of the P2Ps device 200-B collates the hash value with the service name (Service Name).

As a result of the comparison, the P2Ps device 200-B transmits “Service Name” and “Advertisement ID” in a “probe response” (predetermined response). Thus, the P2Ps device 200-B returns a response according to the P2Ps procedure. The control unit 101 of the P2Ps device 200-U receives the transmitted "probe response".
Furthermore, in the case of the P2Ps video transmission procedure, the P2Ps device 200-U transmits "Service Discovery Request" in S424. On the other hand, the P2Ps device 200-B executes a procedure of responding by transmitting "Service Discovery Response".
The control unit 101 of the P2Ps device 200-U receives the "Service Discovery Response" transmitted in S424, and executes the P2Ps connection procedure. That is, the control unit 101 is a setting unit that sets a video transmission procedure.

In S425, the control unit 101 of the P2Ps device 200-U controls the display control unit 105 to cause the display device 108 to perform predetermined display.
In S426, the display device 108 displays “P2Ps connected”. This display allows the user to know that the video transmission procedure of the currently connected link layer is P2Ps connection.
In S427, the control unit 101 of the P2Ps device 200-U transmits (mirroring transmission) to the P2Ps device 200-B, mirroring information which is the content to be subjected to video transmission. When the mirroring destination is the P2Ps device 200-B corresponding to P2Ps, the information of “P2Ps connected” may or may not be added as additional information to the mirroring information.

The P2Ps device 200-B performs mirroring display of the video based on the received mirroring information via the display device of the own device. When the additional information is added to the mirroring information, the display of "P2Ps connected" is displayed on the display device. Therefore, the user of the P2Ps device 200-B on the receiving side can easily know whether or not the P2Ps connection is currently used.
As described above, according to the present embodiment, even if the sink device of the video transmission service is a WFD device or a P2Ps device, the user seamlessly transmits the video without distinguishing the video transmission service. The service can be activated and video transmission can be smoothly performed.

(Operation flow of P2Ps device 200-U)
Next, the operation flow of the P2Ps device 200-U in the sequence shown in FIG. 3 and FIG. 4 will be described with reference to the flowcharts in FIG. 5 and FIG. However, the description of the parts overlapping with the parts described in FIG. 3 and FIG. 4 is omitted. In the operation explanation of the flowcharts shown in FIG. 5 and FIG. 6, the operation of the P2Ps device 200-U is executed by the control unit 101 controlling each part, unless otherwise specified. Such an operation of the control unit 101 is mainly achieved by the CPU of the control unit 101 executing a program.
In S501, the control unit 101 of the P2Ps device 200-U controls the display control unit 105 to cause the display device 108 to display a service selection menu.
In step S502, the control unit 101 of the P2Ps device 200-U is in a state of detecting a service selection operation of the user. The user performs a service selection operation using the input device 109, and the control unit 101 performs detection of the selected operation using the input device 109 and the input control unit 106.

When the service selected by the user detected by the control unit 101 is other than “Display”, it is not related to the operation according to the present embodiment, and thus the description thereof will be omitted. On the other hand, when the control unit 101 detects a selection operation of the “Display” service, the process advances to step S503.
In step S503, the control unit 101 of the P2Ps device 200-U searches for a WFD device. The search is performed by the control unit 101 controlling the wireless LAN unit 104 to broadcast a search request “probe request”.
In S504, the control unit 101 of the P2Ps device 200-U receives "probe response" which is a response to the WFD search. The control unit 101 executes this reception operation via the wireless LAN unit 104. In the configuration of FIG. 2 of the present embodiment, there is a response (probe response) from the WFD device 200 -A and the P2Ps device 200 -B.

In step S505, the control unit 101 of the P2Ps device 200-U performs display update control to display a device name (Device Name) each time a response is received. Specifically, the control unit 101 controls the display control unit 105 to cause the display device 108 to display the device name of the device that has returned the response.
In S506, the control unit 101 of the P2Ps device 200-U is in a state of detecting the device selection operation of the user. As in step S502, the control unit 101 detects the user's device selection operation using the input device 109 and the input control unit 106.
In step S506, when the control unit 101 detects an operation of device selection by the user, the process proceeds to step S607 in the flowchart of FIG. On the other hand, when the control unit 101 can not detect the user's device selection operation in S506, the process returns to S503, and the device search according to the WFD procedure is continued.

Continuing to refer to FIG. 6, when the control unit 101 of the P2Ps device 200-U detects the device selection in S506 in S607, it sends a search request "probe request" based on the P2Ps procedure to the selected device. Do. As described above, this "probe request" may be transmitted by unicast or may be transmitted by broadcast.
In S608, the control unit 101 of the P2Ps device 200-U starts a response timer. The response timer is a timer that times out after a predetermined time has elapsed, and here is a timer that defines the maximum value of the response time. If this response timer times out, it indicates that a time longer than the maximum response time has elapsed, and eventually it can be regarded as a case where no response is returned.

In step S609, the control unit 101 of the P2Ps device 200-U shifts to a state of waiting for a response, and when a response is received, the process proceeds to step S610. On the other hand, when there is no response, it progresses to S612.
In S610, the control unit 101 of the P2Ps device 200-U executes a connection procedure according to the P2Ps procedure.
In step S611, the control unit 101 of the P2Ps device 200-U causes the display device 108 to display that the connection has been established by P2Ps after the connection with the device selected by the user according to the P2Ps video transmission procedure is completed.
In S612, while there is no response, the control unit 101 of the P2Ps device 200-U checks whether the response timer has timed out. Then, when it is confirmed that the response timer has not timed out (that is, when it is within the predetermined time), the process returns to S609, and the response waiting is continued. On the other hand, if it is confirmed that the response timer has timed out (ie, if the predetermined time has elapsed), the process proceeds to S613.

In step S613, the control unit 101 of the P2Ps device 200-U performs a process of confirming the user's permission for the WFD connection. This processing is processing corresponding to the processing operation in S414 of FIG.
If the control unit 101 of the P2Ps device 200-U detects a selection operation “WFD connection may be sufficient” by the user, the process advances to step S614. On the other hand, when a selection operation to the effect that the WFD connection by the user is not desired is detected, the process returns to S607, and the P2Ps search is started again. Note that this WFD connection permission confirmation process may be omitted. In addition, when a selection operation to the effect that WFD connection by the user is not desired is detected in S613, the process itself of “Display” service may be stopped instead of returning to S607.
In S614, the control unit 101 of the P2Ps device 200-U starts a connection procedure by WFD. This WFD connection procedure is a procedure corresponding to S414 in FIG.
In step S615, the control unit 101 of the P2Ps device 200-U starts transmission of mirroring information to the sink device after the WFD connection procedure is completed. In the present embodiment, at this time, the control unit 101 of the P2Ps device 200-U adds additional information to a video (content) which is mirroring information and notifies.

  This additional information is for alerting the user of the WFD connection. That is, it is indicated that, by terminating the WFD communication, a communication link layer (common link) commonly used among a plurality of video transmission procedures between devices may be disconnected. By adding this additional information to the video (content) which is the mirroring information, information on the video transmission procedure being executed can be transmitted to the user who is viewing only the sink device, and attention can be drawn. This additional information may be any information as long as its meaning is clear, may be a predetermined flag, or may use predetermined bits in the control information. Further, it may be predetermined text data indicating the possibility that the communication link layer is disconnected by terminating the WFD communication. The additional information may be displayed superimposed on the image to be mirrored.

By transmitting this additional information, the user of the sink device can know that the procedure currently being used is the WFD procedure, and if mirroring by the WFD procedure is ended, other services are also ended. You can also know that there is a risk of
As described above, in the present embodiment, P2Ps connection is tried as much as possible in the processing after S609. Furthermore, WFD connection is to be established only when the user permits by control of S613 or later. The reason for performing such control in this embodiment is that the processing for the specific operation in the “Display” service is different between the two video transmission procedures of WFD and P2Ps. The details will be described below with reference to FIGS. 7 and 8.

(Control during WFD connection)
FIG. 7 is a flowchart showing the processing operation of the control unit 101 during WFD connection. The processing operation shown in FIG. 7 is mainly achieved by the CPU of the control unit 101 executing a program.
In S700, the steady state during WFD connection is shown.
In step S701, the control unit 101 determines whether the user has performed a WFD function stop operation. Hereinafter, the control unit 101 that makes the determination will be described as, for example, the control unit 101 in the P2Ps device 200-U (or B).
If the control unit 101 determines that the user has performed the WFD function stop operation, the processing proceeds to step S702. On the other hand, if it is determined that the user has not performed the WFD function stop operation, the processing proceeds to step S703.

In step S702, the control unit 101 performs communication link layer disconnection processing. Specifically, in the case of a wireless LAN, this disconnection process is to transmit either an Association (Deassociation) or a Deauthentication frame. The control unit 101 controls the wireless LAN unit 104 to transmit these frames, and executes disconnection processing.
In step S703, the control unit 101 determines whether an operation of “TEARDOWN” request indicating stop of mirroring in RTSP (Real Time Streaming Protocol) has been performed. If it is determined that the "TEARDOWN" request operation has been performed, the process proceeds to S704. On the other hand, when it is determined that the operation of the “TEARDOWN” request is not performed, the process returns to S701, and it is determined again whether the user has performed the WFD function stop operation.
In step S704, the control unit 101 ends the RTSP session and performs “TEARDOWN” processing such as releasing the RTSP server resource. Thereafter, the process proceeds to step S702, and the control unit 101 performs communication link layer disconnection processing.

As described above, when the P2Ps device 200-U and the P2Ps device 200-B are connected by the WFD procedure, if the WFD service is terminated on the P2Ps device 200-B, the Wi-Fi Direct communication link Cutting will occur. Further, not only termination of the WFD service but also termination of mirroring (TEARDOWN) similarly causes disconnection of Wi-Fi Direct.
In addition, if the disconnection of the Wi-Fi Direct is caused by the operation on the P2Ps device 200-B on the sink side, the disconnection can not be prevented from the P2Ps device 200-U side on the source side.

(Control during P2Ps connection)
Next, control during P2Ps connection will be described with reference to FIG.
FIG. 8 is a flowchart of the processing operation of the control unit 101 during P2Ps connection. The processing operation shown in FIG. 8 is mainly achieved by the CPU of the control unit 101 executing a program.
S800 represents the steady state during P2Ps connection.
In step S801, the control unit 101 determines whether a new P2Ps service start operation has been performed in the steady state during P2P connection. If the control unit 101 determines that the user has performed an operation of starting a new service by P2Ps, the processing proceeds to step S802. On the other hand, if it is determined that the user has not performed an operation to start a service by a new P2Ps, the process advances to step S804.
If the control unit 101 determines in step S802 that an operation to start a service has been performed, the control unit 101 establishes an application service platform (ASP) session corresponding to the service.

In step S803, the control unit 101 subsequently establishes a service session. Here, establishing a session, for example, when the service is "Send", means executing a file transfer procedure using FTP or TCP. Here, FTP is an abbreviation of File Transfer Protocol, and TCP is an abbreviation of Transmission Control Protocol.
In step S804, the control unit 101 determines whether a predetermined service termination operation has been performed. If the control unit 101 determines that the service end operation has been performed, the process advances to step S805. On the other hand, if it is determined that the service termination operation has not been performed, the processing returns to step S801.
In step S805, the control unit 101 ends the session of the service main body.
In step S806, the control unit 101 subsequently terminates the session of the service ASP.
In step S807, the control unit 101 determines whether another service is in operation. Here, when the control unit 101 determines that another service is being activated, the P2Ps connection is maintained. That is, the link layer of communication is maintained. Then, the state of control during connection of P2Ps is continued, and the process of FIG. 8 is continued.

If the control unit 101 determines in step S807 that there is no service being activated, the processing proceeds to step S808.
In step S808, the control unit 101 performs P2Ps disconnection processing. Specifically, this disconnection process is the same process as S702 in FIG.
As described above, when the P2Ps device 200-U and the P2Ps device 200-B are connected by the P2Ps procedure, even if there is an operation to end the “Display” service on the P2Ps device 200-B, the other (P2Ps ) Can continue the service.
For this reason, if there is a possibility of executing another service in addition to the "Display" service, it is desirable to connect with P2Ps as much as possible. Therefore, in the P2Ps device 200-U of this embodiment, the control from S613 to S615 shown in FIG. 6 is performed. Such control realizes guidance to a more desirable procedure for the user and prevention of careless operation. As a result, according to the present embodiment, video transmission communication with improved convenience for the user can be performed.

(Modification)
In addition, in S413 shown in FIG. 4 and S609 shown in FIG. 6, another control method may be used.
For example, in S413 of FIG. 4, the WFD device 200-A is a trigger for displaying whether the WFD connection is acceptable by not responding. However, instead of this, when the WFD device 200 -A returns “probe response” that does not include P2Ps information, it may be a trigger to display whether or not WFD connection is acceptable. In other words, the control unit 101 may proceed with the WFD procedure by not including information on P2Ps in the “probe request”, instead of advancing the WFD procedure due to the occurrence of timeout.

As described above, according to the present embodiment, after performing the device search according to the WFD procedure (first video transmission procedure), the user is shown the searched device and the user is selected Is configured to enter. Then, first, a search request according to the P2Ps procedure (second video transmission procedure) is transmitted to the device selected by the user.
As a result, it is possible to reduce the calculation load of the communication device (communication device) as compared to the case where the device search is performed at one time in a plurality of types of procedures. Since the search is performed serially for each transmission procedure and the determination processing as to whether the device is the same device may be performed only for the selected device, it is possible to reduce the operation load on the communication device side that performs the search.

In addition, when the search for P2Ps is performed first, the WFD device does not respond to the P2Ps search, and thus the display of the search result of the WFD device is delayed. Therefore, when the P2Ps search is performed first, the search result of the device corresponding to only WFD will be displayed after the delay. On the other hand, according to this embodiment, when the user performs an operation of instructing transmission of a video, first, WFD search is performed first. Thus, the search result can be obtained more quickly in response to the instruction from the user, and the search result can be presented to the user more quickly.
Furthermore, for the user, even when devices corresponding to a plurality of video transmission procedures are mixed, seamless video transmission operation can be performed without the user being aware of the distinction. Also, since the type of the video transmission procedure being connected is indicated to the user, the user can easily know the video transmission procedure currently connected, and mirroring of the video is easy for the user to understand and use. be able to.
Furthermore, since it is displayed and output to the user that other services will be terminated if video mirroring is disconnected, mirroring of easy-to-use communication devices and video can be performed.

Furthermore, according to the present embodiment, since the information on the type of the video transmission procedure in connection is added to the mirroring information as the additional information, the video transmission procedure in connection to the display device of the sink device on the video reception side Can be shown. In particular, as the additional information, when the video transmission procedure under connection is a procedure such that the service termination such as WFD results in the disconnection of the communication link, for the other services being executed concurrently with the unexpected communication link disconnection from the sink device side. It can prevent unexpected termination.
Also, in the above embodiment, one video transmission procedure (P2Ps described above) has been described as having backward compatibility with the other video transmission procedure (WFD described above). However, the present invention is applicable not only to this but also to each of a plurality of video transmission procedures, when there is interconnectivity.

As mentioned above, although the embodiment of the present invention was described in detail, these embodiments only showed the specific example in the case of practicing the present invention, and the technical scope of the present invention is limited to the above-mentioned embodiment. It is not a thing. The present invention can be modified in various ways without departing from the scope of the invention, which are also included in the technical scope of the present invention.
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

100: Mirroring device, 101: Control unit, 102: Storage unit, 104: Wireless LAN unit, 105: Display control unit, 106: Input control unit, 108: Display Device, 109 ... input device

Claims (12)

A communication device,
First transmission means for performing video transmission compliant with the first communication method;
A second transmission unit configured to execute video transmission conforming to a second communication scheme, which is executed preferentially to video transmission conforming to the first communication scheme in the communication apparatus;
Selection means for selecting another communication device ;
A determination as to whether the other communication device selected by the selection means can execute both video transmission conforming to the first communication scheme and video transmission conforming to the second communication scheme Means,
When it is determined by the determination unit that the other communication device can execute both video transmission conforming to the first communication method and video transmission conforming to the second communication method, the user operation Control means for controlling to perform video transmission by the other communication device and the second transmission means without accepting
A communication apparatus comprising: In the case where it is not determined by the determination unit that the other communication device can execute both video transmission compliant with the first communication method and video transmission compliant with the second communication method. User who selects whether to perform video transmission according to the first communication method with the other communication device when the other communication device can execute the video transmission according to the first communication method It further has a reception means for receiving a selection,
The control means is not determined that the other communication device can execute both the video transmission conforming to the first communication method and the video transmission conforming to the second communication method, and the user If it is selected to perform video transmission conforming to the first communication method by selection, control is performed to perform video transmission by the other communication device and the first transmission unit,
It is not determined that both video transmission compliant with the first communication scheme and video transmission compliant with the second communication scheme can be performed, and video compliant with the first communication scheme by the user selection If it is selected not to perform transmission, the communication apparatus according to claim 1, characterized that you control so as not to perform video transmission that conforms to the other communication device the first communication method. Further comprising a table 示手 stage that displays information indicating whether to perform a video transmission to said another communication device to the display unit of the communication device by the first transmission means or the second transmission means The communication device according to claim 1 or 2 . First transmission means for transmitting a first search request conforming to the first communication scheme ;
First receiving means for receiving a first response to the first search request sent by the first sending means ;
Second transmitting means for sending a second search request that complies with the second communication method,
And second receiving means for receiving a second response to the second search request transmitted by the second transmission means.
The determination unit is configured to transmit the first search request by the first transmission unit and the transmission of the second search request by the second transmission unit. The other communication device receives the first response from the other communication device and the second reception means receives the second response from the other communication device by the second receiving means, a video transmission that conforms to the first communication method, according to any one of claims 1 to 3, wherein the determining that it can perform both a video transmission that complies with the second communication method Communication device. When the selection means transmits the first search request by the first transmission means, the other one of the other communication devices that has transmitted the first response received by the first reception means Select the communication device of
  5. The communication apparatus according to claim 4, wherein the second transmission unit transmits the second search request after the other communication apparatus is selected by the selection unit. 6. The communication apparatus according to claim 5 , wherein the second transmission unit transmits the second search request in unicast to the other communication apparatus. The first search request is a probe request conforming to the Wi-Fi Display (WFD) standard, and includes a WFD Information Element,
The communication apparatus according to any one of claims 4 to 6, wherein the first response is a probe response compliant with the Wi-Fi Display standard, and includes a WFD Information Element. The second search request is a probe request conforming to the Peer to Peer Services (P2Ps) standard, and includes a hash value corresponding to the Display service of the P2Ps standard,
The communication apparatus according to any one of claims 4 to 7, wherein the second response is a probe response conforming to the P2Ps standard, and includes a service name corresponding to the hash value. The communication apparatus according to any one of claims 1 to 8, wherein the first transmission unit executes video transmission compliant with the WFD standard. The communication apparatus according to any one of claims 1 to 9, wherein the second transmission unit executes video transmission conforming to the P2Ps standard. A control method of the communication device ,
Performing video transmission in accordance with the first communication scheme;
Executing, in the communication device, video transmission conforming to a second communication method, which is preferentially executed over video transmission conforming to the first communication method;
Selecting another communication device ;
Determining whether the selected other communication device can execute both video transmission compliant with the first communication scheme and video transmission compliant with the second communication scheme;
If it is determined that the other communication device can execute both video transmission conforming to the first communication method and video transmission conforming to the second communication method, the user may not receive the user operation. Controlling to perform video transmission by another communication device and the second transmission unit ;
A control method of a communication apparatus, comprising : Program for causing a computer to function as each unit of the communication apparatus according to any one of 0 claims 1 1.

Images