JP6278031B2 - Data processing system, data processing apparatus, and data processing method - Google Patents

Description

The present invention relates to a data processing system, a data processing apparatus and data processing how.

Conventionally, when image data captured by an imaging device such as a digital camera is transmitted to a mobile terminal such as a smartphone, or instruction information related to imaging is transmitted from the mobile terminal to the imaging device, Wi-Fi communication or A technique using Bluetooth (registered trademark) communication is known (see Patent Document 1).
In recent years, it has become possible to use BLE (Bluetooth Low Energy) (trademark) technology that enables communication with lower power consumption.
Each communication technology has different characteristics such as communication speed, power consumption, and convenience in use, and it is necessary to perform communication in accordance with rules (constraints) according to each characteristic.

JP 2014-230024 A

  However, in the above-described technology, it has been impossible to effectively operate the communication characteristics (or satisfy the rules) and operate the imaging device and the portable terminal more effectively in cooperation. The same applies to cooperation between devices other than cameras and smartphones.

  The present invention has been made in view of such a situation, and under the respective restrictions, the communication characteristics are effectively utilized (or satisfying the rules), and a plurality of devices are operated more effectively in cooperation with each other. For the purpose.

In order to solve the above object, a data processing system according to one embodiment of the present invention includes:
A data processing system in which a peripheral device that is a device that provides a predetermined function and a central device that is a device that uses a function provided by the peripheral device perform predetermined data processing in cooperation with each other,
Said peripheral equipment,
Sends a A Dobataijingu signal, establishes a communication connection with the central device has responded to the advertising signal, a communication connection by performing periodic communication with a central device that established this communication connection A first communication unit that performs communication control according to the first communication method to be maintained;
A control unit that executes the predetermined data processing in cooperation with the central device;
With
The central device is
Detecting the advertising signal the peripheral device transmits, prior SL establishes communication connection by the first communication method with a peripheral device, to perform a regular communication with the peripheral device that established this communication connection A first communication unit that performs communication control according to the first communication method to maintain communication connection at
A control unit that executes the predetermined data processing in cooperation with the peripheral device;
With
The control unit of the peripheral device and the control unit of the central device,
Move any peripheral device and any central device to the pairing state that is a combination of each other,
Establishing a communication connection by the first communication unit between the peripheral device and the central device that have transitioned to the pairing state,
Execute the predetermined data processing in cooperation with the peripheral device and the central device transferred to the pairing state,
The control unit of the peripheral device is
When transmitting the advertising signal, the first communication unit is controlled to change a part of the advertising signal according to the pairing state,
The control unit of the central device is
The first communication unit is configured to determine whether to establish a communication connection with the peripheral device according to the pairing state and a change state of a part of the advertising signal received from the peripheral device. Control,
It is characterized by that.

  According to the present invention, it is possible to effectively utilize communication characteristics (or satisfy the rules) and operate a plurality of devices in cooperation with each other under each constraint.

It is a system configuration figure showing the system configuration of the communication system concerning one embodiment of the present invention. It is a schematic diagram which shows an example of the data communication performed with a communication system. It is a block diagram which shows the hardware configuration of the imaging device and portable terminal which concern on one Embodiment of this invention. It is a functional block diagram which shows the functional structure for performing an automatic image reception process and a mode operation process among the functional structures of the imaging device of FIG. 3, and a portable terminal. 5 is a flowchart for explaining the flow of automatic image reception processing executed by the imaging apparatus and portable terminal of FIG. 3 having the functional configuration of FIG. 4. 5 is a flowchart illustrating a flow of mode operation processing executed by the imaging device and portable terminal of FIG. 3 having the functional configuration of FIG. 4. It is a schematic diagram which shows the display of the communication status in an imaging device and a portable terminal. It is a system configuration figure showing the system configuration of the communication system concerning one embodiment of the present invention. 5 is a flowchart for explaining the flow of automatic image reception processing executed by the imaging apparatus and portable terminal of FIG. 3 having the functional configuration of FIG. 4. 5 is a flowchart illustrating a flow of mode operation processing executed by the imaging device and portable terminal of FIG. 3 having the functional configuration of FIG. 4. It is a schematic diagram which shows the display of the communication status in an imaging device and a portable terminal. It is a functional block diagram which shows the functional structure for performing an image sharing process among the functional structures of the portable terminal and server of FIG. It is a flowchart explaining the flow of the image sharing process which the portable terminal of FIG. 3 which has the functional structure of FIG. 15, and a server perform. It is an operation | movement block diagram of the application in the imaging device and portable terminal in the communication system of this embodiment. It is a flowchart which shows the operation | movement sequence with the imaging device and portable terminal in the communication system of this embodiment. It is a schematic diagram which shows the selection screen of the album in an application. It is a flowchart explaining the flow of an album registration process. It is a flowchart explaining the flow of an automatic transmission process. It is a flowchart explaining the flow of the album selection process by the camera side. It is a flowchart explaining the flow of an image registration process. It is a schematic diagram which shows the example of a screen display in an imaging device. It is a schematic diagram which shows the example of a screen display in an imaging device. It is a functional block diagram which shows the functional structure for performing a pairing connection process among the functional structures of the imaging device of FIG. 3, and a portable terminal. It is a flowchart explaining the flow of the pairing connection process which the imaging device of FIG. 3 which has a functional structure of FIG. 29, and a portable terminal perform. It is a flowchart explaining the other flow of the pairing connection process which the portable terminal which has a functional structure of FIG. 29 performs. It is a flowchart for demonstrating the background process process of automatic transmission. It is a flowchart for demonstrating the background process process of automatic transmission. It is a flowchart for explaining a BLE connection parameter adaptive setting process. It is a flowchart for demonstrating a Wi-Fi setting control process. It is a flowchart for demonstrating Menu open processing. It is a flowchart for demonstrating the mode determination process of the camera starting by BLE communication.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<First Embodiment>
FIG. 1 is a system configuration diagram showing a system configuration of a communication system according to an embodiment of the present invention.
As shown in FIG. 1, the communication system S includes an imaging device 1 having at least an imaging / communication function, and a portable terminal 2 that is an information terminal having at least an image display / communication function.
In the communication system S, when the user operates one of the imaging device 1 and the portable terminal 2, data communication at the image file level from the operating device operated by the user to the other device. A communication connection request is made in a communication method capable of transmitting and receiving an image file with the other device in response to an operation of the operation device in a state where the communication connection between the imaging device 1 and the portable terminal 2 is established. And a function of browsing image data held by the other device. In the present embodiment, “establishing” a communication connection means that a partner that communicates with each other is designated and a predetermined procedure (negotiation) is performed to recognize the partner that communicates with each other, and thereafter, communication is performed. It is to be able to communicate at any time without performing a predetermined procedure every time. This state is maintained until a procedure for releasing the communication connection is performed. Further, the state where the communication connection is “established” is maintained even when the radio wave condition is deteriorated and communication is temporarily disabled or the power of the device is turned off.

In the communication system S of the present embodiment, the communication connection between the imaging device 1 and the portable terminal 2 is established in a state where data communication is possible using two communication methods. In the communication system S, a low-speed but power-saving wireless communication method (hereinafter referred to as “first communication method”) and a high-speed wireless communication method (hereinafter referred to as “first communication method”) are described. It is configured to perform communication by a communication method of “second communication method”. In the present embodiment, the first communication method uses a communication method based on the communication standard of Bluetooth low energy / Bluetooth LE (trademark) (hereinafter referred to as “BLE”). In addition, the second communication method uses a communication method based on a Wi-Fi (Wireless Fidelity) communication standard in a wireless LAN (Local Area Network).
In the present embodiment, Wi-Fi, which is the second communication method, consumes a large amount of power in a state where a communication connection is established, and therefore it can be predicted that the waiting time until the next data transfer will be increased. The power consumption is reduced by releasing the communication connection each time. Further, in a state where the communication connection has not been established, it is not possible to automatically turn on the power of the counterpart device or start the application by communication using Wi-Fi as the second communication method. For this reason, in the communication system S of the present embodiment, the BLE that is the first communication method with low power consumption is always connected, and the Wi-Fi communication connection that is the second communication method is established according to the situation.
The continuous connection by BLE, which is the first communication method, is actually performed by external cooperation from a plurality of devices when there are a plurality of imaging devices and portable terminals each having an external cooperation function within the distance range in which communication connection is possible. It is possible to arbitrarily select a combination of the imaging device 1 and the portable terminal 2 that use the function and maintain the selected combination of the imaging device 1 and the portable terminal 2 until the external cooperation function is canceled. To do.
A method (pairing process) for selecting a combination of the imaging device 1 and the portable terminal 2 from a plurality of devices and starting a constant connection by BLE as the first communication method will be described later.

Here, an example in which an image file is transmitted from the imaging apparatus 1 that is always connected by BLE, which is the first communication method, to the portable terminal 2 will be described.
FIG. 2 is a schematic diagram illustrating an example of data communication performed in the communication system S.
Specifically, in the example of FIG. 2, the user operates the imaging device 1 as one device to exhibit the external cooperation function on the imaging device 1 side, and is carried through the communication in the first communication method. An instruction (connection instruction) for establishing a communication connection by the second communication method suitable for transmission / reception of an image file is transmitted to the terminal 2.
In the mobile terminal 2 that has received the connection instruction via the communication using the first communication method, the function of the camera cooperation application is exhibited, and processing for establishing communication using the second communication method is performed. And the portable terminal 2 establish a communication connection by the second communication method.
Specifically, a program for demonstrating the function of the camera cooperation application on the mobile terminal 2 side is activated by a connection instruction from the imaging device 1 via communication in the first communication method, and the external device on the imaging device 1 side is activated. Communication by the second communication method is established between the imaging device 1 and the portable terminal 2 by the cooperation function and the function of the camera cooperation application on the portable terminal 2 side.
The first communication method is power saving, and is always connected even when the main power of one or both of the imaging device 1 and the portable terminal 2 is turned off (or in a low power consumption state). The device whose main power is off (or in the low power consumption state) is capable of at least communication by the second communication method and execution of the application program through communication from the other device via the first communication method. As described above, it has a function of turning on the main power (or canceling the low power consumption state) and a function of starting (executing) an application program designated through the first communication method.
Therefore, for example, when an event such as transmission of an image captured by the imaging apparatus 1 occurs, communication can be established using the second communication method used for data communication without operating the mobile terminal 2.
Thereby, data communication can be performed between the imaging device 1 and the portable terminal 2, and image data can be automatically transmitted from the imaging device 1 to the portable terminal 2.
The received image data is temporarily stored in the storage of the portable terminal 2 by the function of the camera cooperation application.

  Further, in the present embodiment, image data captured by the imaging device 1 is used as the utilization of image data automatically transmitted and received by the external cooperation function on the imaging device 1 side and the function of the camera cooperation application on the mobile terminal 2 side. By using an image sharing service on the Internet, it is automatically brought into a state where it can be viewed from a portable terminal owned by another user. Specifically, when shooting is performed in a state in which a cooperative operation mode for automatically sharing an image is set, the imaging device 1 communicates with the mobile terminal 2 via communication using the first communication method. And instructing that the image can be shared from the imaging apparatus 1 to another portable terminal. In the portable terminal 2 that has received the sharing instruction, the function of the camera cooperation application is exhibited, the image data captured by the imaging device 1 is received and temporarily stored in the storage of the portable terminal 2, and then the camera cooperation application function The function of the application for image management & network access is exhibited by the instruction by (the program for the function is activated), and the image data temporarily stored in the storage of the mobile terminal 2 is stored (self-image management). & Network access application) and image data is transmitted to a previously linked cloud server for the purpose of image sharing. In the cloud server, the image data captured by the imaging device 1 and received by the mobile terminal 2 is shared by making the image data available to other mobile terminals linked in advance.

In the present embodiment, the imaging device 1 and the mobile terminal 2 are configured as devices that realize predetermined functions in cooperation with other devices. The imaging device 1 and the portable terminal 2 exchange data (data transfer) between the devices using the second communication method Wi-Fi, for example, according to the operation of the imaging device 1. 2, a process for transferring an image to the mobile terminal 2 to acquire an image and a process for transferring an image from the imaging device 1 to the mobile terminal 2 in response to an operation of the mobile terminal 2 (hereinafter referred to as “cooperation process”). Is executed).
In addition, in order to shift from the state where the communication connection in Wi-Fi, which is the second communication method, has not been established between the imaging device 1 and the mobile terminal 2 to the state where the cooperation process can be executed, A configuration in which a communication connection is established by turning on Wi-Fi, which is the second communication method of the other device, from the device performing the operation via BLE, which is the first communication method in which the connection is maintained (always connected). Is done. That is, the BLE which is the first communication method is in a state where the predetermined cooperative process cannot be executed / prepared to execute the predetermined cooperative process due to the fact that the communication connection with another device has not been established. Even if it exists, the communication connection with another apparatus is maintained (always connected). Here, “a state in which preparation for executing the predetermined cooperative process cannot be performed” refers to a state in which the power of another apparatus is turned off, a program for executing the predetermined cooperative process is not activated, or the second communication A state where a communication connection by Wi-Fi, which is a method, is not established (the power-off state here means that communication by the first communication method is possible, but communication by the second communication method or predetermined cooperation) Including a low power consumption state where processing cannot be performed). Therefore, in the imaging device 1 and the portable terminal 2, the power of the other device is in an off state, a state in which a program for executing a predetermined linkage process is not activated, or communication by Wi-Fi that is the second communication method. Even when it is not possible to prepare for executing the predetermined cooperative process in a state where the connection is not established (non-functioning), it is possible to prepare to execute the predetermined cooperative process via the BLE which is the first communication method. Transition to the state.

Here, the pairing process will be described.
The pairing process is a process for setting connection between two BLE devices (in the present embodiment, the imaging device 1 and the portable terminal 2). After the connection setting, the imaging device 1 and the portable terminal 2 are connected in a communicable state based on the setting. Moreover, the pairing information of the other party required for connection is memorize | stored in each apparatus (the imaging device 1 and the portable terminal 2) by pairing processing.
In the BLE communication according to this embodiment, communication is performed between peripherals and centrals having different roles. In this embodiment, the peripheral is the imaging device 1, and the central is the mobile terminal 2.
On the other hand, the peripheral sends out an advertise signal to the surroundings using radio waves (sends the advertise signal) in order to notify its existence, and responds to the connection request from the central.
Central scans for peripherals that provide the necessary data, and when it detects such peripherals, it requests a connection and starts exchanging data. Then, the central executes some task using information (service) provided from the peripheral.
The advertisement signal includes a peripheral name (device name: in this embodiment, an SSID that is an identification name of an access point in the wireless LAN (Wi-Fi)) and information (UUID: Universally) that can be provided (service). (Unique Identifier).
When BLE is connected (communication) after connection setting is completed by the pairing process, a communication packet including a BD address (Bluetooth (registered trademark) Device Address) that is unique throughout the world is transmitted. Thereby, it does not connect with the other apparatus which is not intended.

FIG. 3 is a block diagram illustrating a hardware configuration of the imaging device 1 and the mobile terminal 2 according to an embodiment of the present invention.
The imaging device 1 is configured as a digital camera, for example.

  The imaging apparatus 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an imaging unit 16, and an input unit 17. An output unit 18, a storage unit 19, a first communication unit 20, a second communication unit 21, a drive 22, and a power supply unit 23.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 19 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The CPU 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. An imaging unit 16, an input unit 17, an output unit 18, a storage unit 19, a first communication unit 20, a second communication unit 21, a drive 22, and a power supply unit 23 are connected to the input / output interface 15.

  Although not shown, the imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit is configured by a lens that collects light, for example, a focus lens or a zoom lens, in order to photograph a subject.
The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range.
The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 16.
Hereinafter, the output signal of the imaging unit 16 is also referred to as “photographed image data”. The captured image data is appropriately supplied to the CPU 11 or an image processing unit (not shown).

The input unit 17 includes various buttons and the like, and inputs various types of information according to user instruction operations.
The output unit 18 includes a display, a speaker, and the like, and outputs images and sounds.

  The storage unit 19 includes a hard disk or a flash memory, and stores various image data.

  The first communication unit 20 controls communication performed with an external device (in the present embodiment, the portable terminal 2) in a first communication method that is low speed but saves power and is suitable for constant connection. In the present embodiment, the first communication method uses a communication method based on the BLE communication standard.

  The second communication unit 21 controls communication with an external device (in the present embodiment, the portable terminal 2) by a second communication method that is high-speed and suitable for file transmission / reception. In the present embodiment, the second communication method uses a communication method based on the Wi-Fi communication standard in the wireless LAN.

  A removable medium 31 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 22. The program read from the removable medium 31 by the drive 22 is installed in the storage unit 19 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 19 in the same manner as the storage unit 19.

  The power supply unit 23 is constituted by, for example, a lithium ion secondary battery, and is a power supply source that supplies driving power to the imaging device 1 via a power supply circuit (not shown). Is supplied to each component of the imaging apparatus 1. The power supply unit 23 is controlled by the CPU 11. For example, in the power-off state, the power supply unit 23 stops supplying power to the output unit 18 and the display output is turned off, and the first communication unit 20, the second communication unit 21, etc. It is controlled so that image transmission is possible even when the power is off while maintaining the supply of power in communication.

Moreover, the portable terminal 2 is comprised as a smart phone, for example.
Note that the hardware configuration is the same as that of the imaging apparatus 1, and therefore will be omitted. Hereinafter, when the hardware in the imaging device 1 and the portable terminal 2 is used as an explanation, the imaging device 1 is given a suffix “−1”, and the portable terminal 2 is given a symbol “−”. 2 ”shall be attached. That is, the imaging device 1 is represented as CPU 11-1 to removable media 31-1, and the portable terminal 2 is represented as CPU 11-2 to removable media 31-2.

When the imaging device 1 and the mobile terminal 2 configured as described above perform the data communication function, a state in which communication connection is established between the imaging device 1 and the mobile terminal 2 by BLE which is the first communication method. (Always connected). That is, the automatic transmission function of a captured image is exhibited on the assumption that the imaging device 1 and the mobile terminal 2 are connected by the BLE that is the first communication method.
Specifically, the imaging device 1 instructs the portable terminal 2 to establish a communication connection with Wi-Fi, which is the second communication method, via communication using the first communication method (connection instruction). ) To establish a communication connection using Wi-Fi, which is the first communication method, between the imaging apparatus 1 and the mobile terminal 2. In the present embodiment, the imaging device 1 is set to an access point (AP) mode so that it becomes a parent device in Wi-Fi, and the mobile terminal 2 is a child device in Wi-Fi that is the first communication method. As described above, in the station (ST) mode, a communication connection is established by direct one-to-one communication between the imaging device 1 and the portable terminal 2.
In addition, when a communication connection is established once and pairing is performed, information regarding the pairing is held in each device. In the present embodiment that performs short-range communication, a device within a range where radio waves reach is searched, and a communication connection is automatically established based on pairing information held therein without inputting a password or the like. Processing shall be performed. As for the pairing operation, first, all connectable devices (devices in which BLE / Wi-Fi is activated) in the surrounding area are displayed with device names, etc., and the user selects a device for executing the cooperation process from among them. This is done by specifying.

  FIG. 4 is a functional block diagram illustrating a functional configuration for executing the automatic image reception process and the mode operation process among the functional configurations of the imaging apparatus 1 and the portable terminal 2.

First, automatic image reception processing will be described.
“Automatic image reception processing” means that when a captured image is acquired from the imaging unit 16 in the imaging apparatus 1, the mobile terminal 2 establishes a communication connection by the second communication method and transmits the captured image to the mobile terminal 2. In the portable terminal 2, this means a series of processes for automatically receiving images.

When the automatic image reception process is executed on the imaging apparatus 1 side, as shown in FIG. 4, the imaging control unit 51 and the communication control unit 52 function in the CPU 11-1.
An image storage unit 71 is set in one area of the storage unit 19-1.
The image storage unit 71 stores captured image data acquired from the imaging unit 16.

  The imaging control unit 51 controls the imaging unit 16 to execute imaging processing. As a result, a captured image is output from the imaging unit 16. The output captured image is stored in the image storage unit 71.

The communication control unit 52 performs communication using BLE (Wi-Fi), which is the first communication method (second communication method), and performs instructions and data communication to the portable terminal 2. (2nd communication part 21-1) is controlled.
Specifically, for example, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and transmits the image captured by the imaging device 1 to the mobile terminal 2. −1 is controlled.

Further, when the automatic image reception process is executed on the portable terminal 2 side, as shown in FIG. 4, an application management unit 91 and a communication control unit 92 function in the CPU 11-2.
The image storage unit 111 is set in one area of the storage unit 19-2.
The image storage unit 111 stores captured image data acquired from the imaging device 1.

The application management unit 91 manages the activation and termination of applications.
Specifically, for example, the application management unit 91 performs communication using BLE, which is the first communication method, and instructs the first communication unit 20-2 to start an application (hereinafter simply referred to as “application”). When received, the specified application is activated. In this embodiment, the application management part 91 starts the application which performs communication control in Wi-Fi, and exhibits a communication control function. “Startup” in an application or device includes not only the case of newly executing an application, but also the case of resuming the execution of an application that is paused (running in the background). This includes cases involving the transition to the ON state.

The communication control unit 92 performs communication using BLE (Wi-Fi), which is the first communication method (second communication method), and receives instructions to the portable terminal 2 and performs data communication. -2 (second communication unit 21-2) is controlled.
Specifically, for example, the communication control unit 92 performs communication using Wi-Fi that is the second communication method, and controls the second communication unit 21-2 to receive an image from the imaging apparatus 1.

FIG. 5 is a flowchart for explaining the flow of automatic image reception processing executed by the imaging device 1 and the portable terminal 2 of FIG. 3 having the functional configuration of FIG.
In the start state of the automatic image reception process, pairing of BLE, which is the first communication method, is completed between the imaging device 1 and the portable terminal 2 and is always connected. In addition, Wi-Fi, which is the first communication method, is in an off state, but the Wi-Fi setting (profile) is acquired between the imaging device 1 and the mobile terminal 2, and the Wi-Fi is acquired. Is in a state where a one-to-one communication connection can be established between the imaging device 1 and the portable terminal 2.

<Automatic image reception processing on the imaging apparatus 1>
In step S111-1, the imaging control unit 51 controls the imaging unit 16 to execute the imaging process. As a result, a captured image is output from the imaging unit 16. The output captured image is stored in the image storage unit 71.

  If the automatic image transfer mode is set when the shooting process is executed, in step S112-1, the communication control unit 52 communicates with the mobile terminal 2 using BLE, which is the first communication method. The first communication unit 20-1 is controlled to transmit an instruction to start the application. As a result, the application is activated in the mobile terminal 2 that has received the instruction to activate the application. In the present embodiment, an application that performs communication control in Wi-Fi is activated, and a communication control function is exhibited.

  In step S113-1, the communication control unit 52 communicates with the mobile terminal 2 using BLE, which is the first communication method, and access point information of the imaging apparatus 1 (hereinafter referred to as “camera AP information”). The first communication unit 20-1 is controlled to transmit. As a result, in the mobile terminal 2 that has received the camera AP information, Wi-Fi is turned on in ST (station) mode in which the mobile terminal 2 is a slave.

  In step S114-1, the communication control unit 52 controls the second communication unit 21-1 to turn on Wi-Fi in an AP (access point) mode serving as a parent device.

In step S115-1, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and the second communication unit 21-1 communicates with the portable terminal 2 in response to a connection request from the portable terminal 2. Determine whether a connection has been established.
When the connection with the portable terminal 2 is established, YES is determined in step S115-1, and the process proceeds to step S118-1. The process of step S118-1 will be described later.
On the other hand, when the connection with the portable terminal 2 has not been established, it is determined as NO in Step S115-1, and the process proceeds to Step S116-1.

In step S116-1, the communication control unit 52 determines whether a preset time has elapsed and the time has expired.
If the time has not expired, NO is determined in step S116-1, and the process returns to step S115-1.
If the time has expired, YES is determined in step S116-1, and the process proceeds to step S117-1.

  In step S117-1, the communication control unit 52 controls the second communication unit 21-1 to turn off Wi-Fi. Thereafter, the process returns to step S111-1.

  In step S118-1, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and transmits the captured image taken to the connected mobile terminal 2 to the second communication unit. 21-1 is controlled. As a result, a captured image taken with Wi-Fi is transmitted. Thereafter, the automatic image reception process on the imaging device 1 side ends.

<Automatic image reception processing on the mobile terminal 2>
In step S111-2, the application management unit 91 performs communication using BLE, which is the first communication method, and activates the designated application when receiving an instruction to activate the application in the first communication unit 20-2. In the present embodiment, an application that performs communication control in Wi-Fi is activated, and a communication control function is exhibited.

  In step S112-2, the communication control unit 92 performs communication using BLE, which is the first communication method, and receives camera AP information from the imaging apparatus 1, so that Wi-Fi is turned on in the ST mode. 2 Control the communication unit 21-2.

  In step S113-2, the communication control unit 92 controls the second communication unit 21-2 to search for the imaging device 1 of the access point (AP).

In step S114-2, the communication control unit 92 determines whether or not the imaging device 1 of the access point (AP) has been found.
If the access point imaging apparatus 1 is found, YES is determined in step S114-2, and the process proceeds to step S117-2. The processing after step S117-2 will be described later.
On the other hand, if the access point imaging apparatus 1 is not found, NO is determined in step S114-2, and the process proceeds to step S115-2.

In step S115-2, the communication control unit 92 determines whether a preset time has elapsed and the time has expired.
If the time has not expired, NO is determined in step S115-2, and the process returns to step S114-2.
If the time has expired, YES is determined in step S115-2, and the process proceeds to step S116-2.

  In step S116-2, the application management unit 91 ends the application activated in step S111-2. By ending the application, the Wi-Fi communication function in the second communication unit 21-2 is turned off. Thereafter, the process returns to step S111-2.

  In step S117-2, the communication control unit 92 performs communication using Wi-Fi, which is the second communication method, connects to the imaging device 1 of the access point (AP), and indicates that the connection has been made (connection request). 1 to control the second communication unit 21-2.

  In step S118-2, the communication control unit 92 controls the second communication unit 21-2 to receive the image transmitted from the imaging device 1. The received image is stored in the image storage unit 111. Thereafter, the automatic transmission / reception process on the mobile terminal 2 side ends.

Next, the mode operation process will be described.
Further, “mode operation processing” means that the mobile terminal 2 establishes a communication connection by the second communication method in the imaging device 1 based on various modes of the REC mode / PLAY mode, and images the operation corresponding to the mode. A series of processes to be executed by the apparatus 1.

When the mode operation process is executed on the imaging apparatus 1 side, as illustrated in FIG. 4, the imaging control unit 51 and the communication control unit 52 function in the CPU 11-1.
An image storage unit 71 is set in one area of the storage unit 19-1.
The image storage unit 71 stores captured image data acquired from the imaging unit 16.

  The imaging control unit 51 controls the imaging unit 16 to capture a through image for the REC mode. As a result, a through image is output from the imaging unit 16.

The communication control unit 52 performs communication using BLE (Wi-Fi), which is the first communication method (second communication method), and performs instructions and data communication to the portable terminal 2. (2nd communication part 21-1) is controlled.
Specifically, for example, in the REC mode, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and transmits the through image output from the imaging unit 16 to the mobile terminal 2. The second communication unit 21-1 is controlled. Further, in the PLAY mode, the communication control unit 52 performs second communication so that a list of images stored in the image storage unit 71 is communicated with Wi-Fi as the second communication method and transmitted to the mobile terminal 2. The communication unit 21-1 is controlled.

Further, when the automatic image reception process is executed on the portable terminal 2 side, as shown in FIG. 4, an application management unit 91 and a communication control unit 92 function in the CPU 11-2.
The image storage unit 111 is set in one area of the storage unit 19-2.
The image storage unit 111 stores image data acquired from the imaging apparatus 1.

The application management unit 91 manages the activation and termination of applications.
Specifically, for example, the application management unit 91 performs communication using BLE, which is the first communication method, and starts the designated application when receiving an instruction to start the application in the first communication unit 20-2. . In this embodiment, the application management part 91 starts the application which performs communication control in Wi-Fi, and exhibits a communication control function.

The communication control unit 92 performs communication using BLE (Wi-Fi), which is the first communication method (second communication method), and performs instructions and data communication to the portable terminal 2. (2nd communication part 21-2) is controlled.
Specifically, for example, in the REC mode, the communication control unit 92 performs communication using the second communication method Wi-Fi and receives the through image from the imaging unit 16 from the imaging device 1. The second communication unit 21-2 is controlled. Further, in the PLAY mode, the communication control unit 52 performs second communication so that the list of images stored in the image storage unit 71 is communicated by Wi-Fi, which is the second communication method, and received from the imaging device 1. The communication unit 21-2 is controlled.

FIG. 6 is a flowchart illustrating the flow of mode operation processing executed by the imaging device 1 and the mobile terminal 2 of FIG. 3 having the functional configuration of FIG.
Note that in the start state of the mode operation process, pairing of BLE, which is the first communication method, is completed between the imaging device 1 and the portable terminal 2 and is always connected. In addition, Wi-Fi, which is the first communication method, is in an off state, but the Wi-Fi setting (profile) is acquired between the imaging device 1 and the mobile terminal 2, and the Wi-Fi is acquired. Is in a state where a one-to-one communication connection can be established between the imaging device 1 and the portable terminal 2.

<Mode operation processing on the imaging apparatus 1>
In step S211-1, the CPU 11 communicates with the portable terminal 2 using BLE, which is the first communication method, and activates the imaging device 1 in response to an activation request from the portable terminal 2, and the portable terminal 2 also. If there is a mode specification at startup from, the specified mode is set. In the present embodiment, the mode is either a REC mode in which shooting is performed while confirming a through image from the imaging device 1 in the mobile terminal 2 or a PLAY mode in which a list of images stored in the imaging device 1 is browsed in the mobile terminal 2. Is set.

  In step S212-1, the communication control unit 52 controls the first communication unit 20-1 to communicate with the mobile terminal 2 using BLE, which is the first communication method, and transmit camera AP information. . As a result, in the mobile terminal 2 that has received the camera AP information, Wi-Fi is turned on in ST (station) mode in which the mobile terminal 2 is a slave unit based on the received camera AP information.

  In step S213-1, the communication control unit 52 controls the second communication unit 21-1 to turn on Wi-Fi in an AP (access point) mode serving as a parent device.

In step S214-1, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and the second communication unit 21-1 communicates with the mobile terminal 2 in response to a connection request from the mobile terminal 2. Determine whether a connection has been established.
If the connection with the portable terminal 2 is established, YES is determined in step S214-1, and the process proceeds to step S217-1. The process of step S217-1 will be described later.
On the other hand, when the connection with the portable terminal 2 has not been established, NO is determined in step S214-1, and the process proceeds to step S215-1.

In step S215-1, the communication control unit 52 determines whether a preset time has elapsed and the time has expired.
If the time has not expired, it is determined as NO in Step S215-1, and the process returns to Step S214-1.
If the time has expired, YES is determined in step S215-1, and the process proceeds to step S216-1.

  In step S216-1, the communication control unit 52 controls the second communication unit 21-1 to turn off Wi-Fi. Thereafter, the process returns to step S211-1.

In step S217-1, the imaging control unit 51 and the communication control unit 52 operate in the mode specified in step S211-1 or the mode newly specified from the mobile terminal 2. That is, when the designated mode is the REC mode and there is a transmission request for a through image, the imaging control unit 51 controls the imaging unit 16 to capture the through image and acquires the through image. To do. And the communication control part 52 performs communication by Wi-Fi which is a 2nd communication system, and controls the 2nd communication part 21-1 so that the acquired through image may be transmitted to the portable terminal 2 sequentially. If the designated mode is the PLAY mode and a transmission request for a list of images (thumbnail images) is made, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method. Then, the second communication unit 21-1 is controlled so as to transmit the list of images stored in the image storage unit 111 to the portable terminal 2.
Thereafter, the mode operation process on the imaging device 1 side ends.

<Mode operation processing on the mobile terminal 2>
In step S211-2, the application management unit 91 activates the application by an operation on the input unit 17 by the user. In the present embodiment, an application that exhibits a function for designating a mode is activated, and a function for designating a mode is exhibited.

  In step S212-2, the communication control unit 92 performs communication using BLE, which is the first communication method, and controls the second communication unit 21-2 to start up the imaging apparatus 1. In addition, when it is necessary to specify a mode at the time of startup of the imaging apparatus 1, information specifying the mode is transmitted. In the present embodiment, the mode is either a REC mode in which shooting is performed while confirming a through image from the imaging device 1 in the mobile terminal 2 or a PLAY mode in which a list of images stored in the imaging device 1 is browsed in the mobile terminal 2. Can be specified.

  In step S213-2, the communication control unit 92 performs communication using BLE, which is the first communication method, and receives camera AP information from the imaging apparatus 1, so that Wi-Fi is turned on in the ST mode. 2 Control the communication unit 21-2.

  In step S214-2, the communication control unit 92 controls the second communication unit 21-2 to search for the imaging device 1 of the access point (AP).

In step S215-2, the communication control unit 92 determines whether or not the imaging device 1 of the access point (AP) has been found.
If the access point imaging device 1 is found, YES is determined in step S215-2, and the process proceeds to step S218-2. The processing after step S218-2 will be described later.
On the other hand, if the access point imaging device 1 is not found, NO is determined in step S215-2, and the process proceeds to step S216-2.

In step S216-2, the communication control unit 92 determines whether or not a preset time has elapsed and timed out.
If the time has not expired, NO is determined in step S216-2, and the process returns to step S215-2.
If the time has expired, YES is determined in step S216-2, and the process proceeds to step S217-2.

  In step S217-2, the application management unit 91 ends the application activated in step S211-2. By ending the application, the Wi-Fi communication function in the second communication unit 21-2 is turned off. Thereafter, the process returns to step S211-2.

  In step S218-2, the communication control unit 92 communicates with the imaging device 1 using Wi-Fi, which is the second communication method, and connects to the imaging device 1 of the access point (AP). The second communication unit 21-2 is controlled so as to notify the imaging apparatus 1 of (connection request).

In step S219-2, the communication control unit 92 confirms the mode designated by the user operation or the like.
If the designated mode is REC, [REC] is set in step S219-2, and the process proceeds to step S220-2.

  In step S220-2, the communication control unit 92 performs communication with the imaging apparatus 1 using Wi-Fi, which is the second communication method, switches to the REC mode, and requests transmission of a through image. The through images sequentially transmitted from the imaging device 1 are sequentially acquired in response to the request. Then, the through images sequentially acquired in the output unit 18-2 are sequentially displayed. The user performs an operation such as a shooting instruction while browsing through images taken by the imaging apparatus 1. Thereafter, the mode operation process on the mobile terminal 2 side ends.

  On the other hand, when the mode designated by the user operation or the like is PLAY, [PLAY] is set in step S219-2, and the process proceeds to step S221-2.

  In step S <b> 221-2, the communication control unit 92 performs communication with the imaging apparatus 1 using Wi-Fi, which is the second communication method, and switches to the PLAY mode and the image stored in the image storage unit 71. In response to this request, a list of images (thumbnail images) transmitted from the imaging apparatus 1 is acquired. Then, a list of images acquired by the output unit 18-2 is displayed. The user performs operations such as selection of an image acquired from the imaging device 1 while browsing a list of images stored in the imaging device 1. Thereafter, the mode operation process on the mobile terminal 2 side ends.

FIG. 7 is a schematic diagram showing a display of a communication status indicating a transition of a communication state in the imaging device 1 and the mobile terminal 2 that sequentially change with the execution of various processes as described above.
As shown in the example of FIG. 7, the communication status display in the imaging device 1 and the portable terminal 2 in the first communication method and the second communication method is configured to change the display for each status.
When the communication status is neither paired nor connected (<pairing: not yet><connected:none>), the status display is not performed.
If the communication status is paired but not connected (<Pairing: Completed><Connected:None>), the icons indicating the first communication method and the second communication method are indicated by broken lines or semi-transparent. Configured to display in state.
When the communication status is paired and connected (<Pairing: Completed><Connected:Yes>), an icon indicating the first communication method and the second communication method is displayed. Is done.

The imaging device 1 configured as described above includes the second communication unit 21-1, the communication control unit 52, the first communication unit 20-1, and the communication control unit 52.
The communication control unit 52 performs predetermined cooperation processing by performing data transfer with the mobile terminal 2 which is another device by the second communication unit 21-1.
The first communication unit 20-1 maintains the communication connection with the mobile terminal 2 that is another device even when the predetermined cooperation process by the communication control unit 52 cannot be executed.
The communication control unit 52 causes the first communication unit 20-1 to perform predetermined communication to shift from a state where the predetermined cooperation process by the communication control unit 52 cannot be performed to a state where it can be performed.
Thereby, even if it is a state which cannot perform the predetermined cooperation process by the communication control part 52, communication connection with the portable terminal 2 which is another apparatus is maintained, and predetermined communication is performed by the 1st communication part 20-1. Accordingly, the communication control unit 52 shifts from a state where the predetermined cooperation process cannot be executed to a state where the communication control unit 52 can execute the predetermined cooperation process, and the communication control unit 52 executes the predetermined cooperation process.
Therefore, the imaging device 1 can receive predetermined data without operating the mobile terminal 2, and can improve the convenience of cooperation in a plurality of devices via wireless communication.

The first communication unit 20-1 is slower than the second communication unit 21-1, but saves power.
The first communication unit 20-1 is in a state in which a predetermined linkage process cannot be performed because a communication connection with the portable terminal 2 which is another device by the second communication unit 21-1 is not established. In addition, the communication connection with the portable terminal 2 which is another device is maintained.
The communication control unit 52 is established from a state in which communication connection with the portable terminal 2 which is another device by the second communication unit 21-1 is not established by performing predetermined communication with the first communication unit 20-1. Transition to the completed state.
Thereby, it is possible to shift to a state in which a predetermined cooperation process can be executed while maintaining a connection with the portable terminal 2 that is another device in a state of lower power consumption.

The first communication unit 20-1 cannot execute the predetermined cooperation process because either the mobile terminal 2 or the imaging apparatus 1 which is another device is not ready to execute the predetermined cooperation process. Even in the state, the communication connection with the portable terminal 2 which is another device is maintained.
The communication control unit 52 is ready to execute a predetermined linkage process on either the portable terminal 2 or the imaging device 1 which is another device by performing predetermined communication with the first communication unit 20-1. Transition from a not ready state to a ready state.
As a result, among the devices that execute the predetermined linkage processing, the device is shifted from one device that is not ready to execute the predetermined linkage processing to a state that is ready. Is possible.

The state in which the preparation for executing the predetermined cooperation process is not ready means that either the portable terminal 2 which is another device or the imaging apparatus 1 is powered off, or a program for executing the predetermined cooperation process. It is a state where it is not activated or a state where the second communication unit 21-1 is not functioning.
As a result, it is possible to shift from various states in which some of the functions for executing the predetermined cooperative process are not operating to a state in which preparations for executing the predetermined cooperative process are ready.

The communication control unit 52 performs a predetermined communication by the first communication unit 20-1, so that neither the portable terminal 2 which is another device nor the imaging device 1 is ready to execute the predetermined cooperation process. Even if it exists in the case, both the portable terminal 2 which is another apparatus, or the said imaging device 1 is made to transfer to the state which is ready for performing a predetermined cooperation process.
As a result, either of the devices that execute the predetermined cooperative process can shift both devices that execute the predetermined cooperative process to a state in which preparations for executing the predetermined cooperative process are ready.

When the mobile terminal 2 which is another device is not ready to execute a predetermined cooperation process, the communication control unit 52 causes the first communication unit 20-1 to change the mobile terminal 2 which is another device. By transmitting a predetermined signal, the portable terminal 2 which is another device is shifted to a state where it is ready to execute a predetermined linkage process.
In addition, when the imaging device 1 is not ready to execute a predetermined cooperation process, the communication control unit 52 performs a predetermined communication from the portable terminal 2 that is another device by the first communication unit 20-1. By receiving the signal, the imaging apparatus 1 is shifted to a state where it is ready to execute a predetermined cooperation process.
As a result, it is possible to shift to a state in which both devices that execute the predetermined linkage processing are ready to execute by transmitting and receiving a predetermined signal by the second wireless communication.

The predetermined linkage process includes a first linkage process that controls the portable terminal 2 that is another device by operating the imaging device 1 and a first linkage process that controls the imaging device 1 by operating the portable terminal 2 that is another device. 2 linkage processing.
When performing the first linkage process, the communication control unit 52 transmits a predetermined signal to the portable terminal 2 that is another device by the second wireless communication in accordance with the operation of the imaging device 1. The portable terminal 2 that is the first device is shifted to a state in which it is ready to execute the first linkage processing.
In addition, when performing the second linkage process, the communication control unit 52 receives a predetermined signal transmitted by the second wireless communication in response to an operation of the mobile terminal 2 that is another device. The imaging apparatus 1 is shifted to a state where it is ready to execute the second linkage process.
Thereby, the mobile device 2 that is another device is controlled from the imaging device 1 to perform the first cooperation processing, or the imaging device 1 is controlled from the mobile terminal 2 that is another device to perform the second cooperation processing. It is possible to go.

The communication control unit 52 arbitrarily designates the portable terminal 2, which is another device that performs predetermined cooperation processing, as a designated device through a user operation by the input unit 17 or the like.
In addition, the communication control unit 52 starts communication connection with the designated device by the first communication unit 20-1, and maintains communication connection with the designated device by the second communication unit 21-1 while maintaining this communication connection. Set to the released state.
Moreover, the communication control part 52 starts the communication connection with the designated apparatus by the 2nd communication part 21-1 by performing the predetermined communication which designated the designated apparatus by the 1st communication part 20-1.
As a result, it is possible to specify the portable terminal 2 which is a specific other device and execute a predetermined linkage process.

One of the imaging device 1 and the portable terminal 2 which is another device is the imaging device 1 having an imaging function, and the other is the portable terminal 2 having an image display function.
The predetermined cooperation process includes an image transfer process in which the image data captured by the imaging device 1 is transferred to the display terminal by the second communication unit 21-1.
As a result, the imaging device 1 and the portable terminal 2 can be linked to transfer the image data captured by the imaging device 1 to the display terminal and display it using the function of the display terminal.

The predetermined linkage process includes a first linkage process that starts an image transfer process in response to an operation of the imaging apparatus 1 and a second linkage process that starts an image transfer process in response to an operation of a display terminal.
As a result, it is possible to transfer image data to the display terminal in accordance with the operation of the imaging device 1, and to transfer image data from the imaging device 1 in accordance with the operation of the display terminal.

The communication system S configured as described above includes the imaging device 1 and the mobile terminal 2 that realize predetermined functions in cooperation with each other.
The imaging device 1 includes a second communication unit 21-1, a communication control unit 52, a first communication unit 20-1, and a communication control unit 52.
The communication control unit 52 performs predetermined cooperation processing by performing data transfer with the mobile terminal 2 which is another device by the second communication unit 21-1.
The first communication unit 20-1 maintains the communication connection with the mobile terminal 2 that is another device even when the predetermined cooperation process by the communication control unit 52 cannot be executed.
The communication control unit 52 causes the first communication unit 20-1 to perform predetermined communication to shift from a state where the predetermined cooperation process by the communication control unit 52 cannot be performed to a state where it can be performed.
Thereby, even if it is a state which cannot perform the predetermined cooperation process by the communication control part 52, communication connection with the portable terminal 2 which is another apparatus is maintained, and predetermined communication is performed by the 1st communication part 20-1. Accordingly, the communication control unit 52 shifts from a state where the predetermined cooperation process cannot be executed to a state where the communication control unit 52 can execute the predetermined cooperation process, and the communication control unit 52 executes the predetermined cooperation process.
Therefore, the imaging device 1 can receive predetermined data without operating the mobile terminal 2, and can improve the convenience of cooperation in a plurality of devices via wireless communication.

Moreover, the communication control part 52 transmits the image data imaged with the imaging device 1 as a 1st apparatus with the 2nd communication system as a 2nd wireless communication to the portable terminal 2 as a 2nd apparatus.
The communication control unit 52 is in a state in which the communication connection between the imaging device 1 as the first device and the portable terminal 2 as the second device is disconnected by the second communication method as the second wireless communication, The communication connection between the imaging device 1 as the first device and the portable terminal 2 as the second device in the first communication method as the first wireless communication is maintained, and the first as the first wireless communication. By transmitting and receiving predetermined control data between the imaging device 1 as the first device and the portable terminal 2 as the second device by the communication method, the second communication method as the second wireless communication is changed to the first. Shift from the state in which the communication connection between the imaging device 1 as the second device and the portable terminal 2 as the second device is disconnected to the connected state.
Thereby, in the communication system S, it can connect without operating in the portable terminal 2, and the convenience of cooperation in the some apparatus via wireless communication can be improved.

Further, in the above-described embodiment, the imaging device 1 as the first device associates the association information that associates the imaging device 1 as the first device with the mobile terminal 2 as the second device as a mutual communication partner. A communication control unit 52 / communication control unit 92 serving as association means for storing each other can be further provided.
In the imaging device 1 as the first device, the imaging device 1 as the first device and the portable terminal as the second device according to the association information stored by the communication control unit 52 / communication control unit 92 as the association unit 2 can be configured to shift from a state in which the communication connection with the communication terminal 2 is disconnected to a connected state.

  Further, in the above-described embodiment, the communication control unit 52 / communication control unit 92, which is an association unit, transmits and receives information related to pairing, which is association information, so that the imaging device 1 as the first device and the second device It can comprise so that the portable terminal 2 as an apparatus may be linked | related.

  In the above-described embodiment, the communication control unit 52 / communication control unit 92, which is an association unit, transmits and receives association information, thereby the imaging apparatus 1 as a first device serving as a mutual communication partner by the communication control unit 52. And the portable terminal 2 as the second device can be associated with each other.

  In the above-described embodiment, the communication control unit 52 / communication control unit 92, which is an associating unit, uses the device identification information to display on the output unit 18 and select a device name of a partner that is a candidate for association. It can be constituted as follows.

2. Description of the Related Art Conventionally, a technology for connecting an imaging device such as a digital camera and an information processing device such as a smartphone by wireless communication has been used.
In such a technique, when the imaging apparatus is remotely operated by wireless communication from the information processing apparatus, a wireless communication connection is first established between these apparatuses, and then a predetermined remote operation is performed.
As an example of such a technique, there is an imaging system in which a camera is remotely operated by a camera operation terminal (see, for example, JP-A-2014-230024).

  However, when the image pickup apparatus is remotely operated by the information processing apparatus, it is necessary to establish a wireless communication connection after turning on the power of these apparatuses each time the remote operation is performed. In addition, the role of each device is set in advance, such as remotely operating the imaging device from the information processing device, and the functions that remotely operate the imaging device from the information processing device are limited to the preset functions. Since it can only be used, it is not convenient for a user who performs a remote operation.

  The present embodiment has been made in view of such a situation, and aims to improve the convenience of cooperation in a plurality of apparatuses via wireless communication.

Second Embodiment
FIG. 8 is a system configuration diagram showing another system configuration of the communication system according to the embodiment of the present invention.
As shown in FIG. 8, the communication system S is based on the system configuration shown in FIG. 1, and includes an imaging device 1 having at least an imaging / communication function, a portable terminal 2 having at least an image display / communication function, and a server 3. Is provided. In the communication system S, an image captured by the image capturing apparatus 1 is transferred to the server 3 via the portable terminal 2, the image is stored for sharing, and shared information such as an address of the stored image is set to be shared. To other portable terminals 100, 100, 100. The other portable terminal 100 accesses the server 3 based on the received shared information and browses the image.
In the communication system S, when the user operates one of the devices of the imaging device 1 and the portable terminal 2, data on the image file level is transferred from the operating device operated by the user to the other device. A request for communication connection in a communication method capable of communication is performed, and a communication connection between the imaging device 1 and the mobile terminal 2 is established, and in response to an operation of the operation device, an image file with the other device It has a function of performing transmission / reception and browsing of image data held by the other device.

As shown in FIG. 3, the server 3 is connected to the portable terminal 2 so as to be able to exchange image data via a network N such as the Internet, and is configured to be able to publish images on the network. Note that the hardware configuration is the same except for the imaging device 1, the imaging unit 16, and the first communication unit 20, and a description thereof will be omitted.
Hereinafter, when the hardware in the server 3 is used as an explanation, “−3” is added to the end of the reference numeral. That is, the server 3 is expressed as a CPU 11-3 to a removable medium 31-3.

Here, the cooperation preparation process (pairing process) will be described.
The user arbitrarily designates the imaging device 1 and the portable terminal 2 to be subjected to the automatic image transfer process from the plurality of imaging devices and the plurality of portable terminals, and the designated imaging device 1 and the portable terminal 2 are paired. Process to ring.
After the cooperation preparation process (pairing process) is completed, the cooperative operation is performed according to the mode setting operation of the imaging device 1 or the portable terminal 2 by the user, or whether the user operates the imaging device 1 or the portable terminal 2. It is automatically determined whether or not to perform and whether to execute automatic image transfer processing or remote operation processing.
When imaging is instructed by a user operation, the imaging apparatus 1 performs normal shooting recording if the cooperative operation mode is not set. However, if the cooperative operation mode is set, the automatic image is automatically generated. Start the transfer process.
Moreover, the portable terminal 2 starts a remote operation process automatically, when cooperation operation is instruct | indicated by user operation.

Next, automatic image transfer processing will be described.
“Automatic image transfer processing” means that when a captured image is acquired from the imaging unit 16 in the imaging apparatus 1, a communication connection is established with the mobile terminal 2 using the second communication method, and the captured image is transferred to the mobile terminal. 2 is a series of processes in which the mobile terminal 2 automatically receives an image.

When the automatic image reception process is executed on the imaging apparatus 1 side, as shown in FIG. 4, the imaging control unit 51 and the communication control unit 52 function in the CPU 11-1.
An image storage unit 71 is set in one area of the storage unit 19-1.
The image storage unit 71 stores captured image data acquired from the imaging unit 16.

  The imaging control unit 51 controls the imaging unit 16 to execute imaging processing. As a result, a captured image is output from the imaging unit 16. The output captured image is stored in the image storage unit 71.

The communication control unit 52 performs communication by LE (Wi-Fi), which is the first communication method (second communication method), and performs instructions and data communication to the portable terminal 2. (2nd communication part 21-1) is controlled.
Specifically, for example, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and transmits the image captured by the imaging device 1 to the mobile terminal 2. −1 is controlled.

Further, when the automatic image reception process is executed on the portable terminal 2 side, as shown in FIG. 4, an application management unit 91 and a communication control unit 92 function in the CPU 11-2.
The image storage unit 111 is set in one area of the storage unit 19-2.
The image storage unit 111 stores captured image data acquired from the imaging device 1.

The application management unit 91 manages activation and termination of an application (application program).
Specifically, for example, the application management unit 91 performs communication using LE, which is the first communication method, and an application program (hereinafter simply referred to as “application” or “application”) in the first communication unit 20-2. When the instruction to start is received, the specified application is started. In this embodiment, the application management part 91 starts the application which performs communication control in Wi-Fi, and exhibits a communication control function. “Startup” in an application or device includes not only the case of newly executing an application, but also the case of resuming the execution of an application that is paused (running in the background). This includes cases involving the transition to the ON state.

The communication control unit 92 performs communication by LE (Wi-Fi) which is the first communication method (second communication method), receives the instruction to the portable terminal 2, and performs data communication. -2 (second communication unit 21-2) is controlled.
Specifically, for example, the communication control unit 92 performs communication using Wi-Fi that is the second communication method, and controls the second communication unit 21-2 to receive an image from the imaging apparatus 1.

FIG. 9 is a flowchart for explaining the flow of the automatic image receiving process executed by the imaging device 1 and the portable terminal 2 of FIG. 3 having the functional configuration of FIG.
In the start state of the automatic image reception process, the pairing of LE, which is the first communication method, is completed between the imaging device 1 and the portable terminal 2, and is always connected. In addition, Wi-Fi, which is the second communication method, is in an off state, but the Wi-Fi setting (profile) is mutually acquired between the imaging device 1 and the mobile terminal 2, and Wi-Fi is acquired. Is activated, a one-to-one communication connection can be easily established between the imaging device 1 and the portable terminal 2.

<Automatic image transfer processing on the imaging apparatus 1>
In step S311-1, the imaging control unit 51 controls the imaging unit 16 to execute imaging processing. As a result, a captured image is output from the imaging unit 16. The output captured image is stored in the image storage unit 71.

  In step S312-1, the communication control unit 52 performs communication using the first communication method LE to the mobile terminal 2, and sends the first communication unit 20-1 to transmit an instruction to start the application. Control. As a result, the application is activated in the mobile terminal 2 that has received the instruction to activate the application. In the present embodiment, an application that performs communication control in Wi-Fi is activated, and a communication control function is exhibited.

  In step S313-1, the communication control unit 52 communicates with the mobile terminal 2 using LE, which is the first communication method, and access point information of the imaging apparatus 1 (hereinafter referred to as “camera AP information”). The first communication unit 20-1 is controlled to transmit. As a result, in the mobile terminal 2 that has received the camera AP information, Wi-Fi is turned on in ST (station) mode in which the mobile terminal 2 is a slave.

  In step S314-1, the communication control unit 52 controls the second communication unit 21-1 to turn on Wi-Fi in an AP (access point) mode serving as a parent device.

In step S315-1, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and determines whether the second communication unit 21-1 has established a connection with the mobile terminal 2. (If the connection with the portable terminal 2 is not established, the connection is established after waiting for a connection request from the portable terminal 2).
When the connection with the portable terminal 2 is established, YES is determined in step S315-1, and the process proceeds to step S318-1. The process of step S318-1 will be described later.
On the other hand, when the connection with the portable terminal 2 has not been established, NO is determined in step S315-1, and the process proceeds to step S316-1.

In step S316-1, the communication control unit 52 determines whether a preset time has elapsed and the time has expired.
If the time has not expired, NO is determined in step S316-1, and the process returns to step S315-1.
If the time has expired, YES is determined in step S316-1, and the process proceeds to step S317-1.

  In step S317-1, an error message or the like is displayed, and the communication control unit 52 controls the second communication unit 21-1 to turn off Wi-Fi (at this time, without immediately turning off Wi-Fi). In addition, reconnection may be attempted in accordance with a user instruction, or reconnection may be automatically repeated for a certain period of time). Thereafter, the processing returns to step S311-1.

  In step S318-1, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and transmits the captured image captured to the connected mobile terminal 2 to the second communication unit. 21-1 is controlled. As a result, a captured image taken with Wi-Fi is transmitted. Thereafter, the automatic image reception process on the imaging device 1 side ends.

<Automatic image reception processing on the mobile terminal 2>
In step S311-2, the application management unit 91 performs communication using BLE, which is the first communication method, and starts the designated application when receiving an instruction to start the application in the first communication unit 20-2. In the present embodiment, an application that performs communication control in Wi-Fi is activated, and a communication control function is exhibited.

  In step S312-2, the communication control unit 92 performs communication using BLE, which is the first communication method, and receives camera AP information from the imaging apparatus 1 so that Wi-Fi is turned on in the ST mode. 2 Control the communication unit 21-2.

  In step S313-2, the communication control unit 92 controls the second communication unit 21-2 to search for the imaging device 1 of the access point (AP) corresponding to the received camera AP information.

In step S314-2, the communication control unit 92 determines whether or not the imaging device 1 of the access point (AP) has been found.
If the imaging device 1 of the access point is found (or if the connection with the imaging device 1 has already been established), YES is determined in step S314-2, and the process proceeds to step S317-2. The processing after step S317-2 will be described later.
On the other hand, if the access point imaging apparatus 1 is not found, NO is determined in step S314-2, and the process proceeds to step S315-2.

In step S315-2, the communication control unit 92 determines whether a preset time has elapsed and the time has expired.
If the time has not expired, NO is determined in step S315-2, and the process returns to step S314-2.
If the time has expired, YES is determined in step S315-2, and the process proceeds to step S316-2.

  In step S316-2, an error message or the like is displayed, and the application management unit 91 ends the application activated in step S311-2. By closing the application, the Wi-Fi communication function in the second communication unit 21-2 is turned off (at this time, according to the user's instruction without immediately closing the application or turning off the Wi-Fi). You may try to reconnect or try to reconnect automatically for a certain period of time). Thereafter, the process returns to step S311-2.

  In step S317-2, the communication control unit 92 performs communication using Wi-Fi as the second communication method, connects to the imaging device 1 of the access point (AP), and notifies the imaging device 1 of the connection. The second communication unit 21-2 is controlled as described above (communication connection is established with the imaging device 1).

  In step S318-2, the communication control unit 92 controls the second communication unit 21-2 to receive the image transmitted from the imaging device 1. The received image is stored in the image storage unit 111. Thereafter, the automatic transmission / reception process on the mobile terminal 2 side ends.

Next, remote operation processing will be described.
Further, the “remote operation process” is a process in which the mobile terminal 2 is instructed to perform a cooperative operation by a user operation and various cooperative operation modes such as the REC mode / PLAY mode are selected. A series of processes that establishes a communication connection by the two-communication method and causes the imaging apparatus 1 to execute an operation corresponding to the selected cooperative operation mode.

When the mode operation process is executed on the imaging apparatus 1 side, as illustrated in FIG. 4, the imaging control unit 51 and the communication control unit 52 function in the CPU 11-1.
An image storage unit 71 is set in one area of the storage unit 19-1.
The image storage unit 71 stores captured image data acquired from the imaging unit 16-1.

  The imaging control unit 51 controls the imaging unit 16-1 so as to capture a through image for the REC mode. As a result, a through image is output from the imaging unit 16-1.

The communication control unit 52 performs communication using BLE (Wi-Fi), which is the first communication method (second communication method), and performs instructions and data communication to the portable terminal 2. (2nd communication part 21-1) is controlled.
Specifically, for example, in the REC mode, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and transmits the through image output from the imaging unit 16-1 to the mobile terminal 2. Thus, the second communication unit 21-1 is controlled. Further, in the PLAY mode, the communication control unit 52 performs second communication so that a list of images stored in the image storage unit 71 is communicated with Wi-Fi as the second communication method and transmitted to the mobile terminal 2. The communication unit 21-1 is controlled.

Further, when the automatic image reception process is executed on the portable terminal 2 side, as shown in FIG. 4, an application management unit 91 and a communication control unit 92 function in the CPU 11-2.
The image storage unit 111 is set in one area of the storage unit 19-2.
The image storage unit 111 stores image data acquired from the imaging apparatus 1.

The application management unit 91 manages the activation and termination of applications.
Specifically, for example, the application management unit 91 performs communication using BLE, which is the first communication method, and starts the designated application when receiving an instruction to start the application in the first communication unit 20-2. . In this embodiment, the application management part 91 starts the application which performs communication control in Wi-Fi, and exhibits a communication control function.

The communication control unit 92 performs communication using BLE (Wi-Fi), which is the first communication method (second communication method), and performs instructions and data communication to the portable terminal 2. (2nd communication part 21-2) is controlled.
Specifically, for example, in the REC mode, the communication control unit 92 performs communication using Wi-Fi, which is the second communication method, and receives the through image from the imaging unit 16-1 from the imaging device 1. In this manner, the second communication unit 21-2 is controlled. Further, in the PLAY mode, the communication control unit 92 performs second communication so that the list of images stored in the image storage unit 71 is communicated by Wi-Fi, which is the second communication method, and is received from the imaging device 1. The communication unit 21-2 is controlled.

FIG. 10 is a flowchart for explaining the flow of remote operation processing executed by the imaging device 1 and the portable terminal 2 of FIG. 3 having the functional configuration of FIG.
Note that in the start state of the mode operation process, pairing of BLE, which is the first communication method, is completed between the imaging device 1 and the portable terminal 2 and is always connected. In addition, Wi-Fi, which is the first communication method, is in an off state, but the Wi-Fi setting (profile) is acquired between the imaging device 1 and the mobile terminal 2, and the Wi-Fi is acquired. Is in a state where a one-to-one communication connection can be established between the imaging device 1 and the portable terminal 2.

<Remote operation processing on the imaging device 1 side>
In step S411-1, the imaging apparatus 1 is activated in response to a request from the portable terminal 2 via communication using BLE, which is the first communication method, and sets the cooperative operation mode designated by the portable terminal 2. In the present embodiment, the cooperative operation mode includes a REC mode in which shooting is performed while confirming a through image from the imaging device 1 in the mobile terminal 2, and a PLAY mode in which a list of images stored in the imaging device 1 is browsed in the mobile terminal 2. Either mode is set.

  In step S412-1, the communication control unit 52 controls the first communication unit 20-1 to communicate with the mobile terminal 2 using BLE, which is the first communication method, and to transmit camera AP information. . As a result, in the mobile terminal 2 that has received the camera AP information, Wi-Fi is turned on in ST (station) mode in which the mobile terminal 2 is a slave.

  In step S413-1, the communication control unit 52 controls the second communication unit 21-1 to turn on Wi-Fi in an AP (access point) mode serving as a parent device.

In step S414-1, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and determines whether the second communication unit 21-1 has established a connection with the mobile terminal 2. .
When the connection with the portable terminal 2 is established, YES is determined in step S414-1, and the process proceeds to step S417-1. The process of step S417-1 will be described later.
On the other hand, when the connection with the portable terminal 2 has not been established, it is determined as NO in Step S414-1, and the process proceeds to Step S415-1.

In step S415-1, the communication control unit 52 determines whether or not a preset time has elapsed and timed out.
If the time has not expired, NO is determined in step S415-1, and the process returns to step S414-1.
If the time has expired, YES is determined in step S415-1, and the process proceeds to step S416-1.

  In step S416-1, the communication control unit 52 controls the second communication unit 21-1 to turn off Wi-Fi. Thereafter, the process returns to step S411-1.

In step S417-1, the imaging control unit 51 and the communication control unit 52 operate in the mode specified in step S411-1. That is, when the designated mode is the REC mode, the imaging control unit 51 acquires the through image by controlling the imaging unit 16-1 so as to capture the through image. And the communication control part 52 performs communication by Wi-Fi which is a 2nd communication system, and controls the 2nd communication part 21-1 so that the acquired through image may be transmitted to the portable terminal 2. FIG. When the designated mode is the PLAY mode, the communication control unit 52 performs communication using Wi-Fi, which is the second communication method, and displays a list of images stored in the image storage unit 111. 2nd communication part 21-1 is controlled so that it may transmit to.
Thereafter, the mode operation process on the imaging device 1 side ends.

<Remote operation processing on the mobile terminal 2>
In step S <b> 411-2, the application management unit 91 activates the application by an operation on the input unit 17 by the user. In the present embodiment, an application that exhibits a function for designating a mode is activated, and a function for designating a mode is exhibited.

  In step S412-2, when the user operates the input unit 17 to perform an operation of selecting one of a plurality of cooperative operation modes including the REC mode and the PLAY mode, the communication control unit 92 is the first communication method. The second communication unit 21-2 is controlled so as to transmit instruction information for performing an instruction to set the activated and selected cooperative operation mode to the imaging apparatus 1 via the BLE communication. In the present embodiment, the cooperative operation mode includes a REC mode in which shooting is performed while confirming a through image from the imaging device 1 in the mobile terminal 2, and a PLAY mode in which a list of images stored in the imaging device 1 is browsed in the mobile terminal 2. One of the cooperative operation modes is set.

  In step S413-2, the communication control unit 92 performs communication using BLE, which is the first communication method, and receives camera AP information from the imaging device 1, so that Wi-Fi is turned on in the ST mode. 2 Control the communication unit 21-2.

  In step S414-2, the communication control unit 92 controls the second communication unit 21-2 to search for the imaging device 1 of the access point (AP).

In step S415-2, the communication control unit 92 determines whether or not the imaging device 1 of the access point (AP) has been found.
When the access point imaging device 1 is found, YES is determined in the step S415-2, and the process proceeds to a step S418-2. The processing after step S418-2 will be described later.
On the other hand, if the access point imaging apparatus 1 is not found, NO is determined in step S415-2, and the process proceeds to step S416-2.

In step S416-2, the communication control unit 92 determines whether or not a preset time has elapsed and timed out.
If the time has not expired, NO is determined in step S416-2, and the process returns to step S415-2.
If the time has expired, YES is determined in step S416-2, and the process proceeds to step S417-2.

  In step S417-2, the application management unit 91 ends the application activated in step S411-2. By ending the application, the Wi-Fi communication function in the second communication unit 21-2 is turned off. Thereafter, the process returns to step S411-2.

  In step S418-2, the communication control unit 92 communicates with the imaging apparatus 1 using Wi-Fi, which is the second communication method, and connects to the imaging apparatus 1 of the access point (AP). The second communication unit 21-2 is controlled so as to notify the imaging apparatus 1 of the above.

In step S419-2, the communication control unit 92 confirms the designated cooperative operation mode.
If the designated cooperative operation mode is REC, [REC] is set in step S419-2, and the process proceeds to step S420-2.

  In step S420-2, the communication control unit 92 communicates with the imaging apparatus 1 using Wi-Fi, which is the second communication method, and acquires a through image. And the through image acquired in the output part 18-2 is displayed. The user performs an operation such as a shooting instruction while browsing through images taken by the imaging apparatus 1. Thereafter, the mode operation process on the mobile terminal 2 side ends.

  On the other hand, when the designated mode is PLAY, [PLAY] is set in step S419-2, and the process proceeds to step S421-2.

  In step S <b> 421-2, the communication control unit 92 communicates with the imaging apparatus 1 using Wi-Fi, which is the second communication method, and acquires a list of images stored in the image storage unit 71. Then, a list of images acquired by the output unit 18-2 is displayed. The user performs operations such as selection of an image acquired from the imaging device 1 while browsing a list of images stored in the imaging device 1. Thereafter, the mode operation process on the mobile terminal 2 side ends.

Next, a display operation indicating a communication status that changes before and after the execution of the radio wave state or the power state of the device, or the cooperation preparation process (pairing process), the automatic image transfer process, and the remote operation process will be described.
FIG. 11 is a schematic diagram showing a display of communication status in the imaging apparatus 1 and the portable terminal 2.
As shown in the example of FIG. 11, the status display of communication in the imaging device 1 and the portable terminal 2 in the first communication method and the second communication method is configured to change the display for each status.
When the communication status is neither paired nor connected (<pairing: not yet><connected:none>), the status display is not performed.
If the communication status is paired but not connected (<Pairing: Completed><Connected:None>), the icons indicating the first communication method and the second communication method are indicated by broken lines or semi-transparent. Configured to display in state.
When the communication status is paired and connected (<Pairing: Completed><Connected:Yes>), an icon indicating the first communication method and the second communication method is displayed. Is done.

FIG. 12 is a functional block diagram showing a functional configuration for executing the image sharing process among the functional configurations of the mobile terminal 2 and the server 3 of FIG.
“Image sharing processing” refers to transmitting an image captured by the imaging device 1 to the server 3 via the mobile terminal 2 and sharing the image in a state where the image can be browsed to other mobile terminals 100. It is processing.

  When the image sharing process is executed on the portable terminal 2 side, as shown in FIG. 12, the communication control unit 92 and the application management unit 91 function in the CPU 11-2.

The image storage unit 111 is set in one area of the storage unit 19-2.
The image storage unit 111 stores image data acquired from the imaging apparatus 1.

  The communication control unit 92 controls communication in the second communication unit 21-2. Specifically, the communication control unit 92 controls the second communication unit 21-2 to transmit an instruction to create an image or cloud album or set a sharing destination to the server 3.

  The application management unit 91 manages and controls various application operations, and stores an image received from the imaging device 1 in an application album provided in the image storage unit 111.

  On the other hand, when the image sharing process is executed on the server 3 side, as shown in FIG. 12, an application management unit 131 and a communication control unit 132 function in the CPU 11-3.

An image storage unit 151 is set in one area of the storage unit 19-3.
The image storage unit 151 stores image data acquired from the mobile terminal 2.

  The application management unit 131 manages and controls various application operations, creates a cloud album in the image storage unit 151 based on an instruction from the mobile terminal 2, or, for example, an email address of another mobile terminal 100 that is a sharing destination Sharing settings for registering the image, or storing the image received from the mobile terminal 2 in the cloud album of the image storage unit 151 that created the image.

  The communication control unit 132 controls communication in the second communication unit 21-3. Specifically, the communication control unit 92 transmits the sharing notification describing the location of the image to be shared to the registered e-mail address based on the sharing setting to the other mobile terminal 100. 21-3 is controlled. In the present embodiment, the URL indicating the location of the image is described in the sharing notification. In another mobile terminal 100 that has received the sharing notification, it is possible to view an image by accessing the URL described in the notification.

Next, in step S318-2 of the automatic transfer process in FIG. 9 when image sharing with another portable terminal 100 via the server 3 is set, image sharing via the server 3 is performed after receiving the image. Is set, the flow of FIG. 16 is executed.
FIG. 13 is a flowchart for explaining the flow of image sharing processing executed by the mobile terminal 2 and the server 3 of FIG. 3 having the functional configuration of FIG. This flowchart is executed when image sharing with another portable terminal 100 via the server 3 is set. After receiving an image in step S318-2 of the automatic transfer process in FIG. This is processing performed between the terminal 2 and the server 3.

<Image sharing processing on the mobile terminal 2>
In step S <b> 511-1, the communication control unit 92 transmits a cloud album creation instruction to the server 3. In response to this, the server 3 creates a cloud album in the image storage unit 151.

  In step S512-1, the communication control unit 92 transmits an instruction for sharing destination setting (in this embodiment, registration of the mail address of another portable terminal 100 for sharing). In response to this, the server 3 performs sharing destination setting.

  In step S513-1, the second communication unit 21-2 receives an image from the imaging device 1 by Wi-fi communication.

  In step S514-1, the application management unit 91 stores an image for transmission to the server 3 in the application album of the image storage unit 111 by receiving an image from the imaging device 1. Note that the image capturing apparatus 1 transmits an image having a size based on the “resizing at transmission” setting.

  In step S515-1, the communication control unit 92 transmits an image to the server 3. In response to this, the server 3 stores the received image in the cloud album of the image storage unit 151.

<Image sharing processing on the server 3 side>
In Step S <b> 511-2, the second communication unit 21-3 receives a cloud album creation instruction from the mobile terminal 2.

  In step S512-2, the application management unit 131 creates a cloud album in the image storage unit 151.

  In Step S513-2, the second communication unit 21-3 receives a sharing setting instruction from the mobile terminal 2.

  In step S514-2, the application management unit 131 performs sharing settings. Specifically, the mail address of the sharing destination is registered.

  In Step S515-2, the second communication unit 21-3 receives the sharing image from the mobile terminal 2.

  In step S516-2, the application management unit 131 stores the received image in the cloud album of the image storage unit 151.

  In step S517-2, the communication control unit 132 transmits a sharing notification describing the location of the image to be shared to the registered mail address based on the sharing setting. In the present embodiment, the URL indicating the location of the image is described in the sharing notification. In the other mobile terminal 100 that has received the sharing notification, an image can be browsed by accessing the URL described in the notification.

  In the communication step T configured as described above, the image is automatically transferred to the smartphone (portable terminal 2) only by photographing with the camera (imaging device 1), and further the image is sent to the cloud album and automatically shared. It has a function to notify the other party.

  Conventionally, there has been a technology for automatically transferring a photographed image from a camera to a smartphone, but there is no technology for simply storing the image on the smartphone and even sharing it beyond that.

Therefore, in the communication step T of the present embodiment, the following operation is performed.
○ Pair the camera and smartphone with BLE according to the procedure.
○ When performing pairing, the smartphone application determines the OS of the smartphone and sends the information to the camera.
○ The access point information of the camera is stored in the smartphone so that the smartphone can automatically connect to the camera via Wi-Fi.
○ Create an album to share with the cloud album.
○ Set a sharing partner for the album to be shared.
○ Set the smartphone app to share it with the cloud album when it receives an image from the camera.
○ When shooting with the camera, the camera access point is activated and the BLE is instructed to connect to the camera access point to the smartphone. At this time, it is determined whether to switch to the access point forcibly based on the OS discrimination result of the smartphone.
○ Depending on the OS discrimination result of the smartphone, an instruction is issued by BLE and the cloud album application is also activated.
○ When the camera confirms Wi-Fi connection from the smartphone, it transfers the captured image to the smartphone. The size at this time follows the “Resize when sending” setting of the camera.
○ When the smartphone app receives an image from the camera, it saves the image in the specified location on the smartphone and transfers the image to the cloud album. Depending on the OS discrimination result of the smartphone, the image exchange method between the camera image receiving application and the cloud album application is changed.
○ When the cloud album side receives an image, it notifies the sharer that the image has been registered in the album.
○ The sharer who receives the notification can access the cloud album and check the image by operating the notification.

As a result, the following effects can be achieved in the communication step T of the present embodiment.
○ The captured image can be automatically transferred from the camera to the smartphone.
○ Images automatically received by smartphones can be shared with cloud albums without operating the smartphone.
○ Users are not aware of differences in smartphone OS.

<Application cooperation processing by BLE>
The application cooperation processing by BLE is a part not mentioned in FIGS. 9 and 13, and is processing related to the OS restrictions and the restrictions that are prerequisites for executing the processes in FIGS. 9 and 13.
The communication system S according to the present embodiment has a function of using a BLE notification function and performing a cooperative operation among a plurality of applications.

  Conventionally, the “URL scheme”, which is a mechanism for cooperative operation of a plurality of applications that operate on a specific OS (for example, iOS), can be used only from an application that is operating in the foreground (frontmost), and in the background There is a restriction that it cannot be used during operation, and an application operating in the background cannot cooperate with other applications using the “URL scheme”. On the other hand, the BLE function can be used even in an application operating in the background.

Therefore, the communication system S of the present embodiment is operated as follows.
-Provide a BLE profile for requesting and notifying application activation on the camera.
・ The app with the initiative (App A) connects (pairs) the camera and BLE, notifies the connection information of BLE to another app (App B), and app A and app B share the BLE connection. .
Application B prepares and waits for an application activation notification from BLE connection information.
The application A executes an application activation request, the camera receives the notification and notifies the application activation of the application B, and the application B that receives the application starts operation.
When the application A cancels the pairing with the camera, the application B is notified, and the application B ends the standby for the BLE notification.
Therefore, in the communication system S of the present embodiment, a plurality of applications that operate on the iOS can perform a cooperative operation even when operating in the background. Also, there is no need to wait for BLE notification after pairing is cancelled.

Next, the operation configuration of the application will be described. FIG. 14 is an operation configuration diagram of an application in the imaging device 1 and the mobile terminal 2 in the communication system S of the present embodiment.
The application A stores an image automatically transmitted from the camera.
The application B realizes a cooperative function of registering an image stored by the application A in an album managed by the application B.
The imaging device 1 is a peripheral in BLE and is equipped with a BLE profile for application cooperation.
The mobile terminal 2 operating on a specific OS is a central in BLE, and the application A and the application B share the BLE connection.
The imaging apparatus 1 and the iOS device are connected by BLE, and BLE profile information is transmitted.

Next, an operation sequence is shown. FIG. 15 is a flowchart showing an operation sequence in the imaging device 1 and the portable terminal 2 in the communication system S of the present embodiment.
Application A pairs with the camera and notifies BLE connection information to application B using a URL scheme. Since app A is operating in the foreground, a URL scheme can be used.
Application B prepares to acquire an application activation notification (application B activation notification characteristic notification) from the BLE connection information, and starts waiting for the BLE notification.
When the OS is put to sleep, the application A becomes a background operation.
Application A receives and saves the automatically transmitted image from the camera while operating in the background, makes an activation request for application B to the camera (writes data to application B activation request characteristic), and the camera receives application B The notification by the start notification characteristic is performed, and the application B waiting for it is started, and the image is registered in the album managed by the application B.
When the application A cancels the pairing with the camera, the application B is notified by the URL scheme, and the application B ends the standby for the BLE notification.

<Imaging device side processing>
The imaging device side processing is started by an operation for starting the imaging device side processing to the input unit 17-1 by the user. Note that after the processing is started, the pairing (connection) of BLE communication and Wi-Fi communication is established between the imaging device 1 and the mobile terminal 2 (application A).

In step S611-1, the imaging control unit 51 controls the imaging unit 16-1 to perform imaging, and the communication control unit 52 transmits the captured image to the mobile terminal 2 in the second communication unit 21-. 1 is controlled.
Thereafter, when the activation request for the application B from the application A of the portable terminal 2 is via BLE, the communication control unit 52 transmits an activation notification to the application B of the portable terminal 2 via BLE. The first communication unit 20-1 is controlled. As a result, the application B of the mobile terminal 2 is activated and the transmitted image is registered in the album. Thereafter, the pairing (connection) with the mobile terminal 2 is released, and the imaging device side processing ends.

<App A side processing>
The process on the mobile terminal 2 side in the application A and the application B is started by an operation of starting the mobile terminal side process on the input unit 17-2 by the user. Note that, after the processing is started, the imaging device 1 and the mobile terminal 2 operate so that pairing (connection) of BLE communication and Wi-Fi communication is established by the application A of the mobile terminal 2. When pairing is established, the application A provides BLE connection information to the application B.

  In step S611-2, the application management unit 131 controls the application A to perform a background operation by OS sleep.

  In step S612-2, the application management unit 131 controls the application A to store the image in the image storage unit 151 when an image is received from the imaging apparatus 1. Thereafter, the communication control unit 92 controls the first communication unit 20-2 so that the application A under the application management unit 91 transmits an activation request to the application B via BLE.

  In step S613-2, the application management unit 131 operates the app A in the foreground to perform a pairing cancellation operation. As a result, pairing (connection) with the imaging device 1 is released, a pairing release notification is provided to the app B, and the app A-side processing ends.

<App B side processing>
In step S611-3, the application management unit 131 receives the BLE connection information provided from the application A, and controls the application B to start the BLE notification standby.

  In step S612-3, the application management unit 131 controls the application B to perform a background operation by OS sleep.

  In step S613-3, the application management unit 131 controls to operate in the foreground in response to an application activation request from the imaging device 1, and the communication control unit 132 transfers the image stored in the image storage unit 151 to the cloud server. The second communication unit 21-2 is controlled so as to transmit, and an image is stored in a predetermined storage area of the cloud server to perform album registration.

  In step S614-3, the application management unit 131 receives the pairing release notification from the application A, and controls the application B to end the BLE notification standby. Thereafter, the application B side processing ends.

<Modification>
This example is another example in which the image sharing process in FIG. 13 is executed after the image is received in step S318-2 of the automatic transfer process in FIG.
In the above-described embodiment, the number of linked applications is not limited to two.
Further, the BLE profile for application cooperation may be mounted on another device instead of the imaging device 1.

<Album registration process in automatic image transmission camera>
The communication system S of the present embodiment has an album registration function in the automatic image transmission camera. That is, the communication system S of the present embodiment has a function of automatically transferring an image and registering it in an album on the network by setting an album in advance in the automatic transmission compatible camera.

  2. Description of the Related Art Conventionally, a function of automatically sending a shot image to a terminal side after shooting with a camera between a camera and a mobile terminal such as a smartphone is installed. Conventionally, after transmitting an image to a mobile terminal by wireless connection, it has been necessary to register with an SNS by manual operation of a user or register with an album service on the network. Sharing an album with many images has the problem that it takes a lot of time and effort, especially with this camera with automatic transmission function, it is possible to send many images. It was.

Therefore, the following operation is performed in the communication system S of the present embodiment.
1. Select the album in advance before the operation As shown in FIG. 16, the album is selected in advance by the application, and the image automatically transmitted by the camera is transferred in the transfer application on the mobile terminal corresponding to the camera. Select whether to register to album Select which album to register. FIG. 16 is a schematic diagram showing an album selection screen in the application.
As the processing operation, as shown in FIGS. 17 and 18, when “share album” is turned on in advance and automatic transmission is performed using a camera, it is registered in the album according to this setting. FIG. 17 is a flowchart for explaining the flow of the album registration process, and FIG. 18 is a flowchart for explaining the flow of the automatic transmission process.

<Album setting process>
The album setting process is started by an operation of starting the album setting process on the input unit 17-2 by the user.

  In step S <b> 711, the communication control unit 132 controls the second communication unit 21-2 to perform album service authentication with the server 3.

In step S712, the communication control unit 132 determines whether or not the authentication is successful as a result of the authentication control with the server 3.
If the authentication is OK, YES is determined in step S712, and the process proceeds to step S714.
On the other hand, if the authentication is not OK, NO is determined in step S712, and the process proceeds to step S713.

  In step S713, since the CPU 11-2 is authentication NG, the CPU 11-2 controls the output unit 18-1 to display an error.

  In step S714, the communication control unit 132 controls the second communication unit 21-2 so as to acquire the album list from the server 3.

  In step S715, the CPU 11-2 controls the output unit 18-2 to display the album list acquired from the server 3.

  In step S716, an operation for selecting an album in the album sharing setting is performed on the input unit 17-2 by a user operation, and the application management unit 131 selects an album to be shared. Thereafter, the album setting process ends.

<Automatic transmission processing>
This automatic transmission process is another example of the automatic transfer process of FIG.
The automatic transmission process is started by an operation of starting an automatic transmission process to the input unit 17-1 by the user.

  In step S811, the communication control unit 132 controls the second communication unit 21-2 so as to receive an image from the imaging device 1.

  In step S812, the application management unit 131 stores the received image in the image storage unit 151.

In step S813, the application management unit 131 determines whether the album sharing setting is ON.
If the album share setting is ON, YES is determined in step S813, and the process proceeds to step S814.
On the other hand, if the album share setting is not ON, it is determined as NO in step S813, and the process ends.

  In step S814, the communication control unit 132 controls the second communication unit 21-2 so as to store the image stored in the image storage unit 151 in a predetermined storage area of the server 3, and performs album registration. Thereafter, the automatic transmission process ends.

2. Selecting an album in advance by the camera In the operation 1, the content is that the album is selected on the application side. However, the album information acquired on the application side can be notified to the camera, and the album can be selected on the camera side.
The camera sets the album in advance before shooting. By communication (which may be BLE or Wi-Fi), album information is acquired by the application of the mobile terminal, and the album information is displayed on the camera by notifying this to the camera. The user looks at the camera screen, selects an album, and sets whether to share with the album.
In automatic transmission, the selected album ID is added to the photographed image and transmitted to the mobile terminal. On the terminal side, registration is performed in the album according to the album ID of the received image.
FIG. 19 is a flowchart for explaining the flow of album selection processing on the camera side, and FIG. 20 is a flowchart for explaining the flow of image registration processing.

<Imaging device side album setting process>
The album setting process on the imaging apparatus 1 side is started by an operation of starting the album setting process to the input unit 17-1 by the user.

  In step S911-1, the communication control unit 92 controls the second communication unit so as to acquire the album list from the server 3.

  In step S <b> 912-1, the CPU 11-1 controls the output unit 18-1 to display the album list acquired from the server 3.

  In step S913-1, an operation for selecting an album in the album sharing setting is performed on the input unit 17-1 by a user operation, and the application management unit 91 selects an album to be shared. Thereafter, the album setting process on the imaging apparatus 1 side ends.

<Mobile device side album list acquisition processing>
The album list acquisition process on the portable terminal 2 side is started by an operation of starting the album list acquisition process to the input unit 17-2 by the user.

  In step S911-2, the communication control unit 132 controls the second communication unit 21-2 to perform album service authentication on the server 3.

In step S912-2, the communication control unit 132 determines whether or not the authentication is successful as a result of the authentication control with the server 3.
If the authentication is OK, YES is determined in step S912-2, and the process proceeds to step S913-2.
On the other hand, if the authentication is not OK, NO is determined in step S912-2, and the album list acquisition process on the portable terminal 2 side ends.

  In step S913-2, the communication control unit 132 controls the second communication unit 21-2 to acquire the album list from the server 3.

  In step S914-2, the communication control unit 132 controls the second communication unit 21-2 that notifies the imaging apparatus 1 of the album list acquired from the server 3. Thereafter, the album list acquisition process on the portable terminal 2 side ends.

<Imaging device side automatic transmission processing>
The automatic transmission process on the imaging apparatus 1 side is started by an operation of starting an automatic transmission process to the input unit 17-1 by the user.

  In step S1011-1, the imaging control unit 51 controls the imaging unit 16-1-1 to perform imaging.

  In step S1012-1, the photographing control unit 51 stores the photographed image in the image storage unit 71.

In step S1013-1, the communication control unit 52 determines whether or not the album share setting is ON.
If the album share setting is ON, YES is determined in step S1013-1, and the process proceeds to step S1014-1.
On the other hand, if the album share setting is not ON, NO is determined in step S1013-1, and the process proceeds to step S1015-1.

  In step S1014-1, the communication control unit 52 adds an album ID to the image to be transmitted for sharing.

  In step S1015-1, the communication control unit 52 controls the second communication unit 21-1 to transmit the image with the album ID added thereto to the mobile terminal 2. Thereafter, the automatic transmission process on the imaging device 1 side ends.

<Mobile device side album registration process>
The album registration process on the portable terminal 2 side is started by an operation for starting the portable terminal side album registration process to the input unit 17-2 by the user.

  In step S1011-2, the communication control unit 92 controls the second communication unit 21-2 so as to receive an image from the imaging device 1.

  In step S1012-2, the application management unit 91 stores the received image in the image storage unit 111.

In step S1013-3, the application management unit 91 determines whether there is an album ID.
If there is an album ID, YES is determined in step S1013-3, and the process proceeds to step S1014-2.
On the other hand, if there is no album ID, NO is determined in step S1013-2, and the album registration process on the portable terminal 2 side ends.

In step S1014-2, the communication control unit 92 performs album registration by controlling the second communication unit 21-2 to store the image stored in the image storage unit 151 in a predetermined storage area of the server 3.
Thereafter, the album registration process on the portable terminal 2 side ends.

3. Select multiple albums with the camera and app When using multiple albums in one operation, the camera will select the album A, album B, album C and album not registered (N / A) on the album setting screen. select. During shooting (REC), the type of the selected album can be confirmed.
In the application, album A, album B, and album C are specifically selected in advance as to which album is set.
FIG. 21 is a schematic diagram illustrating a screen display example in the imaging apparatus 1, and FIG. 22 is a schematic diagram illustrating a screen display example in the imaging apparatus 1.

  Therefore, in the communication system S of the present embodiment, the automatic transmission camera that automatically transfers many images to the mobile terminal not only transfers the image to the mobile terminal by setting an album in advance. , Can also automatically send and share to albums on the network. For example, it is convenient when taking a photo of the exhibition today and reporting it to a colleague. Also, by notifying the camera of album information, the album name can be confirmed and selected on the camera body. In addition, by simply switching and shooting the album on the camera side, it is possible to easily share the album when sharing the album with a plurality of themes.

<Modification>
In the operations 1 to 3 described above, there is only one service that provides an album, but it is also possible to select and set on the transfer application side from a plurality of services with different business entities. With this configuration, according to the modification, it is possible to select and register an album from a plurality of services. The camera side can absorb the difference in services without being aware of a plurality of services, so that album sharing by different services can be easily performed.

In the data processing system configured as described above, the first device having a function of acquiring data and the second device having a function of managing data cooperate to realize a predetermined cooperation function. .
The first device includes data transmission means for transmitting data to the second device via the first wireless communication means.
The second device has a first program for executing data reception processing for receiving data from the first device via the first wireless communication means, and data management for managing data received in the data reception processing Storage means for storing the second program for executing the processing, switching means for switching the first program and the second program between the stopped state and the activated state, the second program is stopped, When data is received by the data reception process while the first program is activated, the second program is switched from the stopped state to the activated state, and the received data is designated as a management target and the data management process And a control means for executing.
Thereby, in the data processing system, the convenience of data management can be improved.

  When the first device receives a second program activation request from the first device via the second wireless communication means, the first device transmits the second device to the second device via the second wireless communication means. The activation notification transmission unit that transmits the activation notification of the second program and the control unit of the second device, when the second program cannot be activated directly from the first program, are transmitted via the second wireless communication unit. A start request for the second program is transmitted to one device, and the second program is switched from the stop state to the start state by the start notification transmitted from the first device in response to the start request.

  The second wireless communication means is slower than the first wireless communication means but saves power, and the control means cannot start the second program in the first wireless communication means, and the second wireless communication The second program can be started by the means.

The data management process is a process for managing specified data by distributing it to one of a plurality of groups.
The control means designates the received data as a group management target and executes data management processing.

The second device includes a group information transmitting unit that transmits group information related to a plurality of groups that can be managed by the data management process to the first device, and a control unit of the second device receives the data received from the first device. Are distributed and managed in groups designated by the group selection information received from the first device.
The first device selects a predetermined group from among a plurality of groups included in the group information received from the second device, and selects information transmitting means for transmitting the group selection information to the second device. In addition.

  The second device stores the group selection information transmitted from the first device, and is specified by the stored group selection information every time new data is received from the first device. Distribute them to different groups.

  The second device distributes the data received together with the group selection information from the first device to the group specified by the group selection information for management.

  The first device displays a list of a plurality of groups included in the group information received from the second device, causes the user to select, and transmits group selection information based on the user operation to the second device.

The second device includes a third communication unit that communicates with a server that provides a data sharing service on the network.
In the data management process, the data received from the first device is designated as a sharing target and transmitted to the server via the third communication means.

The data sharing service is a service for classifying and sharing a plurality of data into a plurality of groups.
The second device designates a group designated by the group selection information when the received data is designated as a sharing target and transmitted to the server for sharing.

  The first device causes the user to select whether or not to share the acquired image, and transmits sharing enable / disable information together with the group selection information to the second device.

The first device causes the user to select whether or not to share the acquired image, and transmits sharing enable / disable information together with the group selection information to the second device.
When sharing is possible, the second device transmits the received data to the server.

  A service on a plurality of different networks that provide a data sharing service is selected, and the received data is transmitted to a server that provides the selected service.

  The first device is an imaging device having a function of acquiring image data by photographing.

  When new image data is acquired in a state where the automatic transmission mode is set, the imaging apparatus that is the first device transmits the image data by the data transmission unit.

  The imaging apparatus that is the first device stores and updates the group selection information, and displays the currently selected group on the live view screen.

  The second device has a plurality of different types, and the control unit changes the activation control depending on the type.

  The first wireless communication means is always connected, and the second wireless communication means establishes a connection in response to a connection request via the first wireless communication means, and changes connection establishment control depending on the type. .

Conventionally, a technique for connecting an imaging device such as a digital camera and a portable terminal such as a smartphone by wireless communication has been used.
As an example of such a technique, there is an imaging system in which a camera is remotely controlled by a camera operation terminal (see, for example, JP-A-2014-230024).
In the portable terminal, for example, various application software such as image sharing application software that accesses an image sharing service on a network and shares an image with another user can be used.
By using such technology, the user operates the mobile terminal, remotely causes the camera to take a picture, saves the image data transmitted from the camera to the mobile terminal, and then starts the necessary application software In addition, by performing various operations, it is possible to manage image data and use an image sharing service.
In this case, the user starts and operates different application software according to the type (for example, iOS or Android) of the OS (operating software) of the mobile terminal.

  However, when the above-described technology is used, for example, in order to use an image sharing service using a camera and a mobile terminal, a user performs an operation of starting required application software or It was necessary to perform various operations according to the specifications, and it was very time-consuming. There is a similar problem not only when the camera and the mobile terminal are linked, but when various types of management of data acquired by linking a device that provides data and a device that manages data are performed.

  The present embodiment has been made in view of such a situation, and enhances convenience in performing various management of acquired data by linking a device that provides data and a device that manages data. It is an object.

<Third Embodiment>
<Pairing connection operation>
Although the detailed portions have not been described in the first and second embodiments described above, in the present embodiment, processing related to the restriction of the BLE communication standard that is a premise in the processing in the first and second embodiments will be described. The processing described in the present embodiment is executed at the start of the processing in FIG. 9 and FIG. 10 or in parallel with the processing in FIG. 9 and FIG.
In the communication system S of this embodiment, when an imaging device and a mobile terminal are connected by BLE, an advertising signal is output from the imaging device, and the mobile terminal detects the signal and performs connection processing so that Bluetooth (registered trademark) is used. ) Is established, but if the contents of the advertising signal are the same in all states, the following problems (problems 1, 2, and 3) occur. Further, if the information to be put on the advertising signal is increased, the data size of the signal becomes large, which is disadvantageous in terms of power.

[Problem 1]
There is a security problem because the pairing setting can be changed between a paired mobile terminal and another mobile terminal (robbery problem).
If there is an imaging device and a portable terminal that are paired, and the BLE connection cannot be established because the two distances are too far, the imaging device issues an advertisement signal and tries to connect to the portable terminal. At this time, when a pairing operation is performed with another mobile terminal, the imaging device and the mobile terminal are connected to enable a part of the operation.
In addition, when the imaging apparatus is powered on, the content of the BLE signal (Wi-Fi SSID, password) is sent to the mobile terminal C.
[Problem 2]
If there is a mobile device that has been paired before, the mobile device will automatically perform the pairing process when pairing is performed on the imaging device, so it cannot be paired with another mobile device. (Mobile device change issue).
There are an imaging device and a portable terminal that are paired, and the pairing is canceled by operating the imaging device. If the imaging device is operated to pair another mobile terminal with the imaging device, the mobile terminal B automatically connects to the imaging device. At this time, the portable terminal cannot continue the pairing process.
[Problem 3]
The imaging devices listed in the pairing process of the mobile terminal application include those that can be paired and those that do not (list organization).

The following measures are taken with respect to such a problem in the communication system S of the present embodiment.
The device name is changed according to the connection state (presence / absence of pairing) of the imaging device 1 connected to the mobile terminal 2, and processing is performed on the smartphone using the change. That is, according to the BLE connection information (pairing presence / absence) which is the pairing information of the imaging apparatus 1, a space character is added to the device name of the advertising signal to make a difference, and the mobile terminal 2's Change connection control in the app.

Specifically, in the communication system S, the device name included in the data of the advertising signal is changed according to the pairing state of the imaging apparatus 1, and the application process of the mobile terminal 2 is branched based on the device name. It is assumed that pairing can be performed one-to-one between the imaging device 1 and the portable terminal 2. In addition, after the connection is established, the mobile terminal 2 identifies the imaging device 1 that is a pairing partner with a BD address instead of a device name.
<State in which imaging device 1 is not paired>
It is assumed that the device name is a Wi-Fi SSID with no space at the end.
Example: “ZR1600-01ACDC” (device name + no space)
-Even if paired, it does not automatically reconnect ([Problem 2] is avoided).
(For this reason, the connection is not made unless the pairing operation is performed.)
<State in which imaging device 1 has been paired>
A space is added at the end of the device name.
Example: “ZR1600-01ACDC” (device name + space)
・ Do not connect to an unpaired smartphone (avoid [Problem 1]).
(Connect only to the paired mobile terminal 2)
・ Do not display in the list of candidates that can be paired (avoid [Problem 3]).
(Displays only unpaired devices.)

FIG. 23 is a functional block diagram illustrating a functional configuration for executing the pairing connection process among the functional configurations of the imaging device 1 and the mobile terminal 2 of FIG. 3.
The pairing connection process refers to a series of processes in which pairing is performed and connection is established between the imaging device 1 and the portable terminal 2 in the BLE communication standard.

When the pairing connection process is executed by the imaging apparatus 1, as shown in FIG. 23, the CPU 11-1 functions as a pairing status determination unit 171, an advertising signal generation unit 172, and a communication control unit 173. To do.
A communication information storage unit 191 is set in one area of the storage unit 19-1.
In the communication information storage unit 191, pairing information obtained as a result of the pairing process (in this embodiment, information generated based on the SSID that is the identification name of the access point in the wireless LAN (Wi-Fi)) Connection information (BD address in the present embodiment) obtained as a result of the connection process is stored. The pairing information is the device name in the advertising signal used for the pairing process and the BD address used at the time of connection after the end of the pairing process.

  The pairing status determination unit 171 refers to the pairing information stored in the communication information storage unit 191 (refers to the presence / absence of pairing information) and determines the pairing status. When there is no pairing information, the pairing status determination unit 171 determines that the pairing is not performed (hereinafter referred to as “unpaired status”). Judgment is made as a ringing situation (hereinafter referred to as “paired situation”).

The advertising signal generation unit 172 generates an advertising signal based on the determination result by the pairing status determination unit 171.
When generating the advertising signal, the advertising signal generation unit 172 determines whether the determination result of the pairing status determination unit 171 is an unpaired state or a paired status (hereinafter referred to as “advertising”). Information ”).
The advertising signal generation unit 172 generates an “unpaired specification advertising signal” in which the advertising information is “device name + no space (device name only)” in the case of an unpaired state, and has been paired If it is a situation, an “advertising signal with paired specifications” is generated with the advertising information “device name + with space”.

  The communication control unit 173 controls the first communication unit 20-1. Specifically, the communication control unit 173 controls the first communication unit 20-1 so as to transmit an advertising signal and to perform pairing processing and connection processing. Note that the pairing information and the BD address acquired as a result of the pairing process and the connection process are stored in the communication information storage unit 191.

When the pairing connection process is executed in the portable terminal 2, as shown in FIG. 23, in the CPU 11-2, the communication control unit 211, the pairing status determination unit 212, and the advertising signal determination unit 213 function. To do.
A communication information storage unit 231 is set in one area of the storage unit 19-2.
The communication information storage unit 231 stores pairing information obtained when pairing. The pairing information is the device name in the advertising signal used for the pairing process and the BD address used at the time of connection after the end of the pairing process.

  The communication control unit 211 controls the first communication unit 20-2. Specifically, the communication control unit 211 controls the first communication unit 20-2 so as to detect an advertising signal and execute a pairing process and a connection process.

  The pairing status determination unit 212 refers to the pairing information stored in the communication information storage unit 231 (refers to the presence / absence of pairing information) and determines the pairing status. When there is no pairing information, the pairing status determination unit 212 determines that the pairing is not performed (hereinafter referred to as “unpaired status”). Judgment is made as a ringing situation (hereinafter referred to as “paired situation”).

  The advertising signal determination unit 213 determines whether the advertising information of the detected advertising signal is an unpaired advertising signal or a paired advertising signal. Specifically, when the advertising information is device name + no space (only the device name), the advertising signal determination unit 213 determines that the advertising signal is an unpaired specification, and the advertising information includes the device name + space. In this case, it is determined as an unpaired advertising signal.

  FIG. 24 is a flowchart for explaining the flow of pairing connection processing executed by the imaging device 1 and the mobile terminal 2 of FIG. 3 having the functional configuration of FIG.

<[Imaging device side] Pairing connection processing>
The pairing connection process on the imaging device 1 side is started by an operation for starting the pairing connection process to the input unit 17-1 by the user.

In step S1111-1, the pairing status determination unit 171 determines whether or not it is an unpaired status.
If it is an unpaired situation, YES is determined in step S1111-1 and the process proceeds to step S1112-1.

  In step S1112-1, the advertising signal generation unit 172 generates an unpaired advertising signal. Specifically, the advertising signal generation unit 172 generates an unpaired advertising signal with information having no space in the device name.

  In step S1113-1, the communication control unit 173 controls the first communication unit 20-1 so as to transmit the generated unpaired advertising signal.

  In step S1114-1, the communication control unit 173 controls the first communication unit 20-1 so as to execute a pairing process with the mobile terminal 2.

  In step S1115-1, the communication control unit 173 controls the first communication unit 20-1 to execute the connection process based on the connection setting performed by the pairing process. Thereafter, the process ends.

  On the other hand, when it is not the unpaired situation but the paired situation has been paired, NO is determined in step S1111-1 and the process proceeds to step S1116-1.

  In step S1116-1, the advertising signal generation unit 172 generates an advertising signal with a paired specification. Specifically, the advertising signal generation unit 172 generates an advertising signal of a paired specification in which information having a space in the device name is added.

  In step S1117-1, the communication control unit 173 controls the first communication unit 20-1 to transmit the generated advertising signal of the paired specification.

  In Step S1118-1, the first communication unit 20-1 is controlled to execute the connection process based on the connection setting performed by the pairing process. Thereafter, the process ends.

<[Mobile device side] Pairing connection processing>
The pairing connection process on the portable terminal 2 side is started by an operation of starting the pairing connection process to the input unit 17-2 by the user.

  In step S1111-2, the communication control unit 211 controls the first communication unit 20-1 so as to detect an advertising signal. As a result, the first communication unit 20-1 detects the advertising signal transmitted from the imaging device 1.

In step S1112-2, the pairing status determination unit 212 determines whether or not it is an unpaired status.
When it is an unpaired situation, it is determined as YES in Step S1112-2, and the process proceeds to Step S1113-2.

In step S1113-2, the advertising signal determination unit 213 determines whether the advertising signal is an unpaired advertising signal.
If the advertising signal is not an unpaired specification but a paired advertising signal, NO is determined in step S1113-2, and the pairing connection process ends.
In the case of an unpaired advertising signal, it is determined as YES in Step S1113-2, and the process proceeds to Step S1114-2.

  In step S1114-2, the communication control unit 211 controls the communication unit so as to execute pairing processing with the imaging device 1.

  In step S1115-2, the communication control unit 211 controls the communication unit to execute the connection process based on the connection setting performed by the pairing process. Thereafter, the pairing connection process ends.

  On the other hand, when it is not paired but not paired, NO is determined in step S1112-2, and the process proceeds to step S1116-2.

In step S1116-2, the advertising signal determination unit 213 determines whether the advertising signal is a paired specification advertising signal.
In the case of an advertising signal not in the paired specification but in the unpaired specification, NO is determined in step S1116-2, and the pairing connection process ends.
In the case of the advertising signal of the paired specification, it is determined as YES in Step S1116-2, and the process proceeds to Step S1117-2.

  In step S1117-2, the communication control unit 211 controls the communication unit to execute the connection process based on the connection setting performed by the pairing process. Thereafter, the pairing connection process ends.

<Modification>
In order to reinforce the avoidance of “Problem 1”, a specific OS (Operating System) specification (in this embodiment, for iOS) is specially provided, a device name characteristic is provided, and BLE is once connected. It is possible to obtain and determine in the same manner as the connection availability determination by the device name of the advertising data, and determine whether to maintain or disconnect the connection.

  Moreover, when the function of this modification is added to the flowchart mentioned above, it can be grasped as shown in FIG. 25 is a flowchart for explaining another flow of the pairing connection process executed by the mobile terminal 2 of FIG. 3 having the functional configuration of FIG.

<Portable terminal side pairing connection processing>
The pairing connection process on the portable terminal 2 side is started by an operation of starting the pairing connection process to the input unit 17-2 by the user. As a premise, the BLE of the mobile terminal 2 is not connected at the start of processing.

  In step S1211, the communication control unit 211 controls the first communication unit 20-2 so as to detect an advertising signal. As a result, the first communication unit 20-2 detects the advertising signal transmitted from the imaging device 1.

  In step S <b> 1212, the communication control unit 211 starts the BLE connection process and controls the first communication unit 20-2 so as to perform BLE connection with the imaging device 1.

In step S1213, the pairing status determination unit 212 determines whether pairing processing has been performed.
If the pairing process has been performed, YES is determined in step S1213, and the process proceeds to step S1214.
On the other hand, if the pairing process is not performed, NO is determined in step S1213, and the process proceeds to step S1219.

In step S1214, the advertising signal determination unit 213 determines whether the advertising device name has been determined.
If the advertising device name is determined, YES is determined in step S1214, and the portable terminal 2 side pairing connection process ends.
In contrast, if the advertising device name is not determined, NO is determined in step S1214, and the process proceeds to step S1215.

  In step S1215, the communication control unit 211 controls the first communication unit 20-2 to execute the connection process.

In step S1216, the advertising signal determination unit 213 determines whether the characteristic device name has been determined.
If the characteristic device name is determined, YES is determined in step S1216, and the process proceeds to step S1218.
On the other hand, if the characteristic device name has not been determined, NO is determined in step S1216, and the process proceeds to step S1217.

  In step S1217, the communication control unit 211 controls the first communication unit 20-2 to execute the pairing process. Thereafter, the pairing connection process on the mobile terminal 2 side ends.

  In step S1218, the communication control unit 211 controls the first communication unit 20-2 to execute the BLE disconnection process. Thereafter, the pairing connection process on the mobile terminal 2 side ends.

In step S1219, the advertising signal determination unit 213 determines whether the advertising device name has been determined.
If the advertising device name is determined, YES is determined in step S1219, and the process proceeds to step S1220.
On the other hand, if the advertising device name has not been determined, NO is determined in step S1219, and the pairing connection process on the mobile terminal 2 side ends.

  In step S1220, the communication control unit 211 controls the first communication unit 20-2 to execute the connection process. Thereafter, the pairing connection process on the mobile terminal 2 side ends.

<Background process for automatic transmission>
In the communication system S of the present embodiment, the background operation of the application of the mobile terminal 2 (smartphone) has a time restriction, and has a function for sending image transmission within the time.

A conventional imaging device is equipped with a function of automatically transmitting a captured image to the terminal side after shooting with a camera between the imaging device (camera) and a mobile terminal such as a smartphone.
In order to send only the operation of the camera without the operation of the smartphone, by sending a startup notification using Bluetooth, the application is started in a background process, and a mechanism to receive images even when the smartphone is in the sleep state is realized .
In iOS, there is a time limit on background operation, and in this case, not all data may be sent.

Therefore, in the communication system S of the present embodiment, an operation as shown in FIGS. 26 and 27 is performed. FIGS. 26 and 27 are flowcharts for explaining the background process of automatic transmission.
1. Process activation notification by BLE is performed from the camera to the smartphone.
2. Launch an image reception app on your smartphone in the background.
3. Start up the Wi-Fi access point of the camera and connect to the smartphone with Wi-Fi.
4). Send a list of files to send from the camera to the app.
5. The app gets the files in the file list from the camera.
6A-1. If the data transfer finishes in time, it tells the camera success, terminates the background process, and puts the smartphone back to sleep.
6A-2. In order to send the next file list, the camera performs a process start notification by BLE again.
6B-1. If data transfer is unlikely to finish in time, the camera is informed of the failure, terminates the background process, and returns the smartphone to sleep.
6B-2. In order to send the file list that could not be sent, the camera performs a process start notification by BLE again.
6C-1. If the background process ends without notice, the app cannot do anything.
6C-2. The camera detects the disconnection of communication, and again sends a process start notification by BLE to send a file list that could not be sent.
If transmission fails, retry the transmission data by changing the granularity.

<[Image capture device side] File transfer process>
The file transfer process on the image pickup apparatus 1 side is started by an operation of starting the [image pickup apparatus side] file transfer process to the input unit 17-1 by the user.

  In step S1311-1, the communication control unit 173 controls the first communication unit 20-1 to transmit a notification.

In step S1312-1, the communication control unit 173 determines ON / OFF of Wi-Fi.
If Wi-Fi is ON, YES is determined in step S1312-1, and the process proceeds to step S1314-1.
On the other hand, when Wi-Fi is OFF, NO is determined in step S1312-1, and the process proceeds to step S1313-1.

  In step S1313-1, the communication control unit 173 controls the second communication unit 21-1 so as to activate the Wi-Fi access point.

  In step S1314-1, the communication control unit 173 controls the second communication unit 21-1 so as to establish HTTP communication.

  In step S1315-1, the communication control unit 173 creates a file list.

  In step S1316-1, the communication control unit 173 transmits a file list.

  In step S1317-1, the communication control unit 173 transmits the file.

In step S1318-1, the communication control unit 173 controls the second communication unit 21-1 to determine whether or not a timeout has been detected in the mobile terminal 2.
If a timeout is detected in the mobile terminal 2, YES is determined in step S1318-1, and the process proceeds to step S1321-1.
On the other hand, when the portable terminal 2 does not detect a timeout, it is determined as NO in Step S1318-1, and the process proceeds to Step S1319-1.

  In step S1319-1, the communication control unit 173 controls the second communication unit 21-1 to receive a communication completion notification.

In step S1320-1, the communication control unit 173 determines whether or not the transmission is successful.
If the transmission is successful, YES is determined in step S13220-1, and the process proceeds to step S1322-1.
On the other hand, if the transmission is not successful, NO is determined in step S1320-1, and the process proceeds to step S1321-1.

  In step S1321-1, the communication control unit 173 controls the second communication unit 21-1 so as to reset the transmission data amount.

  In step S1322-1, the communication control unit 173 controls the second communication unit 21-1 to set the next transmission data.

In step S1323-1, the communication control unit 173 controls the second communication unit 21-1 so as to determine whether there is next data.
If there is next data, YES is determined in step S1323-1, and the process returns to step S1221.
On the other hand, if there is no next data, NO is determined in step S1323-1, and the file transfer process on the imaging device 1 side ends.

<[Mobile device side] File transfer process>
The file transfer process on the portable terminal 2 side is started by an operation of starting the file transfer process on the portable terminal 2 side to the input unit 17-2 by the user.

  In step S1311-2, the communication control unit 211 controls the first communication unit 20-2 to receive the BLE notification.

  In step S1312-2, the CPU 11 starts the application in the background (BG).

In step S1313-2, the communication control unit 211 determines whether or not Wi-Fi is not connected.
If it is not connected to Wi-Fi, it is determined as YES in Step S1313-1, and the process proceeds to Step S1314-2.
On the other hand, if it is not connected to Wi-Fi, NO is determined in step S1313-2, and the process proceeds to step S1315-2.

  In step S1314-2, the communication control unit 211 controls the second communication unit 21-2 so as to connect to the AP of the imaging device 1.

  In step S1315-2, the communication control unit 211 controls the second communication unit 21-2 so as to establish HTTP communication.

  In step S1316-2, the communication control unit 211 controls the second communication unit 21-2 to receive the file list.

  In step S1317-2, the communication control unit 211 controls the second communication unit 21-2 to receive a file.

In step S1318-2, the CPU 11 determines whether or not the process by the OS has ended.
If the process by the OS is completed, YES is determined in step S1318-2, and the file transfer process on the portable terminal 2 side ends.
On the other hand, if the process by the OS has not ended, NO is determined in step S1318-2, and the process proceeds to step S1319-2.

In step S <b> 1319-2, the CPU 11 determines whether or not the OS has notified the end of the process.
If the OS notifies the end of the process, it is determined as YES in Step S1319-2, and the process proceeds to Step S1321-2.
On the other hand, if the OS has not notified the end of the process, NO is determined in step S1319-2, and the process proceeds to step S1320-2.

In step S1320-2, the communication control unit 211 determines whether reception of the file is completed.
If reception of the file is completed, YES is determined in step S1320-2, and the process proceeds to step S1321-2.
On the other hand, if the file reception has not been completed, NO is determined in step S1320-2, and the process returns to step S1317-2.

  In step S1321-2, the communication control unit 211 controls the second communication unit 21-2 to transmit a communication completion notification. Thereafter, the file transfer process on the portable terminal 2 side ends.

  Therefore, in the communication system S of the present embodiment, since all of the transmission processes divided into a plurality of times start with the Bluetooth notification, it is possible to send a large amount of data with a communication function with a time limit. In addition, it becomes easy to transmit again from data that could not be transmitted by a process whose end timing is unknown.

<BLE connection parameter adaptive setting process>
The communication system S of the present embodiment has a function of setting connection parameters of BLE adaptively when the camera power is turned on and off, and achieving both connection stability and power saving.

  Conventionally, the shorter the connection interval time of the BLE connection parameter, the higher the data transfer rate, but the larger the current consumption. The shorter the connection monitoring timeout time, the shorter the time until it is determined that the BLE has been disconnected and the reconnection process is performed, and the time during which communication cannot actually be performed is shortened.

Therefore, the communication system S of the present embodiment performs an operation as shown in FIG. FIG. 28 is a flowchart for explaining the BLE connection parameter adaptive setting process.
・ Adaptively change BLE connection parameters when the camera power is on and off.
-When the camera power is on, shorten the connection interval and connection monitoring timeout time.
・ When the camera is turned off, increase the connection interval and connection monitoring timeout. That is, branching occurs when the camera power is on and off, and the connection parameter setting of BLE is changed.

  That is, the BLE connection parameter adaptive setting process is started by an operation for starting the BLE connection parameter adaptive setting process to the input unit 17-1.

In step S1411, the CPU 11 determines whether the camera power is turned off.
If the camera power is turned off, YES is determined in step S1411, and the process proceeds to step S1413.
On the other hand, if the camera power supply is not turned off, NO is determined in step S1411, and the process proceeds to step S1412.

  In step S1412, the communication control unit 173 changes the setting to “connection interval ← 40 ms” and “connection monitoring timeout ← 3.01 s”. Thereafter, the BLE connection parameter adaptive setting process ends.

  In step S1413, the communication control unit 173 changes the setting to “connection interval ← 1000 ms” and “connection monitoring timeout ← 5 s”. Thereafter, the BLE connection parameter adaptive setting process ends.

The communication system S of the present embodiment has the following effects.
-When the camera is turned on, the data transfer rate is high and the time during which communication is not possible is shortened.
-When the camera is turned off, it operates with power saving, and even if communication is interrupted to some extent, it is not recognized as disconnected.
(There is no problem even if the transfer rate is low because data transfer does not occur when the camera is turned off.)

<Wi-Fi setting control processing on the imaging device side>
In the communication system S of the present embodiment, if the camera and the smartphone are paired with Bluetooth, Wi-Fi connection becomes easy, and if the Wi-Fi setting is changed from this state, the connection cannot be made. The function of limiting the Wi-Fi setting changing function depending on whether there is a pair or no pair. In addition, it has a function of adjusting so that the operation differs depending on whether or not there is a pair.

2. Description of the Related Art Conventionally, a function of automatically transmitting a captured image to a terminal side after capturing with a camera and a mobile terminal such as a smartphone is installed.
In order to automatically transmit, the camera and the smartphone are paired with BLE, and the Wi-Fi setting of the camera is sent to the smartphone via BT. The smartphone connects to the Wi-Fi access point of the camera based on the information at this time.
However, since the SSID and password of the access point are only set values, they can be easily changed. If changed, the camera and the smartphone cannot be connected via Wi-Fi.

Therefore, the communication system S of the present embodiment performs an operation as shown in FIG. FIG. 29 is a flowchart for explaining the Wi-Fi setting control process on the imaging apparatus 1 side.
The camera transmits the SSID and password of the Wi-Fi access point of the camera on the BT communication to the smartphone during BLE pairing.
-The smartphone adds the received SSID and password to its own Wi-Fi settings.
The camera records the pair establishment information and masks the Wi-Fi password change menu so that it cannot be executed by the user.
That is, in the communication system S of the present embodiment, the Wi-Fi password change is enabled / disabled depending on the presence or absence of pairing.

  That is, the Wi-Fi setting control process on the imaging device 1 side is started by an operation of starting the Wi-Fi setting control process to the input unit 17-1 by the user.

  In step S1511, the communication control unit 173 controls the first communication unit 20-1 to execute the BLE pairing process.

  In step S1512, the communication control unit 173 sets the SSID and password, and controls the second communication unit 21-1 to activate the WiFi AP.

  In step S1513, the communication control unit 173 controls the first communication unit 20-1 to transmit the SSID and the path by BLE.

In step S1514, the communication control unit 173 controls the second communication unit 21-1 so as to determine whether or not a WiFi connection is detected.
If a WiFi connection is detected, YES is determined in step S1514, and the process proceeds to step S1515.
On the other hand, if the WiFi connection is not detected, NO is determined in step S1514, and the process enters a standby state in step S1514.

  In step S1515, the communication control unit 173 stores pairing information. Thereafter, the Wi-Fi setting control process on the imaging apparatus 1 side ends.

FIG. 30 is a flowchart for explaining the Menu open process.
The menu open process start is started by an operation of the menu open process start to the input unit 17-1 by the user.

  In step S1611, the communication control unit 173 acquires pairing information.

In step S1612, the communication control unit 173 determines whether pair setting has been completed.
If the pair has been set, YES is determined in step S1612, and the process proceeds to step S1613.
On the other hand, if the pair has not been set, NO is determined in step S1612, and the menu open process start ends.

  In step S1613, the CPU 11 masks the menu. Thereafter, the start of the menu open process ends.

  Therefore, in the communication system S of the present embodiment, it is possible to prevent automatic transmission from being performed due to a change in the setting on the camera side, and that other communication functions cannot be used.

In addition to the Wi-Fi password, the function of switching the operation depending on the presence / absence of a pair is as follows.
-Automatic image transmission With pair: Executable Without pair: Unexecutable (cannot be set to ON)
-Manual image transmission Paired: All executable No pair: App cannot be transmitted in the background

<Camera activation mode determination process by BLE communication>
In the communication system S of the present embodiment, when the camera is activated due to a BLE factor, the activation mode is determined while confirming the BLE communication state of the camera without immediately starting normal operation, and the power is turned off as necessary. By performing the above, there is a function of suppressing unnecessary processing of the camera. That is, the communication system S according to the present embodiment has a function of preventing a useless activation process from being performed only when the camera shifts to a normal operation only by an intentional operation such as when the camera is activated from a smartphone. .

  Conventionally, the HW configuration makes it possible to maintain the BLE connection even when the camera is turned off. Further, when the camera is in the power-off state while utilizing BLE, various events of BLE can be detected by the BLE HW, and the camera can be turned on as a factor. However, since it can be activated due to various factors such as BLE disconnection, connection, BLE Read / Write request from a smartphone as a factor when starting up with BLE, simply turn on the camera power supply normally for all factors If this happens, extra processing will be performed, which is disadvantageous in terms of power. Also, when the camera is activated by BLE, it is difficult to leave information on which BLE event was activated. (Because the camera is powered off, the contents of the BLE connection cannot be left in the RAM or the like.)

Therefore, the communication system S of the present embodiment performs an operation as shown in FIG. FIG. 31 is a flowchart for explaining the camera activation mode determination processing by BLE communication. As [Prerequisite], when the BLE of the camera is advertised or connected, it is necessary to set the BLE module to Sleep, turn off the camera, and turn off the power while maintaining the BLE output. It becomes.
1) The camera is activated by a certain BLE event.
At this time, only the fact that the camera is awakened due to the BLE factor can be grasped as the activation factor.
2) The camera performs dedicated activation in the BLE activation standby state (only the LED is lit).
Restart BLE to advertise and start timer (5 seconds).
If there is no BLE connection within the timer (5 seconds), it is determined as a BLE disconnection event.
The BLE sleep is set as it is to power off the camera.
→ PowerOff [1]
3) If there is a BLE connection within the time of the timer, the timer is deleted and the next processing is performed.
A timer is started again after completion of the BLE connection process (5 seconds).
If there is no Wi-Fi connection request by the BLE signal within the timer (5 seconds), Sleep is set in this state to power off the camera.
4) When the BLE signal is notified within the timer time, it is determined that the smartphone is intentionally activated and the camera is activated in the Wi-Fi mode.

  That is, the mode determination process is started by an operation for starting the mode determination process to the input unit 17-1 by the user.

  In step S1711, the communication control unit 173 controls the first communication unit 20-1 so that it is in BLE sleep (advanced or connected).

  In step S1712, the communication control unit 173 controls the first communication unit 20-1 to generate a BLE event (connection / disconnection / WiFi mode activation).

  In step S1713, the CPU 11 performs camera activation processing (minimum necessary processing).

  In step S1714, the communication control unit 173 controls the first communication unit 20-1 to perform the BLE open process (BLE connection waiting timer setting).

In step S1715, the communication control unit 173 determines whether it is waiting for a timer.
If the timer is waiting, YES is determined in step S1715, and the process proceeds to step S1716.
On the other hand, if not waiting for the timer, NO is determined in step S1715, and the process proceeds to step S1718.

  In step S1716, the communication control unit 173 performs a BLE connection process (a timer for waiting for a request from the portable terminal 2).

In step S1717, the communication control unit 173 determines whether or not the timer is waiting.
If the timer is waiting, YES is determined in step S1717, and the process advances to step S1719.
On the other hand, if not waiting for the timer, NO is determined in step S1717, and the process proceeds to step S1718.

  In step S1718, the CPU 11 performs BLE Sleep processing and turns off the camera power. Thereafter, the mode determination process ends.

  In step S1719, the communication control unit 173 controls the second communication unit 21-1 so as to execute the WiFi activation process.

  In step S1720, the communication control unit 173 controls the second communication unit 21-1 to execute a WiFi connection process with the mobile terminal 2.

  In step S1721, the CPU 11 performs control to activate the NET mode (remote shooting, view a photograph, etc.) in the portable terminal designation mode. Thereafter, the mode determination process ends.

  Therefore, in the communication system S of the present embodiment, it is possible to suppress battery consumption of the camera processing due to the BLE event as much as possible by performing only the minimum necessary processing when the camera is awakened by the BLE event. .

<Modification>
If it is determined that the activation is due to the disconnection of BLE, a process for reducing power consumption may be added by changing a setting such as increasing the interval of advertising.

The communication system S configured as described above has the following configuration.
A wireless communication system in which a plurality of devices having different roles perform predetermined cooperation processing by performing wireless communication, and specifies a combination of a plurality of devices to be subjected to predetermined cooperation processing based on a user operation, A pairing unit that executes pairing processing for storing pairing information indicating a combination in each device is provided.
The first device responds to the advertising signal sending means for sending an advertising signal, which is a signal for informing other devices of the existence of the device itself and the function provided by itself, and the pairing information stored by the pairing means. Advertising signal control means for changing a self-identification name included in the advertising signal.
The second device detects the advertising signal sent by the advertising signal sending means, and when it is sending from the device that provides the function related to the predetermined linkage processing, establishes communication connection with the device. Connection for controlling whether to establish a communication connection with the device that detected the advertising signal based on the connection means to be established, and the pairing information stored by the pairing means and the change state of the identification name included in the advertising signal Control means.
As a result, in the communication system S, when a plurality of devices are connected for communication using wireless communication, it is possible to prevent unintended devices from being erroneously connected to each other and to perform appropriate communication connection. Can do.

The first device is an imaging device having a photographing function, and the second device is an information terminal having a display function.
The predetermined linkage process is a process for transmitting and displaying image data captured by the imaging apparatus to the information terminal.

Wireless communication is wireless communication based on the BLE standard.
The first device is a BLE standard peripheral, and the second device is a BLE standard central.

The advertising signal transmitting means does not transmit the advertising signal when connected to any device, and transmits the advertising signal when not connected to any device.
When the advertising signal control means is not paired with any device, the advertising signal control means sends the first advertising signal with no space added to the end of the device name included in the advertising signal, and has been paired with any device. In the state, the advertising signal transmitting means is controlled to transmit the second advertising signal with a space added to the end of the device name included in the advertising signal.

  If the connection control means detects the first advertising signal, it does not reconnect even if it is already paired with the camera that sent the first advertising signal, and if it detects the second advertising signal, Control is performed so that the camera is reconnected when paired with the camera that has transmitted the second advertising signal, and is not reconnected when not paired.

  The connection control means of the information terminal performs the pairing at the time of the pairing operation and starts the connection, and after that, when the connection is terminated with the pairing being performed, the connection is not made even if the connection becomes possible again. To control.

1st communication means by a 1st communication system, and 2nd communication means by a 2nd communication system are provided.
The advertising signal is transmitted by the first communication method.
The identification name included in the advertising signal includes identification information for identifying a device in the second communication method.
The apparatus further includes second connection control means for establishing a communication connection according to the second communication method using the device identification information included in the identification name included in the advertising signal.

The first communication method is wireless communication based on the BLE (Bluetooth Low Energy) (trademark) standard.
The second communication method is wireless communication based on the Wi-Fi standard, and the identification information is SSID.

Conventionally, when an information terminal such as a smartphone remotely controls an imaging device such as a digital camera connected (paired) via wireless communication such as Bluetooth (registered trademark), the partner device once connected (paired) When the same imaging device and the information terminal are connected (paired) again, the shooting conditions can be easily set using the stored information on the other device. A technique is known (see, for example, JP-A-2015-5889).
In general, since a battery is consumed in a state where a wireless communication connection is established, control is performed to disconnect the connection as much as possible when communication is not necessary. In many cases, low-power-consumption communication means such as Bluetooth Low Energy (trademark) is used.

  However, in the above-described technique, setting of shooting conditions and the like after reconnecting the same imaging device and information terminal connected in the past is facilitated, but the connection between the once connected imaging device and information terminal is disconnected. Later, if you want to reconnect the same imaging device and smartphone again, or if you want to reconnect after changing the pairing, if there are multiple connectable imaging devices or information terminals, you may mistake You may be connected or a security problem may occur. A similar problem occurs when a wireless communication connection is made using a combination of devices other than the imaging device and the information terminal.

  The present embodiment has been made in view of such a situation, and prevents unintended devices from being erroneously connected to each other when a plurality of devices are connected for communication using wireless communication. The purpose is to enable communication connection.

In the communication system configured as described above, a peripheral device that is a device that provides a predetermined function and a central device that is a device that uses the function provided by this peripheral device execute predetermined data processing. As a data processing system, the following configuration can be provided.
The peripheral device includes a first communication unit and a control unit.
In a state where no communication connection is established with any central device, the first communication unit transmits an advertising signal, which is a signal that informs other devices of the presence of itself and the function provided by itself, by broadcast communication. Communication control by the first communication method that maintains a communication connection by establishing a communication connection with the central device that has responded to the advertising signal and periodically communicating with the central device that has established the communication connection. I do.
The control unit executes predetermined data processing in cooperation with the central device.
The central device includes a first communication unit and a control unit.
The first communication unit detects an advertising signal transmitted by the peripheral device, and establishes communication connection with the peripheral device by the first communication method when the function indicated by the advertising signal is a function desired by the first communication unit. Then, communication control is performed by the first communication method that maintains communication connection by periodically communicating with the peripheral device that has established this communication connection.
The control unit executes predetermined data processing in cooperation with the peripheral device.
The first communication unit of the peripheral device and the first communication unit of the central device regularly communicate even when the peripheral device and the central device are not in a predetermined operation state where predetermined data processing can be performed. Doing so maintains the communication connection.
When the peripheral device control unit and the central device control unit are not in the predetermined operation state, the predetermined operation is performed by transmitting and receiving a predetermined signal between the peripheral device and the central device via the first communication unit. After shifting to the state, the peripheral device and the central device are linked to start execution of predetermined data processing.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The control unit of the peripheral device and the control unit of the central device are configured so that when one of the peripheral device and the central device is not in the predetermined operation state, the device in the predetermined operation state is not applied to the device in the predetermined operation state. By transmitting and receiving a predetermined signal via the first communication unit, a device that is not in the predetermined operation state is shifted to the predetermined operation state.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The control unit of the peripheral device and the control unit of the central device shift the peripheral device and the central device to a pairing state in which any peripheral device and any central device are combined with each other. The communication connection by the first communication unit is established between the peripheral device and the peripheral device and the central device that have shifted to the pairing state, and predetermined data processing is executed.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

When the peripheral device control unit and the central device control unit establish a communication connection between the peripheral device that is not in the pairing state and the central device, the two devices are newly transferred to the pairing state. When the first communication unit is controlled to establish a communication connection on the condition that a user operation has been performed, and a communication connection is established between the peripheral device in the pairing state and the central device, The first communication unit is controlled to automatically establish a communication connection without performing a user operation.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

When the peripheral device control unit and the central device control unit establish a communication connection between the peripheral device and the central device, the pairing status of these two devices and other peripheral devices or other central devices Whether or not to establish a communication connection is determined in consideration of the pairing state of the combination.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

When transmitting the advertising signal, the control unit of the peripheral device controls the first communication unit to change a part of the advertising signal according to the pairing state.
The control unit of the central device determines whether to establish a communication connection with the peripheral device according to the pairing state and a partial change state of the advertising signal received from the peripheral device. Control the communication unit.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

When transmitting the advertising signal, the control unit of the peripheral device transmits a first advertising signal in which a part of the advertising signal is in the first state if none of the central devices is in the pairing state. When in a pairing state with the central device, the first communication unit is controlled so that a part of the advertising signal transmits a second advertising signal in a second state different from the first state.
When the control unit of the central device receives the first advertising signal from a peripheral device that is not in a pairing state, the control unit controls the first communication unit to establish a communication connection with the peripheral device and performs pairing. When a second advertising signal is received from a peripheral device that is not in the state, the first communication unit is controlled so as not to establish a communication connection with the peripheral device, and the first advertising is performed from the peripheral device in the pairing state When the signal is received, the first communication unit is controlled so as not to establish a communication connection with the peripheral device, and when the second advertising signal is received from the peripheral device in the pairing state, The first communication unit is controlled so as to establish a communication connection with the peripheral device.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The control unit of the peripheral device and the control unit of the central device are automatically disconnected without any user operation when the communication connection by the first communication unit is disconnected during execution of predetermined data processing. The first communication unit is controlled to re-establish communication connection.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

When reestablishing the disconnected communication connection, the control unit of the peripheral device controls the first communication unit to transmit the second advertising signal obtained by changing a part of the advertising signal.
When reestablishing the disconnected communication connection, the control unit of the central device controls the first communication unit to establish the communication connection on condition that the second advertising signal is received.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The peripheral device is an imaging device having a photographing function.
The central device is an information terminal having an image management function.
The predetermined data processing is processing for transmitting an image captured by the imaging device to the information terminal and managing the transmitted image at the information terminal.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The control unit of the information terminal shifts the image management program necessary for execution of the predetermined data processing to the execution stop state in which the execution is temporarily stopped while maintaining the communication connection by the first communication unit. When a predetermined signal is received via the first communication unit, the image management program in the execution stop state is shifted to the execution state, and an image transmitted from the imaging apparatus is received by the image management program shifted to the execution state. Process to manage.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

When the automatic transmission mode is set when shooting is performed, the control unit of the imaging apparatus transmits a predetermined signal to the information terminal via the first communication unit, and the information terminal stores the image management program. After shifting to the execution state, a process of automatically transmitting the captured image to the information terminal is executed.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The peripheral device is an imaging device having a photographing function.
The central device is an information terminal having an operation function and a display function.
The predetermined data processing is processing for remotely operating the photographing function of the imaging device in accordance with the operation of the information terminal.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The control unit of the image pickup device turns on the power when the communication connection by the first communication unit is maintained, the power is turned off, and a predetermined signal is received from the information terminal via the first communication unit. The process related to the imaging function is executed in response to a remote operation from the information terminal in a state where the power is turned on.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The control unit of the information terminal transmits a predetermined signal to the imaging device via the first communication unit and turns on the power of the imaging device when a user operation is performed in the state where the remote operation mode is set. After shifting to the state, a process of remotely operating the imaging function of the imaging apparatus is executed.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The control unit of the information terminal transmits a predetermined signal designating an operation mode at the time of activation to the imaging device via the first communication unit.
When the control unit of the imaging apparatus receives a predetermined signal designating the operation mode at the time of activation from the information terminal via the first communication unit, the control unit shifts the power to the on state and shifts to the designated operation mode. .
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The peripheral device and the central device can perform data communication at a higher speed than the first communication method, but perform communication control by the second communication method in which communication is not possible when the peripheral device and the central device are not in a predetermined operation state. A second communication unit is further provided.
The predetermined data processing is processing for performing data communication by the second communication method between the peripheral device and the central device via the second communication unit.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The first communication unit has lower power saving for maintaining communication connection than the second communication unit.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The control unit of the peripheral device and the control unit of the central device send a predetermined signal via the first communication unit to a device that is not in an operation state in which data communication can be performed by the second communication unit among the peripheral device and the central device. , The data communication by the second communication unit is started between the peripheral device and the central device after shifting to an operation state in which data communication by the second communication unit can be performed.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

In the second communication method, connection information necessary for establishing a communication connection with an arbitrary device is set, and a communication connection is established using the set connection information.
The control unit of the peripheral device prohibits connection information setting change in a state where the communication connection by the first communication unit is established.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

When the control unit of the imaging apparatus receives a signal via the first communication unit, the control unit shifts the power supply to the on state on condition that the signal is an intentional activation request signal from the information terminal in the pairing state. .
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The control unit of the peripheral device and the control unit of the central device execute the predetermined data processing because either the peripheral device or the central device is not in the predetermined operation state during execution of the predetermined data processing. Device that is not in the predetermined operation state by transmitting a predetermined signal via the first communication unit to the device that is no longer in the predetermined operation state when the device is interrupted Then, the execution of the interrupted predetermined data processing is resumed.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The control unit of the information terminal executes the image management program in the background while maintaining the communication connection by the first communication unit, and continues the image management program beyond the time limit for background execution defined by the operating system. When it is executed automatically, the image management program is shifted to the execution stop state.
The control unit of the imaging apparatus performs predetermined data processing due to the information terminal shifting the image management program to the execution stop state due to a time limit of background execution by the operating system during execution of predetermined data processing. Each time the execution of is interrupted, a predetermined signal is transmitted via the first communication unit, and the image management program in the execution stop state is shifted to the execution state to execute the predetermined data processing that has been interrupted. Let it resume.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The predetermined operation state is a state where the power is on, a program for executing predetermined data processing is operating, and communication by the second communication method by the second communication unit is possible. is there.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The peripheral device changes the interval time for monitoring whether or not the communication connection is maintained by the first communication unit depending on whether the power supply of the peripheral device is on or off.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The first communication method is wireless communication based on the BLE (Bluetooth Low Energy) (trademark) standard.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The communication system is a data processing system in which a first device that provides a predetermined function and a second device that uses the function provided by the first device cooperate to execute predetermined data processing.
The data processing system includes an execution unit, a communication control unit, a pairing unit, and a control unit.
The execution unit executes predetermined data processing in cooperation between the first device and the second device.
The communication control unit establishes a communication connection between the first device and the second device, and enters a predetermined operation state in which the first device and the second device that have established the communication connection can execute predetermined data processing. Even if not, the communication connection is maintained between the first device and the second device.
The pairing unit shifts the first device and the second device to a pairing state in which the first device and the second device are combined with each other.
The control unit transmits and receives a predetermined signal by the communication control unit between the first device and the second device when the first device and the second device that have entered the pairing state are not in the predetermined operation state. By doing so, the state is shifted to a predetermined operation state.
The execution unit causes the first device and the second device to transition to the pairing state, and then starts execution of predetermined data processing by linking the first device and the second device.
When establishing a communication connection between the first device and the second device, the communication control unit pairs the paired state of the two devices with a combination of the other first device or the other second device. Whether or not to establish a communication connection is determined in consideration of the ring state.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The communication system is a data processing device that functions as a central device that executes predetermined data processing in cooperation with a peripheral device that provides a predetermined function.
The data processing device includes a first communication unit and a control unit.
The first communication unit detects an advertising signal transmitted by the peripheral device, and establishes communication connection with the peripheral device by the first communication method when the function indicated by the advertising signal is a function desired by the first communication unit. Then, communication control is performed by the first communication method that maintains communication connection by periodically communicating with the peripheral device that has established this communication connection.
The control unit executes predetermined data processing in cooperation with the peripheral device.
The first communication unit maintains communication connection by performing regular communication even when the peripheral device and the central device are not in a predetermined operation state in which predetermined data processing can be performed.
The control unit transmits the predetermined signal via the first communication unit between the peripheral device and the central device when the control unit is not in the predetermined operation state, and then shifts to the predetermined operation state. And start execution of predetermined data processing.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

The communication system is a data processing device that functions as a peripheral device that provides a predetermined function and executes predetermined data processing in cooperation with a central device that uses the function.
The data processing device includes a first communication unit and a control unit.
In a state where no communication connection is established with any central device, the first communication unit transmits an advertising signal, which is a signal that informs other devices of the presence of itself and the function provided by itself, by broadcast communication. Communication control by the first communication method that maintains a communication connection by establishing a communication connection with the central device that has responded to the advertising signal and periodically communicating with the central device that has established the communication connection. I do.
The control unit executes predetermined data processing in cooperation with the central device.
The first communication unit maintains communication connection by performing regular communication even when the peripheral device and the central device are not in a predetermined operation state in which predetermined data processing can be performed.
The control unit transmits the predetermined signal via the first communication unit between the peripheral device and the central device when the control unit is not in the predetermined operating state, and then shifts the central device to the predetermined operating state. And start execution of predetermined data processing.
Therefore, in each data processing system, it is possible to effectively operate a plurality of devices in cooperation with each other by effectively using communication characteristics or OS functions (or satisfying the rules) under each constraint.

In the communication system configured as described above, data is exchanged between a plurality of devices.
In addition, the communication system is configured to register communication destinations between apparatuses that perform communication.
In the communication system, a predetermined communication procedure for communicating predetermined information is performed, the communication connection state is established and the communication connection state is established. Intermittent periodic communication is performed at predetermined intervals in the communication connection state. While the communication is maintained, the communication connection state is maintained, and when the regular communication is interrupted, the communication connection state is canceled, and in the state where the communication connection state is released, the communication connection state is shifted again. Whether to shift to the communication connection state is controlled according to the change state of the content of the predetermined information transmitted at the time and the presence or absence of the registered communication destination.
Therefore, in each communication system, it is possible to effectively use a communication characteristic or an OS function (or satisfy a rule) and operate a plurality of devices in cooperation with each other under each restriction.

In the communication system, one device detects the advertising signal of the other device, and determines whether or not there is a connection according to the registration state of the communication destination between the devices and the change state of the device name included in the advertising signal. Control.
Therefore, in the communication system, under the respective constraints, the communication system can effectively utilize the communication characteristics or the OS function (or satisfy the rules), and more effectively operate a plurality of devices in cooperation with each other. .

In the communication system, the application is configured to operate in the background so that data can be transferred.
In addition, in the communication system, whenever data transfer operation in the background of the application in the other device is interrupted by the control of the OS (Operating System) during the data transfer from one device to the other device, The application that has been transferring data from one device to the other device is activated to resume the interrupted data transfer.
Therefore, in the communication system, under the respective constraints, the communication system can effectively utilize the communication characteristics or the OS function (or satisfy the rules), and more effectively operate a plurality of devices in cooperation with each other. .

In the communication system, the communication connection state is monitored at a predetermined timing.
Further, in the communication system, the monitoring connection time of the communication connection state is changed according to whether the power supply of the device to be monitored is ON or OFF.
Therefore, in the communication system, under the respective constraints, the communication system can effectively utilize the communication characteristics or the OS function (or satisfy the rules), and more effectively operate a plurality of devices in cooperation with each other. .

Also, in the communication system, in the state where the communication destination is registered between the devices, when a communication event occurs in one device, on the condition that it is an intentional request from the other device, Turn on the power of the one device.
Therefore, in each communication system, it is possible to effectively use a communication characteristic or an OS function (or satisfy a rule) and operate a plurality of devices in cooperation with each other under each restriction.

The communication system is configured to perform communication using a plurality of different communication methods.
In the communication system, the first communication method and the second communication method different from the first communication method are linked so that one device and the other device can be connected to each other. Predetermined control is performed by operation from the apparatus.
Therefore, in the communication system, under the respective constraints, the communication system can effectively utilize the communication characteristics or the OS function (or satisfy the rules), and more effectively operate a plurality of devices in cooperation with each other. .

In the communication system, image transmission requests are exchanged using communication using the second communication method, and image transmission is performed using communication using the first communication method.
Therefore, in each communication system, it is possible to effectively use a communication characteristic or an OS function (or satisfy a rule) and operate a plurality of devices in cooperation with each other under each restriction.

Further, in the communication system, in the state where the communication destination of the communication in the second communication method is registered, the communication setting change in the first communication method is prohibited.
Therefore, in the communication system, under the respective constraints, the communication system can effectively utilize the communication characteristics or the OS function (or satisfy the rules), and more effectively operate a plurality of devices in cooperation with each other. .

The communication device configured as described above includes pairing means, communication means, and control means.
The communication control unit 51 (pairing means) registers a communication partner.
Further, the communication control unit 51 (communication means) shifts to a communication connection state in which a communication connection with the registered communication partner is established by a predetermined communication procedure for communicating predetermined information, and at a predetermined interval in the communication connection state. The first communication is performed so that the communication connection state is maintained while intermittent periodic communication is performed and the periodic communication is maintained, and the communication connection state is released when the periodic communication is interrupted. The unit 20-1 is controlled.
In addition, the communication control unit 51 (control unit), in the state where the communication connection state is released, again changes the content of the predetermined information transmitted when shifting to the communication connection state, the presence or absence of the registered communication destination In response to this, the communication connection is controlled.
Therefore, in the imaging device 1 (communication device), in the communication system, under the respective restrictions, the communication characteristics or the OS function is effectively utilized (or the rules are satisfied), and a plurality of devices are linked more effectively. It can be operated.

In addition, there are the following as preconditions of the embodiment described above.
-With Wi-Fi communication, multiple devices that can be connected to a single device at the same time are possible, and Wi-Fi communication is used while sharing multiple applications. For example, eight mobile terminals 2 that are PCs or smartphones can be connected to the AP of the imaging device 1 that is a camera, and images of the imaging device 1 that is a camera can be referred to at the same time.
In the present embodiment, the AP (imaging device 1 that is a camera) that can be connected simultaneously from the mobile terminal 2 that is a smartphone is configured as only one unit.

-In Wi-Fi communication, each application is not guaranteed to maintain a data communication connection when it is running in the background.
On the other hand, in BLE communication, there can be a plurality of counterparts capable of simultaneous communication connection with one device. Specifically, a central can connect multiple peripherals, but a peripheral is configured to connect to only one central.
In BLE communication, each application can monopolize its own communication connection. That is, there is one physical connection of BLE, and the original logical connection can be monopolized by sharing the physical connection.

In addition, in BLE communication, each application can maintain a communication connection under a predetermined condition even when it is executed in the background.
The predetermined condition is that intermittent communication performed every predetermined interval interval in order to maintain communication connection is continued.
・ When this condition is not met, for example, when the radio wave condition deteriorates due to the distance between devices being separated, or when the iOS is forced to run in the background to free up CPU power and memory area to other applications. There are cases where the operation of an application performing BLE communication is interrupted. That is, when the distance is long, the physical connection is disconnected, but when the operation of the application is interrupted, the physical connection is maintained and the data communication by the logical connection is interrupted.

The portable terminal 2 that is a smartphone can execute a plurality of application software including application software not related to the present embodiment.
-When the application related to this embodiment is executing Wi-Fi communication in the background while another application not related to this embodiment starts Wi-Fi communication in the foreground, the mobile terminal 2 that is a smartphone The Wi-Fi communication of the application related to the embodiment may be interrupted. When an application is executing Wi-Fi communication (data communication) in the background and another application starts Wi-Fi communication in the foreground, the Wi-Fi communication of the background application is necessarily interrupted. Instead, for example, in the case of iOS, data communication can be continued in the background within the time limit.

-When the application related to the present embodiment is in the background and the BLE communication with the paired partner is performed, the other application not related to the present embodiment is in the foreground. It is also possible to configure so as not to start BLE communication with other parties. Note that it is possible for an irrelevant application to perform BLE communication.

-The continuous connectivity of BLE communication when compared with Wi-Fi communication in this embodiment has two meanings.
One is that the communication connection is maintained even in the low power consumption state while the predetermined condition is satisfied.
・ The other is that even if the communication connection is interrupted due to failure to satisfy the predetermined conditions, it is easy to re-establish with the same partner unless the connection partner (a concept that is slightly different from pairing) is changed. It means that you can connect.
Note that general BLE pairing refers to establishment of a BLE connection, but in addition to establishing a BLE connection, pairing of the imaging device 1 that is a camera allows the application of the mobile terminal 2 that is a smartphone to set the BD address of the camera. Recording and establishing a Wi-Fi connection once (in the case of iOS, registration of a Wi-Fi profile). The application of the mobile terminal 2 that is a smartphone stores the BD address, so that it can be connected to the camera that was connected before when reconnecting after BLE disconnection.

-OS of the portable terminal 2 which is a smart phone carries the version 8 of iOS which operate | moves under the restrictions mentioned above, for example.

-In this embodiment, since it is based on the above-mentioned premise, in Wi-Fi communication, it is possible to configure so that a communication partner cannot be registered (paired) in advance in BLE communication. Can be configured so that the communication partner is fixedly registered (paired) in advance. When power consumption is not taken into consideration, it can be configured to always connect Wi-Fi, and can be configured to store a partner to which Wi-Fi is connected in an application.
The advantage of using BLE is that the user operation during Wi-Fi connection can be simplified, the input of SSID and PW is unnecessary, and the operation of either the imaging device 1 that is a camera or the mobile terminal 2 that is a smartphone. A Wi-Fi connection can be established.

In the embodiment configured as described above, the BLE communication is an operation for enabling communication with low power consumption. The advertising signal of the peripheral (imaging device 1 that is a camera) is sent to the central (portable terminal that is a smartphone). 2) detects and starts the connection, and after the connection is started, intermittent communication is performed while the communication power supply is repeatedly turned on and off at predetermined intervals.
As a rule (restriction) of such BLE communication, the communication connection state is maintained while communication for each predetermined interval time is continued, but communication for every predetermined interval time cannot be performed for some reason. In the case of failure, the communication connection state is canceled. When the connection state of communication is released, in order to reconnect, it is necessary to start again with advertising of the peripheral (imaging device 1 that is a camera) and scanning of the central (portable terminal 2 that is a smartphone).
Some factors mentioned here include, for example, a weakened radio wave due to a distance between devices, or a limitation of the OS (operating system) of the device.
For example, in the case of iOS, each application can communicate with the BLE device in the background execution. However, since other applications share the CPU power and memory, the time that can be continuously operated is set. The connection is interrupted even when BLE communication is being executed.

For this reason, in the above-described embodiment, for example, in the case of assuming an OS, when a plurality of devices are operated in a coordinated manner, a coordinated operation is performed more effectively using a plurality of application software. The purpose is that.
Further, in the above-described embodiment, for example, when BLE is assumed, when a plurality of devices are operated in cooperation, the cooperative operation is more effectively performed using low power consumption communication. The purpose is that.

  Specifically, in the above-described embodiment, by linking BLE and Wi-Fi, the imaging device 1 that is a camera moves from the imaging device 1 that is a camera to the mobile terminal 2 that is a smartphone, and the imaging device 1 that is a camera from the mobile terminal 2 that is a smartphone. Then, the activation and control of the other are performed by only one operation.

  In the above-described embodiment, image transmission requests are exchanged using BLE communication, and actual image transmission is performed using Wi-Fi communication.

  In the above-described embodiment, when the captured image is automatically registered in the cloud album via the mobile terminal 2 that is a smartphone simply by shooting with the imaging device 1 that is a camera, the OS type of the mobile terminal 2 that is a smartphone is used. Change the behavior of the app accordingly.

  Further, in the above-described embodiment, when the captured image is automatically registered in the cloud album via the mobile terminal 2 that is a smartphone simply by photographing with the imaging device 1 that is a camera, the mobile terminal 2 that is a smartphone is set in advance. You can automatically register to the cloud album under the conditions you have set.

  In the above-described embodiment, since the mobile terminal 2 that is a smartphone cannot cooperate with another application that is activated in the background, the mobile terminal 2 activates another application by BLE via the imaging device 1 that is a cameraman.

  Further, in the above-described embodiment, when the captured image is automatically registered in the cloud album through the mobile terminal 2 that is a smartphone simply by photographing with the imaging device 1 that is a camera, the album to be registered in advance is the cameran. The selection is made on the imaging device 1 side, and this selection information is stored in the mobile terminal 2 that is a smartphone.

  Moreover, in embodiment mentioned above, the portable terminal 2 which is a smart phone detects the advertising signal of the imaging device 1 which is a cameraman, and performs the BLE connection (reconnection), and the device included in the pairing state and the advertising signal The presence or absence of connection is controlled according to the name change state.

  Further, in the above-described embodiment, the imaging device 1 that is a cameraman each time the background operation of the application is interrupted by the control of the IOS during the data transfer from the imaging device 1 that is a cameraman to the mobile terminal 2 that is a smartphone. Then, the application is started again by BLE to resume the interrupted data transfer.

  In the above-described embodiment, the imaging device 1 that is a cameraman changes the interval time of BLE connection monitoring depending on whether the power supply of the imaging device 1 is ON or OFF.

  In the above-described embodiment, the imaging device 1 that is a cameraman prohibits Wi-Fi setting change in a state where BLE pairing is established.

  In the above-described embodiment, the imaging device 1 that is a cameraman is an intentional request from the mobile terminal 2 that is a smartphone when a BLE event occurs in a state where BLE pairing is established. On the condition, the power supply of the imaging device 1 that is a camera is turned on.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

  In the above-described embodiment, the external device has been described as the mobile terminal 2 configured with a smartphone. However, the external device is not limited to this, and for example, an electronic device such as a tablet terminal, a PC (Personal Computer), another digital camera, Alternatively, a server may be used. Further, the communication method may be NFC (Near Field Communication) of near field communication, other wireless communication such as a public line, more wired, and a plurality of transmission destinations or via a network such as the Internet.

In the above-described embodiment, the imaging apparatus 1 to which the present invention is applied is described as an example of a digital camera and the mobile terminal 2 is a smartphone. However, the present invention is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having the processing functions described above. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only configured by the removable medium 31 of FIG. 3 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in this. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray (registered trademark) Disc (Blu-ray Disc), and the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preinstalled in the apparatus main body includes, for example, the ROM 12 in FIG. 3 in which the program is recorded, the hard disk included in the storage unit 19 in FIG.

In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.
Further, in the present specification, the term “system” means an overall device configured by a plurality of devices, a plurality of means, and the like.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
A data processing system in which a peripheral device that is a device that provides a predetermined function and a central device that is a device that uses a function provided by the peripheral device perform predetermined data processing in cooperation with each other,
The peripheral device is
In a state where no communication connection has been established with any of the central devices, an advertising signal, which is a signal that informs other devices of the existence of itself and the functions provided by itself, is transmitted by broadcast communication, and has responded to this advertising signal. A first communication unit that establishes a communication connection with a central device and performs communication control by a first communication method that maintains communication connection by periodically communicating with the central device that has established the communication connection. When,
A control unit that executes the predetermined data processing in cooperation with the central device;
With
The central device is
An advertising signal transmitted by the peripheral device is detected, and when the function indicated by the advertising signal is a function desired by the peripheral device, a communication connection is established with the peripheral device by the first communication method, and the communication connection is established. A first communication unit that performs communication control according to the first communication method to maintain communication connection by periodically communicating with peripheral devices that have established
A control unit that executes the predetermined data processing in cooperation with the peripheral device;
With
The first communication unit of the peripheral device and the first communication unit of the central device are:
Even when the peripheral device and the central device are not in a predetermined operation state capable of executing the predetermined data processing, the communication connection is periodically maintained to maintain the communication connection,
The control unit of the peripheral device and the control unit of the central device,
When the peripheral device is not in the predetermined operation state, the peripheral device is transferred to the predetermined operation state by transmitting and receiving a predetermined signal via the first communication unit between the peripheral device and the central device, and then the peripheral device Linking the device and the central device to start execution of the predetermined data processing;
A data processing system characterized by that.
[Appendix 2]
The control unit of the peripheral device and the control unit of the central device,
When any one of the peripheral device and the central device is not in the predetermined operation state, the device in the predetermined operation state is connected to the device not in the predetermined operation state via the first communication unit. A device that is not in the predetermined operation state is transferred to the predetermined operation state by transmitting and receiving a predetermined signal;
The data processing system according to appendix 1, wherein
[Appendix 3]
The control unit of the peripheral device and the control unit of the central device,
Move any peripheral device and any central device to the pairing state that is a combination of each other,
Establishing a communication connection by the first communication unit between the peripheral device and the central device that have transitioned to the pairing state,
Executing the predetermined data processing in cooperation with the peripheral device and the central device transferred to the pairing state;
The data processing system according to appendix 1 or 2, characterized by the above.
[Appendix 4]
The control unit of the peripheral device and the control unit of the central device,
When establishing a communication connection between the peripheral device that is not in the pairing state and the central device, it is provided that a user operation for newly shifting the two devices to the pairing state has been performed. When the first communication unit is controlled to establish a communication connection as follows, and the communication connection is established between the peripheral device and the central device in the pairing state, it is automatically performed without performing a user operation. Controlling the first communication unit to establish a communication connection automatically,
The data processing system according to supplementary note 3, wherein
[Appendix 5]
The control unit of the peripheral device and the control unit of the central device,
When establishing a communication connection between the peripheral device and the central device, consider the pairing state of the two devices and the pairing state of the combination of the other peripheral device or other central device. To determine whether to establish a communication connection,
The data processing system according to appendix 3 or 4, characterized by the above.
[Appendix 6]
The control unit of the peripheral device is
When transmitting the advertising signal, the first communication unit is controlled to change a part of the advertising signal according to the pairing state,
The control unit of the central device is
The first communication unit is configured to determine whether to establish a communication connection with the peripheral device according to the pairing state and a change state of a part of the advertising signal received from the peripheral device. Control,
The data processing system according to supplementary note 5, wherein
[Appendix 7]
The control unit of the peripheral device is
If any central device is not in the pairing state when transmitting the advertising signal, the first advertising signal in which a part of the advertising signal is in the first state is transmitted, Control the first communication unit so that a part of the advertising signal transmits a second advertising signal in a second state different from the first state when the pairing state is in between
The control unit of the central device is
When the first advertising signal is received from a peripheral device that is not in the pairing state, the first communication unit is controlled to establish a communication connection with the peripheral device,
When the second advertising signal is received from a peripheral device that is not in the pairing state, the first communication unit is controlled not to establish a communication connection with the peripheral device,
When the first advertising signal is received from the peripheral device in the pairing state, the first communication unit is controlled not to establish a communication connection with the peripheral device,
When the second advertising signal is received from the peripheral device in the pairing state, the first communication unit is controlled to establish a communication connection with the peripheral device.
The data processing system according to supplementary note 6, wherein:
[Appendix 8]
The control unit of the peripheral device and the control unit of the central device,
If the communication connection by the first communication unit is disconnected during the execution of the predetermined data processing, the first communication is performed so as to re-establish the communication connection automatically disconnected without performing a user operation. Control the part,
The data processing system according to any one of appendices 1 to 7, characterized in that:
[Appendix 9]
The control unit of the peripheral device is
When reestablishing a disconnected communication connection, the first communication unit is controlled to transmit a second advertising signal in which a part of the advertising signal is changed,
The control unit of the central device is
When reestablishing a disconnected communication connection, the first communication unit is controlled to establish a communication connection on condition that the second advertising signal is received.
The data processing system according to appendix 8, wherein
[Appendix 10]
The peripheral device is an imaging device having a photographing function,
The central device is an information terminal having an image management function,
The predetermined data processing is processing for transmitting an image captured by the imaging device to the information terminal and managing the transmitted image at the information terminal.
The data processing system according to any one of appendices 1 to 9, characterized in that:
[Appendix 11]
The control unit of the information terminal
In a state where the communication connection by the first communication unit is maintained, the image management program necessary for executing the predetermined data processing is shifted to an execution stop state in which execution is temporarily stopped,
When the predetermined signal is received from the imaging device via the first communication unit, the image management program in the execution stop state is shifted to the execution state,
The image management program that has shifted to the execution state executes a process for receiving and managing an image transmitted from the imaging device,
The data processing system according to supplementary note 10, wherein:
[Appendix 12]
The control unit of the imaging device includes:
When an automatic transmission mode is set when shooting is performed, a predetermined signal is transmitted to the information terminal via the first communication unit,
After the information terminal shifts the image management program to the execution state, a process of automatically transmitting a captured image to the information terminal is executed.
The data processing system according to appendix 11, characterized by the above.
[Appendix 13]
The peripheral device is an imaging device having a photographing function,
The central device is an information terminal having an operation function and a display function,
The predetermined data processing is processing for remotely operating a photographing function of the imaging device according to an operation of the information terminal.
The data processing system according to any one of appendices 1 to 9, characterized in that:
[Appendix 14]
The control unit of the imaging device includes:
With the communication connection by the first communication unit maintained, the power is turned off,
When a predetermined signal is received from the information terminal via the first communication unit, the power is turned on,
Executing processing related to the photographing function in response to a remote operation from the information terminal in a state where the power is turned on;
14. The data processing system according to appendix 13, wherein
[Appendix 15]
The control unit of the information terminal
When there is a user operation with the remote operation mode set, a predetermined signal is transmitted to the imaging device via the first communication unit,
Executing a process of remotely operating the photographing function of the imaging device after the imaging device is powered on;
15. The data processing system according to appendix 14, wherein
[Appendix 16]
The control unit of the information terminal
A predetermined signal for designating an operation mode at the time of activation is transmitted to the imaging apparatus via the first communication unit;
The control unit of the imaging device includes:
When a predetermined signal designating an operation mode at the time of activation is received from the information terminal via the first communication unit, the power is turned on and the designated operation mode is moved.
The data processing system according to appendix 14 or 15, characterized in that:
[Appendix 17]
The peripheral device and the central device are:
A second communication unit that performs communication control according to a second communication method that can perform higher-speed data communication than the first communication method, but cannot perform communication when the peripheral device and the central device are not in the predetermined operation state. Further comprising
The predetermined data processing is processing for performing data communication according to the second communication method between the peripheral device and the central device via the second communication unit.
The data processing system according to any one of appendices 1 to 16, characterized in that:
[Appendix 18]
The first communication unit has lower power saving for maintaining communication connection than the second communication unit,
Item 18. The data processing apparatus according to appendix 17, wherein
[Appendix 19]
The control unit of the peripheral device and the control unit of the central device,
By transmitting a predetermined signal via the first communication unit to a device that is not in an operation state capable of data communication by the second communication unit among the peripheral device and the central device, the second communication is performed. After transitioning to an operation state in which data communication can be performed by the unit, starting data communication by the second communication unit between the peripheral device and the central device,
The data processing device according to appendix 17 or 18, characterized in that.
[Appendix 20]
The second communication method sets connection information necessary for establishing a communication connection with an arbitrary device, establishes a communication connection using the set connection information,
The control unit of the peripheral device is
In a state where the communication connection by the first communication unit is established, setting change of the connection information is prohibited.
The data processing system according to any one of appendices 17 to 19, characterized in that:
[Appendix 21]
The control unit of the imaging device includes:
When a signal is received via the first communication unit, the power is turned on on the condition that the signal is an intentional activation request signal from the information terminal in the pairing state.
15. The data processing system according to appendix 14, wherein
[Appendix 22]
The control unit of the peripheral device and the control unit of the central device,
When execution of the predetermined data processing is interrupted due to the fact that either the peripheral device or the central device is no longer in the predetermined operation state during execution of the predetermined data processing, A device that is not in the predetermined operation state is transmitted to the device that is no longer in the predetermined operation state from the device that is in the operation state of After the transition to the state, the execution of the predetermined data processing that has been suspended is resumed.
The data processing system according to any one of appendices 1 to 21, characterized in that:
[Appendix 23]
The control unit of the information terminal
The image management program is executed in the background in a state where the communication connection by the first communication unit is maintained, and the image management program is continuously executed over the background execution time limit defined by the operating system. The image management program is shifted to the execution stop state,
The control unit of the imaging device includes:
During execution of the predetermined data processing, the information terminal executes the predetermined data processing because the information terminal has shifted the image management program to the execution stop state due to a time limit of background execution by the operating system. Each time it is interrupted, a predetermined signal is transmitted via the first communication unit to shift the image management program in the execution stopped state to the execution state, and execution of the interrupted predetermined data processing is performed. To resume,
13. The data processing system according to appendix 11 or 12, characterized by the above.
[Appendix 24]
The predetermined operation state means that a power supply is on, a program for executing the predetermined data processing is operating, and communication by the second communication method by the second communication unit is performed. Is possible,
24. A data processing system according to any one of appendices 1 to 23, wherein:
[Appendix 25]
The peripheral device is
Changing the interval time for monitoring whether or not the communication connection is maintained by the first communication unit, depending on whether its own power supply is on or off;
25. A data processing system according to any one of appendices 1 to 24, wherein:
[Appendix 26]
The first communication method is wireless communication based on the BLE (Bluetooth Low Energy) standard.
26. A data processing system according to any one of appendices 1 to 25, wherein:
[Appendix 27]
A data processing system in which a first device that provides a predetermined function and a second device that uses a function provided by the first device cooperate to execute predetermined data processing,
An execution unit that executes the predetermined data processing in cooperation between the first device and the second device;
A communication connection is established between the first device and the second device, and the first device and the second device that have established the communication connection are in a predetermined operation state in which the predetermined data processing can be performed. A communication control unit that maintains a communication connection between the first device and the second device, even if not,
A pairing unit for shifting to a pairing state in which the first device and the second device are combined with each other;
When the first device and the second device that have shifted to the pairing state are not in the predetermined operation state, a predetermined signal is transmitted by the communication control unit between the first device and the second device. A control unit that shifts to the predetermined operation state by transmitting and receiving; and
With
The execution unit causes the first device and the second device to cooperate with each other after the first device and the second device are shifted to the pairing state, and starts execution of the predetermined data processing.
When the communication control unit establishes a communication connection between the first device and the second device, the pairing state of the two devices and the other first device or the other second device Determine whether to establish a communication connection in consideration of the pairing state of the combination with
A data processing system characterized by that.
[Appendix 28]
A data processing device that functions as a central device that executes predetermined data processing in cooperation with a peripheral device that provides a predetermined function,
An advertising signal transmitted by the peripheral device is detected, and when the function indicated by the advertising signal is a function desired by the peripheral device, a communication connection is established with the peripheral device by the first communication method, and the communication connection is established. A first communication unit that performs communication control according to the first communication method to maintain communication connection by periodically communicating with peripheral devices that have established
A control unit that executes the predetermined data processing in cooperation with the peripheral device;
With
The first communication unit is
Even when the peripheral device and the central device are not in a predetermined operation state capable of executing the predetermined data processing, the communication connection is periodically maintained to maintain the communication connection,
The controller is
In a case where the predetermined operation state is not established, after the peripheral device and the central device transmit a predetermined signal via the first communication unit, the transition to the predetermined operation state is performed. Start execution of the predetermined data processing in cooperation with a peripheral device;
A data processing apparatus.
[Appendix 29]
A data processing device that functions as a peripheral device that provides a predetermined function and executes predetermined data processing in cooperation with a central device that uses the function,
In a state where no communication connection has been established with any of the central devices, an advertising signal, which is a signal that informs other devices of the existence of itself and the functions provided by itself, is transmitted by broadcast communication, and has responded to this advertising signal. A first communication unit that establishes a communication connection with a central device and performs communication control by a first communication method that maintains communication connection by periodically communicating with the central device that has established the communication connection. When,
A control unit that executes the predetermined data processing in cooperation with the central device;
With
The first communication unit is
Even when the peripheral device and the central device are not in a predetermined operation state capable of executing the predetermined data processing, the communication connection is periodically maintained to maintain the communication connection,
The controller is
In a case where the predetermined operation state is not established, after the peripheral device and the central device transmit a predetermined signal via the first communication unit, the transition to the predetermined operation state is performed. In cooperation with a central device, the execution of the predetermined data processing is started.
A data processing apparatus.
[Appendix 30]
A data processing method executed by a data processing system in which a peripheral device that is a device that provides a predetermined function and a central device that is a device that uses a function provided by the peripheral device perform predetermined data processing Because
In the peripheral device,
In a state where no communication connection has been established with any of the central devices, an advertising signal, which is a signal that informs other devices of the existence of itself and the functions provided by itself, is transmitted by broadcast communication, and has responded to this advertising signal. A first communication step of performing communication control by a first communication method that establishes a communication connection with a central device and maintains communication connection by periodically communicating with the central device that has established the communication connection. When,
A control step of executing the predetermined data processing in cooperation with the central device;
Including
In the central device,
An advertising signal transmitted by the peripheral device is detected, and when the function indicated by the advertising signal is a function desired by the peripheral device, a communication connection is established with the peripheral device by the first communication method, and the communication connection is established. A first communication step of performing communication control by the first communication method for maintaining communication connection by periodically communicating with peripheral devices that have established
A control step of executing the predetermined data processing in cooperation with the peripheral device;
Including
The first communication step in the peripheral device and the first communication step in the central device are:
Even when the peripheral device and the central device are not in a predetermined operation state capable of executing the predetermined data processing, the communication connection is periodically maintained to maintain the communication connection,
The control step in the peripheral device, and the control step in the central device,
When the peripheral device is not in the predetermined operation state, the peripheral device is transferred to the predetermined operation state by transmitting and receiving a predetermined signal via the first communication unit between the peripheral device and the central device, and then the peripheral device Linking the device and the central device to start execution of the predetermined data processing;
A data processing method.
[Appendix 31]
A data processing method executed by a data processing system in which a first device that provides a predetermined function and a second device that uses the function provided by the first device cooperate to execute predetermined data processing. ,
An execution step in which the first device and the second device cooperate to execute the predetermined data processing;
A communication connection is established between the first device and the second device, and the first device and the second device that have established the communication connection are in a predetermined operation state in which the predetermined data processing can be performed. A communication control step for maintaining a communication connection between the first device and the second device, even if not,
A pairing step for shifting to a pairing state in which the first device and the second device are combined with each other;
In a case where the first device and the second device that have shifted to the pairing state are not in the predetermined operation state, a predetermined signal is transmitted between the first device and the second device by the communication control step. A control step of shifting to the predetermined operating state by transmitting and receiving;
including,
In the execution step, after the first device and the second device are shifted to the pairing state, the execution of the predetermined data processing is started by linking the first device and the second device,
In the communication control step, when a communication connection is established between the first device and the second device, the pairing state of the two devices and the other first device or the other second device Determine whether to establish a communication connection in consideration of the pairing state of the combination with
A data processing method.
[Appendix 32]
A computer that controls a data processing device that functions as a central device that executes predetermined data processing in cooperation with a peripheral device that provides a predetermined function.
An advertising signal transmitted by the peripheral device is detected, and when the function indicated by the advertising signal is a function desired by the peripheral device, a communication connection is established with the peripheral device by the first communication method, and the communication connection is established. A first communication function for performing communication control by the first communication method for maintaining communication connection by periodically communicating with peripheral devices that have established
A control function for executing the predetermined data processing in cooperation with the peripheral device;
And execute
In the first communication function,
Even when the peripheral device and the central device are not in a predetermined operation state capable of executing the predetermined data processing, the communication connection is periodically maintained to maintain the communication connection,
In the control function,
In a case where the predetermined operation state is not established, after the peripheral device and the central device transmit a predetermined signal via the first communication unit, the transition to the predetermined operation state is performed. Start execution of the predetermined data processing in cooperation with a peripheral device;
A program characterized by that.
[Appendix 33]
A computer that controls a data processing device that functions as a peripheral device that provides a predetermined function and performs predetermined data processing in cooperation with a central device that uses the function.
In a state where no communication connection has been established with any of the central devices, an advertising signal, which is a signal that informs other devices of the existence of itself and the functions provided by itself, is transmitted by broadcast communication, and has responded to this advertising signal. A first communication function for performing communication control by a first communication method that establishes a communication connection with a central device and maintains communication connection by periodically communicating with the central device that has established the communication connection. When,
A control function for executing the predetermined data processing in cooperation with the central device;
And execute
In the first communication function,
Even when the peripheral device and the central device are not in a predetermined operation state capable of executing the predetermined data processing, the communication connection is periodically maintained to maintain the communication connection,
In the control function,
In a case where the predetermined operation state is not established, after the peripheral device and the central device transmit a predetermined signal via the first communication unit, the transition to the predetermined operation state is performed. In cooperation with a central device, the execution of the predetermined data processing is started.
A program characterized by that.
[Appendix 34]
A data processing system for exchanging data between a plurality of devices,
Configure the devices to communicate with each other to communicate with each other,
Perform a predetermined communication procedure to communicate predetermined information, shift to a communication connection state where communication connection is established with each other,
In the communication connection state, intermittent periodic communication is performed every predetermined interval,
While the regular communication is maintained, the communication connection state is maintained, and when the regular communication is interrupted, the communication connection state is released,
In the state in which the communication connection state is released, the communication connection state is again determined according to the change state of the content of the predetermined information transmitted when shifting to the communication connection state and the presence or absence of the registered communication destination. Control whether or not to move to
A data processing system characterized by that.
[Appendix 35]
One device detects the advertising signal of the other device, and controls the presence or absence of connection according to the registration state of the communication destination between devices and the change state of the device name included in the advertising signal.
35. A data processing system according to appendix 34, wherein
[Appendix 36]
The application is configured to work in the background to allow data transfer,
Each time the data transfer operation in the background of the application in the other device is interrupted by the control of the OS (Operating System) during the data transfer from the one device to the other device, Start the application that was performing the data transfer in the device, and resume the interrupted data transfer,
36. The data processing system according to appendix 34 or 35, wherein
[Appendix 37]
Configure to communicate with multiple different communication methods,
By linking the first communication method and the second communication method that is different from the first communication method, one device and the other device can be operated by an operation from the other device, Perform predetermined control,
37. A data processing system according to any one of appendices 34 to 36, wherein:
[Appendix 38]
Exchanging image transmission requests using communication in the second communication method, and performing image transmission using communication in the first communication method;
40. A data processing system according to appendix 39, wherein
[Appendix 39]
A pairing means for registering a communication partner;
According to a predetermined communication procedure for communicating predetermined information, a transition is made to a communication connection state in which a communication connection with the registered communication partner is established,
In the communication connection state, intermittent periodic communication is performed every predetermined interval,
While the regular communication is maintained, the communication connection state is maintained, and communication means for performing communication so that the communication connection state is canceled when the regular communication is interrupted,
In the state where the communication connection state is released, whether or not the communication connection is possible is determined according to the change state of the content of the predetermined information transmitted when shifting to the communication connection state and the presence or absence of the registered communication destination. Control means for controlling;
A data processing apparatus comprising:
[Appendix 40]
There is a data processing method executed in a data processing system for exchanging data between a plurality of devices,
Configure the devices to communicate with each other to communicate with each other,
A process of performing a predetermined communication procedure for communicating predetermined information and shifting to a communication connection state in which communication connections are established with each other;
In the communication connection state, a process of performing intermittent periodic communication every predetermined interval;
While the periodic communication is maintained, the communication connection state is maintained, and when the periodic communication is interrupted, the communication connection state is canceled, and in the state where the communication connection state is canceled, the communication is performed again. A process for controlling whether or not to shift to the communication connection state according to the change state of the content of the predetermined information transmitted when shifting to the connection state and the presence or absence of the registered communication destination;
A data processing method comprising:
[Appendix 41]
A computer that controls a data processing system that exchanges data between multiple devices.
Configure the devices to communicate with each other to communicate with each other,
A process of performing a predetermined communication procedure for communicating predetermined information and shifting to a communication connection state in which communication connections are established with each other;
In the communication connection state, a process of performing intermittent periodic communication every predetermined interval;
While the periodic communication is maintained, the communication connection state is maintained, and when the periodic communication is interrupted, the communication connection state is canceled, and in the state where the communication connection state is canceled, the communication is performed again. A process for controlling whether or not to shift to the communication connection state according to the change state of the content of the predetermined information transmitted when shifting to the connection state and the presence or absence of the registered communication destination;
A program characterized by having executed.

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 2 ... Portable terminal, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Bus, 15 ... Input / output interface, 16 ... Imaging unit, 17 ... input unit, 18 ... output unit, 19 ... storage unit, 20 ... first communication unit, 21 ... second communication unit, 22 ... drive, 31. .. Removable media, 51... Imaging control unit, 52... Communication control unit, 71... Image storage unit, 91. Storage unit 131... Application management unit 132 132 Communication control unit 151 Image storage unit 171 Pairing status determination unit 172 Advertising information generation unit 173 Communication control unit, 191... Communication information storage unit, 2 1 ... communication control unit, 212 ... pairing state determination section, 213 ... advertising information determination unit, 231 ... communication information storage unit, S ... communication system

Claims (6)

A data processing system in which a peripheral device that is a device that provides a predetermined function and a central device that is a device that uses a function provided by the peripheral device perform predetermined data processing in cooperation with each other,
Said peripheral equipment,
Sends a A Dobataijingu signal, establishes a communication connection with the central device has responded to the advertising signal, a communication connection by performing periodic communication with a central device that established this communication connection A first communication unit that performs communication control according to the first communication method to be maintained;
A control unit that executes the predetermined data processing in cooperation with the central device;
With
The central device is
Detecting the advertising signal the peripheral device transmits, prior SL establishes communication connection by the first communication method with a peripheral device, to perform a regular communication with the peripheral device that established this communication connection A first communication unit that performs communication control according to the first communication method to maintain communication connection at
A control unit that executes the predetermined data processing in cooperation with the peripheral device;
With
The control unit of the peripheral device and the control unit of the central device,
Move any peripheral device and any central device to the pairing state that is a combination of each other,
Establishing a communication connection by the first communication unit between the peripheral device and the central device that have transitioned to the pairing state,
Execute the predetermined data processing in cooperation with the peripheral device and the central device transferred to the pairing state,
The control unit of the peripheral device is
When transmitting the advertising signal, the first communication unit is controlled to change a part of the advertising signal according to the pairing state,
The control unit of the central device is
The first communication unit is configured to determine whether to establish a communication connection with the peripheral device according to the pairing state and a change state of a part of the advertising signal received from the peripheral device. Control,
A data processing system characterized by that. The control unit of the peripheral device and the control unit of the central device,
When establishing a communication connection between the peripheral device that is not in the pairing state and the central device, it is provided that a user operation for newly shifting the two devices to the pairing state has been performed. When the first communication unit is controlled to establish a communication connection as follows, and the communication connection is established between the peripheral device and the central device in the pairing state, it is automatically performed without performing a user operation. Controlling the first communication unit to establish a communication connection automatically,
The data processing system according to claim 1 . The control unit of the peripheral device is
If any central device is not in the pairing state when transmitting the advertising signal, the first advertising signal in which a part of the advertising signal is in the first state is transmitted, Control the first communication unit so that a part of the advertising signal transmits a second advertising signal in a second state different from the first state when the pairing state is in between
The control unit of the central device is
When the first advertising signal is received from a peripheral device that is not in the pairing state, the first communication unit is controlled to establish a communication connection with the peripheral device,
When the second advertising signal is received from a peripheral device that is not in the pairing state, the first communication unit is controlled not to establish a communication connection with the peripheral device,
When the first advertising signal is received from the peripheral device in the pairing state, the first communication unit is controlled not to establish a communication connection with the peripheral device,
When the second advertising signal is received from the peripheral device in the pairing state, the first communication unit is controlled to establish a communication connection with the peripheral device.
The data processing system according to claim 1 or 2 , characterized by the above. A data processing device that functions as a central device that executes predetermined data processing in cooperation with a peripheral device that provides a predetermined function,
An advertising signal transmitted by the peripheral device is detected, and when the function indicated by the advertising signal is a function desired by the peripheral device, a communication connection is established with the peripheral device by the first communication method, and the communication connection is established. A first communication unit that performs communication control according to the first communication method to maintain communication connection by periodically communicating with peripheral devices that have established
A control unit that executes the predetermined data processing in cooperation with the peripheral device;
With
The controller is
Transition to the pairing state that is combined with any peripheral device,
Establishing a communication connection by the first communication unit with the peripheral device transitioned to the pairing state,
Execute the predetermined data processing in cooperation with the peripheral device that has transitioned to the pairing state,
The first communication unit is configured to determine whether to establish a communication connection with the peripheral device according to the pairing state and a change state of a part of the advertising signal received from the peripheral device. Control,
A data processing apparatus. A data processing device that functions as a peripheral device that provides a predetermined function and executes predetermined data processing in cooperation with a central device that uses the function ,
Sends a A Dobataijingu signal, establishes a communication connection with the central device has responded to the advertising signal, a communication connection by performing periodic communication with a central device that established this communication connection A first communication unit that performs communication control according to the first communication method to be maintained;
A control unit that executes the predetermined data processing in cooperation with the central device;
With
The controller is
Move to pairing state that is combined with any central device,
Establishing a communication connection by the first communication unit with the central device that has shifted to the pairing state,
Execute the predetermined data processing in cooperation with the peripheral device and the central device transferred to the pairing state,
The data processing device , wherein when transmitting the advertising signal, the first communication unit is controlled to change a part of the advertising signal according to the pairing state . A data processing method executed by a data processing system in which a peripheral device that is a device that provides a predetermined function and a central device that is a device that uses a function provided by the peripheral device perform predetermined data processing Because
In the peripheral device ,
Sends a A Dobataijingu signal, establishes a communication connection with the central device has responded to the advertising signal, a communication connection by performing periodic communication with a central device that established this communication connection A first communication step for performing communication control by the first communication method to be maintained;
A control step of executing the predetermined data processing in cooperation with the central device;
Including
In the central device,
Detecting the advertising signal the peripheral device transmits, prior SL establishes communication connection by the first communication method with a peripheral device, to perform a regular communication with the peripheral device that established this communication connection A first communication step of performing communication control by the first communication method for maintaining communication connection at
A control step of executing the predetermined data processing in cooperation with the peripheral device;
Including
The control step of the peripheral device and the control step of the central device,
Move any peripheral device and any central device to the pairing state that is a combination of each other,
Establishing the communication connection between the peripheral device and the central device transitioned to the pairing state,
Execute the predetermined data processing in cooperation with the peripheral device and the central device transferred to the pairing state,
The control step of the peripheral device includes:
In the first communication step, when transmitting the advertising signal, the state of a part of the advertising signal is changed according to the pairing state,
The control step of the central device includes:
In the first communication step, it is determined whether to establish a communication connection with the peripheral device according to the pairing state and a change state of a part of the advertising signal received from the peripheral device.
A data processing method.

Images