KR102524304B1 - Data processing device, data processing system, data processing method, and program recorded in recording medium - Google Patents

Abstract

The communication system S exchanges data between a plurality of devices to execute predetermined functions. Further, in the communication system S, one device and the other device are connected by a plurality of different communication methods, and if the data transmission is interrupted during data transmission in the first communication method, the second By the communication method, control is performed to establish the first communication method, and data transmission in the first communication method is resumed.

Description

Data processing device, data processing system, data processing method, and program recorded on a recording medium

The present invention relates to a data processing device, a data processing system, a data processing method, and a program recorded on a recording medium, which perform predetermined data processing in conjunction with other devices.

Conventionally, when image data captured by an imaging device such as a digital camera is transmitted to a portable terminal such as a smartphone, or instruction information related to photography is transmitted from the portable terminal to the imaging device, Wi- A technique using Fi communication or bluetooth (registered trademark) communication is known (see Patent Document 1).

In recent years, it has also become possible to use the technology of BLE (Bluetooth Low Energy) (trademark), which enables communication with lower power consumption.

Each communication technology has different characteristics such as communication speed, power consumption, and ease of use, and it is necessary to perform communication according to rules (restrictions) according to each characteristic.

In addition, the portable terminal can simultaneously activate a plurality of application software under the management of an OS (Operating System).

In the OS of such a portable terminal, it is possible to start up a plurality of application software simultaneously, and even when a plurality of application software is started at the same time, in order to use the CPU and memory appropriately, each application software follows the rules of the OS. It is necessary to operate according to (constraints).

However, in the foregoing technique, it has not been possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules) and more effectively operate the imaging device and the portable terminal in tandem. The same applies to linkage between a camera and a device other than a smartphone.

Japanese Unexamined Patent Publication No. 2014-230024

The present invention has been made to solve such a problem, and under each constraint, effectively utilizes the characteristics of communication or the function of the OS (or satisfies the rules), and more effectively operates a plurality of devices in conjunction. The purpose.

One aspect of the present invention is,

A data processing device that performs predetermined data processing in conjunction with other devices, comprising:

a first communication unit that performs communication by a first communication method in which a communication connection with the other device is maintained even when the data processing device and the other device are not in a predetermined operating state capable of executing the predetermined data processing;

a second communication unit that performs communication by a second communication method in which a communication connection with the other device is maintained on condition that the predetermined operating state is present;

When data transmission with the other device is performed through the second communication unit to execute predetermined linkage processing, and the predetermined linkage processing cannot be executed due to not being in the predetermined operating state, the and a control unit that executes the predetermined linkage processing after the data processing device and the other apparatus are brought into the predetermined operating state by performing predetermined communication with the other apparatus by the first communication unit. to be characterized

In addition, another aspect of the present invention,

A data processing system in which a plurality of devices having different roles cooperate to perform predetermined data processing, comprising:

a first communication unit that performs communication by a first communication method in which a communication connection with the plurality of devices is maintained even when the plurality of devices are not in a predetermined operating state capable of executing the predetermined data processing;

a second communication unit that performs communication by a second communication method in which a communication connection with the plurality of devices is maintained on condition that the predetermined operating state is present;

When the predetermined data processing is executed by performing data transmission between the plurality of devices through the second communication unit, and the predetermined data processing cannot be executed due to not being in the predetermined operation state, , a control unit for executing predetermined data processing after the device and another device are brought into the predetermined operating state by performing predetermined communication with the other device by the first communication unit;

It is characterized by having a.

In addition, another aspect of the present invention,

In a data processing system for exchanging data between a plurality of devices and executing a predetermined function,

One device and the other device are connected by a plurality of different communication methods;

During data transmission in the first communication method, if the data transmission is interrupted, control to establish the first communication method by a second communication method, and resume data transmission in the first communication method. characterized by

1 is a system configuration diagram showing the system configuration of a communication system according to an embodiment of the present invention.
2 is a schematic diagram showing an example of data communication performed by the communication system.
Fig. 3 is a block diagram showing hardware configurations of an imaging device and portable terminal according to an embodiment of the present invention.
FIG. 4 is a functional block diagram showing a functional configuration for executing an automatic image receiving process and a mode operation process among the functional configurations of the imaging device and portable terminal of FIG. 3 .
FIG. 5 is a flowchart for explaining the flow of automatic image reception processing executed by the imaging device and mobile terminal of FIG. 3 having the functional configuration of FIG. 4;
FIG. 6 is a flowchart for explaining the flow of mode operation processing executed by the imaging device and portable terminal of FIG. 3 having the functional configuration of FIG. 4;
Fig. 7 is a schematic diagram showing display of communication status in an imaging device and portable terminal.
8 is a system configuration diagram showing the system configuration of a communication system according to an embodiment of the present invention.
FIG. 9 is a flowchart for explaining the flow of automatic image reception processing executed by the imaging device and mobile terminal of FIG. 3 having the functional configuration of FIG. 4;
FIG. 10 is a flowchart for explaining the flow of mode operation processing executed by the imaging device and mobile terminal of FIG. 3 having the functional configuration of FIG. 4;
Fig. 11 is a schematic diagram showing display of communication status in an imaging device and portable terminal.
FIG. 12 is a functional block diagram showing a functional configuration for executing image sharing processing among the functional configurations of the portable terminal and server of FIG. 3 .
FIG. 13 is a flowchart for explaining the flow of image sharing processing executed by the portable terminal and server of FIG. 3 having the functional configuration of FIG. 15;
Fig. 14 is a configuration diagram of an operation of an application in an imaging device and a portable terminal in the communication system of the present embodiment.
Fig. 15 is a flowchart showing an operation sequence in the imaging device and portable terminal in the communication system of the present embodiment.
Fig. 16 is a schematic diagram showing an album selection screen in the application.
17 is a flowchart explaining the flow of album registration processing.
18 is a flowchart explaining the flow of automatic transmission processing.
Fig. 19 is a flowchart explaining the flow of album selection processing on the camera side.
20 is a flowchart explaining the flow of image registration processing.
21 is a schematic diagram showing an example of a screen display in the imaging device.
22 is a schematic diagram showing an example of a screen display in the imaging device.
FIG. 23 is a functional block diagram showing a functional configuration for executing a pairing connection process among the functional configurations of the imaging device and portable terminal of FIG. 3 .
FIG. 24 is a flowchart for explaining the flow of pairing connection processing executed by the imaging device of FIG. 3 having the functional configuration of FIG. 29 and the portable terminal.
Fig. 25 is a flowchart for explaining another flow of pairing connection processing executed by a mobile terminal having the functional configuration of Fig. 29;
26 is a flowchart for explaining background process processing of automatic transmission.
27 is a flowchart for explaining background process processing of automatic transmission.
28 is a flowchart for explaining BLE connection parameter adaptive setting processing.
29 is a flowchart for explaining Wi-Fi setting control processing.
30 is a flowchart for explaining Menu open processing.
Fig. 31 is a flowchart for explaining a mode determination process for starting a camera by BLE communication.

EMBODIMENT OF THE INVENTION Hereinafter, embodiment of this invention is described with reference to drawings.

<First Embodiment>

1 is a system configuration diagram showing the system configuration of a communication system according to an embodiment of the present invention.

As shown in FIG. 1 , the communication system S includes an imaging device 1 having at least an imaging/communication function and a portable terminal 2 which is an information terminal having at least an image display/communication function.

In the communication system S, when the user operates either device of the imaging device 1 or portable terminal 2, the image file level is transferred from the operating device operated by the user to the other device. In a state in which a communication connection request in a communication method capable of data communication is made and a communication connection between the imaging device 1 and the portable terminal 2 is established, in accordance with the operation of the operating device, communication with the other device is established. It has a function of sending and receiving image files and viewing image data held by the other device. Further, in the present embodiment, "establishing" a communication connection means that a mutually communicating partner is designated and a predetermined procedure is performed to recognize the mutually communicating partner, and thereafter, when performing communication It is to set a state in which communication is possible at any time without carrying out a predetermined procedure every time. This state is maintained until a procedure for releasing the communication connection is performed. In addition, the state in which the communication connection is "established" is maintained even when the radio wave condition deteriorates and communication becomes temporarily impossible, or when the power of the device is turned off.

In the communication system S of the present embodiment, a communication connection between the imaging device 1 and the portable terminal 2 is established in a state where data communication is possible using two communication methods. In the communication system S, a low-speed but power-saving wireless communication method suitable for always-on connection (hereinafter referred to as "first communication method") and a high-speed wireless communication method suitable for file transmission and reception (hereinafter referred to as "first communication method") 2 communication method”) is configured to perform communication. And, in this embodiment, the 1st communication method uses the communication method according to the communication standard of bluetooth low energy/bluetooth LE (trademark) (hereinafter referred to as "BLE"). In addition, the second communication method uses a communication method according to the communication standard of Wi-Fi (Wireless Fidelity) among wireless local area networks (LANs).

Further, in the present embodiment, since Wi-Fi, which is the second communication method, consumes large amounts of power in a state in which a communication connection is established, it can be predicted that the waiting time until data transmission is performed next becomes long. If there is, power consumption is reduced by releasing the communication connection each time. In addition, in a state where a communication connection is not established, it is not possible to automatically turn on the power of the other party's device or activate an application through communication by Wi-Fi, which is the second communication method. Therefore, in the communication system S of the present embodiment, BLE, which is a first communication method with low power consumption, is always connected, and communication connection of Wi-Fi, which is a second communication method, is established according to circumstances.

Always-on connection by BLE, which is the first communication method, is an imaging device that actually uses an external linkage function among a plurality of devices when a plurality of image capture devices having an external linkage function and a portable terminal are each present within a communication-connectable distance range. It is possible to arbitrarily select a combination of (1) and portable terminal 2, and maintain the selected combination of imaging device 1 and portable terminal 2 until the external linkage function is released.

A method of selecting a combination of the imaging device 1 and the portable terminal 2 from among a plurality of devices and starting an always-on connection by BLE, which is the first communication method (pairing process), will be described later.

Here, an example of transmitting an image file from the imaging device 1 in a constantly connected state to the portable terminal 2 by BLE, which is the first communication method, will be described.

2 is a schematic diagram showing an example of data communication performed by the communication system S.

Specifically, in the example of FIG. 2 , the user operates the imaging device 1 as one of the devices to exert an external cooperation function on the side of the imaging device 1, and through communication in the first communication method, the portable terminal For (2), an instruction for establishing a communication connection by the second communication method suitable for transmission and reception of image files (connection instruction) is transmitted.

In the portable terminal 2 that has received the connection instruction through communication in the first communication method, the function of the camera-linked application is exhibited, processing for establishing communication by the second communication method is performed, and the imaging device 1 ) and the mobile terminal 2, a communication connection by the second communication method is established.

In detail, in response to a connection instruction from the imaging device 1 through communication in the first communication method, a program for exercising the function of the camera-linked application on the portable terminal 2 side is started, and the imaging device 1 Communication between the imaging device 1 and the portable terminal 2 is established by the second communication method by the external linkage function on the side and the function of the camera linkage application on the portable terminal 2 side.

The first communication method enables power saving, and is always connected even when either or both of the main power sources of the imaging device 1 and the portable terminal 2 are disconnected (or in a low power consumption state), and the main power source The device on the side that is disconnected (or in a low power consumption state) is connected to the main power source so that communication through the first communication method from the other side is in a state where at least communication by the second communication method and execution of application programs are possible. It has a function of entering (or canceling the low power consumption state) and a function of activating (executing) a designated application program through the first communication method.

Therefore, establishment of communication by the second communication method used for data communication when an event such as transmission of an image taken by the imaging device 1 occurs, for example, without operating the portable terminal 2. can be done without

Thus, data communication can be performed between the imaging device 1 and the portable terminal 2, and image data can be automatically transmitted from the imaging device 1 to the portable terminal 2.

Then, the received image data is temporarily saved in the storage of the portable terminal 2 by displaying the function of the camera-linked application.

Further, in the present embodiment, the image captured by the imaging device 1 is utilized as image data automatically transmitted and received by the external linkage function on the side of the imaging device 1 and the function of the camera linkage application on the side of the portable terminal 2. Data is automatically made viewable from portable terminals owned by other users by using an image sharing service on the Internet. Specifically, when shooting is performed in a state in which a linked operation mode for automatically sharing images is set, the imaging device 1 transmits an image capture to the portable terminal 2 through communication in the first communication method. It instructs that sharing of images from the device 1 to other portable terminals can be performed. In the portable terminal 2 receiving the sharing instruction, the function of the camera-linked application is exhibited, image data taken by the imaging device 1 is received, and after temporarily storing it in the storage of the portable terminal 2, the camera The function of the application for image management and network access is exercised by the instruction by the coordinated application function (a program for the above function is started), and the image data temporarily stored in the storage of the portable terminal 2 is transferred to the self ( It is managed in the functions of self-image management and network access (application for image management and net access), and image data is transmitted to the cloud server linked in advance for the purpose of image sharing. In the cloud server, the image data taken by the imaging device 1 and received by the portable terminal 2 is shared by making the image data available to other portable terminals linked in advance.

And, in the present embodiment, the imaging device 1 and portable terminal 2 are configured as devices that realize predetermined functions in cooperation with other devices. The imaging device 1 and the portable terminal 2 exchange data (data transmission) between the devices using Wi-Fi as the second communication method, so that, for example, the imaging device 1 Processing of transferring an image to the portable terminal 2 in accordance with an operation to acquire an image in the portable terminal 2 or transferring an image from the imaging device 1 to the portable terminal 2 in response to an operation of the portable terminal 2 A linked process such as a process (hereinafter referred to as "linked process") is executed.

In addition, in the imaging device 1 and portable terminal 2, a transition from a state in which link processing cannot be executed because a communication connection in Wi-Fi, which is the second communication method is not established, to a state in which link processing can be executed In order to do this, through BLE, which is the first communication method in which connection is maintained (always connected), the device performing the operation turns on Wi-Fi, which is the second communication method of the other device, to establish a communication connection. do. That is, BLE, which is the first communication method, is in a state in which a predetermined linkage process cannot be executed/a state in which preparation for execution of a predetermined linkage process cannot be performed due to a communication connection with another device not being established, etc. A communication connection with the device is maintained (always-on). Here, “a state in which preparations for execution of a predetermined linkage process cannot be made” means a state in which the power of the other device is off, or a state in which a program for executing a predetermined linkage process is not running, or Wi, which is the second communication method. ―This refers to a state in which a communication connection by Fi has not been established (power is off in this case, communication by the first communication method is possible, but communication by the second communication method and predetermined linkage processing are executed) including impossible low power consumption states). Therefore, in the imaging device 1 and portable terminal 2, the power of the other devices is off, or a program for executing a predetermined linkage process is not running, or Wi-Fi as the second communication method Even in a state in which no communication connection is established (non-functioning state) and in which preparations for execution of predetermined coordinated processing cannot be made, preparations for execution of predetermined coordinated processing can be made via BLE, which is the first communication method. fulfill the status quo

Here, pairing processing is explained.

The pairing process is a process of establishing a connection between two BLE devices (in this embodiment, the imaging device 1 and portable terminal 2). After setting the connection, based on the setting, the imaging device 1 and portable terminal 2 are connected in a communicable state. In addition, pairing information of the other party required for connection is stored in the respective devices (the imaging device 1 and the portable terminal 2) by the pairing process.

In the communication of the BLE method of the present embodiment, communication is performed between a peripheral having a different role and a central. In this embodiment, the peripheral is the imaging device 1, and the central is the portable terminal 2.

On the other hand, in order to inform the existence of itself, the peripheral uses radio waves to issue an advertisement signal to the surroundings (broadcasting the advertisement signal), and responds to a connection request from the central.

The central scans to see if there is a peripheral that provides necessary data, and upon detecting a corresponding peripheral, requests connection and starts exchanging data. Then, the central executes a certain task using the information (service) provided from the peripheral.

In the advertisement signal, the name of the peripheral [device name: in this embodiment, SSID that is the identification name of the access point in wireless LAN (Wi-Fi)] and information indicating information (service) that can be provided ( UUID: Universally Unique Identifier).

Upon connection (at the time of communication) of BLE after connection setting is completed by pairing processing, a communication packet including a unique (unique) BD address (bluetooth (registered trademark) Device Address) in the world is transmitted. In this way, there is no case of being connected to another device unexpectedly.

3 is a block diagram showing hardware configurations of the imaging device 1 and portable terminal 2 according to an embodiment of the present invention.

The imaging device 1 is constituted by, for example, a digital camera.

An imaging device 1 includes a central processing unit (CPU) 11, a read only memory (ROM) 12, a random access memory (RAM) 13, a bus 14, and an input/output interface 15. ), an imaging unit 16, an input unit 17, an output unit 18, a storage unit 19, a first communication unit 20, a second communication unit 21, A drive 22 and a power supply unit 23 are provided.

The CPU 11 executes various processes according to programs recorded in the ROM 12 or programs loaded into the RAM 13 from the storage unit 19 .

This CPU 11, RAM 13, ROM 12 (or storage unit 19) constitutes a control unit.

The RAM 13 also appropriately stores data necessary for the CPU 11 to execute various processes.

The CPU 11 , ROM 12 and RAM 13 are connected to each other via a bus 14 . An input/output interface 15 is also connected to this bus 14. The input/output interface 15 includes an imaging unit 16, an input unit 17, an output unit 18, a storage unit 19, a first communication unit 20, a second communication unit 21, a drive 22, and a power supply unit. (23) is connected.

Although not shown, the imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit is composed of a lens that condenses light in order to photograph a subject, for example, a focus lens or a zoom lens.

A focus lens is a lens that forms an image of a subject on a light receiving surface of an image sensor. A zoom lens is a lens that freely changes its focal length within a certain range.

A peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance is also installed in the optical lens unit, if necessary.

The image sensor is composed of a photoelectric conversion element, an AFE (Analog Front End), or the like.

The photoelectric conversion element is constituted by, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. An object image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (imaging) the subject image, accumulates image signals for a certain period of time, and sequentially supplies the accumulated image signals to the AFE as an analog signal.

The AFE performs various signal processing such as A/D (Analog/Digital) conversion processing on this analog image signal. A digital signal is generated through various signal processing and is output as an output signal of the imaging unit 16 .

Such an output signal of the imaging unit 16 is hereinafter also referred to as "photographed image data". Data of the captured image is appropriately supplied to the CPU 11 or an image processing unit (not shown).

The input unit 17 is composed of various buttons and the like, and inputs various types of information according to the user's instructional operation.

The output unit 18 is composed of a display, a speaker, or the like, and outputs an image or sound.

The storage unit 19 is constituted by a hard disk or a flash memory, and stores data of various images.

The first communication unit 20 controls communication with an external device (portable terminal 2 in this embodiment) using a first communication method that is low-speed but capable of saving power and suitable for always-on connection. In the present embodiment, the first communication method uses a communication method conforming to the BLE communication standard.

The second communication unit 21 controls communication performed with an external device (portable terminal 2 in this embodiment) by a second communication method suitable for transmission and reception of files at high speed. In the present embodiment, the second communication method uses a communication method according to the Wi-Fi communication standard among wireless LANs.

A removable medium 31 made of a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted on the drive 22 . Programs read from the removable medium 31 by the drive 22 are installed in the storage unit 19 as needed. In addition, the removable medium 31 can also store various types of data such as image data stored in the storage unit 19 in the same way as the storage unit 19 .

The power supply unit 23 is constituted by, for example, a lithium ion secondary battery, and is a power supply source for supplying driving power to the imaging device 1 via a power supply circuit (not shown), and the imaging device ( Current as a driving source of 1) is supplied to each component of the imaging device 1. The power supply unit 23 is controlled by the CPU 11 and, for example, in a power-off state, stops the supply of power to the output unit 18 and the like to turn off the display output, and the first communication unit 20 ) or the second communication unit 21, etc., maintaining the supply of power for communication, so that image transmission is possible even in a power-off state.

In addition, the portable terminal 2 is configured as, for example, a smart phone.

Incidentally, the configuration of the hardware is omitted because it is the same as that of the imaging device 1. Hereinafter, when the hardware in the imaging device 1 and the portable terminal 2 is used as an explanation, "-1" is added to the end of the code for the imaging device 1, and the portable terminal 2 , "-2" is added to the end of the code. That is, the imaging device 1 is referred to as the CPU 11 - 1 to the removable medium 31 - 1 , and the portable terminal 2 includes the CPU 11 - 2 to the removable medium 31 - 2) shall be indicated.

When the function of data communication is exhibited in the imaging device 1 and portable terminal 2 configured as described above, communication between the imaging device 1 and portable terminal 2 is performed by BLE, which is the first communication method. This is done in a state where a connection is established (always-on state). That is, the automatic transmission function of captured images is exhibited on the premise that a connection is established between the imaging device 1 and the portable terminal 2 by BLE, which is the first communication method.

Specifically, an instruction (connection instruction) is given to the portable terminal 2 from the imaging device 1 to establish a communication connection by Wi-Fi, which is the second communication method, through communication in the first communication method. and a communication connection is established between the imaging device 1 and the portable terminal 2 by Wi-Fi as the first communication method. In the present embodiment, the imaging device 1 is set to an access point (AP) mode so as to be a main device in Wi-Fi, and the portable terminal 2 uses Wi, which is the first communication method. - A communication connection is established by one-to-one direct communication between the imaging device 1 and the portable terminal 2 in the station (ST) mode so as to become a sub device in Fi.

Then, when the first communication connection is established and pairing is performed, the information related to the pairing is held by each device. In the present embodiment for short-distance communication, a process of searching for devices within the reach of radio waves and automatically establishing a communication connection without inputting a password or the like based on pairing information held therein is performed. do. Regarding the pairing operation, first, all devices that can be connected nearby (devices with BLE/Wi-Fi in an active state) are displayed by device name, etc., and the user designates a device that executes linkage processing among them. .

4 is a functional block diagram showing a functional configuration for executing automatic image reception processing and mode operation processing among the functional configurations of the imaging device 1 and portable terminal 2.

First, the automatic image receiving process will be described.

"Automatic image reception processing" means that when a captured image is acquired from the image capture unit 16 in the image capture device 1, a communication connection is established in the portable terminal 2 by the second communication method to obtain the captured image. is transmitted to the portable terminal 2, and the portable terminal 2 automatically receives an image.

When the automatic image receiving process is executed on the imaging device 1 side, as shown in FIG. 4 , the shooting control unit 51 and the communication control unit 52 function in the CPU 11 - 1 .

In one area of the storage unit 19 - 1, an image storage unit 71 is set.

In the image storage unit 71, data of a captured image obtained from the imaging unit 16 is stored.

The shooting control unit 51 controls the imaging unit 16 to execute shooting processing. As a result, a captured image is output from the imaging unit 16 . The output captured image is stored in the image storage unit 71 .

The communication control unit 52 performs communication in BLE (Wi-Fi), which is the first communication method (second communication method), and the first communication unit 20- 1) Control the [second communication unit 21-1].

Specifically, the communication control unit 52 performs communication by Wi-Fi, which is the second communication method, for example, and transmits an image captured by the imaging device 1 to the mobile terminal 2. The communication unit 21-1 is controlled.

In addition, when the automatic image receiving process is executed on the portable terminal 2 side, as shown in Fig. 4, in the CPU 11 - 2, the application management unit 91 and the communication control unit 92 function. .

In one area of the storage unit 19 - 2, an image storage unit 111 is set.

The image storage unit 111 stores captured image data acquired from the imaging device 1 .

The application management unit 91 manages the startup and termination of applications (programs).

Specifically, the application management unit 91 performs communication in BLE, which is the first communication method, for example, and activates an application (hereinafter simply referred to as "application") in the first communication unit 20 - 2 . When an instruction to do so is received, the specified application is started. In the present embodiment, the application management unit 91 activates an application that performs communication control in Wi-Fi to exert a communication control function. Incidentally, "activation" in an application or device includes a case of resuming execution of an application that is dormant (running in the background) other than a case of newly executing an application, and also turning off the power supply. It also includes cases involving a transition from the state to the on state.

The communication control unit 92 performs communication in BLE (Wi-Fi), which is a first communication method (second communication method), and a first communication unit ( 20-2) (the second communication unit 21-2) is controlled.

Specifically, the communication control unit 92 controls the second communication unit 21 - 2 to receive an image from the imaging device 1 by, for example, performing communication by Wi-Fi as the second communication method. .

FIG. 5 is a flowchart for explaining the flow of automatic image reception processing executed by the imaging device 1 and portable terminal 2 of FIG. 3 having the functional configuration of FIG. 4 .

In the automatic image receiving process start state, pairing of BLE, which is the first communication method, has been completed between the imaging device 1 and the portable terminal 2, and they are always connected. In addition, although Wi-Fi, which is the first communication method, is in an off state, between the imaging device 1 and the portable terminal 2, Wi-Fi settings (profiles) are mutually acquired, and Wi-Fi At startup, a one-to-one communication connection can be established between the imaging device 1 and the portable terminal 2 .

<Automatic image reception processing on the imaging device 1 side>

In Step S111 - 1 , the shooting control unit 51 controls the imaging unit 16 to execute shooting processing. As a result, a captured image is output from the imaging unit 16 . The output captured image is stored in the image storage unit 71 .

When the shooting process is executed, if the automatic image transfer mode has been set, in step S112 - 1, the communication control unit 52 performs communication with the portable terminal 2 by BLE, which is the first communication method, , controls the first communication unit 20 - 1 to transmit an instruction to activate the app. As a result, in the mobile terminal 2 that has received the instruction to launch the app, the app is launched. In this embodiment, an application that performs communication control in Wi-Fi is started, and the communication control function is exhibited.

In Step S113 - 1, the communication control unit 52 performs communication with the mobile terminal 2 by BLE, which is the first communication method, and access point information of the imaging device 1 (hereinafter referred to as "camera AP information"). ”) is controlled to transmit the first communication unit 20 - 1 . As a result, in the portable terminal 2 that has received the camera AP information, Wi-Fi is turned on in the ST (station) mode in which the portable terminal 2 serves as a sub device.

In Step S114 - 1 , the communication control unit 52 controls the second communication unit 21 - 1 to turn on Wi-Fi in AP (Access Point) mode serving as the main device.

In step S115 - 1 , the communication control unit 52 performs communication by Wi-Fi, which is the second communication method, and the second communication unit 21 - 1 responds to the connection request from the mobile terminal 2 to carry out the mobile device. Whether or not a connection with the terminal 2 has been established is determined.

If the connection with the portable terminal 2 is established, it is determined as YES in step S115-1, and the process proceeds to step S118-1. The process of step S118-1 will be described later.

In contrast, in the case where a connection with the portable terminal 2 has not been established, it is determined as NO in step S115 - 1 , and the processing proceeds to step S116 - 1 .

In Step S116 - 1, the communication control unit 52 determines whether or not timed out has elapsed after a preset time has elapsed.

In the case where there is no time interruption, it is determined as NO in step S116 - 1 , and the process returns to step S115 - 1 .

In the case of time interruption, it is determined as YES in step S116-1, and the process proceeds to step S117-1.

In Step S117 - 1 , the communication control unit 52 controls the second communication unit 21 - 1 to turn off Wi-Fi. After that, the process returns to step S111-1.

In Step S118 - 1, the communication control unit 52 performs communication by Wi-Fi, which is the second communication method, and transmits the captured image to the portable terminal 2 connected to the second communication unit 21 -1) is controlled. As a result, a captured image taken by Wi-Fi is transmitted. After that, the automatic image receiving process on the imaging device 1 side ends.

<Automatic image reception processing on the portable terminal 2 side>

In step S111-2, the application management unit 91 performs communication by BLE, which is the first communication method, and upon receiving an instruction to launch an app in the first communication unit 20-2, activates the specified application. . In this embodiment, an application that performs communication control in Wi-Fi is started, and the communication control function is exhibited.

In Step S112 - 2, the communication control unit 92 turns on Wi-Fi in the ST mode when communication is performed by BLE as the first communication method and camera AP information is received from the imaging device 1. The second communication unit 21 - 2 is controlled.

In Step S113 - 2 , the communication control unit 92 controls the second communication unit 21 - 2 to search for the imaging device 1 of the access point (AP).

In Step S114 - 2 , the communication control unit 92 determines whether or not the imaging device 1 of the access point (AP) has been found.

If the imaging device 1 of the access point is found, it is determined YES in step S114 - 2 , and the process proceeds to step S117 - 2 . Processing after step S117-2 will be described later.

In contrast, when the imaging device 1 of the access point is not found, it is determined NO in step S114 - 2 , and the process proceeds to step S115 - 2 .

In Step S115 - 2 , the communication control unit 92 determines whether or not a time break has occurred after a preset time has elapsed.

In the case where there is no time interruption, it is determined as NO in step S115 - 2 , and the process returns to step S114 - 2 .

In the case of time interruption, it is determined as YES in step S115 - 2 , and the process proceeds to step S116 - 2 .

In step S116-2, the application management unit 91 terminates the application activated in step S111-2. By ending the application, the Wi-Fi communication function in the second communication unit 21 - 2 is turned off. After that, the process returns to step S111-2.

In Step S117 - 2, the communication control unit 92 performs communication by Wi-Fi as the second communication method, connects to the imaging device 1 of the access point (AP), and connects (connection request) The second communication unit 21 - 2 is controlled to notify the imaging device 1 of .

In step S118 - 2 , the communication control unit 92 controls the second communication unit 21 - 2 to receive the image transmitted from the imaging device 1 . The received image is stored in the image storage unit 111. After that, the automatic transmission/reception processing on the portable terminal 2 side ends.

Next, mode operation processing will be described.

Further, "mode operation processing" means that the portable terminal 2 establishes a communication connection by the second communication method in the imaging device 1 based on various modes of the REC mode/PLAY mode, This refers to a series of processes that cause the imaging device 1 to perform corresponding operations.

When mode operation processing is executed on the imaging device 1 side, as shown in FIG. 4 , the shooting control unit 51 and the communication control unit 52 function in the CPU 11 - 1 .

In one area of the storage unit 19 - 1, an image storage unit 71 is set.

In the image storage unit 71, data of a captured image obtained from the imaging unit 16 is stored.

The shooting control unit 51 controls the imaging unit 16 to take a through image for the REC mode. As a result, a through image is output from the imaging unit 16 .

The communication control unit 52 performs communication in BLE (Wi-Fi), which is the first communication method (second communication method), and the first communication unit 20- 1) Control the [second communication unit 21-1].

Specifically, the communication control unit 52 communicates the through image from the imaging unit 16 by Wi-Fi, which is the second communication method, in the REC mode, for example, and the mobile terminal 2 The second communication unit 21 - 1 is controlled to transmit to . Further, in the PLAY mode, the communication control unit 52 transmits a list of images stored in the image storage unit 71 to the portable terminal 2 by performing communication using Wi-Fi as the second communication method. The second communication unit 21-1 is controlled.

In addition, when the automatic image receiving process is executed on the portable terminal 2 side, as shown in Fig. 4, in the CPU 11 - 2, the application management unit 91 and the communication control unit 92 function. .

In one area of the storage unit 19 - 2, an image storage unit 111 is set.

The image storage unit 111 stores image data obtained from the imaging device 1 .

The application management unit 91 manages the startup and termination of applications.

Specifically, the application management unit 91, for example, performs communication by BLE, which is the first communication method, and upon receiving an instruction to launch an app in the first communication unit 20 - 2 , activates the designated application. do. In the present embodiment, the application management unit 91 activates an application that performs communication control in Wi-Fi to exert a communication control function.

The communication control unit 92 performs communication in BLE (Wi-Fi), which is the first communication method (second communication method), and the first communication unit 20- 2) Control the [second communication unit 21-2].

Specifically, the communication control unit 92 communicates the through image from the imaging unit 16 by Wi-Fi, which is the second communication method, in the REC mode, for example, and transfers the through image to the imaging device 1. Controls the second communication unit 21 - 2 to receive from Further, in the PLAY mode, the communication control unit 52 receives a list of images stored in the image storage unit 71 from the imaging device 1 through communication using Wi-Fi as the second communication method. The second communication unit 21 - 2 is controlled.

FIG. 6 is a flowchart for explaining the flow of mode operation processing executed by the imaging device 1 and portable terminal 2 of FIG. 3 having the functional configuration of FIG. 4 .

In the start state of the mode operation process, pairing of BLE, which is the first communication method, has been completed between the imaging device 1 and the portable terminal 2, and they are always connected. In addition, although Wi-Fi, which is the first communication method, is in an off state, between the imaging device 1 and the portable terminal 2, Wi-Fi settings (profiles) are mutually acquired, and Wi-Fi At startup, a one-to-one communication connection can be established between the imaging device 1 and the portable terminal 2 .

<Processing Mode Operation on Imaging Device 1 Side>

In Step S211 - 1 , the CPU 11 performs communication with the portable terminal 2 by BLE, which is the first communication method, and activates the imaging device 1 in response to an activation request from the portable terminal 2 . At the same time as activation, if there is a mode designation at the time of activation from the mobile terminal 2, the specified mode is set. In the present embodiment, the modes include a REC mode in which shooting is performed while checking a through image from the imaging device 1 in the portable terminal 2, and a REC mode stored in the imaging device 1 in the portable terminal 2. Any one of the PLAY modes for viewing a list of images is set.

In Step S212 - 1, the communication control unit 52 controls the first communication unit 20 - 1 to communicate with the mobile terminal 2 by BLE, which is the first communication method, and transmit camera AP information do. As a result, in the portable terminal 2 that has received the camera AP information, Wi-Fi is turned on in the ST (station) mode in which the portable terminal 2 serves as a sub device based on the received camera AP information.

In Step S213 - 1 , the communication control unit 52 controls the second communication unit 21 - 1 to turn on Wi-Fi in AP (Access Point) mode serving as the main device.

In step S214 - 1 , the communication control unit 52 performs communication by Wi-Fi, which is the second communication method, and in response to the connection request from the mobile terminal 2, the second communication unit 21 - 1 carries out mobile communication. Whether or not a connection with the terminal 2 has been established is determined.

If the connection with the portable terminal 2 is established, it is determined as YES in step S214 - 1 , and the process proceeds to step S217 - 1 . The process of step S217 - 1 will be described later.

In contrast, in the case where a connection with the portable terminal 2 has not been established, it is determined as NO in step S214 - 1 , and the process proceeds to step S215 - 1 .

In step S215 - 1 , the communication control unit 52 determines whether or not the time interruption has occurred after a preset time has elapsed.

If it is not a time interruption, it is determined as NO in step S215 - 1 , and the process returns to step S214 - 1 .

In the case of time interruption, it is determined as YES in step S215 - 1 , and the process proceeds to step S216 - 1 .

In Step S216 - 1 , the communication control unit 52 controls the second communication unit 21 - 1 to turn off Wi-Fi. After that, the process returns to step S211 - 1.

In Step S217 - 1 , the shooting control unit 51 and the communication control unit 52 operate in the mode designated in Step S211 - 1 or in the mode newly designated by the portable terminal 2 . That is, when the designated mode is the REC mode and there is a request for transmission of a through image, the shooting control unit 51 controls the imaging unit 16 to capture a through image to acquire the through image. Then, the communication control unit 52 controls the second communication unit 21 - 1 to perform communication by Wi-Fi, which is the second communication method, and sequentially transmit the acquired through images to the portable terminal 2 . Further, when the designated mode is the PLAY mode and there is a request for transmission of a list of images (thumbnail images), the communication control unit 52 performs communication by Wi-Fi, which is the second communication method, and stores images. The second communication unit 21 - 1 is controlled to transmit a list of images stored in the unit 111 to the portable terminal 2 .

After that, the mode operation process on the imaging device 1 side ends.

<Processing Mode Operation on the Mobile Terminal 2 Side>

In Step S211 - 2 , the application management unit 91 activates the application by a user's operation of the input unit 17 or the like. In the present embodiment, an application that exhibits a function of specifying a mode is started, and the function of specifying a mode is exhibited.

In Step S212 - 2 , the communication control unit 92 controls the second communication unit 21 - 2 to perform communication by BLE, which is the first communication method, and start up the imaging device 1 . In addition, when it is necessary to designate the mode at the time of startup of the imaging device 1, information designating the mode is transmitted. In the present embodiment, the modes include a REC mode in which shooting is performed while checking a through image from the imaging device 1 in the portable terminal 2, and an imaging device 1 in the portable terminal 2 ), any one of the PLAY modes for viewing a list of images stored in ) can be specified.

In Step S213 - 2 , the communication control unit 92 turns on Wi-Fi in the ST mode when communication is performed by BLE, which is the first communication method, and camera AP information is received from the imaging device 1. The second communication unit 21 - 2 is controlled.

In step S214 - 2 , the communication control unit 92 controls the second communication unit 21 - 2 to search for the imaging device 1 of the access point (AP).

In Step S215 - 2, the communication control unit 92 determines whether or not the imaging device 1 of the access point (AP) has been found.

If the imaging device 1 of the access point is found, it is determined YES in step S215 - 2 , and the process proceeds to step S218 - 2 . Processing after step S218-2 will be described later.

In contrast, when the imaging device 1 of the access point is not found, it is determined NO in step S215 - 2 , and the process proceeds to step S216 - 2 .

In step S216 - 2, the communication control unit 92 determines whether or not a time break has occurred after a preset time has elapsed.

In the case where there is no time interruption, it is determined as NO in step S216 - 2 , and the process returns to step S215 - 2 .

In the case of a time interruption, it is determined as YES in step S216 - 2 , and the process proceeds to step S217 - 2 .

In step S217 - 2 , the application management unit 91 terminates the application activated in step S211 - 2 . By ending the application, the Wi-Fi communication function in the second communication unit 21 - 2 is turned off. After that, the process returns to step S211-2.

In Step S218 - 2, the communication control unit 92 performs communication with the imaging device 1 by Wi-Fi as the second communication method, and connects to the imaging device 1 of the access point (AP). , the second communication unit 21 - 2 is controlled so as to notify the imaging device 1 of the connection (connection request).

In step S219 - 2, the communication control unit 92 confirms the mode specified by user operation or the like.

If the designated mode is REC, it becomes [REC] in step S219 - 2 , and the process proceeds to step S220 - 2 .

In step S220 - 2, the communication control unit 92 performs communication in Wi-Fi, which is the second communication method, with respect to the imaging device 1, switches to the REC mode, and requests transmission of a through image, , through images sequentially transmitted from the imaging device 1 according to this request are sequentially acquired. Then, sequentially acquired through images are sequentially displayed in the output unit 18 - 2 . The user performs an operation such as a shooting instruction while browsing through images captured by the imaging device 1 . After that, the mode operation processing on the portable terminal 2 side ends.

In contrast, when the mode designated by user operation or the like is PLAY, it becomes [PLAY] in step S219 - 2 , and the process proceeds to step S221 - 2 .

In Step S221 - 2 , the communication control unit 92 performs communication with the imaging device 1 by Wi-Fi as the second communication method, switches to the PLAY mode, and returns to the image storage unit 71 A transmission request for a list of stored images is made, and a list of images (thumbnail images) transmitted from the imaging device 1 in response to the request is acquired. Then, a list of acquired images is displayed on the output unit 18 - 2 . The user performs operations such as selecting an image to be acquired from the imaging device 1 while browsing a list of images stored in the imaging device 1 . After that, the mode operation processing on the portable terminal 2 side ends.

Fig. 7 is a schematic diagram showing display of communication status indicating transitions in communication states in the imaging device 1 and portable terminal 2, which sequentially change with the execution of various processes as described above.

As shown in the example of Fig. 7, the status display of the communication in the imaging device 1 and portable terminal 2 in the first communication method and the second communication method is configured to change the display for each status.

In the communication status, when neither pairing nor connection has been established (<pairing: no> <connection: no>), the status display is configured not to be performed.

In the communication status, when pairing is established but connection is not established (<pairing: complete> <connection: no>), the icons representing the first communication method and the second communication method are displayed in a broken line or semi-transparent state. It is configured to display as

In the case of pairing and connection in the communication status (<pairing: complete> <connection: yes>), icons indicating the first communication method and the second communication method are displayed.

The imaging device 1 configured as described above includes a second communication unit 21 - 1 , a communication control unit 52 , a first communication unit 20 - 1 , and a communication control unit 52 .

The communication control unit 52 executes a predetermined linkage process by transmitting data with the portable terminal 2 as another device through the second communication unit 21 - 1 .

The first communication unit 20 - 1 maintains a communication connection with the portable terminal 2 as another device even in a state in which the predetermined linkage processing by the communication control unit 52 cannot be executed.

The communication control unit 52 makes a transition from a state in which a predetermined linkage process by the communication control unit 52 cannot be executed to a state in which it can be executed by performing predetermined communication by the first communication unit 20 - 1 .

In this way, even in a state in which the predetermined linkage processing by the communication control unit 52 cannot be executed, a communication connection with the portable terminal 2, which is another device, is maintained, and predetermined communication is performed by the first communication unit 20-1. By doing so, a transition is made from a state in which the predetermined coordinated processing by the communication control unit 52 cannot be executed to a state in which it can be executed, and the predetermined coordinated processing by the communication control unit 52 is executed.

Therefore, the imaging device 1 can receive predetermined data without performing an operation on the portable terminal 2, and the convenience of linkage among a plurality of devices through wireless communication can be enhanced.

The first communication unit 20 - 1 is slower than the second communication unit 21 - 1 but is power saving.

Even in a state in which the first communication unit 20 - 1 cannot execute a predetermined linkage process due to the fact that a communication connection with the portable terminal 2, which is another device, by the second communication unit 21 - 1 has not been established, A communication connection with the portable terminal 2, which is another device, is maintained.

The communication control unit 52 performs predetermined communication by the first communication unit 20 - 1 , so that a communication connection is not established between the second communication unit 21 - 1 and the portable terminal 2 as another device. from to an established state.

In this way, it is possible to transfer to a state in which a connection with the portable terminal 2, which is another device, can be maintained in a lower power consumption state and a predetermined linkage process can be executed.

The first communication unit 20 - 1 can execute a predetermined coordinated process due to the fact that either the portable terminal 2 or the imaging device 1, which is another device, is not ready to execute the predetermined coordinated process. Even in an absent state, a communication connection with the portable terminal 2, which is another device, is maintained.

The communication control unit 52, by performing predetermined communication through the first communication unit 20 - 1 , causes either the mobile terminal 2 or the imaging device 1, which is another device, to execute a predetermined linkage process. Transition from not ready to ready.

This makes it possible to make a transition from a state in which one of the devices executing the predetermined coordinated processing to the other device is not ready to execute the predetermined coordinated processing to a ready state.

A state in which a predetermined coordinated process is not ready to be executed means that either the portable terminal 2 or the imaging device 1, which is another device, is turned off, or a program for executing a predetermined coordinated process is started. It is a state in which it is not, or a state in which the second communication unit 21 - 1 is not functioning.

This makes it possible to transition from various states in which a part of the function for executing the predetermined coordinated processing is not operating to a state in which preparations for executing the predetermined coordinated processing can be made.

The communication control unit 52 prepares for either the portable terminal 2 or the imaging device 1 to execute a predetermined linkage process by performing predetermined communication by the first communication unit 20 - 1 . Even when in a state in which the process is not performed, both the portable terminal 2 or the imaging device 1, which are other devices, are brought into a state in which a predetermined linkage process is ready to be executed.

This makes it possible for any one of the devices executing the predetermined coordinated processing to make both devices executing the predetermined coordinated processing transition to a state in which they are ready to execute the predetermined coordinated processing.

The communication control unit 52, when the portable terminal 2, which is another device, is in a state where it is not ready to execute a predetermined linkage process, the first communication unit 20-1 transmits the portable terminal 2, which is another device. By transmitting a predetermined signal to , the portable terminal 2, which is another device, is moved to a state in which a predetermined linkage process is ready to be executed.

In addition, the communication control unit 52, when the imaging device 1 is not ready to execute a predetermined linkage process, transmits the mobile terminal 2, which is another device, by the first communication unit 20-1. By receiving a predetermined signal from , the imaging device 1 is brought into a state in which a predetermined linkage process is ready to be executed.

In this way, by transmitting and receiving a predetermined signal through the second wireless communication, it is possible to make both devices executing the predetermined linkage process transition to a ready-to-execute state.

A predetermined linkage process includes a first linkage process for controlling the portable terminal 2, which is another device, by operation of the imaging device 1, and a first linkage process for controlling the portable terminal 2, which is another device, to control the imaging device 1. ) and a second linkage process for controlling .

In the case of performing the first linkage processing, the communication control unit 52 transmits a predetermined signal to the mobile terminal 2, which is another device, through second wireless communication in response to the operation of the imaging device 1, so that the other device, that is, The mobile terminal 2 is brought into a state in which the first cooperative process is ready to be executed.

Further, when the second linkage processing is performed, the communication control unit 52 receives a predetermined signal transmitted by the second wireless communication in response to an operation of the portable terminal 2, which is another device, so that the imaging device 1 ) to a state in which the second coordinate processing is ready to be executed.

As a result, either the portable terminal 2, which is another device, is controlled from the imaging device 1 to perform the first coordinated processing, or the portable terminal 2, which is another device, controls the imaging device 1 to perform the second coordinated processing. It becomes possible to do or do.

The communication control unit 52 arbitrarily designates the mobile terminal 2, which is another device that allows a predetermined linkage process to be performed, as the designation device through a user operation by the input unit 17 or the like.

Further, the communication control unit 52 initiates a communication connection with the designated device by the first communication unit 20-1, and maintains the communication connection with the designated device by the second communication unit 21-1. The communication connection with the is disconnected.

Further, the communication control unit 52 causes the second communication unit 21-1 to initiate a communication connection with the designated device by performing predetermined communication in which the designated device is specified by the first communication unit 20-1. .

This makes it possible to designate the portable terminal 2, which is another specific device, and execute a predetermined linkage process.

One of the portable terminal 2, which is a device different from the imaging device 1, is an imaging device 1 with an imaging function, and the other is a portable terminal 2 equipped with an image display function.

The predetermined linkage processing includes image transmission processing for transmitting image data captured by the imaging device 1 to a display terminal via the second communication unit 21 - 1 for display.

This makes it possible to link the image capturing device 1 and the mobile terminal 2, transmit image data captured by the image capturing device 1 to the display terminal, and display using functions of the display terminal.

The predetermined coordinated processing includes a first coordinated process for starting an image transfer process in response to an operation of the imaging device 1 and a second coordinated process for starting an image transfer process in response to an operation of the display terminal.

This makes it possible to transmit image data to the display terminal in response to operation of the imaging device 1 or to transmit image data from the imaging device 1 in accordance with operation of the display terminal.

The communication system S configured as described above includes an imaging device 1 and a portable terminal 2 that cooperate with each other to realize predetermined functions.

The imaging device 1 includes a second communication unit 21 - 1 , a communication control unit 52 , a first communication unit 20 - 1 and a communication control unit 52 .

The communication control unit 52 executes a predetermined linkage process by transmitting data with the portable terminal 2 as another device through the second communication unit 21 - 1 .

The first communication unit 20 - 1 maintains a communication connection with the portable terminal 2 as another device even in a state in which the predetermined linkage processing by the communication control unit 52 cannot be executed.

The communication control unit 52 makes a transition from a state in which a predetermined linkage process by the communication control unit 52 cannot be executed to a state in which it can be executed by performing predetermined communication by the first communication unit 20 - 1 .

In this way, even in a state in which the predetermined linkage processing by the communication control unit 52 cannot be executed, a communication connection with the portable terminal 2, which is another device, is maintained, and predetermined communication is performed by the first communication unit 20-1. By doing so, a transition is made from a state in which the predetermined coordinated processing by the communication control unit 52 cannot be executed to a state in which it can be executed, and the predetermined coordinated processing by the communication control unit 52 is executed.

Therefore, the imaging device 1 can receive predetermined data without performing an operation on the portable terminal 2, and the convenience of linkage among a plurality of devices through wireless communication can be improved.

Further, the communication control unit 52 transmits the image data captured by the imaging device 1 as the first device to the portable terminal 2 as the second device by the second communication method as the second wireless communication.

The communication control unit 52, in a state in which the communication connection between the imaging device 1 as the first device and the portable terminal 2 as the second device by the second communication method as the second wireless communication is broken, A communication connection is maintained between the imaging device 1 as the first device by the first communication method as the first wireless communication and the portable terminal 2 as the second device, and by the first communication method as the first wireless communication By transmitting and receiving predetermined control data between the imaging device 1 as the first device and the portable terminal 2 as the second device, the second communication method as the second wireless communication is established with the imaging device 1 as the first device. The communication connection with the portable terminal 2 as the second device is shifted from a disconnected state to a connected state.

In this way, in the communication system S, connection can be made without performing an operation on the portable terminal 2, and the convenience of linkage between a plurality of devices through wireless communication can be improved.

Furthermore, in the above-described embodiment, the imaging device 1 as the first device is associated with association information for associating the imaging device 1 as the first device and the portable terminal 2 as the second device as mutual communication partners. It can be configured to further include a communication control unit 52/communication control unit 92 serving as an association means for mutually storing (association information).

In the imaging device 1 as the first device, according to the association information stored by the communication control unit 52/communication control unit 92 serving as association means, the imaging device 1 as the first device and the second device It can be configured so that the communication connection with the portable terminal 2 as the transition is made from a disconnected state to a connected state.

Furthermore, in the above-described embodiment, the communication control unit 52/communication control unit 92, which are association means, transmits and receives information related to pairing, which is association information, so that the imaging device 1 as the first device and the second device It can be configured to associate the portable terminal 2 as the .

Further, in the above-described embodiment, the communication control unit 52/communication control unit 92, which are association means, transmits and receives association information, thereby providing an imaging device as the first device as a mutual communication partner by the communication control unit 52. (1) and the portable terminal 2 as the second device can be configured to be associated.

Further, in the above-described embodiment, the communication control unit 52/communication control unit 92, which is the association means, displays the device name of the other party as a candidate for association using the identification information of the device on the output unit 18, It can be configured to allow selection.

BACKGROUND ART Conventionally, a technique for connecting an imaging device such as a digital camera and an information processing device such as a smart phone by wireless communication has been used.

In such a technique, when remotely operating an imaging device from an information processing device by wireless communication, a wireless communication connection is first established between these devices, and then a predetermined remote operation is performed.

In the prior art, as an example of such a technique, there is an imaging system that remotely operates a camera using a camera operating terminal (for example, see Japanese Laid-Open Patent Publication No. 2014-230024).

However, when the imaging device is remotely operated by the information processing device, it is necessary to establish a wireless communication connection after turning on the power of these devices each time the remote operation is performed. In addition, since the role of each device is set in advance to remotely operate the imaging device from the information processing device, the preset function can only be limitedly used for the function of remotely operating the imaging device from the information processing device. , it was not highly convenient for users who performed remote operations.

The present embodiment has been made to solve such a problem, and aims at enhancing the convenience of linkage in a plurality of devices through wireless communication.

<Second Embodiment>

8 is a system configuration diagram showing another system configuration of a communication system according to an embodiment of the present invention.

As shown in FIG. 8, the communication system S is based on the system configuration shown in FIG. 1, and includes at least an imaging device 1 having an imaging/communication function and a portable terminal having at least an image display/communication function. (2) and a server (3). In the communication system S, the image captured by the imaging device 1 is transmitted to the server 3 via the mobile terminal 2, the image is saved for sharing, and the address of the saved image is stored. The sharing information is transmitted to other portable terminals (100, 100, 100...) set for sharing. The other portable terminal 100 accesses the server 3 based on the received sharing information to view the image or the like.

In the communication system S, when the user operates either device of the imaging device 1 or portable terminal 2, the image file level is transferred from the operating device operated by the user to the other device. In a state in which a communication connection request is made in a communication system capable of data communication and a communication connection between the imaging device 1 and the portable terminal 2 is established, in accordance with the operation of the operating device, the other device is connected. It has a function of sending and receiving image files of the other device and browsing image data held by the other device.

As shown in FIG. 3, the server 3 is connected to the portable terminal 2 via a network N such as the Internet so that image data can be exchanged, and the image can be published on the network. there is. Incidentally, the configuration of the hardware is the same except for the imaging device 1, the imaging unit 16, and the first communication unit 20, so description is omitted.

Hereinafter, when using the hardware in the server 3 as an explanation, “-3” is added to the end of the code. In other words, the server 3 is described as the CPU 11 - 3 or the removable medium 31 - 3 .

Here, linkage preparation processing (pairing processing) is explained.

A user arbitrarily designates an imaging device 1 and a portable terminal 2 to be subjected to automatic image transfer processing among a plurality of imaging devices and a plurality of portable terminals, and the specified imaging device 1 and portable terminal 2 are selected. Pairing processing is performed.

After the linkage preparation process (pairing process) is completed, the mode setting operation of the imaging device 1 or portable terminal 2 by the user, or whether the user operates either the imaging device 1 or the portable terminal 2 According to this, it is automatically determined whether to perform the linked operation or whether to execute the automatic image transfer process or the remote operation process.

When shooting is instructed by user operation, the imaging device 1 performs normal shooting recording unless the coordinated operation mode is set, but automatically performs automatic image transfer processing when the coordinated operation mode is set. Initiate.

Further, the portable terminal 2 automatically starts a remote operation process when a coordinated operation is instructed by a user operation.

Next, the automatic image transfer process will be explained.

"Automatic image transmission processing" means that, in the imaging device 1, when a captured image is acquired from the imaging unit 16, a communication connection is established with the portable terminal 2 by the second communication method, and the photographing is performed. It refers to a series of processing of transmitting an image to the portable terminal 2 and automatically receiving the image in the portable terminal 2 .

When the automatic image receiving process is executed on the imaging device 1 side, as shown in FIG. 4 , the shooting control unit 51 and the communication control unit 52 function in the CPU 11 - 1 .

In one area of the storage unit 19 - 1, an image storage unit 71 is set.

In the image storage unit 71, data of a captured image obtained from the imaging unit 16 is stored.

The shooting control unit 51 controls the imaging unit 16 to execute shooting processing. As a result, a captured image is output from the imaging unit 16 . The output captured image is stored in the image storage unit 71 .

The communication control unit 52 performs communication in LE (Wi-Fi), which is the first communication method (second communication method), and the first communication unit 20- 1) Control the [second communication unit 21-1].

Specifically, the communication control unit 52 performs communication by Wi-Fi, which is the second communication method, for example, and transmits an image captured by the imaging device 1 to the mobile terminal 2. The communication unit 21-1 is controlled.

In addition, when the automatic image receiving process is executed on the portable terminal 2 side, as shown in Fig. 4, in the CPU 11 - 2, the application management unit 91 and the communication control unit 92 function. do.

In one area of the storage unit 19 - 2, an image storage unit 111 is set.

The image storage unit 111 stores captured image data acquired from the imaging device 1 .

The application management unit 91 manages startup and termination of applications (application programs).

Specifically, the application management unit 91 performs communication in LE, which is the first communication method, for example, and executes an application program (hereinafter simply “application” or “application”) in the first communication unit 20 - 2 . ) is received, the specified application is launched. In the present embodiment, the application management unit 91 activates an application that performs communication control in Wi-Fi to exert a communication control function. Incidentally, "activation" in an application or device includes a case of resuming execution of an application during a pause (running in the background) other than a case of newly executing an application, and also a case where the power is turned on from an off state. It also includes cases involving the implementation of

The communication control unit 92 performs communication in LE (Wi-Fi), which is a first communication method (second communication method), and a first communication unit ( 20-2) (the second communication unit 21-2) is controlled.

Specifically, the communication control unit 92 controls the second communication unit 21 - 2 to receive an image from the imaging device 1 by, for example, performing communication by Wi-Fi as the second communication method. .

FIG. 9 is a flowchart for explaining the flow of automatic image reception processing executed by the imaging device 1 and portable terminal 2 of FIG. 3 having the functional configuration of FIG. 4 .

In the automatic image receiving process starting state, pairing of LE, which is the first communication method, has been completed between the imaging device 1 and the portable terminal 2, and they are always connected. In addition, although Wi-Fi, which is the second communication method, is in an OFF state, between the imaging device 1 and the portable terminal 2, Wi-Fi settings (profiles) are mutually acquired, and Wi-Fi At startup, a one-to-one communication connection can be easily established between the imaging device 1 and the portable terminal 2 .

<Automatic image transfer processing on imaging device 1 side>

In Step S311 - 1 , the shooting control unit 51 controls the imaging unit 16 to execute shooting processing. As a result, a captured image is output from the imaging unit 16 . The output captured image is stored in the image storage unit 71 .

In Step S312 - 1 , the communication control unit 52 performs communication in LE, which is the first communication method, with respect to the mobile terminal 2, and transmits an instruction to activate the application, the first communication unit 20 - 1 to control As a result, in the mobile terminal 2 that has received the instruction to launch the app, the app is launched. In this embodiment, an application that performs communication control in Wi-Fi is started, and the communication control function is exhibited.

In Step S313 - 1 , the communication control unit 52 performs communication with the mobile terminal 2 in LE, which is the first communication method, and obtains access point information of the imaging device 1 (hereinafter referred to as "camera AP information"). ”) is controlled to transmit the first communication unit 20 - 1 . As a result, in the portable terminal 2 that has received the camera AP information, Wi-Fi is turned on in the ST (station) mode in which the portable terminal 2 serves as a sub device.

In Step S314 - 1 , the communication control unit 52 controls the second communication unit 21 - 1 to turn on Wi-Fi in AP (Access Point) mode serving as the main device.

In step S315 - 1, the communication control unit 52 performs communication by Wi-Fi, which is the second communication method, and checks whether or not the second communication unit 21 - 1 has established a connection with the portable terminal 2 is determined (if the connection with the portable terminal 2 has not been established, wait for a connection request from the portable terminal 2 to establish the connection).

If the connection with the portable terminal 2 is established, it is determined as YES in step S315 - 1 , and the process proceeds to step S318 - 1 . The process of step S318-1 will be described later.

In contrast, in the case where a connection with the portable terminal 2 has not been established, it is determined as NO in step S315 - 1 , and the process proceeds to step S316 - 1 .

In Step S316 - 1 , the communication control unit 52 determines whether or not the time has elapsed due to the lapse of a preset time.

If there is no time interruption, it is determined as NO in step S316 - 1 , and the process returns to step S315 - 1 .

In the case of a time interruption, it is determined as YES in step S316-1, and the process proceeds to step S317-1.

In Step S317 - 1, an error message or the like is displayed, and the communication control unit 52 controls the second communication unit 21 - 1 to turn off Wi-Fi (at this time, Wi-Fi is not turned off immediately). , Reconnection may be attempted according to the user's instruction, or repeated reconnection may be attempted automatically for a certain period of time). After that, the process returns to step S311 - 1.

In Step S318 - 1, the communication control unit 52 performs communication by Wi-Fi, which is the second communication method, and sends the captured image to the portable terminal 2 connected to the second communication unit 21 -1) is controlled. As a result, a captured image taken by Wi-Fi is transmitted. After that, the automatic image receiving process on the imaging device 1 side ends.

<Automatic image reception processing on the portable terminal 2 side>

In step S311 - 2 , the application management unit 91 performs communication by BLE, which is the first communication method, and upon receiving an instruction to launch an app in the first communication unit 20 - 2 , activates the designated application. . In this embodiment, an application that performs communication control in Wi-Fi is started, and the communication control function is exhibited.

In Step S312 - 2, the communication control unit 92 turns on Wi-Fi in the ST mode when communication is performed by BLE, which is the first communication method, and camera AP information is received from the imaging device 1. The second communication unit 21 - 2 is controlled.

In Step S313 - 2 , the communication control unit 92 controls the second communication unit 21 - 2 to search for the imaging device 1 of the access point (AP) corresponding to the received camera AP information.

In Step S314 - 2, the communication control unit 92 determines whether or not the imaging device 1 of the access point (AP) has been found.

If the imaging device 1 of the access point is found (or if a connection with the imaging device 1 has already been established), it is determined YES in step S314-2, and the process proceeds to step S317-2. . Processing after step S317-2 will be described later.

In contrast, when the imaging device 1 of the access point is not found, it is determined NO in step S314 - 2 , and the process proceeds to step S315 - 2 .

In Step S315 - 2 , the communication control unit 92 determines whether or not the time has elapsed due to the lapse of a preset time.

If it is not a time interruption, it is determined as NO in step S315 - 2 , and the process returns to step S314 - 2 .

In the case of time interruption, it is determined as YES in step S315 - 2 , and the process proceeds to step S316 - 2 .

In step S316 - 2 , an error message or the like is displayed, and the application management unit 91 terminates the application started in step S311 - 2 . By terminating the application, the Wi-Fi communication function in the second communication unit 21 - 2 is turned off (at this time, Wi-Fi that has just ended the application is not turned off, and reconnection is attempted according to the user's instruction or During this time, you may automatically attempt repeated reconnection). After that, the process returns to step S311-2.

In Step S317 - 2, the communication control unit 92 performs communication by Wi-Fi, which is the second communication method, connects to the imaging device 1 of the access point (AP), and transmits the fact of the connection to the imaging device ( 1) The second communication unit 21 - 2 is controlled to notify (establish communication connection with the imaging device 1).

In Step S318 - 2 , the communication control unit 92 controls the second communication unit 21 - 2 to receive the image transmitted from the imaging device 1 . The received image is stored in the image storage unit 111. After that, the automatic transmission/reception processing on the portable terminal 2 side ends.

Next, the remote operation process is explained.

Further, "remote operation processing" means that when a coordinated operation is instructed by a user operation in the portable terminal 2 and various coordinated operation modes such as the REC mode/PLAY mode are selected, the interaction with the imaging device 1 is controlled. This refers to a series of processing that establishes a communication connection by a two-communication system and causes the imaging device 1 to execute an operation corresponding to the selected coordinated operation mode.

When mode operation processing is executed on the imaging device 1 side, as shown in FIG. 4 , the shooting control unit 51 and the communication control unit 52 function in the CPU 11 - 1 .

In one area of the storage unit 19 - 1, an image storage unit 71 is set.

In the image storage unit 71, data of a captured image acquired from the imaging unit 16-1 is stored.

The shooting control unit 51 controls the imaging unit 16 - 1 to shoot a through image for the REC mode. As a result, a through image is output from the imaging unit 16 - 1 .

The communication control unit 52 performs communication in BLE (Wi-Fi), which is the first communication method (second communication method), and the first communication unit 20- 1) Control the [second communication unit 21-1].

Specifically, in the REC mode, for example, the communication control unit 52 communicates the through image from the imaging unit 16 - 1 by Wi-Fi as the second communication method, and transfers the mobile terminal ( 2) Controls the second communication unit 21 - 1 to transmit. Further, in the PLAY mode, the communication control unit 52 transmits a list of images stored in the image storage unit 71 to the portable terminal 2 by performing communication using Wi-Fi as the second communication method. The second communication unit 21-1 is controlled.

In addition, when the automatic image receiving process is executed on the portable terminal 2 side, as shown in Fig. 4, in the CPU 11 - 2, the application management unit 91 and the communication control unit 92 function. do.

In one area of the storage unit 19 - 2, an image storage unit 111 is set.

The image storage unit 111 stores image data obtained from the imaging device 1 .

The application management unit 91 manages the startup and termination of applications.

Specifically, the application management unit 91, for example, performs communication by BLE, which is the first communication method, and upon receiving an instruction to launch an app in the first communication unit 20 - 2 , activates the designated application. do. In the present embodiment, the application management unit 91 activates an application that performs communication control in Wi-Fi to exert a communication control function.

The communication control unit 92 performs communication in BLE (Wi-Fi), which is the first communication method (second communication method), and the first communication unit 20- 2) Control the [second communication unit 21-2].

Specifically, in the REC mode, for example, the communication control unit 92 communicates the through image from the imaging unit 16 - 1 by Wi-Fi, which is the second communication method, and transmits the through image to the imaging device ( Control the second communication unit 21 - 2 to receive from 1). Further, in the PLAY mode, the communication control unit 92 receives a list of images stored in the image storage unit 71 from the imaging device 1 through communication using Wi-Fi as the second communication method. The second communication unit 21 - 2 is controlled.

FIG. 10 is a flowchart for explaining the flow of remote operation processing executed by the imaging device 1 and portable terminal 2 of FIG. 3 having the functional configuration of FIG. 4 .

In the start state of the mode operation process, pairing of BLE, which is the first communication method, has been completed between the imaging device 1 and the portable terminal 2, and they are always connected. In addition, although Wi-Fi, which is the first communication method, is in an off state, between the imaging device 1 and the portable terminal 2, Wi-Fi settings (profiles) are mutually acquired, and Wi-Fi At startup, a one-to-one communication connection can be established between the imaging device 1 and the portable terminal 2 .

<Remote operation processing on imaging device 1 side>

In Step S411 - 1, the imaging device 1 is activated in response to a request from the portable terminal 2 via communication in BLE, which is the first communication method, and sets a designated coordinated operation mode from the portable terminal 2 do. In the present embodiment, the coordinated operation mode includes a REC mode in which photographing is performed while checking a through image from the imaging device 1 in the portable terminal 2, and a Any one of the PLAY modes for viewing a list of stored images is set.

In step S412 - 1, the communication control unit 52 controls the first communication unit 20 - 1 to perform communication with the portable terminal 2 by BLE, which is the first communication method, and transmit camera AP information do. As a result, in the portable terminal 2 that has received the camera AP information, Wi-Fi is turned on in the ST (station) mode in which the portable terminal 2 serves as a sub device.

In Step S413 - 1 , the communication control unit 52 controls the second communication unit 21 - 1 to turn on Wi-Fi in AP (Access Point) mode serving as the main device.

In step S414 - 1, the communication control unit 52 performs communication by Wi-Fi, which is the second communication method, and checks whether or not the second communication unit 21 - 1 has established a connection with the portable terminal 2 to judge

If the connection with the portable terminal 2 is established, it is determined as YES in step S414 - 1 , and the process proceeds to step S417 - 1 . The processing of step S417 - 1 will be described later.

In contrast, in the case where a connection with the portable terminal 2 has not been established, it is determined as NO in step S414 - 1 , and the process proceeds to step S415 - 1 .

In Step S415 - 1 , the communication control unit 52 determines whether or not the time has elapsed due to the lapse of a preset time.

If there is no time interruption, it is determined as NO in step S415 - 1 , and the process returns to step S414 - 1 .

In the case of time interruption, it is determined as YES in step S415 - 1 , and the process proceeds to step S416 - 1 .

In Step S416 - 1 , the communication control unit 52 controls the second communication unit 21 - 1 to turn off Wi-Fi. After that, the process returns to step S411 - 1.

In Step S417 - 1 , the shooting control unit 51 and the communication control unit 52 operate in the mode designated in Step S411 - 1 . That is, when the designated mode is the REC mode, the shooting control unit 51 controls the imaging unit 16 - 1 to capture a through image to obtain a through image. Then, the communication control unit 52 controls the second communication unit 21 - 1 to perform communication by Wi-Fi, which is the second communication method, and to transmit the acquired through image to the portable terminal 2 . Further, when the designated mode is the PLAY mode, the communication control unit 52 performs communication by Wi-Fi, which is the second communication method, and displays a list of images stored in the image storage unit 111 to the portable terminal 2. The second communication unit 21 - 1 is controlled to transmit to .

After that, the mode operation process on the imaging device 1 side ends.

<Remote operation processing on the portable terminal 2 side>

In step S411 - 2 , the application management unit 91 activates the application by the user's operation of the input unit 17 or the like. In the present embodiment, an application that exhibits a function of specifying a mode is started, and the function of specifying a mode is exhibited.

In Step S412 - 2, when the user operates the input unit 17 to select one of a plurality of linked operation modes including the REC mode and the PLAY mode, the communication control unit 92 determines the first communication method The second communication unit 21 - 2 is controlled to transmit instruction information for instructing the imaging device 1 to activate and set the selected linked operation mode through communication in the BLE. In the present embodiment, the coordinated operation mode includes a REC mode in which photographing is performed while checking a through image from the imaging device 1 in the portable terminal 2, and a Any one of the linked operation modes in the PLAY mode for viewing a list of stored images is set.

In Step S413 - 2, the communication control unit 92 turns on Wi-Fi in the ST mode when communication is performed by BLE, which is the first communication method, and camera AP information is received from the imaging device 1. The second communication unit 21 - 2 is controlled.

In step S414 - 2 , the communication control unit 92 controls the second communication unit 21 - 2 to search for the imaging device 1 of the access point (AP).

In step S415 - 2, the communication control unit 92 determines whether or not the imaging device 1 of the access point (AP) has been found.

If the imaging device 1 of the access point is found, it is determined YES in step S415 - 2 , and the process proceeds to step S418 - 2 . Processing after step S418-2 will be described later.

In contrast, when the imaging device 1 of the access point is not found, it is determined NO in step S415 - 2 , and the process proceeds to step S416 - 2 .

In Step S416 - 2 , the communication control unit 92 determines whether or not the time has elapsed due to the lapse of a preset time.

If it is not a time interruption, it is determined as NO in step S416 - 2 , and the process returns to step S415 - 2 .

In the case of a time interruption, it is determined as YES in step S416 - 2 , and the process proceeds to step S417 - 2 .

In step S417 - 2 , the application management unit 91 terminates the application activated in step S411 - 2 . By ending the application, the Wi-Fi communication function in the second communication unit 21 - 2 is turned off. After that, the process returns to step S411-2.

In step S418 - 2, the communication control unit 92 performs communication with the imaging device 1 by Wi-Fi as the second communication method, and connects to the imaging device 1 of the access point (AP). , the second communication unit 21 - 2 is controlled so as to notify the imaging device 1 of the connection.

In Step S419 - 2, the communication control unit 92 confirms the designated linked operation mode.

If the designated coordinated operation mode is REC, it becomes [REC] in step S419 - 2 , and the process proceeds to step S420 - 2 .

In step S420 - 2 , the communication control unit 92 performs communication with the imaging device 1 by Wi-Fi as the second communication method, and acquires a through image. Then, the acquired through image is displayed on the output unit 18 - 2 . The user performs an operation such as a shooting instruction while browsing through images captured by the imaging device 1 . After that, the mode operation processing on the portable terminal 2 side ends.

In contrast, when the designated mode is PLAY, it becomes [PLAY] in step S419 - 2 , and the process proceeds to step S421 - 2 .

In step S421 - 2, the communication control unit 92 performs communication with the imaging device 1 by Wi-Fi as the second communication method, and acquires a list of images stored in the image storage unit 71 do. Then, a list of acquired images is displayed on the output unit 18 - 2 . The user performs operations such as selecting an image to be acquired from the imaging device 1 while browsing a list of images stored in the imaging device 1 . After that, the mode operation processing on the portable terminal 2 side ends.

Next, a display operation showing the communication status that changes before and after the change in the radio wave state or the power supply state of devices, or the execution of linkage preparation processing (pairing processing), automatic image transfer processing, and remote operation processing will be described.

11 is a schematic diagram showing display of communication status in the imaging device 1 and portable terminal 2. As shown in FIG.

As shown in the example of Fig. 11, the status display of the communication in the imaging device 1 and portable terminal 2 in the first communication method and the second communication method is configured to change the display for each status.

In the communication status, when neither pairing nor connection has been established (<pairing: no> <connection: no>), the status display is configured not to be performed.

In the communication status, when pairing is established but connection is not established (<Pairing: complete> <Connection: None>), the icons representing the first communication method and the second communication method are displayed in a broken line or semi-transparent state. It is configured to display as

In the case of pairing and connection in the communication status (<pairing: complete> <connection: yes>), icons indicating the first communication method and the second communication method are displayed.

FIG. 12 is a functional block diagram showing a functional configuration for executing image sharing processing among the functional configurations of the portable terminal 2 and server 3 in FIG. 3 .

"Image sharing processing" means that an image captured by the imaging device 1 is transmitted to the server 3 via the portable terminal 2, and the image is made viewable by other portable terminals 100. This is processing to share images.

When the image sharing process is executed on the portable terminal 2 side, as shown in Fig. 12, the communication control unit 92 and the application management unit 91 function in the CPU 11-2.

In one area of the storage unit 19 - 2, an image storage unit 111 is set.

The image storage unit 111 stores image data obtained from the imaging device 1 .

The communication control unit 92 controls communication in the second communication unit 21 - 2 . Specifically, the communication control unit 92 controls the second communication unit 21 - 2 to transmit instructions to the server 3 to create images or cloud albums or to set sharing destinations.

The application manager 91 manages and controls various application operations, and stores images received from the imaging device 1 in an app album installed in the image storage unit 111 .

In contrast, when image sharing processing is executed on the server 3 side, the application management unit 131 and the communication control unit 132 function in the CPU 11 - 3 as shown in FIG. 12 . .

In one area of the storage unit 19-3, an image storage unit 151 is set.

The image storage unit 151 stores image data acquired from the portable terminal 2 .

The application management unit 131 manages and controls various application operations, creates a cloud album in the image storage unit 151 according to instructions from the portable terminal 2, and, for example, other portable terminals serving as sharing destinations. A sharing setting is performed to register the mail address of (100), or an image received from the portable terminal 2 is stored in a cloud album of the created image storage unit 151.

The communication control unit 132 controls communication in the second communication unit 21 - 3 . Specifically, the communication control unit 92 transmits, to the other portable terminal 100, a sharing notification describing the location of the image to be shared to the registered mail address based on the sharing setting, and the second communication unit 21-3 ) to control. In this embodiment, a URL describing the location of the image is described in the sharing notification. In the other portable terminal 100 that has received the notification of sharing, it is possible to view the image or the like by accessing the URL described in the notification.

Next, in step S318 - 2 of the automatic transfer processing of Fig. 9 in the case where image sharing with other portable terminals 100 via the server 3 is set, after receiving the image, via the server 3 When image sharing is set, the flow of FIG. 16 is executed.

FIG. 13 is a flowchart for explaining the flow of image sharing processing executed by the portable terminal 2 and server 3 of FIG. 3 having the functional configuration of FIG. 12. As shown in FIG. Then, this flowchart is executed when image sharing with other portable terminals 100 via the server 3 is set, and after receiving an image in step S318 - 2 of the automatic transmission process in Fig. 9 , processing performed between the portable terminal 2 and the server 3.

<Image sharing processing on the portable terminal 2 side>

In step S511 - 1 , the communication control unit 92 transmits a cloud album creation instruction to the server 3 . Upon receiving this, the server 3 creates a cloud album in the image storage unit 151.

In Step S512 - 1 , the communication control unit 92 transmits an instruction for setting a sharing destination (registration of mail addresses of other mobile terminals 100 as sharing destinations in this embodiment). Upon receipt of this, the server 3 performs the sharing destination setting.

In Step S513 - 1 , the second communication unit 21 - 2 receives an image from the imaging device 1 by Wi-fi communication.

In Step S514 - 1, the application management unit 91 receives the image from the imaging device 1, and stores the image for transmission to the server 3 in the application album of the image storage unit 111. Then, in the imaging device 1, an image having a size based on the "resize when sending" setting is transmitted.

In Step S515 - 1, the communication control unit 92 transmits the image to the server 3. Upon receiving this, the server 3 stores the received image in the cloud album of the image storage unit 151.

<Image sharing processing on the server 3 side>

In Step S511 - 2 , the second communication unit 21 - 3 receives an instruction to create a cloud album from the portable terminal 2 .

In Step S512 - 2 , the application management unit 131 creates a cloud album in the image storage unit 151 .

In step S513 - 2 , the second communication unit 21 - 3 receives an instruction for setting sharing from the portable terminal 2 .

In Step S514 - 2, the application management unit 131 performs sharing settings. Specifically, the mail address of the sharing destination is registered.

In step S515 - 2 , the second communication unit 21 - 3 receives an image for sharing from the portable terminal 2 .

In Step S516 - 2, the application management unit 131 stores the received image in the cloud album of the image storage unit 151.

In Step S517 - 2, the communication control unit 132 transmits a sharing notification describing the location of the image to be shared to the registered mail address based on the sharing settings. In this embodiment, a URL describing the location of the image is described in the sharing notification. In the other mobile terminal 100 receiving the notification of sharing, the image can be viewed or the like by accessing the URL described in the notification.

In the communication step T structured as described above, the image is automatically sent to the smartphone (portable terminal 2) just by shooting with the camera (imaging device 1), and the image is also sent to the cloud album and automatically It has the function of sending a notification to the sharing partner.

Conventionally, there has been a technique for automatically transferring captured images from a camera to a smartphone, but there has been no technique for sharing images from just storing them in a smartphone.

Therefore, in the communication step T of the present embodiment, the following operation is performed.

○ Pair the camera and smart phone with BLE according to the procedure.

○ When performing pairing, the smartphone application determines the OS of the smartphone and sends the information to the camera.

○ Store the access point information of the camera in the smartphone, and enable automatic Wi-Fi connection from the smartphone to the camera.

○ Create an album to share in the cloud album.

○ Set the sharing partner in the shared album.

○ When an image is received from a camera with a smartphone application, set to share it in a cloud album.

○ When shooting with a camera, the access point of the camera is activated, and a BLE instruction is given to the smartphone to connect to the access point of the camera. At this time, it is judged whether or not to forcibly switch to the access point according to the determination result of the OS of the smart phone.

○ Depending on the smartphone OS determination result, an instruction is given to the BLE and the cloud album application is also started.

○ When the camera confirms Wi-Fi connection from the smartphone, the captured image is transferred to the smartphone. The size at this time depends on the "Resize when sending" setting of the camera.

○ When the smartphone application receives an image from the camera, it saves the image in a designated location on the smartphone and transmits the image to the cloud album. The image exchange method between the camera image receiving application and the cloud album application is changed according to the OS determination result of the smartphone.

○ When the image arrives, the cloud album side notifies the sharer that the image has been registered in the album.

○ The sharer who received the notification can access the cloud album and check the image by manipulating the notification.

As a result, in the communication step T of the present embodiment, it is possible to obtain the following effects.

○ Captured images can be automatically transferred from the camera to a smartphone.

○ Images automatically received by the smartphone can be shared to cloud albums without operating the smartphone.

○ Users are not conscious of differences in OS of smart phones.

<Application-linked processing by BLE>

Application linkage processing by BLE is a part not mentioned in FIGS. 9 and 13 , and is a constraint of the OS that is a premise for executing the processing in FIG. 9 or FIG.

In the communication system S of the present embodiment, it has a function of linking operation between a plurality of applications using the notification function of BLE.

Conventionally, a "URL scheme", which is a configuration of coordinated operation among a plurality of applications running on a specific OS (e.g., iOS), can only be used by an application running in the foreground. However, there is a restriction that it cannot be used while it is running in the background, and an application running in the background cannot use a "URL scheme" to link with other applications. On the other hand, BLE functions can be used even in applications running in the background.

Then, in the communication system S of this embodiment, it operates as follows.

- A BLE profile for requesting and notifying the activation of the application is installed in the camera.

· The app that has the initiative (app A) connects (pairs) the camera and BLE, notifies the BLE connection information to a separate app (app B), and the app A and B share the BLE connection.

· App B prepares and waits so that it can obtain application start notification from the BLE connection information.

· App A executes the application activation request, the camera receives it and notifies application B of application activation, and application B which receives it starts operation.

When app A cancels pairing with the camera, app B is notified, and app B ends waiting for BLE notification.

Therefore, in the communication system S of the present embodiment, in a plurality of applications that operate on iOS, cooperative operation is possible even during operation in the background. Also, after canceling pairing, it does not unnecessarily wait for notification of BLE.

Next, the operational configuration of the application will be described. 14 is a configuration diagram of an operation of an application in the imaging device 1 and portable terminal 2 in the communication system S of the present embodiment.

Application A stores an image automatically transmitted from the camera.

The application B realizes a linkage function of registering an image stored by the application A in an album managed by the application B.

The imaging device 1 is a peripheral in BLE, and is equipped with a BLE profile for application linkage.

The portable terminal 2 operating in a specific OS is central in BLE and shares a BLE connection with the app A and the app B.

The imaging device 1 and the iOS device are connected by BLE, and information of a BLE profile is transferred.

Next, the operation sequence is shown. 15 is a flowchart showing an operation sequence in the imaging device 1 and portable terminal 2 in the communication system S of the present embodiment.

App A performs pairing with the camera, and notifies BLE connection information to app B using a URL scheme. Since application A is running in the foreground, it can use the URL scheme.

The app B starts waiting for the BLE notification by making preparations so that it can obtain the app startup notification (notification of the application B startup notification characteristic) from the BLE connection information.

When the OS is put to sleep, application A becomes a background operation.

App A receives and saves an automatically transmitted image from the camera while operating in the background, requests application B to start up to the camera (writes data into the application B start request characteristic), and the camera accepts it and starts up application B Notification by the notification characteristic is performed, and the application B waiting for it is activated and the image is registered in the album managed by the application B.

When app A cancels the pairing with the camera, it notifies app B using the URL scheme, and app B ends waiting for BLE notification.

<Imaging device side processing>

The processing on the imaging device side is initiated by the user's operation of starting the processing on the imaging device side to the input unit 17 - 1 . Then, after the processing starts, between the imaging device 1 and the mobile terminal 2 (with the application A), it operates so that pairing (connection) of BLE communication and Wi-Fi communication is established.

In Step S611 - 1 , the shooting control unit 51 controls the imaging unit 16 - 1 to take a picture, and the communication control unit 52 performs a second step so as to transmit the captured image to the portable terminal 2 . The communication unit 21-1 is controlled.

Then, when the activation request of the app B from the application A of the portable terminal 2 is via BLE, the communication control unit 52 transmits an activation notification to the application B of the portable terminal 2 via BLE The first communication unit 20 - 1 is controlled to do so. As a result, the application B of the portable terminal 2 is started, and the transmitted image is registered in the album. After that, pairing (connection) with the portable terminal 2 is released, and processing on the imaging device side ends.

<App A side processing>

The processing on the portable terminal 2 side in the apps A and B is initiated by the user's operation of the portable terminal side processing start to the input unit 17 - 2 . Then, after the processing starts, between the imaging device 1 and the portable terminal 2, the application A of the portable terminal 2 operates so that pairing (connection) of BLE communication and Wi-Fi communication is established. When pairing is established, app A provides BLE connection information to app B.

In Step S611 - 2 , the application management unit 131 controls the application A to be in the background operation due to the OS sleep.

In Step S612 - 2 , the application management unit 131 controls to store the image in the image storage unit 151 by the application A when receiving an image from the imaging device 1 . After that, the communication control unit 92 controls the first communication unit 20 - 2 to transmit an activation request from the application A to the application B via the BLE, under the application management unit 91 .

In Step S613 - 2 , the application manager 131 operates the app A in the foreground to perform a pairing release operation. As a result, pairing (connection) with the imaging device 1 is released, a pairing release notification is provided to app B, and processing on the app A side ends.

<Application B side processing>

In step S611 - 3 , the application management unit 131 receives the BLE connection information provided from the app A, and controls the app B to start waiting for BLE notification.

In Step S612 - 3, the application management unit 131 controls the application B to enter the background operation due to the OS sleep.

In Step S613 - 3 , the application manager 131 performs control to operate in the foreground in response to a request for launching the application from the imaging device 1 , and the communication control unit 132 controls the application stored in the image storage unit 151 . The second communication unit 21 - 2 is controlled to transmit the image to the cloud server, the image is stored in a predetermined storage area of the cloud server, and album registration is performed.

In Step S614 - 3 , the application management unit 131 receives the pairing release notification from the app A, and controls the app B to end the waiting for BLE notification. After that, processing on the application B side ends.

<Example of modification>

This example is another example in the case of executing the image sharing processing of FIG. 13 after receiving an image in step S318 - 2 of the automatic transmission processing of FIG. 9 .

In the embodiment described above, the linked apps are not limited to two.

In addition, the BLE profile for application linkage may be implemented in a device other than the imaging device 1 .

<Processing album registration in the automatic image transmission camera>

The communication system S of this embodiment has an album registration function in an automatic image transmission camera. That is, in the communication system S of the present embodiment, the automatic transmission compatible camera has a function of automatically transferring images and registering them in an album on the net by setting the album in advance.

Background Art [0002] Conventionally, a function for automatically transmitting a captured image to a terminal side after photographing with a camera is installed between a camera and a mobile terminal such as a smart phone. Conventionally, after transmitting an image to a mobile terminal through a wireless connection, the user had to manually register the image in an SNS or register in an album service on the net. Album sharing of many images is a problem that requires a lot of effort, and since it is possible to transmit many images especially in this camera having an automatic transmission function, a function corresponding to this has been demanded.

So, in the communication system S of this embodiment, the following operation is performed.

1. I choose an album by application beforehand

Before starting the operation, as shown in Fig. 16, whether an album is selected in the app in advance and the image automatically transmitted to the camera is registered in the album in the transfer app on the mobile terminal side corresponding to the camera is checked. Select and choose which album to register to. 16 is a schematic diagram showing an album selection screen in the application.

As for the operation of the processing, as shown in Figs. 17 and 18, if "Share album" is turned ON in advance and then automatically transmitted using the camera, it is registered in the album according to this setting. Fig. 17 is a flowchart for explaining the flow of an album registration process, and Fig. 18 is a flowchart for explaining the flow of an automatic transmission process.

<Processing Album Settings>

The album setting process is initiated by the user's operation of starting the album setting process to the input unit 17 - 2 .

In step S711, the communication control unit 132 controls the second communication unit 21 - 2 to perform album service authentication to the server 3 .

In step S712, as a result of authentication control with the server 3, the communication control unit 132 determines whether authentication is OK.

If authentication is OK, it is determined as YES in step S712, and the process proceeds to step S714.

In contrast, when authentication is not OK, it is determined NO in step S712, and the process proceeds to step S713.

In step S713, since it is authentication NG, the CPU 11 - 2 controls the output unit 18 - 1 to display an error.

In step S714, the communication control unit 132 controls the second communication unit 21 - 2 to obtain a list of albums from the server 3 .

In step S715, the CPU 11 - 2 controls the output unit 18 - 2 to display a list of albums acquired from the server 3 .

In step S716, an operation to select an album in the album sharing setting is performed on the input unit 17 - 2 by a user operation, and the application management unit 131 selects an album to be shared. After that, the album setting process ends.

<Auto Send Processing>

Incidentally, this automatic transmission process is another example of the automatic transmission process in FIG. 9 .

The automatic transmission process is initiated by the user's operation of starting the automatic transmission process to the input unit 17-1.

In step S811, the communication control unit 132 controls the second communication unit 21 - 2 to receive an image from the imaging device 1 .

In step S812, the application management unit 131 stores the received image in the image storage unit 151.

In step S813, the application management unit 131 determines whether the album share setting is ON.

If the album share setting is turned ON, it is determined YES in step S813, and the process proceeds to step S814.

In contrast, when the album share setting is not turned ON, it is determined NO in step S813, and the process ends.

In step S814, the communication control unit 132 controls the second communication unit 21 - 2 to store the image stored in the image storage unit 151 in a predetermined storage area of the server 3, and registers the album. do After that, the automatic transmission process ends.

2. Select an album with the camera in advance

In the operation of 1, the album is selected on the app side, but the album information acquired on the app side is notified to the camera, and the camera side can also select an album.

The camera performs album setting in advance before shooting. Album information is acquired by an application on a mobile terminal through communication (either BLE or Wi-Fi), and by notifying the camera of this, the album information is displayed on the camera. When viewing the screen of the camera, the user selects an album and sets whether or not to share the album.

In automatic transmission, a selected album ID is added to a captured image and transmitted to the mobile terminal. On the terminal side, registration is performed in the album according to the album ID of the received image.

Fig. 19 is a flowchart for explaining the flow of an album selection process on the camera side, and Fig. 20 is a flowchart for explaining the flow of an image registration process.

<Processing album settings on the imaging device side>

The album setting process on the imaging device 1 side is initiated by the user's operation of starting the album setting process to the input unit 17 - 1 .

In Step S911 - 1 , the communication control unit 92 controls the second communication unit to obtain a list of albums from the server 3 .

In step S912 - 1 , the CPU 11 - 1 controls the output unit 18 - 1 to display a list of albums obtained from the server 3 .

In Step S913 - 1 , the input unit 17 - 1 is subjected to an operation to select an album in album share setting by user operation, and the application management unit 91 selects an album to be shared. After that, the album setting process on the imaging device 1 side ends.

<Acquisition process of album list on mobile terminal>

The album list acquisition process on the portable terminal 2 side is initiated by the user's operation of starting the album list acquisition process to the input unit 17 - 2 .

In Step S911 - 2 , the communication control unit 132 controls the second communication unit 21 - 2 to perform album service authentication to the server 3 .

In Step S912 - 2 , as a result of the authentication control with the server 3 , the communication control unit 132 determines whether authentication is OK.

If authentication is OK, it is determined YES in Step S912 - 2 , and the process proceeds to Step S913 - 2 .

In contrast, when authentication is not OK, it is determined NO in Step S912 - 2 , and the album list acquisition process on the portable terminal 2 side ends.

In step S913 - 2 , the communication control unit 132 controls the second communication unit 21 - 2 to obtain a list of albums from the server 3 .

In Step S914 - 2 , the communication control unit 132 controls the second communication unit 21 - 2 that notifies the imaging device 1 of the list of albums acquired from the server 3 . After that, the album list acquisition process on the portable terminal 2 side ends.

<Automatic transmission processing on the imaging device side>

The automatic transmission process on the imaging device 1 side is initiated by the user's operation of starting the automatic transmission process to the input unit 17 - 1 .

In step S1011 - 1 , the shooting control unit 51 controls the imaging unit 16 - 1 - 1 to perform shooting.

In step S1012 - 1 , the shooting control unit 51 stores the captured image in the image storage unit 71 .

In step S1013 - 1, the communication control unit 52 determines whether the album share setting is ON.

If the album share setting is ON, it is determined YES in step S1013-1, and the process proceeds to step S1014-1.

In contrast, if the album share setting is not ON, it is determined NO in step S1013 - 1 , and the process proceeds to step S1015 - 1 .

In step S1014 - 1, the communication control unit 52 adds an album ID to an image to be transmitted for sharing.

In step S1015 - 1 , the communication control unit 52 controls the second communication unit 21 - 1 to transmit the image to which the album ID has been added to the portable terminal 2 . After that, the automatic transmission processing on the imaging device 1 side ends.

<Processing album registration on mobile terminal>

The album registration process on the portable terminal 2 side is initiated by the user's operation of starting the album registration process on the portable terminal side to the input unit 17 - 2 .

In step S1011 - 2 , the communication control unit 92 controls the second communication unit 21 - 2 to receive an image from the imaging device 1 .

In step S1012 - 2 , the application management unit 91 stores the received image in the image storage unit 111 .

In step S1013 - 2 , the application management unit 91 determines whether or not an album ID exists.

If there is an album ID, it is determined YES in step S1013 - 2 , and the process proceeds to step S1014 - 2 .

In contrast, when there is no album ID, it is determined NO in step S1013 - 2 , and the album registration processing on the portable terminal 2 side ends.

In step S1014 - 2, the communication control unit 92 controls the second communication unit 21 - 2 to store the image stored in the image storage unit 151 in a predetermined storage area of the server 3, Album registration is performed.

After that, the album registration processing on the portable terminal 2 side ends.

3. We choose plural albums by camera and application

In the case of distinguishing multiple albums in operation 1 (for different purposes), the camera selects three types of album A, album B, and album C, and no album registration (N/A) on the album setting screen. . During recording (REC), the type of the selected album can be confirmed.

Further, in the application, it is selected in advance which album is specifically set for Album A, Album B, and Album C, respectively.

21 is a schematic diagram showing an example of screen display in the imaging device 1, and FIG. 22 is a schematic diagram showing an example of screen display in the imaging device 1.

Therefore, in the communication system S of the present embodiment, in the automatic transmission camera that automatically transmits many images to the mobile terminal, by setting the album in advance, not only the images are transmitted to the mobile terminal, but also the It can also be automatically sent to albums and shared. For example, it is convenient when taking a picture of today's exhibition and reporting it to a colleague. In addition, by notifying the camera of album information, the album name can be confirmed and selected by the camera body. In addition, album sharing can be performed easily when sharing albums with a plurality of themes by simply switching albums and shooting on the camera side.

<Example of modification>

In the operations 1 to 3 described above, although there was only one service providing albums, the delivery application side may select and set from a plurality of different services of the business entity. By configuring in this way, according to the modified example, it is possible to select and register an album from a plurality of services. On the camera side, since differences in services can be absorbed on the app side without being aware of a plurality of services, it is possible to easily share albums by different services.

In the data processing system structured as described above, the first device having a function of acquiring data and the second device having a function of managing data cooperate to realize a predetermined linked function.

The first device includes data transmission means for transmitting data to the second device via the first wireless communication means.

The second device is configured to execute a first program for executing data reception processing for receiving data from the first device via the first wireless communication means, and data management processing for managing data received by the data reception processing. storage means for storing a second program for processing; switching means for switching the first program and the second program between a stopped state and an active state; and control means for switching the second program from a suspended state to an active state when data is received by the reception processing, designating the received data as a management target, and executing data management processing.

In this way, in the data processing system, the convenience of data management can be improved.

When the first device receives a request for starting the second program from the first device via the second wireless communication means, the first device sends an activation notification of the second program to the second device via the second wireless communication means. The notification transmission means and the control means for the second device transmit a start request for the second program to the first device via the second wireless communication means when the second program cannot be started directly from the first program; , The second program is switched from the suspended state to the active state by the activation notification transmitted from the first device in response to the activation request.

The second wireless communication means is slower than the first wireless communication means, but it can save power, and the control means cannot start the second program by the first wireless communication means, and the second wireless communication means activates the second program. program can be started.

The data management process is a process of dividing designated data into one of a plurality of groups and managing it.

The control means designates the received data as a group management target and executes data management processing.

The second device includes group information transmission means for transmitting group information on a plurality of groups manageable by data management processing to the first device, and control means of the second device transmits data received from the first device to the first device. 1 Divide into groups designated by the group selection information received from the device and manage them.

The first device further includes selection information transmitting means for selecting a predetermined group from among a plurality of groups included in the group information received from the second device and transmitting the group selection information to the second device.

The second device stores the group selection information transmitted from the first device, and whenever new data is received from the first device, it is divided into groups specified by the stored group selection information and managed.

The second device divides the data received together with the group selection information from the first device into groups designated by the group selection information and manages them.

The first device displays a list of a plurality of groups included in the group information received from the second device, allows the user to select them, and transmits group selection information based on user operation to the second device.

The second device includes third communication means for communicating with a server providing a data sharing service on a network.

In the data management process, data received from the first device is designated as a sharing target and transmitted to the server via a third communication means.

The data sharing service is a service for classifying and sharing a plurality of data into a plurality of groups.

When the second device designates the received data as a sharing target and transmits the received data to the server to be shared, the second device designates a group designated by the group selection information.

The first device causes the user to select whether or not to share the acquired image, and transmits sharing permission information to the second device together with the group selection information.

The first device causes the user to select whether or not to share the acquired image, and transmits sharing permission information to the second device together with the group selection information.

The second device transmits the received data to the server when sharing is possible.

A service on a plurality of different networks providing a data sharing service is selected, and the received data is transmitted to a server providing the selected service.

The first device is an imaging device having a function of acquiring image data by shooting.

When new image data is obtained in a state in which the automatic transmission mode is set, the imaging device as the first device transmits the image data by the data transmission means.

The imaging device, which is the first device, stores and updates group selection information, and displays the currently selected group on the live view screen.

The second device has a plurality of different types, and the control means changes control of activation according to the type.

The first radio communication means is always connected, and the second radio communication means establishes a connection according to a request for connection via the first radio communication means, and changes connection establishment control according to the type.

BACKGROUND Conventionally, a technique for connecting an imaging device such as a digital camera and a portable terminal such as a smart phone by wireless communication has been used.

As an example of such technology, there is an imaging system that remotely operates a camera using a camera operating terminal (eg, see Japanese Laid-Open Patent Publication No. 2014-230024).

Further, in the mobile terminal, various application software such as image sharing application software for accessing an image sharing service on a network and sharing images with other users can be used, for example.

Using such a technique, the user operates the portable terminal, causes the camera to take a picture by remote operation, stores the image data transmitted from the camera in the portable terminal, and then activates the necessary application software and various By performing operations, it is possible to manage image data or use an image sharing service.

In this case, the user activates and operates different application software depending on the type of OS (operating software) of the mobile terminal (for example, iOS or Android).

However, in the case of using the above-described technology, for example, in order to use the image sharing service using a camera and a mobile terminal, the user either performs an operation to activate the necessary application software or conforms to the specifications of the activated application software. Therefore, it was necessary to perform various operations, or it took a lot of time. The same problem exists when various management of acquired data is not limited to the case of linking a camera and a mobile terminal, but by linking a device providing data with a device managing data.

The present embodiment has been made to solve such a problem, and aims to enhance convenience in the case of performing various management of acquired data by linking a device that provides data with a device that manages data.

<Third Embodiment>

<Pairing connection operation>

Although details were not explained in the above-described Embodiments 1 and 2, in this embodiment, the processing related to the constraints of the BLE communication standard, which is premised in the processing of Embodiments 1 and 2, will be described. The processing described in this embodiment is executed at the start of the processing of FIG. 9 or FIG. 10 or the like, or executed in parallel with the processing of FIG. 9 or FIG. 10 or the like.

In the communication system S of the present embodiment, when connecting an imaging device and a mobile terminal by BLE, an advertising signal is emitted from the imaging device, and the mobile terminal detects the signal and performs connection processing, thereby obtaining bluetooth (registered trademark). ) is established, but if the content of the advertising signal is the same in all states, the following problems (problems 1, 2, and 3) occur. In addition, increasing the information loaded on the advertising signal increases the data size of the signal, which is disadvantageous in terms of power.

[Problem 1]

Since the pairing settings can be changed with a portable terminal separate from the portable terminal in which pairing has been set, there is a problem in terms of security (extortion problem).

In a situation where there is an imaging device and a portable terminal that have been paired, and a BLE connection cannot be established due to the distance between the two, etc., the imaging device issues an advertisement signal and attempts to connect to the portable terminal. At this time, if a pairing operation is performed with a separate portable terminal, the imaging device and the portable terminal are connected and some operations are possible.

In addition, when the power of the imaging device is turned on, the contents of the BLE signal (SSID and password of Wi-Fi) are sent to the portable terminal C.

[Problem 2]

If there is a portable terminal that has been paired previously, pairing processing cannot be performed with another portable terminal because the portable terminal automatically executes pairing processing when a pairing operation is performed on the imaging device (mobile terminal change problem).

There is an imaging device and a portable terminal that have been paired, and pairing is canceled by operating the imaging device. When the imaging device is operated to pair a separate portable terminal and the imaging device, the portable terminal B is automatically connected to the imaging device. At this time, the portable terminal cannot continue the pairing process.

[Problem 3]

Imaging devices that are listed up by the pairing process of the portable terminal application are mixed with those that can be paired and those that cannot be paired (listing).

To such a problem, in the communication system S of this embodiment, the following countermeasure is adopted.

Depending on the connection state (presence or absence of pairing) of the imaging device 1 connected to the portable terminal 2, the device name is changed, and the change is used to perform processing on the smart phone. That is, according to BLE connection information (whether or not pairing is present), which is pairing information of the imaging device 1, a space character is added to the device name of the advertising signal to give a difference, and the portable terminal 2 Change the access control in the application of

Specifically, in the communication system S, the device name contained in the data of the advertising signal is changed according to the pairing state of the imaging device 1, and the application of the portable terminal 2 is determined by the device name. diverge processing. And it is premised that pairing is possible on a one-to-one basis by the imaging device 1 and the portable terminal 2 . In addition, the portable terminal 2 identifies the imaging device 1 as a pairing partner by its BD address, not by its device name, after connection establishment.

<Status where imaging device 1 is not paired>

The device name is the SSID of Wi-Fi without a space at the end.

Example: "ZR1600-01ACDC" (device name + no space)

・Do not automatically reconnect even when paired (avoid [problem 2]).

(Therefore, connection cannot be made without going through the pairing operation.)

<State that the pairing of the imaging device 1 has been completed>

A space is added at the end of the device name.

Example: "ZR1600-01ACDC " (with device name + space)

・Do not connect to a smart phone that is not paired (avoid [problem 1]).

[Connect only with the paired mobile terminal (2)]

· Not displayed in the list of candidates that can be paired with (avoiding [Problem 3]).

(Only devices that are not paired are displayed)

FIG. 23 is a functional block diagram showing a functional configuration for executing a pairing connection process among the functional configurations of the imaging device 1 and portable terminal 2 in FIG. 3 .

The pairing connection process refers to a series of processes for performing connection between the imaging device 1 and the portable terminal 2 by performing pairing in the BLE communication standard.

When pairing connection processing is executed with the imaging device 1, as shown in FIG. And, the communication control unit 173 functions.

Further, in one area of the storage unit 19 - 1, a communication information storage unit 191 is set.

In the communication information storage unit 191, pairing information obtained as a result of pairing processing (in this embodiment, information generated based on the SSID that is an identification name of an access point in wireless LAN (Wi-Fi)) and connection processing result The obtained connection information (BD address in this embodiment) is stored. The pairing information is a device name in an advertising signal used for pairing processing or the like, and a BD address used at the time of connection after completion of the pairing processing.

The pairing status determination unit 171 refers to the pairing information stored in the communication information storage unit 191 (refers to the presence or absence of pairing information) and determines the pairing status. The pairing situation judging unit 171 judges a situation in which pairing is not performed (hereinafter referred to as "non-pairing situation") when there is no pairing information, and when there is pairing information, a situation in which pairing is being performed (hereinafter referred to as "non-pairing situation"). , referred to as "pairing completion status").

The advertising signal generation unit 172 generates an advertising signal based on the result of the determination by the pairing situation determination unit 171 .

When the advertising signal is generated, the advertising signal generation unit 172 determines whether the pairing status determining unit 171 determines whether the pairing status is unpaired status or pairing status. Information added to the signal (hereinafter referred to as "advertising information") is changed.

In the case of a non-pairing situation, the advertising signal generation unit 172 converts the advertising information to "advertising signal of non-pairing specifications" such as "device name + no space (device name only)" and in the case of a pairing completion situation, a "pairing completion specification advertising signal" that sets the advertising information as "device name + space present" is generated.

The communication control unit 173 controls the first communication unit 20 - 1 . Specifically, the communication control unit 173 controls the first communication unit 20 - 1 so as to transmit an advertising signal or execute a pairing process or a connection process. Then, the pairing information and BD address obtained as a result of the pairing process or the connection process are stored in the communication information storage unit 191.

When performing pairing connection processing with the portable terminal 2, as shown in FIG. The gong signal determination unit 213 functions.

Further, in one area of the storage unit 19 - 2, a communication information storage unit 231 is set.

In the communication information storage unit 231, pairing information obtained when pairing is performed is stored. The pairing information is a device name in an advertising signal used for pairing processing or the like, and a BD address used at the time of connection after pairing processing is finished.

The communication control unit 211 controls the first communication unit 20 - 2 . Specifically, the communication control unit 211 controls the first communication unit 20 - 2 so as to detect an advertising signal or execute a pairing process or a connection process.

The pairing status determination unit 212 refers to the pairing information stored in the communication information storage unit 231 (refers to the presence or absence of pairing information) to determine the pairing status. When there is no pairing information, the pairing situation judging unit 212 determines as a situation in which pairing is not performed (hereinafter referred to as "non-pairing situation"), and in the case where there is pairing information, a situation in which pairing is being performed (hereinafter referred to as "non-pairing situation"). , referred to as "pairing completion status").

The advertising signal determination unit 213 determines whether the advertising information of the detected advertising signal is an advertising signal of an unpaired specification or an advertising signal of a paired specification. Specifically, the advertising signal determination unit 213 determines that the advertising information is an advertising signal of an unpaired specification when the advertising information is a device name + no space (only a device name); If the advertising information includes device name + space, it is determined that it is an advertising signal of an unpaired specification.

FIG. 24 is a flowchart for explaining the flow of pairing connection processing executed by the imaging device 1 and portable terminal 2 of FIG. 3 having the functional configuration of FIG. 23 .

<[Imaging Device Side] Pairing Connection Processing>

The pairing connection processing on the imaging device 1 side is initiated by the user's operation of starting the pairing connection processing to the input unit 17 - 1 .

In step S1111 - 1 , the pairing status determining unit 171 determines whether or not the pairing status is unpaired.

In the case of non-pairing, it is determined as YES in step S1111-1, and the process proceeds to step S1112-1.

In step S1112 - 1, the advertising signal generation unit 172 generates an advertising signal of the unpaired specification. Specifically, the advertising signal generation unit 172 generates an advertising signal of an unpaired specification in which information without a space is added to the device name.

In step S1113 - 1 , the communication control unit 173 controls the first communication unit 20 - 1 to transmit the advertising signal of the generated unpaired specification.

In step S1114 - 1 , the communication control unit 173 controls the first communication unit 20 - 1 to execute pairing processing with the portable terminal 2 .

In step S1115 - 1 , the communication control unit 173 controls the first communication unit 20 - 1 to execute connection processing based on the connection setting performed by the pairing processing. After that, the post-processing ends.

On the other hand, if it is not a non-pairing situation but a pairing situation where pairing is being performed, it is determined NO in step S1111-1, and the process proceeds to step S1116-1.

In Step S1116 - 1, the advertising signal generation unit 172 generates an advertising signal of pairing completion specifications. Specifically, the advertising signal generation unit 172 generates an advertising signal of a pairing complete specification in which information with a space is added to the device name.

In step S1117 - 1 , the communication control unit 173 controls the first communication unit 20 - 1 to transmit an advertising signal of the generated pairing completion specification.

In step S1118 - 1 , the first communication unit 20 - 1 is controlled to execute connection processing based on the connection setting performed by the pairing processing. After that, the post-processing ends.

<[Mobile terminal side] pairing connection processing>

The pairing connection processing on the portable terminal 2 side is started by the user's operation of starting the pairing connection processing to the input unit 17 - 2 .

In step S1111 - 2 , the communication control unit 211 controls the first communication unit 20 - 1 to detect an advertising signal. As a result, the first communication unit 20 - 1 detects the advertising signal transmitted from the imaging device 1 .

In Step S1112 - 2 , the pairing status determining unit 212 determines whether or not the pairing status is unpaired.

In the case of non-pairing, it is determined as YES in step S1112 - 2 , and the process proceeds to step S1113 - 2 .

In step S1113 - 2 , the advertising signal determining unit 213 determines whether or not the advertising signal is an unpaired specification.

In the case of an advertising signal that is not a non-pairing specification and has been paired, it is determined NO in step S1113-2, and the pairing connection process ends.

In the case of an advertising signal of unpaired specifications, it is determined YES in step S1113-2, and the process proceeds to step S1114-2.

In step S1114 - 2 , the communication control unit 211 controls the communication unit to execute pairing processing with the imaging device 1 .

In step S1115 - 2 , the communication control unit 211 controls the communication unit to execute connection processing based on the connection setting performed by the pairing processing. After that, the pairing connection process ends.

In contrast, in the case of a situation where pairing has been completed rather than unpaired, it is determined NO in step S1112 - 2 , and the process proceeds to step S1116 - 2 .

In step S1116 - 2 , the advertising signal determination unit 213 determines whether or not the advertising signal is a pairing complete specification.

In the case of an advertising signal of an unpaired specification rather than a pairing completed specification, it is determined as NO in step S1116 - 2 , and the pairing connection process ends.

In the case of an advertising signal of a pairing complete specification, it is determined YES in step S1116-2, and the process proceeds to step S1117-2.

In step S1117 - 2 , the communication control unit 211 controls the communication unit to execute connection processing based on the connection setting performed by the pairing processing. After that, the pairing connection process ends.

<Example of modification>

In order to strengthen the avoidance of "Problem 1", it is specialized in the specification of a predetermined OS (Operating System) (in this embodiment, only for iOS), installs the characteristic of the device name, connects BLE once and acquires it, It may be configured to determine whether to maintain or disconnect the connection in the same way as the connection determination based on the device name of the advertising data described above.

In addition, if the function of this modified example is added to the flowchart described above, it can be grasped as shown in FIG. 25 . 25 is a flowchart for explaining another flow of pairing connection processing executed by the portable terminal 2 of FIG. 3 having the functional configuration of FIG. 23 .

<Pairing connection processing on the mobile terminal side>

The pairing connection processing on the portable terminal 2 side is started by the user's operation of starting the pairing connection processing to the input unit 17 - 2 . And, as a premise, at the time of a process start, the BLE of the portable terminal 2 is not connected.

In step S1211, the communication control unit 211 controls the first communication unit 20 - 2 to detect an advertising signal. As a result, the first communication unit 20 - 2 detects the advertising signal transmitted from the imaging device 1 .

In step S1212, the communication control unit 211 starts a BLE connection process and controls the first communication unit 20 - 2 to establish a BLE connection with the imaging device 1 .

In step S1213, the pairing status determination unit 212 determines whether pairing processing has been performed.

When pairing processing is performed, it is determined as YES in step S1213, and the process proceeds to step S1214.

In contrast, when pairing processing is not being performed, it is determined as NO in step S1213, and the process proceeds to step S1219.

In step S1214, the advertising signal determination unit 213 determines whether or not the advertising device name has been determined.

When the advertising device name is judged, it is determined YES in step S1214, and the pairing connection processing on the portable terminal 2 side ends.

In contrast, when the advertising device name is not judged, it is determined NO in step S1214, and the process proceeds to step S1215.

In step S1215, the communication control unit 211 controls the first communication unit 20 - 2 to execute connection processing.

In step S1216, the advertising signal determination unit 213 determines whether or not the characteristic device name has been determined.

When the characteristic device name is judged, it is determined as YES in step S1216, and the process proceeds to step S1218.

In contrast, if the characteristic device name has not been determined, it is determined NO in step S1216, and the process proceeds to step S1217.

In step S1217, the communication control unit 211 controls the first communication unit 20 - 2 to execute pairing processing. After that, the pairing connection processing on the portable terminal 2 side ends.

In step S1218, the communication control unit 211 controls the first communication unit 20 - 2 to execute BLE disconnection processing. After that, the pairing connection processing on the portable terminal 2 side ends.

In step S1219, the advertising signal determining unit 213 determines whether or not the advertising device name has been determined.

When the advertising device name is judged, it is determined YES in step S1219, and the process proceeds to step S1220.

In contrast, if the advertising device name has not been determined, it is determined NO in step S1219, and the pairing connection processing on the portable terminal 2 side ends.

In step S1220, the communication control unit 211 controls the first communication unit 20 - 2 to execute connection processing. After that, the pairing connection processing on the portable terminal 2 side ends.

<Background process processing for automatic transmission>

In the communication system S of the present embodiment, the application of the portable terminal 2 (smart phone) has a time limit for background operation, and has a function for sending an image transmission within a time limit.

In a conventional imaging device, a function of automatically transmitting a captured image to the terminal after shooting with the camera is installed between the imaging device (camera) and a mobile terminal such as a smart phone.

In order to transmit only by camera operation without smartphone operation, the application is activated by a background process by sending an activation notification using bluetooth, and a configuration in which images are received even when the smartphone is in a sleep state is realized.

In iOS, there is a time limit for background operation, so in this case, all data may not be sent.

So, in the communication system S of this embodiment, the operation as shown in FIG. 26 and FIG. 27 is made. 26 and 27 are flowcharts for explaining the background process processing of automatic transmission.

1. Notification of process activation by BLE is performed from the camera to the smartphone.

2. The application for image reception is launched in the background on the smartphone.

3. Raise the camera's Wi-Fi access point and connect to the smartphone via Wi-Fi.

4. Send a list of files to be transmitted from the camera to the application.

5. The application acquires the files in the file list from the camera.

6A-1. When the data transfer is completed within the time, success is reported to the camera, the background process is terminated, and the smartphone is returned to sleep.

6A-2. The camera performs process activation notification by BLE again to send the next file list.

6B-1. If data transfer is not completed within the time limit, a failure is reported to the camera, the background process is terminated, and the smartphone returns to sleep.

6B-2. The camera performs process activation notification by BLE again to send the file list that could not be sent.

6C-1. If the background process terminates without notice, the application cannot do anything.

6C-2. The camera detects the disconnection of communication, and again performs process activation notification by BLE to send the file list that could not be sent.

Then, if the transmission fails, the granularity of the transmission data is changed and retried.

<[Imaging Device Side] File Transfer Processing>

The file transfer process on the imaging device 1 side is started by the user's [imaging device side] file transfer process start operation to the input unit 17 - 1 .

In step S1311 - 1 , the communication control unit 173 controls the first communication unit 20 - 1 to transmit a notification.

In step S1312 - 1 , the communication control unit 173 determines Wi-Fi ON/OFF.

If Wi-Fi is ON, it is determined as YES in step S1312-1, and the process proceeds to step S1314-1.

In contrast, when Wi-Fi is OFF, it is determined NO in step S1312 - 1 , and the process proceeds to step S1313 - 1 .

In step S1313 - 1 , the communication control unit 173 controls the second communication unit 21 - 1 to activate the Wi-Fi access point.

In step S1314 - 1 , the communication control unit 173 controls the second communication unit 21 - 1 to establish HTTP communication.

In step S1315 - 1, the communication control unit 173 creates a file list.

In step S1316 - 1, the communication control unit 173 transmits the file list.

In step S1317 - 1, the communication control unit 173 transmits the file.

In step S1318 - 1 , the communication control unit 173 controls the second communication unit 21 - 1 to determine whether time-out has been detected in the portable terminal 2 .

When time-out is detected in the portable terminal 2, it is determined as YES in step S1318-1, and the process proceeds to step S1321-1.

In contrast, in the case where timeout is not detected in the portable terminal 2, it is determined as NO in step S1318-1, and the process proceeds to step S1319-1.

In step S1319 - 1 , the communication control unit 173 controls the second communication unit 21 - 1 to receive a communication completion notification.

In step S1320 - 1 , the communication control unit 173 determines whether or not transmission has succeeded.

If the transmission is successful, it is determined as YES in step S1320 - 1 , and the process proceeds to step S1322 - 1 .

In contrast, when transmission is not successful, it is determined NO in step S1320 - 1 , and the process proceeds to step S1321 - 1 .

In step S1321 - 1 , the communication control unit 173 controls the second communication unit 21 - 1 to reset the transmission data amount.

In step S1322 - 1 , the communication control unit 173 controls the second communication unit 21 - 1 to set the next transmission data.

In step S1323 - 1 , the communication control unit 173 controls the second communication unit 21 - 1 to determine whether there is next data.

If there is the next data, it is determined as YES in step S1323 - 1, and the process returns to step S1221.

In contrast, in the case where there is no next data, it is determined as NO in step S1323 - 1, and the file transfer processing on the imaging device 1 side ends.

<[Mobile terminal side] file transfer processing>

The file transfer process on the portable terminal 2 side is initiated by the user's operation of starting the file transfer process on the portable terminal 2 side to the input unit 17 - 2 .

In step S1311 - 2 , the communication control unit 211 controls the first communication unit 20 - 2 to receive the BLE notification.

In step S1312 - 2, the CPU 11 activates the application in the background (BG).

In step S1313 - 2 , the communication control unit 211 determines whether or not it is not connected to Wi-Fi.

If not connected to Wi-Fi, it is determined as YES in step S1313-2, and the process proceeds to step S1314-2.

In contrast, when not connected to Wi-Fi, it is determined NO in step S1313 - 2 , and the process proceeds to step S1315 - 2 .

In step S1314 - 2 , the communication control unit 211 controls the second communication unit 21 - 2 to connect to the AP of the imaging device 1 .

In step S1315 - 2 , the communication control unit 211 controls the second communication unit 21 - 2 to establish HTTP communication.

In step S1316 - 2 , the communication control unit 211 controls the second communication unit 21 - 2 to receive the file list.

In step S1317 - 2 , the communication control unit 211 controls the second communication unit 21 - 2 to receive the file.

In step S1318 - 2 , the CPU 11 determines whether or not the process by the OS has ended.

If the process by the OS has ended, it is determined YES in step S1318 - 2 , and the file transfer processing on the portable terminal 2 side ends.

In contrast, if the process by the OS has not ended, it is determined NO in step S1318 - 2 , and the process proceeds to step S1319 - 2 .

In step S1319 - 2, the CPU 11 determines whether or not an end notice of the process has been given by the OS.

When the end of the process is notified by the OS, it is determined as YES in step S1319 - 2 , and the process proceeds to step S1321 - 2 .

In contrast, when the end of the process is not notified by the OS, it is determined NO in step S1319 - 2 , and the process proceeds to step S1320 - 2 .

In step S1320 - 2 , the communication control unit 211 determines whether or not reception of the file has been completed.

If reception of the file has been completed, it is determined YES in step S1320 - 2 , and the process proceeds to step S1321 - 2 .

On the other hand, if reception of the file has not been completed, it is determined as NO in step S1320 - 2 , and the process returns to step S1317 - 2 .

In step S1321 - 2 , the communication control unit 211 controls the second communication unit 21 - 2 to transmit a communication completion notification. After that, the file transfer process on the portable terminal 2 side ends.

Therefore, in the communication system S of the present embodiment, since all of the transmission processes divided into multiple times start from notification of bluetooth, it is possible to send a lot of data with a communication function with a time limit. Further, in a process whose ending timing is unknown, it becomes easy to transmit again from data that could not be transmitted.

<BLE connection parameter adaptation setting processing>

The communication system S of the present embodiment has a function of adaptively setting the connection parameters of BLE at the time of camera power supply ON and OFF to achieve both connection stability and power saving.

Conventionally, the shorter the connection interval time of the BLE connection parameter, the higher the data transfer rate, but the higher the current consumption. The shorter the connection monitoring timeout time is, the shorter the time until the BLE is judged to be disconnected and reconnection processing is performed, shortening the actual communication time, but it seems to be easy to disconnect from the user.

So, in the communication system S of this embodiment, the operation as shown in FIG. 28 is performed. 28 is a flowchart for explaining the BLE connection parameter adaptive setting process.

BLE connection parameters are adaptively changed when camera power is ON and OFF.

・When the camera power is ON, shorten the connection interval and connection monitoring timeout.

・When the camera power is OFF, lengthen the connection interval and connection monitoring timeout. That is, it branches when the camera power is ON and OFF, and the BLE connection parameter setting is changed.

That is, the BLE connection parameter adaptive setting process is initiated by the user's operation of the BLE connection parameter adaptive setting process start to the input unit 17 - 1 .

In step S1411, the CPU 11 determines whether or not the camera power supply has been turned off.

If the power supply of the camera is turned OFF, it is determined as YES in step S1411, and the process proceeds to step S1413.

In contrast, when the camera power supply is not turned OFF, it is determined as NO in step S1411, and the process proceeds to step S1412.

In step S1412, the communication control unit 173 changes the settings to "connection interval ← 40 ms" and "connection monitoring timeout ← 3.01 s". After that, the BLE connection parameter adaptive setting process ends.

In step S1413, the communication control unit 173 changes the settings to "connection interval ← 1000 ms" and "connection monitoring timeout ← 5 s". After that, the BLE connection parameter adaptive setting process ends.

In the communication system S of this embodiment, the following effects can be obtained.

・When the camera power is ON, the data transmission rate is high, and the time during which communication cannot be performed is shortened.

・When the camera power is OFF, it operates to save power, and even if communication is cut off to some extent, it is not recognized as disconnected.

(Since data transfer does not occur when the camera power is OFF, there is no problem even if the transfer rate is low.)

<Wi-Fi setting control processing on the imaging device side>

In the communication system S of the present embodiment, Wi-Fi connection becomes easy when the camera and the smartphone are paired by bluetooth, and if the Wi-Fi setting is changed from this state, the connection becomes impossible. It has a function to limit the Wi-Fi setting change function depending on whether there is a pair on the side. In addition, it has a function of adjusting so that the operation becomes different depending on whether or not there is a pair.

Conventionally, a function of automatically transmitting a captured image to the terminal side after photographing with a camera is installed between a camera and a mobile terminal such as a smart phone.

For automatic transmission, the camera and smart phone are paired via BLE, and the camera's Wi-Fi settings are sent to the smart phone via BT. The smartphone connects to the Wi-Fi access point of the camera based on the information at this time.

However, the SSID and password of the access point can be easily changed because they are only set values, and if they are changed, the camera and smartphone cannot connect via Wi-Fi.

So, in the communication system S of this embodiment, the operation as shown in FIG. 29 is performed. 29 is a flowchart for explaining Wi-Fi setting control processing on the imaging device 1 side.

・The camera transmits the SSID and password of the Wi-Fi access point of the camera to the smartphone at the time of BLE pairing through BT communication.

· The smartphone adds the received SSID and password to its own Wi-Fi settings.

· The camera records pair establishment information, and then masks the Wi-Fi password change menu so that the user cannot execute it.

That is, in the communication system S of the present embodiment, enabling/disabling of Wi-Fi password change is switched according to the presence or absence of pairing.

In other words, the Wi-Fi setting control process on the imaging device 1 side is initiated by the user's operation of starting the Wi-Fi setting control process to the input unit 17 - 1 .

In step S1511, the communication control unit 173 controls the first communication unit 20 - 1 to execute the BLE pairing process.

In step S1512, the communication control unit 173 sets the SSID and password, and controls the second communication unit 21 - 1 to activate the WiFi AP.

In step S1513, the communication control unit 173 controls the first communication unit 20 - 1 to transmit the SSID and the pass by BLE.

In step S1514, the communication control unit 173 controls the second communication unit 21 - 1 to measure whether a WiFi connection has been detected.

When WiFi connection is detected, it is determined as YES in step S1514, and the process proceeds to step S1515.

On the other hand, when WiFi connection is not detected, it is determined as NO in step S1514, and the process enters a standby state in step S1514.

In step S1515, the communication control unit 173 stores the pairing information. After that, the Wi-Fi setting control process on the imaging device 1 side ends.

30 is a flowchart for explaining Menu open processing.

The Menu open process start is initiated by the user's operation of the Menu open process start to the input unit 17-1.

In step S1611, the communication control unit 173 acquires pairing information.

In step S1612, the communication control unit 173 determines whether pair setting has been completed.

In the case where pair setting has been completed, it is determined YES in step S1612, and the process proceeds to step S1613.

In contrast, in the case where the pair setting has not been completed, it is determined NO in step S1612, and the Menu open process start ends.

In step S1613, the CPU 11 masks the menu. After that, the start of the Menu open process ends.

Therefore, in the communication system S of the present embodiment, it is possible to prevent another communication function from becoming unavailable due to a setting change on the camera side for which automatic transmission is not performed.

In addition to the Wi-Fi password, the function that switches the operation according to the presence or absence of a pair is as follows.

· Automatic image transmission

With Pair: Executable

No Pair: Not Executable (Cannot Be Set to ON)

· Manual image transmission

With Pairs: Any Executable

No pairing: Applications cannot transmit in the background

<Processing to judge the mode of starting the camera by BLE communication>

In the communication system S of the present embodiment, when the camera starts up due to the BLE factor, it does not start right away normally, but determines the starting mode while checking the BLE communication state of the camera, and turns off the power if necessary. By doing so, it has a function of suppressing unnecessary processing of the camera. That is, in the communication system S of the present embodiment, a function is provided so that the camera shifts to a normal operation only by an intentional operation, such as when the camera is activated from a smartphone, and unnecessary activation processing is not performed. have

Conventionally, the configuration of the HW makes it possible to maintain the BLE connection even when the power of the camera is turned off. In addition, it was possible to detect various BLE events with the HW of BLE at some time while the camera was in power-off state while utilizing BLE, and to turn the camera power-on based on this. However, as a factor in the case of starting with BLE, it can be started by various factors such as BLE disconnection, connection, and BLE Read/Write request from Smart. By performing the processing, power becomes disadvantageous as well. Also, when the camera activates BLE, it is difficult to store information on which BLE event triggered the camera (because the camera is powered off, the contents of the BLE connection cannot be stored in RAM or the like).

So, in the communication system S of this embodiment, the operation as shown in FIG. 31 is performed. 31 is a flowchart for explaining a mode judgment process for starting a camera by BLE communication. And, as a [prerequisite], if the BLE of the camera is advertised or connected, the BLE module is set to Sleep, the camera's power is dropped, and the power is turned off while maintaining the BLE output is needed

1) A camera is activated by a certain BLE event.

At this time, only that the camera was raised as a factor of BLE was grasped as an activation factor.

2) The camera performs a dedicated activation in a BLE activation standby state (only the LED is lit).

BLE is restarted, put in an advertised state, and a timer is started (5 seconds).

And, if there is no BLE connection within the timer (5 seconds), it is determined as a BLE disconnection event.

Set BLE Sleep as it is, and power off the camera.

→PowerOff[1]

3) If there is a BLE connection within the timer's time, delete the timer and proceed to the next process.

After the BLE connection processing is completed, the timer is activated (5 seconds).

Then, if there is no Wi-Fi connection request by BLE signal within the timer (5 seconds), Sleep is set in this state, and the camera is turned off.

4) If the BLE signal is notified within the timer time, it is determined that the camera was started intentionally from the smart device and the camera is started in the Wi-Fi mode.

That is, the mode judgment process is initiated by the user's operation of mode judgment process start to the input unit 17 - 1 .

In step S1711, the communication control unit 173 controls the first communication unit 20 - 1 so that the BLE is in Sleep (advertising or connecting).

In step S1712, the communication control unit 173 controls the first communication unit 20 - 1 so as to generate a BLE event (connection/disconnection/WiFi mode activation).

In step S1713, the CPU 11 performs camera startup processing (minimum necessary processing).

In step S1714, the communication control unit 173 controls the first communication unit 20 - 1 to perform BLE open processing (BLE connection standby timer setting).

In step S1715, the communication control unit 173 determines whether or not the timer waits.

In the case of waiting for the timer, it is determined YES in step S1715, and the process proceeds to step S1716.

In contrast, if the timer is not waiting, it is determined NO in step S1715, and the process proceeds to step S1718.

In step S1716, the communication control unit 173 controls to perform BLE connection processing (awaiting timer for request from portable terminal 2).

In step S1717, the communication control unit 173 determines whether or not the timer waits.

In the case of waiting for the timer, it is determined YES in step S1717, and the process proceeds to step S1719.

In contrast, when the timer is not waiting, it is determined NO in step S1717, and the process proceeds to step S1718.

In step S1718, the CPU 11 performs a BLE Sleep process to turn off the camera power. After that, the mode judgment process ends.

In step S1719, the communication control unit 173 controls the second communication unit 21 - 1 to execute the WiFi activation process.

In step S1720, the communication control unit 173 controls the second communication unit 21 - 1 to execute WiFi connection processing with the portable terminal 2 .

In step S1721, the CPU 11 performs control to activate the NET mode as the mobile terminal designation mode (remote shooting, viewing photos, etc.). After that, the mode judgment process ends.

Therefore, in the communication system S of this embodiment, when a camera is aroused by a BLE event, it becomes possible to suppress the battery consumption of the camera process by a BLE event as much as possible by performing only the minimum required process.

<Example of modification>

When it is judged that activation is caused by disconnection of BLE, processing for more power saving may be incorporated by changing settings such as increasing the advertising interval.

The communication system S configured as above has the following configuration.

A wireless communication system in which a plurality of devices having different roles perform wireless communication to perform predetermined cooperative processing, wherein a combination of a plurality of apparatuses to be subjected to predetermined cooperative processing is specified based on a user operation, and the combination is displayed. and pairing means for executing a pairing process of storing pairing information in each other's devices.

The first device transmits an advertising signal, which is a signal for informing other devices of its existence and the functions provided by itself through wireless communication, and pairing information stored by the pairing means. and an advertising signal control means for changing its identification name included in the advertising signal according to the above.

The second device detects the advertising signal being sent out by the advertising signal sending means, and if it is sent from a device providing a function related to a predetermined linkage process, the second device communicates with the device. Whether a communication connection is established between the connection means for establishing a communication connection and the device that detected the advertising signal based on the pairing information stored by the pairing means and the change status of the identification name included in the advertising signal. It includes connection control means for controlling the availability of.

In this way, in the communication system S, when a plurality of devices are communicatively connected using wireless communication, it is possible to prevent unexpected devices from being erroneously connected, and to properly establish a communication connection.

The first device is an imaging device having a photographing function, and the second device is an information terminal having a display function.

A predetermined linkage process is a process of transmitting and displaying image data photographed by an imaging device to an information terminal.

Wireless communication is wireless communication according to the BLE standard.

The first device is a peripheral of the BLE standard, and the second device is a central device of the BLE standard.

The advertising signal transmission means does not transmit an advertising signal when connected to any one device, and transmits an advertising signal when no communication connection is established with any device.

The advertising signal control means transmits a first advertising signal without appending a space at the end of the device name included in the advertising signal in a state where it is not paired with any device, In a state in which pairing with one device is completed, the advertising signal transmitting means is controlled to transmit a second advertising signal in which a space is added to the end of the device name included in the advertising signal.

When the connection control means detects the first advertising signal, it does not reconnect even if pairing is completed with the camera that sent the first advertising signal, and detects the second advertising signal. In this case, control is performed to reconnect when pairing with the camera that sent the second advertising signal is completed, and not to reconnect when pairing is not completed.

The connection control means of the information terminal performs pairing and starts connection at the time of pairing operation. After that, if the connection is terminated while pairing, control is performed so that the connection is not made even if the connection becomes possible again.

It includes a first communication means by a first communication method and a second communication means by a second communication method.

The advertising signal is transmitted by the first communication method.

The identification name included in the advertising signal includes identification information for identifying the device in the second communication method.

It further includes second connection control means for establishing a communication connection by the second communication method using the device identification information included in the identification name included in the advertising signal.

The first communication method is wireless communication according to the BLE (bluetooth Low Energy) (trademark) standard.

The second communication method is wireless communication according to the Wi-Fi standard, and the identification information is an SSID.

Conventionally, when an information terminal such as a smart phone remotely operates an imaging device such as a digital camera connected (paired) via wireless communication such as bluetooth (registered trademark), information on the other device once connected (paired) is stored, and when the same imaging device and information terminal are connected (paired) again, a technique is known that makes it possible to easily set shooting conditions and the like using the stored information of the counterpart device (e.g., Japan See Publication No. 2015-5889).

In general, since the battery is consumed in the state where the wireless communication connection is established, when there is no need to communicate, control is performed to disconnect the connection as much as possible, and recently, BLE (bluetooth Low Energy) ( Trademarks) and the like are increasingly being used for communication means of low power consumption.

However, in the foregoing technique, although it is easy to set shooting conditions and the like after connecting the same image capture device and information terminal connected in the past again, after disconnecting the once connected image capture device and information terminal, When trying to reconnect the same imaging device and smart again, or when trying to reconnect after changing the pairing, etc., when there are multiple connectable imaging devices or information terminals, you may accidentally misconnect to the other party or security problems may occur. There are cases. The same problem exists in the case of making a connection by wireless communication with a combination of an imaging device and a device other than an information terminal.

The present embodiment was made to solve such a problem, and in the case of communication connection of a plurality of devices using wireless communication, in order to prevent unexpected devices from being erroneously connected, and to properly perform communication connection. It aims to

The data processing device configured as described above is a data processing device that executes predetermined data processing in cooperation with other devices.

The data processing device includes a first communication unit, a second communication unit, and a control unit.

The first communication unit performs communication by a first communication method in which a communication connection with the other device is maintained even when the data processing device and the other device are not in a predetermined operating state capable of executing predetermined data processing.

The second communication unit performs communication by the second communication method in which a communication connection with other devices is maintained on condition that it is in a predetermined operating state.

The control unit executes a predetermined linkage process by transmitting data through the second communication unit with other devices, and when the predetermined linkage process cannot be executed due to not being in a predetermined operating state, a first linkage process is performed. By carrying out predetermined communication with other devices by the communication unit, after the data processing device and other devices are brought into a predetermined operating state, a predetermined linkage process is executed.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

In the data processing device, communication of the first communication method by the first communication unit is slower than communication of the second communication method by the second communication unit, but is power saving.

The first communication unit maintains a communication connection with the other device even in a state in which predetermined data processing cannot be executed due to the fact that the communication connection with the other device has not been established by the second communication unit.

The control unit makes a transition from a state in which a communication connection with the other device is not established to a state in which it has been established by the second communication unit by performing predetermined communication with the other device by the first communication unit.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The first communication unit maintains a communication connection with the other device even in a state in which the predetermined data processing cannot be executed due to the fact that either the other device or the data processing device is not ready to execute the predetermined data processing. .

By performing predetermined communication through the first communication unit, the control unit causes either the other device or the data processing device to transition from a state not ready to execute predetermined data processing to a ready state.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

A state in which a predetermined data process is not ready to be executed is a state in which the power of any one of the other devices or the data processing apparatus is off, or a program for executing a predetermined data process is not running, or a state in which a program for executing a predetermined data process is not started The communication unit is not functioning.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit performs predetermined communication by the first communication unit, so that even when either of the other device or the data processing device is in a state where the predetermined data processing is not ready, the other device or the data processing device Transition both sides to a state in which predetermined data processing is ready to be executed.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit transmits a predetermined signal to the other device by the first communication unit when the other device is not ready to perform predetermined data processing, thereby making the other device ready to execute predetermined data processing. fulfill with

When the data processing device is in a state where it is not ready to execute predetermined data processing, by receiving a predetermined signal from another device by the first communication unit, the data processing apparatus is ready to execute predetermined data processing. fulfill the state

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Predetermined data processing includes first data processing for controlling another device by operating the data processing device, and second data processing for controlling the data processing device by operating the other device.

When performing the first data processing, the control unit transmits a predetermined signal to the other device by the first communication unit in response to the operation of the data processing device, thereby shifting the other device to a state in which the other device is ready to execute the first data processing. to perform second data processing, the data processing apparatus is moved to a state in which the second data processing is ready by receiving a predetermined signal transmitted by the first communication unit in response to operation of another device. .

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit arbitrarily designates another device for performing predetermined data processing as a designated device, initiates a communication connection with the designated device by the first communication unit, and in a state where the communication connection is maintained, the designation by the second communication unit. The communication connection with the device is released, and the first communication unit performs a predetermined communication in which the designated device is designated, so that the second communication unit starts a communication connection with the designated device.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

One of the data processing device and other devices is an imaging device with an imaging function, and the other is a display terminal with an image display function.

The predetermined association processing includes image transmission processing for transmitting image data captured by the imaging device to the display terminal by the second communication unit for display.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Predetermined data processing includes a first data processing for starting image transfer processing in response to an operation of an imaging device, and a second data processing for starting an image transfer processing in response to an operation of a display terminal.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, the communication system S is a data processing system in which a plurality of devices having different roles cooperate to perform predetermined data processing.

The data processing system includes a first communication unit, a second communication unit, and a control unit.

The first communication unit performs communication by the first communication method in which a communication connection between the plurality of devices is maintained even when the plurality of devices are not in a predetermined operating state capable of executing predetermined data processing.

The second communication unit performs communication by the second communication method in which a communication connection with a plurality of devices is maintained on the condition that it is in a predetermined operating state.

The control unit executes predetermined data processing by performing data transmission between a plurality of devices through the second communication unit, and when the predetermined data processing cannot be executed due to not being in a predetermined operating state, 1. Predetermined data processing is executed after the data processing apparatus and the other device are brought into a predetermined operating state by performing predetermined communication with other devices by a communication unit.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The plurality of devices includes a first device having a function of acquiring data and a second device having a function of managing data.

The first device includes a control unit that transmits the acquired data to the second device via the second communication unit.

The second device includes a storage unit for storing a first program for executing data management processing for managing data received from the first device, and a control unit for switching the first program between a stopped state and an active state.

The control unit of the first device transmits a predetermined signal to the second device through the first communication unit while the first program of the second device is stopped, and then transmits the acquired data through the second communication unit. transmit to the second device.

When the control unit of the second device receives a predetermined signal from the first device through the first communication unit while the first program of the second device is stopped, the first program is moved from the stopped state to the running state. After that, data received from the first device via the second communication unit is designated as a management target, and data management processing is executed by the first program.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The storage unit of the second device further stores a second program for executing data receiving processing for receiving data from the first device via the second communication unit.

The control unit of the second device switches the first program and the second program between a stopped state and an active state.

The control unit of the first device transmits a predetermined signal to the second device through the first communication unit in a state where the first program of the second device is stopped and the second program is running, and then obtains Data is transmitted to the second device through the second communication unit.

In a state where the first program of the second device is stopped and the second program is running, the control unit of the second device performs a data reception process executed by the second program to determine a predetermined value from the first device through the first communication unit. When the signal of is received, the first program is switched from a stopped state to an active state, and thereafter, the data received from the first device through the second communication unit is designated as a management object, and data management processing is performed by the first program. run

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit of the first device transmits a start notification of the first program to the second device through the first communication unit when receiving a request for starting the first program from the second device through the first communication unit.

When the first program cannot be started directly from the second program, the control unit of the second device transmits a start-up request for the first program to the first device through the first communication unit, and in response to the start-up request, the first program The first program is switched from a suspended state to an active state according to an activation notification transmitted from the device.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The first communication unit is slower than the second communication unit, but power saving.

The control unit cannot activate the first program through communication with the second communication unit, and can activate the first program through communication with the first communication unit.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The data management process is a process of dividing designated data into one of a plurality of groups and managing it.

The control unit of the second device designates the data received by execution of the first program as a group management target and executes data management processing.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit of the second device transmits group information regarding a plurality of groups manageable by data management processing to the first device, and designates data received from the first device as group selection information received from the first device. Divide into groups to manage.

The control unit of the first device selects a predetermined group from among a plurality of groups included in the group information received from the second device, and transmits the group selection information to the second device.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit of the second device stores group selection information transmitted from the first device in the second device.

Each time new data is received from the first device, it is divided into groups designated by stored group selection information and managed.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit of the second device divides the data received from the first device together with the group selection information into groups designated by the group selection information and manages them.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit of the first device displays a list of a plurality of groups included in the group information received from the second device, allows the user to select them, and transmits group selection information based on user operation to the second device.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit of the second device includes a third communication unit that communicates with a server providing a data sharing service on a network.

In the data management process, data received from the first device is designated as a sharing target and transmitted to the server through the third communication unit.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The data sharing service is a service for classifying and sharing a plurality of data into a plurality of groups.

The control unit of the second device designates a group designated by the group selection information when designating the received data as a sharing target and transmitting the received data to the server to be shared.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The controller of the first device causes the user to select whether or not to share the acquired image, and transmits sharing availability information to the second device together with group selection information.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit of the first device causes the user to select whether or not to share the acquired image, and the control unit of the first device transmits sharing availability information together with group selection information to the second device.

The control unit of the second device transmits the received data to the server when sharing is possible.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit of the first device selects a service on a plurality of different networks providing data sharing service.

The control unit of the second device transmits the received data to a server providing the selected service.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The first device is an imaging device having a function of acquiring image data by shooting.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit of the imaging device, which is the first device, transmits the image data by the second communication unit when new image data is acquired in a state where the automatic transmission mode is set.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The control unit of the imaging device as the first device stores and updates the group selection information, and displays the currently selected group on the live view screen.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The second device has a plurality of different types.

The control unit changes the control of activation depending on the type.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The first communication unit is always connected.

The second communication unit establishes a communication connection in response to a connection request through the first communication unit, and changes communication connection establishment control according to the type.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

The communication system S configured as described above exchanges data between a plurality of devices and executes a predetermined function.

Further, in the communication system S, one device and the other device are connected by a plurality of different communication methods, and if the data transmission is interrupted during data transmission in the first communication method, the second By the communication method, control is performed to establish the first communication method, and data transmission in the first communication method is resumed.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, in the communication system S, the application is configured to operate in the background so that data transmission is possible.

Further, in the communication system S, during data transfer from one device to the other device, the background data transfer operation of the application in the other device is interrupted by OS (Operating System) control. Whenever this occurs, the app that has been transferring data from the one device to the other device by the second communication method is started, and the interrupted data transfer is resumed.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, in the communication system S, by linking the first communication method with the second communication method, predetermined control is performed between one device and the other device by operations from the counterpart device.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, in the communication system S, image transmission requests are exchanged using communication in the second communication method, and image transmission is performed using communication in the first communication method.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, in the communication system S, one device has a photographing function.

Further, in the communication system S, by executing shooting processing in one device, the captured image is transmitted to the other device, and the captured image is stored in the server in the other device, and the server In the case where the device is configured to perform automatic registration to , the other device performs a different operation for each installed OS (Operating System).

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, in the communication system S, one device has a photographing function.

Further, in the communication system S, by executing shooting processing in one device, the captured image is transmitted to the other device, and the captured image is stored in the server in the other device, and the server In the case where it is configured to perform automatic registration to the server, automatic registration to the server is performed under conditions previously set in the other device.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, in the communication system S, when an application running in the background has a specification that cannot be linked with other applications, the other application can be started by communication in the first communication method through another device. make up

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, in the communication system S, one device has a photographing function.

Further, in the communication system S, by executing shooting processing in one device, the captured image is transmitted to the other device, and the captured image is stored in the server in the other device, and the server In the case of automatic registration to the server, a storage location in the server is selected in advance in the other device, and the storage location in the selected server is stored in the one device.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, in the communication system S, when one device detects an advertising signal of the other device and performs communication by the second communication method, the pairing state and advertising signal between devices The presence or absence of connection is controlled according to the change state of the device name included in .

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, in the communication system S, the connection state of communication in the second communication method is monitored at a predetermined timing.

Further, in the communication system S, the interval time for monitoring the connection state of communication in the second communication method is changed according to whether the power supply of the monitoring device is ON or OFF.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

Further, in the communication system S, in a state in which communication pairing in the second communication method has been established, changing communication settings in the first communication method is prohibited.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

In addition, in the communication system S, in a state in which communication pairing in the second communication method is established, when a communication event in the second communication method occurs in one device, intentional intentional communication from the other device occurs. On the condition that the authentication request was made, the power supply of the one device is turned on.

Therefore, in the communication system S, under each restriction, it is possible to effectively utilize the characteristics of communication or functions of the OS (or satisfy the rules), and more effectively operate a plurality of devices in conjunction.

In addition, as a prerequisite for the above-described embodiment, there are the following.

・With Wi-Fi communication, a single device can connect to a plurality of partners at the same time, and multiple applications use Wi-Fi communication while sharing. For example, by connecting eight portable terminals 2, such as PCs or smart phones, to the AP of the imaging device 1, which is a camera, images of the imaging device 1, which is a camera, can be viewed at the same time.

And, in this embodiment, the AP (imaging device 1 which is a camera) which can be simultaneously connected from the portable terminal 2 which is a smart phone is comprised only by one unit.

• In Wi-Fi communication, there is no guarantee that data communication connection will be maintained in a state where each application is running in the background.

On the other hand, in BLE communication, a plurality of counterparts capable of simultaneous communication connection with one device are possible. In detail, the central is capable of connecting a plurality of peripherals, but the peripheral is configured so that only one central can be connected.

In addition, in BLE communication, each application can monopolize its own dedicated communication connection. That is, there is only one physical connection of BLE, and it is possible to monopolize an independent logical connection by sharing the physical connection.

In addition, in BLE communication, even when each application is running in the background, communication connection can be maintained under a predetermined condition.

• The predetermined condition is that intermittent communication performed at predetermined interval intervals to maintain the communication connection is continuing.

・ In cases where this condition is not satisfied, for example, when the radio wave situation deteriorates due to distance between devices, etc., or when iOS is forced to free up CPU power or memory area to other applications. There is a case where the operation of an application performing BLE communication in the background is stopped. That is, when the distance is separated, the physical connection is disconnected, but when the operation of the application is stopped, the physical connection is maintained and data communication through the logical connection is stopped.

· The portable terminal 2 that is a smart phone can execute a plurality of application software including application software not related to the present embodiment.

When the portable terminal 2, which is a smartphone, starts Wi-Fi communication in the foreground while an application related to the present embodiment is executing Wi-Fi communication in the background, the application related to the present embodiment starts Wi-Fi communication in the foreground. Wi-Fi communication of applications related to the form may be interrupted. Also, if another application starts Wi-Fi communication in the foreground while an application is executing Wi-Fi communication (data communication) in the background, the Wi-Fi communication of the application in the background does not necessarily stop. For example, in the case of iOS, data communication can be continued in the background as long as it is within the time limit.

In the portable terminal 2, which is a smart phone, when an application related to the present embodiment is performing BLE communication with a partner being paired in the background, another application not related to the present embodiment is in the foreground with another partner. It can also be configured not to initiate BLE communication. And, it is configured to enable unrelated applications to perform BLE communication.

• Always-on connectivity of BLE communication compared to Wi-Fi communication in this embodiment has two meanings.

One means that the communication connection is maintained even in a low power consumption state as long as predetermined conditions are satisfied.

・The other is that even if the communication connection is cut off due to the failure to satisfy a predetermined condition, the limit of not changing the connection partner (a slightly different concept from pairing) means that it is possible to easily reconnect with the same partner. .

And, general BLE pairing refers to establishment of BLE connection, but pairing of imaging device 1, which is a camera, in addition to establishment of BLE connection, application of mobile terminal 2, which is a smart phone, records the BD address of the camera and establishing a Wi-Fi connection once (registering a Wi-Fi profile in the case of iOS). When the application of the portable terminal 2, which is a smart phone, stores the BD address, it becomes possible to connect to the previously connected camera at the time of reconnection after BLE disconnection.

· The OS of the portable terminal 2, which is a smart phone, is equipped with, for example, version 8 of iOS, which operates under the above-mentioned constraints.

・ Since the present embodiment is based on the above-mentioned premise, Wi-Fi communication can be configured so that the communication partner cannot be registered (paired) fixedly in advance, and in BLE communication, the communication partner can be fixed in advance It can be configured to be registered (paired). In the case where power consumption is not taken into account, Wi-Fi connection can be established at all times, and Wi-Fi connection parties can be stored in an application.

The advantage of using BLE is that the user's operation during Wi-Fi connection can be simplified, SSID and PW input is unnecessary, and either the imaging device 1, which is a camera, or the portable terminal 2, which is a smartphone It is possible to connect Wi-Fi with one operation.

In the embodiment structured as described above, BLE communication is an operation for enabling communication with low power consumption, and the advertising signal of the peripheral (image capture device 1 as a camera) is transferred to the central (mobile phone as a smart phone). The terminal 2] detects and initiates connection, and after connection is initiated, intermittent communication is performed while repeating turning ON and OFF of the power supply for communication at predetermined interval time intervals.

As such a rule (restriction) of BLE communication, while the communication continues at every predetermined interval time, the connection state of communication is maintained, but if communication cannot be performed every predetermined interval time for some reason, communication connection state is released. When the connection state of communication is released, in order to reconnect, it is necessary to start again from advertising of the peripheral (image capture device 1 as a camera) and scanning of the central (portable terminal 2 as a smart phone).

Some of the factors mentioned here include, for example, radio wave weakening due to distance between devices or limitations of the OS (operating system) of devices.

OS restrictions include, for example, in the case of iOS, each application can communicate with the BLE device in background execution, but since CPU power and memory are shared with other applications, the time that can be operated continuously is limited , the connection is interrupted even during BLE communication.

Therefore, in the above-described embodiment, for example, in the case of iOS as a premise, when a plurality of apparatuses are operated in conjunction, a plurality of application software is used for the purpose of enabling more effective cooperative operation. are doing

In addition, in the above-described embodiment, for example, in the case of BLE as a premise, when a plurality of devices are operated in conjunction, using communication with low power consumption, for the purpose of performing linked operation more effectively are doing

Specifically, in the above-described embodiment, by linking BLE and Wi-Fi, an image capture device 1 as a camera is transferred to a portable terminal 2 as a smart phone, and an image capture device 1 as a camera is transferred from the portable terminal 2 as a smartphone. ), the activation or control of the other is performed only with the operation of one side.

Further, in the above-described embodiment, image transmission requests are exchanged using BLE communication, and actual image transmission is performed using Wi-Fi communication.

In addition, in the above-described embodiment, when a captured image is automatically registered in a cloud album via the portable terminal 2, which is a smart phone, just by taking a picture with the imaging device 1, which is a camera, the mobile terminal 2, which is a smart phone Depending on the OS type, the operation of the application is changed.

In addition, in the above-described embodiment, when a captured image is automatically registered in a cloud album via the portable terminal 2, which is a smart phone, just by taking a picture with the imaging device 1, which is a camera, the portable terminal 2, which is a smart phone, in advance Automatic registration to the cloud album can be performed under conditions set on the side.

Further, in the above-described embodiment, the mobile terminal 2 that is a smart phone activates another app by BLE via the imaging device 1 that is a camera because the app running in the background cannot be linked with other apps.

In addition, in the above-described embodiment, when a captured image is automatically registered in a cloud album via the portable terminal 2, which is a smart phone, just by taking a picture with the imaging device 1, which is a camera, the album to be registered in advance is set to the camera. Selection is made on the side of the image capture device 1, and this selection information is stored in the mobile terminal 2, which is a smart phone.

Further, in the above-described embodiment, when the portable terminal 2, which is a smart phone, detects an advertising signal of the imaging device 1, which is a camera, and performs a BLE connection (reconnection), the pairing state and advertising The presence or absence of connection is controlled according to the change state of the device name included in the signal.

Further, in the above-described embodiment, during data transmission from the imaging device 1, which is a camera, to the portable terminal 2, which is a smart phone, whenever the background operation of an application is interrupted by the control of iOS, the imaging device 1, which is a camera, ), the application is started again by BLE, and the interrupted data transmission is resumed.

Furthermore, in the above-described embodiment, the imaging device 1, which is a camera, changes the BLE connection monitoring interval time according to whether its own power supply is in an ON state or an OFF state.

Further, in the above-described embodiment, the imaging device 1 serving as a camera prohibits changing Wi-Fi settings in a state in which BLE pairing has been established.

Further, in the above-described embodiment, the imaging device 1, which is a camera, when a BLE event occurs in a state in which BLE pairing is established, on the condition that there is an intentional request from the portable terminal 2, which is a smartphone The power supply of the imaging device 1 which is a camera is turned on.

Incidentally, the present invention is not limited to the above-described embodiment, and variations, improvements, and the like within a range capable of achieving the object of the present invention are included in the present invention.

In addition, in the above-described embodiment, the external device has been described as the portable terminal 2 composed of a smart phone, but is not limited thereto, and includes, for example, a tablet terminal, a PC (Personal Computer), and other digital cameras. It may be an electronic device, such as, or a server. In addition, the communication method may be other wireless communication such as NFC (Near Field Communication) of short-distance communication, public line, or wired communication, and the transmission destination may be plural or may be via a network such as the Internet.

In the above-described embodiments, the image capturing device 1 to which the present invention is applied is described as a digital camera and the mobile terminal 2 is a smart phone, but it is not particularly limited thereto.

For example, the present invention can be generally applied to electronic devices having the processing function described above. Specifically, the present invention can be applied, for example, to notebook-type personal computers, printers, television receivers, video cameras, portable navigation devices, mobile phones, smart phones, portable game machines, and the like.

When a series of processes are executed by software, a program constituting the software is installed from a network or a recording medium to a computer or the like.

The computer may be a computer incorporated in dedicated hardware. Further, the computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

A recording medium containing such a program is constituted by the removable medium 31 of FIG. 3 that is distributed separately from the main body of the device to provide the program to the user, and is pre-installed in the main body of the device to provide the user with the program. It is composed of provided recording media and the like. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. Optical discs are composed of, for example, CD-ROM (Compact Disk-Read Only Memory), DVD (Digital Versatile Disk), Blu-ray (registered trademark) disc (Blu-ray Disc), and the like. The magneto-optical disk is constituted by MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a pre-embedded state in the device body is, for example, the ROM 12 of FIG. 3 in which the program is recorded, the hard disk included in the storage unit 19 of FIG. 3, etc. It consists of

Incidentally, in this specification, the step of describing a program recorded on a recording medium is executed in parallel or individually, not necessarily in chronological order, as well as processing performed in chronological order according to the order. It also includes processing.

Also, in this specification, the term "system" means an overall device composed of a plurality of devices or a plurality of means.

As mentioned above, several embodiments of the present invention have been described, but these embodiments are only examples and do not limit the technical scope of the present invention. The present invention can take other various embodiments, and various changes such as omissions and substitutions can be made without departing from the gist of the present invention. These embodiments and variations thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and their equivalents.

Further, in the above-described embodiment, the imaging unit, the input unit, the output unit, the storage unit, the first communication unit, the second communication unit, and the like are constituted by electronic circuits, and the imaging control unit, communication control unit, application management unit, pairing status determination unit, ad The butting signal generation unit and the like are realized with software (a program stored in RAM or ROM is executed by the CPU).

However, some or all of the various functions constituted by electronic circuits may be realized by software, or some or all of the various functions realized by software may be constituted by electronic circuits.

Claims (46)

A data processing device that performs predetermined data processing in conjunction with other devices, comprising:
a first communication unit that performs communication by a first communication method in which a communication connection with the other device is maintained even when the data processing device and the other device are not in a predetermined operating state capable of executing the predetermined data processing;
a second communication unit that performs communication by a second communication method in which a communication connection with the other device is maintained on condition that the predetermined operating state is present;
When data transmission with the other device is performed through the second communication unit to execute predetermined linkage processing, and the predetermined linkage processing cannot be executed due to not being in the predetermined operating state, the a control unit which executes the predetermined linkage processing after the data processing device and the other apparatus are shifted to the predetermined operation state by performing predetermined communication with the other apparatus by a first communication unit;
an acquisition unit that acquires data; and
transmits a predetermined signal to a second device through the first communication unit when a first program for executing data management processing for managing data received from the first device in the other device is in a stopped state; After that, a transmission control unit for transmitting the acquired data to the other device through the second communication unit.
Data processing device comprising a. According to claim 1,
Communication of the first communication method by the first communication unit is slower than communication of the second communication method by the second communication unit, but power saving is possible;
the first communication unit maintains a communication connection with the other device even in a state in which the predetermined data processing cannot be executed due to the fact that the communication connection with the other device by the second communication unit has not been established;
The control unit causes a transition from a state in which a communication connection with the other device by the second communication unit is not established to an established state by performing predetermined communication with the other device by the first communication unit. , data processing unit. According to claim 1,
The first communication unit communicates with the other device even in a state in which the predetermined data processing cannot be executed due to the fact that either the other device or the data processing device is not ready to perform the predetermined data processing. A communication connection is maintained;
The control unit, by performing predetermined communication by the first communication unit, moves either the other device or the data processing device from a state in which the predetermined data processing is not ready to a state in which it is ready. The data processing device that makes the transition. According to claim 3,
The state of not being ready to execute the predetermined data processing means that the power supply of any one of the other device or the data processing apparatus is off, or a program for executing the predetermined data processing is not running. or a state in which the second communication unit is not functioning. According to claim 3,
The control unit performs predetermined communication by the first communication unit, so that even when either of the other device or the data processing device is in a state where the predetermined data processing is not ready, the other device or a data processing device that causes both of the data processing devices to transition to a state in which they are ready to execute the predetermined data processing. According to claim 5,
The control unit,
When the other device is in a state in which the other device is not ready to execute the predetermined data process, the first communication unit transmits a predetermined signal to the other device to make the other device ready to execute the predetermined data process. fulfill the status quo,
When the data processing device is in a state where it is not ready to execute the predetermined data processing, by receiving a predetermined signal from the other device by the first communication unit, the data processing apparatus is set to execute the predetermined data processing. A data processing device that shifts to a ready state. According to claim 6,
The predetermined data processing includes first data processing for controlling another device by operating the data processing device and second data processing for controlling the data processing device by operating the other device;
The control unit,
In the case of performing the first data processing, a state in which the other device is ready to execute the first data processing by transmitting a predetermined signal to the other device by the first communication unit in response to an operation of the data processing device. to fulfill,
In the case of performing the second data processing, by receiving a predetermined signal transmitted by the first communication unit in response to operation of the other device, the data processing apparatus is placed in a state in which the second data processing is ready to be executed. The data processing device that makes the transition. According to claim 2,
The control unit,
Arbitrarily designating another device for performing the predetermined data processing as a designated device;
Initiating a communication connection with the designated device by the first communication unit, and in a state in which the communication connection is maintained, establishing a state in which the communication connection with the designated device by the second communication unit is released;
The data processing device causes the second communication unit to initiate a communication connection with the designated device by performing predetermined communication specifying the designated device by the first communication unit. According to claim 7,
One of the data processing device and the other device is an imaging device having an image pickup function, and the other is a display terminal having an image display function;
The data processing device according to claim 1 , wherein the predetermined linkage processing includes image transmission processing for transmitting image data captured by the imaging device to the display terminal by the second communication unit for display. According to claim 9,
The predetermined data process includes a first data process for starting the image transfer process in response to an operation of the imaging device and a second data process for starting the image transfer process in response to an operation of the display terminal. processing unit. A data processing system in which a plurality of devices having different roles cooperate to perform predetermined data processing, comprising:
a first communication unit that performs communication by a first communication method in which a communication connection with the plurality of devices is maintained even when the plurality of devices are not in a predetermined operating state capable of executing the predetermined data processing;
a second communication unit that performs communication by a second communication method in which a communication connection with the plurality of devices is maintained on condition that the predetermined operating state is present; and
When the predetermined data processing is executed by performing data transmission between the plurality of devices through the second communication unit, and the predetermined data processing cannot be executed due to not being in the predetermined operation state, a control unit which executes the predetermined data processing after the device and the other device are brought into the predetermined operation state by performing predetermined communication with the other apparatus by the first communication unit;
including,
The plurality of devices include a first device having a function of acquiring data and a second device having a function of managing data;
The control unit of the first device transmits the acquired data to the second device through the second communication unit;
The control unit of the second device,
switching a first program for executing data management processing for managing data received from the first device between a stopped state and an active state;
The control unit of the first device also,
In a state in which the first program of the second device is stopped, a predetermined signal is transmitted to the second device through the first communication unit, and thereafter, acquired data is transmitted to the second device through the second communication unit. send to
The control unit of the second device also,
When a predetermined signal is received from the first device through the first communication unit while the first program of the second device is stopped, the first program is switched from a stopped state to an active state, and and then designating the data received from the first device through the second communication unit as a management target and executing data management processing by the first program. delete According to claim 11,
The control unit of the second device also,
switch a second program for executing data management processing for receiving data from the first device through the second communication unit between a stopped state and an active state;
The control unit of the first device also,
In a state where the first program of the second device is stopped and the second program is running, a predetermined signal is transmitted to the second device through the first communication unit, and then the acquired data is stored. transmitting to the second device through the second communication unit;
The control unit of the second device also,
In a state where the first program of the second device is stopped and the second program is running, data receiving processing executed by the second program sends the predetermined information from the first device via the first communication unit. When the signal of is received, the first program is switched from a stopped state to an active state, and thereafter, the data received from the first device through the second communication unit is designated as a management target and stored in the first program. A data processing system that executes data management processing by means of According to claim 13,
The control unit of the first device also,
when a request for starting the first program is received from a second device through the first communication unit, a notification for starting the first program is transmitted to the second device through the first communication unit;
The control unit of the second device also,
When the first program cannot be started directly from the second program, an activation request for the first program is transmitted to the first device via the first communication unit, and the first device is sent in response to the activation request. and switches the first program from a suspended state to an active state by an activation notification transmitted from the data processing system. According to claim 11,
The first communication unit is slower than the second communication unit, but it is possible to save power,
The data processing system according to claim 1 , wherein the control unit cannot activate the first program in communication with the second communication unit and can activate the first program in communication with the first communication unit. According to claim 11,
The data management process is a process of dividing designated data into any one of a plurality of groups and managing it;
The data processing system according to claim 1 , wherein the control unit of the second device designates data received by execution of the first program as a group management target and executes data management processing. According to claim 16,
The control unit of the second device also,
Group information regarding a plurality of groups manageable by the data management processing is transmitted to the first device, and data received from the first device is divided into groups designated by the group selection information received from the first device. manage,
The control unit of the first device also,
and selecting a predetermined group from among a plurality of groups included in the group information received from the second device, and transmitting the group selection information to the second device. According to claim 17,
The control unit of the second device also,
storing group selection information transmitted from the first device in a storage unit of the second device;
A data processing system that divides into groups designated by stored group selection information and manages them whenever new data is received from the first device. According to claim 17,
The control unit of the second device also,
A data processing system configured to divide data received from the first device together with group selection information into groups designated by the group selection information and manage them. According to claim 17,
The control unit of the first device also,
and displaying a list of a plurality of groups included in the group information received from the second device on a display unit so that a user can select them, and transmitting group selection information based on a user operation to the second device. According to claim 16,
The second device,
A third communication unit communicating with a server providing a data sharing service on a network;
wherein the data management process includes a process of designating data received from the first device as a sharing target and transmitting the data to the server via the third communication unit. According to claim 21,
The data sharing service is a service for classifying and sharing a plurality of data into a plurality of groups,
The control unit of the second device also,
The data processing system designates a group specified by group selection information received from the first device when designating received data as a sharing target and transmitting to the server for sharing. According to claim 19,
The control unit of the first device also,
A data processing system which causes a user to select whether or not to share an acquired image, and transmits sharing availability information to the second device together with the group selection information. According to claim 21,
The control unit of the first device also,
causing a user to select whether or not to share the acquired image, and a control unit of the first device transmits sharing availability information to a second device together with group selection information received from the first device;
The control unit of the second device also,
When sharing is possible, the data processing system transmits the received data to the server. According to claim 11,
The control unit of the first device also,
select a service on a plurality of different networks providing a data sharing service;
The control unit of the second device also,
A data processing system that transmits received data to a server providing a selected service. According to claim 11,
The first device,
A data processing system, which is an imaging device having a function of acquiring image data by shooting. According to claim 25,
The control unit of the imaging device, which is the first device,
and transmits the image data by the second communication unit when new image data is acquired in a state in which an automatic transmission mode is set. According to claim 25,
The control unit of the imaging device, which is the first device,
remembers and updates group selection information;
A data processing system that displays a currently selected group on a live view screen. According to claim 11,
The second device is of a plurality of different types;
The data processing system according to claim 1 , wherein the control unit of the second device changes control of the startup according to the type. According to claim 29,
The first communication unit is always connected,
the second communication unit establishes a communication connection according to a connection request through the first communication unit;
The control unit of the second communication unit also,
and changing control of establishment of the communication connection according to the kind. delete delete delete delete delete delete delete delete delete delete delete delete A data processing method executed by a data processing system in which a plurality of devices having different roles cooperate to perform predetermined data processing, comprising:
first communication processing for performing communication by a first communication method in which a communication connection with the plurality of devices is maintained even when the plurality of devices are not in a predetermined operating state capable of executing the predetermined data processing;
a second communication process for performing communication by a second communication method in which a communication connection with the plurality of devices is maintained on condition that the predetermined operating state is present; and
When the predetermined data processing is executed by performing data transfer between the plurality of devices through the second communication processing, and the predetermined data processing cannot be executed due to not being in the predetermined operating state. [0014] [0012] In this, after the device and the other device transition to the predetermined operating state by performing predetermined communication with the other device, the predetermined data processing;
control step that executes
including,
The plurality of devices include a first device having a function of acquiring data and a second device having a function of managing data;
The control unit of the first device transmits the acquired data to the second device through the second communication processing;
The control unit of the second device,
switching a first program for executing data management processing for managing data received from the first device between a stopped state and an active state;
The control unit of the first device also,
In a state in which the first program of the second device is stopped, a predetermined signal is transmitted to the second device through the first communication processing, and thereafter, acquired data is transmitted to the second device through the second communication processing. 2 Send to the device,
The control unit of the second device also,
switching the first program from a stopped state to an active state when a predetermined signal is received from the first device through the first communication processing while the first program of the second device is stopped; and then designating the data received from the first device through the second communication processing as a management target and executing data management processing by the first program. delete Causes a computer that controls a data processing device that performs predetermined data processing in conjunction with other devices,
a first communication function for performing communication by a first communication method in which a communication connection with the other device is maintained even when the data processing device and the other device are not in a predetermined operating state capable of executing the predetermined data processing;
a second communication function for performing communication by a second communication method in which a communication connection with the other device is maintained on condition that the predetermined operating state is present;
When data transmission is performed with the other device through the second communication function to execute predetermined linkage processing, and the predetermined linkage processing cannot be executed due to not being in the predetermined operating state, a control function that executes the predetermined linkage processing after the data processing device and the other device transition to the predetermined operating state by performing predetermined communication with the other device;
an acquisition function to acquire data; and
transmits a predetermined signal to the second device through the first communication function when a first program for executing data management processing for managing data received from the first device in the other device is in a stopped state; , thereafter, a transmission control function for transmitting the acquired data to the other device through the second communication function
A program recorded on a recording medium that executes. delete

Images