CN111083685A

CN111083685A - Data processing system, data processing method, and storage medium

Info

Publication number: CN111083685A
Application number: CN201911401849.9A
Authority: CN
Inventors: 田中仁; 萩原一晃; 栗山祐司; 富所佳规; 细田润; 奈良和也; 木曾俊也; 山田卓也; 大谷大辅; 星野博之
Original assignee: Casio Computer Co Ltd
Current assignee: Casio Computer Co Ltd
Priority date: 2015-02-04
Filing date: 2016-02-02
Publication date: 2020-04-28
Anticipated expiration: 2036-02-02
Also published as: KR102524304B1; JP6278031B2; CN111083685B; JP2016174348A; KR102538118B1; JP6669151B2; KR20160096025A; JP6217731B2; KR20160096026A; JP2018038081A; JP2016174347A

Abstract

The invention provides a data processing apparatus, a data processing system, and a data processing method. A communication system (S) exchanges data among a plurality of devices to perform a given function. In addition, in the communication system (S), one device and the other device are connected by a plurality of different communication methods, and when data transmission in the 1 st communication method is interrupted, control is performed so that the 1 st communication method is established by the 2 nd communication method and data transmission in the 1 st communication method is restarted.

Description

Data processing system, data processing method, and storage medium

The present application is a divisional application entitled "data processing apparatus, data processing system, and data processing method" having an application number of "201610073256.4", an application date of 2016, and an application date of 02/02.

Technical Field

The present invention relates to a data processing apparatus and a data processing system that perform given data processing in cooperation with other devices.

Background

Conventionally, there is known a technique of using Wi-Fi communication or Bluetooth (registered trademark) communication when image data captured by an imaging device such as a digital camera is transmitted to a portable terminal such as a smartphone or instruction information related to imaging is transmitted from the portable terminal to the imaging device (see patent document 1).

Further, in recent years, a technology of BLE (Bluetooth low energy) (trademark) capable of communicating with lower power consumption has been available.

In each communication technology, characteristics such as communication speed, power consumption, and convenience in use are different from each other, and it is necessary to perform communication in compliance with a protocol (restriction) corresponding to each characteristic.

The portable terminal can simultaneously start a plurality of application software under the management of an OS (Operating System).

In such an OS of a mobile terminal, a plurality of application software programs can be simultaneously started, and when a plurality of application software programs are simultaneously started, each application software program needs to be operated in conformity with the specifications (restrictions) of the OS in order to appropriately use the CPU and the memory.

Patent document 1: JP 2014-230024 publication

However, in the above-described technology, it is not possible to more efficiently cause the image pickup apparatus and the mobile terminal to cooperate with each other to perform an operation by effectively utilizing the characteristics of communication and the functions of the OS (or conforming to the specifications). The same applies to the cooperation of a camera and a device other than a smartphone.

Disclosure of Invention

The present invention has been made in view of such circumstances, and an object thereof is to more effectively cause a plurality of devices to cooperate with each other to execute operations by effectively utilizing communication characteristics and functions of an OS (or satisfying a protocol) under each constraint.

A 1 aspect of the present invention is a data processing apparatus for executing predetermined data processing in cooperation with another device, the data processing apparatus including:

a 1 st communication unit that performs communication by a 1 st communication method, wherein the 1 st communication method maintains a communication connection with another device even when the data processing apparatus and the other device are not in a predetermined operation state in which the predetermined data processing is executable;

a 2 nd communication unit that performs communication by a 2 nd communication method, the 2 nd communication method maintaining a communication connection with the other device on condition that the given operation state is present; and

and a control unit that executes a predetermined cooperation process by transferring data to and from the other device via the 2 nd communication unit, and when the predetermined cooperation process cannot be executed due to the non-presence of the predetermined operating state, causes the data processing apparatus and the other device to transition to the predetermined operating state by performing the predetermined communication with the other device via the 1 st communication unit, and then executes the predetermined cooperation process.

Another aspect of the present invention is a data processing system in which a plurality of devices having different functions cooperate to perform predetermined data processing, the data processing system including:

a 1 st communication unit that performs communication by a 1 st communication method, wherein the 1 st communication method maintains communication connection among the plurality of devices even when the plurality of devices are not in a given operation state in which the given data processing can be executed;

a 2 nd communication unit that performs communication by a 2 nd communication method, wherein the 2 nd communication method maintains communication connection between the plurality of devices on condition that the given operation state is present; and

and a control unit that executes the predetermined data processing by transferring data between the plurality of devices via the 2 nd communication unit, and executes the predetermined data processing after the device and another device are shifted to the predetermined operation state by performing predetermined communication with the another device via the 1 st communication unit when the predetermined data processing cannot be executed due to non-existence of the predetermined operation state.

In addition, another aspect of the present invention is characterized in that,

in a data processing system that exchanges data among a plurality of devices to perform a given function,

one device is connected to the other device by a plurality of different communication methods,

in data transfer in the 1 st communication method, when the data transfer is interrupted, control is performed such that the 1 st communication method is established by the 2 nd communication method, and the data transfer in the 1 st communication method is restarted.

Drawings

Fig. 1 is a system configuration diagram showing a system configuration of a communication system according to an embodiment of the present invention.

Fig. 2 is a schematic diagram showing an example of data communication performed in the communication system.

Fig. 3 is a block diagram showing a hardware configuration of an imaging device and a mobile terminal according to an embodiment of the present invention.

Fig. 4 is a functional block diagram showing a functional configuration for executing an automatic image reception process and a mode operation process among the functional configurations of the imaging apparatus and the portable terminal shown in fig. 3.

Fig. 5 is a flowchart illustrating a flow of automatic image reception processing executed by the imaging apparatus and the portable terminal of fig. 3 having the functional configuration of fig. 4.

Fig. 6 is a flowchart illustrating a flow of a mode operation process executed by the imaging apparatus and the mobile terminal of fig. 3 having the functional configuration of fig. 4.

Fig. 7 is a schematic diagram showing a display of a communication state in the imaging device and the portable terminal.

Fig. 8 is a system configuration diagram showing a system configuration of a communication system according to an embodiment of the present invention.

Fig. 9 is a flowchart illustrating a flow of automatic image reception processing executed by the imaging apparatus and the portable terminal of fig. 3 having the functional configuration of fig. 4.

Fig. 10 is a flowchart illustrating a flow of a mode operation process executed by the imaging apparatus and the mobile terminal of fig. 3 having the functional configuration of fig. 4.

Fig. 11 is a schematic diagram showing a display of a communication state in the imaging device and the mobile terminal.

Fig. 12 is a functional block diagram showing a functional configuration for executing the image sharing process among the functional configurations of the portable terminal and the server shown in fig. 3.

Fig. 13 is a flowchart illustrating a flow of image sharing processing executed by the portable terminal and the server of fig. 3 having the functional configuration of fig. 15.

Fig. 14 is an operation configuration diagram of an imaging device and an application on a mobile terminal in the communication system of the present embodiment.

Fig. 15 is a flowchart showing an operation sequence in the imaging device and the mobile terminal in the communication system according to the present embodiment.

Fig. 16 is a schematic diagram showing a selection screen of an album in an application.

Fig. 17 is a flowchart illustrating the flow of the album registration processing.

Fig. 18 is a flowchart illustrating the flow of the automatic transmission processing.

Fig. 19 is a flowchart illustrating the flow of album selection processing on the camera side.

Fig. 20 is a flowchart illustrating the flow of the image registration processing.

Fig. 21 is a schematic diagram showing an example of screen display in the image pickup apparatus.

Fig. 22 is a schematic diagram showing an example of screen display in the image pickup apparatus.

Fig. 23 is a functional block diagram showing a functional configuration for executing the pairing connection process among the functional configurations of the imaging apparatus and the portable terminal of fig. 3.

Fig. 24 is a flowchart illustrating a flow of pairing connection processing executed by the imaging apparatus and the mobile terminal of fig. 3 having the functional configuration of fig. 29.

Fig. 25 is a flowchart illustrating another flow of the pairing-connection process executed by the portable terminal having the functional configuration of fig. 29.

Fig. 26 is a flowchart for explaining the background process processing of automatic transmission.

Fig. 27 is a flowchart for explaining the background process processing of automatic transmission.

Fig. 28 is a flowchart for explaining the BLE connection parameter adaptive setting process.

Fig. 29 is a flowchart for explaining the Wi-Fi setting control process.

Fig. 30 is a flowchart for explaining the Menu Open (Menu Open) process.

Fig. 31 is a flowchart for explaining the mode determination processing for camera activation based on BLE communication.

Detailed Description

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

< embodiment 1 >

As shown in fig. 1, the communication system S includes: an image pickup apparatus 1 having at least an image pickup/communication function; and a portable terminal 2 as an information terminal having at least an image display/communication function.

The communication system S has a function of requesting a communication connection in a communication scheme capable of realizing image file-level data communication from one operating device operated by a user to the other device by operating one of the imaging apparatus 1 and the mobile terminal 2, and transmitting and receiving an image file to and from the other device, viewing image data held by the other device, and the like in accordance with an operation of the operating device in a state where the communication connection between the imaging apparatus 1 and the mobile terminal 2 is established. In the present embodiment, the term "establishing" a communication connection means identifying a partner of mutual communication by specifying the partner of mutual communication and performing a predetermined procedure (negotiation), and thereafter, always being in a state in which communication is possible without performing the predetermined procedure every time communication is performed. This state is maintained until the procedure of releasing the communication connection is performed. Further, the state in which the communication connection has been "established" is maintained even in the case where the radio wave state becomes poor to become a state in which communication is temporarily impossible or the power of the apparatus is turned OFF (OFF).

In the communication system S of the present embodiment, 2 communication systems are used, and a communication connection between the imaging device 1 and the mobile terminal 2 is established in a state in which data communication is possible. The communication system S is configured to perform communication by a wireless communication method (hereinafter, referred to as "1 st communication method") suitable for constant connection while saving power even at low speed and a wireless communication method (hereinafter, referred to as "2 nd communication method") suitable for transmission and reception of a file at high speed. In the present embodiment, the 1 st communication scheme is a communication scheme based on the communication standard Bluetooth low energy/Bluetooth LE (trademark) (hereinafter referred to as "BLE"). The 2 nd communication system uses a communication system based on Wi-Fi (Wireless Fidelity) communication standards in a Wireless LAN (Local Area Network).

In addition, in the present embodiment, since Wi-Fi, which is the 2 nd communication scheme, has a large power consumption in a state where a communication connection is established, when it can be predicted that a waiting time until data transmission is performed next will be long, the power consumption is reduced by releasing the communication connection every time. Further, in a state where the communication connection is not established, it is not possible to automatically turn ON (ON) the power of the device ON the other side or start the application by communication based ON Wi-Fi, which is the 2 nd communication method. Therefore, in the communication system S according to the present embodiment, BLE, which is the 1 st communication scheme with low power consumption, is always connected, and a Wi-Fi communication connection, which is the 2 nd communication scheme, is established according to the situation.

With regard to the constant connection based on BLE as the 1 st communication method, when there are a plurality of image pickup devices and mobile terminals each having an external cooperation function within a distance range in which communication connection is possible, a combination of the image pickup device 1 and the mobile terminal 2 that actually utilize the external cooperation function may be arbitrarily selected from among the plurality of devices, and the selected combination of the image pickup device 1 and the mobile terminal 2 may be maintained until the external cooperation function is released.

A method (pairing process) of selecting a combination of the image pickup apparatus 1 and the mobile terminal 2 from a plurality of devices and starting constant connection based on BLE as the 1 st communication method will be described later.

Here, an example will be described in which an image file is transmitted from the imaging device 1 in a state of being always connected by BLE as the 1 st communication method to the mobile terminal 2.

Fig. 2 is a schematic diagram showing an example of data communication performed in the communication system S.

Specifically, in the example of fig. 2, the user operates the imaging device 1, which is one of the devices, thereby exerting an external cooperation function on the imaging device 1 side, and transmits an instruction (connection instruction) to establish a communication connection by the 2 nd communication method suitable for transmission and reception of an image file to the mobile terminal 2 via communication in the 1 st communication method.

In the mobile terminal 2 that has received the connection instruction via the communication in the 1 st communication method, the camera cooperation application functions to perform a process for establishing the communication in the 2 nd communication method, and a communication connection in the 2 nd communication method is established between the image pickup device 1 and the mobile terminal 2.

Specifically, a program for developing the camera cooperation application function on the portable terminal 2 side is activated by a connection instruction from the image pickup device 1 via communication in the 1 st communication method, and communication by the 2 nd communication method is established between the image pickup device 1 and the portable terminal 2 by the external cooperation function on the image pickup device 1 side and the camera cooperation application function on the portable terminal 2 side.

The 1 st communication method is power-saving and is always connected even when the main power supply of either or both of the imaging device 1 and the mobile terminal 2 is turned off (or in a low power consumption state), and one device in which the main power supply is turned off (or in a low power consumption state) has a function of turning on the main power supply (or releasing the low power consumption state) and a function of starting (executing) an application program designated via the 1 st communication method, so that at least communication by the 2 nd communication method and execution of the application program can be realized by communication via the 1 st communication method from the other device.

Therefore, for example, when an event such as transmission of an image captured by the image capturing apparatus 1 occurs, communication can be established by the 2 nd communication method for data communication without operating the portable terminal 2.

This enables data communication between the imaging device 1 and the mobile terminal 2, and image data can be automatically transmitted from the imaging device 1 to the mobile terminal 2.

The received image data is temporarily stored in a memory (storage) of the mobile terminal 2 by the function of the camera cooperation application.

In the present embodiment, as effective use of image data that is automatically transmitted and received by the external cooperation function on the imaging apparatus 1 side and the function of the camera cooperation application on the portable terminal 2 side, the image data captured by the imaging apparatus 1 is set to a state in which it can be automatically viewed from a portable terminal or the like held by another user by using an image sharing service on the internet. Specifically, when the imaging apparatus 1 performs imaging in a state in which the cooperation operation mode for automatically performing image sharing is set, it instructs the mobile terminal 2 via communication in the 1 st communication method that sharing of images from the imaging apparatus 1 to another mobile terminal is possible. The mobile terminal 2 that has received the sharing instruction functions as a camera cooperation application, receives image data captured by the imaging device 1, temporarily stores the image data in the memory of the mobile terminal 2, and then functions as an image management & network access application (starts a program for the function) based on the instruction of the camera cooperation application function, manages the image data temporarily stored in the memory of the mobile terminal 2 in the function of itself (image management & network access application), and transmits the image data to a cloud server that has already been cooperated in advance for the purpose of image sharing. In the cloud server, sharing of images captured by the imaging device 1 and received by the mobile terminal 2 is performed by setting a state in which image data can be used for other mobile terminals that have already collaborated in advance.

In the present embodiment, the imaging device 1 and the mobile terminal 2 are configured as devices that implement a predetermined function in cooperation with other devices. The image pickup device 1 and the portable terminal 2 perform a process (hereinafter referred to as a "cooperation process") in which, for example, a process of transferring an image to the portable terminal 2 in accordance with an operation of the image pickup device 1 to cause the portable terminal 2 to acquire the image, a process of transferring an image from the image pickup device 1 to the portable terminal 2 in accordance with an operation of the portable terminal 2, and the like are cooperated by performing data exchange (data transfer) between the devices using Wi-Fi, which is a 2 nd communication method.

In addition, the imaging device 1 and the mobile terminal 2 are configured to establish a communication connection by opening Wi-Fi, which is the 2 nd communication method, of the other device from the operating device via BLE, which is the 1 st communication method in which the connection is maintained (always connected) in order to shift from a state in which the communication connection of Wi-Fi, which is the 2 nd communication method, is not established and the cooperation process cannot be executed to a state in which the cooperation process can be executed. That is, BLE as the 1 st communication scheme maintains (always connects) the communication connection with the other device even in a state where the predetermined cooperation process cannot be executed or a state where readiness to execute the predetermined cooperation process is not ready due to, for example, communication connection with the other device not being established. Here, the "state of readiness to execute the predetermined cooperation process" refers to a state in which the power of another device is turned off, a state in which a program for executing the predetermined cooperation process is not started, or a state in which a communication connection by Wi-Fi, which is the 2 nd communication method, is not established (the state of power off here includes a state in which communication by the 1 st communication method is enabled but communication by the 2 nd communication method is not executed, and a low power consumption state in which the predetermined cooperation process is executed). Therefore, in the imaging device 1 and the mobile terminal 2, even in a state where the power of another device is off, a state where a program for executing a predetermined cooperation process is not started, or a state where communication connection by Wi-Fi, which is the 2 nd communication method, is not established (a state where the communication connection is not functional), that is, a state where the preparation for executing the predetermined cooperation process is not ready, it is possible to shift to a state where the preparation for executing the predetermined cooperation process is ready via BLE, which is the 1 st communication method.

Here, the pairing process will be explained.

The pairing process is a process of setting connection of 2 BLE devices (the imaging device 1 and the mobile terminal 2 in the present embodiment). After the connection setting, the imaging device 1 and the portable terminal 2 are connected in a communicable state based on the setting. Further, through the pairing process, pairing information on the partner side necessary for connection is stored in the respective devices (the image pickup apparatus 1 and the portable terminal 2).

In the BLE communication according to the present embodiment, communication is performed between a peripheral device (peripheral) and a central device (central) that function differently. In the present embodiment, the peripheral device is the image pickup apparatus 1, and the center device is the portable terminal 2.

In this regard, the peripheral device issues an announcement (advertising) signal to the surroundings using radio waves (broadcast transmission of the announcement signal) in order to notify its own presence, and responds to a connection request from the center device.

The central equipment scans whether peripheral equipment providing required data for the central equipment exists, and if the peripheral equipment detects the corresponding peripheral equipment, connection is requested to start data exchange. The central device then uses the information (services) provided by the peripheral devices to perform some task.

The notification signal may include a name of a peripheral device (device name: SSID which is an identification name of an access point in a wireless LAN (Wi-Fi) in the present embodiment), and information (UUID: universal Unique Identifier) indicating information (service) that can be provided.

When connection of BLE after connection setting is completed by pairing processing (at the time of communication), a communication packet including a BD Address (Bluetooth (registered trademark) Device Address) unique (unique) around the world is transmitted. Thus, no connection with other devices is made as desired.

Fig. 3 is a block diagram showing the hardware configuration of the imaging device 1 and the mobile terminal 2 according to the embodiment of the present invention.

The imaging device 1 is configured as a digital camera, for example.

The imaging device 1 includes: a CPU (Central Processing Unit) 11, a ROM (Read only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input/output interface 15, an image pickup Unit 16, an input Unit 17, an output Unit 18, a storage Unit 19, a 1 st communication Unit 20, a 2 nd communication Unit 21, a driver 22, and a power supply Unit 23.

The CPU11 executes various processes in accordance with a program recorded in the ROM12 or a program loaded into the RAM13 from the storage section 19.

The CPU11, RAM13, and ROM12 (or storage unit 19) constitute a control unit.

In the RAM13, data and the like necessary for the CPU11 to execute various processes are also stored as appropriate.

The CPU11, ROM12, and RAM13 are connected to each other via the bus 14. An input/output interface 15 is also connected to the bus 14. The input/output interface 15 is connected to an imaging unit 16, an input unit 17, an output unit 18, a storage unit 19, a 1 st communication unit 20, a 2 nd communication unit 21, a driver 22, and a power supply unit 23.

Although not shown, the imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit is configured by a lens for converging light to image a subject, for example, a focus lens, a zoom lens, and the like.

The focus lens is a lens that forms a subject image on a light receiving surface of the image sensor. The zoom lens is a lens in which a focal length is freely changed within a certain range.

In the optical lens unit, a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance is provided as necessary.

The image sensor is configured by a photoelectric conversion element, AFE (Analog Front End), and the like.

The photoelectric conversion element is formed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. The subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (images) an object image, accumulates image signals for a certain period of time, and sequentially supplies the accumulated image signals to the AFE as analog signals.

The AFE executes various signal processes such as an Analog/Digital (a/D) conversion process on the Analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 16.

Hereinafter, such an output signal of the imaging unit 16 is also referred to as "captured image data". The data of the photographed image is appropriately supplied to the CPU11, an image processing unit not shown, and the like.

The input unit 17 is configured by various buttons and the like, and inputs various information in accordance with an instruction operation by a user.

The output unit 18 is configured by a display, a speaker, and the like, and outputs images and sounds.

The storage unit 19 is configured by a hard disk, a flash memory, or the like, and stores data of various images.

The 1 st communication unit 20 controls communication with an external device (in the present embodiment, the mobile terminal 2) by the 1 st communication method which is low in speed, power-saving, and suitable for constant connection. In the present embodiment, the 1 st communication scheme uses a communication scheme based on a BLE communication standard.

The 2 nd communication unit 21 controls communication with an external device (in the present embodiment, the mobile terminal 2) by the 2 nd communication method suitable for transmission and reception of a file at high speed. In the present embodiment, the 2 nd communication scheme uses a communication scheme based on the Wi-Fi communication standard in the wireless LAN.

The drive 22 is appropriately mounted with a removable medium 31 made of a magnetic disk, an optical disk, an opto-magnetic disk, a semiconductor memory, or the like. The program read out from the removable medium 31 by the drive 22 is installed in the storage section 19 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 19, similarly to the storage unit 19.

The power supply unit 23 is, for example, a lithium ion secondary battery, and is a power supply source that supplies driving power to the imaging device 1 via a power supply circuit (not shown), and supplies current as a driving source of the imaging device 1 to each component of the imaging device 1. The power supply unit 23 is controlled by the CPU11 to stop the supply of power to the output unit 18 and the like and turn off the display output, for example, in a power-off state, and to maintain the supply of power in the communication of the 1 st communication unit 20, the 2 nd communication unit 21 and the like, and to enable image transmission even in the power-off state.

The mobile terminal 2 is configured as a smartphone, for example.

The hardware configuration is omitted as in the imaging apparatus 1. Hereinafter, when hardware in the imaging device 1 and the mobile terminal 2 is used as an explanation, the imaging device 1 is given "-1" at the end of the symbol, and the mobile terminal 2 is given "-2" at the end of the symbol. That is, the image pickup apparatus 1 is labeled as CPU11-1 to removable medium 31-1, and the portable terminal 2 is labeled as CPU11-2 to removable medium 31-2.

When the image pickup device 1 and the mobile terminal 2 configured as described above function to perform data communication, communication connection is established between the image pickup device 1 and the mobile terminal 2 by BLE which is the 1 st communication method (a constantly connected state). That is, the automatic transmission function of the photographed image is exhibited between the imaging device 1 and the mobile terminal 2 on the premise that connection is made by BLE which is the 1 st communication system.

Specifically, an instruction (connection instruction) is issued from the image pickup apparatus 1 to the mobile terminal 2 via communication in the 1 st communication method so that communication connection in Wi-Fi, which is the 2 nd communication method, is established, and communication connection in Wi-Fi, which is the 1 st communication method, is established between the image pickup apparatus 1 and the mobile terminal 2. In the present embodiment, the imaging device 1 is set to the Access Point (AP) mode so as to be the master in Wi-Fi, and the mobile terminal 2 is set to the Station (ST) mode so as to be the slave in Wi-Fi, which is the 1 ST communication method, so that the imaging device 1 and the mobile terminal 2 establish a communication connection by 1-to-1 direct communication.

In addition, in the case where 1-time communication connection is established and paired, information related to the pairing is held in each device. In the present embodiment in which the short-range communication is performed, a process is performed in which a device located within the range reached by the radio wave is searched for, and a communication connection is automatically established therefrom without input of a password or the like based on the held pairing information. In addition, regarding the pairing operation, first, the pairing operation is performed by displaying the device names and the like of all devices (devices in which BLE/Wi-Fi is activated) located in the periphery and designating a device that executes the cooperation process from among them by the user.

Fig. 4 is a functional block diagram showing a functional configuration for executing the automatic image reception processing and the mode operation processing among the functional configurations of the imaging device 1 and the mobile terminal 2.

First, the automatic image reception process will be described.

The "automatic image reception processing" is a series of processing for establishing a communication connection by the 2 nd communication method in the mobile terminal 2, transmitting a captured image to the mobile terminal 2, and automatically receiving an image in the mobile terminal 2 when the captured image is acquired from the imaging unit 16 in the imaging device 1.

When the automatic image reception process is executed on the imaging apparatus 1 side, as shown in fig. 4, the photographing control unit 51 and the communication control unit 52 function as the CPU 11-1.

Further, in one area of the storage section 19-1, an image storage section 71 is set.

The image storage unit 71 stores data of the shot image acquired from the imaging unit 16.

The photographing control section 51 controls the image pickup section 16 to execute photographing processing. As a result, the image pickup section 16 outputs a picked-up image. The outputted captured image is stored in the image storage section 71.

The communication control unit 52 controls the 1 st communication unit 20-1 (the 2 nd communication unit 21-1) to perform communication in BLE (Wi-Fi), which is the 1 st communication method (the 2 nd communication method), and to perform instruction and data communication to the mobile terminal 2.

Specifically, the communication control unit 52 controls, for example, the 2 nd communication unit 21-1 to perform communication under Wi-Fi, which is a 2 nd communication method, and transmits an image captured by the imaging device 1 to the mobile terminal 2.

When the mobile terminal 2 executes the automatic image reception process, the CPU11-2 functions as an application management unit 91 and a communication control unit 92, as shown in fig. 4.

In addition, the image storage unit 111 is set in one area of the storage unit 19-2.

The image storage unit 111 stores data of the captured image acquired from the imaging device 1.

The application management unit 91 manages the start and end of an application (program).

Specifically, the application management unit 91 performs communication under BLE, which is the 1 st communication scheme, for example, and, upon receiving an instruction to start an application from the 1 st communication unit 20-2, starts the designated application. In the present embodiment, the application management unit 91 starts an application that performs communication control in Wi-Fi and causes the application to function as communication control. The "activation" of an application or a device includes not only a case of newly executing an application but also a case of resuming the execution of an application in a sleep state (in a background execution), and also a case of accompanying a transition of a power supply from an off state to an on state.

The communication control unit 92 controls the 1 st communication unit 20-2 (the 2 nd communication unit 21-2) to perform communication under BLE (Wi-Fi) which is the 1 st communication method (the 2 nd communication method), and to perform reception of an instruction to the mobile terminal 2 and data communication.

Specifically, the communication control unit 92 controls, for example, the 2 nd communication unit 21-2 to perform communication in Wi-Fi, which is the 2 nd communication method, and receive an image from the imaging apparatus 1.

Fig. 5 is a flowchart illustrating a flow of automatic image reception processing executed by the imaging device 1 and the mobile terminal 2 of fig. 3 having the functional configuration of fig. 4.

In the starting state of the automatic image reception process, pairing of BLE as the 1 st communication method is completed between the imaging device 1 and the mobile terminal 2, and a state of constant connection is established. In addition, although the Wi-Fi communication system 1 is in the off state, settings (profiles) of Wi-Fi are acquired in advance between the imaging apparatus 1 and the mobile terminal 2, and a 1-to-1 communication connection can be established between the imaging apparatus 1 and the mobile terminal 2 when the Wi-Fi is activated.

< automatic image reception processing on imaging apparatus 1 side >

In step S111-1, the photographing control section 51 controls the image pickup section 16 to execute photographing processing. As a result, the image pickup section 16 outputs a picked-up image. The outputted captured image is stored in the image storage section 71.

When the automatic image transfer mode is set when the photographing process is executed, the communication control unit 52 controls the 1 st communication unit 20-1 to perform communication under BLE as the 1 st communication scheme with respect to the mobile terminal 2 and transmit an instruction to start the application in step S112-1. As a result, the application is started in the portable terminal 2 that has received the instruction to start the application. In the present embodiment, an application that performs communication control in Wi-Fi is activated to function as communication control.

In step S113-1, the communication control unit 52 controls the 1 st communication unit 20-1 to perform communication under BLE as the 1 st communication scheme with respect to the mobile terminal 2, and to transmit access point information (hereinafter referred to as "camera AP information") of the imaging device 1. As a result, in the mobile terminal 2 that has received the camera AP information, the Wi-Fi is turned on in an ST (station) mode in which the mobile terminal 2 becomes a slave.

In step S114-1, the communication control section 52 controls the 2 nd communication section 21-1 so that Wi-Fi is turned on in an AP (access point) mode to become a host.

In step S115-1, the communication control unit 52 performs communication in Wi-Fi, which is the 2 nd communication method, and determines whether or not the 2 nd communication unit 21-1 has established connection with the mobile terminal 2 in response to a connection request from the mobile terminal 2.

When the connection with the mobile terminal 2 is established, the determination is yes in step S115-1, and the process proceeds to step S118-1. The processing of step S118-1 will be described later.

In contrast, when the connection to the mobile terminal 2 is not established, the determination is no in step S115-1, and the process proceeds to step S116-1.

In step S116-1, the communication control unit 52 determines whether or not a predetermined time has elapsed and the time has timed out.

If the timeout has not elapsed, the determination is no in step S116-1, and the process returns to step S115-1.

If the time has timed out, the determination is yes in step S116-1, and the process proceeds to step S117-1.

In step S117-1, the communication control section 52 controls the 2 nd communication section 21-1 to turn off Wi-Fi. Then, the process returns to step S111-1.

In step S118-1, the communication control unit 52 controls the 2 nd communication unit 21-1 to perform communication in Wi-Fi, which is the 2 nd communication method, and to transmit the captured image to the connected mobile terminal 2. As a result, the shot image is transmitted through Wi-Fi. Then, the automatic image reception processing on the imaging apparatus 1 side ends.

< automatic image reception processing on the side of Mobile terminal 2 >

In step S111-2, the application management unit 91 performs communication under BLE as the 1 st communication scheme, and when receiving an instruction to start an application in the 1 st communication unit 20-2, starts the designated application. In the present embodiment, an application that performs communication control in Wi-Fi is activated to function as communication control.

In step S112-2, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication under BLE as the 1 ST communication scheme, and turns on Wi-Fi in the ST mode when the camera AP information is received from the imaging device 1.

In step S113-2, the communication control section 92 controls the 2 nd communication section 21-2 to retrieve the image pickup apparatus 1 of the Access Point (AP).

In step S114-2, the communication control unit 92 determines whether or not the imaging apparatus 1 of the Access Point (AP) is found.

If the image pickup apparatus 1 of the access point is found, the determination is yes in step S114-2, and the process proceeds to step S117-2. The processing after step S117-2 will be described later.

On the other hand, if the imaging apparatus 1 of the access point is not found, the determination is no in step S114-2, and the process proceeds to step S115-2.

In step S115-2, the communication control unit 92 determines whether or not a predetermined time has elapsed and the time has timed out.

If the timeout has not elapsed, the determination is no in step S115-2, and the process returns to step S114-2.

If the time has timed out, the determination is yes in step S115-2, and the process proceeds to step S116-2.

In step S116-2, the application management unit 91 ends the application started in step Si 11-2. By ending the application, the Wi-Fi communication function in the 2 nd communication section 21-2 is turned off. Then, the process returns to step S111-2.

In step S117-2, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication under Wi-Fi, which is the 2 nd communication method, to connect to the imaging apparatus 1 of the Access Point (AP), and to notify the imaging apparatus 1 of the connection (connection request).

In step S118-2, the communication control section 92 controls the 2 nd communication section 21-2 to receive the image transmitted from the image pickup apparatus 1. The received image is stored in the image storage section 111. Then, the automatic transmission/reception processing on the mobile terminal 2 side is ended.

Next, the mode operation processing will be described.

The "mode operation processing" is a series of processing for establishing a communication connection by the 2 nd communication method in the image pickup apparatus 1 based on various modes of the REC mode and the PLAY mode in the mobile terminal 2 and causing the image pickup apparatus 1 to execute an operation corresponding to the mode.

When the imaging apparatus 1 executes the mode operation processing, the photographing control unit 51 and the communication control unit 52 function as shown in fig. 4 in the CPU 11-1.

The photographing control section 51 controls the image pickup section 16 to take a through image for the REC mode. As a result, a through image is output from the image pickup section 16.

The communication control unit 52 controls the 1 st communication unit 20-1 (the 2 nd communication unit 21-1) to perform communication under BLE (Wi-Fi) which is the 1 st communication method (the 2 nd communication method), and to perform instruction and data communication to the mobile terminal 2.

Specifically, the communication control unit 52 controls the 2 nd communication unit 21-1 to perform communication in Wi-Fi, which is a 2 nd communication method, and transmits the through image obtained from the image pickup unit 16 to the mobile terminal 2, for example, in the REC mode. Further, the communication control unit 52 controls the 2 nd communication unit 21-1 to perform communication in Wi-Fi, which is the 2 nd communication method, in the PLAY mode, and transmits a list of images stored in the image storage unit 71 to the mobile terminal 2.

The image storage unit 111 stores data of an image acquired from the imaging device 1.

The application management unit 91 manages the start and end of an application.

Specifically, the application management unit 91 performs communication under BLE, which is the 1 st communication scheme, for example, and, upon receiving an instruction to start an application from the 1 st communication unit 20-2, starts the designated application. In the present embodiment, the application management unit 91 starts an application that performs communication control in Wi-Fi and causes the application to function as communication control.

The communication control unit 92 controls the 1 st communication unit 20-2 (the 2 nd communication unit 21-2) to perform communication under BLE (Wi-Fi) which is the 1 st communication method (the 2 nd communication method), and to perform instruction and data communication to the mobile terminal 2.

Specifically, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication in Wi-Fi, which is a 2 nd communication method, and receives a through image obtained from the image pickup unit 16 from the image pickup device 1, for example, in the REC mode. The communication control unit 52 controls the 2 nd communication unit 21-2 to perform communication in Wi-Fi, which is the 2 nd communication method, in the PLAY mode, and receives a list of images stored in the image storage unit 71 from the image pickup device 1.

Fig. 6 is a flowchart illustrating a flow of a mode operation process executed by the imaging device 1 and the mobile terminal 2 of fig. 3 having the functional configuration of fig. 4.

In the starting state of the mode operation processing, pairing of BLE as the 1 st communication method is completed between the imaging device 1 and the mobile terminal 2, and a state of constant connection is established. In addition, although the Wi-Fi communication system 1 is in the off state, settings (profiles) of Wi-Fi are acquired in advance between the imaging apparatus 1 and the mobile terminal 2, and a 1-to-1 communication connection can be established between the imaging apparatus 1 and the mobile terminal 2 when the Wi-Fi is activated.

< processing of mode operation on imaging apparatus 1 side >

In step S211-1, the CPU11 performs communication under BLE as the 1 st communication scheme with respect to the mobile terminal 2, activates the image pickup device 1 in response to an activation request from the mobile terminal 2, and sets a mode specified when the mode is specified from the time of activation of the mobile terminal 2. In the present embodiment, the mode may be any of the following modes: an REC mode in which the portable terminal 2 performs shooting while checking a through image from the image pickup device 1; and a PLAY mode in which the portable terminal 2 views a list of images stored in the imaging device 1.

In step S212-1, the communication control unit 52 controls the 1 st communication unit 20-1 to perform communication under BLE as the 1 st communication scheme with respect to the mobile terminal 2, and to transmit the camera AP information. As a result, in the mobile terminal 2 that has received the camera AP information, the Wi-Fi is turned on in an ST (station) mode in which the mobile terminal 2 becomes a slave unit, based on the received camera AP information.

In step S213-1, the communication control unit 52 controls the 2 nd communication unit 21-1 so as to turn on Wi-Fi in the AP (access point) mode as the master.

In step S214-1, the communication control unit 52 performs communication in Wi-Fi, which is the 2 nd communication method, and determines whether or not a connection with the mobile terminal 2 is established in the 2 nd communication unit 21-1 in response to a connection request from the mobile terminal 2.

When the connection with the mobile terminal 2 is established, the determination is yes in step S214-1, and the process proceeds to step S217-1. The processing of step S217-1 will be described later.

In contrast, when the connection to the mobile terminal 2 is not established, the determination is no in step S214-1, and the process proceeds to step S215-1.

In step S215-1, the communication control unit 52 determines whether or not a predetermined time has elapsed and the time has timed out.

If the timeout has not elapsed, the determination is no in step S215-1, and the process returns to step S214-1.

If the time has timed out, the determination is yes in step S215-1, and the process proceeds to step S216-1.

In step S216-1, the communication control section 52 controls the 2 nd communication section 21-1 to turn off Wi-Fi. Then, the process returns to step S211-1.

In step S217-1, the photographing control unit 51 and the communication control unit 52 operate in the mode designated in step S211-1 or the mode newly designated from the mobile terminal 2. That is, when the designated mode is the REC mode and a request to transmit a through-image is made, the photographing control unit 51 controls the image pickup unit 16 to pick up the through-image and acquire the through-image. Then, the communication control unit 52 controls the 2 nd communication unit 21-1 to perform communication under Wi-Fi, which is the 2 nd communication method, and sequentially transmits the acquired through-images to the mobile terminal 2. When the designated mode is the PLAY mode and there is a request to transmit a list of images (thumbnail images), the communication control unit 52 controls the 2 nd communication unit 21-1 to perform communication in Wi-Fi, which is the 2 nd communication method, and transmits the list of images stored in the image storage unit 111 to the mobile terminal 2.

Then, the mode operation processing on the imaging apparatus 1 side is ended.

< processing of mode operation on the side of Mobile terminal 2 >

In step S211-2, the application managing section 91 starts the application by the user' S operation of the input section 17 or the like. In the present embodiment, an application that functions to specify a mode is started to function to specify a mode.

In step S212-2, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication under BLE as the 1 st communication scheme, and activates the imaging device 1. Further, when the mode at the time of activation of the imaging apparatus 1 needs to be designated, information for designating the mode is transmitted. In the present embodiment, the mode can specify any of the following modes: an REC mode in which the portable terminal 2 performs shooting while checking a through image from the image pickup device 1; and a PLAY mode in which the portable terminal 2 views a list of images stored in the imaging device 1.

In step S213-2, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication under BLE as the 1 ST communication scheme, and turns on Wi-Fi in the ST mode when the camera AP information is received from the imaging device 1.

In step S214-2, the communication control section 92 controls the 2 nd communication section 21-2 to retrieve the image pickup apparatus 1 of the Access Point (AP).

In step S215-2, the communication control unit 92 determines whether or not the imaging apparatus 1 of the Access Point (AP) is found.

If the camera 1 of the access point is found, the determination is yes in step S215-2, and the process proceeds to step S218-2. The processing after step S218-2 will be described later.

On the other hand, if the imaging apparatus 1 of the access point is not found, the determination is no in step S215-2, and the process proceeds to step S216-2.

In step S216-2, the communication control unit 92 determines whether or not a predetermined time has elapsed and the time has timed out.

If the timeout has not elapsed, the determination is no in step S216-2, and the process returns to step S215-2.

If the time has timed out, the determination is yes in step S216-2, and the process proceeds to step S217-2.

In step S217-2, the application management unit 91 ends the application started in step S211-2. By ending the application, the Wi-Fi communication function in the 2 nd communication section 21-2 is turned off. Then, the process returns to step S211-2.

In step S218-2, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication in Wi-Fi, which is the 2 nd communication method, with the imaging apparatus 1, to connect to the imaging apparatus 1 of the Access Point (AP), and to notify the imaging apparatus 1 of the connection (connection request).

In step S219-2, the communication control section 92 confirms the mode designated by the user operation or the like.

In the case where the specified mode is REC, it becomes "REC" in step S219-2, and the process proceeds to step S220-2.

In step S220-2, the communication control unit 92 performs communication in Wi-Fi, which is the 2 nd communication method, with respect to the imaging apparatus 1, performs switching to the REC mode and a request for transmitting a through-image, and sequentially acquires through-images sequentially transmitted from the imaging apparatus 1 in accordance with the request. Then, the sequentially acquired through-images are sequentially displayed on the output unit 18-2. The user performs operations such as a photographing instruction while viewing a through image captured by the imaging apparatus 1. Then, the mode operation processing on the mobile terminal 2 side ends.

On the other hand, if the mode designated by the user operation or the like is PLAY, "PLAY" is set in step S219-2, and the process proceeds to step S221-2.

In step S221-2, the communication control unit 92 performs communication in Wi-Fi, which is the 2 nd communication method, with respect to the imaging apparatus 1, performs switching to the PLAY mode and a request for transmitting a list of images stored in the image storage unit 71, and acquires a list of images (thumbnail images) transmitted from the imaging apparatus 1 in response to the request. Then, the list of the acquired images is displayed on the output unit 18-2. The user performs operations such as selecting an image acquired from the imaging apparatus 1 while viewing a list of images stored in the imaging apparatus 1. Then, the mode operation processing on the mobile terminal 2 side ends.

Fig. 7 is a schematic diagram showing a display of a communication state showing a transition of the communication state of the image pickup device 1 and the portable terminal 2 which sequentially changes with the execution of the various processes described above.

As shown in the example of fig. 7, the display of the communication states of the imaging device 1 and the mobile terminal 2 in the 1 st communication method and the 2 nd communication method is configured to change the display for each state.

When the communication state is not paired and not connected (pairing: not > < connection: none >), the state display is not performed.

When the communication is paired but not connected in the communication state (< pairing: complete > < connection: none >), icons indicating the 1 st communication method and the 2 nd communication method are displayed in a broken line or semi-transparent state.

When the communication is paired and connected in the communication state (< pairing: completed > < connection: present >), icons indicating the 1 st communication method and the 2 nd communication method are displayed.

The imaging device 1 configured as described above includes the 2 nd communication unit 21-1, the communication control unit 52, the 1 st communication unit 20-1, and the communication control unit 52.

The communication control section 52 performs a given cooperation process by performing data transfer with the portable terminal 2 as another device through the 2 nd communication section 21-1.

The 1 st communication unit 20-1 maintains a communication connection with the portable terminal 2 as another device even in a state where the given cooperation process by the communication control unit 52 cannot be executed.

The communication control section 52 makes a transition from a state in which the given cooperation process by the communication control section 52 cannot be executed to a state in which the given cooperation process by the communication control section 1 is executable by performing the given communication by the 1 st communication section 20-1.

Thus, even in a state where the predetermined cooperation process by the communication control unit 52 cannot be executed, the communication connection with the portable terminal 2 as another device is maintained, and the predetermined communication is performed by the 1 st communication unit 20-1, whereby the predetermined cooperation process by the communication control unit 52 is executed by shifting from a state where the predetermined cooperation process by the communication control unit 52 cannot be executed to a state where the predetermined cooperation process by the communication control unit 52 can be executed.

Therefore, the imaging apparatus 1 can receive the given data without operating the portable terminal 2, and can improve the convenience of cooperation among a plurality of apparatuses via wireless communication.

The 1 st communication unit 20-1 is lower in speed but saves power than the 2 nd communication unit 21-1.

The 1 st communication section 20-1 maintains the communication connection with the portable terminal 2 as the other device even in a state in which the given cooperation process cannot be executed because the communication connection with the portable terminal 2 as the other device based on the 2 nd communication section 21-1 is not established.

The communication control section 52 makes a predetermined communication by the 1 st communication section 20-1 to transit from a state in which a communication connection with the portable terminal 2 as another device based on the 2 nd communication section 21-1 is not established to an established state.

Thereby, in a state of lower power consumption, the connection with the portable terminal 2 as another device is maintained, and it is possible to shift to a state in which a given cooperation process can be executed.

The 1 st communication unit 20-1 maintains a communication connection with the portable terminal 2 as another apparatus even in a state in which the given cooperation process cannot be executed because the readiness of either the portable terminal 2 or the image pickup device 1 as another apparatus to execute the given cooperation process is not ready.

The communication control unit 52 causes any one of the portable terminal 2 and the imaging apparatus 1, which is another device, to transition from a state in which the execution of the predetermined cooperation process is not ready to a state in which the predetermined communication is performed by the 1 st communication unit 20-1.

In this way, it is possible to change from a state in which one of the devices that execute the predetermined cooperation process is not ready to a state in which the other device is ready to execute the predetermined cooperation process.

The state of readiness to execute the predetermined cooperation process means a state in which the power of either the mobile terminal 2 or the imaging device 1, which is another device, is turned off, a state in which a program for executing the predetermined cooperation process is not started, or a state in which the 2 nd communication unit 21-1 does not function.

Thereby, it is possible to transition from various states in which a part of functions for executing a given cooperative processing is not operated to a state in readiness for executing the given cooperative processing.

By performing the predetermined communication by the 1 st communication unit 20-1, the communication control unit 52 can cause both the mobile terminal 2 and the imaging apparatus 1 as the other devices to be in the ready state for executing the predetermined cooperation process even when either the mobile terminal 2 or the imaging apparatus 1 as the other devices is in the state of not being ready for executing the predetermined cooperation process.

In this way, both the devices that execute the predetermined cooperation process can be brought into a ready state for executing the predetermined cooperation process by either one of the devices that execute the predetermined cooperation process.

When the portable terminal 2 as the other device is in a state of not being ready to execute the predetermined cooperation process, the communication control unit 52 causes the portable terminal 2 as the other device to transit to a state of being ready to execute the predetermined cooperation process by transmitting a predetermined signal from the 1 st communication unit 20-1 to the portable terminal 2 as the other device.

Further, when the imaging apparatus 1 is in a state in which the imaging apparatus is not ready to execute the predetermined cooperation process, the communication control unit 52 causes the imaging apparatus 1 to shift to a state in which the imaging apparatus is ready to execute the predetermined cooperation process by receiving a predetermined signal from the portable terminal 2 as another device by the 1 st communication unit 20-1.

Thus, by transmitting and receiving a predetermined signal by the 2 nd wireless communication, both devices that execute a predetermined cooperation process can be brought into a ready state for execution.

The given cooperation process includes a 1 st cooperation process of controlling the portable terminal 2 as the other device by the operation of the image pickup apparatus 1, and a 2 nd cooperation process of controlling the image pickup apparatus 1 by the operation of the portable terminal 2 as the other device.

When the 1 st cooperation process is performed, the communication control unit 52 transmits a predetermined signal to the mobile terminal 2 as another device by the 2 nd wireless communication according to the operation of the image pickup apparatus 1, thereby bringing the mobile terminal 2 as another device into a ready state in which the 1 st prevention process is executed.

Further, when performing the 2 nd cooperation process, the communication control unit 52 receives a predetermined signal transmitted by the 2 nd wireless communication in accordance with the operation of the portable terminal 2 as another device, thereby causing the image pickup apparatus 1 to shift to a state ready for performing the 2 nd cooperation process.

This enables the imaging apparatus 1 to control the mobile terminal 2 as another device to perform the 1 st cooperation process, or the imaging apparatus 1 to control the mobile terminal 2 as another device to perform the 2 nd cooperation process.

The communication control unit 52 arbitrarily specifies the portable terminal 2 as another device performing a given cooperation process as a specified device via a user operation based on the input unit 17 or the like.

The communication control unit 52 is set to a state in which the communication connection with the specified device by the 2 nd communication unit 21-1 is released in a state in which the communication connection with the specified device by the 1 st communication unit 20-1 is started and maintained.

Further, the communication control section 52 starts communication connection with the specified device based on the 2 nd communication section 21-1 by performing the given communication in which the specified device is specified by the 1 st communication section 20-1.

Thereby, the portable terminal 2 as a specific other device can be specified to execute the given cooperation process.

One of the imaging device 1 and the mobile terminal 2 as another device is the imaging device 1 having an imaging function, and the other is the mobile terminal 2 having an image display function.

The predetermined cooperation process includes an image transfer process of transferring image data captured by the image capturing apparatus 1 to the display terminal through the 2 nd communication unit 21-1 to display the image data.

This makes it possible to transmit image data captured by the imaging device 1 to the display terminal in cooperation with the mobile terminal 2, and to display the image data using the function of the display terminal.

The given cooperation process includes a 1 st cooperation process of starting the image transfer process according to the operation of the image pickup apparatus 1, and a 2 nd cooperation process of starting the image transfer process according to the operation of the display terminal.

Thereby, it is possible to transfer image data to the display terminal in accordance with the operation of the image pickup apparatus 1, or to transfer image data from the image pickup apparatus 1 in accordance with the operation of the display terminal.

The communication system S configured as above includes the image pickup device 1 and the portable terminal 2 that realize a given function in cooperation with each other.

The imaging device 1 includes a 2 nd communication unit 21-1, a communication control unit 52, a 1 st communication unit 20-1, and a communication control unit 52.

The 1 st communication section 20-1 maintains a communication connection with the portable terminal 2 as another device even in a state in which a given cooperation process based on the communication control section 52 cannot be executed.

The communication control section 52 makes a transition from a state in which the given cooperation process by the communication control section 52 is not executable to a state in which it is executable by performing the given communication by the 1 st communication section 20-1.

Further, the communication control section 52 transmits the image data captured by the imaging device 1 as the 1 st apparatus to the portable terminal 2 as the 2 nd apparatus by the 2 nd communication method as the 2 nd wireless communication.

The communication control unit 52 maintains a communication connection between the image pickup apparatus 1 as the 1 st device and the portable terminal 2 as the 2 nd device based on the 1 st communication method as the 1 st wireless communication in a state where the communication connection between the image pickup apparatus 1 as the 1 st device and the portable terminal 2 as the 2 nd device based on the 2 nd communication method as the 2 nd wireless communication is disconnected, and transmits and receives predetermined control data between the image pickup apparatus 1 as the 1 st device and the portable terminal 2 as the 2 nd device by the 1 st communication method as the 1 st wireless communication, thereby shifting the 2 nd communication method as the 2 nd wireless communication from a state where the communication connection between the image pickup apparatus 1 as the 1 st device and the portable terminal 2 as the 2 nd device is disconnected to a state where the communication connection is connected.

Thus, in the communication system S, connection can be performed without an operation performed in the mobile terminal 2, and the convenience of cooperation among a plurality of devices via wireless communication can be improved.

In the above embodiment, the imaging apparatus 1 as the 1 st device may be configured to further include the communication control unit 52/the communication control unit 92, which are association means for storing association information associating the imaging apparatus 1 as the 1 st device and the portable terminal 2 as the 2 nd device with each other as communication targets.

The imaging apparatus 1 as the 1 st device can be configured to change from a state in which the communication connection between the imaging apparatus 1 as the 1 st device and the portable terminal 2 as the 2 nd device is disconnected to a state in which the communication connection is connected, in accordance with the association information stored in the communication control unit 52/the communication control unit 92 as the association means.

In the above embodiment, the communication control unit 52/the communication control unit 92 as the association unit may be configured to associate the imaging apparatus 1 as the 1 st device with the portable terminal 2 as the 2 nd device by transmitting and receiving information related to the pairing as the association information.

In the above-described embodiment, the communication control unit 52/the communication control unit 92 as the association unit may be configured to associate the imaging apparatus 1 as the 1 st device and the portable terminal 2 as the 2 nd device with each other as the communication targets by the communication control unit 52 by transmitting and receiving the association information.

In the above-described embodiment, the communication control unit 52 and the communication control unit 92 as the association means may be configured to display and select the device name of the target candidate to be associated using the identification information of the device in the output unit 18.

Conventionally, a technology for connecting an imaging device such as a digital camera to an information processing device such as a smartphone by wireless communication has been used.

In such a technique, in the case of remotely operating an image pickup apparatus by wireless communication from an information processing apparatus, first, wireless communication connection is established between these apparatuses, and then a given remote operation is performed.

In addition, conventionally, as an example of such a technique, there is an image pickup system that remotely operates a camera by a camera operation terminal (for example, see JP 2014-230024).

However, in the case of remotely operating an image pickup apparatus by an information processing apparatus, it is necessary to establish a wireless communication connection after turning on the power of these apparatuses every time the remote operation is performed. Further, after the roles of the respective devices are set in advance so as to remotely operate the image pickup apparatus from the information processing apparatus, the function of remotely operating the image pickup apparatus from the information processing apparatus is also a function that can be used only by a limited amount, and therefore, the user of the remote operation is not convenient.

The present embodiment has been made in view of such a situation, and an object thereof is to improve the convenience of cooperation among a plurality of devices via wireless communication.

< embodiment 2 >

Fig. 8 is a system configuration diagram showing another system configuration of the communication system according to the embodiment of the present invention.

As shown in fig. 8, the communication system S is premised on the system configuration shown in fig. 1, and includes an imaging device 1 having at least an imaging/communication function, a mobile terminal 2 having at least an image display/communication function, and a server 3. In the communication system S, an image captured by the imaging device 1 is transmitted to the server 3 via the mobile terminal 2, the image is stored for sharing, and sharing information such as an address of the stored image is transmitted to the other

mobile terminals

100, and 100 … that are set to be shared. The other mobile terminal 100 accesses the server 3 to view an image or the like based on the received shared information.

The communication system S has the following functions: when a user operates one of the image pickup apparatus 1 and the mobile terminal 2, the user requests the other apparatus to perform a communication connection in a communication scheme capable of communicating image file-level data from the one operating apparatus operated by the user, and transmits and receives image files to and from the other apparatus, views image data held by the other apparatus, and the like in accordance with the operation of the operating apparatus in a state where the communication connection between the image pickup apparatus 1 and the mobile terminal 2 is established.

As shown in fig. 3, the server 3 is connected to the mobile terminal 2 via a network N such as the internet so as to be able to exchange image data, and is configured to be able to disclose an image on the network. Since the hardware configuration is the same except for the imaging device 1, the imaging unit 16, and the 1 st communication unit 20, the description thereof is omitted.

Hereinafter, when hardware in the server 3 is used as an explanation, "-3" is added to the end of the symbol. That is, server 3 is labeled CPU11-3 to removable media 31-3.

Here, the cooperation preparation process (pairing process) will be described.

The user arbitrarily designates the image pickup device 1 and the portable terminal 2 to be subjected to the automatic image transfer processing from among the plurality of image pickup devices and the plurality of portable terminals, and performs a process of pairing the designated image pickup device 1 and the portable terminal 2.

After the cooperation preparation process (pairing process) is completed, whether or not to perform the cooperation operation, which of the automatic image transfer process and the remote operation process is executed, is automatically determined according to the mode setting operation of the image pickup apparatus 1 and the portable terminal 2 by the user, and which of the image pickup apparatus 1 and the portable terminal 2 is operated by the user.

When a user operation instructs to photograph, the imaging apparatus 1 performs normal photographing recording if the cooperative operation mode is not set, and automatically starts the automatic image transfer process if the cooperative operation mode is set.

When the user operation instructs the cooperative operation, the mobile terminal 2 automatically starts the remote operation process.

Next, the automatic image transfer process will be described.

The "automatic image transfer processing" is a series of processing for establishing a communication connection by the 2 nd communication method with the mobile terminal 2, transmitting a photographed image to the mobile terminal 2, and automatically receiving an image at the mobile terminal 2 when the photographed image is acquired from the image pickup unit 16 in the image pickup device 1.

The communication control unit 52 controls the 1 st communication unit 20-1 (the 2 nd communication unit 21-1) to perform communication in LE (Wi-Fi) which is the 1 st communication method (the 2 nd communication method) and to perform instruction and data communication to the mobile terminal 2.

Specifically, the communication control unit 52 controls the 2 nd communication unit 21-1, for example, to perform communication under Wi-Fi, which is the 2 nd communication method, and to transmit the image captured by the imaging device 1 to the mobile terminal 2.

The application management unit 91 manages the start and end of an application (application program).

Specifically, the application management unit 91 performs communication in LE as the 1 st communication method, for example, and when an instruction to start an application program (hereinafter simply referred to as "application") is received by the 1 st communication unit 20-2, the designated application is started. In the present embodiment, the application management unit 91 starts an application that performs communication control in Wi-Fi and causes the application to function as communication control. The "activation" of an application or a device includes not only a case of newly executing an application but also a case of resuming the execution of an application in a sleep state (in a background execution), and also a case of accompanying a transition of a power supply from an off state to an on state.

The communication control unit 92 controls the 1 st communication unit 20-2 (the 2 nd communication unit 21-2) to perform communication in LE (Wi-Fi) which is the 1 st communication method (the 2 nd communication method), and to receive an instruction to the mobile terminal 2 and perform data communication.

Fig. 9 is a flowchart illustrating a flow of automatic image reception processing executed by the imaging device 1 and the mobile terminal 2 of fig. 3 having the functional configurations of fig. 4.

In the starting state of the automatic image reception process, the pairing of the LE as the 1 st communication method is completed between the imaging apparatus 1 and the mobile terminal 2, and the communication is always connected. In addition, although the Wi-Fi communication system 2 is in the off state, settings (profiles) of the Wi-Fi communication systems are acquired in advance between the imaging apparatus 1 and the mobile terminal 2, and a 1-to-1 communication connection can be easily established between the imaging apparatus 1 and the mobile terminal 2 when the Wi-Fi communication system is activated.

< automatic image transfer processing on imaging apparatus 1 side >

In step S311-1, the photographing control section 51 controls the image pickup section 16 to execute photographing processing. As a result, the image pickup section 16 outputs a picked-up image. The outputted captured image is stored in the image storage section 71.

In step S312-1, the communication control unit 52 controls the 1 st communication unit 20-1 to perform communication in LE as the 1 st communication method for the mobile terminal 2, and to transmit an instruction to start an application. As a result, the application is started in the portable terminal 2 that has received the instruction to start the application. In the present embodiment, an application that performs communication control in Wi-Fi is activated to function as communication control.

In step S313-1, the communication control unit 52 controls the 1 st communication unit 20-1 to perform communication in LE as the 1 st communication scheme with respect to the mobile terminal 2, and transmits access point information (hereinafter referred to as "camera AP information") of the imaging apparatus 1. As a result, in the mobile terminal 2 that has received the camera AP information, Wi-Fi is turned on in an ST (station) mode in which the mobile terminal 2 becomes a slave.

In step S314-1, the communication control unit 52 controls the 2 nd communication unit 21-1 to turn on Wi-Fi in the AP (access point) mode as the host.

In step S315-1, the communication control unit 52 performs communication in Wi-Fi, which is the 2 nd communication method, and determines whether or not the 2 nd communication unit 21-1 has established a connection with the mobile terminal 2 (if a connection with the mobile terminal 2 is not established, waits for a connection request from the mobile terminal 2 to establish a connection).

When the connection with the mobile terminal 2 is established, the determination is yes in step S315-1, and the process proceeds to step S318-1. The processing of step S318-1 will be described later.

In contrast, when the connection to the mobile terminal 2 is not established, the determination is no in step S315-1, and the process proceeds to step S316-1.

In step S316-1, the communication control unit 52 determines whether or not a predetermined time has elapsed and the time has timed out.

If the timeout has not elapsed, the determination is no in step S316-1, and the process returns to step S315-1.

If the time has timed out, the determination is yes in step S316-1, and the process proceeds to step S317-1.

In step S317-1, an error message or the like is displayed, and the communication control unit 52 controls the 2 nd communication unit 21-1 to turn off Wi-Fi (at this time, instead of turning off Wi-Fi immediately, it may try reconnection according to an instruction from the user, or it may automatically repeat trying reconnection for a certain period of time). Then, the process returns to step S311-1.

In step S318-1, the communication control unit 52 controls the 2 nd communication unit 21-1 to perform communication under Wi-Fi, which is the 2 nd communication method, and transmits the captured image to the connected mobile terminal 2. As a result, the captured photographic image is transmitted through Wi-Fi. Then, the automatic image reception processing on the imaging apparatus 1 side ends.

< automatic image reception processing on the side of Mobile terminal 2 >

In step S311-2, the application management unit 91 performs communication under BLE as the 1 st communication scheme, and when receiving an instruction to start an application in the 1 st communication unit 20-2, starts the designated application. In the present embodiment, an application that performs communication control in Wi-Fi is activated to function as communication control.

In step S312-2, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication under BLE as the 1 ST communication scheme, and turns on Wi-Fi in the ST mode when the camera AP information is received from the imaging device 1.

In step S313-2, the communication control section 92 controls the 2 nd communication section 21-2 to retrieve the image pickup apparatus 1 of the Access Point (AP) corresponding to the received camera AP information.

In step S314-2, the communication control unit 92 determines whether or not the imaging apparatus 1 of the Access Point (AP) is found.

In the case where the image pickup apparatus 1 of the access point is found (or the case where the connection with the image pickup apparatus 1 has been established), it is determined as yes in step S314-2, and the processing proceeds to step S317-2. The processing after step S317-2 will be described later.

On the other hand, if the imaging apparatus 1 of the access point is not found, the determination is no in step S314-2, and the process proceeds to step S315-2.

In step S315-2, the communication control unit 92 determines whether or not a predetermined time has elapsed and the time has timed out.

If the timeout has not elapsed, the determination is no in step S315-2, and the process returns to step S314-2.

If the time has timed out, the determination is yes in step S315-2, and the process proceeds to step S316-2.

In step S316-2, an error message or the like is displayed, and the application management section 91 ends the application started in step S311-2. The Wi-Fi communication function in the 2 nd communication unit 21-2 is turned off by ending the application (in this case, the application may not be immediately ended or the Wi-Fi may not be turned off, but reconnection may be attempted according to an instruction from the user or reconnection may be repeatedly attempted automatically for a certain period of time). Then, the process returns to step S311-2.

In step S317-2, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication under Wi-Fi, which is the 2 nd communication method, to connect to the image pickup apparatus 1 of the Access Point (AP), and to notify the image pickup apparatus 1 of the connection (to establish communication connection with the image pickup apparatus 1).

In step S318-2, the communication control section 92 controls the 2 nd communication section 21-2 to receive the image transmitted from the image pickup apparatus 1. The received image is stored in the image storage section 111. Then, the automatic transmission/reception processing on the mobile terminal 2 side is ended.

Next, the remote operation process will be described.

The "remote operation process" is a series of processes in which, when the mobile terminal 2 instructs a cooperative operation by a user operation and selects various cooperative operation modes such as the REC mode and the PLAY mode, a communication connection is established with the imaging apparatus 1 by the 2 nd communication method, and the imaging apparatus 1 is caused to execute an operation corresponding to the selected cooperative operation mode.

The image storage unit 71 stores data of the shot image acquired from the image pickup unit 16-1.

The photographing control section 51 controls the image pickup section 16-1 to take a through image for the REC mode. As a result, a through image is output from the image pickup section 16-1.

Specifically, the communication control unit 52 controls the 2 nd communication unit 21-1 to perform communication in Wi-Fi, which is a 2 nd communication method, and transmits the through image obtained from the image pickup unit 16-1 to the mobile terminal 2, for example, in the REC mode. Further, the communication control unit 52 controls the 2 nd communication unit 21-1 to perform communication in Wi-Fi, which is the 2 nd communication method, in the PLAY mode, and transmits a list of images stored in the image storage unit 71 to the mobile terminal 2.

The application management unit 91 manages the start and end of an application.

Specifically, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication in Wi-Fi, which is a 2 nd communication method, and receives a through image obtained from the image pickup unit 16-1 from the image pickup device 1, for example, in the REC mode. The communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication in Wi-Fi, which is the 2 nd communication method, in the PLAY mode, and receives a list of images stored in the image storage unit 71 from the image pickup device 1.

Fig. 10 is a flowchart illustrating a flow of remote operation processing executed by the imaging apparatus 1 and the mobile terminal 2 of fig. 3 having the functional configuration of fig. 4.

< remote operation processing on imaging apparatus 1 side >

In step S411-1, the image pickup device 1 is activated in response to a request from the portable terminal 2 via communication under BLE as the 1 st communication method, and sets the cooperative operation mode designated from the portable terminal 2. In the present embodiment, the cooperative operation mode may be any of the following modes: an REC mode in which the portable terminal 2 performs shooting while checking a through image from the image pickup device 1; and a PLAY mode in which the portable terminal 2 views a list of images stored in the imaging device 1.

In step S412-1, the communication control unit 52 controls the 1 st communication unit 20-1 to perform communication under BLE as the 1 st communication scheme with respect to the mobile terminal 2, and to transmit the camera AP information. As a result, in the mobile terminal 2 that has received the camera AP information, Wi-Fi is turned on in an ST (station) mode in which the mobile terminal 2 becomes a slave.

In step S413-1, the communication control unit 52 controls the 2 nd communication unit 21-1 to turn on Wi-Fi in the AP (access point) mode as the host.

In step S414-1, the communication control unit 52 performs communication in Wi-Fi, which is the 2 nd communication method, and determines whether or not the 2 nd communication unit 21-1 has established a connection with the mobile terminal 2.

When the connection to the mobile terminal 2 is established, the determination is yes in step S414-1, and the process proceeds to step S417-1. The processing of step S417-1 will be described later.

In contrast, when the connection to the mobile terminal 2 is not established, the determination is no in step S414-1, and the process proceeds to step S415-1.

In step S415-1, the communication control unit 52 determines whether or not a preset time has elapsed and the time has timed out.

If the timeout has not elapsed, the determination is no in step S415-1, and the process returns to step S414-1.

If the time has timed out, the determination is yes in step S415-1, and the process proceeds to step S416-1.

In step S416-1, the communication control section 52 controls the 2 nd communication section 21-1 to turn off Wi-Fi. Then, the process returns to step S411-1.

In step S417-1, the imaging control unit 51 and the communication control unit 52 operate in the mode designated in step S411-1. That is, when the designated mode is the REC mode, the photographing control section 51 controls the image pickup section 16-1 to take a through image, thereby acquiring the through image. Then, the communication control unit 52 controls the 2 nd communication unit 21-1 to perform communication in Wi-Fi, which is the 2 nd communication method, and transmits the acquired through image to the mobile terminal 2. When the designated mode is the PLAY mode, the communication control unit 52 controls the 2 nd communication unit 21-1 to perform communication in Wi-Fi, which is the 2 nd communication method, and transmits a list of images stored in the image storage unit 111 to the mobile terminal 2.

Then, the mode operation processing on the imaging apparatus 1 side is ended.

< remote operation processing on the side of Mobile terminal 2 >

In step S411-2, the application management unit 91 starts the application by the user operating the input unit 17 or the like. In the present embodiment, an application that functions to specify a mode is started to function to specify a mode.

In step S412-2, when the user operates the input unit 17 to select any one of the plurality of cooperative operation modes including the REC mode and the PLAY mode, the communication control unit 92 controls the 2 nd communication unit 21-2 to transmit instruction information for instructing to start and set the selected cooperative operation mode to the imaging apparatus 1 via communication in BLE which is the 1 st communication method. In the present embodiment, the cooperative operation mode may be any one of the following modes: an REC mode in which the portable terminal 2 performs shooting while checking a through image from the image pickup device 1; and a PLAY mode in which the portable terminal 2 views a list of images stored in the imaging device 1.

In step S413-2, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication under BLE as the 1 ST communication scheme, and turns on Wi-Fi in the ST mode when the camera AP information is received from the imaging device 1.

In step S414-2, the communication control section 92 controls the 2 nd communication section 21-2 to retrieve the image pickup apparatus 1 of the Access Point (AP).

In step S415-2, the communication control unit 92 determines whether or not the imaging apparatus 1 of the Access Point (AP) is found.

If the image pickup apparatus 1 of the access point is found, the determination is yes in step S415-2, and the process proceeds to step S418-2. The processing after step S418-2 will be described later.

In contrast, if the imaging apparatus 1 of the access point is not found, the determination is no in step S415-2, and the process proceeds to step S416-2.

In step S416-2, the communication control unit 92 determines whether or not a predetermined time has elapsed and the time has timed out.

If the timeout has not elapsed, the determination is no in step S416-2, and the process returns to step S415-2.

If the time has timed out, the determination is yes in step S416-2, and the process proceeds to step S417-2.

In step S417-2, the application management unit 91 terminates the application started in step S411-2. By ending the application, the Wi-Fi communication function in the 2 nd communication section 21-2 is turned off. Then, the process returns to step S411-2.

In step S418-2, the communication control unit 92 controls the 2 nd communication unit 21-2 to perform communication in Wi-Fi, which is the 2 nd communication method, with the imaging apparatus 1, to connect to the imaging apparatus 1 of the Access Point (AP), and notifies the imaging apparatus 1 of the connection.

In step S419-2, the communication control unit 92 confirms the designated cooperative operation mode.

If the specified cooperative operation mode is REC, it is "REC" in step S419-2, and the process proceeds to step S420-2.

In step S420-2, the communication control unit 92 performs communication in Wi-Fi, which is the 2 nd communication method, with respect to the imaging apparatus 1, and acquires a through image. Then, the acquired through image is displayed on the output unit 18-2. The user performs operations such as a photographing instruction while viewing a through image captured by the imaging apparatus 1. Then, the mode operation processing on the mobile terminal 2 side ends.

On the other hand, if the specified mode is PLAY, "PLAY" is performed in step S419-2, and the process proceeds to step S421-2.

In step S421-2, the communication control unit 92 performs communication in Wi-Fi, which is the 2 nd communication method, with respect to the imaging apparatus 1, and acquires a list of images stored in the image storage unit 71. Then, the list of the acquired images is displayed on the output unit 18-2. The user performs operations such as selecting an image acquired from the imaging apparatus 1 while viewing a list of images stored in the imaging apparatus 1. Then, the mode operation processing on the mobile terminal side is ended.

Next, a display operation indicating a change in the radio wave state or the power source state of the device, or a communication state that changes before and after execution of the cooperation preparation process (pairing process), the automatic image transfer process, and the remote operation process will be described.

Fig. 11 is a schematic diagram showing a display of a communication state in the imaging device 1 and the mobile terminal 2.

As shown in the example of fig. 11, the display of the communication states in the imaging device 1 and the mobile terminal 2 in the 1 st communication method and the 2 nd communication method is configured to change the display for each state.

Fig. 12 is a functional block diagram showing a functional configuration for executing the image sharing process among the functional configurations of the mobile terminal 2 and the server 3 in fig. 3.

The "image sharing process" is a process of transmitting an image captured by the imaging device 1 to the server 3 via the mobile terminal 2, and sharing the image in a state where another mobile terminal 100 can view the image.

When the image sharing process is executed on the portable terminal 2 side, as shown in fig. 12, the CPU11-2 functions as a communication control unit 92 and an application management unit 91.

The communication control section 92 controls communication in the 2 nd communication section 21-2. Specifically, the communication control unit 92 controls the 2 nd communication unit 21-2 to transmit an image, an instruction for cloud album creation, and a sharing destination setting to the server 3.

The application managing unit 91 manages and controls various application operations, and stores the image received from the imaging apparatus 1 in an application album provided in the image storage unit 111.

On the other hand, when the image sharing process is executed on the server 3 side, as shown in fig. 12, the application management unit 131 and the communication control unit 132 function as the CPU 11-3.

In addition, in one area of the storage unit 19-3, an image storage unit 151 is set.

The image storage unit 151 stores data of an image acquired from the mobile terminal 2.

The application managing unit 131 manages and controls various application operations, and creates a cloud album in the image storage unit 151 based on an instruction from the mobile terminal 2, or performs sharing setting for registering a mail address of another mobile terminal 100 to be shared, or stores an image received from the mobile terminal 2 in the created cloud album of the image storage unit 151, for example.

The communication control section 132 controls communication in the 2 nd communication section 21-3. Specifically, the communication control unit 92 controls the 2 nd communication unit 21-3 to transmit a share notification of the location where the shared image is recorded to the registered mail address based on the share setting with respect to the other mobile terminal 100. In the present embodiment, the sharing notification includes a URL of the location where the image is recorded. The other mobile terminal 100 that has received the sharing notification can view an image or the like by accessing the URL described in the notification.

Next, in step S318-2 of the automatic transfer process of fig. 9 in the case where image sharing with other portable terminals 100 via the server 3 is set, after receiving the image, in the case where image sharing via the server 3 is set, the flow of fig. 16 is executed.

Fig. 13 is a flowchart illustrating a flow of image sharing processing executed by the mobile terminal 2 and the server 3 of fig. 3 having the functional configuration of fig. 12. In addition, the present flowchart is a process performed between the portable terminal 2 and the server 3 after receiving an image in step S318-2 of the automatic transfer process of fig. 9, which is executed in a case where image sharing with other portable terminals 100 via the server 3 is set.

< image sharing processing on the side of the Mobile terminal 2 >

In step S511-1, the communication control unit 92 transmits an instruction to create a cloud album to the server 3. Upon receiving the instruction, the server 3 creates a cloud album in the image storage unit 151.

In step S512-1, the communication control unit 92 sends an instruction of the sharing destination setting (registration of the mail address of another portable terminal 100 that is the sharing destination in the present embodiment). Upon receiving the instruction, the server 3 performs the share target setting.

In step S513-1, the 2 nd communication section 21-2 receives an image from the image pickup apparatus 1 through Wi-fi communication.

In step S514-1, the application managing section 91 stores the image for transmission to the server 3 in the application album of the image storing section 111 by receiving the image from the image pickup apparatus 1. In addition, the imaging apparatus 1 transmits an image having a size set based on the "adjustment size at the time of transmission".

In step S515-1, the communication control unit 92 transmits the image to the server 3. The image is received, and the received image is stored in the cloud album of the image storage unit 151 in the server 3.

< image sharing processing on the Server 3 side >

In step S511-2, the 2 nd communication unit 21-3 receives an instruction of cloud album creation from the mobile terminal 2.

In step S512-2, the application managing section 131 creates a cloud album in the image storage section 151.

In step S513-2, the 2 nd communication section 21-3 receives an instruction of sharing setting from the portable terminal 2.

In step S514-2, the application management section 131 performs sharing setting. Specifically, the mail address of the sharing target is registered.

In step S515-2, the 2 nd communication unit 21-3 receives the shared image from the portable terminal 2.

In step S516-2, the application managing section 131 stores the received image in the cloud album of the image storage section 151.

In step S517-2, the communication control unit 132 transmits a share notification of the location where the shared image is recorded to the registered mail address based on the share setting. In the present embodiment, the sharing notification includes a URL of the location where the image is recorded. The other mobile terminal 100 that has received the sharing notification can view an image or the like by accessing the URL described in the notification.

The communication step T configured as described above has the following functions: only by shooting with a camera (image pickup device 1), an image is automatically transferred to a smartphone (portable terminal 2), and the image is sent to a cloud album and automatically notified to a sharing object.

Conventionally, there is a technique of automatically transferring a photographed image from a camera to a smartphone, but the technique is merely stored in the smartphone and is not shared until after.

Therefore, in the communication step T of the present embodiment, the following operation is performed.

○ the camera is paired with the smartphone through BLE as per step.

○ when pairing, the smartphone application determines the OS of the smartphone and sends this information to the camera.

○ pre-stores access point information for the camera in the smartphone, enabling Wi-Fi connections to be made automatically to the camera from the smartphone.

○ create an album shared in the cloud album in advance.

○ the shared objects are set in advance for the shared albums.

○ are preset in the smartphone application so that when an image is received from a camera, the image is shared in a cloud album.

○ when the camera takes an image, the access point of the camera is activated and a BLE instructs the smart phone to connect to the access point of the camera.

○ an instruction is given by BLE according to the OS determination result of the smartphone, and the application of the cloud album is also started.

○ the camera transmits the captured image to the smartphone when the connection of Wi-Fi is confirmed from the smartphone, and the size at this time conforms to the camera 'resize at transmission'.

○ the smart phone application, upon receiving an image from the camera, saves the image in a designated place of the smart phone and transfers the image to the cloud album.

○, when the image reaches the cloud album side, it notifies the sharer that the image is registered in the album.

○ the sharer who has received the notification can access the cloud album to confirm the image by operating the notification.

As a result, the communication step T of the present embodiment can obtain the following effects.

○ can automatically transfer photographic images from the camera to the smartphone.

○ images automatically received by the smart phone can be shared in the cloud album without operating the smart phone.

○ do not require the user to be aware of differences in the OS of the smart phone.

< application collaboration processing based on BLE >

The BLE-based application cooperation process is a part not shown in fig. 9 and 13, and is a constraint of the OS on which the processes in fig. 9 and 13 are executed, and a process related to the constraint.

The communication system S according to the present embodiment has a function of performing a cooperative operation among a plurality of applications by using a notification function of BLE.

Conventionally, "URL Scheme" (URL Scheme) as a mechanism for a cooperative operation between a plurality of applications that operate on a specific OS (for example, iOS) has a limitation that it can be used only by an application that is operating in the foreground (foremost) but cannot be used in the background operation, and an application that is operating in the background cannot cooperate with another application using the "URL Scheme". On the other hand, an application in which the function of BLE performs an action in the background can also be used.

Therefore, the communication system S according to the present embodiment operates as follows.

A BLE profile for making requests and notifications of application launches is set in the camera.

An application (application a) having a dominant right connects (pairs) with the camera through BLE, notifies other applications (application B) of connection information of BLE, and uses the connection of BLE in common by the application a and the application B.

The application B stands by to be able to acquire the application start notification from the BLE connection information.

The application a executes the application start request, the camera receives the request to notify the application B of the start of the application, and the application B that has received the notification starts operating.

When the pairing with the camera is released, the application a notifies the application B, and the application B ends the standby of the BLE notification.

Therefore, in the communication system S according to the present embodiment, the cooperative operation can be performed even in the background operation among a plurality of applications that operate on the iOS. Further, the notification of BLE is not waited for unnecessarily after pairing is released.

Next, the operation configuration of the application will be described. Fig. 14 is an operation configuration diagram of an application on the imaging device 1 and the mobile terminal 2 in the communication system S according to the present embodiment.

Application a saves the image automatically sent from the camera.

The application B is used to realize a cooperation function of registering the image saved by the application a in an album managed by the application B.

The imaging device 1 is a peripheral device under BLE, and carries a BLE profile for application cooperation.

The portable terminal 2 that performs an action in a specific OS is a center device under BLE, and BLE connection is commonly used by the application a and the application B.

The imaging apparatus 1 and the iOS device are connected by BLE, and transfer information of BLE profile.

Next, a sequence of actions is shown. Fig. 15 is a flowchart showing an operation sequence between the imaging device 1 and the mobile terminal 2 in the communication system S according to the present embodiment.

Application a pairs with the camera and notifies application B of BLE connection information in a URL scheme. Application a can use the URL scheme since it performs actions in the foreground.

Application B prepares to enable acquisition of an application start notification (notification of application B start notification feature) from BLE connection information, and starts standby of BLE notification.

If the OS is put to sleep, application a becomes a background operation.

The application a receives and stores an automatic transmission image from the camera while maintaining the background operation, requests the camera to start the application B (writes data to the application B start request feature), notifies the camera based on the application B start notification feature in response to the request, starts the application B standing by for this, and registers the image in the album managed by the application B.

When the pairing with the camera is released, the application a notifies the application B in the URL scheme, and the application B ends the standby of the BLE notification.

< image pickup apparatus side processing >

The image pickup apparatus side processing is started by an operation of the user to start the image pickup apparatus side processing on the input unit 17-1. In addition, after the process starts, an action is performed to establish pairing (connection) of BLE communication and Wi-Fi communication between the image pickup device 1 and the portable terminal 2 (application a).

In step S611-1, the photographing control section 51 controls the image pickup section 16-1 to perform photographing, and the communication control section 52 controls the 2 nd communication section 21-1 to transmit the photographed image to the portable terminal 2.

Then, when the start request of the application B is from the application a of the portable terminal 2 via BLE, the communication control unit 52 controls the 1 st communication unit 20-1 to transmit the start notification to the application B of the portable terminal 2 via BLE. As a result, the application B of the portable terminal 2 is started, and the transmitted image is registered in the album. Then, the pairing (connection) with the mobile terminal 2 is released, and the imaging device side processing ends.

< application A side treatment >

The processing of the applications a and B on the mobile terminal 2 side is started by the user's operation of the input unit 17-2 to start the processing on the mobile terminal side. Further, after the process starts, an action is performed to establish pairing (connection) of BLE communication and Wi-Fi communication between the image pickup device 1 and the portable terminal 2 by the application a of the portable terminal 2. In the case where pairing is established, application a provides connection information of BLE to application B.

In step S611-2, the application management unit 131 controls the application a to operate in the background by the OS sleeping.

In step S612-2, the application management section 131, upon receiving the image from the image pickup apparatus 1, controls so that the image is saved in the image storage section 151 by the application a. Then, the communication control section 92 controls the 1 st communication section 20-2 so that the start request is transmitted by the application a to the application B via BLE under the application management section 91.

In step S613-2, the application management unit 131 causes the application a to operate in the foreground and performs the pairing-release operation. As a result, the pairing (connection) with the image pickup apparatus 1 is released, a pairing release notification is given to the application B, and the application a side process is ended.

< application B-side treatment >

In step S611-3, the application management unit 131 receives BLE connection information supplied from the application a, and performs control so that the standby for BLE notification is started in the application B.

In step S612-3, the application management unit 131 performs control so that the application B operates in the background by the OS sleeping.

In step S613-3, the application management section 131 controls so that an action is performed in the foreground by an application start request from the image pickup apparatus 1, and the communication control section 132 controls the 2 nd communication section 21-2 to transmit the image stored in the image storage section 151 to the cloud server, and performs album registration in which the image is stored in a given storage area of the cloud server.

In step S614-3, the application management unit 131 receives the pairing release notification from the application a, and performs control so that the BLE notification standby is ended in the application B. Then, the application B side processing ends.

< modification example >

This example is another example of the case where the image sharing process of fig. 13 is executed after the image is received in step S318-2 of the automatic transfer process of fig. 9.

In the above embodiment, the applications for performing the cooperation are not limited to 2.

Further, the BLE profile for application cooperation may be installed not in the imaging apparatus 1 but in another device.

< album registration processing in automatic image sending Camera >

The communication system S of the present embodiment has an album registration function in the automatic image transmission camera. That is, the communication system S according to the present embodiment has the following functions in the automatic transmission supporting camera: by performing album setting in advance, the image is automatically transferred and registered in an album on the network.

Conventionally, the following functions are mounted between a camera and a mobile terminal such as a smartphone: after the image is captured by the camera, the captured image is automatically transmitted to the terminal side. Conventionally, after an image is transmitted to a mobile terminal through a wireless connection, it is necessary to register the image in an SNS or an album service on a network by a manual operation of a user. The sharing of a large number of images in an album has a problem that it takes a lot of time, and particularly, in the camera with the automatic transmission function of this time, since a large number of images can be transmitted, a function matching this is desired.

1. Selecting photo albums by applications in advance

Before the start of the operation, as shown in fig. 16, an album is selected by an application in advance, and in a transfer application on the mobile terminal side corresponding to a camera, whether or not an image automatically transmitted by the camera is registered in the album and in which album is registered is selected. Fig. 16 is a schematic diagram showing a selection screen of an album in an application.

As a processing operation, as shown in fig. 17 and 18, when "shared album" is set to valid (ON) in advance and then automatic transmission is performed using a camera, the "shared album" is registered in the album according to the setting. Fig. 17 is a flowchart illustrating the flow of the album registration processing, and fig. 18 is a flowchart illustrating the flow of the automatic transmission processing.

< album setting processing >

The album setting process is started by the user operating the input unit 17-2 to start the album setting process.

In step S711, the communication control section 132 controls the 2 nd communication section 21-2 to perform the album service authentication at the server 3.

In step S712, the communication control unit 132 determines whether or not the result of the authentication control with the server 3 is authentication OK.

If the authentication is OK, the determination is yes in step S712, and the process proceeds to step S714.

On the other hand, if the authentication is not OK, the determination is no in step S712, and the process proceeds to step S713.

In step S713, since it is the authentication NG, the CPU11-2 controls the output section 18-1 to make an error display.

In step S714, the communication control unit 132 controls the 2 nd communication unit 21-2 to acquire the album list from the server 3.

In step S715, the CPU11-2 controls the output unit 18-2 to display the list of albums acquired from the server 3.

In step S716, the application managing section 131 selects an album to be shared by performing an operation of selecting an album in the album sharing setting to the input section 17-2 by a user operation. Then, the album setting process ends.

< automatic Transmission processing >

The automatic transmission process is another example of the automatic transfer process of fig. 9.

The automatic transmission processing is started by an operation of the input unit 17-1 by the user to start the automatic transmission processing.

In step S811, the communication control section 132 controls the 2 nd communication section 21-2 to receive an image from the image pickup apparatus 1.

In step S812, the application management section 131 saves the received image in the image storage section 151.

In step S813, the application management section 131 determines whether the album share setting is set to be valid.

If the album share setting is set to be valid, the determination is yes in step S813, and the process proceeds to step S814.

On the other hand, if the album share setting is not set to be valid, the determination in step S813 is no, and the process ends.

In step S814, the communication control section 132 controls the 2 nd communication section 21-2 so that the image stored in the image storage section 151 is stored in a predetermined storage area of the server 3 to perform album registration. Then, the automatic transmission processing ends.

2. Selecting photo albums by camera in advance

In the operation 1, the content of the album is selected by the application side, but the album information acquired by the application side may be notified to the camera and the album may be selected by the camera side.

The camera performs album setting in advance before shooting. The album information is acquired by an application of the mobile terminal through communication (BLE or Wi-Fi), and is notified to the camera, thereby displaying the album information on the camera. The user views the screen of the camera, selects an album in advance, and sets whether or not to share the album.

In the automatic transmission, the selected album ID is added to the photographed image, and the photographed image is transmitted to the mobile terminal. The terminal registers the album ID of the received image in the album.

Fig. 19 is a flowchart illustrating the flow of album selection processing on the camera side, and fig. 20 is a flowchart illustrating the flow of image registration processing.

< imaging apparatus-side album setting processing >

The album setting process on the imaging apparatus 1 side is started by the user's operation of the input section 17-1 to start the album setting process.

In step S911-1, the communication control unit 92 controls the 2 nd communication unit to acquire the album list from the server 3.

In step S912-1, the CPU11-1 controls the output unit 18-1 to display the list of albums acquired from the server 3.

In step S913-1, the application managing section 91 selects an album to be shared by performing an operation of selecting an album in the album sharing setting to the input section 17-1 by the user operation. Then, the album setting process on the imaging apparatus 1 side ends.

< Portable terminal album List acquisition processing >

The album list acquisition process on the portable terminal 2 side is started by the user operating the input unit 17-2 to start the album list acquisition process.

In step S911-2, the communication control section 132 controls the 2 nd communication section 21-2 to perform the album service authentication at the server 3.

In step S912-2, the communication control unit 132 determines whether or not the result of the authentication control with the server 3 is authentication OK.

If the authentication is OK, the determination is yes in step S912-2, and the process proceeds to step S913-2.

On the other hand, if OK is not authenticated, the determination is no in step S912-2, and the album list acquisition process on the portable terminal 2 side is finished.

In step S913-2, the communication control section 132 controls the 2 nd communication section 21-2 to acquire the album list from the server 3.

In step S914-2, the communication control unit 132 controls the 2 nd communication unit 21-2 to notify the image pickup apparatus 1 of the album list acquired from the server 3. Then, the album list acquisition process on the portable terminal 2 side is completed.

< automatic transmission processing on imaging apparatus side >

The automatic transmission processing on the imaging apparatus 1 side is started by an operation of the user to start the automatic transmission processing on the input unit 17-1.

In step S1011-1, the photographing control section 51 controls the image pickup section 16-1-1 to perform photographing.

In step S1012-1, the imaging control unit 51 stores the captured image in the image storage unit 71.

In step S1013-1, the communication control unit 52 determines whether the album share setting is valid.

If the album share setting is set to be valid, the determination is yes in step S1013-1, and the process proceeds to step S1014-1.

On the other hand, if the album share setting is not valid, the determination is no in step S1013-1, and the process proceeds to step S1015-1.

In step S1014-1, the communication control section 52 attaches the album ID to the image to be transmitted for sharing.

In step S1015-1, the communication control section 52 controls the 2 nd communication section 21-1 to transmit the image to which the album ID is attached to the portable terminal 2. Then, the automatic transmission processing on the imaging apparatus 1 side ends.

< registration processing of portable terminal-side album >

The album registration processing on the portable terminal 2 side is started by the user's operation of the input section 17-2 to start the album registration processing on the portable terminal side.

In step S1011-2, the communication control section 92 controls the 2 nd communication section 21-2 to receive an image from the image pickup apparatus 1.

In step S1012-2, the application management section 91 saves the received image in the image storage section 111.

In step S1013-2, the application managing section 91 determines whether or not there is an album ID.

If there is an album ID, the determination is yes in step S1013-2, and the process proceeds to step S1014-2.

On the other hand, if there is no album ID, the determination is no in step S1013-2, and the album registration process on the portable terminal 2 side is ended.

In step S1014-2, the communication control section 92 controls the 2 nd communication section 21-2 so that the image stored in the image storage section 151 is stored in a predetermined storage area of the server 3 to perform album registration.

Then, the album registration processing on the portable terminal 2 side ends.

3. Selecting multiple albums by camera and application

In the case where a plurality of albums are used in the operation 1, the camera selects 3 types of albums, i.e., album a, album B, and album C, on the album setting screen and does not perform album registration (N/a). During photographing (REC), the type of the selected album can be confirmed.

In addition, in the application, it is selected in advance which album a, album B, and album C are each specifically set to.

Fig. 21 is a schematic diagram showing an example of screen display in the imaging apparatus 1, and fig. 22 is a schematic diagram showing an example of screen display in the imaging apparatus 1.

Therefore, in the communication system S according to the present embodiment, by setting an album in advance in the automatic transmission camera that automatically transmits a large number of images to the mobile terminal, the images can be automatically transmitted not only to the mobile terminal but also to an album on the network and shared. For example, it is very convenient when taking a photograph of a present day 1 exhibition and reporting to colleagues. Further, by notifying the camera of the information of the album, the name of the album can be confirmed and selected in the camera body. Further, by simply switching albums on the camera side to perform shooting, album sharing can be performed easily when sharing albums with a plurality of subjects.

< modification example >

In the above-described operations 1 to 3, the service for providing the album is one, but may be selected and set on the transfer application side from a plurality of different services of the carrier. With this configuration, according to the modification, it is possible to select an album from a plurality of services and register the album. The application side can absorb the difference of the services without paying attention to a plurality of services on the camera side, and thus album sharing based on different services can be easily performed.

The data processing system configured as described above realizes a predetermined cooperation function by cooperation of the 1 st device having a function of acquiring data and the 2 nd device having a function of managing data.

The 1 st device includes a data transmission unit that transmits data to the 2 nd device via the 1 st wireless communication unit.

The 2 nd device includes: a storage unit that stores a 1 st program for executing data reception processing for receiving data from a 1 st device via a 1 st wireless communication unit, and a 2 nd program for executing data management processing for managing the data received through the data reception processing; a switching unit that switches the 1 st program and the 2 nd program between a stop state and a start state; and a control unit that, in a state where the 2 nd program is stopped and the 1 st program is started, switches the 2 nd program from a stopped state to a started state in a case where data is received by the data reception processing, and specifies the received data as a management target to perform the data management processing.

This improves the convenience of data management in the data processing system.

The 1 st device includes a start notification transmission unit that transmits a start notification of the 2 nd program to the 2 nd device via the 2 nd wireless communication unit when a start request of the 2 nd program is received from the 1 st device via the 2 nd wireless communication unit, and the control unit of the 2 nd device transmits a start request of the 2 nd program to the 1 st device via the 2 nd wireless communication unit when the 2 nd program cannot be directly started from the 1 st program, and switches the 2 nd program from a stopped state to a started state by the start notification transmitted from the 1 st device in accordance with the start request.

The 2 nd wireless communication unit is lower in speed but power-saving than the 1 st wireless communication unit, and the control unit cannot start the 2 nd program by the 1 st wireless communication unit, but can start the 2 nd program by the 2 nd wireless communication unit.

The data management processing is processing for assigning and managing designated data to an arbitrary group among a plurality of groups.

The control unit specifies the received data as a group management object to perform data management processing.

The 2 nd device includes a group information transmission unit that transmits group information on a plurality of groups that can be managed by the data management processing to the 1 st device, and the control unit of the 2 nd device allocates and manages data received from the 1 st device to a group designated by the group selection information received from the 1 st device.

The 1 st device further includes a selection information transmitting unit that selects a given group from a plurality of groups included in the group information received from the 2 nd device and transmits the group selection information to the 2 nd device.

The 2 nd device causes the 2 nd device to store the group selection information transmitted from the 1 st device, and assigns and manages the group designated by the stored group selection information each time new data is received from the 1 st device.

The 2 nd device assigns the data received from the 1 st device together with the group selection information to the group designated by the group selection information for management.

The 1 st device displays a list of a plurality of groups included in the group information received from the 2 nd device to select the group, and transmits group selection information based on a user operation to the 2 nd device.

The 2 nd device includes a 3 rd communication unit, and the 3 rd communication unit communicates with a server that provides a data sharing service on a network.

The data management processing designates data received from the 1 st device as a sharing object and transmits to the server via the 3 rd communication unit.

The data sharing service is a service for classifying a plurality of data into a plurality of groups to share the data.

The 2 nd device specifies the group specified by the group selection information when designating the received data as a sharing target and transmitting the data to the server for sharing.

The 1 st device allows the user to select whether or not to share the acquired image, and transmits the sharing availability information to the 2 nd device together with the group selection information.

The 2 nd device transmits the received data to the server in a case where sharing is possible.

A service on a plurality of different networks providing a data sharing service is selected, and the received data is transmitted to a server providing the selected service.

The 1 st device is an imaging apparatus having a function of acquiring image data by shooting.

When the imaging apparatus as the 1 st device acquires new image data in a state in which the automatic transmission mode is set, the image data is transmitted by the data transmission means.

The image pickup device as the 1 st apparatus stores and updates the group selection information and displays the currently selected group on the live view screen.

The 2 nd apparatus has a plurality of different kinds, and the control unit changes the control of the start-up according to the kinds.

The 1 st wireless communication unit is in a state of being always connected, and the 2 nd wireless communication unit establishes a connection according to a connection request via the 1 st wireless communication unit, and changes establishment control of the connection according to the category.

Conventionally, a technology for connecting an imaging device such as a digital camera and a mobile terminal such as a smartphone by wireless communication has been used.

As an example of such a technique, there is an image pickup system that remotely operates a camera by a camera operation terminal (see, for example, JP 2014-230024).

In addition, in the portable terminal, various application software such as image sharing application software that accesses an image sharing service on a network to share an image with other users can be used.

With such a technique, a user can operate the portable terminal to remotely operate the camera to capture images, store image data transmitted from the camera in the portable terminal, and then activate necessary application software to perform various operations to manage the image data or utilize an image sharing service.

In this case, the user starts different application software according to the type of OS (operating software) of the mobile terminal (for example, iOS, Android, and the like) and operates the mobile terminal.

However, when the above-described technique is used, for example, in order to use the image sharing service using a camera or a mobile terminal, it is necessary for the user to perform an operation of activating a necessary application software or perform various operations in accordance with the specification of the activated application software, which is very time-consuming. This is not limited to the case where the camera is caused to cooperate with the portable terminal, but the same problem occurs when various kinds of management of acquired data are performed by causing the apparatus that provides data to cooperate with the apparatus that manages data.

The present embodiment has been made in view of such a situation, and an object thereof is to improve convenience in the case where various kinds of management of acquired data are performed by causing a device that provides data and a device that manages data to cooperate.

< embodiment 3 >

< pairing connection action >

While the detailed portions are not described in

embodiments

1 and 2, in the present embodiment, the processes related to restrictions on the BLE communication standard that are assumed in the processes of

embodiments

1 and 2 are described. The processing described in this embodiment is executed at the start of the processing in fig. 9, 10, and the like, or in parallel with the processing in fig. 9, 10, and the like.

In the communication system S according to the present embodiment, when the imaging device and the mobile terminal are connected to each other by BLE, the imaging device issues an advertisement signal (advertisement signal) and the mobile terminal detects the signal and performs a connection process to establish a connection with Bluetooth (registered trademark), but if the content of the advertisement signal is the same in all states, the following problems occur (

problems

1, 2, and 3). Further, if the information carried in the announcement signal is increased, the data size of the signal increases, which is disadvantageous in terms of power.

[ problem 1]

Since the pairing setting can be changed by a mobile terminal different from the mobile terminal having performed the pairing setting, there is a problem in security (hijacking) problem).

If the imaging device and the portable terminal are paired and the BLE connection cannot be established due to a long distance between the imaging device and the portable terminal, the imaging device issues an announcement signal to connect to the portable terminal. At this time, when the pairing operation is performed by another portable terminal, the image pickup device is connected to the portable terminal and can perform a part of the operations.

In addition, if the imaging device is in a power-on state, the content of the BLE signal (SSID of Wi-Fi, password) is transmitted to the mobile terminal C.

[ problem 2]

If there is a portable terminal that has been previously paired, the pairing process is automatically executed by the portable terminal when the pairing operation is performed by the imaging device, and therefore the pairing process cannot be performed by another portable terminal (portable terminal change problem).

There are an imaging device and a portable terminal that have been paired, and pairing is released by an operation of the imaging device. If it is desired to pair another portable terminal with the image pickup device, the portable terminal B is automatically connected to the image pickup device when the image pickup device is operated. At this time, the portable terminal cannot continue the pairing process.

[ problem 3]

In the image pickup apparatuses listed in the pairing process of the portable terminal application, pairable and unpassible are mixed (list sort).

In order to solve such a problem, the communication system S according to the present embodiment takes the following measures.

The device name is changed according to the connection state (presence or absence of pairing) of the imaging apparatus 1 connected to the mobile terminal 2, and the change is used to perform processing in the smartphone. That is, based on BLE connection information (presence/absence of pairing) which is pairing information of the imaging device 1, a space character is added to the device name of the notification signal to distinguish the device name, and connection control by the application of the mobile terminal 2 is changed based on the distinction.

Specifically, in the communication system S, the device name included in the data of the notification signal is changed according to the pairing state of the imaging device 1, and the processing of the application of the mobile terminal 2 is branched according to the device name. The pairing can be performed on the premise that the imaging device 1 and the mobile terminal 2 are in a one-to-one relationship. Further, the portable terminal 2 identifies the image pickup apparatus 1 as a pairing object by the BD address instead of the device name after establishing the connection.

< state in which imaging apparatus 1 is not paired >

The device name is the SSID of Wi-Fi and there is no space at the end.

Example (c): "ZR 1600-01 ACDC" (equipment name + without blank space)

Even if pairing is performed, reconnection will not be automatic (avoid [ problem 2 ]).

(therefore, if not pairing operation then not connect.)

< imaging apparatus 1 paired State >

Space is appended at the end of the device name.

Example (c): "ZR 1600-01 ACDC" (equipment name + with space)

Not connected to unpaired smart phones (avoid [ problem 1 ]).

(connected only with the paired portable terminal 2.)

Not displayed in the list of candidates that can be paired (avoid [ problem 3 ]).

(only unpaired devices are shown.)

Fig. 23 is a functional block diagram showing a functional configuration for executing the pairing connection process among the functional configurations of the imaging device 1 and the mobile terminal 2 in fig. 3.

The pairing connection process is a series of processes for pairing and connecting between the imaging device 1 and the mobile terminal 2 under the BLE communication standard.

When the pairing-connection process is executed in the imaging apparatus 1, as shown in fig. 23, the CPU11-1 functions as a pairing-state determination unit 171, an announcement signal generation unit 172, and a communication control unit 173.

In addition, the communication information storage unit 191 is set in one area of the storage unit 19-1.

The communication information storage unit 191 stores pairing information (in the present embodiment, information generated based on an SSID, which is an identification name of an access point in wireless LAN (Wi-Fi)) obtained as a result of the pairing process and connection information (in the present embodiment, a BD address) obtained as a result of the connection process. The pairing information is a device name in an announcement signal used in the pairing process or the like and a BD address used at the time of connection after the pairing process is ended.

The pairing status determination unit 171 determines the status of pairing by referring to the pairing information (whether or not pairing information is referred to) stored in the communication information storage unit 191. The pairing status determination unit 171 determines that pairing is not performed (hereinafter referred to as "unpaired status") when there is no pairing information, and determines that pairing is performed (hereinafter referred to as "paired status") when there is pairing information.

The notification signal generator 172 generates a notification signal based on the determination result of the pairing status determination unit 171.

When generating the notification signal, the notification signal generator 172 changes information (hereinafter referred to as "notification information") added to the notification signal according to whether the pairing status determination unit 171 determines that the pairing status is an unpaired status or a paired status.

The notification signal generator 172 generates an "unpaired notification signal" in which the notification information is "device name + blank space (device name only)" in the case of an unpaired status, and generates a "paired notification signal" in which the notification information is "device name + blank space" in the case of a paired status.

The communication control unit 173 controls the 1 st communication unit 20-1. Specifically, the communication control unit 173 controls the 1 st communication unit 20-1 to transmit an announcement signal or execute pairing processing or connection processing. The pairing information and the BD address acquired as a result of the pairing process and the connection process are stored in the communication information storage unit 191.

When the pairing-connection process is executed in the mobile terminal 2, as shown in fig. 23, the CPU11-2 functions as a communication control unit 211, a pairing-state determination unit 212, and an announcement signal determination unit 213.

In addition, the communication information storage unit 231 is set in one area of the storage unit 19-2.

The communication information storage unit 231 stores pairing information obtained when pairing is performed. The pairing information is a device name in an announcement signal used in the pairing process or the like and a BD address used at the time of connection after the pairing process is ended.

The communication control section 211 controls the 1 st communication section 20-2. Specifically, the communication control section 211 controls the 1 st communication section 20-2 to detect an announcement signal or execute pairing processing, connection processing.

The pairing status determination unit 212 determines the pairing status by referring to the pairing information (whether or not pairing information is referred to) stored in the communication information storage unit 231. The pairing status determination unit 212 determines that the pairing is not performed (hereinafter referred to as "unpaired status") when there is no pairing information, and determines that the pairing is performed (hereinafter referred to as "paired status") when there is pairing information.

The notification signal determination unit 213 determines whether the notification information of the detected notification signal is an unpaired notification signal or a paired notification signal. Specifically, the notification signal determination unit 213 determines that the notification signal is of the unpaired specification when the notification information is the device name + no space (only the device name), and determines that the notification signal is of the unpaired specification when the notification information is the device name + space.

Fig. 24 is a flowchart illustrating a flow of pairing connection processing executed by the imaging device 1 and the mobile terminal 2 of fig. 3 having the functional configuration of fig. 23.

[ imaging device side ] pairing connection processing >

The pairing connection process on the imaging apparatus 1 side is started by an operation of the user to start the pairing connection process on the input unit 17-1.

In step S1111-1, the pairing status determination unit 171 determines whether or not the pairing status is an unpaired status.

If the pairing is not established, the determination is yes in step S1111-1, and the process proceeds to step S1112-1.

In step S1112-1, the notification signal generation unit 172 generates a notification signal of an unpaired specification. Specifically, the notification signal generator 172 generates an unpaired specification notification signal in which information without a blank space is added to the device name.

In step S1113-1, the communication control unit 173 controls the 1 st communication unit 20-1 to transmit the generated unpaired specification notification signal.

In step S1114-1, the communication control section 173 controls the 1 st communication section 20-1 to perform the pairing process with the portable terminal 2.

In step S1115-1, the communication control unit 173 controls the 1 st communication unit 20-1 to execute the connection process based on the connection setting by the pairing process. The process then ends.

On the other hand, when the pairing is not an unpaired pairing, but a paired pairing is performed, the determination is no in step S1111-1, and the process proceeds to step S1116-1.

In step S1116-1, the notification signal generator 172 generates a notification signal of the paired specification. Specifically, the notification signal generator 172 generates a notification signal of a matched specification in which information with a blank space is added to the device name.

In step S1117-1, the communication control section 173 controls the 1 st communication section 20-1 to transmit the generated notification signal of the paired specification.

In step S1118-1, the 1 st communication unit 20-1 is controlled to execute the connection process based on the connection setting by the pairing process. The process then ends.

[ Portable terminal side ] pairing connection processing >

The pairing-connection process on the portable terminal 2 side is started by an operation of the user to start the pairing-connection process on the input unit 17-2.

In step S1111-2, the communication control section 211 controls the 1 st communication section 20-1 to detect the announcement signal. As a result, the 1 st communication unit 20-1 detects the notification signal transmitted from the image pickup apparatus 1.

In step S1112-2, the pairing status determination unit 212 determines whether or not the pairing is an unpaired status.

If the pairing is not established, the determination is yes in step S1112-2, and the process proceeds to step S1113-2.

In step S1113-2, the notification signal determination unit 213 determines whether or not the notification signal is an unpaired notification signal.

If the notification signal is not an unpaired signal but a paired signal, the determination is no at step S1113-2, and the pairing connection process is terminated.

If the notification signal of the unpaired specification is present, the determination is yes in step S1113-2, and the process proceeds to step S1114-2.

In step S1114-2, the communication control section 211 controls the communication section to perform pairing processing with the image pickup apparatus 1.

In step S1115-2, the communication control section 211 controls the communication section to execute the connection processing based on the connection setting by the pairing processing. Then, the pairing-connection process ends.

On the other hand, if the pairing is not unpaired, the process proceeds to step S1116-2, where the determination is no in step S1112-2.

In step S1116-2, the notification signal determination unit 213 determines whether or not the notification signal is a paired notification signal.

If the notification signal is not the paired specification but the unpaired specification, the determination is no in step S1116-2, and the pairing connection process is ended.

If the specification-matched notification signal is present, the determination is yes at step S1116-2, and the process proceeds to step S1117-2.

In step S1117-2, the communication control section 211 controls the communication section to execute the connection process based on the connection setting by the pairing process. Then, the pairing-connection process ends.

< modification example >

In order to avoid "problem 1" more strongly, specification (for iOS in the present embodiment) specific to a given os (operating system) can be configured to set the feature of the device name, acquire BLE by connecting it once, and determine whether to maintain connection or disconnection in the same manner as the above-described determination of availability of connection of the device name based on the notification data.

Note that, the flowchart can be regarded as fig. 25 when the function of the present modification is added. Fig. 25 is a flowchart illustrating another flow of the pairing-connection process executed by the mobile terminal 2 of fig. 3 having the functional configuration of fig. 23.

< Portable terminal side pairing connection processing >

The pairing-connection process on the portable terminal 2 side is started by an operation of the user to start the pairing-connection process on the input unit 17-2. As a premise, BLE of the mobile terminal 2 is not connected at the start of the processing.

In step S1211, the communication control section 211 controls the 1 st communication section 20-2 to detect the announcement signal. As a result, the 1 st communication unit 20-2 detects the notification signal transmitted from the image pickup apparatus 1.

In step S1212, the communication control unit 211 controls the 1 st communication unit 20-2 to start a BLE connection process and to perform a BLE connection with the imaging device 1.

In step S1213, the pairing situation determination unit 212 determines whether or not the pairing process is performed.

When the pairing process is performed, the determination is yes in step S1213, and the process proceeds to step S1214.

On the other hand, if the pairing process is not performed, the determination is no in step S1213, and the process proceeds to step S1219.

In step S1214, the notification signal determination unit 213 determines whether or not the notification device name is determined.

When the notification device name is determined, the determination is yes in step S1214, and the mobile terminal 2-side pairing-connection process is ended.

On the other hand, if the notification device name is not determined, the determination is no in step S1214, and the process proceeds to step S1215.

In step S1215, the communication control section 211 controls the 1 st communication section 20-2 to execute the connection processing.

In step S1216, the notification signal determination unit 213 determines whether or not the feature device name has been determined.

If the feature device name is determined, the determination is yes in step S1216, and the process proceeds to step S1218.

In contrast, if the feature device name is not determined, the determination is no in step S1216, and the process proceeds to step S1217.

In step S1217, the communication control section 211 controls the 1 st communication section 20-2 to perform the pairing process. Then, the pairing connection process on the portable terminal 2 side ends.

In step S1218, the communication control unit 211 controls the 1 st communication unit 20-2 to execute BLE disconnection processing. Then, the pairing connection process on the portable terminal 2 side ends.

In step S1219, the notification signal determination unit 213 determines whether or not the notification device name has been determined.

If the notification device name is determined, the determination is yes in step S1219, and the process proceeds to step S1220.

On the other hand, if the notification device name is not determined, the determination is no in step S1219, and the pairing connection process on the portable terminal 2 side is terminated.

In step S1220, the communication control section 211 controls the 1 st communication section 20-2 to execute the connection processing. Then, the pairing connection process on the portable terminal 2 side ends.

< background Process handling of automatic Send >

The communication system S according to the present embodiment has a function for transmitting an image in a time period, with a temporal limitation on the application of the mobile terminal 2 (smartphone).

In a conventional imaging device, a function of automatically transmitting a captured image to a terminal side after capturing an image with a camera is mounted between the imaging device (camera) and a mobile terminal such as a smartphone.

In order to transmit only by the operation of the camera without the operation of the smartphone, by transmitting a start notification using bluetooth to start an application by a background process, a mechanism is realized in which the smartphone receives an image even in a sleep state.

Background action has a time limit in iOS, so in this case sometimes all data cannot be transmitted.

Therefore, the communication system S according to the present embodiment operates as shown in fig. 26 and 27. Fig. 26 and 27 are flowcharts for explaining the background process processing of the automatic transmission.

1. A BLE-based process start notification is made from the camera to the smartphone.

2. An application for image reception is started in the background in the smartphone.

3. And starting a Wi-Fi access point of the camera, and connecting with the smart phone through Wi-Fi.

4. A list of files sent to the application is sent from the camera.

5. The application retrieves files of the file list from the camera.

6A-1. in case the data transfer is completed within time, a success is communicated to the camera, the background process is ended, and the smartphone is returned to the sleep state.

6A-2. the camera again makes a BLE based process start notification in order to send the next file list.

6B-1. in case the data transfer is not possible to complete within the time, a failure is communicated to the camera, the background process is ended, and the smartphone is returned to the sleep state.

6B-2, the camera again performs a BLE-based process start notification in order to transmit the list of files that have failed to transmit.

6C-1. in case the background process ends without prior notice, the application cannot do any processing.

6C-2, the camera detects the communication disconnection, and the process starting notification based on BLE is performed again in order to transmit the file list which is not transmitted.

When transmission fails, the granularity of transmission data is changed and retries are performed.

[ image pickup apparatus side ] document transfer processing >

The file transfer processing on the image pickup apparatus 1 side is started by an operation of the user to start the [ image pickup apparatus side ] file transfer processing on the input section 17-1.

In step S1311-1, the communication control section 173 controls the 1 st communication section 20-1 to transmit the notification.

In step S1312-1, the communication control unit 173 determines ON/OFF (ON/OFF) of Wi-Fi.

If Wi-Fi is on, the determination is yes at step S1312-1, and the process proceeds to step S1314-1.

On the other hand, when Wi-Fi is off, the determination is no in step S1312-1, and the process proceeds to step S1313-1.

In step S1313-1, the communication control unit 173 controls the 2 nd communication unit 21-1 to activate the Wi-Fi access point.

In step S1314-1, the communication control section 173 controls the 2 nd communication section 21-1 to establish HTTP communication.

In step S1315-1, the communication control unit 173 creates a file list.

In step S1316-1, the communication control unit 173 transmits the file list.

In step S1317-1, the communication control unit 173 transmits the file.

In step S1318-1, the communication control section 173 controls the 2 nd communication section 21-1 so that whether or not a timeout is detected is determined in the portable terminal 2.

If the timeout is detected in the mobile terminal 2, the determination is yes in step S1318-1, and the process proceeds to step S1321-1.

On the other hand, if the timeout is not detected in the mobile terminal 2, the determination is no in step S1318-1, and the process proceeds to step S1319-1.

In step S1319-1, the communication control section 173 controls the 2 nd communication section 21-1 to receive the communication completion notification.

In step S1320-1, the communication control unit 173 determines whether or not the transmission has succeeded.

If the transmission is successful, the determination is yes in step S1320-1, and the process proceeds to step S1322-1.

On the other hand, if the transmission has not succeeded, the determination is no in step S1320-1, and the process proceeds to step S1321-1.

In step S1321-1, the communication control section 173 controls the 2 nd communication section 21-1 to reset the transmission data amount.

In step S1322-1, the communication control unit 173 controls the 2 nd communication unit 21-1 to set the next transmission data.

In step S1323-1, the communication control section 173 controls the 2 nd communication section 21-1 to determine whether there is next data.

If there is next data, the determination is yes in step S1323-1, and the process returns to step S1221.

On the other hand, if there is no next data, the determination is no in step S1323-1, and the file transfer process on the imaging apparatus 1 side is ended.

[ Portable terminal side ] File transfer processing >

The file transfer process on the portable terminal 2 side is started by the user operating the input unit 17-2 to start the file transfer process on the portable terminal 2 side.

In step S1311-2, the communication control section 211 controls the 1 st communication section 20-2 to receive a BLE notification.

In step S1312-2, the CPU11 starts an application in the Background (BG).

In step S1313-2, the communication control unit 211 determines whether or not the Wi-Fi is not connected.

If the connection to Wi-Fi is not established, the determination is yes at step S1313-2, and the process proceeds to step S1314-2.

On the other hand, if the connection to Wi-Fi is not established, the determination is no in step S1313-2, and the process proceeds to step S1315-2.

In step S1314-2, the communication control section 211 controls the 2 nd communication section 21-2 to connect to the AP of the image pickup apparatus 1.

In step S1315-2, the communication control section 211 controls the 2 nd communication section 21-2 to establish HTTP communication.

In step S1316-2, the communication controlling section 211 controls the 2 nd communication section 21-2 to receive the file list.

In step S1317-2, the communication control section 211 controls the 2 nd communication section 21-2 to receive the file.

In step S1318-2, the CPU11 determines whether the OS-based process has ended.

If the OS-based process has ended, the determination in step S1318-2 is yes, and the file transfer process on the portable terminal 2 side ends.

On the other hand, if the process by the OS is not completed, the determination is no in step S1318-2, and the process proceeds to step S1319-2.

In step S1319-2, the CPU11 determines whether end advance notification of the OS-based process is performed.

If the completion advance notification of the process by the OS is performed, the determination is yes in step S1319-2, and the process proceeds to step S1321-2.

On the other hand, if the OS-based process termination advance notice is not given, the determination is no in step S1319-2, and the process proceeds to step S1320-2.

In step S1320-2, the communication control section 211 determines whether or not the reception of the file is completed.

When the reception of the file is completed, the determination is yes in step S1320-2, and the process proceeds to step S1321-2.

On the other hand, if the file reception is not completed, the determination is no in step S1320-2, and the process returns to step S1317-2.

In step S1321-2, the communication control section 211 controls the 2 nd communication section 21-2 to transmit a communication completion notification. Then, the file transfer process on the portable terminal 2 side ends.

Therefore, in the communication system S according to the present embodiment, since all the transmission processes divided into a plurality of times are started from the notification by the bluetooth, a large amount of data can be completely transmitted by the time-limited communication function. Further, by ending the process whose timing is unknown, it is easy to retransmit data that has not been transmitted.

< BLE connection parameter adaptive setting processing >

The communication system S according to the present embodiment has a function of adaptively setting BLE connection parameters in accordance with the time when the camera power is turned on and the time when the camera power is turned off, thereby achieving both connection stability and power saving.

In the related art, the shorter the connection interval time of the connection parameter of BLE, the higher the data transfer rate, but the consumption current increases. As the time of the connection monitoring timeout becomes shorter, the time until it is determined that BLE is disconnected and the reconnection process is performed becomes shorter, and the time during which communication is actually impossible becomes shorter.

Therefore, the communication system S according to the present embodiment operates as shown in fig. 28. Fig. 28 is a flowchart for explaining the BLE connection parameter adaptive setting process.

Adaptively changing connection parameters of BLE according to camera power on and off.

When the camera power is turned on, the connection interval and the connection monitoring timeout time are shortened.

When the camera power is turned off, the connection interval and the connection monitoring timeout period are increased. That is, connection parameter setting of BLE is changed by branching between the time when the camera power is turned on and the time when the camera power is turned off.

That is, the BLE connection parameter adaptive setting process is started by the user operating the input unit 17-1 to start the BLE connection parameter adaptive setting process.

In step S1411, the CPU11 determines whether the camera power is turned off.

When the camera power is turned off, the determination in step S1411 is yes, and the process proceeds to step S1413.

On the other hand, if the camera power supply is not turned off, the determination is no in step S1411, and the process proceeds to step S1412.

In step S1412, the communication controller 173 changes the setting to "connection interval ← 40 ms" and "connection monitor timeout ← 3.01S". Then, the BLE connection parameter adaptive setting process ends.

In step S1413, the communication controller 173 changes the setting to "connection interval ← 1000 ms", and "connection monitor timeout ← 5S". Then, the BLE connection parameter adaptive setting process ends.

In the communication system S of the present embodiment, the following effects can be achieved.

When the camera is powered on, the data transfer rate is high, and the time during which communication cannot be performed is short.

When the camera is powered off, the operation is performed with power saved, and the disconnection is not recognized even if the communication is slightly interrupted.

(since data transfer does not occur when the camera is powered off, no problem occurs even if the transfer rate is low.)

< Wi-Fi setting control processing on imaging device side >

In the communication system S according to the present embodiment, when the camera and the smartphone are paired by bluetooth, Wi-Fi connection becomes easy, and when the Wi-Fi setting is changed from this state, connection becomes impossible, and therefore, the camera side has a function of restricting a function of changing the Wi-Fi setting according to the presence or absence of pairing. Further, the present invention has a function of adjusting the operation so as to be different depending on the presence or absence of pairing.

Conventionally, a camera and a mobile terminal such as a smartphone are equipped with a function of automatically transmitting a captured image to the terminal side after capturing an image with the camera.

To automatically transmit, the camera is paired with the smartphone through BLE, and the Wi-Fi settings of the camera are transmitted to the smartphone via BT. The smartphone connects to the camera's Wi-Fi access point based on the information at that time.

However, since the SSID and the password of the access point are set values, they can be easily changed, and if they are changed, the camera and the smartphone cannot be connected via Wi-Fi.

Therefore, the communication system S according to the present embodiment performs the operation shown in fig. 29. Fig. 29 is a flowchart for explaining the Wi-Fi setting control process on the imaging apparatus 1 side.

The camera transmits the SSID and password of the Wi-Fi access point of the camera to the smartphone in BT communication when BLE pairing is performed.

The smartphone appends the received SSID and password to its own Wi-Fi settings.

The camera records information indicating that pairing is established, and then masks the change menu of the Wi-Fi password to disable the user.

That is, in the communication system S according to the present embodiment, the possibility/impossibility of changing the Wi-Fi password is switched depending on the presence or absence of pairing.

That is, the Wi-Fi setting control processing on the imaging apparatus 1 side is started by the user's operation of the input unit 17-1 to start the Wi-Fi setting control processing.

In step S1511, the communication control section 173 controls the 1 st communication section 20-1 to execute BLE pairing processing.

In step S1512, the communication control unit 173 controls the 2 nd communication unit 21-1 to set the SSID and password and start the WiFi AP.

In step S1513, the communication control portion 173 controls the 1 st communication portion 20-1 to transmit the SSID and the password through BLE.

In step S1514, the communication control section 173 controls the 2 nd communication section 21-1 to determine whether or not WiFi connection is detected.

If WiFi connection is detected, the determination is yes in step S1514, and the process proceeds to step S1515.

On the other hand, if the WiFi connection is not detected, the determination is no in step S1514, and the process is in a standby state in step S1514.

In step S1515, the communication control unit 173 stores the pairing information. Then, the Wi-Fi setting control process on the imaging apparatus 1 side ends.

Fig. 30 is a flowchart for explaining the menu opening processing.

The menu opening process is started by the user operating the input unit 17-1 to start the menu opening process.

In step S1611, the communication control unit 173 acquires pairing information.

In step S1612, the communication control unit 173 determines whether or not pairing setting is completed.

When the pairing setting is completed, the determination is yes in step S1612, and the process proceeds to step S1613.

On the other hand, if the pairing setting is not completed, the determination is no at step S1612, and the menu opening process is started and ended.

In step S1613, the CPU11 masks the menu. Then, the menu opening processing starts and ends.

Therefore, in the communication system S of the present embodiment, it is possible to prevent the automatic transmission from being disabled or other communication functions from becoming unavailable due to a change in the setting on the camera side.

In addition to the Wi-Fi password, the function of switching the operation depending on the presence or absence of pairing is as follows.

Automatic image transmission

There is a pairing: can execute

No pairing: not executable (not set to active)

Manual image Transmission

There is a pairing: all can execute

No pairing: inability to execute application sending in the background

< processing for determining mode of camera activation based on BLE communication >

The communication system S according to the present embodiment has the following functions: when the camera is activated for the main reason of BLE, the camera is not immediately activated, but a mode for determining activation while confirming the BLE communication state of the camera is performed, and power is turned off as necessary, thereby suppressing useless processing of the camera. That is, the communication system S according to the present embodiment has the following functions: the camera is switched to a normal operation only by an intentional operation such as a case where the camera is started from the smartphone, so that useless starting processing is not performed.

Conventionally, with the HW configuration, the connection of BLE can be maintained even in a state where the power of the camera is turned off. When the camera is powered off while the BLE is kept active, various events of BLE are detected by the HW of BLE, and the camera can be powered on mainly for this reason. However, since activation by BLE can be caused by various factors such as disconnection and connection of BLE and a BLE Read/Write (Read/Write) request from a smartphone, if the camera power supply is normally activated simply by all the factors, redundant processing is performed, which is disadvantageous in terms of power. Furthermore, when the camera is enabled for BLE, it is difficult to keep information on what BLE event was enabled. (the camera does not leave the contents of the BLE connection in RAM or the like because the power is off.)

Therefore, the communication system S according to the present embodiment operates as shown in fig. 31. Fig. 31 is a flowchart for explaining the mode determination processing for camera activation by BLE communication. Further, as [ precondition ], when BLE of the camera is in a state of notification or connection, the following processing needs to be performed: the BLE module is set to Sleep (Sleep), the power supply of the camera is turned off, and the power supply is turned off while the output of BLE is maintained.

1) With a certain BLE event, the camera is activated.

At this time, only the fact that the camera is activated due to BLE can be grasped as the activation factor.

2) The camera is activated exclusively (only the LED is turned on) as a BLE activation standby state.

Restart BLE to the annunciated state and start the timer (5 seconds).

When no BLE is connected during a period within the timer (5 seconds), it is determined that BLE is disconnected.

The Sleep (Sleep) of BLE is set directly, and the camera is powered off.

→PowerOtf[1]

3) When BLE is connected within the time of the timer, the timer is deleted and the process proceeds to the next step.

The timer is restarted (5 seconds) after the BLE connection process is completed.

When there is no Wi-Fi connection request based on the BLE signal during a period within a timer (5 seconds), Sleep (Sleep) is set in this state, and the camera is powered off.

4) When a BLE signal is notified within the timer time, it is determined that the smartphone is intentionally started and the camera is started in the Wi-Fi mode.

That is, the mode determination processing is started by an operation of the user to start the mode determination processing on the input unit 17-1.

In step S1711, the communication control unit 173 controls the 1 st communication unit 20-1 to be in Sleep (Sleep) for BLE (in notification or connection).

In step S1712, the communication control unit 173 controls the 1 st communication unit 20-1 to generate a BLE event (connection/disconnection/WiFi mode activation).

In step S1713, the CPU11 performs camera startup processing (minimum necessary processing).

In step S1714, the communication control unit 173 controls the 1 st communication unit 20-1 to perform BLE on processing (BLE connection waiting timer setting).

In step S1715, the communication control unit 173 determines whether or not the timer is waiting.

If the timer is waiting, the determination is yes in step S1715, and the process proceeds to step S1716.

On the other hand, if the timer is not waiting, the determination is no in step S1715, and the process proceeds to step S1718.

In step S1716, the communication control unit 173 controls the 1 st communication unit 20-1 to perform BLE connection processing (request wait timer from the portable terminal 2).

In step S1717, the communication control unit 173 determines whether or not the timer is waiting.

If the timer is waiting, the determination is yes in step S1717, and the process proceeds to step S1719.

On the other hand, if the timer is not waiting, the determination is no in step S1717, and the process proceeds to step S1718.

In step S1718, the CPU11 performs BLE Sleep (Sleep) processing and turns off the camera power. Then, the mode determination processing ends.

In step S1719, the communication control section 173 controls the 2 nd communication section 21-1 to execute the WiFi activation process.

In step S1720, the communication control section 173 controls the 2 nd communication section 21-1 to execute the WiFi connection process with the portable terminal 2.

In step S1721, the CPU11 performs control to start the NET mode (remote shooting, viewing a photograph, etc.) based on the portable terminal designation mode. Then, the mode determination processing ends.

Therefore, in the communication system S according to the present embodiment, battery consumption in the camera process due to the BLE event can be suppressed as much as possible by performing only the minimum necessary process when the camera is awakened by the BLE event.

< modification example >

When it is determined that start-up is caused by BLE being turned off, a process may be added in which the setting is changed by, for example, extending the interval between notifications to make power saving more efficient.

The communication system S configured as described above has the following configuration.

A wireless communication system for performing a predetermined cooperation process by performing wireless communication by a plurality of devices having different roles includes a pairing unit that specifies a combination of the plurality of devices to be subjected to the predetermined cooperation process based on a user operation and performs a pairing process of storing pairing information indicating the combination in the devices of each other.

The 1 st apparatus includes: an announcement signal sending unit that sends an announcement signal as a signal for notifying the presence of itself and the function provided by itself to other devices by wireless communication; and an announcement signal control unit that changes the own identification name included in the announcement signal in accordance with the pairing information stored by the pairing unit.

The 2 nd device includes: a connection unit that detects the notification signal transmitted by the notification signal transmission unit and establishes a communication connection with the device when the notification signal is transmitted from the device that provides the function related to the predetermined cooperation process; and a connection control unit that controls whether to establish a communication connection with the device that detected the notification signal, based on the pairing information stored by the pairing unit and a change state of the identification name included in the notification signal.

Thus, in the communication system S, when a plurality of devices are communicatively connected by wireless communication, it is possible to prevent unintended devices from being erroneously connected to each other, so that communication connection can be appropriately performed.

The 1 st device is an image pickup apparatus having a photographing function, and the 2 nd device is an information terminal having a display function.

The predetermined cooperation process is a process of transmitting image data captured by the imaging device to the information terminal for display.

The wireless communication is based on BLE standard.

The 1 st device is a peripheral device of the BLE standard and the 2 nd device is a central device of the BLE standard.

The notification signal transmitting unit does not transmit the notification signal when connected to any device, and transmits the notification signal when not connected to any device.

The notification signal control unit controls the notification signal sending unit so that a 1 st notification signal without a space added to the end of the device name included in the notification signal is sent in a state of not being paired with any device, and a 2 nd notification signal with a space added to the end of the device name included in the notification signal is sent in a state of being paired with any device.

The connection control means controls so that, when the 1 st notification signal is detected, reconnection is not performed even if the camera from which the 1 st notification signal is transmitted is paired, and when the 2 nd notification signal is detected, reconnection is performed when the camera from which the 2 nd notification signal is transmitted is paired, and reconnection is not performed when the camera is not paired.

The connection control means of the information terminal performs control so that connection is started while pairing is performed at the time of pairing operation, and then, when the pairing is maintained and connection is ended, connection is not performed even if the information terminal is again in a connectable state.

The communication device is provided with a 1 st communication unit based on a 1 st communication method and a 2 nd communication unit based on a 2 nd communication method.

The announcement signal is transmitted by the 1 st communication method.

The identification name included in the notification signal includes identification information for identifying the device in the 2 nd communication scheme.

The communication system further includes a 2 nd connection control unit that establishes a communication connection based on the 2 nd communication scheme by using the identification information of the device included in the identification name included in the notification signal.

The 1 st communication method is wireless communication based on ble (bluetooth Low energy) standard.

The 2 nd communication method is wireless communication based on the Wi-Fi standard, and the identification information is an SSID.

Conventionally, there is known a technology in which, when an information terminal such as a smartphone remotely operates an imaging apparatus such as a digital camera connected (paired) via wireless communication such as Bluetooth (registered trademark), information of a partner side device that has been connected (paired) once is stored in advance, and when the same imaging apparatus is connected (paired) to the information terminal again, imaging conditions and the like can be easily set using the stored information of the partner side device (see, for example, JP 2015-5889 a).

In addition, since batteries are generally consumed in a state where a connection for wireless communication is established, control is performed to disconnect the connection as much as possible when communication is not required, and recently, a case of using a communication means with low power consumption such as ble (bluetooth low energy) has been increasing.

However, in the above-described technology, although it is easy to set the shooting conditions and the like after the same imaging apparatus and the information terminal that have been connected in the past are connected again, when the same imaging apparatus and the smartphone are to be reconnected again after the imaging apparatus and the information terminal that have been connected once are disconnected, or when the pairing is to be changed and the reconnection is to be performed, if there are a plurality of connectable imaging apparatuses and information terminals, there may be a case where the imaging apparatuses and the information terminals are mistakenly connected to an unintended object or a problem in terms of security occurs. The same problem occurs when a connection by wireless communication is performed by a combination of an imaging device and a device other than an information terminal.

The present embodiment has been made in view of such circumstances, and an object thereof is to prevent unintended devices from being erroneously connected to each other and to enable appropriate communication connection when a plurality of devices are communicatively connected by wireless communication.

The data processing apparatus configured as described above is a data processing apparatus that performs a given data process in cooperation with other devices.

The data processing device includes a 1 st communication unit, a 2 nd communication unit, and a control unit.

The 1 st communication unit performs communication by a 1 st communication method that maintains a communication connection with another device even when the data processing apparatus and the other device are not in a predetermined operation state in which predetermined data processing can be executed.

The 2 nd communication unit performs communication by a 2 nd communication method that maintains a communication connection with another device on condition that the 2 nd communication method is in a predetermined operation state.

The control unit executes the predetermined cooperation process by transferring data to another device via the 2 nd communication unit, and when the predetermined cooperation process cannot be executed due to the absence of the predetermined operation state, the control unit executes the predetermined cooperation process after the data processing apparatus and the other device are shifted to the predetermined operation state by performing the predetermined communication with the other device via the 1 st communication unit.

Therefore, in the communication system S, the characteristics of communication and the functions of the OS (or specifications) can be effectively used under each constraint, and a plurality of devices can be more effectively operated in cooperation with each other.

In the data processing apparatus, the 1 st communication method by the 1 st communication unit is lower in speed but power-saving than the 2 nd communication method by the 2 nd communication unit.

The 1 st communication section maintains the communication connection with the other device even in a state where given data processing cannot be executed because the communication connection with the other device based on the 2 nd communication section is not established.

The control section makes a given communication with the other device by using the 1 st communication section, thereby making a transition from a state in which a communication connection with the other device based on the 2 nd communication section is not established to an established state.

The 1 st communication unit maintains a communication connection with the other device even in a state where the given data processing cannot be executed due to the other device or the data processing apparatus being not ready to execute the given data processing.

The control unit causes any one of the other devices or the data processing apparatus to transition from a state in which the predetermined data processing is not ready to a state in which the predetermined data processing is performed to a state in which the predetermined communication is performed by using the 1 st communication unit.

The state of readiness to execute the predetermined data processing means a state in which the power of any of the other devices or the data processing apparatus is turned off, a state in which a program for executing the predetermined data processing is not started, or a state in which the 2 nd communication unit does not function.

The control unit performs the predetermined communication by using the 1 st communication unit, thereby causing both the other device and the data processing apparatus to be in a ready state for executing the predetermined data processing regardless of which of the other device and the data processing apparatus is in a state of not being ready for executing the predetermined data processing.

When the other device is in a state of not being ready to execute the predetermined data processing, the control unit transmits a predetermined signal to the other device by using the 1 st communication unit, thereby causing the other device to transition to a state of being ready to execute the predetermined data processing.

When the data processing apparatus is in a state in which the data processing apparatus is not ready to execute the predetermined data processing, the data processing apparatus is shifted to a state in which the data processing apparatus is ready to execute the predetermined data processing by receiving the predetermined signal from the other device by the 1 st communication unit.

The given data processing includes 1 st data processing for controlling the other device by the operation of the data processing apparatus and 2 nd data processing for controlling the data processing apparatus by the operation of the other device.

The control unit causes the other device to be in a ready state for executing the 1 st data processing by transmitting a predetermined signal to the other device by the 1 st communication unit in accordance with an operation of the data processing apparatus when the 1 st data processing is performed, and causes the data processing apparatus to be in a ready state for executing the 2 nd data processing by receiving the predetermined signal transmitted by the 1 st communication unit in accordance with an operation of the other device when the 2 nd data processing is performed.

The control unit arbitrarily designates another device that performs a predetermined data processing as a designated device, starts communication connection with the designated device by the 1 st communication unit, and while maintaining the communication connection, sets the communication connection with the designated device by the 2 nd communication unit to a state in which the communication connection with the designated device is released, and starts communication connection with the designated device by the 2 nd communication unit by performing a predetermined communication with the designated device by the 1 st communication unit.

One of the data processing apparatus and the other device is an imaging apparatus having an imaging function, and the other is a display terminal having an image display function.

The predetermined cooperation process includes an image transfer process of transferring image data captured by the image capturing device to the display terminal through the 2 nd communication unit and displaying the image data.

The given data processing includes 1 st data processing for starting image transfer processing according to an operation of the image pickup device, and 2 nd data processing for starting image transfer processing according to an operation of the display terminal.

Further, the communication system S is a data processing system in which a plurality of devices having different roles cooperate to perform given data processing.

The data processing system includes a 1 st communication unit, a 2 nd communication unit, and a control unit.

The 1 st communication unit performs communication by a 1 st communication method that maintains communication connections with a plurality of devices even when the plurality of devices are not in a given operation state in which given data processing can be performed.

The 2 nd communication unit performs communication by a 2 nd communication method that maintains communication connection with a plurality of devices on condition that the 2 nd communication method is in a predetermined operation state.

The control unit executes the predetermined data processing by transferring data to the plurality of devices via the 2 nd communication unit, and when the predetermined data processing cannot be executed due to the non-predetermined operation state, the control unit executes the predetermined data processing after the data processing apparatus and the other device are shifted to the predetermined operation state by performing the predetermined communication with the other device by the 1 st communication unit.

The plurality of devices include a 1 st device having a function of acquiring data and a 2 nd device having a function of managing data.

The 1 st device includes a control unit that transmits the acquired data to the 2 nd device via the 2 nd communication unit.

The 2 nd device includes: a storage unit that stores a 1 st program for executing data management processing for managing data received from a 1 st device; and a control unit for switching the 1 st program between a stop state and a start state.

The control unit of the 1 st device transmits a predetermined signal to the 2 nd device via the 1 st communication unit in a state where the 1 st program of the 2 nd device is stopped, and then transmits the acquired data to the 2 nd device via the 2 nd communication unit.

When a given signal is received from the 1 st device via the 1 st communication unit while the 1 st program of the 2 nd device is stopped, the control unit of the 2 nd device switches the 1 st program from the stopped state to the activated state, and then designates data received from the 1 st device via the 2 nd communication unit as a management target to cause the 1 st program to execute data management processing.

The storage section of the 2 nd device further stores a 2 nd program for executing data reception processing for receiving data from the 1 st device via the 2 nd communication section.

The control unit of the 2 nd device switches the 1 st program and the 2 nd program between a stop state and a start state.

The control unit of the 1 st device transmits a predetermined signal to the 2 nd device via the 1 st communication unit in a state where the 1 st program of the 2 nd device is stopped and the 2 nd program is started, and then transmits the acquired data to the 2 nd device via the 2 nd communication unit.

When a given signal is received from the 1 st device via the 1 st communication unit by the data reception processing executed by the 2 nd program in a state where the 1 st program of the 2 nd device is stopped and the 2 nd program is started, the control unit of the 2 nd device switches the 1 st program from the stopped state to the started state, and then designates the data received from the 1 st device via the 2 nd communication unit as a management target to cause the 1 st program to execute data management processing.

When receiving a start request of a 1 st program from a 2 nd device via a 1 st communication unit, a control unit of the 1 st device transmits a start notification of the 1 st program to the 2 nd device via the 1 st communication unit.

When the 1 st program cannot be directly started from the 2 nd program, the control unit of the 2 nd device transmits a start request of the 1 st program to the 1 st device via the 1 st communication unit, and switches the 1 st program from a stopped state to a started state by a start notification transmitted from the 1 st device in accordance with the start request.

The 1 st communication unit is lower in speed but power-saving than the 2 nd communication unit.

The control unit cannot start the 1 st program by the communication of the 2 nd communication unit, and can start the 1 st program by the communication of the 1 st communication unit.

The data management processing is processing for assigning and managing designated data to any of a plurality of groups.

The control unit of the 2 nd device performs the data management processing by designating the received data as a group management object through the execution of the 1 st program.

The control unit of the 2 nd device transmits group information on a plurality of groups that can be managed by the data management processing to the 1 st device, and assigns and manages data received from the 1 st device to a group designated by the group selection information received from the 1 st device.

The control unit of the 1 st device selects a predetermined group from a plurality of groups included in the group information received from the 2 nd device, and transmits the group selection information to the 2 nd device.

The control unit of the 2 nd device causes the 2 nd device to store the group selection information transmitted from the 1 st device.

Each time new data is received from the 1 st device, the data is assigned to the group designated by the stored group selection information and managed.

The control unit of the 2 nd device assigns and manages data received from the 1 st device together with the group selection information to the group designated by the group selection information.

The control unit of the 1 st device displays a list of a plurality of groups included in the group information received from the 2 nd device to allow the user to select the group, and transmits group selection information based on the user operation to the 2 nd device.

The control unit of the 2 nd device includes a 3 rd communication unit, and the 3 rd communication unit communicates with a server that provides a data sharing service on a network.

The data management processing designates data received from the 1 st device as a sharing target and transmits the data to the server via the 3 rd communication unit.

When the control unit of the 2 nd device designates the received data as a sharing target and transmits the data to the server for sharing, the control unit designates the group designated by the group selection information.

The control unit of the 1 st device allows the user to select whether or not to share the acquired image, and transmits the sharing permission information to the 2 nd device together with the group selection information.

The control unit of the 2 nd device transmits the received data to the server when sharing is possible.

The control section of the 1 st device selects a service on a plurality of different networks that provide a data sharing service.

The control section of the 2 nd device transmits the received data to the server that provides the selected service.

When a control unit of an imaging device as a 1 st apparatus acquires new image data in a state where an automatic transmission mode is set, the image data is transmitted through a 2 nd communication unit.

The control section of the image pickup device as the 1 st apparatus stores and updates the group selection information and displays the currently selected group on the live view screen.

There are a number of different classes of devices 2.

The control unit changes the control of the start-up according to the type.

The 1 st communication unit is always connected.

The 2 nd communication unit establishes a communication connection in accordance with a connection request via the 1 st communication unit, and changes establishment control of the communication connection in accordance with the type.

The communication system S configured as above exchanges data among a plurality of devices to perform a given function.

In the communication system S, one device and the other device are connected by a plurality of different communication methods, and when data transfer in the 1 st communication method is interrupted, control is performed so that the 1 st communication method is established by the 2 nd communication method and data transfer in the 1 st communication method is resumed.

In the communication system S, the application is configured to execute operations in the background so as to be able to transfer data.

In the communication system S, each time the data transfer operation of the application in the other device is interrupted by the control of the os (operating system) in the background during the data transfer from the one device to the other device, the application performing the data transfer is started from the one device by the 2 nd communication method, and the interrupted data transfer is restarted.

In the communication system S, the 1 st communication method and the 2 nd communication method are coordinated with each other, whereby a predetermined control is performed between one device and the other device by an operation from the device on the other side.

In the communication system S, a request for transmitting an image is exchanged using communication in the 2 nd communication scheme, and image transmission is performed using communication in the 1 st communication scheme.

In the communication system S, one of the apparatuses has a photographing function.

In the communication system S, when one of the devices is configured to transmit a captured image to the other device by executing a photographing process, and the other device stores the captured image in a server and performs automatic registration with the server, the other device performs different operations depending on an OS (operating system) installed therein.

In the communication system S, when one of the apparatuses executes the photographing process to transmit a photographed image to the other apparatus, and the other apparatus stores the photographed image in the server to perform automatic registration with the server, the communication system S performs automatic registration with the server according to a condition set in advance in the other apparatus.

In the communication system S, when the application that is being started in the background is of a specification that cannot cooperate with another application, the other application can be started by communication in the 1 st communication scheme via another device.

In the communication system S, when one of the apparatuses executes the photographing process to transmit a photographed image to the other apparatus, and the other apparatus stores the photographed image in the server to perform automatic registration with the server, the other apparatus selects a storage destination to the server in advance, and stores the selected storage destination of the server in the one apparatus.

In the communication system S, when one device detects the notification signal of the other device and performs communication by the 2 nd communication scheme, the presence or absence of connection is controlled based on the pairing state between the devices and the change state of the device name included in the notification signal.

In the communication system S, the connection state of communication in the 2 nd communication scheme is monitored at a predetermined timing.

In the communication system S, the interval time for monitoring the connection state of communication in the 2 nd communication scheme is changed depending on whether the power supply of the device to be monitored is in an on state or an off state.

In the communication system S, the setting change of the communication in the 1 st communication scheme is prohibited in a state where the pairing in the communication in the 2 nd communication scheme is established.

In the communication system S, when an event of communication in the 2 nd communication scheme occurs in one device in a state where a pairing in communication in the 2 nd communication scheme is established, the one device is powered on condition that an intentional request is made from the other device.

The following conditions are assumed as the preconditions of the above-described embodiment.

In Wi-Fi communication, a plurality of devices can be connected to each other by 1 device, and a plurality of applications can share the device and use Wi-Fi communication. For example, 8 mobile terminals 2 each serving as a PC or a smartphone are connected to the AP of the imaging device 1 serving as a camera, and the images of the imaging device 1 serving as a camera can be simultaneously referred to.

In the present embodiment, only 1 AP (imaging device 1 as a camera) that can be simultaneously connected to the mobile terminal 2 as a smartphone is configured.

In Wi-Fi communication, each application has no guarantee that a data communication connection is maintained in a background-executed state.

In contrast, in BLE communication, a plurality of objects that can be simultaneously connected by 1 device can be used. In detail, the center device can be connected to a plurality of peripheral devices, and the peripheral device can be connected to 1 center device.

In addition, in BLE communication, each application can exclusively use its own dedicated communication connection. That is, BLE has 1 physical connection, and can share the physical connection and exclusively own logical connection.

In addition, in BLE communication, each application can maintain communication connection under given conditions even when executed in the background.

The predetermined condition means that intermittent communication performed at predetermined intervals for maintaining communication connection is continuously performed.

As the case where this condition is not satisfied, for example, there are a case where the radio wave condition deteriorates due to a distance between devices being extended, and a case where the operation of an application performing BLE communication in the background is forcibly interrupted by iOS in order to free CPU power and a memory area for another application. That is, when the distance is increased, the physical connection is disconnected, and when the operation of the application is interrupted, the physical connection is maintained, and the data communication by the logical connection is interrupted.

The mobile terminal 2 as a smartphone can execute a plurality of application software including application software not related to the present embodiment.

In the mobile terminal 2 as a smartphone, when an application related to the present embodiment performs Wi-Fi communication in the background and when another application unrelated to the present embodiment starts Wi-Fi communication in the foreground, Wi-Fi communication of the application related to the present embodiment may be interrupted. Further, when an application performs Wi-Fi communication (data communication) in the background and another application starts Wi-Fi communication in the foreground, Wi-Fi communication of the background application is not always interrupted, and for example, in the case of iOS, if the Wi-Fi communication is continued in the background within a limited time.

The mobile terminal 2 as a smartphone may be configured so that, when an application related to the present embodiment performs BLE communication with a paired object in the background, another application unrelated to the present embodiment does not start BLE communication with another object in the foreground. Moreover, unrelated applications are configured to be able to perform BLE communication.

The constant connectivity of BLE communication in the case of comparing Wi-Fi communication as described in the present embodiment has 2 meanings.

1 means that the communication connection is maintained even in the low power consumption state during the period in which the given condition is satisfied.

Another 1 means that even in a case where communication connection is cut off because a given condition is not satisfied, it is possible to easily reconnect with the same object as long as the connection object is not changed (a concept slightly different from pairing.

The pairing of BLE generally refers to the establishment of a BLE connection, but the pairing of the imaging device 1 as a camera includes not only the establishment of a BLE connection but also the recording of a BD address of the camera by an application of the mobile terminal 2 as a smartphone and the establishment of a Wi-Fi connection once (registration of a Wi-Fi profile in the case of iOS). By storing the BD address as an application of the mobile terminal 2 of the smartphone, it is possible to connect to the camera connected before when the BLE is reconnected after being disconnected.

The OS of the mobile terminal 2 as a smartphone is loaded with, for example, version 8 of iOS that operates under the above-described restrictions.

In the present embodiment, since the above-described premise is assumed, it is possible to configure that the communication target cannot be fixedly registered (paired) in advance in Wi-Fi communication, and it is possible to configure that the communication target is fixedly registered (paired) in advance in BLE communication. In addition, when power consumption is not considered, Wi-Fi can be always connected, and an application can store an object to which Wi-Fi connection is to be made.

The BLE is used advantageously to simplify user operations during Wi-Fi connection, and to enable Wi-Fi connection by an operation of either the imaging device 1 as a camera or the mobile terminal 2 as a smartphone without requiring an SSID and a PW input.

In the embodiment configured as described above, as an operation for enabling communication with low power consumption, BLE communication is performed in which the center device (the portable terminal 2 serving as a smartphone) detects an announcement signal of the peripheral device (the image pickup device 1 serving as a camera) to start connection, and after the start of connection, intermittent communication is performed while repeating on and off of the power supply for communication at predetermined intervals.

As a protocol (restriction) of such BLE communication, while the connection state of communication is maintained while communication is continuously performed at predetermined intervals, the connection state of communication is released when communication at predetermined intervals is not performed due to some factor. When the connection state of communication is released, it is necessary to start with notification of the peripheral device (the image pickup apparatus 1 as a camera) and scanning of the center device (the portable terminal 2 as a smartphone) again in order to reconnect.

Some of the factors mentioned here include, for example, weakening of radio waves due to a distance between devices, or restriction of an OS (operating system) of a device.

For example, in the case of iOS, each application can communicate with the BLE device when executing in the background, but because CPU power and memory are shared with other applications, the time during which operations can be continuously executed is limited, and connection is interrupted even during the execution of BLE communication.

Therefore, in the above-described embodiment, for example, when iOS is assumed, when a plurality of devices are caused to cooperate to execute an operation, the purpose is to perform the cooperative operation more efficiently using a plurality of application software.

In the above-described embodiments, for example, when BLE is assumed, when a plurality of devices are caused to cooperate to perform an operation, it is an object to perform the cooperative operation more efficiently using communication with low power consumption.

Specifically, in the above-described embodiment, BLE is coordinated with Wi-Fi so that activation and control of the other is performed by only one operation from the imaging device 1 as a camera to the mobile terminal 2 as a smartphone and from the mobile terminal 2 as a smartphone to the imaging device 1 as a camera.

In the above embodiment, the BLE communication is used to exchange the image transmission request, and the Wi-Fi communication is used to actually transmit the image.

In the above embodiment, when a photographed image is automatically registered in a cloud album via the mobile terminal 2 as a smartphone only by photographing with the image pickup device 1 as a camera, the operation of the application is changed according to the OS type of the mobile terminal 2 as a smartphone.

In the above embodiment, when a photographed image is automatically registered in a cloud album via the mobile terminal 2 as a smartphone only by photographing with the image pickup device 1 as a camera, the automatic registration to the cloud album can be performed under a condition set in advance on the mobile terminal 2 side as a smartphone.

In the above embodiment, in the mobile terminal 2 as a smartphone, since an application that is starting in the background cannot cooperate with another application, another application is started by BLE via the imaging device 1 as a camera.

Further, in the above-described embodiment, in the case where the photographed image is automatically registered in the cloud album via the portable terminal 2 as the smartphone only by photographing by the image pickup device 1 as the camera, the album to be registered is selected in advance on the image pickup device 1 side as the camera, and the selection information is stored in the portable terminal 2 as the smartphone.

In the above embodiment, when the portable terminal 2 as a smartphone detects the notification signal of the imaging device 1 as a camera and performs BLE connection (reconnection), the presence or absence of connection is controlled in accordance with the pairing state and the state of change in the device name included in the notification signal.

In the above embodiment, in the data transfer from the imaging device 1 as a camera to the portable terminal 2 as a smartphone, each time the background operation of the application is interrupted by the control of the iOS, the application is restarted by BLE from the imaging device 1 as a camera, and the interrupted data transfer is restarted.

In the above-described embodiment, the imaging device 1 as a camera changes the interval time of connection monitoring of BLE according to whether its own power supply is in an on state or an off state.

In the above embodiment, the imaging device 1 as a camera prohibits the setting change of Wi-Fi in a state where the pairing of BLE is established.

In the above embodiment, when an event of BLE occurs in a state where pairing of BLE is established, the imaging device 1 as a camera turns on the power supply of the imaging device 1 as a camera on the condition that an intentional request is made from the portable terminal 2 as a smartphone.

The present invention is not limited to the above-described embodiments, and modifications, improvements, and the like within a range that can achieve the object of the present invention are included in the present invention.

In the above-described embodiment, the external device is described as the portable terminal 2 configured by a smartphone, but the present invention is not limited to this, and may be an electronic device such as a tablet terminal, a PC (Personal Computer), another digital camera, or the like, or a server. The Communication method may be other wireless Communication such as Near Field Communication (NFC) for short-range Communication or public line, or may be wired, and the transmission destination may be plural or may be via a network such as the internet.

In the above-described embodiment, the imaging device 1 to which the present invention is applied has been described by taking a digital camera as an example and the mobile terminal 2 has been described by taking a smartphone as an example, but the present invention is not particularly limited thereto.

For example, the present invention can be widely applied to electronic devices having the above-described processing functions. Specifically, the present invention can be applied to, for example, notebook personal computers, printers, television receivers, video cameras, portable navigation devices, mobile phones, smart phones, portable game machines, and the like.

When a series of processes is executed by software, a program constituting the software is installed from a network or a recording medium to a computer or the like.

The computer may be a computer embedded in dedicated hardware. Further, the computer may be a computer capable of executing various functions by installing various programs, such as a general-purpose personal computer.

The recording medium containing such a program is constituted not only by the removable medium 31 of fig. 3 that is distributed separately from the apparatus main body in order to provide the program to the user, but also by a recording medium or the like that is provided to the user in a state of being pre-assembled in the apparatus main body. The removable medium 31 is constituted by, for example, a magnetic disk (including a flexible disk), an optical disk, an optomagnetic disk, or the like. The optical Disk is constituted by, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disk), a Blu-ray (registered trademark) Disc, and the like. The optomagnetic Disk is formed of MD (Mini-Disk) or the like. The recording medium provided to the user in a state of being incorporated in the apparatus main body in advance is constituted by, for example, the ROM12 of fig. 3 in which a program is recorded, a hard disk included in the storage unit 19 of fig. 3, or the like.

In this specification, the steps describing the program recorded in the recording medium include not only processing performed in time series in the order thereof but also processing not necessarily performed in time series but executed in parallel or individually.

In the present specification, the term "system" means an entire apparatus including a plurality of apparatuses, a plurality of units, and the like.

Although several embodiments of the present invention have been described above, these embodiments are merely examples and do not limit the technical scope of the present invention. The present invention can be implemented in various other embodiments, and various modifications such as omission and replacement can be made without departing from the scope of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in the present specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

In the above-described embodiment, the image pickup unit, the input unit, the output unit, the storage unit, the 1 st communication unit, the 2 nd communication unit, and the like are configured by electronic circuits, and the image pickup control unit, the communication control unit, the application management unit, the pairing status determination unit, the notification signal generation unit, and the like are realized by software (causing a CPU to execute a program stored in a RAM or a ROM).

However, a part or all of the various functions implemented by the electronic circuit may be implemented by software, or a part or all of the various functions implemented by software may be implemented by the electronic circuit.

Claims

1. A data processing system for exchanging data between a plurality of devices to perform a given function, said data processing system characterized by,

one device is connected to the other device by a 1 st communication method,

in the case where data transfer in the 1 st communication method is interrupted, control is performed such that connection of the 1 st communication method is established by a 2 nd communication method different from the 1 st communication method, the data transfer is restarted, and,

performing execution control of the given function based on an operation from the one device by causing the connection of the 1 st communication method and the connection of the 2 nd communication method to cooperate.

2. A data processing system for exchanging data between a plurality of devices to perform a given function, said data processing system characterized by,

one device is connected to the other device by a 1 st communication method,

the predetermined function is a function of exchanging a transmission request of an image using the communication in the 2 nd communication scheme and transmitting an image using the communication in the 1 st communication scheme.

3. The data processing system of claim 2,

the one device has a photographing function,

transmitting an image captured by the photographing function in the one device to the other device by communication in the 1 st communication scheme,

the given function also includes a function of transmitting the captured image to a server and registering it to the server in the other party's device.

4. A data processing method which is a data processing method executed in a data processing system that exchanges data among a plurality of devices to perform a given function, the data processing method characterized by comprising:

a process in which one device and the other device are connected by a 1 st communication method;

control, when data transfer in the 1 st communication method is interrupted, so that a connection of the 1 st communication method is established by a 2 nd communication method different from the 1 st communication method, and the data transfer is restarted; and

5. A data processing method which is a data processing method executed in a data processing system that exchanges data among a plurality of devices to perform a given function, the data processing method characterized by comprising:

and executing processing of the given function, the given function being a function of exchanging a transmission request of an image using communication in the 2 nd communication manner, and performing image transmission using communication in the 1 st communication manner.

6. A computer-readable storage medium characterized in that a program is recorded, the program causing a computer of a data processing system that exchanges data among a plurality of devices to execute a given function to execute:

7. A computer-readable storage medium characterized in that a program is recorded, the program causing a computer of a data processing system that exchanges data among a plurality of devices to execute a given function to execute: