JP7118669B2 - Information processing device and its control method and program - Google Patents

Description

More particularly, the present invention relates to an information processing apparatus suitable for performing processing using a plurality of applications, a control method therefor, and a program.

An information processing apparatus such as a smartphone can realize various functions by installing an OS and a plurality of applications and operating using each application. For example, it is possible to connect to a camera using a camera connection application to capture an image, or to edit an image using an image editing application. Japanese Unexamined Patent Application Publication No. 2002-200002 discloses a communication device that communicates with a digital camera using a camera connection application.

JP 2014-86844 A

These multiple applications may have different data formats and sizes suitable for each application.

For example, an information processing apparatus will be described with respect to a first application for executing processing for capturing an image from a camera and a second application for executing processing for editing an image. When the second application activates the first application to acquire data to be edited, the information processing device captures an image from the camera. Here, if the data format is not compatible with the second application, the image cannot be edited and the captured image is wasted. Also, when excellent editing results are obtained for images of a specific data format and size in the second application, the editing process cannot be sufficiently performed by importing an image of a data format or size unsuitable for editing. There was nothing.

SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to capture an image suitable for processing of an application when data is captured from an external device in cooperation with a plurality of applications.

In order to solve the above problems, one of the inventions according to the present application is an information processing apparatus capable of installing a plurality of applications including a first application and a second application, the information processing apparatus operating according to the second application. an acquisition means for acquiring type information indicating at least one of a data format and size suitable for the first application; By operating according to the first receiving means for receiving attribute information about data and the second application, it is possible to identify whether or not the external device can provide the original data that satisfies the conditions indicated by the type information. and display control means for controlling to display attribute information related to the original data held by the external device on a screen; data requesting means for requesting data from the external device; and second receiving means for receiving, from the external device, the original data that satisfies the conditions indicated by the type information by operating according to the second application. characterized by

According to the present invention, when fetching data from an external device in cooperation with a plurality of applications, it is possible to fetch data in a data format and size suitable for the processing of the applications, and obtain more favorable processing results. can. In addition, it is possible to prevent unnecessary data import processing, and to reduce the processing load.

1 is a diagram for explaining a configuration example of a network including communication devices according to an embodiment of the present invention; FIG. 2 is a block diagram showing an example hardware configuration of a communication device according to an embodiment of the present invention; FIG. It is a figure which shows the software structural example of the communication equipment in embodiment of this invention. 1 is a block diagram showing a hardware configuration example of an imaging device according to an embodiment of the present invention; FIG. FIG. 4 is a sequence diagram showing an example in which Read-app starts Write-app, acquires an in-camera image by Write-app, and passes it to Read-app according to the first embodiment of the present invention; FIG. 3 is a diagram showing a configuration example of a data sharing location and a data list according to the embodiment of the present invention; FIG. FIG. 4 is a diagram showing an example of a Read-app display screen according to the embodiment of the present invention; FIG. 4 is a diagram showing an example of a display screen of Write-app according to the embodiment of the present invention; FIG. 4 is a diagram showing an example of a data reception screen of Write-app according to the embodiment of the present invention; FIG. 10 is a sequence diagram showing an example of activating Write-app, determining Read-app, acquiring an in-camera image by Write-app, and passing it to Read-app in another embodiment of the present invention. FIG. 10 is a diagram showing an example of a display screen of Write-app in another embodiment of the present invention;

Preferred embodiments of the present invention will be exemplarily described in detail below with reference to the drawings. However, the components described in this embodiment are merely examples, and the scope of the present invention is not intended to be limited to them.

(First embodiment)
A first embodiment of the present invention will be described below with reference to the drawings. In the present embodiment, an example will be described in which a user operates a communication device (smartphone), which is an information processing device, to start an image editing application and start a data importing application. Note that the "activation" of an application in this embodiment includes a case of activating an application that has not yet been activated and a case of moving an application that is being activated in the background to the foreground.

(Network configuration)
FIG. 1 is a diagram for explaining a configuration example of a system including a communication device 101 according to this embodiment.

As shown in FIG. 1, the communication device 101 can connect to the imaging device 102 using a data capture application and capture images from the imaging device 102 via the network 103 . Note that the communication used for connection with the imaging device 102 may be wired communication or wireless communication.

(Configuration of communication equipment)
FIG. 2 is a block diagram showing a hardware configuration example of the communication device 101 according to this embodiment.

In FIG. 2, a CPU 201 controls processing of the communication device 101 as a whole. The ROM 202 stores various control programs executed by the CPU 201, data, and the like. The RAM 203 has a work area for the CPU 201, an area for saving data during error processing, an area for loading control programs, and the like. A HDD (Hard Disk Drive) 204 stores an OS (Operating System), various applications, control programs and contents executed in the communication device 101, and data.

The input device 205 includes various buttons such as a button for switching ON/OFF of power. A BMU (bit move unit) 206, for example, transfers data between memories (for example, between the VRAM 207 and another memory) and transfers data between the memory and each I/O device (for example, the NETI/F 209). to control. Image data to be displayed on the display device 211 is drawn in the VRAM 207 . The image data drawn in the VRAM 207 is transferred to the display device 211 according to a predetermined rule, and the image is displayed on the display device 211 accordingly. Further, the display device 211 is equipped with a touch panel, and when the user touches the display surface of the display device 211, an instruction related to the icon displayed at that position is input. The NETI/F 209 communicates with the imaging device 102 and the like via the network 103 . Bus 212 includes an address bus, a data bus and a control bus.

FIG. 3 is a diagram showing a software configuration example of the communication device 101 according to this embodiment.

A predetermined OS 301 is installed in the communication device 101, and a data acquisition application (hereinafter referred to as Write-app) 302 and an image editing application (hereinafter referred to as Read-app) 303 are installed. The CPU 201 of the communication device 101 activates the OS 301 to perform basic processing performed by the communication device 101, and also performs cooperative processing of installed applications and processing of recording data in the HDD 204 or the like. In addition, the CPU 201 of the communication device 101 activates the Write-app 302 and performs processing for capturing an image from the imaging device 102 via the NETI/F 209, for example. Further, the CPU 201 of the communication device 101 activates the read-app 303 to process the captured image and instruct the printing apparatus to print the image. Here, Write-app 302 can be said to be an application for input and an application for output. Note that the communication device 101 can install a plurality of Read-apps 303, and one of them will be described as an example in this embodiment.

(Configuration of imaging device)
FIG. 4A is a block diagram showing a configuration example of the imaging device 102, which is an example of the external device of this embodiment. Note that an imaging device will be described here as an example of the external device, but the external device is not limited to this. For example, the external device may be a portable media player, a so-called tablet device, or an information processing device such as a personal computer.

A control unit 401 controls each unit of the imaging device 102 according to an input signal and a program described later. Note that instead of the control unit 401 controlling the entire apparatus, a plurality of pieces of hardware may share processing to control the entire apparatus.

The image capturing unit 402 includes, for example, an optical system for controlling an optical lens unit, aperture, zoom, focus, etc., and an image sensor for converting light (image) introduced through the optical lens unit into an electrical image signal. Configured. As an imaging device, a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) is generally used. Under the control of the control unit 401, the imaging unit 402 converts subject light imaged by the lens included in the imaging unit 402 into an electrical signal by the imaging element, performs noise reduction processing, etc., and converts the digital data into an image. Output as data. In the imaging apparatus 102 of this embodiment, image data is recorded in the recording medium 410 according to the DCF (Design Rule for Camera File System) standard.

The non-volatile memory 403 is an electrically erasable/recordable non-volatile memory, and stores a later-described program and the like executed by the control unit 401 .

The working memory 404 is used as a buffer memory for temporarily holding image data captured by the imaging unit 402, an image display memory for the display unit 406, a work area for the control unit 401, and the like.

The operation unit 405 is used by the user to receive an instruction to the imaging device 102 from the user. The operation unit 405 includes, for example, a power button used by the user to turn on/off the imaging apparatus 102, a release switch used to instruct shooting, and a playback button used to instruct playback of image data. Furthermore, it includes an operation member such as a dedicated connection button for starting communication with an external device via a communication unit 411, which will be described later. The operation unit 405 also includes a touch panel formed in the display unit 406 to be described later. The release switch has SW1 and SW2. When the release switch is in a so-called half-pressed state, SW1 is turned on. This accepts instructions for preparing for shooting such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (flash pre-emission) processing. Further, when the release switch is in a so-called full-press state, SW2 is turned on. Thus, an instruction for photographing is accepted.

A display unit 406 displays a viewfinder image at the time of photographing, displays photographed image data, displays characters for interactive operation, and the like. Note that the display unit 406 does not necessarily have to be built into the imaging device 102 . The imaging device 102 can be connected to an internal or external display unit 406 and has at least a display control function for controlling display on the display unit 406 .

A recording medium 410 can record the image data output from the imaging unit 402 . The recording medium 410 may be configured to be detachable from the imaging device 102 or may be built in the imaging device 102 . In other words, the imaging device 102 should at least have means for accessing the recording medium 410 .

A communication unit 411 is an interface for connecting with an external device. The imaging device 102 of this embodiment can exchange data with an external device via the communication unit 411 . For example, image data generated by the imaging unit 402 can be transmitted to an external device via the communication unit 411 . Further, imaging by the imaging unit 402 can be controlled from an external device via the communication unit 411 . Note that, in this embodiment, the communication unit 411 includes an interface for communicating with an external device via a so-called wireless LAN conforming to the IEEE802.11 standard. The control unit 401 realizes wireless communication with an external device by controlling the communication unit 411 .

The close proximity wireless communication unit 412 includes, for example, an antenna for wireless communication, a modulation/demodulation circuit for processing wireless signals, and a communication controller. A close proximity wireless communication unit 412 outputs a modulated wireless signal from an antenna and demodulates a wireless signal received by the antenna to perform short-range wireless communication according to the IEEE802.15 standard (so-called Bluetooth (registered trademark)). come true. In this embodiment, Bluetooth communication employs Bluetooth Low Energy version 4.0 (hereinafter referred to as BLE), which has low power consumption. The BLE communication has a narrower communicable range (that is, a shorter communicable distance) than the wireless LAN communication. In addition, BLE communication has a slower communication speed than wireless LAN communication. On the other hand, BLE communication consumes less power than wireless LAN communication. The imaging device 102 of this embodiment can exchange data with an external device via the close proximity wireless communication unit 412 . For example, imaging by the imaging unit 402 can be controlled from an external device via the communication unit 411 . However, since the communication speed is slow, the image data generated by the imaging unit 402 is not transmitted.

Note that the communication unit 411 of the imaging apparatus 102 in this embodiment has an AP mode that operates as an access point in infrastructure mode and a CL mode that operates as a client in infrastructure mode. By operating the communication unit 411 in CL mode, the imaging apparatus 102 in this embodiment can operate as a CL device in infrastructure mode. When the imaging apparatus 102 operates as a CL device, it can participate in a network formed by AP devices by connecting to peripheral AP devices. Further, by operating the communication unit 411 in AP mode, the imaging apparatus 102 in the present embodiment can operate as a simple AP (hereinafter referred to as a simple AP) with more limited functions, although it is a type of AP. is also possible. When the imaging device 102 operates as a simple AP, the imaging device 102 itself forms a network. Devices around the imaging device 102 can recognize the imaging device 102 as an AP device and participate in the network formed by the imaging device 102 . It is assumed that the program for operating the imaging apparatus 102 as described above is held in the nonvolatile memory 403 .

Note that the imaging device 102 in this embodiment is a kind of AP, but it is a simple AP that does not have a gateway function for transferring data received from a CL device to an Internet provider or the like. Therefore, even if data is received from other devices participating in the network formed by itself, it will not be transferred to a network such as the Internet.

Next, the appearance of the imaging device 102 will be described. 4B and 4C are diagrams showing an example of the appearance of the imaging device 102. FIG. A release switch 405a, a playback button 405b, a direction key 405c, and a touch panel 405d are operation members included in the operation unit 405 described above. In addition, an image obtained as a result of imaging by the imaging unit 402 is displayed on the display unit 406 . Further, the imaging device 102 of this embodiment has an antenna portion of the close proximity wireless communication unit 412 on the side surface of the camera housing. By bringing the close proximity wireless communication units 412 close to each other within a certain distance, close proximity wireless communication can be established with another device. Thereby, it is possible to perform contactless communication without using a cable or the like, and it is possible to limit communication partners according to the user's intention.

(Processing procedure for communication equipment)
Next, the processing procedure of the communication device 101 according to this embodiment will be described with reference to FIGS. 5 to 8. FIG. In this embodiment, a process will be described in which the CPU 201 of the communication device 101 activates the Read-app, receives a user's instruction on a screen for processing by the Read-app, and calls the Write-app.

FIG. 5 shows that, in this embodiment, the CPU 201 of the communication device 101 activates the Read-app and then the Write-app, acquires an image from an external device, and acquires the acquired image for image editing processing. FIG. 10 is a sequence diagram for explaining a processing procedure for passing data to Read-app; The processing described below is realized by the CPU 201 of the communication device 101 activating the OS 301, the Write-app 302, and the Read-app 303, appropriately operating according to them, and controlling each unit.

To simplify the explanation, the phases are divided into phases such as T501 to T509 as a cooperation start phase, T510 to T516 as a connection phase, T517 to T527 as an image storage phase, and T528 to T531 as a cooperation end phase. do.

First, the cooperation start phase from T501 to T509 will be described.

At T501, the CPU 201 of the communication device 101 accepts a Read-app activation request by the user's operation.

Subsequently, in T502, processing is started by the CPU 201 activating Read-app in response to the activation request in T501. When the Read-app is activated, the CPU 201 causes the display device 211 to display a screen as shown in FIG. 7(a). On the screen shown in FIG. 7A, the user selects editing contents to be executed via the touch panel of the display device 211 .

For example, when "process photo" is selected, the screen shown in FIG. 7B is displayed on the display device 211, and when "print photo" is selected, the screen shown in FIG. The screen shown in (c) is displayed. When "send photo" is selected, the screen shown in FIG. 7(d) is displayed on the display device 211. On the screens shown in FIGS. 7B to 7D, an image to be edited can be selected from images saved in the HDD 204 or the like. On the other hand, if the user wishes to edit an image that is not held by the communication device 101, the image can be imported from an external device by selecting the "add photo from Write-app" button 702. FIG. In the process shown in FIG. 5, when the user selects the "Add photos from Write-app" button 702, the Read-app requests the Write-app to be started, and the image capture process from the external device is executed. be done. The details of these processes will be described later after T506.

In T503 of FIG. 5, the CPU 201 refers to the data sharing location 500 and determines whether or not there is a list holding a combination of data formats and sizes suitable for Read-app processing (hereinafter referred to as an image type list). . If there is a Read-app image type list, it shows the Read-app image type list stored in the shared location 500 and the data format and size suitable for processing set in the Read-app. Compare information to determine if there are changes. Information indicating the data format and size set in the Read-app is not only stored in the HDD 204 when the Read-app is installed, but is also transmitted via the Internet or the like when the version of the Read-app is upgraded. Received from outside and updated. It should be noted that the suitable data format and size may be changeable within the Read-app so as to reflect the user's intentions.

The data sharing location 500 and the image type list will now be described in detail.

First, the data sharing location is a predetermined storage area that is readable and writable by each application, and will be explained using FIG. 6(a). FIG. 6A shows an example directory structure in the HDD 204. FIG. In FIG. 6( a ), the data sharing location folder is 601 . In this embodiment, the image type list 602 of each cooperative application such as Read-app and Write-app is written directly under this. Shared folder 601 and image type list 602 can be read and written from cooperative applications such as Read-app and Write-app. Each cooperative application stores the file path of the image type list 602 (/root/a/share/image_type in FIG. 6). Refer to file 602. Then, it is compared with the latest suitable data format and size set for each cooperative application, and if there is a difference, it is determined that there is a change.

The above is the description of the data sharing location 500 .

Next, the image type list will be described with reference to FIG. 6(b). FIG. 6B shows an example of the image type list 602. FIG. The image type list consists of an application ID 651 , an array 652 of suitable data format and size pairs, and an application name 656 . The application ID 651 is an application-specific ID recorded in the HDD 204 when the application is installed in the communication device 101 . The application name 656 is a character string indicating the name of the application. In the image type list, the data format and size suitable for the application are expressed in combination. For example, a set of data format and size suitable for application 653 with an application ID of 0x41 indicates that large size RAW and small size JPEG. Here, in this embodiment, as shown in FIG. 6B, as the size, one of Large (large size), Small (small size), and Anything (any size is allowed) is specified. there is The above is the description of the image type list.

In this embodiment, the image type list indicates a set of data formats and sizes "suitable" for each application (for example, Read-app). You may make it show the set of. For example, a set of data formats and sizes that each application does not support may be listed as "unsuitable" image types.

In this embodiment, one of three values (Large, Small, Anything) is set as the size. You may make it

Further, when the communication device 101 operates according to Read-app, among the data stored in the HDD 204 , data that does not satisfy the condition indicated by the image type is not processed and is not read from the HDD 204 . Further, when an instruction is received from the HDD 204 to process data that does not satisfy the condition indicated by the image type, a warning message may be displayed on the display device 211 .

Returning to the description of the sequence in FIG. 5 again.

Then, in T503, if the CPU 201 determines that the Read-app image type list 602 does not exist in the data sharing location 500, or that the Read-app image type list 602 exists and has been changed, then T504, T505 to run.

At T504, the CPU 201 generates an image type list based on the suitable data format and size set in Read-app. At T505, the image type list generated at T504 is written to the data sharing location 500 in association with the unique ID of the Read-app.

At this time, if it is determined in T503 that the Read-app image type list 602 does not exist in the data sharing location 500, the list generated in T504 is associated with the unique ID of Read-app and the writing is executed. . On the other hand, if it is determined in T503 that the image type list 602 exists in the data sharing location 500 and that there is a change, the existing image type list associated with the unique ID of the Read-app generated in T504. Overwrite save with image type list.

In T506, the CPU 201 detects that the user has pressed the cooperation button displayed on the Read-app. In the example shown in FIG. 7B, the "add photo from Write-app button" 702 corresponds to the cooperation button.

In T507, the CPU 201 detects that the user has pressed the cooperation button, and transmits to the OS a request to start Write-app by Read-app. At this time, the application ID of Read-app is included in the activation request as information indicating the source of the request for cooperation, and the CPU 201 stores the received application ID of Read-app in the RAM 203 . In T508, the CPU 201 receives a write-app activation request from the OS. In this embodiment, the activation request includes the application ID of Read-app in the activation request, but the activation request is not limited to this. For example, the application ID of the Read-app is stored in a temporary location of the HDD 204 as information indicating the link request source, and the path to the storage destination is included in the Write-app activation request and sent to the OS. good too. Then, the CPU 201 stores the Read-app application ID acquired according to the path in the RAM 203 .

Subsequently, in T509, the CPU 201 activates Write-app. When started, the Write-app screen shown in FIG. 8(a) is displayed. As shown in FIG. 8A, when Write-app is activated for the purpose of cooperation in accordance with a request from Read-app, CPU 201 transitions Write-app to cooperation mode. Note that if the Write-app has already started and is operating in the background, the CPU 201 switches the Write-app to the foreground operation and causes it to operate in cooperation mode. Then, while the Write-app is operating in the cooperation mode, the status bar 801 is displayed to inform the user of this fact. When the Write-app operates in the cooperation mode, the Write-app is intended to give priority to the operation of capturing an image in the imaging device 102. Therefore, as shown in FIG. It is limited to the guide function of and the image list function in the camera. On the other hand, when the user simply starts Write-app in the normal mode, all the functions shown in FIG. 8(a) can be used, and the UI is displayed accordingly. Note that when it is detected that the user presses the cancel button 802, the CPU 201 cancels the write-app cooperative mode and shifts to the normal mode operation.

The above is the cooperation start phase.

Next, the connection phase from T510 to T516 will be described.

In T510, when the imaging device 102 sets the communication mode to ON in response to the user's operation of the imaging device 102, in T511, the imaging device 102 activates the access point function.

Subsequently, in T512, the communication device 101 connects to the access point of the imaging device 102 in response to the user's operation of the communication device 101. FIG.

In T513, the CPU 201 receives notification from the OS that the imaging device 102 has been detected in Write-app, and transmits a connection request to the imaging device 102 in T514.

In T515, the imaging device 102 authenticates the communication device 101, and the connection between the imaging device 102 and the communication device 101 is established.

At T516, the CPU 201 reads the Read-app application ID acquired at T508 from the RAM 203, and refers to the image type list of the data sharing location 500 based on the application ID. The CPU 201 acquires a set of data format and size suitable for Read-app (hereinafter sometimes referred to as image type) from the image type list and stores it in the RAM 203 .

The above is the connection phase. Although the case where the processing of T516 is performed at the timing when the connection with the imaging apparatus 102 is completed has been described, the present invention is not limited to this. For example, it may be the timing at which the Write-app is activated at T509, or the timing at which drawing update is performed at T520, which will be described later.

Next, the image storage phase from T517 to T527 will be described.

At T517, the CPU 201 detects that the image list button 803 in the camera in FIG. 8A is pressed.

In T518, the CPU 201 receives the button press event of T517, and requests attribute information corresponding to the captured image (original image or original data) recorded in the recording medium 410 of the imaging apparatus 102 via the NET I/F 209. and transmits it to the imaging device 102 . In this embodiment, a thumbnail image is used as the attribute information, but the attribute information is not limited to this, and may be, for example, a file name.

Also, the data formats of the original image and the attribute information may be the same or different. For example, if the original image and the thumbnail image are the same JPEG format still image file, or if the original image is an MP4 format video file and the attribute information is a JPEG format still image file extracted from the video file. There is In this embodiment, regardless of whether the data format of the original image is compatible with the Read-app, at least the data format of the attribute information (thumbnail image) of the original image can be compatible with the Write-app.

In T519, the CPU 201 receives the thumbnail images and information indicating the data formats that can be provided from the original images corresponding to the respective thumbnail images from the imaging device 102 via the NETI/F 209, and stores them in the HDD 204. For example, even if the thumbnail image is in JPEG format, if the data format of the corresponding original image is RAW format, the control unit 401 of the imaging device 102 sends the RAW format data of the original image to the communication device 101 as it is. It is possible to send On the other hand, it is also possible to convert the original image from the RAW format to the JPEG format and send it to the communication device 101 . At this time, the control unit 401 notifies the communication device 101 of RAW and JPEG as data formats that can be provided from the original image. In this embodiment, the imaging apparatus 102 is described as being capable of performing size conversion regardless of the data format of the original image, but the present invention is not limited to this. For example, the imaging device 102 may also send information on sizes that can be provided from the original image to the communication device 101 . At this time, the data format and size that can be provided from the original image may be paired and sent to the communication device 101 .

In T520, the thumbnail images saved in the HDD 204 are read and displayed on the display device 211. FIG. At this time, the UI shown in FIG. 8B is displayed on Write-app.

Note that steps T518 to T520 are repeatedly executed for the thumbnail images displayed in the drawing area of the display device 211. FIG. That is, every time the display range is scrolled up and down by the user, T518 to T520 are repeatedly executed for a newly drawn thumbnail image.

At T521, the CPU 201 detects that the user presses the selection button 804 in FIG. 8B.

At T522, the CPU 201 shifts the Write-app to the selection mode operation and updates the screen display. At this time, the Write-app displays a thumbnail image list screen in which a plurality of thumbnail images are arranged, as shown in FIG. 8(c).

At this time, if the image capturing apparatus 102 cannot provide an image in a data format suitable for Read-app from the original image, the corresponding thumbnail image may be displayed in such a manner that the fact is identifiable. At this time, the CPU 201 refers to the data format of the Read-app image type list stored in the RAM 203 at T516, and compares it with the data format that can be provided from the original image corresponding to each thumbnail image received at T519. As a result of collation, the CPU 201 controls to display thumbnail images corresponding to original images that cannot be provided in a data format suitable for Read-app with diagonal lines 805 superimposed thereon, as shown in FIG. 8C. As a result, each thumbnail image is displayed so that it can be identified whether the data format of the original image can be handled by Read-app.

If the user selects a thumbnail image superimposed with diagonal lines 805, the CPU 201 displays a warning dialog 808 indicating that the selected image is not supported by Read-app, as shown in FIG. 8D. display. Information about the selected thumbnail image is not added to the save-planned image list.

On the other hand, when the user selects a thumbnail image of an original image that can be provided in a data format suitable for Read-app, as shown in FIG. is displayed on the thumbnail image. Then, the CPU 201 compares the data format included in the Read-app image type list stored in the RAM 203 in T516 with the data format that can be provided from the original image corresponding to each thumbnail image received in T519. Decide what data format and size should be saved. Then, the CPU 201 associates the information about the selected thumbnail image with the data format and size (image type) to be saved, adds it to the list of images to be saved, makes it readable from the Write-app, and saves it in the RAM 203 . .

For example, if the Read-app is the application 653 in FIG. 6B, and an original image that can be provided in JPEG format and a corresponding thumbnail image are selected, the CPU 201 saves the thumbnail image in JPEG format in Small size. is determined, and linked with the information on the thumbnail image, and added to the image list to be saved.

Here, when the thumbnail image is selected by the user, if the imaging device 102 can provide the image in a plurality of data formats suitable for Read-app from the original image, the user can select one of the data formats. make it At this time, the CPU 201 refers to the data format included in the Read-app image type list stored in the RAM 203 at T516, and compares it with the data format that can be provided from the original image corresponding to each thumbnail image received at T519. do. As a result of checking, if the data can be saved in a plurality of data formats suitable for Read-app, as shown in FIG. indicate.

For example, if Read-app is the application 653 in FIG. 6B, data formats suitable for Read-app are RAW format and JPEG format. On the other hand, when a thumbnail image whose original image is in RAW format is selected in Write-app, the imaging device 102 can provide image data in either RAW format or JPEG format. At this time, the CPU 201 displays a format selection dialog 809 shown in FIG. 8(e). When the data format for saving the original image is determined in the format selection dialog 809, the CPU 201 checks the data format of the Read-app image type list stored in the RAM 203 in T516 against the determined data format, Determine the image type to be saved. Then, the CPU 201 associates the information about the selected thumbnail image with the image type to be saved, adds it to the save-planned image list, and saves it in the RAM 203 so that it can be read from the Write-app.

Similarly, when a thumbnail image is selected by the user, the original image can be provided in a data format suitable for the Read-app, and the Read-app allows multiple sizes in that data format. may allow the user to select either size. At this time, the CPU 201 refers to the data format included in the Read-app image type list stored in the RAM 203 at T516, and compares it with the data format that can be provided from the original image corresponding to each thumbnail image received at T519. do. As a result of checking, if it is determined that the data format suitable for Read-app can be provided, the size corresponding to the data format is confirmed in the image type list. Then, when it is determined that multiple sizes are allowed, a size selection dialog 810 is displayed to prompt the user to select which size to save in, as shown in FIG. 8(f).

For example, if Read-app is application 655 whose application ID is 0x9F in FIG. 6B, an image suitable for Read-app is JPEG format and size Anything (any size is allowed). At this time, when a thumbnail image whose original image is in JPEG format is selected in Write-app, the CPU 201 displays a size selection dialog 810 shown in FIG. 8(f).

When the user determines the size of the image to be saved in the size selection dialog 810, the CPU 201 associates information about the selected thumbnail image with the image type to be saved, adds it to the list of images to be saved, and performs Write. - Store in the RAM 203 so that it can be read from the app. Although the format selection dialog shown in FIG. 8(e) and the size selection dialog shown in FIG. 8(f) are displayed independently, the data format and size may be selected on one screen. .

When the CPU 201 detects in T523 that the user has pressed the save start button 807 shown in FIG. A data request for transmitting an original image that satisfies the conditions of (1) is transmitted to the imaging apparatus 102 via the NETI/F 209 .

Also, at this time, the CPU 201 performs control to switch the display from the screen of FIG. 8(c) to a screen as shown in FIG. 9(a).

In T525, the imaging device 102 performs conversion processing on the original image as necessary. For example, when an image in JPEG format is requested for an original image in RAW format in T524, the imaging apparatus 102 extracts the JPEG image from the image file of the original image in RAW format, and includes the JPEG image. Perform processing to acquire image files. Furthermore, for example, in T524, when a JPEG image in Small size is requested, the imaging apparatus 102 also performs processing to resize the extracted JPEG image to a default Small size (for example, a size within 640×480).

At T526, the CPU 201 receives the image of the suitable data format and size requested at T524 from the imaging device 102 via the NETI/F 209. FIG. Here, the thumbnail image has a lower resolution and a smaller data size than the original image or an image of a data format and size that can be provided from the image. Therefore, when displaying the “list of images in the camera”, thumbnail images can be received from the imaging device 102 and displayed on the display device 211 promptly. Then, when an image having a suitable data format and size, which is larger in data size than the thumbnail image, is captured from the imaging device 102, only the original image corresponding to the thumbnail image selected by the user is read-app-suitable. Request to send in data format and size. As a result, it is possible to receive only the necessary original images, and furthermore, only the images of the data format and size suitable for Read-app, thereby reducing the communication load.

When the reception of the image in the data format and size suitable for Read-app is completed, in T527, the CPU 201 saves the image by Write-app. That is, the CPU 201 saves the image file of the suitable data format and size received in T526 in the HDD 204 or the like, and assigns an image ID to the newly saved image in T528. The image ID will be described as a code associated with the file path of the save destination in the process of T527. Note that the image ID may be the file path of the save destination.

From the request for an image of suitable data format and size at T524, conversion processing of the original image at T525, image reception processing at T526, image storage processing at T527, and suitable data format and size at T528. The processing up to issuing an image ID for an image of the size is repeated for the number of thumbnail images selected by the user. While performing this series of image saving processes, the CPU 201 displays a saving progress screen shown in FIG. 9A on the display device 211 .

The above is the image storage phase. In this embodiment, a case where a predetermined mark such as a slanted line is displayed near the thumbnail image for an original image that cannot be provided by the imaging apparatus 102 in a data format suitable for Read-app in T522 has been described. not limited to For example, thumbnail images corresponding to original images that cannot be provided in a suitable data format may not be displayed on the thumbnail list screen in the selection mode. Alternatively, conversely, the mark may be displayed in the vicinity of the thumbnail image of the original image in the data format supported by Read-app.

Next, the cooperation end phase from T529 to T532 will be described.

As described in T524 to T528, when the saving process of all the images corresponding to the thumbnail image selected by the user is finished, the CPU 201 displays the saving completion screen shown in FIG. 9B on the display device 211. When detecting that the user has pressed the close button 901, the CPU 201 returns to display of the image list screen in the camera shown in FIG. As a result, sharing of the original image captured this time with Read-app can be stopped.

On the other hand, when detecting that the user has pressed the return to Read-app button 902 on the saving completion screen shown in FIG. 9A, the CPU 201 starts the process of T529. In T529, the CPU 201 performs image ID list generation processing. Specifically, first, in the Write-app, an image ID list is generated in which the image IDs of the images of the suitable data format and size saved in T528 are associated with the save destination, and made readable from the OS. Store in HDD 204 . As a result, Read-app can acquire the image ID list from the OS at T532 described later, and the original image can be acquired according to the image ID list and used for Read-app processing.

At T530, the CPU 201 transmits to the OS a request to activate Read-app by Write-app. At this timing, the CPU 201 causes the Write-app to cancel the linked mode and switch to the normal mode for operation. Specifically, the CPU 201 removes the restrictions on the functions that can be used, updates the display so that the functions that were restricted in FIG. 8A can be selected, and returns to the normal mode state.

Subsequently, at T531, the CPU 201 issues an activation request from the OS to Read-app to activate Read-app. In addition, in the example shown in FIG. 5, Read-app is running in the background even after performing the process of T507, so in the process of T530, the CPU 201 switches Read-app to the foreground operation. . Note that the CPU 201 may temporarily stop activation of Read-app after performing the process of T507, and restart Read-app in response to the activation request of T530.

Then, at T532, the CPU 201 receives the image ID list generated by the Write-app at T528 via the OS through the Read-app.

Based on the image ID list obtained in Read-app, the CPU 201 obtains an image of a suitable data format and size from the HDD 204, adds it to the list display screen of the Read-app, and displays it. For example, when "Add photos from Write-app" is selected on the screen shown in FIG. Images of the appropriate data format and size obtained from device 102 and corresponding thumbnail images are additionally displayed.

As described above, according to this embodiment, the Write-app linked from the Read-app receives the original image in a data format and size suitable for the Read-app when capturing the image in the imaging device 102. and save it.

For example, for an original image in a data format not suitable for Read-app, when a list of thumbnail images corresponding to the original image in the imaging device 102 is displayed by Write-app, the corresponding original image in the incompatible data format is displayed. It is displayed so that it can be identified whether it is a thumbnail image or not.

As a result, when the Write-app is activated for the purpose of performing image editing processing in the Read-app and the original image is captured from the imaging device 102, the condition of the appropriate data format and appropriate size indicated by the image type information. Since the original image converted so as to satisfy the condition is captured, unnecessary original images are not captured, and wasteful communication traffic can be avoided. In addition, since it is clearly visible on the thumbnail image list screen of the Write-app that it is an original image that cannot be handled by the Read-app, the user will not select an inappropriate image, improving usability. improves.

Further, in the present embodiment, the description has been given assuming that the resizing process of the original image is performed by the imaging device 102, but the present invention is not limited to this. For example, after receiving an original image that has not been subjected to resizing processing from the imaging device 102, the CPU 201 may resize the original image to a size suitable for Read-app in Write-app processing. According to this, regardless of the capability of the imaging device 102, an image of a size suitable for Read-app can be saved. Further, when information about whether resizing processing is possible is received from the imaging device 102 and resizing to a size suitable for the Read-app is not possible, the Write-app may display a thumbnail image corresponding to the original image in an identifiable manner.

Also, in the image type list described with reference to FIG. 6B in this embodiment, each item in the array 652 included in the image type list may be prioritized and stored. For example, priority may be given to image types that are placed earlier in array 652 . In this case, it can be interpreted that the application 653 in FIG. 6B is most suitable for importing images in the large-size RAW format, but on the other hand, it can also handle the small-size JPEG format. Also, for the application 654 whose application ID is 0x53, it is most suitable to capture an image in the JPEG format in a small size, followed by a large size in the JPEG format, and then a small size in the TIFF format. can be interpreted as By prioritizing the image type list, it is possible to save the original image in a more suitable data format and size and provide the image data to the application. In addition, by automatically determining the data format and size according to the priority, the user's manual operation load in the format selection dialog and size selection dialog as described in FIGS. 8(e) and 8(f) can be reduced.

Also, in the present embodiment, the case where both the data format and size suitable for Read-app are determined has been described, but only one of them is determined and the original image is converted so as to satisfy the determined conditions. may be received from the imaging device.

Also, in the present embodiment, a case has been described in which the imaging apparatus 100 converts the original image so as to satisfy the conditions indicated by the image type. Alternatively, the imaging apparatus 100 may transmit the original image to the communication device 101 without converting it. Then, the communication device 101 may operate according to the Write-app, convert the original image so as to satisfy the conditions indicated by the image type, make it readable by the Read-app, and store it in the HDD 204 . Here, the imaging device 100 may not transmit to the communication device 100 an original image that cannot be converted so as to satisfy the condition indicated by the image type. As a result, the original image that cannot be processed by Read-app is not transmitted from the imaging apparatus 100 to the communication device 101, and unnecessary transmission processing can be prevented. (Second embodiment)
In the first embodiment, the Read-app activates the Write-app, and the Write-app activates the Read-app as a response. However, the present invention is not limited to this. For example, within the Write-app, the Read-app may be selected and activated according to the user's activation instruction. At this time, the CPU 201 confirms the image type list of the shared location, acquires from the imaging device 102 an image of a data format and size suitable for the Read-app that received the activation instruction, and delivers it. The flow of processing will be described below with reference to FIG.

FIG. 10 shows that, in this embodiment, after the CPU 201 of the communication device 101 activates the Write-app, the Read-app as a cooperation destination is determined by a user instruction, an image is acquired from an external device, and the acquired image is displayed. FIG. 10 is a sequence diagram for explaining a processing procedure for passing data to Read-app; The processing described below is realized by the CPU 201 of the communication device 101 activating the OS 301, the Write-app 302, and the Read-app 303, appropriately operating according to them, and controlling each unit. 10 have a lot in common with those in FIG. 5, the same numbers are given to the same processes, and descriptions thereof are omitted.

To simplify the explanation, the phases are divided into phases such as T501 to T1002 as a cooperation preparation phase, T510 to T515 as a connection phase, T517 to T527 as an image storage phase, and T528 to T531 as a cooperation end phase. do.

First, the processing of the cooperation preparation phase will be described. The image type list of Read-app is arranged in the data sharing location by the CPU 201 executing the processes from T501 to T505 described above. Note that the processing indicated by T501 to T505 need only be performed once prior to activation of Write-app, and need not be performed every time prior to activation of Write-app.

Next, in T1001, the CPU 201 accepts a write-app activation request by the user's operation.

Subsequently, at T1002, the processing is started by the CPU 201 activating Write-app in response to the activation request at T1001. Here, unlike T509, Write-app is not activated by a call from Read-app in T1002. Therefore, in T1002, the CPU 201 causes the Write-app to operate in the normal mode and displays the Write-app screen shown in FIG. 11(a). That is, on the screen shown in FIG. 11(a), the status bar indicating the cooperation mode displayed in FIG. 8(a) is not displayed, and a UI is displayed in which all functions are available.

Since the screen in FIG. 11 has many parts in common with those in FIG. 8, the same numbers are given to the same UI parts and the explanation is omitted.

Next, the connection between the imaging device 102 and the communication device 101 is established by the processing of the connection phase from T510 to T515.

Next, the image storage phase from T517 to T527 will be described.

When the CPU 201 detects in T517 that the image list button 803 in the camera in FIG. do. As a result, the UI shown in FIG. 11B is displayed on the Write-app. Here, FIG. 11(b) is a display example of the thumbnail image list screen when the Write-app is operated in the normal mode, and the status bar indicating the cooperation mode is not displayed.

At T521, the CPU 201 detects that the user presses the selection button 804 in FIG. 11(b).

In T1003, the CPU 201 refers to the image type list of the data sharing location 500, acquires a list of application names, and stores it in the RAM 203. FIG. Then, in T1004, the application name list acquired in T1002 is read from the RAM 203, and as shown in FIG. An application selection dialog 1101 is displayed.

In T1005, the CPU 201 detects that the user selects an application name and presses the OK button 1102 in the application selection dialog 1101 in FIG. 11C.

At T1006, the CPU 201 determines Read-app based on the application name selected by the user at T1005. Then, the CPU 201 refers to the image type list of the data sharing location 500 , acquires a suitable image type corresponding to Read-app, and stores it in the RAM 203 .

Subsequently, the CPU 201 performs the processes from T522 to T527 as described above, thereby receiving the image selected by the user in a data format and size suitable for Read-app from the imaging device 102, and transferring the image to the HDD 204 or the like in the communication device 101. can be saved to

Then, by the processing of the cooperation end phase from T528 to T532, the image saved in Write-app can be read out and edited in Read-app.

As described above, according to this embodiment, in Write-app, the user can select Read-app that uses an image, and when capturing an image in imaging device 102, a data format suitable for Read-app and It is possible to receive an image in size and save it.

As a result, when the user starts the Write-app, browses images, and wants to edit an image, he can select any application on the Write-app and select a data format and size suitable for the selected application. An image can be captured from the imaging device 102 . That is, when an original image is captured from the imaging device 102, unnecessary images that are undesirable for editing processing are not captured. Avoid traffic.

(Other embodiments)
In each of the above-described embodiments, the Write-app is an application used by the communication device 101 to capture an image from the imaging device 102, but the Write-app can also be used for applications other than that. can be applied. For example, as Write-app, an application that retrieves images from a database or an application that performs shooting processing may be applied. Further, in the above-described embodiment, the data to be handled is image data, but it is not limited to image data, and may be other data such as audio data.

In addition, in the above-described embodiment, the smartphone was described as an example of the communication device 101, but there is no particular limitation as long as it is a device on which an application can be installed. For example, the communication device 101 may be a mobile phone, a tablet, a personal computer (PC), or the like. Also, when Read-app and Write-app are applications that do not require a communication function, they do not necessarily have a communication function and can be implemented by a wide range of information processing apparatuses.

The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by processing to It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.

Claims (13)

An information processing device capable of installing a plurality of applications including a first application and a second application,
Acquisition means for acquiring type information indicating at least one of a data format and size suitable for the first application by operating according to the second application;
a first receiving means for receiving attribute information about original data held by an external device by operating according to the second application;
By operating according to the second application, it is possible to identify whether or not the external device can provide the original data that satisfies the conditions indicated by the type information, and the attribute of the original data held by the external device is made identifiable. display control means for controlling display of information on a screen;
data request means for requesting the original data satisfying the condition indicated by the type information from the external device by operating according to the second application;
An information processing apparatus comprising: second receiving means for receiving, from the external device, the original data that satisfies the conditions indicated by the type information by operating according to the second application. By operating according to the second application, the receiving means receives original data held by the external device that has been converted so as to satisfy conditions indicated by the type information, from the external device. The information processing apparatus according to claim 1, wherein: The apparatus further comprises storage means for making the original data satisfying the condition indicated by the received type information available to the first application and storing the original data in a storage medium by operating according to the second application. 3. The information processing apparatus according to claim 1, wherein: 4. The display control means performs control so as not to display on the screen attribute information corresponding to original data that cannot provide the original data that satisfies a condition indicated by the type information. The information processing device according to item 1. 5. The information processing apparatus according to claim 1, wherein said original data is an image, and said attribute information is a thumbnail image corresponding to said image. 6. The attribute information has a data format compatible with the second application regardless of whether the original data has a data format that satisfies the condition indicated by the type information. The information processing device according to any one of . if the external device can provide the original data in a plurality of data formats or a plurality of sizes suitable for the first application among the conditions indicated by the type information, 7. The information processing apparatus according to any one of claims 1 to 6, further comprising selection means for selecting one of them. 8. The information processing apparatus according to any one of claims 1 to 7, further comprising means for writing said type information into a predetermined storage area readable and writable by said second application. 9. The information processing apparatus according to claim 1, further comprising communication means that operates according to said second application and establishes communication with said external device. An information processing device capable of installing a plurality of applications including a first application and a second application,
Acquisition means for acquiring type information indicating at least one of a data format and size suitable for the first application by operating according to the second application;
a first receiving means for receiving attribute information about original data held by an external device by operating according to the second application;
if the external device can provide the original data in a plurality of data formats or a plurality of sizes suitable for the first application among the conditions indicated by the type information, a selection means for selecting one of the
data request means for requesting the original data satisfying the condition indicated by the type information from the external device by operating according to the second application;
An information processing apparatus comprising: second receiving means for receiving, from the external device, the original data that satisfies the conditions indicated by the type information by operating according to the second application. A control method for an information processing device capable of installing a plurality of applications including a first application and a second application, comprising:
obtaining type information indicating at least one of a data format and size suitable for the first application by operating in accordance with the second application;
receiving attribute information about original data held by an external device by operating in accordance with a second application;
By operating according to the second application, it is possible to identify whether or not the external device can provide the original data that satisfies the conditions indicated by the type information, and the attribute of the original data held by the external device is made identifiable. controlling information to be displayed on a screen;
requesting the external device for the original data that satisfies the condition indicated by the type information by operating according to the second application;
A control method comprising the step of receiving, from the external device, the original data that satisfies a condition indicated by the type information by operating according to the second application. A control method for an information processing device capable of installing a plurality of applications including a first application and a second application, comprising:
obtaining type information indicating at least one of a data format and size suitable for the first application by operating in accordance with the second application;
receiving attribute information about original data held by an external device by operating in accordance with the second application;
if the external device can provide the original data in a plurality of data formats or a plurality of sizes suitable for the first application among the conditions indicated by the type information, selecting each one of
requesting the external device for the original data that satisfies the condition indicated by the type information by operating according to the second application;
A control method comprising the step of receiving from the external device the original data that satisfies a condition indicated by the type information by operating according to the second application. A program that causes a computer to function as each means of the information processing apparatus according to any one of claims 1 to 10.

Images