JP2019135874A - Communication program - Google Patents

Abstract

To provide a communication program in which information can be notified in a method suitable for a program to be executed in a foreground.SOLUTION: A communication program allows a mobile terminal to execute: communication processing (S13&S14) for communicating with an external device through a communication section; first determination processing (S15) for determining whether or not the communication program is executed in a foreground or background; first notification processing (S20) for notifying termination of the communication processing using a first notification method, in accordance with execution of the communication program in the foreground (S15:NO); acquisition processing (S16) for acquiring target identification information indicative of a target program, in accordance with execution of the communication program in the background (S15:YES); selection processing (S17) for selecting a second notification method corresponding to the target identification information; and a second notification processing (S18) for notifying termination of the communication processing using a second notification method.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a communication program executed by a mobile terminal capable of executing a plurality of programs in parallel.

  Conventionally, portable terminals capable of so-called multi-thread processing for executing a plurality of programs in parallel are known. Multi-thread processing is to execute a plurality of programs in a pseudo manner by switching the processing of each program at short time intervals. In addition, the mobile terminal executes one of a plurality of programs executed in parallel in the foreground, and executes other programs in the background.

  Foreground is a state in which, for example, a screen resulting from the execution of the program is displayed in the main display area of the display. More specifically, the foreground may be a state in which the execution result is reflected in the display of the main display area of the display when the program executes an API for displaying an image on the display. On the other hand, the background is a state in which, for example, a screen resulting from execution of a program different from the program is displayed in the main display area of the display.

  In addition, as an example of a program executed on such a portable terminal, Patent Document 1 describes a program (hereinafter referred to as a “scan program”) that transmits a scan instruction to a scanner and receives scan data from the scanner. ) Is described. In response to receiving the scan data, the scan program displays a screen for prompting a user operation for designating a storage destination of the scan data on the display, and stores the scan data in the storage destination received from the user.

  In such a scan program, it may take a certain amount of time from transmission of a scan instruction to completion of reception of scan data. Therefore, the user of the mobile terminal may cause a program different from the scan program to be executed in the foreground after the scan instruction is transmitted. As a result, the scan program is executed in the background. Even in this case, it is desirable that the scan program informs the user that the reception of the scan data is completed.

JP 2012-203249 A

  However, the mobile terminal can execute various programs such as a video playback program, an audio playback program, or a game program. For this reason, when the scan program is executed in the background, notification of completion of reception of the scan data by a uniform method may cause a problem. Specifically, the user may not be aware of the notification, or the user may feel that the notification is in the way.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a communication program capable of notifying information by a method suitable for a program executed in the foreground.

  (1) The communication program described in this specification includes a display unit, a communication unit, and a notification unit, and can be read by a portable terminal that can execute a plurality of programs in parallel. The display unit also serves as at least a part of the notification unit. The communication unit can communicate with an external device that processes content data. The notification unit can be notified by the notification method selected from a plurality of notification methods. The communication program determines whether the communication program is executed in the foreground or the background, and a communication process for communicating with the external device through the communication unit in order to cause the external device to process the content data. The portable terminal is caused to execute a first determination process. The foreground is a state in which a screen based on the execution of the program is displayed in the display area of the display unit. The background is a state in which a screen based on execution of the program different from the program is displayed in the display area of the display unit. The communication program uses the first notification method to notify that the communication process has ended in response to determining in the first determination process that the communication process has ended and that the communication program is being executed in the foreground. The portable terminal is caused to execute a first notification process to be notified to the notification unit. The communication program includes a plurality of pieces of program identification information each identifying the program in response to the first determination process determining that the communication process is completed and the communication program is being executed in the background. Among them, the portable terminal is caused to execute an acquisition process for acquiring target identification information that is the program identification information indicating the target program. The target program is the program being executed in the foreground. The communication program includes a selection process for selecting, as a second notification method, the notification method corresponding to the target identification information acquired in the acquisition process among the plurality of notification methods, and that the communication process is completed. The portable terminal is caused to execute a second notification process for causing the notification unit to notify the second notification method.

  According to the said structure, the completion | finish of a communication process can be alert | reported with the alerting | reporting method suitable for the object program currently performed in the foreground. As a result, it is possible to improve the possibility that the user who is paying attention to the target program will notice the notification, and to reduce the possibility that the notification will be disturbed. The communication processing is, for example, processing for recording an image indicated by image data in a recording device, processing for receiving image data generated by a reading device, or converting the format of content data to a server, and converting the processing. Including processing for receiving content data.

  (2) Preferably, the portable terminal includes a plurality of input / output units for outputting information or receiving input of information. The display unit also serves as at least a part of the input / output unit. The communication program causes the portable terminal to execute a second determination process for determining a usage status according to the target program for each of the plurality of input / output units, and the usage status determined by the second determination process in the acquisition process The program identification information corresponding to is acquired as the target identification information.

  In recent years, an extremely large number of programs have been provided for mobile terminals, so it is not practical to associate a notification method with all programs in advance. Therefore, according to the above configuration, since the type of the target program can be estimated based on the usage status of the input / output unit, it is possible to notify the end of the communication process by a method suitable for the target program.

  (3) For example, the portable terminal includes a speaker that outputs sound. The speaker also serves as at least a part of the notification unit and the input / output unit. The display unit can be switched between a full screen mode in which an image instructed by the program is displayed in the entire display area and a partial screen mode in which the image is displayed in a part of the display area. The program identification information identifies the type of the program. Then, in the acquisition process when the second determination process determines that the display unit is used in the full screen mode, the communication program uses the program identification information indicating the video reproduction program as the target identification. Obtain as information.

  (4) As an example, in the selection process, the communication program selects, as the second notification method corresponding to the video reproduction program, a method of causing only the speaker of the display unit and the speaker to be notified. In the second notification process, a notification sound that notifies the end of the communication process is output to the speaker.

  The user who is executing the video playback program in the foreground has a high possibility of paying attention to the video displayed on the display unit of the mobile terminal. In such a case, if the notification is performed through the display unit, the user may feel that the notification is in the way, so it is desirable to notify through the speaker.

  (5) As another example, the communication program selects, as the second notification method corresponding to the video reproduction program, a method of displaying a message on a peripheral portion of a display area of the display unit in the selection process. In the second notification process, a message for notifying the end of the communication process is displayed on the peripheral portion of the display area on the display unit.

  The user who is executing the video playback program in the foreground has a high possibility of paying attention to the video displayed on the display unit of the mobile terminal. Therefore, performing notification through the display unit increases the possibility that the user will notice the notification. Moreover, by displaying a message on the peripheral edge of the display unit, it is possible to reduce the possibility that the user feels that the notification is in the way.

  (6) For example, the portable terminal includes a speaker that outputs sound. The speaker also serves as at least a part of the notification unit and the input / output unit. The program identification information identifies the type of the program. Then, the communication program acquires the program identification information indicating the audio reproduction program as the target identification information in the acquisition process when it is determined in the second determination process that the speaker is used.

  (7) For example, in the selection process, the communication program selects, as the second notification method corresponding to the sound reproduction program, a method of outputting a notification sound together with the sound output by the target program to the speaker. In the second notification process, the volume of the sound output by the target program is reduced by the speaker, and the notification sound that notifies the end of the communication process is output.

  The user who is executing the audio reproduction program in the foreground has a high possibility of paying attention to the audio output from the speaker of the mobile terminal. Therefore, performing notification through the speaker increases the possibility that the user will notice the notification. Moreover, the possibility that the user notices the notification sound can be further increased by reducing the volume of the sound output by the sound reproduction program during the notification process.

  (8) For example, the mobile terminal includes an operation unit that receives a user operation. The operation unit also serves as at least a part of the notification unit. The program identification information identifies the type of the program. The communication program acquires the program identification information indicating a game program as the target identification information in the acquisition process when the second determination process determines that the use frequency of the operation unit is equal to or greater than a threshold value. To do.

  (9) For example, in the selection process, the communication program selects, as the second notification method corresponding to the game program, a method of popping up a message below the display area of the display unit, and the second notification In the processing, a message notifying the end of the communication processing is displayed in a pop-up on the display unit.

  A user who is executing a game program in the foreground has a high possibility of paying attention to the game video displayed on the display unit of the mobile terminal. In addition, in games that require real-time performance, a moving game image is often displayed at the top and center of the display area, and static information such as status is often displayed at the bottom of the display area. Therefore, by displaying a message in the lower part of the display area of the display unit as in the above configuration, the notification can be noticed to the user, and the possibility that the user feels the notification is disturbing can be reduced.

  (10) For example, the mobile terminal includes a storage unit. The storage unit stores the program identification information and the usage status of each of the plurality of input / output units associated with the program identification information. Then, in the acquisition process, the communication program acquires the program identification information associated with the usage status determined in the second determination process as the target identification information.

  (11) Preferably, the portable terminal includes a storage unit. The storage unit stores the program identification information and the notification method associated with the program identification information. Then, the communication program acquires the target identification information from the OS of the mobile terminal in the acquisition process, and the notification method associated with the target identification information in the selection process is changed to the second notification method. Choose as.

  By registering in advance the identification information of a typical program installed in many portable terminals and the notification method associated with the identification information as in the above configuration, the method is suitable for the program. The end of the communication process can be notified.

  (12) Preferably, the portable terminal includes an operation unit that receives a user operation. The communication program includes a first reception process for accepting a user operation for designating the program identification information and the notification method through the operation unit, and the program identification information and the notification for which designation is received in the first reception process. And causing the portable terminal to execute a first storage process in which a method is associated and stored in the storage unit.

  According to the said structure, the alerting | reporting method matched with identification information can be customized according to a user preference.

  (13) Preferably, the portable terminal includes a plurality of input / output units that output information or receive input of information. The display unit and the operation unit also serve as at least a part of the input / output unit. The communication program causes the mobile terminal to execute a third determination process for determining whether or not the target identification information associated with the method method is stored in the storage unit, and the target identification information is stored. In the selection process when it is determined in the third determination process, the notification method associated with the target identification information is selected as the second notification method, and the target identification information is not stored. In the acquisition process when the determination is made in the third determination process, the portable terminal is caused to execute a fourth determination process for determining the usage status of the target program for each of the plurality of input / output units, and the fourth determination The program identification information corresponding to the usage status determined in the process is acquired as the target identification information.

  According to the above configuration, even when a target program for which no program identification information is registered is executed in the foreground, the end of the communication process can be notified by a method suitable for the target program.

  (14) Preferably, the portable terminal includes a voice communication unit that transmits and receives voice data to and from an external device through a telephone line. Then, the communication program causes the portable terminal to execute a fifth determination process for determining whether the audio data is being transmitted / received by the audio communication unit. Then, the communication program causes the portable terminal to wait for execution of the second notification process in response to the determination in the fifth determination process that the audio data is being transmitted / received, and the audio data is being transmitted / received Otherwise, the second notification process is executed by the portable terminal in response to the determination in the fifth determination process.

  According to the above configuration, it is possible to prevent the notification of the end of the communication process from interfering with the call.

  (15) Preferably, the mobile terminal includes a speaker that outputs sound. The speaker also serves as at least a part of the notification unit. The speaker can be switched between a permission mode in which sound output is permitted and a restriction mode in which sound output is restricted. The communication program causes the portable terminal to execute a sixth determination process for determining whether the speaker is in the permission mode or the restriction mode. Then, the communication program causes the speaker to output a notification sound in the second notification process when the sixth determination process determines that the permission mode is set.

  (16) More preferably, the portable terminal includes a mounting portion on which an external speaker can be mounted. The mounting part also serves as at least a part of the notification part. The communication program causes the portable terminal to execute a seventh determination process for determining whether or not the external speaker is attached to the attachment unit. The notification sound indicating the notification sound in the second notification process when it is determined in the sixth determination process that it is the restriction mode and the seventh determination process determines that the external speaker is attached. A signal is output to the external speaker through the mounting portion.

  (17) More preferably, the mobile terminal includes a vibrator that vibrates the mobile terminal. The vibrator also serves as at least a part of the notification unit. In the second notification process when the communication program determines that the restriction mode is in the sixth determination process, and the seventh determination process determines that the external speaker is not attached, The portable terminal is vibrated by a vibrator.

  According to each of the above configurations, the output destination of the notification sound can be changed in accordance with the state of the mobile terminal. In the so-called manner mode, the end of the communication process can be notified by vibration instead of the notification sound.

  (18) Preferably, the OS of the mobile terminal displays a switching object on the display unit in response to the communication program being switched from the foreground to the background. The switching object is an image for accepting a user operation instructing to execute the communication program in the foreground. Then, in the notification process, the communication program causes the notification unit to output a message that prompts the user operation on the switching object.

  According to the above configuration, it is possible to prompt the user to start processing to be executed after communication processing in the program.

  (19) For example, the mobile terminal includes an operation unit that receives a user operation. The communication process is a process of receiving the content data from the external device. The communication program receives a user operation for designating a storage destination of the content data received in the communication process through the operation unit in response to switching to the foreground after execution of the notification process. And the second storage process of storing the content data in the storage destination received in the second reception process.

  (20) For example, the first notification method is a method of switching the screen displayed in the display area of the display unit to a screen that notifies the end of the communication process.

  (21) For example, the notification method that can be selected in the selection process includes the same notification method as the first notification method.

  ADVANTAGE OF THE INVENTION According to this invention, the completion | finish of a communication process can be alert | reported with the alerting | reporting method suitable for the object program currently performed in the foreground.

FIG. 1 is a schematic diagram of a communication system 100 according to the present embodiment. 2A is a functional block diagram of the multifunction device 10, and FIG. 2B is a functional block diagram of the portable terminal 50. FIG. 3 shows an example of information stored in the data storage area 62B, where (A) shows a program ID list and (B) shows a notification method list. FIG. 4 is an example of a usage status list stored in the data storage area 62B. FIG. 5 is a flowchart of the image reading process. FIG. 6 is a flowchart of the acquisition process. FIG. 7 is a flowchart of the notification process. FIG. 8 is a display example of the display unit 53, where (A) shows a scan instruction screen and (B) shows a save destination designation screen. 9A and 9B are display examples of the display unit 53, where FIG. 9A shows a playback screen and FIG. 9B shows a playback screen on which a pop-up message is superimposed. FIG. 10 is a display example of the display unit 53, where (A) is an example of a music playback screen, and (B) is an example of a game screen. FIG. 11 is a display example of the display unit 53, where (A) is an example of an SNS screen, and (B) is an example of a notification method editing screen.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it is needless to say that the embodiment of the present invention can be changed as appropriate without departing from the gist of the present invention.

  FIG. 1 is a schematic diagram of a communication system 100 in the present embodiment. A communication system 100 shown in FIG. 1 includes a multifunction device 10, a portable terminal 50, and a server 70. However, one of the multifunction machine 10 and the server 70 can be omitted. The multifunction machine 10, the portable terminal 50, and the server 70 can communicate with each other through a communication network. Although the specific example of a communication network is not specifically limited, For example, the internet 101, wired LAN (abbreviation of Local Area Network), wireless LAN102, or these combination may be sufficient.

  The multifunction machine 10 and the portable terminal 50 belong to the wireless LAN 102 as shown in FIG. The wireless LAN 102 is connected to the Internet 101 through a router (not shown). Note that “belonging to the wireless LAN 102” means that settings for belonging to the wireless LAN 102 have been made and communication with other devices belonging to the wireless LAN 102 is possible. More specifically, the same SSID as that of the access point 102 </ b> A of the wireless LAN 102 is set in the multifunction device 10 and the portable terminal 50, and a network address assigned to the wireless LAN 102 is given.

  Note that wireless communication is not limited to wireless communication being performed in the entire communication section. That is, “the MFP 10 wirelessly transmits or receives information or data via the access point 102A” only needs to be able to execute wireless communication between the MFP 10 and the access point 102A. The same applies to the portable terminal 50.

  The server 70 is connected to the Internet 101. The multifunction device 10 and the portable terminal 50 can communicate with the server 70 via the Internet 101 from the access point 102A and a router (not shown). Furthermore, the portable terminal 50 may be connected to the Internet 101 through a base station (not shown). The portable terminal 50 may be able to wirelessly communicate with the server 70 from the base station via the Internet 101. A router and a base station (not shown) are examples of communication devices.

[Multifunction machine 10]
As shown in FIG. 2A, the multifunction machine 10 includes a printer unit 11, a scanner unit 12, a display unit 23, an operation unit 24, a communication unit 25, a CPU 31, a storage unit 32, and a communication unit. A bus 33 is mainly provided. Each component constituting the multi-function device 10 is connected to each other through a communication bus 33. The multifunction machine 10 is an example of an external device or an image forming apparatus that processes content data.

[Printer 11 and Scanner 12]
The printer unit 11 executes a recording process for recording an image indicated by the image data on a recording sheet. The recording paper is an example of a sheet or a recording medium. As a recording method of the printer unit 11, a known method such as an ink jet method or an electrophotographic method can be adopted. The scanner unit 12 executes a scan process for reading an image recorded on a document and generating image data. The multi-function device 10 may further include a FAX function for performing FAX transmission / reception, a copy function for reading an image recorded on a recording sheet and recording it on another recording sheet.

[Display unit 23]
The display unit 23 includes a display screen that displays various types of information. As the display unit 23, a liquid crystal display (abbreviation of Liquid Crystal Display), an organic EL display (abbreviation of Organic Electro-Luminescence Display), or the like can be adopted.

[Operation unit 24]
The operation unit 24 receives a user operation for selecting an object displayed on the display screen of the display unit 23. Specifically, the operation unit 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Further, the operation unit 24 may include a film-like touch sensor superimposed on the display screen of the display unit 23. That is, the display unit 23 may be configured as a touch panel display.

  The “object” refers to an image that can be selected by the user operating the operation unit 24. As an example, the object is a character string displayed on the display unit 23. One of the objects is highlighted when the direction key of the operation unit 24 is pressed, and the object is highlighted by pressing the enter button of the operation unit 24. A light-displayed object may be selected. As another example, an object when the operation unit 24 is a touch panel is an icon, a button, a link, or the like displayed on the display unit 23, and the object displayed at the touch position may be selected.

  The operation unit 24 realized as a touch panel receives a user operation for touching the display screen of the display unit 23. The operation unit 24 outputs position information indicating the position on the display screen touched by the user. The position information can be expressed, for example, as coordinates (x, y) on the xy plane with the upper left corner of the display screen as the origin, the right direction as the positive direction of the x axis, and the downward direction as the positive direction of the y axis. For the touch sensor, a known method such as a capacitance method or a resistance film method can be adopted.

  Note that “touch” in this specification includes all operations for bringing an input medium into contact with a display screen. That is, a tap operation to move the touched input medium away from the display screen within a predetermined time, a long touch operation to make the touched input medium stand still on the display screen, a slide operation to slide the touched input medium on the display screen, a display screen Flick operation where the acceleration of the input medium sliding above the threshold is more than a threshold, pinch-in operation to slide two input media touched at different positions on the display screen toward each other, two touched at different positions on the display screen A pinch-out operation or the like that slides the input medium away from each other is an example of a touch.

  In addition, even if the input medium is not touching the display screen, the concept of “touch” may include bringing the input medium close to a position where the distance from the display screen is very small. Furthermore, the input medium may be a user's finger or a touch pen.

[Communication unit 25]
The communication unit 25 is an interface for communicating with an external device. For example, the multifunction device 10 can transmit and receive various types of information or data to and from the mobile terminal 50 and the server 70 through the communication unit 25. Although the specific communication procedure of the communication part 25 is not specifically limited, For example, Wi-Fi (registered trademark of Wi-Fi Alliance) is employable.

[CPU 31]
A CPU (abbreviation of Central Processing Unit) 31 controls the overall operation of the multifunction machine 10. The CPU 31 acquires various programs described later from the storage unit 32 and executes them. The CPU 31 executes various processes based on various information output from the operation unit 24 and various information acquired from an external device through the communication unit 25 by executing various programs. The CPU 31 and the storage unit 32 constitute an example of a control unit.

[Storage unit 32]
The storage unit 32 includes a program storage area 32A and a data storage area 32B. In the program storage area 32A, an OS (abbreviation of Operating System) 34 and a control program 35 are stored. The OS 34 and the control program 35 are programs built in a binary format. The control program 35 may be a single program or an aggregate of a plurality of programs. Data or information necessary for execution of the control program 35 (hereinafter sometimes referred to as “data etc.”) is stored in the data storage area 32B.

  Note that “data” and “information” in this specification are common in that they are bits or bit strings that can be handled by a computer. “Data” refers to data that can be handled by the computer without taking into account the meaning of each bit. On the other hand, “information” refers to information that the operation of the computer branches depending on the semantic content indicated by each bit. Furthermore, the “instruction” is a control signal for prompting the destination apparatus to perform the next operation, and may include information or itself has a property as information. There is also.

  In addition, even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer, “data” and “information” have the same data and information as long as they are recognized as the same meaning content. Are treated as For example, information indicating “two” is stored as text information “0x32” in ASCII code in one computer, and binary format information “10” in binary notation in another computer. May be.

  However, the distinction between the above “data” and “information” is not strict, and exceptional handling is allowed. For example, data may be temporarily treated as information, or information may be temporarily treated as data. Also, what is handled as data in a certain device may be handled as information in another device. Furthermore, information may be extracted from the data, or data may be extracted from the information.

  The storage unit 32 includes, for example, RAM (abbreviation of Random Access Memory), ROM (abbreviation of Read Only Memory), EEPROM (abbreviation of Electrically Erasable Programmable Read-Only Memory), HDD (abbreviation of Hard CPU) 31 (HDD). It is configured by a buffer or the like or a combination thereof.

  The storage unit 32 may be a computer-readable storage medium. A computer-readable storage medium is a non-transitory medium. Non-transitory media include recording media such as CD-ROM and DVD-ROM in addition to the above examples. A non-transitory medium is also a tangible medium. On the other hand, an electrical signal that carries a program downloaded from a server on the Internet is a computer-readable signal medium that is a kind of computer-readable medium, but a non-transitory computer-readable storage. Not included in the media.

  The program stored in the program storage area 32A is executed by the CPU 31. However, in this specification, the operation of each program may be described with the CPU 31 omitted. That is, in the following description, the description that “the program A executes the process A” may indicate that “the CPU 31 executes the process A described in the program A”.

  Further, the program stored in the program storage area 32A determines an event and operates according to the determination result. However, in this specification, the operation of each program may be described by omitting the determination. That is, in the following description, the description that “the program executes the process A according to the condition A” is “determining whether or not the program is the condition A. The program is a positive determination. The processing A may be executed according to the above.

  The program stored in the program storage area 32A identifies, acquires, extracts, or selects data and the like. The program specifies data and the like, for example, specifies data that satisfies a condition from a plurality of data and stores the data itself or information for identifying the data in a predetermined storage area. Refers to processing. The information for identifying data or the like is, for example, identification information for identifying the data or the like, an index of an array in which the data or the like is stored, a pointer of a storage area in which the data or the like is stored, or the like. The same applies to the process in which the program acquires, extracts, or selects data.

  The OS 34 provides an API (abbreviation for Application Programming Interface) for controlling the printer unit 11, the scanner unit 12, the display unit 23, the operation unit 24, the communication unit 25, and the like that are hardware constituting the multifunction machine 10. It is a basic program. That is, each of the above programs controls each hardware by calling an API provided by the OS 34. However, in this specification, the operation of each program may be described with the OS 34 omitted. That is, in the following description, the description “the program B controls the hardware C” may refer to “the program B controls the hardware C through the API of the OS 34”.

[Portable terminal 50]
As shown in FIG. 2B, the portable terminal 50 includes a display unit 53, an operation unit 54, a communication unit 55, a voice communication unit 56, a speaker 57, a mounting unit 58, a vibrator 59, A CPU 61, a storage unit 62, and a communication bus 63 are mainly provided. The display unit 53, the operation unit 54, the communication unit 55, the CPU 61, the storage unit 62, and the communication bus 63 included in the portable terminal 50 are the display unit 23, the operation unit 24, the communication unit 25, the CPU 31, Since it is common with the memory | storage part 32 and the communication bus | bath 33, description for the second time is abbreviate | omitted.

  The voice communication unit 56 realizes a call function for transmitting and receiving voice data to and from an external device through a telephone line. More specifically, the portable terminal 50 transmits voice data indicating voice collected by a microphone (not shown) to the external device through the voice communication unit 56, and is indicated by voice data received from the external device through the voice communication unit 56. Audio is output through a speaker. The speaker used for realizing the call function may be the speaker 57 or a speaker attached to the attachment unit 58, or a call provided in advance in the portable terminal 50 separately from the speaker 57. A dedicated speaker may be used.

  The speaker 57 outputs sound. The mounting unit 58 is an interface through which an external speaker can be mounted. The external speaker may be in the form of an earphone or a headphone, for example. The vibrator 59 vibrates the mobile terminal 50. The vibrator 59 generates vibrations by rotating an eccentric weight with a motor, for example.

  The display unit 53 can be switched between a full screen mode in which an image instructed by the program is displayed in the entire display area and a partial screen mode in which the image instructed by the program is displayed in a part of the display area. The full screen mode of this embodiment may refer to a so-called full screen mode. In which mode the display unit 53 is used, for example, a program executed in the foreground may be instructed, or a user may instruct through the operation unit 54.

  In the full screen mode, for example, as shown in FIG. 9A, only the screen instructed by the program executed in the foreground is displayed on the display unit 53. In the partial screen mode, for example, as shown in FIG. 10A, in addition to the screen instructed by the program being executed in the foreground, the status bar 80 instructed by the OS 64 is displayed on the display unit 53. It is. In the status bar 80, for example, the title of the screen displayed by the program, the remaining battery level of the portable terminal 50, the communication status with the access point 102A, or an icon indicating the status of the program being executed in the background are displayed. Is done.

  The speaker 57 can be switched between a permission mode in which sound output is permitted and a restriction mode in which sound output is restricted. The permission mode is a state in which the sound is output from the speaker 57 when the API that instructs the output of the sound is executed by the program. The restriction mode is a state in which the sound is not output from the speaker 57 when the API for instructing the output of the sound is executed by the program. The regulation mode of the present embodiment may indicate a so-called manner mode. The mode in which the speaker 57 is used may be instructed by the user through the operation unit 54, for example.

  The mobile terminal 50 may be a smartphone or a tablet terminal, for example. The display unit 53, the speaker 57, the mounting unit 58, and the vibrator 59 constitute a part of a notification unit that performs notification using a notification method selected from among a plurality of notification methods. The display unit 53, the operation unit 54, the voice communication unit 56, and the speaker 57 are an example of a plurality of input / output units that output information or receive information input. The notification unit and the input / output unit are not limited to the above example. For example, a camera mounted on the portable terminal 50 may be included in the input / output unit.

  The program storage area 62A stores the OS 64. The OS 64 of the portable terminal 50 may be, for example, Android (registered trademark of Google Inc.) OS, iOS (registered trademark of Cisco Systems, Inc.), Windows Phone (registered trademark of Microsoft Corporation) Operating System, or the like.

  The OS 64 can execute a plurality of programs installed in the portable terminal 50 in parallel. The plurality of programs are virtually executed in parallel by, for example, time division multiplexing. Further, the OS 64 executes one of the plurality of programs in the foreground, and executes the other programs in the background. The foreground is a state in which, for example, a screen resulting from the execution of the program is displayed in most of the display area of the display unit 53. The background is a state in which, for example, a screen resulting from execution of a program different from the program is displayed in a large part of the display area of the display unit 53.

  The program storage area 62A stores a scan program 65 and a moving image program 66. The scan program 65 causes the multi-function device 10 to execute a scan process, receives image data generated by the scan process from the multi-function device 10, and executes a process of storing the received image data in a location specified by the user. . The scan program 65 is an example of a communication program. Image data is an example of content data. The moving image program 66 is a program for reproducing a moving image and a sound accompanying the moving image. However, the program that can be installed in the portable terminal 50 is not limited to the moving image program 66, and may be, for example, a music program, a game program, or an SNS (abbreviation of Social Networking Service) program.

  The scan program 65 can display a screen in the display area of the display unit 53 by executing an API provided by the OS 64. The OS 64 provides two APIs that cause the display unit 53 to display a screen. The first type API displays the designated screen on the display unit 53 only when the scan program 65 is executed in the foreground. The second type API causes the display unit 53 to display a designated screen regardless of whether the scan program 65 is executed in the foreground or background. In other words, the screen displayed by the second type API is displayed on the display unit 53 so as to overlap the screen displayed by the program executed in the foreground. These APIs can also use other programs installed in the portable terminal 50.

  As shown in FIG. 3A, the data storage area 62B stores a program ID and type information associated with the program ID. Hereinafter, the information shown in FIG. 3A may be collectively referred to as a program ID list, and each record shown in FIG. 3A may be expressed as a program ID record. The program ID is information that uniquely identifies a program that can be installed in the portable terminal 50. The type information is information indicating the types of programs that can be installed in the mobile terminal 50. Each program that can be installed in the portable terminal 50 is associated with only one program ID and associated with one or more types of information. Each type information is associated with one or more programs. The program ID and type information are examples of program identification information.

  In the present embodiment, the scan program 65 is identified by a program ID “001”, and the moving image program 66 is identified by a program ID “002”. Note that the list shown in FIG. 3A only needs to store program IDs of typical programs that can be installed in the portable terminal 50, and may not include program IDs of all programs. Good. In this embodiment, the type information of the scan program 65 is “communication program”, and the type information of the moving image program 66 is “video reproduction program”.

  Further, as shown in FIG. 3B, the data storage area 62B stores type information and a notification method associated with the type information. Hereinafter, the information shown in FIG. 3B may be collectively referred to as a notification method list, and each record shown in FIG. 3B may be expressed as a notification method record. The notification method indicates a method in which the scan program 65 notifies the end of a communication process to be described later when the program indicated by the corresponding type information is executed in the foreground. The notification method indicates a notification method through the display unit 53 and a notification method through the speaker 57.

  For example, the notification method associated with the type information “video playback program” is a method in which a pop-up message is displayed on the display unit 53 and no sound is output from the speaker 57. The notification method associated with the type information “sound reproduction program” does not display a message on the display unit 53, reduces the volume of the sound output by the sound reproduction program, and sends the notification sound to the speaker 57 together with the sound. It is a method of outputting. The notification method associated with the type information “game program” is a method of displaying a pop-up message on the display unit 53 and outputting a notification sound to the speaker 57. The notification method associated with the type information “SNS program” is a method of displaying a head-up message on the display unit 53 and outputting a notification sound to the speaker 57. The notification method associated with the type information “menu screen” is a method of displaying a toast message on the display unit 53 and outputting a notification sound to the speaker 57.

  The “pop-up message” is a display method in which a message appears upward from the lower end of the display area of the display unit 53. “Head-up message” is a display method in which a message appears downward from the upper end of the display area of the display unit 53. That is, the pop-up message and the head-up message are methods for displaying a message on the periphery of the display area of the display unit 53. The “toast message” is a display method in which a message appears in the center of the display area of the display unit 53 and the message is automatically hidden after a predetermined time. Further, although not shown, “dialog message” is a display method in which an icon for accepting a user operation indicating that a message has been confirmed appears together with the message, and the message is hidden by selecting the icon. is there. The scan program 65 can display “pop-up message”, “head-up message”, “toast message”, “dialog message”, and the like in the display area of the display unit 53 by using the second type API. .

  Furthermore, as shown in FIG. 4, the data storage area 62B stores type information and a usage situation associated with the type information. Hereinafter, the information shown in FIG. 4 may be collectively referred to as a usage status list, and each record shown in FIG. 4 may be expressed as a usage status record. The usage status is information indicating whether or not the input / output unit is used by the program executed in the foreground or how the input / output unit is used. Each type information shown in FIG. 4 is associated with the usage status of each of the plurality of input / output units.

  For example, the usage status “◯” is an input / output unit that is always used by the program indicated by the corresponding type information. The usage status “Δ” is an input / output unit that may or may not be used by the program indicated by the corresponding type information. The usage status “×” is an input / output unit that is not used by the program indicated by the corresponding type information. The use status “full screen” of the display unit 53 indicates that the program indicated by the type information “video playback program” is using the display unit 53 in the full screen mode. Furthermore, the usage status “usage frequency ≧ threshold value” of the operation unit 54 indicates that the program indicated by the type information “game program” has received user operations of the number of times equal to or greater than the threshold value within the predetermined period through the operation unit 54 Show.

  Various information shown in FIGS. 3 and 4 is executed by the scan program 65. Various types of information shown in FIGS. 3 and 4 may be stored, for example, in an ini file that is read by the scan program 65 at startup, or may be directly described in the source code of the scan program 65. 3 and 4 may be updated by the server 70, for example, or may be editable by the user through the scan program 65.

[Server 70]
The server 70 executes processing according to various request information received from the mobile terminal 50. For example, the server 70 stores the data received from the portable terminal 50 in the storage unit, transmits the requested data to the portable terminal 50, or receives the first format data received from the portable terminal 50 in the second format. And the process of transmitting the data in the second format to the mobile terminal can be executed.

[Operation of Scan Program 65]
The operation of the scan program 65 according to the present embodiment will be described with reference to FIGS. The scanner program 65 causes the MFP 10 to execute a scan process in accordance with a user instruction, and executes a process for notifying the user that image data generated by the scan process has been received from the MFP 10. In this embodiment, a method for realizing the following processes using an API provided by the Android OS will be described. However, it may be realized by an API provided by another OS, or may be realized by a method other than the API. May be.

  First, the scan program 65 executed in the foreground causes the display unit 53 to display a scan instruction screen (S11). FIG. 8A shows an example of a scan instruction screen. The scan instruction screen shown in FIG. 8A includes a [scanner] icon, a [original size] icon, a [scan image quality] icon, and a [scan] icon. Further, the OS 64 displays a status bar 80 on the upper part of the display area of the display unit 53. Then, the scan program 65 accepts a user operation for tapping the position of various icons included in the scan instruction screen through the operation unit 54 (S12).

  The [scanner] icon is an icon for accepting selection of a scanner for executing scan processing. The [Original Size] icon and the [Scan Quality] icon are icons for accepting a user operation for specifying a scan processing execution condition. The user can select another reading device with which the portable terminal 50 can communicate by tapping the position of the [scanner] icon. The user can change the execution condition of the scan process by tapping the position of the [Original Size] icon and the [Scan Quality] icon.

  The [Scan] icon is an icon for accepting a user operation for instructing a selected scanner to execute a scan process through an operation on the [Scanner] icon. The multifunction machine 10 is an example of a scanner selected through selection of a [Scanner] icon. That is, the scan program 65 transmits the scan instruction information to the multi-function peripheral 10 indicated by the [scanner] icon through the communication unit 55 in response to the tapping of the position of the [scan] icon (S12: Yes) (S13). ). The scan instruction information is information that instructs execution of a scan process. The scan instruction information includes setting values indicating execution conditions for scan processing indicated by an [original size] icon, a [scan image quality] icon, and the like. Then, the scan program 65 waits for reception of image data through the communication unit 55 (S14). The processing in steps S13 and S14 is an example of communication processing.

  Although illustration is omitted, the control program 35 of the multifunction machine 10 receives the scan instruction information from the portable terminal 50 through the communication unit 25. Next, the control program 35 causes the scanner unit 12 to execute scan processing according to the setting value included in the scan instruction information. The scanner unit 12 reads an image recorded on a document set on contact glass or ADF (abbreviation of Auto Document Feeder), and generates image data. Then, the control program 35 transmits the image data to the portable terminal 50 through the communication unit 25.

  Next, the scan program 65 receives the image data from the multifunction device 10 through the communication unit 55, that is, in response to the end of the communication process (S14: Yes), the scan program 65 is either foreground or background. (S15). For example, the scan program 65 acquires a class “ActivityManager” from the OS 64 and executes a function “getRunningAPPProcesses ()” to obtain a list of program IDs of programs being executed. This list of program IDs is a list of program IDs of programs that the OS 64 is executing in parallel. The program ID of the program being executed in the foreground is stored at the top of the list.

  The scan program 65 determines that the scan program 65 is being executed in the foreground according to the fact that the program ID “001” is stored at the top of the acquired list (S15: No). On the other hand, the scan program 65 determines that the scan program 65 is being executed in the background in response to the fact that a program ID different from the program ID “001” is stored at the top of the acquired list (S15: Yes). ). The process of step S15 is an example of a first determination process.

  Next, when the scan program 65 determines that the reception of the image data has been completed and the scan program 65 is being executed in the foreground (S15: No), the scan program 65 uses the first type API to store A designation screen is displayed on the display unit 53 (S20). FIG. 8B is an example of a save destination designation screen. The process of step S20 executed by the scan program 65 executed in the foreground is an example of a first notification process that notifies the end of the communication process using the first notification method. That is, the first notification method in the present embodiment is equivalent to displaying the storage destination designation screen shown in FIG.

  The save destination designation screen shown in FIG. 8B includes a message “Please specify the save destination of the received image data.” And one or more save destination icons 111, 112, 113. The save destination icons 111 to 113 correspond to the save destinations of the image data received in step S14. For example, the save destination icon 111 corresponds to a data folder provided in the data storage area 62B. The storage destination icons 112 and 113 correspond to a storage server (not shown).

  Next, the scan program 65 accepts a user operation on the storage destination designation screen through the operation unit 54 (S21). Then, in response to accepting a user operation for tapping the location of the storage destination icon 111 to 113 through the operation unit 54 (S21: Yes), the scan program 65 sends the image data to the storage destination corresponding to the storage destination icon. Store (S22). The processes in steps S20 and S21 are an example of a second reception process for receiving a user operation for designating a storage destination of content data. The process of step S22 is an example of a second storage process for storing content data in the storage destination received in the second reception process.

  Depending on the number of documents read in the scanning process or the reading resolution indicated by the [Scan image quality] icon, a certain amount of time may be required between the transmission of the scan instruction information and the completion of the reception of the image data. is there. Therefore, the user of the mobile terminal 50 can execute another program installed in the mobile terminal 50, for example, the moving image program 66 in the foreground while the scan program 65 waits for completion of reception of the image data. .

  The moving image program 66 executed in the foreground displays a playback screen on the display unit 53 in the full screen mode. FIG. 9A shows an example of a playback screen. The playback screen shown in FIG. 9A is a screen for playing back a moving image using the entire display area of the display unit 53. That is, the moving image program 66 executes the first type API for switching the display unit 53 to the full screen mode and displaying the reproduction screen. Further, the status bar 80 is not displayed on the display unit 53 when the playback screen is displayed. As a result, the scan program 65 is executed in the background.

  Therefore, the scan program 65 executes an acquisition process in response to determining that the reception of the image data is completed and the scan program 65 is being executed in the background (S15: Yes) (S16). The acquisition process is a process of acquiring program identification information for identifying a program being executed in the foreground (hereinafter sometimes referred to as “target program”). In the acquisition process in the present embodiment, the type information of the target program is acquired. Details of the acquisition process will be described with reference to FIG.

  First, the scan program 65 acquires the program ID of the target program (S31). For example, the scan program 65 may acquire a program ID stored at the top of the list acquired in step S15, or may acquire a new list again in step S31. In the present embodiment, the scan program 65 acquires the program ID “002” of the moving image program 66.

  Next, the scan program 65 determines whether or not the acquired program ID is registered in the program ID list (S32). The process of step S32 is an example of a third determination process. Then, when the scan program 65 determines that the acquired program ID is registered in the program ID list (S32: Yes), the program ID in the program ID list shown in FIG. The type information “video playback program” associated with “002” is acquired as the type of the target program (S33).

  On the other hand, in response to determining that the acquired program ID is not registered in the program ID list (S32: No), the scan program 65 determines the usage status of each input / output unit by the target program (S34). For example, the scan program 65 may determine the usage status of each of the plurality of input / output units by executing an API provided by the OS 64. The process of step S34 is an example of a second determination process or a fourth determination process.

  The scan program 65 determines whether or not the display unit 53 is used in the full screen mode by setting a transparent view in the class “WindowManager” and monitoring the state of the view with the function “OnGlobalLayoutlistener”, for example. do it. Further, the scan program 65 may acquire the class “AudioManager” from the OS 64 and determine whether or not the speaker 57 is outputting sound based on the return value of the function “isMusicActive ()”. Further, the scan program 65 may acquire the class “TelephonyManager” from the OS 64 and determine whether or not the voice communication unit 56 is used based on the return value of the function “getCallState ()”.

  Then, based on the usage status list shown in FIG. 4, the scan program 65 acquires the type information associated with the usage status determined in step S34 as the type of the target program (S35). For example, in the scan program 65, when the display unit 53 is used in the full screen mode, the speaker 57 is used, and the voice communication unit 56 is not used, the type information “video” of the target program is used. What is necessary is just to acquire "reproduction program" (S35).

  Returning to FIG. 5, the scan program 65 selects the notification method associated with the type information “video reproduction program” acquired in the acquisition process based on the notification method list shown in FIG. 3B (S17). ). The process of step S17 is an example of a selection process. The notification method selected in step S17 is an example of a second notification method. Then, the scan program 65 executes the notification process by the notification method selected in the selection process (S18). The details of the notification process will be described with reference to FIG.

  First, the scan program 65 determines whether a call is in progress. Specifically, the scan program 65 determines whether the voice communication unit 56 is transmitting and receiving voice data (S41). Since the determination method is the same as that in step S34, the description thereof is omitted. The process of step S41 is an example of a fifth determination process. Then, the scan program 65 waits for subsequent processing in response to the determination that the voice communication unit 56 is transmitting and receiving voice data (S41: Yes). Further, the scan program 65 repeatedly executes the process of step S41 at a predetermined time interval until transmission / reception of audio data ends.

  Next, the scan program 65 determines whether or not the speaker 57 is in the restriction mode in response to the determination that the audio communication unit 56 is not transmitting or receiving audio data (S41: No) (S42). For example, the scan program 65 may determine whether or not the speaker 57 is in the restriction mode by executing an API in which the state of the speaker 57 is indicated by a return value. The process of step S42 is an example of a sixth determination process.

  Next, in response to the determination that the speaker 57 is in the permission mode (S42: No), the scan program 65 determines the output destination of the notification sound to the speaker 57 (S43). Then, the scan program 65 notifies the completion of reception of the image data by the selected notification method (S47). For example, as shown in FIG. 9B, the scan program 65 according to the present embodiment displays a message “scan data received” on the display unit 53 as a pop-up and outputs a notification sound to the speaker 57. Let It is assumed that the pop-up message 81 is displayed so as to be superimposed on the playback screen, and the playback of the moving image on the playback screen is continued. The process of step S47 is an example of a second notification process.

  On the other hand, the scan program 65 determines whether or not an external speaker (typically an earphone) is attached to the attachment portion 58 in response to determining that the speaker 57 is in the restriction mode (S42: Yes). (S44). For example, the scan program 65 obtains the class “AudioManager” from the OS 64, and determines whether or not the earphone is attached to the attachment unit 58 based on the return value of the function “isWiredHeadsetOn ()”. This is an example of seventh determination processing.

  In response to determining that the earphone is attached to the attachment unit 58 (S44: Yes), the scan program 65 determines the output destination of the notification sound as the earphone (S45). Then, for example, as shown in FIG. 9B, the scan program 65 displays a pop-up message 81 on the display unit 53 and outputs a notification sound signal indicating a notification sound to the earphone through the attachment unit 58 (S47). . Thereby, a notification sound is output from the earphone attached to the attachment portion 58.

  Further, the scan program 65 determines to vibrate the vibrator 59 instead of outputting the notification sound in response to determining that the earphone is not attached to the attachment portion 58 (S44: No) (S46). Then, for example, as shown in FIG. 9B, the scan program 65 displays a pop message 81 on the display unit 53 and causes the vibrator 59 to vibrate the portable terminal 50 (S47).

  The user who notices the end of the communication process by the pop-up message 81 or the notification sound performs a user operation to instruct the operation unit 54 to execute the moving image program 66 in the background and to execute the scan program 65 in the foreground. It can be carried out. Therefore, the scan program 65 waits until the scan program 65 is executed in the foreground (S19). That is, the scan program 65 repeatedly acquires a list of program IDs acquired by the function “getRunningAPPProcesses ()” at predetermined time intervals. Then, in response to the scan program 65 being executed in the foreground (S19: Yes), the scan program 65 executes the processes after step S20. Since the processing after step S20 has already been described, the description thereof will be omitted.

[Effects of Embodiment]
According to the above embodiment, in response to the completion of the communication process when the scan program 65 is executed in the background, the communication process is terminated by a notification method suitable for the target program being executed in the foreground. Can be notified. As a result, it is possible to improve the possibility that the user who is paying attention to the target program will notice the notification, and to reduce the possibility that the notification will be disturbed. A specific example of the communication program is not limited to the scan program 65, and any program that communicates with the external device through the communication unit 55 in order to cause the external device to process the content data is applicable.

  That is, the communication program may receive content data from the external device or transmit content data to the external device by communicating with the external device through the communication unit 55 in the communication process. More specifically, the communication process may be a process for causing the multifunction device 10 to record an image indicated by the image data, or a process for receiving the image data generated by the multifunction device 10. The content data format may be converted to the server 70 and the converted content data may be received. The content data may be image data, moving image data, music data, or the like, for example.

  The end of the communication processing includes, for example, completion of reception of the entire image data from the multifunction device 10, completion of a print instruction to the multifunction device 10, and transmission of image data to be printed to the multifunction device 10 to the multifunction device 10. The transmission may be completed or the content data upload to the server 70 may be completed. Furthermore, communication with an external device may be further executed after communication determined to be the end of the communication process. As an example, after completion of a print instruction to the multifunction device 10, image data to be printed may be further transmitted to the multifunction device 10. As another example, after the image data to be printed is transmitted to the multifunction device 10, a print instruction may be further transmitted to the multifunction device 10. As yet another example, an instruction to add a tag to the content data may be further transmitted to the server 70 after the upload of the content data to the server 70 is completed.

  According to the above embodiment, when the program ID of the target program is registered in the program ID list, the notification method associated with the program ID is selected as the second notification method via the type information. The In the example of FIG. 3, the program ID and the type information are associated with each other, and the type information and the notification method are associated with each other. However, the program ID and the notification method may be directly associated with each other. On the other hand, when the program ID of the target program is not registered in the program list, the type of the target program is estimated according to the usage status of the input / output unit. As a result, the end of the communication process can be notified by a method suitable for the target program.

  In addition, according to the above-described embodiment, while the voice communication unit is transmitting / receiving voice data, that is, during the call, the notification process is awaited, so the notification of the end of the communication process disturbs the call. Can be prevented. Furthermore, since the speaker 57, the mounting part 58, and the vibrator 59 are used properly depending on whether the so-called manner mode and the earphone are mounted, the output destination of the notification sound is changed according to the state of the mobile terminal 50 can do.

  In the above-described embodiment, the user who is executing the moving image program 66 in the foreground is likely to pay attention to the moving image displayed on the display unit 53 of the mobile terminal 50. Therefore, displaying the notification message on the display unit 53 increases the possibility that the user will notice the notification. Further, by setting the message display method to “pop-up”, the overlap with the moving image displayed on the display unit 53 can be reduced, so that the possibility that the user feels that the notification is disturbing can be reduced.

  However, a specific example of the notification method corresponding to the type information “video reproduction program” is not limited to this. For example, the scan program 65 may select a method of notifying only the speaker 57 of the display unit 53 and the speaker 57 as the second notification method corresponding to the type information “video reproduction program”. In the notification process in this case, the playback screen continues to be displayed on the display unit 53 and a notification sound is output from the speaker 57. Thereby, the possibility that the user feels that the notification is in the way can be further reduced.

[Modification]
Next, a modification of the above embodiment will be described with reference to FIGS. Note that a detailed description of the points in common with the above embodiment will be omitted, and the differences will be mainly described.

  As an example, a program (hereinafter referred to as a “music program”) associated with the type information “sound reproduction program” causes, for example, the music indicated by the music data to be output to the speaker 57 and FIG. ) Is displayed on the display unit 53. Further, the OS 64 displays a status bar 80 on the upper part of the display area of the display unit 53. The music playback screen includes a playback icon 115 for receiving a music playback instruction, a rewind icon 116 for receiving a rewind instruction, a fast-forward icon 117 for receiving a fast-forward instruction, and an indicator 118 indicating a music playback position. Including. The music program can accept a user operation on the music playback screen through the operation unit 54. That is, the display unit 53 is in the partial screen mode, the speaker 57 is used, and the voice communication unit 56 is not used.

  When such a music program is being executed in the foreground, the scan program 65 acquires the type information “music reproduction program” of the target program in step S16. In step S <b> 17, the scan program 65 selects the notification method associated with the type information “music playback program” from the notification method list as the second notification method. Further, in step S47, the scan program 65 reduces the volume of music output by the music program and causes the speaker 57 to output a notification sound that notifies the end of the communication process.

  The user who is executing the music program in the foreground has a high possibility of paying attention to the music output from the speaker 57 of the portable terminal 50. For this reason, the notification through the speaker 57 increases the possibility that the user will notice the notification. Further, by narrowing the volume of music output by the music program during the notification process, the possibility that the user will notice the notification sound can be further increased. When the music program is outputting music to the earphone attached to the attachment unit 58, the notification sound is output from the earphone in the notification process shown in FIG.

  As another example, a program associated with the type information “game program” (hereinafter referred to as “game program”) causes the display unit 53 to display a game screen shown in FIG. Further, the OS 64 displays a status bar 80 on the upper part of the display area of the display unit 53. The game screen includes an animation display area 121 displayed at the top of the display area and a status display area 122 displayed at the bottom of the display area. In the animation display area 121, a character that operates in response to a user operation is displayed. In the status display area 122, the character status and the like are displayed. The game program can accept a user operation on the animation display area 121 through the operation unit 54. In other words, the display unit 53 is in the partial screen mode, and the operation unit 54 is in a state in which many user operations are continuously received.

  When such a game program is being executed in the foreground, the scan program 65 acquires the type information “game program” of the target program in step S16. In step S <b> 17, the scan program 65 selects a notification method associated with the type information “game program” from the notification method list as the second notification method. Further, in step S47, the scan program 65 displays a pop-up message 82 that notifies the end of the communication process on the display unit 53 and causes the speaker 57 to output a notification sound. The pop-up message 82 shown in FIG. 10B includes a message “Scan data has been received. Tap the switching icon.”

  The user who is executing the game program in the foreground has a high possibility of paying attention to the game video displayed on the display unit 53 of the mobile terminal 50. In addition, in games that require real-time performance, a moving game image is often displayed at the top and center of the display area, and static information such as status is often displayed at the bottom of the display area. Therefore, by setting the message display method to “pop-up”, it is possible to make the user aware of the notification and reduce the possibility that the user will feel the notification in the way.

  Further, the OS 64 of the portable terminal 50 displays a switch icon 85 in the status bar 80 as shown in FIGS. 10A to 11A in response to the scan program 65 being switched from the foreground to the background. May be displayed. The switching icon 85 is an image for accepting a user operation instructing to execute the scan program 65 in the foreground. Then, the OS 64 executes the game program in the background and executes the scan program 65 in the foreground in response to accepting a user operation for tapping the position of the switching icon 85 through the operation unit 54. Thereby, the scan program 65 can execute the processing from step S20 onward in FIG.

  As yet another example, a program associated with the type information “SNS program” (hereinafter referred to as “message exchange program”) is displayed on the display unit 53 with, for example, the SNS screen shown in FIG. Display. Further, the OS 64 displays a status bar 80 on the upper part of the display area of the display unit 53. The SNS screen includes a message display area 125 displayed at the top of the display area, and a message edit area 126 displayed at the bottom of the display area. In the message display area 125, messages already transmitted and received are displayed in time series. In the message editing area 126, a software keyboard for receiving input of a message to be transmitted and a text box for displaying the input message are displayed. The game program can accept a user operation on the message editing area 126 through the operation unit 54. That is, the display unit 53 is in the partial screen mode, and user operations accepted by the operation unit 54 are concentrated at the lower part of the display area.

  When such a message exchange program is executed in the foreground, the scan program 65 acquires target program type information “SNS program” in step S16. In step S17, the scan program 65 selects the notification method associated with the type information “SNS program” from the notification method list as the second notification method. Further, in step S47, the scan program 65 causes the display unit 53 to display a head-up message that notifies the end of the communication process, and causes the speaker to output a notification sound.

  Further, the scan program 65 may display the notification method editing screen shown in FIG. 11B on the display unit 53, for example. The notification method editing screen is a screen for accepting a user operation for editing the notification method list shown in FIG. The notification method editing screen shown in FIG. 11B includes a pull-down menu for specifying type information, a pull-down menu for specifying a notification method by the display unit 53, a pull-down menu for specifying a notification method by the speaker 57, [Determine] icon. Then, the scan program 65 receives a user operation on the notification method editing screen through the operation unit 54.

  The scan program 65 acquires the type information selected from each pull-down menu and the notification method in response to accepting a user operation for tapping the position of the [OK] icon through the operation unit 54. This process is an example of a first reception process for receiving a user operation for specifying program identification information and a notification method. Then, when the acquired type information is registered in the notification method list shown in FIG. 3B, the scan program 65 overwrites the notification method of the notification method record including the type information with the acquired notification method. . In addition, when the acquired type information is not registered in the notification method list shown in FIG. 3B, the scan program 65 displays the notification method record including the acquired type information and the notification method in FIG. Is added to the notification method list.

  According to the said structure, the alerting | reporting method matched with the kind information can be customized according to a user preference. That is, the correspondence between the type information and the notification method is not limited to the example illustrated in FIG. For example, the notification method list shown in FIG. 3B may include a notification method record including the same notification method as the first notification method.

  In the MFP 10 and the portable terminal 50 according to the embodiment, the CPU 31 and 61 execute various programs stored in the program storage areas 32A and 62A of the storage units 32 and 62, thereby executing the control unit of the present invention. An example in which each process is realized has been described. However, the configuration of the control unit is not limited to this, and part or all of the configuration may be realized by hardware such as an integrated circuit (also referred to as an IC (Integrated Circuit)).

  Furthermore, the present invention may be realized not only as the multifunction device 10 and the portable terminal 50 but also as a program that causes the multifunction device 10 and the portable terminal 50 to execute processing. Then, the program may be provided by being recorded on a non-transitory recording medium. The non-transitory recording medium may include a storage unit mounted on a server that can be connected to the MFP 10 and the portable terminal 50 through a communication network, in addition to a CD-ROM, a DVD-ROM, and the like. And the program memorize | stored in the memory | storage part of the server may be distributed through communication networks, such as the internet, as the information or signal which shows the said program.

DESCRIPTION OF SYMBOLS 10 ... Multifunction machine 11 ... Printer part 12 ... Scanner part 53 ... Display part 54 ... Operation part 55 ... Communication part 56 ... Voice communication part 57 ... Speaker 58 ..Mounting part 59 ... vibrator 61 ... CPU
62... Storage unit 65... Scan program 66... Video program 50.

Claims (23)

It is a communication program that includes a display unit, a communication unit, a notification unit, and a plurality of input / output units that output information or receive information input, and that can be read by a portable terminal that can execute a plurality of programs in parallel. And
The display unit serves as at least part of the notification unit and at least part of the input / output unit,
The communication unit is capable of communicating with an external device that processes content data,
The notification unit can be notified by the notification method selected from among a plurality of notification methods,
The communication program is:
A communication process for communicating with the external device through the communication unit in order to cause the external device to process the content data;
The portable terminal is caused to execute a first determination process for determining whether the communication program is executed in the foreground or the background, and the foreground displays a screen based on the execution of the program in the display area of the display unit. The background is displayed, and the background is a state in which a screen resulting from execution of the program different from the program is displayed in the display area of the display unit,
The communication program uses the first notification method to notify that the communication process has ended in response to determining in the first determination process that the communication process has ended and that the communication program is being executed in the foreground. Causing the portable terminal to execute a first notification process to be notified to the notification unit;
The communication program includes a plurality of pieces of program identification information each identifying the program in response to the first determination process determining that the communication process is completed and the communication program is being executed in the background. The acquisition processing for acquiring the target identification information that is the program identification information indicating the target program, and the second determination processing for determining the usage status of the target program for each of the plurality of input / output units The target program is the program being executed in the foreground, and in the acquisition process, the program identification information corresponding to the usage status determined in the second determination process is used as the target identification information. Acquired,
The communication program includes: a selection process for selecting, as a second notification method, the notification method corresponding to the target identification information acquired in the acquisition process among the plurality of notification methods;
A communication program for causing the portable terminal to execute a second notification process for causing the notification unit to notify the end of the communication process by the second notification method. The mobile terminal includes a speaker for outputting sound,
The speaker also serves as at least a part of the notification unit and the input / output unit,
The display unit can be switched to a full screen mode for displaying an image instructed by the program in the entire display area and a partial screen mode for displaying in a part of the display area.
The program identification information identifies the type of the program,
In the acquisition process when the second determination process determines that the display unit is used in the full screen mode, the communication program uses the program identification information indicating a video reproduction program as the target identification information. The communication program according to claim 1 to be acquired. The communication program is:
In the selection process, a method of notifying only the speaker of the display unit and the speaker is selected as the second notification method corresponding to the video reproduction program,
The communication program according to claim 2, wherein in the second notification process, a notification sound for notifying the end of the communication process is output to the speaker. The communication program is:
In the selection process, a method of displaying a message on a peripheral portion of the display area of the display unit is selected as the second notification method corresponding to the video reproduction program,
The communication program according to claim 2, wherein in the second notification process, a message for notifying the end of the communication process is displayed on the peripheral portion of the display area on the display unit. The mobile terminal includes a speaker for outputting sound,
The speaker also serves as at least a part of the notification unit and the input / output unit,
The program identification information identifies the type of the program,
The communication program acquires the program identification information indicating an audio reproduction program as the target identification information in the acquisition process when the second determination process determines that the speaker is being used. 5. The communication program according to any one of 4. The communication program is:
In the selection process, a method for causing the speaker to output a notification sound together with the sound output by the target program is selected as the second notification method corresponding to the sound reproduction program,
6. The communication program according to claim 5, wherein, in the second notification process, the speaker is caused to reduce a volume of a sound output by the target program and to output the notification sound that notifies the end of the communication process. The portable terminal includes an operation unit that receives a user operation,
The operation unit also serves as at least a part of the notification unit,
The program identification information identifies the type of the program,
The communication program acquires the program identification information indicating a game program as the target identification information in the acquisition process when the second determination process determines that the use frequency of the operation unit is equal to or greater than a threshold. Item 7. The communication program according to any one of Items 1 to 6. The communication program is:
In the selection process, a method of popping up a message at a lower portion of the display area of the display unit is selected as the second notification method corresponding to the game program,
The communication program according to claim 7, wherein, in the second notification process, a message for notifying the end of the communication process is displayed in a pop-up on the display unit. The portable terminal includes a storage unit,
The storage unit stores the program identification information and the usage status of each of the plurality of input / output units associated with the program identification information,
The communication program according to any one of claims 1 to 8, wherein the communication program acquires the program identification information associated with the usage status determined in the second determination process as the target identification information in the acquisition process. program. A communication unit comprising a display unit, a communication unit, a notification unit, a storage unit, and an operation unit that accepts user operations, and is a communication program that can be read by a portable terminal that can execute a plurality of programs in parallel,
The display unit also serves as at least a part of the notification unit,
The communication unit is capable of communicating with an external device that processes content data,
The notification unit can be notified by the notification method selected from among a plurality of notification methods,
The storage unit stores program identification information and the notification method associated with the program identification information,
The communication program is:
A communication process for communicating with the external device through the communication unit in order to cause the external device to process the content data;
The portable terminal is caused to execute a first determination process for determining whether the communication program is executed in the foreground or the background, and the foreground displays a screen based on the execution of the program in the display area of the display unit. The background is displayed, and the background is a state in which a screen resulting from execution of the program different from the program is displayed in the display area of the display unit,
The communication program uses the first notification method to notify that the communication process has ended in response to determining in the first determination process that the communication process has ended and that the communication program is being executed in the foreground. Causing the portable terminal to execute a first notification process to be notified to the notification unit;
The communication program includes a plurality of pieces of program identification information each identifying the program in response to the first determination process determining that the communication process is completed and the communication program is being executed in the background. Among the above, the mobile terminal is caused to execute an acquisition process for acquiring the target identification information, which is the program identification information indicating the target program, from the OS of the mobile terminal, and the target program is the program executed in the foreground. Yes,
The communication program includes a selection process for selecting, as a second notification method, the notification method associated with the target identification information acquired in the acquisition process among the plurality of notification methods;
A second notification process for notifying the notification unit by the second notification method that the communication process has been completed;
A first receiving process for receiving a user operation for specifying the program identification information and the notification method through the operation unit;
A communication program that causes the portable terminal to execute a first storage process in which the program identification information received in the first reception process and the notification method are associated with each other and stored in the storage unit. The mobile terminal includes a plurality of input / output units for outputting information or receiving information input,
The display unit and the operation unit also serve as at least a part of the input / output unit,
The communication program is:
Causing the portable terminal to execute a third determination process for determining whether or not the target identification information associated with the notification method is stored in the storage unit;
In the selection process when the third determination process determines that the target identification information is stored, the notification method associated with the target identification information is selected as the second notification method,
In the acquisition process when it is determined in the third determination process that the target identification information is not stored,
For each of the plurality of input / output units, the portable terminal is caused to execute a fourth determination process for determining the usage status of the target program,
The communication program according to claim 10, wherein the program identification information corresponding to the usage status determined in the fourth determination process is acquired as the target identification information. A communication program that includes a display unit, a communication unit, a notification unit, and a voice communication unit that transmits and receives voice data to and from an external device through a telephone line, and is readable by a portable terminal that can execute a plurality of programs in parallel Because
The display unit also serves as at least a part of the notification unit,
The communication unit is capable of communicating with an external device that processes content data,
The notification unit can be notified by the notification method selected from among a plurality of notification methods,
The communication program is:
A communication process for communicating with the external device through the communication unit in order to cause the external device to process the content data;
The portable terminal is caused to execute a first determination process for determining whether the communication program is executed in the foreground or the background, and the foreground displays a screen based on the execution of the program in the display area of the display unit. The background is displayed, and the background is a state in which a screen resulting from execution of the program different from the program is displayed in the display area of the display unit,
The communication program uses the first notification method to notify that the communication process has ended in response to determining in the first determination process that the communication process has ended and that the communication program is being executed in the foreground. Causing the portable terminal to execute a first notification process to be notified to the notification unit;
The communication program includes a plurality of pieces of program identification information each identifying the program in response to the first determination process determining that the communication process is completed and the communication program is being executed in the background. Among them, the portable terminal is caused to execute an acquisition process for acquiring target identification information which is the program identification information indicating the target program, and the target program is the program being executed in the foreground,
The communication program includes: a selection process for selecting, as a second notification method, the notification method corresponding to the target identification information acquired in the acquisition process among the plurality of notification methods;
A second notification process for notifying the notification unit by the second notification method that the communication process has been completed;
A fifth determination process for determining whether or not the voice data is being transmitted and received by the voice communication unit;
The communication program causes the portable terminal to wait for the execution of the second notification process in response to determining in the fifth determination process that the audio data is being transmitted / received,
A communication program for causing the portable terminal to execute the second notification process in response to the determination in the fifth determination process that the audio data is not being transmitted / received. The mobile terminal includes a speaker for outputting sound,
The speaker also serves as at least a part of the notification unit,
The speaker can be switched to a permission mode in which sound output is permitted and a restriction mode in which sound output is restricted,
The communication program causes the portable terminal to execute a sixth determination process for determining whether the speaker is in the permission mode or the restriction mode.
The communication program according to any one of claims 1 to 12, wherein the communication program causes the speaker to output a notification sound in the second notification process when the sixth determination process determines that the permission mode is set. The mobile terminal includes a mounting portion on which an external speaker can be mounted,
The mounting portion also serves as at least a part of the notification portion,
The communication program causes the portable terminal to execute a seventh determination process for determining whether or not the external speaker is mounted on the mounting unit.
In the second notification process, when the communication program determines in the sixth determination process that the restriction mode is set, and determines in the seventh determination process that the external speaker is attached, a notification sound is generated. The communication program according to claim 13, wherein a notification sound signal is output to the external speaker through the mounting portion. The mobile terminal includes a vibrator that vibrates the mobile terminal,
The vibrator also serves as at least a part of the notification unit,
In the second notification process when the communication program determines in the sixth determination process that the restriction mode is set and the seventh determination process determines that the external speaker is not attached, the communication program The communication program according to claim 14, wherein the mobile terminal is vibrated. A communication unit that includes a display unit, a communication unit, and a notification unit, and can be read by a mobile terminal that can execute a plurality of programs in parallel.
The display unit also serves as at least a part of the notification unit,
The communication unit is capable of communicating with an external device that processes content data,
The notification unit can be notified by the notification method selected from among a plurality of notification methods,
The communication program is:
A communication process for communicating with the external device through the communication unit in order to cause the external device to process the content data;
The portable terminal is caused to execute a first determination process for determining whether the communication program is executed in the foreground or the background, and the foreground displays a screen based on the execution of the program in the display area of the display unit. The background is displayed, and the background is a state in which a screen resulting from execution of the program different from the program is displayed in the display area of the display unit,
The communication program uses the first notification method to notify that the communication process has ended in response to determining in the first determination process that the communication process has ended and that the communication program is being executed in the foreground. Causing the portable terminal to execute a first notification process to be notified to the notification unit;
The communication program includes a plurality of pieces of program identification information each identifying the program in response to the first determination process determining that the communication process is completed and the communication program is being executed in the background. Among them, the portable terminal is caused to execute an acquisition process for acquiring target identification information which is the program identification information indicating the target program, and the target program is the program being executed in the foreground,
The communication program includes: a selection process for selecting, as a second notification method, the notification method corresponding to the target identification information acquired in the acquisition process among the plurality of notification methods;
Causing the portable terminal to execute a second notification process that notifies the notification unit that the communication process has been completed by the second notification method;
The OS of the portable terminal displays a switching object on the display unit in response to the communication program being switched from the foreground to the background, and the switching object executes the communication program in the foreground. Is an image for accepting a user operation to instruct
The communication program causes the notification unit to output a message that prompts the user operation to the switching object in the notification process. The portable terminal includes an operation unit that receives a user operation,
The communication process is a process of receiving the content data from the external device,
The communication program is:
A second receiving process for receiving, through the operation unit, a user operation for designating a storage destination of the content data received in the communication process in response to switching to the foreground after execution of the notification process;
The communication program according to claim 16, which causes the portable terminal to execute a second storage process for storing the content data in the storage destination received in the second reception process.   The communication program according to any one of claims 1 to 17, wherein the first notification method is a method of switching a screen displayed in a display area of the display unit to a screen that notifies the end of the communication process.   The communication program according to any one of claims 1 to 18, wherein the notification method that can be selected in the selection process includes the same notification method as the first notification method. A display unit, a communication unit, a notification unit, a plurality of input / output units for outputting information or receiving input of information, and a control unit capable of executing a plurality of programs in parallel and executing a communication program are provided. A mobile device,
The display unit serves as at least part of the notification unit and at least part of the input / output unit,
The communication unit is capable of communicating with an external device that processes content data,
The notification unit can be notified by the notification method selected from among a plurality of notification methods,
The controller is
A communication process for communicating with the external device through the communication unit in order to cause the external device to process the content data;
A first determination process for determining whether the communication program is being executed in the foreground or the background, and the foreground has a screen based on the execution of the program displayed in the display area of the display unit. The background is a state in which a screen resulting from execution of the program different from the program is displayed in the display area of the display unit,
In response to determining in the first determination process that the communication process has ended and the communication program is being executed in the foreground, the control unit uses the first notification method to indicate that the communication process has ended. Performing a first notification process to notify the notification unit;
The control unit includes a plurality of pieces of program identification information each identifying the program in response to the first determination process determining that the communication process is completed and the communication program is being executed in the background. An acquisition process for acquiring the target identification information that is the program identification information indicating the target program, and a second determination process for determining the usage status of the target program for each of the plurality of input / output units, The target program is the program being executed in the foreground, and in the acquisition process, the program identification information corresponding to the usage status determined in the second determination process is acquired as the target identification information,
The control unit selects a notification method corresponding to the target identification information acquired in the acquisition process among the plurality of notification methods as a second notification method;
The portable terminal which performs the 2nd alerting | reporting process which makes the said alerting | reporting part alert | report by the said 2nd alerting | reporting method that the said communication process was complete | finished. A display unit, a communication unit, a notification unit, a storage unit, an operation unit that receives user operations, and a portable terminal that can execute a plurality of programs in parallel and includes a control unit that executes a communication program,
The display unit also serves as at least a part of the notification unit,
The communication unit is capable of communicating with an external device that processes content data,
The notification unit can be notified by the notification method selected from among a plurality of notification methods,
The storage unit stores program identification information and the notification method associated with the program identification information,
The controller is
A communication process for communicating with the external device through the communication unit in order to cause the external device to process the content data;
A first determination process for determining whether the communication program is being executed in the foreground or the background, and a screen based on the execution of the program is displayed in the display area of the display unit. The background is a state in which a screen resulting from execution of the program different from the program is displayed in the display area of the display unit,
In response to determining in the first determination process that the communication process has ended and the communication program is being executed in the foreground, the control unit uses the first notification method to indicate that the communication process has ended. Performing a first notification process to notify the notification unit;
The control unit includes a plurality of pieces of program identification information each identifying the program in response to the first determination process determining that the communication process is completed and the communication program is being executed in the background. The target identification information, which is the program identification information indicating the target program, is acquired from the OS of the mobile terminal, and the target program is the program being executed in the foreground,
The control unit selects, as a second notification method, the notification method associated with the target identification information acquired in the acquisition process among the plurality of notification methods;
A second notification process for notifying the notification unit by the second notification method that the communication process has been completed;
A first receiving process for receiving a user operation for specifying the program identification information and the notification method through the operation unit;
A portable terminal that executes a first storage process in which the program identification information received in the first reception process and the notification method are associated with each other and stored in the storage unit. A display unit, a communication unit, a notification unit, a voice communication unit that transmits / receives voice data to / from an external device through a telephone line, and a control unit that can execute a plurality of programs in parallel and execute a communication program Mobile devices,
The display unit also serves as at least a part of the notification unit,
The communication unit is capable of communicating with an external device that processes content data,
The notification unit can be notified by the notification method selected from among a plurality of notification methods,
The controller is
A communication process for communicating with the external device through the communication unit in order to cause the external device to process the content data;
A first determination process for determining whether the communication program is being executed in the foreground or the background, and a screen based on the execution of the program is displayed in the display area of the display unit. The background is a state in which a screen resulting from execution of the program different from the program is displayed in the display area of the display unit,
In response to determining in the first determination process that the communication process has ended and the communication program is being executed in the foreground, the control unit uses the first notification method to indicate that the communication process has ended. Performing a first notification process to notify the notification unit;
The control unit includes a plurality of pieces of program identification information each identifying the program in response to the first determination process determining that the communication process is completed and the communication program is being executed in the background. Among them, an acquisition process for acquiring target identification information that is the program identification information indicating the target program is executed, and the target program is the program being executed in the foreground,
The control unit selects a notification method corresponding to the target identification information acquired in the acquisition process among the plurality of notification methods as a second notification method;
A second notification process for notifying the notification unit by the second notification method that the communication process has been completed;
And a fifth determination process for determining whether or not the audio data is being transmitted / received by the audio communication unit,
The control unit waits for the execution of the second notification process in response to determining in the fifth determination process that the audio data is being transmitted / received,
The portable terminal which performs a said 2nd alerting | reporting process according to having determined in the said 5th determination process that it is not transmitting / receiving the said audio | voice data. A display unit, a communication unit, a notification unit, and a portable terminal that can execute a plurality of programs in parallel and includes a control unit that executes a communication program,
The display unit also serves as at least a part of the notification unit,
The communication unit is capable of communicating with an external device that processes content data,
The notification unit can be notified by the notification method selected from among a plurality of notification methods,
The controller is
A communication process for communicating with the external device through the communication unit in order to cause the external device to process the content data;
A first determination process for determining whether the communication program is being executed in the foreground or the background, and a screen based on the execution of the program is displayed in the display area of the display unit. The background is a state in which a screen resulting from execution of the program different from the program is displayed in the display area of the display unit,
In response to determining in the first determination process that the communication process has ended and the communication program is being executed in the foreground, the control unit uses the first notification method to indicate that the communication process has ended. Performing a first notification process to notify the notification unit;
The control unit includes a plurality of pieces of program identification information each identifying the program in response to the first determination process determining that the communication process is completed and the communication program is being executed in the background. Among them, an acquisition process for acquiring target identification information that is the program identification information indicating the target program is executed, and the target program is the program being executed in the foreground,
The control unit selects a notification method corresponding to the target identification information acquired in the acquisition process among the plurality of notification methods as a second notification method;
Performing a second notification process for notifying the notification unit of the completion of the communication process by the second notification method;
The OS of the portable terminal displays a switching object on the display unit in response to the communication program being switched from the foreground to the background, and the switching object executes the communication program in the foreground. Is an image for accepting a user operation to instruct
The control unit is a portable terminal that causes the notification unit to output a message for prompting the user operation to the switching object in the notification process.

Images