JP6515661B2 - Communication program - Google Patents

Description

  The present invention relates to a communication program executed by a portable terminal capable of executing a plurality of programs in parallel.

  BACKGROUND Conventionally, there has been known a portable terminal capable of so-called multi-thread processing which executes a plurality of programs in parallel. Multi-thread processing is to virtually execute a plurality of programs in parallel by switching the processing of each program at short time intervals. In addition, the portable terminal executes one of a plurality of programs executing in parallel in the foreground, and executes the other programs in the background.

  The foreground is, for example, a state in which a screen according to the execution of the program is displayed in the main display area of the display. More specifically, the foreground may be a state where the execution result is reflected on the display of the main display area of the display when the program executes an API for displaying an image on the display. On the other hand, the background is, for example, a state in which a screen based on the execution of a program different from the program is displayed in the main display area of the display.

  Further, as an example of a program executed by such a portable terminal, Patent Document 1 describes a program for transmitting a scan instruction to a scanner and receiving scan data from the scanner (hereinafter referred to as a “scan program”). ) Is described. Further, in response to the reception of the scan data, the scan program causes the display to display a screen prompting a user operation for specifying the storage destination of the scan data, and stores the scan data in the storage destination received from the user.

  In such a scan program, it may take some time to complete reception of scan data after transmitting a scan instruction. Therefore, the user of the portable terminal may cause a program different from the scan program to be executed in the foreground after transmitting the scan instruction. This causes the scan program to be run in the background. Even in this case, it is desirable that the scan program notify the user that the reception of scan data has been completed.

JP 2012-203249 A

  However, in the portable terminal, various programs such as a video reproduction program, an audio reproduction program, or a game program can be executed. Therefore, if the scan program is being executed in the background, notification of scan data reception completion in a uniform manner may cause a problem. Specifically, the user may not notice the notification, or the user may feel that the notification is in the way.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a communication program capable of notifying information in a method suitable for a program being executed in the foreground.

  (1) The communication program described in the present specification includes a display unit, a communication unit, and a notification unit, and can be read by a portable terminal that can execute a plurality of programs in parallel. The display unit doubles as at least a part of the notification unit. The communication unit can communicate with an external device that processes content data. The notification unit can notify by the notification method selected from among a plurality of notification methods. The communication program determines whether the communication program is being executed in the foreground or the background, and communication processing for communicating with the external device through the communication unit in order to cause the external device to process the content data. The mobile terminal is caused to execute the first determination process. In the foreground, a screen according to the execution of the program is displayed in the display area of the display unit. The background is a state in which a screen based on the execution of the program different from the program is displayed in the display area of the display unit. The communication program is a first notification method that the communication process is completed in response to the determination in the first determination process that the communication process is completed and the communication program is being executed in the foreground. The mobile terminal is caused to execute a first notification process for notifying the notification unit. The communication program includes a plurality of program identification information each of which identifies the program according to the determination in the first determination processing that the communication processing has ended and the communication program is being executed in the background. The portable terminal is caused to execute acquisition processing for acquiring target identification information that is the program identification information indicating a target program. The target program is the program being executed in the foreground. The communication program selects, as a second notification method, the notification method corresponding to the target identification information acquired in the acquisition processing among the plurality of notification methods, and indicates that the communication processing has ended. The mobile terminal is caused to execute a second notification process of causing the notification unit to notify by the second notification method.

  According to the above configuration, the end of the communication process can be notified by a notification method suitable for the target program being executed in the foreground. As a result, it is possible to improve the possibility that the user who is focusing on the target program notices the notification, and to reduce the possibility that the notification may be disturbed. The communication process is, for example, a process of causing an image indicated by image data to be recorded on a recording apparatus, a process of receiving image data generated by a reading apparatus, or converting a format of content data to a server. It includes processing for receiving content data.

  (2) Preferably, the portable terminal includes a plurality of input / output units that output information or receive input of information. The display unit doubles as at least a part of the input / output unit. The communication program causes the portable terminal to execute a second determination process of determining the use status by the target program for each of the plurality of input / output units, and the use status determined in the second determination process in the acquisition process The program identification information corresponding to is acquired as the target identification information.

  In recent years, a large number of programs have been provided for mobile terminals, so it is not realistic to associate notification methods with all programs in advance. Therefore, according to the above configuration, since the type of the target program can be estimated based on the usage status of the input / output unit, the end of the communication processing can be notified by a method suitable for the target program.

  (3) For example, the portable terminal includes a speaker that outputs sound. The speaker doubles as at least a part of the notification unit and the input / output unit. The display unit can switch between a full screen mode in which the image instructed by the program is displayed in the entire display area and a partial screen mode in which a part of the display area is displayed. The program identification information identifies the type of the program. Then, in the acquisition process when the communication program determines that the display unit is used in the full screen mode in the second determination process, the program identification information indicating a video reproduction program is identified as the target identification. Acquire as information.

  (4) As an example, the communication program selects, as the second notification method corresponding to the video reproduction program, a method of notifying only the speaker among the display unit and the speaker in the selection process, In the second notification process, a notification sound for notifying the end of the communication process is output to the speaker.

  It is highly likely that the user executing the video playback program in the foreground is focusing on the video displayed on the display unit of the portable terminal. In such a case, when the notification is performed through the display unit, the user may feel that the notification is in the way, so it is desirable to notify through the speaker.

  (5) As another example, the communication program selects, as the second notification method corresponding to the video reproduction program, a method of causing a message to be displayed on the peripheral portion of the display area of the display unit in the selection process. In the second notification process, a message notifying the end of the communication process is displayed on the peripheral portion of the display area on the display unit.

  It is highly likely that the user executing the video playback program in the foreground is focusing on the video displayed on the display unit of the portable terminal. Therefore, when the notification is performed through the display unit, the possibility that the user notices the notification increases. Further, by displaying a message on the peripheral portion of the display unit, it is possible to reduce the possibility that the user feels that the notification is in the way.

  (6) For example, the portable terminal includes a speaker that outputs sound. The speaker doubles as at least a part of the notification unit and the input / output unit. The program identification information identifies the type of the program. Then, the communication program acquires, as the target identification information, the program identification information indicating an audio reproduction program in the acquisition process when it is determined in the second determination process that the speaker is used.

  (7) For example, the communication program selects, as the second notification method corresponding to the sound reproduction program, a method of causing the speaker to output a notification sound together with the sound being output by the target program in the selection process. In the second notification process, the speaker is made to narrow down the volume of the sound being output by the target program, and the notification sound to notify the end of the communication process is output.

  It is highly likely that a user who is executing a voice reproduction program in the foreground is paying attention to the voice output from the speaker of the portable terminal. Therefore, when the notification is performed through the speaker, the possibility that the user notices the notification increases. Further, by narrowing down the volume of the sound being output by the sound reproduction program at the time of the notification processing, the possibility that the user notices the notification sound can be further enhanced.

  (8) For example, the mobile terminal includes an operation unit that receives a user operation. The operation unit doubles as at least a part of the notification unit. The program identification information identifies the type of the program. Then, the communication program acquires the program identification information indicating a game program as the target identification information in the acquisition process when it is determined in the second determination process that the use frequency of the operation unit is equal to or higher than the threshold. Do.

  (9) For example, the communication program selects, as the second notification method corresponding to the game program, a method of causing a message to pop up in the lower part of the display area of the display unit in the selection process, and the second notification In the processing, a message for notifying the end of the communication processing is popped up on the display unit.

  A user who is executing a game program in the foreground is highly likely to focus on the game image displayed on the display unit of the mobile terminal. In addition, particularly in a game that requires real-time performance, a moving game image is displayed at the top and center of the display area, and static information such as status is often displayed at the bottom of the display area. Therefore, as in the above configuration, by displaying a message in the lower part of the display area of the display unit, it is possible to make the user notice the notification and to reduce the possibility that the user feels the notification in the way.

  (10) For example, the mobile terminal includes a storage unit. The storage unit stores the program identification information and the use status of each of the plurality of input / output units associated with the program identification information. Then, in the acquisition process, the communication program acquires, as the target identification information, the program identification information associated with the usage status determined in the second determination process.

  (11) Preferably, the portable terminal includes a storage unit. The storage unit stores the program identification information and the notification method associated with the program identification information. Then, the communication program acquires the target identification information from the OS of the portable terminal in the acquisition processing, and the notification method associated with the target identification information in the selection processing is the second notification method. Choose as.

  As described above, by registering in advance identification information of a typical program installed in many mobile terminals and a notification method associated with the identification information, a method suitable for the program The end of the communication process can be notified.

  (12) Preferably, the portable terminal includes an operation unit that receives a user operation. Then, the communication program receives, through the operation unit, a user operation specifying the program identification information and the notification method, the program identification information having received the specification in the first reception processing, and the notification And causing the portable terminal to execute a first storage process in which a method is associated and stored in the storage unit.

  According to the above configuration, the notification method associated with the identification information can be customized according to the preference of the user.

  (13) Preferably, the portable terminal includes a plurality of input / output units that output information or receive input of information. The display unit and the operation unit double as at least a part of the input / output unit. The communication program causes the portable terminal to execute a third determination process of determining whether the target identification information associated with the method is stored in the storage unit, and the target identification information is stored. In the selection process when it is determined in the third determination process, the notification method associated with the object identification information is selected as the second notification method, and the object identification information is not stored. Causing the portable terminal to execute a fourth determination process of determining the use status by the target program for each of the plurality of input / output units in the acquisition process when determined by the third determination process, and the fourth determination The program identification information corresponding to the use status determined in the process is acquired as the target identification information.

  According to the above configuration, even when the target program for which the program identification information is not registered is being executed in the foreground, the end of the communication processing can be notified by a method suitable for the target program.

  (14) Preferably, the portable terminal includes a voice communication unit that transmits and receives voice data to and from an external device through a telephone line. Then, the communication program causes the portable terminal to execute a fifth determination process of determining whether the voice communication unit is transmitting or receiving the voice data. Then, the communication program causes the portable terminal to wait for execution of the second notification process in response to the determination in the fifth determination process that the audio data is being transmitted and received, and the audio data is being transmitted and received. If not, the second notification process is performed by the portable terminal according to the determination in the fifth determination process.

  According to the above configuration, it is possible to prevent the notification of the end of the communication process from disturbing the call.

  (15) Preferably, the portable terminal includes a speaker that outputs sound. The speaker doubles as at least a part of the notification unit. The speaker can be switched to the permission mode in which the output of sound is permitted and the restriction mode in which the output of sound is restricted. The communication program causes the portable terminal to execute a sixth determination process of determining whether the speaker is in the permission mode or the restriction mode. Then, the communication program causes the speaker to output a notification sound in the second notification process when it is determined in the sixth determination process that the mode is the permission mode.

  (16) More preferably, the portable terminal includes an attachment portion to which an external speaker can be attached. The mounting unit also serves as at least a part of the notification unit. The communication program causes the portable terminal to execute a seventh determination process of determining whether the external speaker is attached to the attachment unit. Then, in the second notification process when it is determined in the sixth determination process that the restriction mode is set, and in the seventh determination process that the external speaker is attached, a notification sound indicating a notification sound A signal is output to the external speaker through the mounting unit.

  (17) More preferably, the portable terminal includes a vibrator that vibrates the portable terminal. The vibrator also serves as at least a part of the notification unit. The communication program determines in the sixth determination process that the communication mode is the restriction mode, and determines that the external speaker is not attached in the second determination process in the seventh determination process. The vibrator vibrates the portable terminal.

  According to each of the above configurations, the output destination of the notification sound can be changed in accordance with the state of the portable terminal. In the case of the so-called manner mode, the end of the communication process can be notified by vibration instead of the notification sound.

  (18) Preferably, in response to the communication program being switched from the foreground to the background, the OS of the portable terminal causes the display unit to display a switching object. The switching object is an image for receiving a user operation instructing to execute the communication program in the foreground. Then, the communication program causes the notification unit to output a message prompting the user operation to the switching object in the notification process.

  According to the above configuration, it is possible to prompt the user to start processing to be executed after communication processing in the program.

  (19) For example, the mobile terminal includes an operation unit that receives a user operation. The communication process is a process of receiving the content data from the external device. The communication program receives, through the operation unit, a user operation specifying a storage destination of the content data received in the communication process in response to switching to the foreground after execution of the notification process. And causing the portable terminal to execute a second storage process of storing the content data in the storage destination received in the second reception process.

  (20) For example, the first notification method is a method of switching the screen displayed in the display area of the display unit to a screen for notifying the end of the communication process.

  (21) For example, the notification method selectable in the selection process includes the same notification method as the first notification method.

  According to the present invention, the end of communication processing can be notified by a notification method suitable for the target program being executed in the foreground.

FIG. 1 is a schematic view of a communication system 100 according to the present embodiment. FIG. 2A is a functional block diagram of the MFP 10, and FIG. 2B is a functional block diagram of the portable terminal 50. As shown in FIG. FIG. 3 shows an example of information stored in the data storage area 62B, where (A) shows a program ID list and (B) shows a notification method list. FIG. 4 is an example of the usage status list stored in the data storage area 62B. FIG. 5 is a flowchart of the image reading process. FIG. 6 is a flowchart of the acquisition process. FIG. 7 is a flowchart of notification processing. FIG. 8 is a display example of the display unit 53, in which (A) shows a scan instruction screen and (B) shows a save destination designation screen. FIG. 9 is a display example of the display unit 53, in which (A) shows a reproduction screen and (B) shows a reproduction screen on which a pop-up message is superimposed. FIG. 10 is a display example of the display unit 53, where (A) is an example of a music reproduction screen, and (B) is an example of a game screen. FIG. 11 is a display example of the display unit 53, where (A) is an example of the SNS screen, and (B) is an example of the notification method edit screen.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiments described below are merely examples of the present invention, and it goes without saying that the embodiments of the present invention can be appropriately modified without departing from the scope of the present invention.

  FIG. 1 is a schematic view of a communication system 100 in the present embodiment. The communication system 100 shown in FIG. 1 includes a multifunction machine 10, a portable terminal 50, and a server 70. However, one of the MFP 10 and the server 70 can be omitted. The MFP 10, the portable terminal 50, and the server 70 can communicate with each other through a communication network. The specific example of the communication network is not particularly limited, but may be, for example, the Internet 101, a wired LAN (abbreviation of Local Area Network), the wireless LAN 102, or a combination thereof.

  The MFP 10 and the portable terminal 50 belong to the wireless LAN 102 as shown in FIG. The wireless LAN 102 is connected to the Internet 101 through a router or the like (not shown). Note that “belonging to the wireless LAN 102” indicates that the setting for belonging to the wireless LAN 102 is made and that communication with another device belonging to the wireless LAN 102 is possible. More specifically, the same SSID as that of the access point 102A of the wireless LAN 102 is set in the MFP 10 and the portable terminal 50, and a network address assigned to the wireless LAN 102 is assigned.

  Note that wireless communication is not limited to wireless communication being performed in the entire communication zone. That is, the phrase “the MFP 10 wirelessly transmits or wirelessly receives information or data via the access point 102A” is only required to execute wireless communication between the MFP 10 and the access point 102A. The same applies to the portable terminal 50.

  The server 70 is also connected to the Internet 101. Then, the MFP 10 and the portable terminal 50 can communicate with the server 70 via the Internet 101 from the access point 102A and a router (not shown). Furthermore, the portable terminal 50 may be connected to the Internet 101 through a base station (not shown). Then, the mobile terminal 50 may be able to wirelessly communicate with the server 70 from the base station via the Internet 101. A router and a base station (not shown) are examples of communication devices.

[MFP 10]
As illustrated in FIG. 2A, the MFP 10 communicates with the printer unit 11, the scanner unit 12, the display unit 23, the operation unit 24, the communication unit 25, the CPU 31, the storage unit 32, and the communication unit 25. The bus 33 is mainly provided. The components constituting the multi-function device 10 are mutually connected through the communication bus 33. The multifunction peripheral 10 is an example of an external apparatus or an image forming apparatus that processes content data.

[Printer 11 and Scanner 12]
The printer unit 11 executes recording processing for recording an image indicated by image data on a recording sheet. The recording sheet is an example of a sheet or a recording medium. As a recording method of the printer unit 11, a known method such as an inkjet method or an electrophotographic method can be adopted. The scanner unit 12 executes a scan process of reading an image recorded on a document and generating image data. The multifunction machine 10 may further have a fax function for transmitting and receiving a fax, and a copy function for reading an image recorded on a recording sheet and recording the image on another recording sheet.

[Display 23]
The display unit 23 includes a display screen for displaying various information. As the display unit 23, a liquid crystal display (abbreviation of Liquid Crystal Display), an organic EL display (abbreviation of Organic Electro-Luminescence Display) or the like can be adopted.

[Operation 24]
The operation unit 24 receives an operation of a user who selects an object displayed on the display screen of the display unit 23. Specifically, the operation unit 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Furthermore, the operation unit 24 may have a film-like touch sensor superimposed on the display screen of the display unit 23. That is, the display unit 23 may be configured as a touch panel display.

  Note that “object” refers to an image that can be selected by the user operating the operation unit 24. As an example, the object is a character string displayed on the display unit 23. One of the objects is highlighted when the direction key of the operation unit 24 is pressed, and high when the determination button of the operation unit 24 is pressed. An object displayed in light may be selected. As another example, the object when the operation unit 24 is a touch panel may be an icon, a button, a link, or the like displayed on the display unit 23, and an object displayed at the touch position may be selected.

  The operation unit 24 realized as a touch panel receives a user operation of touching the display screen of the display unit 23. The operation unit 24 also outputs position information indicating the position on the display screen touched by the user. The position information can be expressed, for example, as coordinates (x, y) on the xy plane with the upper left end of the display screen as the origin, the right direction as the positive direction of the x axis, and the downward direction as the positive direction of the y axis. A well-known system such as an electrostatic capacity system or a resistive film system can be adopted as the touch sensor.

  Note that “touch” in the present specification includes all operations for causing an input medium to contact a display screen. That is, a tap operation to separate the touched input medium from the display screen within a predetermined time, a long touch operation to stop the touched input medium on the display screen, a slide operation to slide the touched input medium on the display screen, the display screen Flick operation where the acceleration of the input medium sliding on the top is above the threshold, pinch-in operation to slide the two input media touched at different positions on the display screen towards each other, two touched at different positions on the display screen A pinch out operation or the like in which the input media are slid away from each other is an example of a touch.

  Further, even if the input medium does not touch the display screen, bringing the input medium close to a position where the distance to the display screen is very small may be included in the concept of “touch” described above. Furthermore, the input medium may be a finger of the user, a touch pen, or the like.

[Communication unit 25]
The communication unit 25 is an interface for communicating with an external device. The MFP 10 can transmit and receive various information or data through the communication unit 25 with, for example, the portable terminal 50 and the server 70 or the like. Although the specific communication procedure of the communication unit 25 is not particularly limited, for example, Wi-Fi (registered trademark of Wi-Fi Alliance) can be adopted.

[CPU31]
A CPU (abbreviation of Central Processing Unit) 31 controls the overall operation of the multifunction machine 10. The CPU 31 acquires various programs to be described later from the storage unit 32 and executes the programs. The CPU 31 executes various processes based on various information output from the operation unit 24 and various information acquired from an external device through the communication unit 25 by executing various programs. The CPU 31 and the storage unit 32 constitute an example of a control unit.

[Storage unit 32]
The storage unit 32 has a program storage area 32A and a data storage area 32B. The program storage area 32A stores an OS (abbreviation of Operating System) 34 and a control program 35. The OS 34 and the control program 35 are programs built in binary format. The control program 35 may be a single program or a collection of a plurality of programs. The data storage area 32B stores data or information (hereinafter sometimes referred to as "data etc.") necessary for the execution of the control program 35.

  Note that "data" and "information" in the present specification are common in that they are bits or bit strings that can be handled by a computer. "Data" refers to data that can be handled without the computer taking into consideration the semantic content indicated by each bit. On the other hand, "information" indicates that the operation of the computer branches depending on the meaning content indicated by each bit. Furthermore, the "instruction" is a control signal for prompting the destination apparatus to perform the next operation, which may include information, and itself has an information property. There is also.

  Also, "data" and "information" have the same data and information as long as they are recognized as having the same semantic content even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer. Treated as For example, information indicating "two" is held as text information of "0x32" in ASCII code in one computer, and held in binary notation of "10" in binary notation in another computer. It may be done.

  However, the above distinction between "data" and "information" is not strict, and exceptional handling is also permitted. For example, data may be temporarily treated as information, or information may be temporarily treated as data. Also, what is treated as data in one device may be treated as information in another device. Furthermore, information may be extracted from the data, and data may be extracted from the information.

  The storage unit 32 includes, for example, RAM (abbreviation of Random Access Memory), ROM (abbreviation of Read Only Memory), EEPROM (abbreviation of Electrically Erasable Programmable Read-Only Memory), HDD (abbreviation of Hard Disk Drive), and CPU 31. It is configured by a buffer or the like, or a combination thereof.

  The storage unit 32 may be a computer readable storage medium. The computer readable storage medium is a non-transitory medium. The non-transitory medium also includes a recording medium such as a CD-ROM, a DVD-ROM, etc. in addition to the above example. In addition, non-transitory media are tangible media. On the other hand, an electrical signal carrying a program downloaded from a server or the like on the Internet is a computer readable signal medium, which is a type of computer readable medium, but a non-transitory computer readable storage. It is not included in the medium.

  The programs stored in the program storage area 32A are executed by the CPU 31. However, in the present specification, the operation of each program may be described with the CPU 31 omitted. That is, in the following description, the description that "the program A executes the process A" may indicate that "the CPU 31 executes the process A described in the program A".

  The program stored in the program storage area 32A determines an event and operates according to the determination result. However, in the present specification, the operation of each program may be described by omitting judgment. That is, in the following description, the description that "the program executes the process A according to the condition A" determines whether the program is the condition A. The program is an affirmative determination. May be referred to as “performing process A”.

  The program stored in the program storage area 32A specifies, acquires, extracts or selects data and the like. When the program specifies data etc., for example, data that meets the condition is specified from among a plurality of data etc., and the data itself etc. or information for identifying the data etc. is stored in a predetermined storage area Point to processing. The information for identifying data or the like is, for example, identification information for identifying the data or the like, an index of an array in which the data or the like is stored, a pointer of a storage area in which the data or the like is stored, or the like. The same applies to processing in which the program acquires, extracts, or selects data and the like.

  The OS 34 provides an API (abbreviation of application programming interface) for controlling the printer unit 11, the scanner unit 12, the display unit 23, the operation unit 24, the communication unit 25 and the like which are hardware components of the MFP 10. It is a basic program. That is, each of the above programs controls each hardware by calling an API provided by the OS 34. However, in this specification, the OS 34 may be omitted to explain the operation of each program. That is, in the following description, the description that “the program B controls the hardware C” may indicate that “the program B controls the hardware C through the API of the OS 34”.

[Mobile terminal 50]
As shown in FIG. 2B, the portable terminal 50 includes a display unit 53, an operation unit 54, a communication unit 55, a voice communication unit 56, a speaker 57, a mounting unit 58, and a vibrator 59. A CPU 61, a storage unit 62, and a communication bus 63 are mainly provided. The display unit 53, the operation unit 54, the communication unit 55, the CPU 61, the storage unit 62, and the communication bus 63 included in the portable terminal 50 are included in the display unit 23, the operation unit 24, the communication unit 25, the CPU 31, Since the same as the storage unit 32 and the communication bus 33, the description thereof will not be repeated.

  The voice communication unit 56 implements a call function of transmitting and receiving voice data to and from an external device through a telephone line. More specifically, the portable terminal 50 transmits voice data indicating voice collected by a microphone (not shown) to an external device through the voice communication unit 56, and is indicated by voice data received from the external device through the voice communication unit 56. Output the voice through the speaker. The speaker used to realize the call function may be the speaker 57, or may be a speaker attached to the attachment unit 58, or a call provided in advance to the portable terminal 50 separately from the speaker 57. It may be a dedicated speaker.

  The speaker 57 is for outputting sound. The mounting unit 58 is an interface to which an external speaker can be mounted. The external speaker may be, for example, in the form of an earphone or a headphone. The vibrator 59 vibrates the portable terminal 50. The vibrator 59 generates vibration, for example, by rotating an eccentric weight with a motor.

  The display unit 53 can be switched between a full screen mode in which the image instructed by the program is displayed over the entire display area and a partial screen mode in which the image instructed by the program is displayed in part of the display area. The full screen mode of this embodiment may indicate a so-called full screen mode. The mode in which the display unit 53 is used may be instructed by, for example, a program executed in the foreground, or may be instructed by the user through the operation unit 54.

  In the full screen mode, for example, as shown in FIG. 9A, only the screen instructed by the program being executed in the foreground is displayed on the display unit 53. In the partial screen mode, for example, as shown in FIG. 10A, a status bar 80 instructed by the OS 64 is displayed on the display unit 53 in addition to the screen instructed by the program being executed in the foreground. It is. The status bar 80 displays, for example, the title of the screen displayed by the program, the remaining battery level of the portable terminal 50, the state of communication with the access point 102A, or an icon indicating the state of the program being executed in the background. Be done.

  The speaker 57 can be switched between a permission mode in which the output of sound is permitted and a restriction mode in which the output of sound is restricted. The permission mode is a state in which the audio is output from the speaker 57 when an API that instructs output of audio is executed by a program. The restriction mode is a state in which the audio is not output from the speaker 57 when an API for instructing the output of the audio is executed by the program. The restriction mode of the present embodiment may indicate a so-called manner mode. The mode in which the speaker 57 is used may be instructed by the user through the operation unit 54, for example.

  The mobile terminal 50 may be, for example, a smartphone, a tablet terminal, or the like. The display unit 53, the speaker 57, the mounting unit 58, and the vibrator 59 constitute a part of a notification unit that notifies by the notification method selected from the plurality of notification methods. The display unit 53, the operation unit 54, the voice communication unit 56, and the speaker 57 are an example of a plurality of input / output units that output information or receive input of information. The notification unit and the input / output unit are not limited to the above examples. For example, a camera mounted on the portable terminal 50 may be included in the input / output unit.

  The program storage area 62A stores the OS 64. The OS 64 of the mobile terminal 50 may be, for example, Android (registered trademark of Google inc.) OS, iOS (registered trademark of Cisco Systems, Inc.), Windows Phone (registered trademark of Microsoft Corporation) Operating System, or the like.

  The OS 64 can execute a plurality of programs installed in the portable terminal 50 in parallel. The plurality of programs are executed virtually in parallel by, for example, time division multiplexing. In addition, the OS 64 executes one of a plurality of programs in the foreground and executes the other programs in the background. In the foreground, for example, a screen according to the execution of the program is displayed in most of the display area of the display unit 53. In the background, for example, a screen based on the execution of a program different from the program is displayed in most of the display area of the display unit 53.

  The program storage area 62A also stores a scan program 65 and a moving image program 66. The scan program 65 causes the MFP 10 to execute a scan process, receives image data generated by the scan process from the MFP 10, and stores the received image data in a location designated by the user. . The scan program 65 is an example of a communication program. Image data is an example of content data. The moving picture program 66 is a program for reproducing a moving picture and sound accompanying the moving picture. However, the program that can be installed in the portable terminal 50 is not limited to the moving image program 66, and may be, for example, a music program, a game program, or a social networking service (SNS) program.

  The scan program 65 can display a screen on the display area of the display unit 53 by executing the API provided by the OS 64. The OS 64 provides two APIs that cause the display unit 53 to display a screen. The first type of API causes the display unit 53 to display the specified screen only when the scan program 65 is being executed in the foreground. The second type of API causes the display unit 53 to display a designated screen regardless of whether the scan program 65 is being executed in the foreground or in the background. In other words, the screen displayed by the second type of API is displayed on the display unit 53 so as to be superimposed on the screen displayed by the program being executed in the foreground. These APIs can also be used by other programs installed on the portable terminal 50.

  As shown in FIG. 3A, the data storage area 62B stores a program ID and type information associated with the program ID. Hereinafter, the information shown in FIG. 3A may be collectively referred to as a program ID list, and each record shown in FIG. 3A may be referred to as a program ID record. The program ID is information that uniquely identifies a program that can be installed on the portable terminal 50. The type information is information indicating the type of program that can be installed on the portable terminal 50. Each program installable in the portable terminal 50 is associated with only one program ID, and is associated with one or more types of type information. Further, each type information is associated with one or more programs. The program ID and the type information are an example of program identification information.

  In the present embodiment, the scan program 65 is identified by the program ID "001", and the moving image program 66 is identified by the program ID "002". The list shown in FIG. 3 (A) only needs to store program IDs of typical programs that can be installed in the portable terminal 50, even if program IDs of all the programs are not included. Good. Also, in the present embodiment, the type information of the scan program 65 is “communication program”, and the type information of the moving image program 66 is “video reproduction program”.

  Also, as shown in FIG. 3B, the data storage area 62B stores type information and a notification method associated with the type information. Hereinafter, the information illustrated in FIG. 3B may be collectively referred to as a notification method list, and each record illustrated in FIG. 3B may be referred to as a notification method record. The notification method indicates a method in which the scan program 65 notifies the end of the communication processing described later when the program indicated by the corresponding type information is being executed in the foreground. The notification method indicates a method of notification through the display unit 53 and a method of notification through the speaker 57.

  For example, the notification method associated with the type information “video reproduction program” is a method of causing the display unit 53 to display a pop-up message and not causing the speaker 57 to output sound. The notification method associated with the type information “audio reproduction program” does not display a message on the display unit 53, but reduces the volume of the audio being output by the audio reproduction program, and sends a notification sound to the speaker 57 together with the audio. It is a method of outputting. The notification method associated with the type information “game program” is a method of causing the display unit 53 to display a pop-up message and causing the speaker 57 to output a notification sound. The notification method associated with the type information “SNS program” is a method of causing the display unit 53 to display a head-up message and causing the speaker 57 to output a notification sound. The notification method associated with the type information “menu screen” is a method of causing the display unit 53 to display a toast message and causing the speaker 57 to output a notification sound.

  The “pop-up message” is a display method for causing a message to appear upward from the lower end of the display area of the display unit 53. The “head up message” is a display method for causing a message to appear from the upper end of the display area of the display unit 53 downward. That is, the pop-up message and the head-up message are methods for displaying a message on the peripheral portion of the display area of the display unit 53. The “toast message” is a display method of causing a message to appear in the central portion of the display area of the display unit 53 and automatically hiding the message after a predetermined time has elapsed. Furthermore, although illustration is omitted, the "dialog message" is a display method that causes an icon for accepting a user operation indicating that the message has been confirmed to appear with the message, and hides the message by selecting the icon. is there. The scan program 65 can display “pop-up message”, “head-up message”, “toast message”, “dialog message”, etc. in the display area of the display unit 53 by using the second type API. .

  Furthermore, as shown in FIG. 4, the data storage area 62B stores type information and a use status associated with the type information. Hereinafter, the information shown in FIG. 4 may be collectively referred to as a usage status list, and each record shown in FIG. 4 may be referred to as a usage status record. The usage status is information indicating whether or not the input / output unit is being used or how the input / output unit is being used by the program being executed in the foreground. The usage status of each of the plurality of input / output units is associated with each type information shown in FIG.

  For example, the usage status “o” is an input / output unit that is always used by the program indicated by the corresponding type information. The use status “Δ” is an input / output unit that may or may not be used by the program indicated by the corresponding type information. The use status “x” is an input / output unit that is not used by the program indicated by the corresponding type information. Further, the usage condition "full screen" of the display unit 53 indicates that the program indicated by the type information "video reproduction program" uses the display unit 53 in the full screen mode. Furthermore, the use status "use frequency ≧ threshold" of the operation unit 54 indicates that the program indicated by the type information "game program" receives user operations of the number of times equal to or more than the threshold through the operation unit 54 within a predetermined period. Show.

  The various information shown in FIGS. 3 and 4 is executed by the scan program 65. The various information shown in FIGS. 3 and 4 may be stored, for example, in an ini file read by the scan program 65 at startup, or may be directly described in the source code of the scan program 65. The various information shown in FIGS. 3 and 4 may be updated by the server 70, for example, or may be editable by the user through the scan program 65.

[Server 70]
The server 70 executes processing in accordance with various request information received from the portable terminal 50. For example, the server 70 stores the data received from the portable terminal 50 in the storage unit, transmits the requested data to the portable terminal 50, or the first format data received from the portable terminal 50 in the second format. And transmit the data of the second format to the portable terminal.

[Operation of scan program 65]
The operation of the scan program 65 according to the present embodiment will be described with reference to FIGS. 5 to 9. The scanner program 65 causes the MFP 10 to execute scan processing in accordance with the user's instruction, and notifies the user that the reception of the image data generated by the scan processing has been completed from the MFP 10. In the present embodiment, a method of realizing the following processes using an API provided by the Android OS will be described, but the method may be realized by an API provided by another OS, or realized by a method other than the API. It may be done.

  First, the scan program 65 executed in the foreground causes the display unit 53 to display a scan instruction screen (S11). FIG. 8A is an example of a scan instruction screen. The scan instruction screen shown in FIG. 8A includes a [scanner] icon, an [original size] icon, a [scan quality] icon, and a [scan] icon. The OS 64 also displays a status bar 80 at the top of the display area of the display unit 53. Then, the scan program 65 receives, through the operation unit 54, a user operation of tapping the positions of various icons included in the scan instruction screen (S12).

  The [scanner] icon is an icon for receiving a selection of a scanner that executes a scan process. The [document size] icon and the [scan quality] icon are icons for receiving a user operation for specifying an execution condition of scan processing. The user can select another reader with which the portable terminal 50 can communicate by tapping the position of the [Scanner] icon. Also, the user can change the execution condition of the scan process by tapping the position of the [document size] icon and the [scan quality] icon.

  The [scan] icon is an icon for receiving a user operation instructing the scanner selected through the operation on the [scanner] icon to execute a scan process. The multifunction peripheral 10 is an example of a scanner selected through the selection to the [Scanner] icon. That is, when the position of the [scan] icon is tapped (S12: Yes), the scan program 65 transmits scan instruction information through the communication unit 55 to the multi-function device 10 indicated by the [scanner] icon (S13) ). The scan instruction information is information for instructing execution of scan processing. The scan instruction information includes setting values indicating the execution conditions of the scan process indicated by the [document size] icon, the [scan image quality] icon, and the like. Then, the scan program 65 waits for reception of the image data through the communication unit 55 (S14). The processes of steps S13 and S14 are an example of the communication process.

  Although illustration is omitted, the control program 35 of the MFP 10 receives scan instruction information from the portable terminal 50 through the communication unit 25. Next, the control program 35 causes the scanner unit 12 to execute the scan process according to the setting value included in the scan instruction information. The scanner unit 12 reads an image recorded on a document set on a contact glass or an ADF (abbreviation of Auto Document Feeder), and generates image data. Then, the control program 35 transmits the image data to the portable terminal 50 through the communication unit 25.

  Next, the scan program 65 receives image data from the MFP 10 through the communication unit 55, that is, in response to the end of the communication process (S14: Yes), the scan program 65 is either foreground or background. At step S15, it is determined whether the process is being executed. For example, the scan program 65 obtains the class “ActivityManager” from the OS 64 and executes the function “getRunningAPPProcesses ()” to obtain a list of program IDs of programs being executed. The list of program IDs is a list of program IDs of programs being executed by the OS 64 in parallel. The program ID of the program being executed in the foreground is stored at the top of the list.

  The scan program 65 determines that the scan program 65 is being executed in the foreground in response to the program ID "001" being stored at the top of the acquired list (S15: No). On the other hand, the scan program 65 determines that the scan program 65 is being executed in the background according to the fact that the program ID different from the program ID "001" is stored at the top of the acquired list (S15: Yes). ). The process of step S15 is an example of a first determination process.

  Next, the scan program 65 uses the first type of API in response to the reception of the image data being completed and determining that the scan program 65 is being executed in the foreground (S15: No). The designation screen is displayed on the display unit 53 (S20). FIG. 8B is an example of the save destination designation screen. The process of step S20 executed by the scan program 65 executed in the foreground is an example of a first notification process in which the end of the communication process is notified by the first notification method. That is, the first notification method in the present embodiment corresponds to displaying the storage destination designation screen shown in FIG. 8 (B).

  The save destination designation screen shown in FIG. 8B includes a message of “specify a save destination of the received image data” and one or more save destination icons 111, 112, 113. The storage destination icons 111 to 113 correspond to the storage destination of the image data received in step S14. For example, the storage destination icon 111 corresponds to a data folder provided in the data storage area 62B. In addition, storage destination icons 112 and 113 correspond to storage servers (not shown).

  Next, the scan program 65 receives a user operation on the save destination designation screen through the operation unit 54 (S21). Then, in response to the user's operation of tapping the positions of the storage destination icons 111 to 113 being accepted through the operation unit 54 (S21: Yes), the scan program 65 transfers the image data to the storage destination corresponding to the storage destination icon. It memorizes (S22). The processes of steps S20 and S21 are an example of a second accepting process of accepting a user operation of designating a storage destination of content data. The process of step S22 is an example of a second storage process for storing the content data in the storage destination received in the second reception process.

  Depending on the number of documents scanned in the scan process or the scanning resolution indicated by the [Scan Quality] icon, it may take some time from transmission of scan instruction information to completion of reception of image data. is there. Therefore, the user of the portable terminal 50 can execute another program installed on the portable terminal 50, for example, the moving picture program 66 in the foreground while the scan program 65 is waiting for completion of reception of image data. .

  The moving image program 66 executed in the foreground causes the display unit 53 in the full screen mode to display the playback screen. FIG. 9A shows an example of the reproduction screen. The reproduction screen shown in FIG. 9A is a screen for reproducing a moving image using the entire display area of the display unit 53. That is, the moving picture program 66 switches the display unit 53 to the full screen mode, and executes the first type of API for displaying the reproduction screen. Further, the status bar 80 is not displayed on the display unit 53 when the playback screen is displayed. As a result, the scan program 65 is executed in the background.

  Therefore, the scan program 65 executes the acquisition process (S16) in response to the determination that the reception of the image data is completed and the scan program 65 is being executed in the background (S15: Yes). The acquisition process is a process of acquiring program identification information that identifies a program being executed in the foreground (hereinafter, may be referred to as a “target program”). In the acquisition process in the present embodiment, type information of a target program is acquired. The details of the acquisition process will be described with reference to FIG.

  First, the scan program 65 acquires the program ID of the target program (S31). The scan program 65 may acquire, for example, the program ID stored at the top of the list acquired in step S15, or may acquire a new list again in step S31. In the present embodiment, the scan program 65 acquires the program ID “002” of the moving image program 66.

  Next, the scan program 65 determines whether the acquired program ID is registered in the program ID list (S32). The process of step S32 is an example of a third determination process. Then, when the scan program 65 determines that the acquired program ID is registered in the program ID list (S32: Yes), the program ID in the program ID list shown in FIG. The type information “video reproduction program” associated with “002” is acquired as the type of the target program (S33).

  On the other hand, in response to determining that the acquired program ID is not registered in the program ID list (S32: No), the scan program 65 determines the use status of each input / output unit by the target program (S34). The scan program 65 may determine the use status of each of the plurality of input / output units by executing an API provided by the OS 64, for example. The process of step S34 is an example of the second determination process or the fourth determination process.

  The scan program 65 determines, for example, whether or not the display unit 53 is used in the full screen mode by setting a transparent View to the class “WindowManager” and monitoring the state of the view with the function “OnGlobalLayoutlistener”. do it. In addition, the scan program 65 may obtain the class “AudioManager” from the OS 64, and may determine whether the speaker 57 is outputting audio based on the return value of the function “isMusicActive ()”. Furthermore, the scan program 65 may obtain the class "TelephonyManager" from the OS 64, and may determine whether the voice communication unit 56 is used based on the return value of the function "getCallState ()".

  Then, based on the usage status list shown in FIG. 4, the scan program 65 acquires type information associated with the usage status determined in step S34 as the type of the target program (S35). For example, according to the scan program 65, the display unit 53 is used in the full screen mode, the speaker 57 is used, and the voice communication unit 56 is not used. The reproduction program may be acquired (S35).

  Returning to FIG. 5, the scan program 65 selects a notification method associated with the type information “video reproduction program” acquired in the acquisition processing based on the notification method list shown in FIG. 3B (S17). ). The process of step S17 is an example of the selection process. The notification method selected in step S17 is an example of a second notification method. Then, the scan program 65 executes the notification process by the notification method selected in the selection process (S18). Details of the notification process will be described with reference to FIG.

  First, the scan program 65 determines whether a call is in progress. Specifically, the scan program 65 determines whether the voice communication unit 56 transmits and receives voice data (S41). The method of determination is the same as that of step S34, so the description thereof will be omitted. The process of step S41 is an example of a fifth determination process. Then, in response to determining that the voice communication unit 56 is transmitting and receiving voice data (S41: Yes), the scan program 65 waits for execution of the subsequent process. The scan program 65 repeatedly executes the process of step S41 at predetermined time intervals until transmission and reception of audio data is completed.

  Next, in response to determining that the voice communication unit 56 does not transmit or receive voice data (S41: No), the scan program 65 determines whether the speaker 57 is in the restriction mode (S42). The scan program 65 may determine, for example, whether or not the speaker 57 is in the restriction mode by executing an API in which the state of the speaker 57 is indicated by a return value. The process of step S42 is an example of a sixth determination process.

  Next, in response to the determination that the speaker 57 is in the permission mode (S42: No), the scan program 65 determines the output destination of the notification sound as the speaker 57 (S43). Then, the scan program 65 notifies completion of reception of the image data by the selected notification method (S47). For example, as shown in FIG. 9B, the scan program 65 according to the present embodiment causes the display unit 53 to pop-up a message “Scan data has been received” and outputs a notification sound to the speaker 57. Let It is assumed that the pop-up message 81 is displayed superimposed on the playback screen, and playback of the moving image on the playback screen is continued. The process of step S47 is an example of a second notification process.

  On the other hand, in response to the determination that the speaker 57 is in the restriction mode (S42: Yes), the scan program 65 determines whether the external speaker (typically, an earphone) is attached to the attachment unit 58. (S44). The scan program 65 acquires, for example, the class "" AudioManager "from the OS 64, and determines whether or not the earphone is attached to the mounting unit 58 based on the return value of the function" isWiredHeadsetOn () ". , And an example of a seventh determination process.

  Further, when it is determined that the earphone is attached to the attachment unit 58 (S44: Yes), the scan program 65 determines the output destination of the notification sound as the earphone (S45). Then, the scan program 65 causes the display unit 53 to display the pop-up message 81 and outputs a notification sound signal indicating a notification sound to the earphone through the mounting unit 58, as shown in FIG. 9B, for example (S47) . As a result, the notification sound is output from the earphone attached to the attachment unit 58.

  Furthermore, when it is determined that the earphone is not attached to the attachment unit 58 (S44: No), the scan program 65 determines to vibrate the vibrator 59 instead of the output of the notification sound (S46). Then, the scan program 65 causes the display unit 53 to display the pop message 81 and causes the vibrator 59 to vibrate the portable terminal 50, as shown in FIG. 9B, for example (S47).

  The user who notices the end of the communication processing by the pop-up message 81 or the notification sound causes the operation unit 54 to perform a user operation to execute the moving image program 66 in the background and to execute the scan program 65 in the foreground. It can be carried out. Therefore, the scan program 65 stands by until the scan program 65 is executed in the foreground (S19). That is, the scan program 65 repeatedly acquires the list of program IDs acquired by the function "getRunningAPPProcesses ()" at predetermined time intervals. Then, in response to the execution of the scan program 65 in the foreground (S19: Yes), the scan program 65 executes the processing of step S20 and subsequent steps. Since the process after step S20 has already been described, the description for the second time will be omitted.

[Operation and effect of the embodiment]
According to the above embodiment, when the scan program 65 is being executed in the background, the communication process is terminated in a notification method suitable for the target program being executed in the foreground in response to the termination of the communication process. Can be notified. As a result, it is possible to improve the possibility that the user who is focusing on the target program notices the notification, and to reduce the possibility that the notification may be disturbed. The specific example of the communication program is not limited to the scan program 65, and any program that communicates with an external device through the communication unit 55 in order to cause the external device to process content data is applicable.

  That is, in the communication processing, the communication program may receive content data from the external device or transmit content data to the external device by communicating with the external device through the communication unit 55. More specifically, the communication process may be a process of recording an image represented by image data in the MFP 10, or may be a process of receiving image data generated by the MFP 10. Alternatively, the process may be a process of converting the format of the content data to the server 70 and receiving the converted content data. The content data may be, for example, image data, moving image data, or music data.

  Further, termination of the communication process may include, for example, completion of reception of the entire image data from the multifunction machine 10, completion of print instruction to the multifunction machine 10, and transmission of image data to be printed on the multifunction machine 10 It may be transmission completion or content data upload to the server 70. Furthermore, communication with the external device may be further performed after the communication determined to be the end of the communication process. As one example, after completion of the print instruction to the multifunction machine 10, the image data to be printed may be further transmitted to the multifunction machine 10. As another example, after transmission of image data to be printed to the multifunction machine 10, a print instruction may be further sent to the multifunction machine 10. As another example, after uploading of content data to the server 70 is completed, an instruction to tag the content data may be further transmitted to the server 70.

  Further, according to the above embodiment, when the program ID of the target program is registered in the program ID list, the notification method associated with the program ID is selected as the second notification method through the type information. Ru. In the example of FIG. 3, the program ID and the type information are associated with each other, and the type information and the notification method are associated with each other. However, the program ID and the notification method may be directly associated with each other. On the other hand, when the program ID of the target program is not registered in the program list, the type of the target program is estimated according to the usage status of the input / output unit. As a result, the end of the communication process can be notified by a method suitable for the target program.

  Further, according to the above embodiment, while the voice communication unit transmits and receives voice data, that is, the execution of the notification process is on standby during the call, the notification of the end of the communication process disturbs the call. Can be prevented. Furthermore, since the speaker 57, the mounting unit 58, and the vibrator 59 are used properly depending on whether or not the so-called manner mode and the earphone are attached, the output destination of the notification sound is changed according to the state of the portable terminal 50. can do.

  In the above embodiment, the user who is executing the moving image program 66 in the foreground is highly likely to focus on the moving image displayed on the display unit 53 of the portable terminal 50. Therefore, by displaying the notification message on the display unit 53, the possibility that the user notices the notification increases. Further, by setting the display method of the message to "pop-up", the overlap with the moving image displayed on the display unit 53 can be reduced, so that the possibility that the user feels that the notification is disturbed can be reduced.

  However, a specific example of the notification method corresponding to the type information “video reproduction program” is not limited to this. For example, the scan program 65 may select a method of notifying only the speaker 57 of the display unit 53 and the speaker 57 as the second notification method corresponding to the type information “video reproduction program”. In the notification process in this case, the reproduction screen continues to be displayed on the display unit 53, and the notification sound is output from the speaker 57. This can further reduce the possibility that the user feels that the notification is in the way.

[Modification]
Next, with reference to FIG. 10 and FIG. 11, the modification of said embodiment is demonstrated. In addition, detailed description of common points with the above-mentioned embodiment is omitted, and differences will be mainly described.

  As an example, a program associated with the type information “audio reproduction program” (hereinafter referred to as “music program”) causes, for example, the music indicated by the music data to be output to the speaker 57, as shown in FIG. ) Is displayed on the display unit 53. The OS 64 also displays a status bar 80 at the top of the display area of the display unit 53. The music playback screen includes a playback icon 115 for accepting a playback instruction of music, a rewind icon 116 for accepting a rewind instruction, a fast forward icon 117 for accepting a fast forward instruction, and an indicator 118 for indicating a playback position of music. And. Then, the music program can receive a user operation on the music reproduction screen through the operation unit 54. That is, the display unit 53 is in the partial screen mode, the speaker 57 is used, and the voice communication unit 56 is not used.

  When such a music program is being executed in the foreground, the scan program 65 acquires type information “music reproduction program” of the target program in step S16. In step S17, the scan program 65 selects a notification method associated with the type information “music reproduction program” in the notification method list as a second notification method. Furthermore, in step S47, the scan program 65 narrows down the volume of the music being output by the music program and causes the speaker 57 to output a notification sound notifying that the communication processing is completed.

  It is likely that a user who is running a music program in the foreground is paying attention to the music being output from the speaker 57 of the portable terminal 50. Therefore, when the notification is performed through the speaker 57, the possibility that the user notices the notification increases. In addition, by narrowing the volume of music being output by the music program at the time of notification processing, it is possible to further increase the possibility that the user notices the notification sound. When the music program causes the earphones attached to the attachment unit 58 to output the music, the notification sound is output from the earphones in the notification process shown in FIG. 7.

  As another example, a program associated with the type information “game program” (hereinafter referred to as “game program”) causes the display unit 53 to display, for example, a game screen shown in FIG. The OS 64 also displays a status bar 80 at the top of the display area of the display unit 53. The game screen includes an animation display area 121 displayed in the upper part of the display area, and a status display area 122 displayed in the lower part of the display area. In the animation display area 121, a character that operates in response to a user operation is displayed. The status display area 122 displays the status of the character and the like. Then, the game program can receive a user operation on the animation display area 121 through the operation unit 54. That is, the display unit 53 is in the partial screen mode, and the operation unit 54 is in a state in which many user operations are continuously received.

  When such a game program is being executed in the foreground, the scan program 65 acquires type information "game program" of the target program in step S16. In step S17, the scan program 65 selects a notification method associated with the type information “game program” in the notification method list as a second notification method. Further, in step S47, the scan program 65 causes the display unit 53 to display a pop-up message 82 for notifying the end of the communication processing, and causes the speaker 57 to output a notification sound. The pop-up message 82 shown in FIG. 10 (B) includes a message “Scan data received. Please tap the switching icon.”.

  The user who is executing the game program in the foreground is highly likely to focus on the game video displayed on the display unit 53 of the portable terminal 50. In addition, particularly in a game that requires real-time performance, a moving game image is displayed at the top and center of the display area, and static information such as status is often displayed at the bottom of the display area. Therefore, by setting the display method of the message to "pop-up", the user can be made to notice the notification, and the possibility that the user feels the notification to be disturbed can be reduced.

  Also, the OS 64 of the portable terminal 50 is switched to the status bar 80 as shown in FIG. 10A to FIG. 11A in response to the scanning program 65 being switched from the foreground to the background. May be displayed. The switching icon 85 is an image for receiving a user operation instructing to execute the scan program 65 in the foreground. Then, in response to the user's operation of tapping the position of the switching icon 85 being accepted through the operation unit 54, the OS 64 executes the game program in the background and executes the scan program 65 in the foreground. Thus, the scan program 65 can execute the processes after step S20 of FIG.

  Further, as another example, a program (hereinafter referred to as a “message exchange program”) associated with the type information “SNS program” may, for example, display the SNS screen shown in FIG. Display. The OS 64 also displays a status bar 80 at the top of the display area of the display unit 53. The SNS screen includes a message display area 125 displayed in the upper part of the display area and a message editing area 126 displayed in the lower part of the display area. In the message display area 125, already transmitted and received messages are displayed in chronological order. The message editing area 126 displays a software keyboard for receiving input of a message to be sent, and a text box in which the input message is displayed. Then, the game program can receive a user operation on the message editing area 126 through the operation unit 54. That is, the display unit 53 is in the partial screen mode, and the user operation received by the operation unit 54 is concentrated in the lower part of the display area.

  When such a message exchange program is executed in the foreground, the scan program 65 acquires target program type information “SNS program” in step S16. In step S17, the scan program 65 selects a notification method associated with the type information “SNS program” in the notification method list as a second notification method. Further, in step S47, the scan program 65 causes the display unit 53 to display a head-up message notifying of the end of the communication process, and causes the speaker to output a notification sound.

  The scan program 65 may also cause the display unit 53 to display a notification method editing screen shown in FIG. 11 (B), for example. The notification method editing screen is a screen for receiving a user operation for editing the notification method list shown in FIG. 3 (B). The notification method editing screen shown in FIG. 11B includes a pull-down menu for specifying type information, a pull-down menu for specifying a method of notification by the display unit 53, and a pull-down menu for specifying a method of notification by the speaker 57. Includes a [decision] icon. Then, the scan program 65 receives a user operation on the notification method editing screen through the operation unit 54.

  In response to the user's operation of tapping the position of the [decision] icon being accepted through the operation unit 54, the scan program 65 acquires the type information and notification method selected in each pull-down menu. This process is an example of a first accepting process for accepting a user operation specifying program identification information and a notification method. Then, when the acquired type information is registered in the notification method list shown in FIG. 3B, the scan program 65 overwrites the notification method of the notification method record including the type information with the acquired notification method. . Further, when the acquired type information is not registered in the notification method list shown in FIG. 3B, the scan program 65 displays the notification method record including the acquired type information and the notification method as shown in FIG. 3B. Add to the notification method list shown in.

  According to the above configuration, the notification method associated with the type information can be customized according to the preference of the user. That is, the correspondence between the type information and the notification method is not limited to the example shown in FIG. 3 (B). For example, the notification method list shown in FIG. 3 (B) may include a notification method record including the same notification method as the first notification method.

  Further, in the MFP 10 and the portable terminal 50 of the embodiment, the control unit of the present invention is executed by the CPUs 31, 61 executing various programs stored in the program storage areas 32A, 62A of the storage units 32, 62. An example has been described in which each process is implemented. However, the configuration of the control unit is not limited to this, and part or all of the control unit may be realized by hardware such as an integrated circuit (also referred to as an IC (abbreviated as Integrated Circuit)).

  Furthermore, the present invention can be realized not only as the MFP 10 and the portable terminal 50, but also as a program that causes the MFP 10 and the portable terminal 50 to execute processing. Then, the program may be provided by being recorded on a non-transitory recording medium. The non-transitory recording medium may include, in addition to a CD-ROM, a DVD-ROM, etc., a storage unit mounted on a server connectable to the multifunction machine 10 and the portable terminal 50 through a communication network. Then, the program stored in the storage unit of the server may be distributed as information or a signal indicating the program through a communication network such as the Internet.

10: multifunction device 11: printer unit 12: scanner unit 53: display unit 54: operation unit 55: communication unit 56: voice communication unit 57: speaker 58 .. Mounting portion 59 ... vibrator 61 ... CPU
62 ... storage unit 65 ... scan program 66 ... moving image program 50 ... portable terminal 70 ... server 100 ... communication system

Claims (23)

Display unit, a communication unit, broadcast knowledge unit, and outputs the information or provided with a plurality of input-output unit for receiving input of information, a plurality of programs can be executed in parallel mobile terminal readable communication program There,
The display unit doubles as at least a part of the notification unit and at least a part of the input / output unit .
The communication unit can communicate with an external device that processes content data.
The notification unit can notify by the notification method selected from among a plurality of notification methods,
The communication program
Communication processing for communicating with the external device through the communication unit to cause the external device to process the content data;
A first determination process of determining whether the communication program is being executed in the foreground or the background is performed by the portable terminal, and the foreground is a screen according to the execution of the program in the display area of the display unit. In the displayed state, the background is a state in which a screen based on the execution of the program different from the program is displayed in the display area of the display unit.
The communication program is a first notification method that the communication process is completed in response to the determination in the first determination process that the communication process is completed and the communication program is being executed in the foreground. Causing the mobile terminal to execute a first notification process for notifying the notification unit;
The communication program includes a plurality of program identification information each of which identifies the program according to the determination in the first determination processing that the communication processing has ended and the communication program is being executed in the background. Among the above, the portable terminal acquires an acquisition process of acquiring target identification information that is the program identification information indicating a target program, and a second determination process of determining a use status by the target program for each of the plurality of input / output units. The target program is the program being executed in the foreground, and in the acquisition processing, the program identification information corresponding to the use status determined in the second determination processing is the target identification information. Acquired,
The communication program selects, as a second notification method, the notification method corresponding to the target identification information acquired in the acquisition processing among the plurality of notification methods;
A communication program that causes the mobile terminal to execute a second notification process that causes the notification unit to notify that the communication process has ended using the second notification method. The portable terminal is provided with a speaker for outputting sound,
The speaker also serves as at least a part of the notification unit and the input / output unit.
The display unit can switch between a full screen mode in which the image instructed by the program is displayed in the entire display area and a partial screen mode in which a part of the display area is displayed.
The program identification information identifies the type of the program,
The communication program uses the program identification information indicating a video reproduction program as the target identification information in the acquisition process when it is determined in the second determination process that the display unit is used in the full screen mode. The communication program according to claim 1 to acquire. The communication program
In the selection process, a method of notifying only the speaker among the display unit and the speaker is selected as the second notification method corresponding to the video reproduction program,
The communication program according to claim 2 , wherein in the second notification process, a notification sound for notifying the end of the communication process is output to the speaker. The communication program
In the selection process, a method of displaying a message on the periphery of the display area of the display unit is selected as the second notification method corresponding to the video reproduction program,
The communication program according to claim 2 , wherein in the second notification process, a message notifying of the end of the communication process is displayed on the peripheral portion of the display area on the display unit. The portable terminal is provided with a speaker for outputting sound,
The speaker also serves as at least a part of the notification unit and the input / output unit.
The program identification information identifies the type of the program,
The communication program, in the acquisition process when the speaker is determined by the second determination processing is used, the program identification information indicating the sound reproduction program, claims 1 to obtain as the object identification information The communication program according to any one of 4 . The communication program
In the selection process, a method of outputting a notification sound to the speaker together with the sound being output by the target program is selected as the second notification method corresponding to the sound reproduction program,
The communication program according to claim 5 , wherein in the second notification process, the speaker is caused to narrow the volume of the sound being output by the target program and to output the notification sound for notifying the end of the communication process. The portable terminal includes an operation unit that receives a user operation,
The operation unit doubles as at least a part of the notification unit,
The program identification information identifies the type of the program,
The communication program acquires the program identification information indicating a game program as the target identification information in the acquisition process when it is determined in the second determination process that the use frequency of the operation unit is equal to or higher than a threshold value. The communication program according to any one of Items 1 to 6 . The communication program
In the selection process, a method of causing a message to pop up in the lower part of the display area of the display unit is selected as the second notification method corresponding to the game program,
The communication program according to claim 7 , wherein in the second notification process, a message for notifying the end of the communication process is popped up on the display unit. The portable terminal includes a storage unit,
The storage unit stores the program identification information and the use status of each of the plurality of input / output units associated with the program identification information,
The communication according to any one of claims 1 to 8 , wherein the communication program acquires, as the target identification information, the program identification information associated with the use status determined in the second determination processing in the acquisition processing. program. A communication program that includes a display unit, a communication unit, a notification unit, a storage unit, and an operation unit that receives a user operation, and can be read by a portable terminal that can execute a plurality of programs in parallel.
The display unit doubles as at least a part of the notification unit,
The communication unit can communicate with an external device that processes content data.
The notification unit can notify by the notification method selected from among a plurality of notification methods,
The storage unit stores program identification information and the notification method associated with the program identification information.
The communication program
Communication processing for communicating with the external device through the communication unit to cause the external device to process the content data;
A first determination process of determining whether the communication program is being executed in the foreground or the background is performed by the portable terminal, and the foreground is a screen according to the execution of the program in the display area of the display unit. In the displayed state, the background is a state in which a screen based on the execution of the program different from the program is displayed in the display area of the display unit.
The communication program is a first notification method that the communication process is completed in response to the determination in the first determination process that the communication process is completed and the communication program is being executed in the foreground. Causing the mobile terminal to execute a first notification process for notifying the notification unit;
The communication program includes a plurality of program identification information each of which identifies the program according to the determination in the first determination processing that the communication processing has ended and the communication program is being executed in the background. And allowing the portable terminal to execute acquisition processing for acquiring target identification information, which is the program identification information indicating a target program, from the OS of the portable terminal, the target program being the program being executed in the foreground Yes,
The communication program selects, as a second notification method, the notification method associated with the target identification information acquired in the acquisition processing among the plurality of notification methods;
A second notification process for notifying the notification unit of the end of the communication process using the second notification method;
A first acceptance process of accepting, through the operation unit, a user operation specifying the program identification information and the notification method;
A communication program that causes the portable terminal to execute a first storage process that stores the program identification information whose specification has been received in the first reception process and the notification method in association with each other in the storage unit . The portable terminal includes a plurality of input / output units that output information or receive information input,
The display unit and the operation unit double as at least a part of the input / output unit,
The communication program
The mobile terminal is caused to execute a third determination process of determining whether the target identification information associated with the notification method is stored in the storage unit,
In the selection process when it is determined in the third determination process that the object identification information is stored, the notification method associated with the object identification information is selected as the second notification method,
In the acquisition process when it is determined in the third determination process that the target identification information is not stored,
For each of the plurality of input / output units, the mobile terminal is caused to execute a fourth determination process of determining the use status by the target program;
The communication program according to claim 10 , wherein the program identification information corresponding to the use status determined in the fourth determination process is acquired as the target identification information. A communication program that includes a display unit, a communication unit, a notification unit, and an audio communication unit that transmits and receives audio data to and from an external device through a telephone line, and a portable terminal capable of executing a plurality of programs in parallel And
The display unit doubles as at least a part of the notification unit,
The communication unit can communicate with an external device that processes content data.
The notification unit can notify by the notification method selected from among a plurality of notification methods,
The communication program
Communication processing for communicating with the external device through the communication unit to cause the external device to process the content data;
A first determination process of determining whether the communication program is being executed in the foreground or the background is performed by the portable terminal, and the foreground is a screen according to the execution of the program in the display area of the display unit. In the displayed state, the background is a state in which a screen based on the execution of the program different from the program is displayed in the display area of the display unit.
The communication program is a first notification method that the communication process is completed in response to the determination in the first determination process that the communication process is completed and the communication program is being executed in the foreground. Causing the mobile terminal to execute a first notification process for notifying the notification unit;
The communication program includes a plurality of program identification information each of which identifies the program according to the determination in the first determination processing that the communication processing has ended and the communication program is being executed in the background. And allowing the portable terminal to execute acquisition processing for acquiring target identification information that is the program identification information indicating a target program, the target program being the program being executed in the foreground,
The communication program selects, as a second notification method, the notification method corresponding to the target identification information acquired in the acquisition processing among the plurality of notification methods;
A second notification process for notifying the notification unit of the end of the communication process using the second notification method;
Causing the portable terminal to execute a fifth determination process of determining whether the audio communication unit is transmitting or receiving the audio data;
The communication program causes the portable terminal to wait for execution of the second notification process in response to the determination in the fifth determination process that the audio data is being transmitted and received.
A communication program that causes the portable terminal to execute the second notification process in response to the determination in the fifth determination process that the audio data is not being transmitted and received. The portable terminal is provided with a speaker for outputting sound,
The speaker also serves as at least a part of the notification unit.
The speaker can be switched to a permission mode in which the output of sound is permitted and a restriction mode in which the output of sound is restricted,
The communication program causes the portable terminal to execute a sixth determination process of determining whether the speaker is in the permission mode or the restriction mode.
The communication program according to any one of claims 1 to 12 , wherein the communication program causes the speaker to output a notification sound in the second notification process when it is determined in the sixth determination process that the communication program is in the permission mode. The portable terminal includes a mounting unit to which an external speaker can be mounted;
The mounting unit doubles as at least a part of the notification unit,
The communication program causes the portable terminal to execute a seventh determination process of determining whether the external speaker is attached to the attachment unit.
The communication program determines in the second notification process that the communication program determines that the regulation mode is the restriction mode in the sixth determination process and determines that the external speaker is attached in the seventh determination process. The communication program according to claim 13 , wherein a notification sound signal to be indicated is output to the external speaker through the mounting unit. The portable terminal includes a vibrator for vibrating the portable terminal.
The vibrator also serves as at least a part of the notification unit.
The communication program determines that the vibrator is in the second notification process when the communication program determines that the restriction mode is in the sixth determination process and the external speaker is not attached in the seventh determination process. The communication program according to claim 14 , wherein the mobile terminal is vibrated. A communication program that includes a display unit, a communication unit, and a notification unit, and that can be read by a portable terminal that can execute a plurality of programs in parallel.
The display unit doubles as at least a part of the notification unit,
The communication unit can communicate with an external device that processes content data.
The notification unit can notify by the notification method selected from among a plurality of notification methods,
The communication program
Communication processing for communicating with the external device through the communication unit to cause the external device to process the content data;
A first determination process of determining whether the communication program is being executed in the foreground or the background is performed by the portable terminal, and the foreground is a screen according to the execution of the program in the display area of the display unit. In the displayed state, the background is a state in which a screen based on the execution of the program different from the program is displayed in the display area of the display unit.
The communication program is a first notification method that the communication process is completed in response to the determination in the first determination process that the communication process is completed and the communication program is being executed in the foreground. Causing the mobile terminal to execute a first notification process for notifying the notification unit;
The communication program includes a plurality of program identification information each of which identifies the program according to the determination in the first determination processing that the communication processing has ended and the communication program is being executed in the background. And allowing the portable terminal to execute acquisition processing for acquiring target identification information that is the program identification information indicating a target program, the target program being the program being executed in the foreground,
The communication program selects, as a second notification method, the notification method corresponding to the target identification information acquired in the acquisition processing among the plurality of notification methods;
Causing the mobile terminal to execute a second notification process of causing the notification unit to notify that the communication process has ended using the second notification method;
The OS of the portable terminal displays a switching object on the display unit in response to the communication program being switched from the foreground to the background, and the switching object executes the communication program in the foreground. It is an image for accepting user operation to indicate that
The communication program, in the notification process, causes the notification unit to output a message prompting the user operation to the switching object. The portable terminal includes an operation unit that receives a user operation,
The communication process is a process of receiving the content data from the external device,
The communication program
A second reception process for receiving, through the operation unit, a user operation specifying a storage destination of the content data received in the communication process in response to switching to the foreground after execution of the notification process;
The communication program according to claim 16 , causing the portable terminal to execute a second storage process of storing the content data in the storage destination received in the second reception process. The communication program according to any one of claims 1 to 17 , wherein the first notification method is a method of switching a screen displayed in a display area of the display unit to a screen for notifying the end of the communication process. The communication program according to any one of claims 1 to 18 , wherein the notification method selectable in the selection process includes the same notification method as the first notification method. A display unit, a communication unit, a notification unit, a plurality of input / output units that output information or receive information input, and a control unit that can execute a plurality of programs in parallel and execute a communication program A mobile terminal,
The display unit doubles as at least a part of the notification unit and at least a part of the input / output unit.
The communication unit can communicate with an external device that processes content data.
The notification unit can notify by the notification method selected from among a plurality of notification methods,
The control unit
Communication processing for communicating with the external device through the communication unit to cause the external device to process the content data;
Performing a first determination process of determining whether the communication program is being executed in the foreground or in the background; in the foreground, a screen according to the execution of the program is displayed in the display area of the display unit The background is a state in which a screen based on the execution of the program different from the program is displayed in the display area of the display unit,
The control unit is configured to perform the first notification method that the communication process is completed in response to the determination in the first determination process that the communication process is completed and the communication program is being executed in the foreground. Execute a first notification process to notify the notification unit;
The control unit determines a plurality of program identification information each of which identifies the program according to the determination in the first determination processing that the communication processing is completed and the communication program is being executed in the background. And an acquisition process of acquiring object identification information that is the program identification information indicating an object program, and a second determination process of determining a use status of the object program for each of the plurality of input / output units, The target program is the program being executed in the foreground, and in the acquisition processing, the program identification information corresponding to the use status determined in the second determination processing is acquired as the target identification information.
The control unit, as a second notification method, selecting the notification method corresponding to the target identification information acquired in the acquisition process among the plurality of notification methods;
A portable terminal that executes a second notification process that causes the notification unit to notify that the communication process has ended using the second notification method. A portable terminal comprising a display unit, a communication unit, a notification unit, a storage unit, an operation unit for receiving a user operation, and a control unit capable of executing a plurality of programs in parallel and executing a communication program,
The display unit doubles as at least a part of the notification unit,
The communication unit can communicate with an external device that processes content data.
The notification unit can notify by the notification method selected from among a plurality of notification methods,
The storage unit stores program identification information and the notification method associated with the program identification information.
The control unit
Communication processing for communicating with the external device through the communication unit to cause the external device to process the content data;
Performing a first determination process of determining whether the communication program is being executed in the foreground or in the background, and a screen according to the execution of the program is displayed in the display area of the display unit in the foreground The background is a state in which a screen based on the execution of the program different from the program is displayed in the display area of the display unit.
The control unit is configured to perform the first notification method that the communication process is completed in response to the determination in the first determination process that the communication process is completed and the communication program is being executed in the foreground. Execute a first notification process to notify the notification unit;
The control unit determines a plurality of program identification information each of which identifies the program according to the determination in the first determination processing that the communication processing is completed and the communication program is being executed in the background. Executing acquisition processing for acquiring target identification information, which is the program identification information indicating a target program, from the OS of the mobile terminal, and the target program is the program being executed in the foreground;
The control unit, as a second notification method, selecting the notification method associated with the target identification information acquired in the acquisition process among the plurality of notification methods;
A second notification process for notifying the notification unit of the end of the communication process using the second notification method;
A first acceptance process of accepting, through the operation unit, a user operation specifying the program identification information and the notification method;
A portable terminal that executes a first storage process of storing the program identification information whose specification has been received in the first reception process and the notification method in the storage unit in association with each other . A display unit, a communication unit, a notification unit, a voice communication unit that transmits and receives voice data to and from an external device through a telephone line, and a control unit that can execute a plurality of programs in parallel and execute a communication program Mobile terminal, and
The display unit doubles as at least a part of the notification unit,
The communication unit can communicate with an external device that processes content data.
The notification unit can notify by the notification method selected from among a plurality of notification methods,
The control unit
Communication processing for communicating with the external device through the communication unit to cause the external device to process the content data;
Performing a first determination process of determining whether the communication program is being executed in the foreground or in the background, and a screen according to the execution of the program is displayed in the display area of the display unit in the foreground The background is a state in which a screen based on the execution of the program different from the program is displayed in the display area of the display unit.
The control unit is configured to perform the first notification method that the communication process is completed in response to the determination in the first determination process that the communication process is completed and the communication program is being executed in the foreground. Execute a first notification process to notify the notification unit;
The control unit determines a plurality of program identification information each of which identifies the program according to the determination in the first determination processing that the communication processing is completed and the communication program is being executed in the background. Executing an acquisition process of acquiring object identification information that is the program identification information indicating an object program, the object program being the program being executed in the foreground;
The control unit, as a second notification method, selecting the notification method corresponding to the target identification information acquired in the acquisition process among the plurality of notification methods;
A second notification process for notifying the notification unit of the end of the communication process using the second notification method;
Performing a fifth determination process of determining whether the voice communication unit is transmitting or receiving the voice data;
The control unit waits for execution of the second notification process in response to the determination in the fifth determination process that the audio data is being transmitted and received.
A portable terminal that executes the second notification process according to the determination in the fifth determination process that the audio data is not being transmitted and received. A mobile terminal comprising a display unit, a communication unit, a notification unit, and a control unit capable of executing a plurality of programs in parallel and executing a communication program,
The display unit doubles as at least a part of the notification unit,
The communication unit can communicate with an external device that processes content data.
The notification unit can notify by the notification method selected from among a plurality of notification methods,
The control unit
Communication processing for communicating with the external device through the communication unit to cause the external device to process the content data;
Performing a first determination process of determining whether the communication program is being executed in the foreground or in the background, and a screen according to the execution of the program is displayed in the display area of the display unit in the foreground The background is a state in which a screen based on the execution of the program different from the program is displayed in the display area of the display unit.
The control unit is configured to perform the first notification method that the communication process is completed in response to the determination in the first determination process that the communication process is completed and the communication program is being executed in the foreground. Execute a first notification process to notify the notification unit;
The control unit determines a plurality of program identification information each of which identifies the program according to the determination in the first determination processing that the communication processing is completed and the communication program is being executed in the background. Executing an acquisition process of acquiring object identification information that is the program identification information indicating an object program, the object program being the program being executed in the foreground;
The control unit, as a second notification method, selecting the notification method corresponding to the target identification information acquired in the acquisition process among the plurality of notification methods;
Executing a second notification process for notifying the notification unit of the end of the communication process using the second notification method;
The OS of the portable terminal displays a switching object on the display unit in response to the communication program being switched from the foreground to the background, and the switching object executes the communication program in the foreground. It is an image for accepting user operation to indicate that
The portable terminal, wherein the control unit causes the notification unit to output a message prompting the user operation on the switching object in the notification process.

Images