JP2022176996A - Display method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a terminal device and the like that explicitly display that a reply is made to a reception image received in an image communication device.

SOLUTION: A terminal device includes: an acquisition unit that acquires a reception image received by an image communication device that transmits and receives images and information that can identify the reception image that has been already replied; and a display control unit that performs control to display a thumbnail image based on the reception image and to display a thumbnail image based on the reception image that has been already replied by superimposing identification information.

SELECTED DRAWING: Figure 1

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to a display method and the like.

2. Description of the Related Art Conventionally, there has been known an invention for notifying reception of a facsimile in a facsimile, which is one of image communication apparatuses.

For example, an image forming apparatus that creates a notification message notifying that a facsimile has been received and sends it to a notification destination, and displays a form in the notification message that can specify facsimile data preview display and facsimile data processing. A technique including a URL (Uniform Resource Locator) has been proposed (see, for example, Patent Document 1).

JP 2008-160531

However, the technique described in Patent Literature 1 has a problem that it is impossible to explicitly confirm that a reply has been sent.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a terminal device or the like that explicitly displays that a reply has been made to a received image received by an image communication device.

In order to solve the above-mentioned problems, the first embodiment of the present invention is
an acquisition unit that acquires a received image received by an image communication device that transmits and receives an image, and information that can identify the received image that has been returned;
a display control unit that displays a thumbnail image based on the received image and performs control to display identification information together with the thumbnail image based on the received image that has already been replied;
A terminal device comprising:

A second embodiment of the present invention comprises:
A system including an image communication device for transmitting and receiving images, a server device capable of communicating with the image communication device, and a terminal device capable of communicating with the server device,
The server device
a management unit that manages a received image received by the image communication device and information capable of specifying the received image that has been replied to,
The terminal device
an acquisition unit configured to acquire information capable of specifying the received image and the returned image from the server device;
a display control unit that displays a thumbnail image based on the received image and performs control to display identification information together with the thumbnail image based on the received image that has already been replied;
A system characterized by comprising

A third embodiment of the present invention comprises:
a step of obtaining a received image received by an image communication device that transmits and receives an image, and information capable of specifying the received image that has been sent back;
displaying a thumbnail image based on the received image, and performing control to display identification information along with the thumbnail image based on the received image that has already been replied;
A display method characterized by comprising:

A fourth embodiment of the present invention comprises:
to the computer,
a function of acquiring a received image received by an image communication device that transmits and receives an image and information that can specify the received image that has been replied;
a function of displaying a thumbnail image based on the received image, and performing control to display identification information along with the thumbnail image based on the received image that has already been replied;
It is a program characterized by realizing

According to the present invention, it is possible to explicitly display that a reply has been made to a received image.

It is a figure for explaining the whole system composition in a 1st embodiment. It is a figure for explaining the outline of the system in a 1st embodiment. 2 is a diagram for explaining the functional configuration of the image communication apparatus according to the first embodiment; FIG. 3 is a diagram for explaining the functional configuration of a server device according to the first embodiment; FIG. 4 is a diagram for explaining an example of the data configuration of timeline data in the first embodiment; FIG. 4 is a diagram for explaining an example of a data structure of group information in the first embodiment; FIG. 3 is a diagram for explaining the functional configuration of a terminal device according to the first embodiment; FIG. It is a figure for demonstrating the process of the terminal device in 1st Embodiment. FIG. 7 is a diagram for explaining timeline display processing in the first embodiment; It is a figure for demonstrating the process of the server apparatus in 1st Embodiment. It is a figure for explaining an example of operation in a 1st embodiment. It is a figure for explaining an example of operation in a 1st embodiment. It is a figure for explaining an example of operation in a 1st embodiment. It is a figure for explaining an example of operation in a 1st embodiment. It is a figure for explaining an example of operation in a 1st embodiment. It is a figure for explaining an example of operation in a 1st embodiment. It is a figure for demonstrating the process of the server apparatus in 2nd Embodiment. It is a figure for explaining an example of operation in a 2nd embodiment. It is a figure for demonstrating the process of the terminal device in 3rd Embodiment. It is a figure for explaining an example of operation in a 3rd embodiment. It is a figure for explaining an example of operation in a 3rd embodiment. It is a figure for explaining an example of operation in a 3rd embodiment. It is a figure for explaining an example of operation in a 4th embodiment. It is a figure for explaining an example of operation in a 5th embodiment.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, in this embodiment, as an example, a system including a terminal device to which the present invention is applied will be described.

[1. First Embodiment]
[1.1 Overall Description]
[1.1.1 Overall configuration]
FIG. 1 is a diagram for explaining the entire system 1. As shown in FIG. In the system 1, an image communication device 10, a server device 20, and a terminal device 30 are connected via a network NW1.

The image communication device 10 is a device having at least a facsimile (FAX/facsimile) function. The image communication apparatus 10 may be installed in an image forming apparatus such as a multi-function peripheral/printer (MFP), or may be a standalone apparatus. The image communication apparatus 10 can also be connected to a network NW2 of telephone lines such as analog lines and digital lines (ISDN), for example.

The server device 20 is a device that provides a predetermined service (eg, IoT platform), and is installed on the cloud, for example. In the present embodiment, the server device 20 manages the image communication device 10 and a group composed of one or more users who use the image communication device, and receives information about images received by the image communication device 10, which belongs to the group. provide a service that allows users to share

The terminal device 30 is a device used by a user, and is an information processing device including, for example, a mobile terminal such as a smartphone or a tablet, or a PC (Personal Computer).

The network NW1 is a network that connects each device. For example, it is implemented by a LAN (Local Area Network) or a WAN (Wide Area Network). Moreover, it may be configured by combining these networks.

In this specification, "receiving a FAX", "receiving a FAX", and "receiving a FAX" refer to receiving an image based on a standard using facsimile communication. Further, "transmit by FAX", "transmit by FAX", and "transmit by FAX" refer to transmitting an image based on a standard using facsimile communication. Facsimile communication is electronic communication for transmitting and receiving images including characters, figures, etc., and a transmission path for facsimile communication is called a facsimile communication network.

[1.1.2 Overview of system operation]
Next, an overview of the operation of the system 1 will be described with reference to FIG. In FIG. 2, user A is a user who sends a FAX to the image communication apparatus 10 using a device having a facsimile function. A device that transmits a FAX to the image communication device 10 is called a transmission source device. In FIG. 2, user B is a user of the service provided by the server device 20 and belongs to the same group as the group to which the image communication device 10 belongs.

First, a case where the image communication apparatus 10 receives a FAX will be described with reference to FIG. User A uses the transmission source device to send a FAX to the image communication device 10 . As a result, the image is transmitted from the transmission source device to the image communication device 10 .

The image communication device 10 receives an image from a transmission source device. In this embodiment, an image (fax data) received by the image communication apparatus 10 from the transmission source apparatus is referred to as a "received image".

The image communication device 10 transmits to the server device 20 received data including the received image and information about the received image. The information about the received image is, for example, the information of the source device extracted from the received image (for example, the FAX number of the source device).

The server device 20 authenticates the image communication device 10 and receives reception data from the image communication device 10 . The server device 20 manages (stores) the received image so that the device used by the user B (for example, the terminal device 30) can acquire the received image.

The terminal device 30 acquires the received image from the server device 20 and displays a notification (receipt notification) indicating that the image communication device 10 has received the FAX, or displays the received image. As a result, the user B can check the received image without printing it, or allow the terminal device 30 to download the received image. In this way, the received image is transferred (transmitted) to the server device 20 by the image communication device 10 and acquired by the terminal device 30 via the server device 20 . Therefore, by connecting the terminal device 30 to the server device 20, the user B can timely check the reception of the received image regardless of the location such as his desk or outside the office.

Note that the user B may cause a device other than the terminal device 30 (for example, a mobile terminal or a personal computer) to download the received image from the server device 20 . Further, user B may check data such as received images and cause a device such as a printer to print only necessary data out of the received images. The printer may acquire the received image from the server device 20, or may acquire the received image from the device (for example, the terminal device 30) that downloaded the received image.

Further, the server device 20 associates the content of the operation performed on the received image (corresponding content) and information indicating the state of the received image (for example, status information such as whether or not a reply has been received) with the received image. It is attached and managed (stored) so that it can be acquired by the terminal device 30 . By displaying the information associated with the received image, the terminal device 30 informs the user (a plurality of users) of the group to which the image communication device 10 belongs, the details of the operation performed on the received image, and the received image. Make image state shareable. Therefore, a user who desires to obtain information about the image communication device 10 may belong to the same group as the group to which the image communication device 10 belongs in the service provided by the server device 20 .

In this embodiment, as an operation for a received image, an operation for transmitting a predetermined image (for example, an image indicating that a FAX has been received) corresponding to the received image to the transmission source device of the received image is called "reply". Further, in the present embodiment, an image that is transmitted to the transmission source device of the received image by a reply operation is referred to as a "reply image".

Note that the server device 20 may manage received images for a certain period of time. This allows the user to check past data (received images) and perform operations on past data (received images).

In addition, the terminal device 30 displays the received image and the details of the operation performed on the received image as a timeline-format UI (User Interface), and enables the received image to be operated from the timeline-format UI. . As a result, the user can check the received image and perform an operation on the received image with a simple operation through a UI operation in the timeline format.

Next, with reference to FIG. 2B, the case where the user sends a reply will be described. After confirming the received image, user B can immediately send a reply FAX to the transmission source device (destination for user B) to notify that the FAX has been received.

User B selects a received image to be a reply target, and transmits a reply work request to server device 20 . When receiving a reply work request, the server device 20 authenticates the user who sent the request, and then generates reply data including at least a reply image and information on the source device of the received image. The information of the transmission source device is the destination of the transmission destination of the reply image at the time of reply.

The server device 20 generates, for example, a reply image based on a preset template. Further, the server device 20 sets the information of the destination of the reply image (the transmission source device) based on the information of the transmission source device transmitted together with the received image from the image communication device 10 .

User B can edit the reply data. For example, user B can edit the information of the transmission source device, and select or input an original comment (comment of reply data) to be added to the reply image. Further, when the user B becomes ready to transmit a reply image to the user A, the user B transmits a request for execution of reply to the server device 20 .

The server device 20 transmits the reply data to the image communication device 10 when the user B requests execution of the reply. The image communication apparatus 10 FAX-transmits the reply image included in the reply data to the transmission source device based on the information of the transmission source device included in the reply data. As a result, the transmission source device of the received image to be replied receives the FAX from the image communication device 10 and outputs the reply image. User A can confirm the reply image.

When the server device 20 successfully transmits the reply image to the transmission source device, the server device 20 updates the status of the received image that is the target of the reply to “replied”. As a result, the users who belong to the same group as the user who sent the reply can share the information of the received image in which the reply has been completed.

In addition, the terminal device 30 checks the message when replying again to a received image whose status is “reply completed”, thereby preventing redundant reply operations.

[1.2 Functional configuration]
[1.2.1 Image communication device]
A functional configuration of the image communication apparatus 10 will be described with reference to FIG. The image communication apparatus 10 includes a control unit 100, an image reading unit 120, an image forming unit 130, a display unit 140, an input unit 150, a storage unit 160, a line communication unit 170, and a NW communication unit 180, as shown in FIG. consists of

The control unit 100 is a functional unit for controlling the image communication apparatus 10 as a whole. The control unit 100 implements various functions by reading and executing various programs stored in the storage unit 160, and is configured by one or a plurality of arithmetic units (for example, CPU (Central Processing Unit)). there is

The control unit 100 functions as a FAX control unit 102, an image processing unit 104, a reception processing unit 106, and a transmission processing unit 108 by executing programs.

A FAX control unit 102 performs FAX transmission and FAX reception. For example, the FAX control unit 102 transmits the image of the document read by the image reading unit 120 from the line communication unit 170 to another device via the telephone line. In the case of Internet FAX, the FAX control unit 102 transmits an image from the NW communication unit 180 to another device via the Internet.

That is, the FAX control unit 102 performs facsimile communication using normal G3/G4 standards or the like, or facsimile communication using Internet FAX, thereby transmitting and receiving images to and from other devices. The FAX control unit 102 may perform facsimile communication using any known standard or protocol.

Also, the FAX control unit 102 receives an image based on a facsimile communication signal via the line communication unit 170 or the NW communication unit 180 . The FAX control unit 102 stores the received image, which is the received image, in the image data storage area 162 as image data.

The image data is, for example, a PDF (Portable Document Format) file. The image data may be a file in TIFF (Tagged Image File Format) format, JPEG (Joint Photographic Experts Group) format, or the like. When receiving a plurality of images at once, the FAX control unit 102 may store in the image data storage area 162 image data composed of a plurality of pages in which each received image is stored in a different page.

The image processing unit 104 performs processing related to various images. The image processing unit 104 executes, for example, sharpening processing and gradation conversion processing on the image read by the image reading unit 120 .

When the FAX control unit 102 receives a FAX, the reception processing unit 106 generates image data in which the received image is stored and received data including information about the received image. Reception processing unit 106 transmits the received data and authentication information stored as authentication information 164 to server device 20 via NW communication unit 180 .

The information about the received image is, for example, the following information. All of the following information may be included, or any of the information may be included.
・Date and time of reception ・Number of pages received ・Capacity of image data ・Information of source device

The information of the transmission source device includes information included in the protocol in facsimile communication, the telephone number notified by the transmission telephone number notification service, information set in the transmission source device, and the like. For example, in the case of the G3 protocol, the reception processing unit 106 acquires a transmitting terminal identification number (TSI: Transmitting Subscriber Identification) and uses it as information of the transmission source device. Note that the reception processing unit 106 may extract information on the transmission source device from the received image by recognizing the received image.

Transmission processing unit 108 receives reply data from server device 20 via NW communication unit 180 . Further, when receiving the reply data, the transmission processing unit 108 controls the FAX control unit 102 so that the reply image included in the reply data is sent to the sending device based on the information of the sending device included in the reply data. Send to

The image reading unit 120 reads a document and outputs image data. For example, the image reading unit 120 reads a document placed on the table of the image communication apparatus 10 using a CCD scanner, and outputs an image. Image reading section 120 stores the image in storage section 160 . The image reading unit 120 is configured by, for example, a scanner device or the like, but may read an image stored in, for example, a USB memory.

The image forming unit 130 forms an image on recording paper, for example. That is, the image forming section 130 prints the image on the recording paper. The image forming section 130 is configured by, for example, a laser printer section.

The display unit 140 is a functional unit for displaying various information, and is configured by, for example, an LCD (Liquid crystal display). Also, the input unit 150 is a functional unit for receiving operations of the user who uses the image communication apparatus 10 . The input unit 150 is configured by, for example, a touch panel or the like. A general detection method such as a resistive film method, an infrared method, an electromagnetic induction method, or an electrostatic capacitance method may be used as a method for detecting an input to the touch panel. Input unit 150 may be a hardware key, or may be configured by a touch panel and hardware keys.

The storage unit 160 is a functional unit that stores various programs and various data necessary for the operation of the image communication apparatus 10 . The storage unit 160 is configured by, for example, a semiconductor memory such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive).

The storage unit 160 secures an image data storage area 162 and stores authentication information 164 . The authentication information 164 stores a device ID, a password, and the like required for authentication performed when using a service provided by the server device 20 . Note that the device ID is an ID for identifying a device that uses the service provided by the server device 20 .

The line communication unit 170 is a functional unit capable of communicating with a telephone line and communicating with other devices via the telephone line.

The NW communication unit 180 is, for example, a functional unit that connects to a LAN (Local Area Network) and transmits/receives information or images to/from other devices. The NW communication unit 180 uses a LAN, which is Ethernet (registered trademark), or a communication system such as LTE (Long Term Evolution)/4G/5G as a communication system.

[1.2.2 Server device]
A functional configuration of the server device 20 will be described with reference to FIG. The server device 20 includes a control unit 200, a NW communication unit 210, and a storage unit 220, as shown in FIG.

The control unit 200 is a functional unit for controlling the server device 20 as a whole. The control unit 200 implements various functions by reading and executing various programs stored in the storage unit 220, and is configured by one or a plurality of arithmetic units (for example, CPU).

The control unit 200 functions as a timeline data processing unit 202, a reception data processing unit 204, and an authentication processing unit 206 by executing programs.

The timeline data processing unit 202 performs processing related to timeline data. Timeline data is data for displaying information about received images, such as received images and details of operations performed on received images, in a timeline format. The timeline data processing unit 202 transmits and stores timeline data.

When receiving a request to acquire timeline data from the terminal device 30, the timeline data processing unit 202 transmits the timeline data stored in the timeline data storage area 222 to the terminal device 30 that transmitted the request. . For example, the timeline data processing unit 202 transmits the timeline data to which the group ID of the group to which the user authenticated by the authentication processing unit 206 belongs is designated as the posting destination, and the terminal device that transmitted the request to acquire the timeline data. 30. The group ID of the group to which the user belongs is obtained by the timeline data processing unit 202 reading the group information in which the user ID is stored from the group information storage area 232 and reading the group ID stored in the read group information. get. When the timeline data processing unit 202 receives an image data acquisition request from the terminal device 30 , the timeline data processing unit 202 reads the corresponding image data from the image data storage area 354 and transmits it to the terminal device 30 .

Note that the timeline data processing unit 202 may notify the terminal device 30 when the timeline data is generated or updated, and prompt acquisition of the timeline data. Also, the timeline data processing unit 202 may transmit the timeline data by a push method. By doing so, the terminal device 30 can acquire the latest timeline data in real time.

When the timeline data processing unit 202 receives a message posting request for the received image from the terminal device 30 , the timeline data processing unit 202 stores the timeline data based on the information included in the posting request in the timeline data storage area 222 . For example, the timeline data processing unit 202 includes predetermined information such as date and time in the information included in the request for posting (for example, message, title, posting source user ID, posting destination group ID, image ID), message type is stored as a "user message". Posting means that the user transmits a message to the server device 20 via the terminal device 30 . A message is specific content (for example, text data) displayed on the terminal device 30 .

The received data processing unit 204 receives received data from the image communication apparatus 10 and generates timeline data regarding the received image.

Specifically, the reception data processing unit 204 generates timeline data by executing the following processes.
(1) Storage of Image Data The received data processing unit 204 stores the image data included in the received data in the image data storage area 224 .

(2) Generation of Image ID The received data processing unit 204 generates an image ID that uniquely identifies a received image (image data). The image ID is a serial number, a code in a predetermined format, a hash value of image data, a UUID (Universally Unique Identifier), or the like.

(3) Acquisition of Group ID to which Image Communication Apparatus 10 Belongs The received data processing unit 204 acquires the group ID of the group to which the image communication apparatus 10 that transmitted the received image belongs. For example, the received data processing unit 204 reads group information stored with the device ID included in the authentication information transmitted from the image communication device 10 from the group information storage area 232 . The received data processing unit 204 uses the group ID stored in the read group information as the group ID to which the image communication apparatus 10 belongs.

(4) Generation of Timeline Data The received data processing unit 204 generates timeline data regarding the received image and stores it in the timeline data storage area 222 . For example, the received data processing unit 204 includes information about the received image in the message, sets the date and time when the received data is received from the image communication apparatus 10 or the date and time when the received image is received, and uses the information of the transmission source device as the transmission source. Generate line data. Here, the received data processing unit 204 includes the file name of the image data stored in (1), the image ID generated in (2), and the group ID acquired in (3) in the timeline data. Further, the received data processing unit 204 sets the posting source user ID to be included in the timeline data as an ID indicating the server device 20, sets the message type as "received message", and sets the reply status as "unreply".

The authentication processing unit 206 authenticates users and devices that use services provided by the server device 20 . For example, when the authentication processing unit 206 receives a request to acquire timeline data or a request to post from the terminal device 30, the authentication processing unit 206 authenticates the user based on the authentication information transmitted along with the request. If the image communication apparatus 10 can be authenticated, the authentication processing unit 206 permits the timeline data processing unit 202 to execute predetermined processing. Similarly, the authentication processing unit 206 authenticates the image communication device 10 based on the authentication information transmitted from the image communication device 10 together with the received data. If the image communication apparatus 10 can be authenticated, the authentication processing unit 206 permits the received data processing unit 204 to generate timeline data.

The authentication processing unit 206 searches the authentication information storage area 226 for authentication information in which the same information as the authentication information transmitted from the terminal device 30 or the image communication device 10 is stored. If the search is successful, the terminal device 30 and the image communication device 10 are authenticated.

The NW communication unit 210 is, for example, a functional unit that connects to a LAN (Local Area Network) and transmits/receives information to/from another device. The NW communication unit 210 uses a LAN, which is Ethernet (registered trademark), or a communication system such as LTE (Long Term Evolution)/4G/5G as a communication system.

The storage unit 220 is a functional unit that stores various programs and various data necessary for the operation of the server device 20 . The storage unit 350 is configured by, for example, a semiconductor memory such as an SSD, an HDD, or the like.

In the storage unit 220, a timeline data storage area 222, an image data storage area 224, an authentication information storage area 226, a user information storage area 228, a device information storage area 230, and a group information storage area 232 are secured.

The timeline data storage area 222 is an area for storing timeline data. As timeline data, for example, as shown in FIG. 5, a posting source user ID (eg, "faxreceived") indicating a user who posted a message, and a posting destination group ID indicating a group to which the message was posted (eg, , “grp1”), the date and time of the message (e.g., “2019/11/06 09:17:39”), the message title (e.g., “New FAX received”), the message (e.g., “FAX number 091434..."), image ID (eg "1"), image data in which the received image is stored (eg "FAX_201911060917_091434.pdf"), sender of the received image (eg "091434"), reply A working user ID indicating the user who performs the work, a message type (e.g., "received message"), a reply status indicating whether or not a reply image corresponding to the received image has been sent (e.g., "reply"), and a message An edit status (eg, "edited") is stored that indicates whether the file has been edited.

When a message is posted by a user, the user ID of the user who posted the message is stored as the posting source user ID. Further, when the timeline data is generated by the server device 20, a predetermined ID (for example, “fax received”) indicating the server device 20 is stored as the posting source user ID.

The date and time is date and time information that serves as a reference when arranging the timeline data in chronological order. The date and time may be, for example, the date and time when the request to post the message was sent, or the date and time when the message was generated.

For the sender, the FAX number of the sender is stored. The image data stores information (for example, file name) specifying the image data stored in the image data storage area 224 . Note that the image data may be included in the timeline data.

The message type is information indicating the type of content of the message. For example, the following information is stored as the message type.
- Received message A message indicating that a FAX has been received. The message includes, for example, the FAX number of the transmission source device, the date and time of reception, the number of pages received, and the file name of the image data. In addition, the message contains content that explicitly indicates that the fax has been received (for example, text data such as "Fax has been received") and content that prompts a reply operation (for example, "Reply to the received fax"). ?”) may be included. Note that the content explicitly indicating that the FAX has been received may be included in the title of the timeline data.
- Reply operation message A reply operation message that indicates the content of an inquiry about reply data to the user who operates the reply operation. The message includes contents prompting confirmation and editing of the reply data. Specifically, the message includes content prompting the user to enter a comment to be added to the reply image, and confirmation and editing of information on the transmission source device of the received image to be replied (the destination of the reply image). Contains content that encourages
- System message A message generated by the server device 20 to notify the user of the status of the reply operation. The message includes the status of the operation on the received image and the result of the reply operation.
- User message A message posted by a user. The message includes content posted by the user.

Note that the user ID of the user who performs the reply operation is stored in the timeline data whose message type is a message for reply work.

The reply status is stored in the timeline data whose message type is "received message". The reply status stores "not replied" when the image data (received image) stored in the timeline data has not been replied, and "replyed" is stored when the reply has been received. be.

In this way, in the timeline data whose message type is "received message", the received image is associated with whether or not the received image has been replied. A device that acquires the timeline data (for example, the terminal device 30) can identify whether the received image has already been replied based on the timeline data whose message type is “received message”.

The authentication information storage area 226 stores information (authentication information) necessary for authenticating users and devices that use services provided by the server device 20 . In the authentication information, a user ID that uniquely identifies a user or a device ID that uniquely identifies a device and a password are stored in association with each other.

The user information storage area 228 stores information (user information) of users who use services provided by the server device 20 . The user information stores a user ID that can uniquely identify the user, a user name, an icon indicating the user, and the like.

In the device information storage area 230, information (device information) of a device (for example, the image communication device 10) that uses the service provided by the server device 20 is stored. The device information stores a device ID that can uniquely identify the device, a device name, an icon indicating the device, and the like.

Group information (group information) managed by the server device 20 is stored in the group information storage area 232 . As shown in FIG. 6, the group information includes a group ID (for example, "grp1") that uniquely identifies a group, a device ID (for example, "MFP1") that indicates a device that belongs to the group, and a device that belongs to the group. A user ID (for example, "yokomitsu, hiroaki") indicating the user who performs the request is stored.

[1.2.3 Terminal device]
A functional configuration of the terminal device 30 will be described with reference to FIG. The terminal device 30 includes a control unit 300, a display unit 320, an input unit 330, a NW communication unit 340, and a storage unit 350, as shown in FIG.

The control unit 300 is a functional unit for controlling the terminal device 30 as a whole. The control unit 300 implements various functions by reading and executing various programs stored in the storage unit 350, and is configured by one or a plurality of arithmetic units (for example, CPU).

The control unit 300 functions as a timeline data acquisition unit 302, a post processing unit 304, and a notification display control unit 306 by executing programs.

The timeline data acquisition unit 302 acquires the timeline data by transmitting a request to acquire the timeline data together with the authentication information stored as the authentication information 356 to the server device 20 . The timeline data acquisition unit 302 also stores the acquired timeline data in the timeline data storage area 352 . Also, when image data is included in the timeline data, the timeline data acquisition unit 302 transmits a request to acquire the image data to the server device 20 . When acquiring image data from the server device 20 , the timeline data acquisition unit 302 stores the image data in the image data storage area 354 .

The posting processing unit 304 posts a message by transmitting a message posting request for the received image together with the authentication information stored as the authentication information 356 to the server device 20 . Note that in the present embodiment, the message to be posted is a message related to a specific received image, and the posting processing unit 304 causes the user to select a received image related to the message. The posting processing unit 304 reads the timeline data in which the image data corresponding to the received image selected by the user is stored from the timeline data storage area 352, and acquires the posting destination group ID and the image ID. In response to a request for posting, the posting processing unit 304 receives the message and title input by the user, the user ID of the user (posting source) using the terminal device 30, the group ID (posting destination group ID) obtained from the timeline data, and Include an image ID, etc. Thereby, the posting processing unit 304 can transmit to the server device 20 a message posting request to the user of the group to which the image communication device 10 that has received the received image belongs.

The notification display control unit 306 causes the display unit 320 to display a pop-up screen including predetermined notification content or toast display.

The display unit 320 is a functional unit for displaying various information, and is configured by, for example, an LCD. Also, the input unit 330 is a functional unit for receiving operations of the user who uses the terminal device 30 . The input unit 330 is configured by, for example, a touch panel or the like. A general detection method such as a resistive film method, an infrared method, an electromagnetic induction method, or an electrostatic capacitance method may be used as a method for detecting an input to the touch panel. Input unit 330 may be a hardware key, or may be configured by a touch panel and hardware keys.

The NW communication unit 340 is, for example, a functional unit that connects to a LAN and transmits/receives information to/from another device.

The storage unit 350 is a functional unit that stores various programs and various data necessary for the operation of the terminal device 30 . The storage unit 350 is configured by, for example, an SSD, which is a semiconductor memory.

In the storage unit 350, a timeline data storage area 352 for storing timeline data and an image data storage area 354 for storing image data are secured, and authentication information 356 is stored.

The authentication information 356 stores a user ID, password, etc. required for authentication when using the service provided by the server device 20 . Note that the user ID is an ID for identifying a user who uses the service provided by the server device 20 .

[1.3 Flow of processing]
A flow of main processing of this embodiment will be described. First, the processing of the terminal device 30 will be described with reference to FIG. It should be noted that when the terminal device 30 transmits a request or information to the server device 20, the authentication information stored as the authentication information 356 is also transmitted, and the server device 20 performs authentication. In the explanation of the flow of processing, the explanation regarding authentication is omitted for the sake of simplicity.

[1.3.1 Terminal device]
Processing of the terminal device 30 will be described with reference to FIG. First, the control unit 300 (timeline data acquisition unit 302) acquires timeline data from the server device 20 (step S102).

Subsequently, when a new FAX is received, the control unit 300 (notification display control unit 306) displays a new arrival guide (reception notification) of the received data (received image) (step S104). For example, if the latest timeline data acquired in step S102 includes timeline data whose message type is "received message", the control unit 300 determines that a new FAX has been received. At this time, the control unit 300 (notification display control unit 306) displays a toast display or a pop-up screen indicating that the FAX has been received as a display (receipt notification) of the new arrival information of the received data. Note that the control unit 300 may notify that a FAX has been received by displaying a badge on an icon selected by the user to display the timeline.

Subsequently, the control unit 300 executes timeline display processing (step S106). The timeline display process is a process of displaying a timeline based on timeline data. The timeline display processing will be described with reference to FIG.

The control unit 300 reads the timeline data stored in the timeline data storage area 352 (step S132).

Subsequently, the control unit 300 arranges the read timeline data in chronological order and displays the message stored in the timeline data for each piece of timeline data, thereby displaying the timeline on the display unit 320 (step S134). Note that the control unit 300 may display information included in the timeline data together with the message. For example, the control unit 300 may display the user ID of the posting source, the date and time, the title, etc., or may display the characters "edited" when the editing status is already edited. Further, the control unit 300 may acquire user information (a user name and an icon indicating the user) corresponding to the user ID from the server device 20 and display the user name and the icon indicating the user.

Further, for the timeline data whose message type is "received message", the control unit 300 adds and displays information to be displayed on the timeline in addition to the message displayed in step S134. The information to be additionally displayed is a thumbnail image of the received image, a stamp indicating that a reply has been made, and a reply button for accepting a reply work request. This will be explained below.

The control unit 300 displays, on the display unit 320, the thumbnail image of the received image stored in the timeline data whose message type is "received message" (step S136). A thumbnail image is an image generated based on a received image, and is, for example, an image obtained by reducing one page of the received image (for example, the first page). A thumbnail image may be generated by the terminal device 30 or by the server device 20 .

When the terminal device 30 generates a thumbnail image, the control section 300 acquires the received image based on the image data stored in the timeline data. For example, the control unit 300 reads image data corresponding to image data stored in the timeline data from the image data storage area 354 . The control unit 300 generates a thumbnail image by reducing one page of the received image included in the read image data. Note that when the thumbnail image is generated by the server device 20, the control unit 300 requests the server device 20 for the thumbnail image along with information based on the timeline data (for example, the file name and image ID of the image data). . The control unit 300 acquires the thumbnail image transmitted from the server device 20 as a response to the request for the thumbnail image.

Then, the control unit 300 displays the generated or acquired thumbnail image near the location where the corresponding message was displayed.

Next, when the reply status stored in the timeline data whose message type is "received message" is "reply completed", control unit 300 adds a stamp (identification information) to the thumbnail image displayed in step S136. It is superimposed and displayed (step S138). It should be noted that if the reply status is "not replied", the control unit 300 displays the thumbnail image without displaying the stamp (identification information) superimposed thereon. Note that the identification information in the present embodiment is information indicating that the received image has already been replied to, with respect to the received image that has already been replied to. The identification information is displayed superimposed on the received image or the thumbnail image of the received image, or displayed around the received image or the thumbnail image of the received image. Further, the identification information may be any information that allows the user to recognize that the received image has been returned. The identification information is, for example, predetermined images such as stamps and icons, animations, moving images, characters, and symbols. Note that the identification information may be a frame line or the like displayed around the received image or the thumbnail image of the received image.

Subsequently, the control unit 300 displays a reply button near the place where the message stored in the timeline data whose message type is "received message" is displayed (step S140).

In addition, the control unit 300 performs a process of omitting and displaying messages stored in the timeline data whose message type is “message for reply work” in the timelines of users other than the user who performs the reply work.

First, the control unit 300 identifies, among the messages displayed in step S134, the messages displayed based on the timeline data whose message type is "message for reply work" (step S142).

Next, for each specified message, the control unit 300 determines whether or not the working user ID stored in the timeline data corresponding to the message matches the user ID of the user using the terminal device 30. do. The control unit 300 acquires the user ID of the user who uses the terminal device 30 by reading the user ID stored in the authentication information 356, for example. If the work user ID stored in the timeline data and the user ID of the user who uses the terminal device 30 do not match, the control unit 300 abbreviates (reduces) the message stored in the timeline data in the timeline. display) (step S144). The abbreviated display is a display method in which the control unit 300 omits part or all of the message and displays it (a display method in which the message is not expanded entirely). Note that, when the user selects a message that is displayed in an abbreviated manner, the control unit 300 may expand the message so that the full text of the message is displayed. Also, the control unit 300 may hide the message instead of displaying the message in an abbreviated manner. By doing so, the control unit 300 can omit or hide the display of the message regarding the reply operation on the timeline of the user who does not perform the reply operation.

Through the processing described above, the control unit 300 displays the timeline on the display unit 320 based on the timeline data. Here, the control unit 300 displays messages related to reply work (for example, reply settings such as comments to be added to the reply image, and edited contents of the destination of the transmission source device) on the screen (display unit 320) of the user who performs the reply work. to display only. The control unit 300 abbreviates and displays a message regarding reply work by other users on the screen (display unit 320) of a user who does not perform reply work (displays the message without expanding it entirely). In this way, the control unit 300 does not display the details of operations performed by other users as common information, but rather displays the operation status and results between the user who performed the reply operation and the system (server device 20). to display only the results of interactions between Thereby, the control unit 300 can prevent the display of unnecessary information for the user and improve the operability for the user.

Returning to FIG. 8, when the thumbnail image displayed together with the message displayed when the received image is received is selected by the user by an operation such as clicking or tapping (step S108; Yes), the control unit 300 selects the thumbnail image. A preview image of the received image corresponding to the thumbnail image is displayed (step S110). The control unit 300 displays the preview image as an image larger than the thumbnail image, for example, on a screen different from the screen on which the timeline is displayed. In this way, the control unit 300 allows the user to check the detailed information of the image data of the received image. As described in step S138, only the stamp is superimposed on the image data, and the image data itself is not changed. Therefore, even when a thumbnail image on which a stamp is superimposed is selected, a preview image of the received image itself is displayed. Identification information such as a stamp is not displayed in the preview image.

Subsequently, the control unit 300 determines whether or not the Reply button has been selected (step S112). When the reply button is selected, the control unit 300 determines whether or not the reply status of the timeline data corresponding to the reply button is "reply completed" (step S112; Yes→step S114). When the reply status is "reply completed", the control unit 300 displays a confirmation message (warning) indicating that the reply has already been sent on the display unit 320 (step S114; Yes→step S116).

By displaying a warning, for example, after a certain user performs an operation (in this embodiment, a reply operation), the same user tries to perform the same operation again, or another user performs the same operation. You will get a warning if you try. By doing so, it is possible to prevent erroneous operations such as duplicate operations being performed by a plurality of users. In addition to the warning, the control unit 300 may also inquire of the user whether or not to continue the work of replying. If the user selects not to continue replying, the control unit 300 omits the processes of steps S118 to S126.

Further, the control unit 300 stores the same image ID as the image ID of the timeline data corresponding to the reply button, and reads out the timeline data whose message type is "message for reply work". Furthermore, the control unit 300 determines whether or not the work user ID stored in the read timeline data matches the user ID of the user who uses the terminal device 30 . If there is a match, no warning may be displayed, and if there is no match, a warning may be displayed indicating that another user has replied. In this case, if the user using the terminal device 30 repeats the reply operation, the control unit 300 does not display a warning.

Through the above-described processing, the control unit 300 detects that a user other than the user who has performed the reply operation presses (for example, clicks or taps) the reply button for the received image whose reply status is "reply completed". In this case, a warning (confirmation message) such as "Another user has already replied, do you want to reply?" can be displayed. In addition, when the user who has performed the reply operation presses (for example, clicks or taps) the reply button for the received image whose reply status is "reply completed", the control unit 300 displays "already replied". It is already done, but would you like to reply?" can be displayed as a warning (confirmation message).

Subsequently, the control unit 300 transmits a reply work request including the image ID stored in the timeline data corresponding to the reply button and the user ID of the user who uses the terminal device 30 to the server device 20 (step S118). By including the image ID in the reply work request, the server apparatus 20 can specify the received image to be the reply target.

When the timeline data acquiring unit 302 acquires the timeline data whose message type is "reply work message", the control unit 300 displays the message included in the acquired timeline data on the timeline (step S120). ). When image data (for example, a reply image) is included in the timeline data, the control unit 300 displays a thumbnail image of the image data.

The control unit 300 accepts the user's operation on the message for reply work, and edits the reply data by transmitting the confirmation result of the contents of the reply data and the edited contents to the server device 20 (step S122). Further, when the user instructs to execute a reply, the control unit 300 transmits a request for executing a reply (reply execution request) to the server device 20 (step S124).

Subsequently, when the reply is completed, the control unit 300 superimposes the stamp on the thumbnail image of the received image that is the target of the reply (step S126).

For example, the control unit 300 includes an image ID corresponding to the received image to which the reply is made and information indicating that the reply has been completed, as information that can identify the received image that has been replied from the server device 20 . Receive execution results. Subsequently, the control unit 300 identifies timeline data in which the image ID received from the server device 20 is stored and whose message type is "received message". The control unit 300 superimposes the stamp on the thumbnail image corresponding to the image data stored in the identified timeline data among the thumbnail images displayed on the timeline.

In this way, the control unit 300 immediately adds (reflects) new information indicating that a reply has been made to the received image to the thumbnail image (past display content) already displayed on the timeline. do. As a result, it is possible to prevent a mismatch between the displayed content of the timeline and the content of the operation performed by the user.

[1.3.2 Server Device]
Next, the processing of the server device 20 will be described with reference to FIG. First, the control unit 200 determines whether or not a reply work request has been received from the terminal device 30 (step S152).

When receiving a reply work request, the control unit 200 generates reply data (step S152; Yes→step S154). For example, the control unit 200 stores the image ID included in the reply work request from the timeline data storage area 222, and the timeline data whose message type is "received message" (the message displayed when the received image is received is stored timeline data). The control unit 200 acquires the transmission source stored in the read timeline data and generates a reply image based on the image data. The control unit 200 generates reply data including the acquired transmission source and the generated reply image.

Subsequently, the control unit 200 generates timeline data with the message type as "message for reply work", and stores it in the timeline data storage area 222 (step S156). Specifically, control unit 200 sets the poster user ID as an ID indicating server device 20, and sets the posting destination group ID as the posting destination group ID stored in the timeline data read in step S154. Generate. Further, the control unit 200 asks the user who performs the reply work as a message the image ID contained in the reply work request as the image ID and the user ID contained in the reply work request as the work user ID in the timeline data. Include content.

Note that the content of the message may be a content prompting the user to input a comment to be added to the reply image, or a content prompting the user to confirm information about the sender of the received image to which the reply is to be sent. In addition, the timeline data generated in step S156 is transmitted to the terminal device 30 by the timeline data processing unit 202 based on the request from the terminal device 30 to acquire the timeline data.

When receiving the edited content of the reply data from the terminal device 30, the control unit 200 reflects it in the reply data (step S158; Yes→step S160). For example, when receiving a comment to be added to the reply image from the terminal device 30, the control unit 200 adds the comment to the reply image. Also, when receiving the information on the transmission source from the terminal device 30 , the control unit 200 updates the information on the transmission source included in the reply data to the information received from the terminal device 30 .

Subsequently, when receiving a reply execution request from the terminal device 30, the control section 200 transmits reply data to the image communication device 10 (step S162; Yes→step S164).

Subsequently, the control unit 200 receives the transmission result of the image based on the reply data from the image communication device 10, and updates the reply status of the received image to be replied. For example, when the control unit 200 receives a result indicating that the image has been successfully transmitted from the image communication apparatus 10, the control unit 200 updates the reply status of the timeline data read in step S154 to "reply completed". (Step S166). Furthermore, the control unit 200 adds a comment (for example, text data such as "Mr. The status is updated to "edited" (step S168). Note that the control unit 200 acquires the user who sent the reply from, for example, the work user ID stored in the timeline data in which the image ID corresponding to the received image to which the reply was sent is stored.

In this way, after the reply operation is completed, the control unit 200 updates the reply status or adds a comment indicating that the reply has been made to the timeline data at the time when the received image to be replied is received. I do. As a result, new information can be added to the timeline data corresponding to the past display content. Further, the terminal device 30 displays the timeline based on the added timeline data, so that the received image displayed as a thumbnail image in the message has already been returned to the message displayed when the received image is received. can show that there is

Furthermore, the control unit 200 transmits the execution result including the image ID of the received image to be the reply target and the information indicating that the reply is completed to the terminal device 30 that transmitted the reply execution request (step S170).

If no reply is received (for example, if a result indicating that transmission of the reply image has failed is received from the image communication apparatus 10), the control unit 200 omits the processing of steps S166 to S170. good too. Alternatively, the control unit 200 may update the reply status of the timeline data read in step S154 to "transmission failed".

Further, the server device 20 appropriately displays the status of the reply operation, such as when reply data is being edited, when reply data is being transmitted, when the reply data transmission result is received from the image communication device 10, and so on. may generate timeline data including a message indicating In this case, the control unit 200 sets the poster user ID as an ID indicating the server device 20, sets the posting destination group ID as the posting destination group ID stored in the timeline data read in step S154, and sets the image ID as the reply work request. , the message type is “system message”, and the timeline data including the content of the reply operation status is generated and stored in the timeline data storage area 222 .

[1.4 Operation example]
An operation example of the present embodiment will be described with reference to the drawings. In addition, in the description of the operation example, among the messages displayed on the timeline, the same messages are given the same reference numerals. Also, in the following description, a message displayed based on timeline data whose message type is "received message" is simply referred to as "received message". Similarly, messages displayed based on timeline data whose message types are "message for reply work" and "system message" are simply described as "message for reply work" and "system message".

FIG. 11 shows a screen display example when a notification (receipt notification) indicating that a new FAX has been received by the image communication apparatus 10 is displayed on the display unit 320 . For example, when the so-called standby screen W100 is displayed as shown in FIG. 11(a), or when the so-called home screen W102 is displayed as shown in FIG. Toast display a notification indicating that there is a fax reception of Note that when toast is selected, the display may be switched to a screen displaying timeline data in a timeline format.

In addition, on the screen W104 of the dedicated application for using the service provided by the server device 20, the icon selected by the user for displaying the timeline is indicated by the reception of FAX (new reception of FAX), as in the area B104. A badge may be displayed as a notification that the By viewing the toast display and badge display displayed on the display unit 320, the user can confirm that there is a new FAX reception, that is, that the image communication apparatus 10 has received the FAX.

12 and 13 are examples of display screens when the timeline is displayed on the display unit 320. FIG. In mobile terminals, the timeline is generally displayed from the latest information, and past information is displayed by scrolling upward. FIG. 12A shows an example of the display screen W130 when the received message C100 is displayed on the display unit 320 by displaying the timeline on the display unit 320 and scrolling it upward by the user. The received message C100 includes received image information E100 (eg, FAX number, reception date and time, number of pages, file name). A thumbnail image F100 of the received image is also displayed.

FIG. 12(b) is an example of the display screen W140 when the timeline displayed in FIG. 12(a) is scrolled downward. A reply button B100 is displayed on the received message C100. A button B102 for printing the received image may be displayed in the received message C100.

When the Reply button B100 is selected, a reply work message C110 is displayed on the timeline as the latest message. FIG. 12B is a display example of the display screen W140 when a message prompting confirmation of the FAX number of the sender of the received image (the destination to which the reply image is sent) is displayed as the reply operation message C110. be. The reply operation message C110 displays a button B110 indicating that the FAX number of the sender is correct and a button B112 for correcting the FAX number. By selecting button B110 or button B112, the user can indicate to server device 20 that the FAX number is correct or needs to be corrected. When the button B112 is selected, for example, a reply work message for entering a FAX number is displayed on the timeline.

FIG. 13A is an example of a display screen W150 when a reply work message C120 prompting the input of a comment to be added to a reply image is displayed on the timeline after the FAX number has been confirmed. The user inputs the number of a fixed phrase prepared in advance or a free comment in the input field T120 and selects the button B120 to input the selected number or input comment information as a comment to be included in the reply image to the server device. 20. In this way, the user can edit and check the reply data by operating the reply work message.

FIG. 13B is an example of a display screen W160 when a reply operation message C130 prompting confirmation of a reply image is displayed on the timeline after information about a comment to be added to the reply image is transmitted. A thumbnail image F130 of the reply image is displayed in the reply operation message C130, and a button B130 for transmitting a reply execution request is further displayed. By selecting button B130, the user can transmit the reply image to the sender of the received image.

Note that an area E130 including buttons for correcting the address, telephone number (FAX number), and text (comment to be added to the reply image) may be displayed in the reply operation message C130. When the button included in E130 is selected by the user, a reply work message for correcting the reply data is displayed on the timeline.

FIG. 13C is a display example of the display screen W170 when the system message C140 and the system message C150 are displayed on the timeline after the button B130 is selected. For example, the system message C140 is a message indicating the status of starting FAX transmission based on the reply operation. The system message C150 is a message indicating the completion of FAX transmission.

As shown in FIGS. 12(a) to 13(c), the latest messages are displayed one after another on the timeline, and the received message C100 is a past message (past display content). Therefore, the received message C100 is displayed on the display unit 320 by scrolling the display screen W170 shown in FIG. 13(c) upward. Here, FIG. 13(d) shows a case where the display screen W170 shown in FIG. 13(c) is scrolled upward and a received message C100 including the thumbnail image F100 of the received image to be replied is displayed. is an example of the display screen W180 in . The received message C100 has display content older than the system message C150, but when the reply is completed, a stamp is added to the thumbnail image F100 of the received image to which the reply is to be sent, included in the received message C100, which is the past display content. (Completed stamp) is superimposed and displayed. In this way, even in the past display content, the information of the reply operation is added (reflected) like the thumbnail image F100 shown in FIG. 13(d).

FIG. 14 is a diagram showing a display example of a timeline. FIG. 14A is a diagram showing a timeline L100 displayed on the terminal device 30 used by the user who performed the reply operation. In L100, received message C100, reply work messages C110, C120, and C130, and system messages C140 and C150 are displayed.

14(b) and 14(c) show the time displayed on the terminal device 30 used by another user belonging to the same group as the user who sent the reply, that is, the user who did not operate the reply. It is an example of lines L110 and L120. For example, the terminal device 30 of the user who is not working on the reply may display a timeline in which the reply work messages C110, C120, and C130 are not displayed, such as the timeline L110. Alternatively, on the terminal device 30 of the user who is not doing the reply work, a timeline in which the reply work messages C110, C120, and C130 are omitted may be displayed like the timeline L120. By displaying such a timeline, a user who has not performed a reply operation can know only the fact that the FAX has been received and the status and result of other user's operations, thereby grasping the status of the received image. easier to do.

FIG. 15 is an example of a display screen W190 when a warning W192 is displayed when the reply button is selected for a received image that has already been replied to. By confirming the warning W192, the user can avoid repeating the reply operation.

Note that, as shown in FIG. 15, a button B192 indicating performing a reply operation and a button B194 indicating canceling the reply operation may be displayed together with the warning W192. When B192 is selected by the user, a reply work message is displayed on the timeline. At this time, if a reply operation is executed in accordance with the user's operation for the reply operation message, the reply operation is executed along with identification information such as a stamp (completed stamp) on the received image that has been replied to. Information indicating the number of times the reply has been made and information on the user who performed the reply operation may be displayed. If B194 is selected by the user, the reply is canceled, so the message for reply work is not displayed on the timeline.

FIG. 16 is a diagram showing another display example of a received message including a received image that has been replied to. FIG. 16(a) is an example of a timeline L130 including a received message C102 including a received image that has been replied to. The received message C102 may include a comment E102 indicating that a reply has been made (for example, "Mr. hiroaki has replied"). It should be noted that when the reply is completed, the message has been edited by adding a comment indicating that the reply has been completed, so the text "edited" is displayed together with the message, as in A102.

Also, FIG. 16B is an example of a timeline L140 including a received message C104 including a received image that has been replied to. As in the received message C104, a thumbnail image F104 (reply data) of the reply image may be displayed instead of superimposing a stamp (completed stamp) on the reply-completed received image. The thumbnail image of the reply image may be displayed based on the image data stored in the timeline data whose message type is "message for reply work".

As described above, according to the present embodiment, the user can confirm reception of a FAX and perform operations on received images using a UI in the timeline format. In addition, since a stamp (identification information) is superimposed on the received image to which the reply has been sent, the user can easily confirm whether or not the reply has been received.

It should be noted that the embodiment may be changed as appropriate within a consistent range other than the above description.

For example, in the present embodiment, in addition to the timeline (shared screen) that is checked by all users belonging to the group, a timeline that displays messages sent and received one-on-one between the server device 20 and the users in chronological order. It may be possible to display the line (operation user screen). In this case, the terminal device 30 may display the reply work message on the work user screen and not display it on the shared screen. As a result, the message for reply work is not displayed on the shared screen, so that the user who has not performed the reply operation can confirm that the FAX has been received and the status and result of other users' operations. Only the results of exchanges between the user and the system (server device 20) can be known. Since unnecessary information is not displayed for a user who does not perform a reply operation, the terminal device 30 can improve operability for the user.

Further, in the present embodiment, the image communication apparatus 10 is provided with the reception processing unit 106 and the transmission processing unit 108. terminal). The edge terminal cooperates with the image communication apparatus 10 (MFP cooperation) to implement the functions of the image communication apparatus 10 in this embodiment. In this case, the image communication apparatus 10 transmits the received image and information about the received image to the edge terminal. The edge terminal transmits the received image received from the image communication apparatus 10 and the received data including information about the received image to the server device 20 together with the authentication information stored in the edge terminal. Further, when receiving transmission data from the server device 20, the edge terminal controls the image communication device 10 to transmit a reply image to the transmission source device. Note that the edge terminal may implement the functions of the image communication apparatus 10. For example, the edge terminal may have the function of the FAX control unit 102 so that the edge terminal receives and transmits FAX to and from the transmission source apparatus. transmission may be implemented.

Also, in the timeline display processing, instead of displaying messages related to all received images, only messages related to received images received only from a transmission source device (destination) preset by the user are displayed. good too. For example, in step S132, control unit 300 extracts from timeline data storage area 222 timeline data in which the FAX number of the transmission source device specified by the user is stored and whose message type is "received message." The control unit 300 reads from the timeline data storage area 222 the timeline data in which the same image ID as the image ID stored in the extracted timeline data is stored. After that, the control unit 300 executes the processes after step S134. By doing this, only the message about the received image received from the preset transmission source device is displayed instead of displaying the messages about all the received images, so that the user can easily check the received image. become.

Also, in the timeline display process, when the reply status stored in the timeline data whose message type is "received message" is "reply completed", a stamp (identification information) is displayed superimposed on the thumbnail image. , other processing may be performed. For example, the control unit 300 may display the message in a predetermined character color, or display the background of the message in a predetermined color. In addition, the control unit 300 may superimpose a semi-transparent color on the message or thumbnail image to display it, or superimpose it on the thumbnail image or add predetermined identification information around the thumbnail image. (for example, an icon) may be displayed. In other words, the control unit 300 may display identification information visually indicating that a reply has been made for a message or thumbnail image based on timeline data whose reply status is already replied.

Further, in step S104, the notification display control unit 306 has been described as displaying a notification of new incoming FAX based on the timeline data, but notification of new incoming FAX may be made by other methods. For example, after generating the timeline data, the received data processing unit 204 sends a new FAX to the terminal device 30 used by a user who belongs to the same group as the group to which the image communication device 10 that received the received image belongs. Sends information indicating that it has received The notification display control unit 306 displays a notification of a new FAX when receiving information indicating that a new FAX has been received.

Further, when the timeline data is updated such as by adding a postscript, the control unit 200 causes the terminal device 30 used by the user belonging to the group specified by the posting destination group ID stored in the timeline data to be updated. , information indicating that the timeline data has been updated may be transmitted. Upon receiving the information indicating that the timeline data has been updated, the terminal device 30 reacquires the timeline data updated by the server device 20 and reflects it on the timeline. By doing so, the timeline can be brought to the latest state.

It should be noted that the order of the steps may be changed or some steps may be omitted as long as there is no contradiction other than the above description. For example, in the timeline display process, the control unit 300 may display a reply button (step S140), and then display a thumbnail image and superimpose a stamp (steps S136 and S138).

According to this embodiment, the terminal device 30 displays a timeline based on the timeline data acquired from the server device. Since the timeline data is designated as a posting destination to the group, it is acquired by the terminal devices 30 used by the users who belong to the group, and information sharing is realized. Further, when a reply operation is performed on the received image, information indicating that the reply operation has been performed is added (reflected) to the timeline. Therefore, as long as the user is connected to the server device, the user can share the image received by the image communication device and the contents of the operation via the terminal device regardless of the location.

Further, in the present embodiment, when a reply operation is performed, the content of the operation for the received image is added to the display content of the timeline in the terminal device 30 where the reply operation is performed. Therefore, it is possible to display the contents of the operation by the user in real time, and furthermore, it is possible to prevent a mismatch between the contents of the already displayed timeline and the contents of the operation performed by the user. Further, the server device adds (updates) information to the timeline data in which the received image that is the target of the reply is stored. For example, the server device updates the reply status to already replied, or adds a comment indicating that the reply has already been made to the message. By acquiring and displaying the timeline data again, the user can prevent a mismatch between the content displayed on the timeline and the content of the operation performed by the user. In this way, while maintaining the convenience of a service that displays messages input between a plurality of user terminals in real time in chronological order, the display content (received image) can be displayed without degrading operability. It may be possible to perform operations. By participating in the group, the user can obtain information about the image communication device and receive reception notifications via the terminal device. Therefore, it is possible to prevent the reception notification from being sent only to preset users. If you want to reply to the received data (received image) after confirming the reception notification, you can simply reply by selecting the reply button displayed on the timeline. In addition, by sharing the timeline data among a plurality of users, the plurality of users can share the response status for the received image.

Also, when the user selects a notification (receipt notification) that there is a new FAX reception and confirms the timeline, first, the thumbnail image of the received data (received image) is searched from the timeline, and the received data is received. Check the image. However, when the timeline is shared with other users, the timing of checking received images is generally different from that of other users. Since actions (operation details) performed by other users are displayed on the timeline until the user checks the received image, the user may find it difficult to check the process. As a result, it may be difficult for the user to grasp whether or not a reply operation has been performed on the received image. On the other hand, in the present embodiment, identification information such as a stamp is displayed on the thumbnail image corresponding to the received image to which the reply has been received, and a comment indicating that the reply has been completed is added to the message and displayed. , the user can easily grasp the received image to which the reply is sent at a glance.

Further, according to the present embodiment, the terminal device displays a message based on timeline data whose message type is "message for reply work" to the user who performs the reply operation, and displays it to the user who does not perform the reply operation. display is omitted. By omitting and displaying unnecessary information for a user who does not perform a reply operation, the terminal device can improve operability for the user.

Further, according to the present embodiment, when a reply operation is performed on a received image that has already been replied to, a warning is displayed. Therefore, the user can prevent an erroneous operation such as duplicating a reply.

[2. Second Embodiment]
Next, a second embodiment will be described. In the second embodiment, not only is the comment indicating that a reply has been added as described in the first embodiment, but also a comment indicating that a reply is being processed (operating) is added and displayed on the terminal device. is. The second embodiment is obtained by replacing FIG. 10 of the first embodiment with FIG. 17, and the same functional units and processes are denoted by the same reference numerals, and description thereof is omitted.

The flow of processing in the server device 20 of this embodiment will be described with reference to FIG. In the present embodiment, after the process of step S156, the control unit 200 adds a comment (for example, Text data such as "Mr. Yokomitsu is replying" is added (step S252). At this time, the control unit 200 updates the editing status of the timeline data read in step S154 to "edited".

After the process of step S168, the control unit 200 deletes the comment added in step S252 (step S254).

By the above-described processing, the message of the timeline data in which the received image to be the reply target is stored is stored from the time when the reply work request is received until the time when the reply execution request is received, that is, until the reply work is completed. , a comment indicating that a reply is in progress is added. The terminal device 30 obtains and displays the timeline data to which the comment has been added, thereby displaying that the reply operation is being performed.

In the present embodiment, the control unit 300 of the terminal device 30 also determines in step S114 whether or not the timeline data corresponding to the reply button includes a comment indicating that the message is being replied to. do. If the message includes a comment indicating that a reply is in progress, the control unit 300 displays a confirmation message (warning) indicating that a reply is in progress on the display unit 320 .

At this time, as in the first embodiment, the control unit 300 determines whether or not another user has performed a reply operation based on the timeline data, and switches whether to display a warning. may

Further, in step S134, if the message includes a comment indicating that a reply is in progress, the control unit 300 may highlight and display the comment. Comments can be emphasized by making the text size of comments larger than that of messages, making the text color of comments different from that of normal messages, drawing lines around comments, It is a method such as changing the background color.

An operation example of the present embodiment will be described with reference to FIG. FIG. 18(a) is an example of a timeline L200 displayed on the display unit 320 in this embodiment. A received message C200 is displayed on the timeline L200.

The received message C200 displays a thumbnail image F200 of the received image corresponding to the received message. Here, when a reply operation is performed on the received image corresponding to the received message C200, a comment indicating that a reply is in progress is displayed as in an area E200. Also, since the editing status of the timeline data corresponding to the received message C200 is already edited, a display indicating that it has been edited is displayed as in the area A200.

FIG. 18(b) is an example of the display screen W200 displayed on the display unit 320 when the reply button B200 displayed on the received message C200 shown in FIG. 18(a) is selected. In the present embodiment, a warning W202 is displayed when an attempt is made to perform a reply operation on a received image for which a reply operation has been performed. The user can choose whether or not to continue the reply operation.

According to the present embodiment, the terminal device 30 displays that the replying work is being done when the user is doing the replying work. Depending on the contents of the reply, it may take some time to reply. Even in this case, the user who performs the reply work should prevent other users from accidentally doing duplicate work. can be done.

[3. Third Embodiment]
The third embodiment is an embodiment in which the timeline is displayed after linking the timeline data to the image data. The third embodiment is obtained by replacing FIG. 8 of the first embodiment with FIG. 19, and the same functional units and processes are denoted by the same reference numerals, and description thereof is omitted.

The flow of processing of the terminal device 30 in this embodiment will be described with reference to FIG. In this embodiment, after the process of step S106, the control unit 300 selects one piece of timeline data from the timeline data displayed as the timeline, and selects timeline data having the same image ID as the selected timeline data. is extracted (step S302). In this way, the timeline data corresponding to one received image is linked.

Subsequently, the control unit 300 displays the same identification display for messages corresponding to the timeline data extracted in step S302 (step S304). The identification display is, for example, a strip-shaped rectangle having a predetermined width displayed next to the message. In this case, the control unit 300 displays a band-shaped rectangle with the same background color as the same identification display next to the message corresponding to the extracted timeline data. By doing so, the control unit 300 associates the message with one received image and performs the same colored display.

Note that, when repeatedly executing the process of step S304, the control unit 300 performs identification display different from the identification display that has already been displayed. For example, when executing step S304 for the first time, the control unit 300 displays a strip-shaped rectangle with a red background color. When executing step S304 for the second time, the control unit 300 displays a belt-shaped rectangle with a green background color. By doing so, the same identification display is displayed for messages based on timeline data in which the same image ID is stored, but messages based on timeline data in which different image IDs are stored are different from each other. Identification is displayed.

Note that the identification display does not have to be a strip-shaped rectangle, and may be the background color of the message, the character color of the message, an icon added to the message, or the like.

Subsequently, the control unit 300 extracts a message (a message displayed when a received image is received) based on the timeline data whose message type is “received message”, and a timeline with the latest date and time. Only messages based on the data (latest messages) are fully displayed, and other messages are omitted (reduced display) (step S306). By doing so, the control unit 300 can display, for each received image, among the messages for the same received image (1 data), the message (display at the time of reception) when the received image is received and the message other than the latest message. is abbreviated.

Subsequently, the control unit 300 displays (installs) a message display switching button for switching the display to the previous or next message for each message corresponding to the extracted timeline data (step S308). A message immediately preceding a certain message is a message having a date and time before the date and time of the certain message and corresponding to the date and time closest to the date and time of the certain message among the messages with the same identification display. Similarly, the next message in the message is the message corresponding to the date and time closest to the date and time of the certain message among the messages with the same identification indication, which date and time are later than the date and time of the certain message. In other words, the message display switching button is a button for switching the display to the messages before and after one in chronological order among the messages related to the same received image.

Subsequently, the control unit 300 determines whether or not all the timeline data has been extracted from the timeline data displayed as the timeline (step S310). If all the timeline data have not been extracted, the process returns to step S302, and the processing of steps S302 to S308 is executed for the unextracted timeline data (step S310; No→step S302).

Further, when the message display switching button is selected, the control unit 300 switches the display to the corresponding message (step S312; Yes→step S314). For example, the control unit 300 switches the display of the message by displaying the corresponding message one before or after at the position where the message display switching button selected by the user is displayed.

Note that the control unit 300 may execute either one of steps S306 and S308, or may not execute both.

An operation example in this embodiment will be described with reference to the drawings. In addition, in the description of the operation example, among the messages displayed on the timeline, the same messages are given the same reference numerals.

FIG. 20 is an example of a timeline L300 when an identification display is displayed in a message based on timeline data. Here, it is assumed that the same image ID is stored in the timeline data corresponding to message C300, message C320, message C340, message C350, and message C360. In this case, strip-shaped rectangles R300, R320, R340, R350, and R360 with the same background color are displayed next to these messages.

On the other hand, it is assumed that the same image ID is stored in the timeline data corresponding to message C310 and message C330. However, the image IDs corresponding to message C310 and message C330 are different from the image ID corresponding to message C300. In this case, strip-shaped rectangles R310 and R330 with the same background color are displayed next to the messages C310 and C330. However, rectangle R310 and rectangle R330 have different background colors from rectangle R300.

Further, assume that the image ID corresponding to message C370 is different from message C300 and message C310. In this case, the message C370 displays a strip-shaped rectangle R370 with a background color different from that of the rectangles R300 and R310.

In this way, messages corresponding to the same image ID are displayed with the same identification display, and messages corresponding to different image IDs are displayed with different identification displays. Therefore, even when the timeline is scrolled and displayed, the user can easily check a series of operations and states performed on the same received image.

FIG. 21 shows a case where messages other than those based on timeline data whose message type is "received message" and messages based on timeline data with the latest date and time among the messages with the same identification display are omitted. is an example of a timeline L310 in .

For example, message C300, message C320, message C340, message C350, and message C360 are displayed with the same identification. Of these, messages C320, C340, and C350 other than the message C300 based on the timeline data whose message type is "received message" and the message C360 based on the latest timeline data are omitted. Similarly, among the messages C310 and C330 having the same identification display, the message C310, which is a message other than the message C330 based on the latest timeline data, is omitted. Also, the message C370 whose message type is "received message" is displayed without omission.

Since messages other than the message indicating the reception of the FAX and the message indicating the latest status of the received image are omitted, the user can easily grasp the latest status of each received image.

FIG. 22(a) is an example of the timeline L320 when the message display switching button is displayed. For example, the message C300 includes a button B300 for switching the display to the previous message and a button B302 for switching the display to the next message. If there is no previous message or next message, the message display switching button may be disabled or hidden. For example, like button B300 in FIG. 22(a), button B300 may be disabled if there is no previous message.

FIG. 22(b) is an example of the timeline L330 when the button B302 in FIG. 22(a) is selected. In this case, the message C320, which is one message after, is displayed at the position where the message C300 was displayed. The message C320 also has a button B320 for switching the display to the previous message and a button B322 for switching the display to the next message. When the button B320 is selected, the message C300, which is the previous message, is displayed at the position where the message C320 was displayed. When the button B322 is selected, the next message (for example, message C340) is displayed at the position where the message C320 was displayed.

In this way, the user can switch back and forth between messages with the same identification display, ie, messages related to the same received image. As a result, the user can easily grasp the status of each received image.

According to this embodiment, the timeline is displayed after linking the timeline data linked to the same received image, so that the user can easily grasp the situation for the same received image.

In general, the display area of the screen of a mobile terminal is limited, and messages are displayed in chronological order. For example, as shown in FIG. 20, messages regarding operations on different received images may be arranged in chronological order. Also, for example, when the user confirms the message C350 in FIG. 20, the user can know that the reply data is being created (edited), but the operation on which data out of the plurality of FAX data (received images) cannot be performed. It is difficult to identify whether the message is about

According to the present embodiment, messages relating to the same received image are displayed with the same identification display. It becomes easier to check a series of tasks (operations) and status. In addition, among the messages with the same identification display, messages other than the message when the received image was received and the message based on the latest date and time of the timeline data are omitted and displayed. image). In addition, the user can switch the display to messages in chronological order by selecting a button to switch the display to the previous message or the next message. You can easily see the connections.

[4. Fourth Embodiment]
The fourth embodiment is an embodiment in which communication (notification) is performed when there is an unreply received image for which no reply operation has been performed.

In the present embodiment, for example, the notification display control unit 306 periodically checks the timeline data stored in the timeline data storage area 352 so that the date and time are included in a predetermined period (for example, one week), and the response status. to extract the timeline data for which is "unanswered". The timeline data extracted in this manner is timeline data including received images for which no reply operation has been performed for a predetermined period. When one or more pieces of timeline data can be extracted, the notification display control unit 306 displays a notification indicating that there is a received image for which a reply operation has not been performed. Note that the notification display control unit 306 may display a message stored in the extracted timeline data.

FIG. 23 is a diagram showing an operation example in this embodiment. FIG. 23 shows an example of the display screen W400 when the display unit 320 displays a notification W402 indicating that there is a received image for which a reply operation has not been performed. The notification W402 includes, for example, the contents of the message stored in the timeline data extracted by the notification display control unit 306 (for example, information about the received image such as the FAX number and date and time of reception).

According to the present embodiment, even if the unreply data (received image) is left unattended, the user can receive a notification (notification) from the system side (for example, the terminal device 30) by toast display or the like. By confirming, it is possible to prevent omission of correspondence to received images that have not yet been replied to.

[5. Fifth Embodiment]
The fifth embodiment is an embodiment in which the status of received images is displayed using a method other than the timeline.

In this embodiment, the terminal device 30 performs the following process instead of the timeline display process in step S106.

The control unit 300 reads out only the timeline data whose message type is “received message” and displays the messages on the display unit 320 in tabular form. Subsequently, the control unit 300 displays thumbnail images based on the read image data of the timeline data. When the reply status of the read timeline data is "Replied", the control unit 300 superimposes the stamp on the thumbnail image. Also, the control unit 300 displays a reply button.

When the reply button is selected, the control unit 300 displays a warning if the reply status of the timeline data corresponding to the reply button is "reply completed". Further, when a reply operation is performed, for example, the control unit 300 may display a reply operation message on the display unit 320 and accept an operation for editing reply data or a reply execution request.

FIG. 24 is a diagram showing an operation example in this embodiment. FIG. 24 is an example of a display screen W500 when timeline data is displayed in a tabular format on the display unit 320. As shown in FIG. A message E500 and a thumbnail image F500 of the received image are displayed on the display screen W500. Note that a stamp is displayed superimposed on the thumbnail image F502 of the received image corresponding to the timeline data whose reply status is “reply completed”.

A button B500 for replying the received image is also displayed on the display screen W500. When button B500 is selected by the user, display unit 320 displays a screen for accepting an operation to reply to the corresponding received image.

In this embodiment, the timeline data is displayed in a tabular format, but it may be displayed in a format other than the tabular format. Also, a screen displaying the timeline data in a timeline format and a screen displaying the timeline data in a tabular format may be switched.

According to this embodiment, the received image and the status of the received image can be summarized and displayed. Therefore, for example, even when there is a large amount of timeline data displayed on the terminal device and the displayed timeline is long, the user can easily grasp the received image and the status of the received image.

[6. Modification]
The present invention is not limited to the embodiments described above, and various modifications are possible. That is, the technical scope of the present invention also includes embodiments obtained by combining technical means appropriately modified within the scope of the present invention.

In addition, although the above-described embodiments are described separately for convenience of explanation, it is of course possible to combine them within the technically possible range. For example, the third embodiment and the fifth embodiment may be combined. By doing so, the user can check the message related to each received image in a timeline format, and can check the overview of the situation for each received image in a tabular format.

In addition, the program that operates in each device in the embodiment is a program that controls the CPU and the like (a program that causes the computer to function) so as to implement the functions of the above-described embodiments. Information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) during processing, and then stored in storage devices such as various ROMs (Read Only Memory) and HDDs. The data is read, corrected, and written by the CPU.

Here, as recording media for storing programs, semiconductor media (eg, ROM, non-volatile memory cards, etc.), optical recording media/magneto-optical recording media (eg, DVD (Digital Versatile Disc), MO (Magneto Optical Disc), MD (Mini Disc), CD (Compact Disc), BD (Blu-ray Disc), etc.), magnetic recording media (for example, magnetic tape, flexible disc, etc.). By executing the loaded program, the functions of the above-described embodiments are realized. In some cases, inventive features are realized.

When distributed to the market, the program can be stored in a portable recording medium for distribution, or transferred to a server computer connected via a network such as the Internet. In this case, of course, the storage device of the server computer is also included in the present invention.

1 system 10 image communication device 100 control unit 102 FAX control unit 104 image processing unit 106 reception processing unit 108 transmission processing unit 120 image reading unit 130 image forming unit 140 display unit 150 input unit 160 storage unit 162 image data storage area 164 authentication information 170 line communication unit 180 NW communication unit 20 server device 200 control unit 202 timeline data processing unit 204 reception data processing unit 206 authentication processing unit 210 NW communication unit 220 storage unit 222 timeline data storage area 224 image data storage area 226 authentication information Storage area 228 User information storage area 230 Device information storage area 232 Group information storage area 30 Terminal device 300 Control unit 302 Timeline data acquisition unit 304 Post processing unit 306 Notification information control unit 320 Display unit 330 Input unit 340 NW communication unit 350 Storage Unit 352 Timeline data storage unit 354 Image data storage area 356 Authentication information

Claims (10)

A display method, wherein, when displaying a thumbnail image based on a received image received by an image communication device, identification information indicating that the response has been completed is displayed together with the thumbnail image based on the received image that has been processed. 2. The display method according to claim 1, wherein said identification information is displayed superimposed on a thumbnail image based on said received image that has been processed. 3. The display method according to claim 1, further comprising: displaying information of a user who has performed a response to said received image together with said identification information. 4. The display method according to any one of claims 1 to 3, wherein said identification information is a stamp. 5. The display method according to any one of claims 1 to 4, wherein a button for selecting a process for the thumbnail image is displayed together with the thumbnail image. 6. The display method according to any one of claims 1 to 5, wherein said thumbnail images are displayed in a timeline format. 6. The display method according to any one of claims 1 to 5, wherein said thumbnail images are displayed in a table format. 6. The display method according to any one of claims 1 to 5, wherein the thumbnail images can be displayed by switching between a timeline format and a table format. 9. The display method according to any one of claims 1 to 8, wherein said thumbnail images are displayed so as to be viewable by an authorized user. A program executed in a computer for displaying thumbnail images based on received images received by an image communication device,
A program for causing the computer to display a thumbnail image based on a received image that has been handled together with identification information indicating that the handling has been completed.

Images