WO2020003508A1

WO2020003508A1 - Information processing method, information processing device, program, and electronic apparatus

Info

Publication number: WO2020003508A1
Application number: PCT/JP2018/024891
Authority: WO
Inventors: 侑一小野
Original assignee: Ｌｉｎｅ株式会社
Priority date: 2018-06-29
Filing date: 2018-06-29
Publication date: 2020-01-02

Abstract

Provided is an information processing method for an information processing device which provides a messaging service. A first account and a second account of the messaging service are grouped, first information is received from a first electronic apparatus with which the grouped first account is associated, and second information extracted from the first information is transmitted to a second electronic apparatus with which the second account is associated.

Description

Information processing method, information processing apparatus, program, and electronic device

The present disclosure relates to an information processing method, an information processing device, a program, and an electronic device.

Conventionally, there is known a technique for transmitting and receiving a message between a user and a bot of a business operator to order a product (for example, see Patent Document 1). However, there are cases where it is not appropriate to transmit information from the user to the bot of the business operator.

JP-A-2015-26092

According to a first aspect of the present invention, there is provided an information processing method for an information processing apparatus providing a messaging service, wherein a first account and a second account of the messaging service are grouped, and the grouped first accounts correspond to each other. The first information is received from the attached first electronic device, and the second information extracted from the first information is transmitted to the second electronic device associated with the second account.
According to a second aspect of the present invention, there is provided an information processing apparatus for providing a messaging service, wherein a control unit for grouping a first account and a second account of the messaging service corresponds to the grouped first account. A communication unit that receives the first information from the attached first electronic device and transmits the second information extracted from the first information to the second electronic device associated with the second account.
According to a third aspect of the present invention, there is provided a program to be executed by a computer of an information processing apparatus that provides a messaging service, wherein the processing includes grouping a first account and a second account of the messaging service. A process of receiving the first information from the first electronic device associated with the first account, and a process of transmitting the second information extracted from the first information to the second electronic device associated with the second account And execute.
According to a fourth aspect of the present invention, there is provided an information processing method of an electronic device provided with a messaging service from an information processing device, wherein the method is grouped with an electronic device associated with a first account of the messaging service. Receiving a request from an electronic device different from the electronic device to which the second account of the messaging service is associated, and responding to an operation of transmitting first information to the user's electronic device based on the reception of the request; The second information extracted from the first information is transmitted to an electronic device different from.
According to a fifth aspect of the present invention, there is provided a program to be executed by a computer of an electronic device provided with a messaging service from an information processing device, the program being grouped with an electronic device associated with a first account of the messaging service. Receiving a request from an electronic device different from the electronic device associated with the second account of the messaging service, and responding to an operation of transmitting first information to the user's electronic device based on the reception of the request. And transmitting the second information extracted from the first information to an electronic device different from the electronic device.
According to a sixth aspect of the present invention, there is provided an electronic device provided with a messaging service from an information processing apparatus, wherein the electronic device is grouped with an electronic device associated with a first account of the messaging service. A communication unit that receives a request from an electronic device different from the electronic device with which the two accounts are associated, and responds to an operation of transmitting first information to the user's electronic device based on the reception of the request; Includes a control unit that controls transmission of the second information extracted from the first information to a different electronic device via the communication unit.

1 is a diagram illustrating a configuration of a communication system according to an embodiment of the present disclosure. FIG. 5 is a diagram illustrating an example of a processing sequence of the communication system according to the first embodiment. It is a figure showing the example of a display of the screen of the terminal concerning an embodiment. It is a figure showing an example of a sequence of a process of a communication system concerning a 2nd embodiment. It is a figure showing an example of a sequence of a process of a communication system concerning a 3rd embodiment. It is a figure showing an example of the sequence of the processing of the communication system concerning a 4th embodiment.

<Compliance with legal matters>
It should be noted that the disclosure herein is subject to compliance with the legal requirements of the country of implementation necessary for the practice of this disclosure, including communication secrets.

An embodiment for implementing the information processing method according to the present disclosure will be described with reference to the drawings.

<System configuration>
FIG. 1 is a diagram illustrating a configuration of a communication system 1 according to an embodiment of the present disclosure. As disclosed in FIG. 1, in the communication system 1, the server 10, the terminals 20 (the terminals 20 </ b> A, 20 </ b> B, and 20 </ b> C) and the external server 50 are connected via the network 30. The server 10 provides the terminal 20 owned by the user via the network 30 with a messaging service for realizing transmission and reception of contents such as messages and images between the terminals 20. Note that the number of terminals 20 connected to the network 30 is not limited.

The network 30 plays a role of connecting one or more terminals 20, one or more servers 10, and one or more external servers 50. That is, the network 30 means a communication network that provides a connection path so that data can be transmitted and received after the terminal 20 connects to the server 10 or the like.

One or more portions of the network 30 may be a wired network or a wireless network. The network 30 may be, for example and without limitation, an ad hoc network (ad @ hoc @ network), an intranet, an extranet, a virtual private network (virtual @ private @ network: VPN), a local area network (local @ area @ network: LAN), and wireless. LAN (wireless LAN: WLAN), wide area network (wide area network: WAN), wireless WAN (wireless WAN: WWAN), metropolitan area network (MAN), part of the Internet, public switched telephone network (Public) Part of Switched Telephone Network: PSTN, mobile phone network, integrated service digital network (ISDN), wireless LAN, long term evolution (LTE), code division multiple access (CDMA), Bluetooth (registered trademark), satellite Communication Or it may include combinations of two or more thereof. Network 30 may include one or more networks 30.

The terminal 20 (the terminal 20A, the terminal 20B, and the terminal 20C) may be any terminal as long as it is an information processing terminal capable of realizing the functions described in each embodiment. Terminal 20 may include, but is not limited to, a smartphone, a mobile phone (feature phone), a computer (eg, but not limited to, a desktop, laptop, tablet, etc.), a media computer platform (eg, but not limited to, a cable, satellite set, etc.). Top box, digital video recorder), handheld computer device (personal digital assistant (e.g., by way of example and not limitation), e-mail client, etc.), wearable terminal (eyeglass device, watch device, etc.), or other type of computer , Or a communication platform. Further, the terminal 20 may be expressed as an information processing terminal.

Since the configurations of the terminal 20A, the terminal 20B, and the terminal 20C are basically the same, the terminal 20 will be described in the following description. If necessary, the terminal used by the user X is expressed as a terminal 20X, and user information in a predetermined service associated with the user X or the terminal 20X is expressed as user information X. Note that the user information is information of a user associated with an account used by the user in a predetermined service. The user information is, by way of example and not limitation, a user's name, a user's icon image, a user's age, a user's gender, a user's address, and a user's hobby, input by the user or given by a predetermined service It includes information associated with the user, such as the user's preference and the user's identifier, and any one of these or a combination thereof may be used.

The server 10 has a function of providing a predetermined service to the terminal 20. The server 10 may be any device as long as the information processing device can realize the functions described in each embodiment. The server 10 includes, but is not limited to, a server device, a computer (for example, but not limited to, a desktop, laptop, tablet, etc.), a media computer platform (for example, but not limited to, a cable, a satellite set-top box, a digital video recorder). ), A handheld computing device (such as, but not limited to, a PDA, an email client, etc.), or any other type of computer, or communication platform. Further, the server 10 may be expressed as an information processing device. When it is not necessary to distinguish between the server 10 and the terminal 20, the server 10 and the terminal 20 may be expressed as information processing devices, respectively.

The external server 50 is, for example, a server operated by a company such as a company, a government office, or various organizations, and has a function of exchanging messages and the like with the user of the terminal 20 by bot and providing various services to the user of the terminal 20. Prepare. The external server 50 may be any device as long as the information processing device can realize the functions described in each embodiment.

<Hardware (HW) configuration>
The HW configuration of each device included in the communication system 1 will be described with reference to FIG.

(1) HW Configuration of Terminal The terminal 20 includes a control unit 21 (CPU: central processing unit (CPU)), a storage unit 28, a communication I / F 22 (interface), an input / output unit 23, and a display unit 24. The input / output unit 23 may include a microphone 25, a speaker 26, a camera 27, a touch panel 29, and the like. The components of the HW of the terminal 20 are interconnected via a bus B as an example and not by way of limitation. The touch panel 29 is an example of an operation unit, and may be a keyboard hardware key, a pointing device such as a mouse, or the like instead of or in addition to the touch panel 29. Note that it is not essential that the HW configuration of the terminal 20 include all components. As an example and not by way of limitation, the terminal 20 may be configured to have no individual components or multiple components, such as a microphone 25, a camera 27, and the like.

The communication I / F 22 transmits and receives various data via the network 30. The communication may be performed by wire or wirelessly, and any communication protocol may be used as long as mutual communication can be performed. The communication I / F 22 has a function of executing communication with the server 10 via the network 30. The communication I / F 22 transmits various data to the server 10 according to an instruction from the control unit 21. Further, the communication I / F 22 receives various data transmitted from the server 10 and transmits the data to the control unit 21. Further, the communication I / F 22 receives a radio wave from the beacon 40. The communication I / F 22 may include a separate circuit for each communication standard, for example. By way of example, and not limitation, the communication I / F 22 may include a first wireless communication unit (first communication circuit) using BLE and a second communication unit (second communication circuit) performing communication using LTE. The communication I / F 22 may communicate with the beacon 40 using the first communication unit and communicate with the server 10 via the network 30 using the second communication unit. This configuration may be changed as appropriate, and any configuration described in at least the embodiments may be adopted. Also, the communication I / F 22 may be simply referred to as a communication unit. Further, when the communication I / F 22 is configured by a physically structured circuit, it may be expressed as a communication circuit.

The input / output unit 23 includes an input unit which is a device for inputting various operations on the terminal 20 and an output unit which is a device for outputting a processing result processed by the terminal 20. In the input / output unit 23, the input unit and the output unit may be integrated, or may be separated into the input unit and the output unit.

The input unit is realized by any one or a combination of all types of devices that can receive an input from a user and transmit information related to the input to the control unit 21. The input unit includes, for example and without limitation, hardware keys such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (operation input via a moving image), and a microphone (operation input by voice).

The output unit is realized by any one or a combination of all types of devices capable of outputting the processing result processed by the control unit 21. The output unit includes, for example and without limitation, a touch panel, a touch display, a speaker (audio output), a lens (for example, without limitation, 3D (three dimensions) output and a hologram output), and a printer.

The display unit 24 is realized by any one or a combination of all types of devices capable of displaying according to the display data written in the frame buffer. The display unit 24 includes, for example and without limitation, a touch panel, a touch display, a monitor (for example, but not limited to, a liquid crystal display and an OELD (organic electroluminescence display)), a head mounted display (HDM: Head Mounted Display), a projection mapping, and a hologram. And a device capable of displaying images, text information, and the like in the air or the like (may be a vacuum). Note that these display units 24 may be capable of displaying display data in 3D.

(4) When the input / output unit 23 is a touch panel, the input / output unit 23 and the display unit 24 may be arranged to face each other with substantially the same size and shape.

The control unit 21 includes a physically structured circuit for executing a function realized by a code or an instruction included in a program, and includes, for example and without limitation, a data processing device built in hardware. Is realized by: Therefore, the control unit 21 may be expressed as a control circuit.

The control unit 21 includes, for example and without limitation, a central processing unit (CPU), a microprocessor, a processor core, a multiprocessor, an ASIC (application-specific integrated circuit), and an FPGA (field programmable). gate array).

The storage unit 28 has a function of storing various programs and various data required for the operation of the terminal 20. The storage unit 28 includes, without limitation, various storage media such as a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a random access memory (RAM), and a read only memory (ROM). Further, the storage unit 28 may be expressed as a memory.

The terminal 20 stores the program P in the storage unit 28 and executes the program P so that the control unit 21 executes processing as each unit included in the control unit 21. That is, the program P stored in the storage unit 28 causes the terminal 20 to realize each function executed by the control unit 21.

The microphone 25 is used for inputting audio data. The speaker 26 is used for outputting audio data. The camera 27 is used for acquiring moving image data.

(2) Server HW configuration
The server 10 includes a control unit 11 (CPU), a storage unit 15, a communication I / F 14 (interface), an input / output unit 12, and a display (display unit) 13. The components of the HW of the server 10 are interconnected via a bus B, for example and not limitation. Note that the HW of the server 10 does not necessarily include all components as a configuration of the HW of the server 10. As an example and not by way of limitation, the HW of the server 10 may be configured to have no display 13.

The control unit 11 includes a physically structured circuit for executing a function realized by a code or an instruction included in a program, and includes, for example and without limitation, a data processing device built in hardware. Is realized by:

The control unit 11 is typically a central processing unit (CPU), and may be a microprocessor, a processor core, a multiprocessor, an ASIC, or an FPGA. However, in the present disclosure, the control unit 11 is not limited to these.

The storage unit 15 has a function of storing various programs and various data necessary for the operation of the server 10. The storage unit 15 is realized by various storage media such as an HDD, an SSD, and a flash memory. However, in the present disclosure, the storage unit 15 is not limited to these. Further, the storage unit 15 may be expressed as a memory.

The communication I / F 14 transmits and receives various data via the network 30. The communication may be performed by wire or wirelessly, and any communication protocol may be used as long as mutual communication can be performed. The communication I / F 14 has a function of executing communication with the terminal 20 via the network 30. The communication I / F 14 transmits various data to the terminal 20 according to an instruction from the control unit 11. Further, the communication I / F 14 receives various data transmitted from the terminal 20 and transmits the data to the control unit 11. The communication I / F 14 may be simply referred to as a communication unit. Further, when the communication I / F 14 is configured by a physically structured circuit, it may be expressed as a communication circuit.

The input / output unit 12 is realized by a device that inputs various operations to the server 10. The input / output unit 12 is realized by any one or a combination of all types of devices that can receive an input from a user and transmit information related to the input to the control unit 11. The input / output unit 12 is typically realized by a hardware key represented by a keyboard or the like, or a pointing device such as a mouse. The input / output unit 12 may include, for example, but not limited to, a touch panel, a camera (operation input through a moving image), and a microphone (operation input by voice). However, in the present disclosure, the input / output unit 12 is not limited to these.

The display 13 is typically realized by a monitor (a liquid crystal display or an OELD (organic electroluminescence display) by way of example and not limitation). Note that the display 13 may be a head-mounted display (HDM) or the like. Note that these displays 13 may be capable of displaying display data in 3D. However, in the present disclosure, the display 13 is not limited to these.

The server 10 stores the program P in the storage unit 15 and executes the program P so that the control unit 11 executes processing as each unit included in the control unit 11. That is, the program P stored in the storage unit 15 causes the server 10 to realize each function executed by the control unit 11.

In each embodiment of the present disclosure, a description will be given on the assumption that the terminal 20 and / or the CPU of the server 10 execute the program P to be realized.

Note that the control unit 21 of the terminal 20 and / or the control unit 11 of the server 10 are not only a CPU but also a logic circuit formed on an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or the like. Each processing may be realized by (hardware) or a dedicated circuit. In addition, these circuits may be realized by one or a plurality of integrated circuits, and the plurality of processes described in each embodiment may be realized by one integrated circuit. Further, the LSI may be referred to as a VLSI, a super LSI, an ultra LSI, or the like, depending on the degree of integration. Therefore, the control unit 21 may be expressed as a control circuit.

The program P (software program / computer program) of each embodiment of the present disclosure may be provided in a state stored in a computer-readable storage medium. (4) The storage medium can store the program in a “temporary tangible medium”.

The storage medium is, where appropriate, one or more semiconductor-based or other integrated circuits (ICs), such as, but not limited to, a field programmable gate array (FPGA) or an application specific IC (ASIC). ), Hard disk drive (HDD), hybrid hard drive (HHD), optical disk, optical disk drive (ODD), magneto-optical disk, magneto-optical drive, floppy diskette, floppy disk drive (FDD), magnetic It may include a tape, a solid state drive (SSD), a RAM drive, a secure digital card or drive, any other suitable storage medium, or a suitable combination of two or more. A storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate. The storage medium is not limited to these examples, and may be any device or medium as long as the program P can be stored. Further, the storage medium may be expressed as a memory.

The server 10 and / or the terminal 20 read the program P stored in the storage medium and execute the read program P to realize the functions of the plurality of functional units described in each embodiment.

The program P of the present disclosure may be provided to the server 10 and / or the terminal 20 via an arbitrary transmission medium (a communication network, a broadcast wave, or the like) capable of transmitting the program. The server 10 and / or the terminal 20 realize the functions of the plurality of functional units described in each embodiment by executing the program P downloaded via the Internet or the like without limitation.

The embodiments of the present disclosure can also be realized in the form of a data signal embedded in a carrier wave, in which the program P is embodied by electronic transmission.

At least part of the processing in the server 10, the external server 50, and / or the terminal 20 may be realized by cloud computing including one or more computers.

The server 20 may be configured to perform at least part of the processing in the terminal 20 and the external server 50. In this case, at least a part of the processing of the control unit 21 of the terminal 20 and the processing of each functional unit of the external server 50 may be performed by the server 10.

At least a part of the processing in the server 10 and the external server 50 may be performed by the terminal 20. In this case, at least a part of the processing of the control unit 11 of the server 10 and the processing of each functional unit of the external server 50 may be performed by the terminal 20.

Unless explicitly stated, the configuration of the determination in the embodiment of the present disclosure is not essential, and a predetermined process is performed when the determination condition is satisfied, or a predetermined process is performed when the determination condition is not satisfied. May be.

The program of the present disclosure includes, without limitation, script languages such as ActionScript and JavaScript (registered trademark), object-oriented programming languages such as Objective-C and Java (registered trademark), and markup languages such as HTML5. Implemented using Note that the hardware configuration of the external server 50 may be the same as the hardware configuration of the server 10.

<Functional configuration>
(1) Functional Configuration of Terminal The input / output unit 23 receives various operations from the user of the terminal 20 and outputs the operation to the control unit 21. For example, but not limited to, a user operation is received by the touch panel 29 of the terminal 20 and output to the control unit 21. The control unit 21 performs control to display the content received from the server 10 on the display unit 24 based on the received operation by the user.

The control unit 21 performs a process for using various services provided by the server 10, such as SNS (Social Networking Service).

The communication I / F 22 (communication unit) transmits and receives data to and from the server 10 and the like according to the instruction of the control unit 21.

(2) Functional Configuration of Server As shown in FIG. 1, the server 10 stores account information 151, content information 152, and the like in the storage unit 15. The account information 151 stores account information for various services such as SNS. The content information 152 stores content such as an image and a sound transmitted from the terminal 20 using a messaging service (not a limitation, but an example of a messaging service).

The control unit 11 performs various processes for providing various services such as SNS to the user of the terminal 20. The control unit 11 causes the terminal 20 to display various display screens by transmitting information for displaying various display screens to the terminal 20 via the communication I / F 14, for example.

Further, for example, upon receiving a login request from an account of a user of the terminal 20 and a business operator of the external server 50, the control unit 11 performs user authentication, and executes the account and the terminal 20 or the external device used for the login. The information is stored in association with the server 50. In this case, for example, the control unit 11 may store the account ID of the account in association with the ID of the terminal 20 or the like, the address for communication, or the information on the communication session.

The control unit 11 groups users of a plurality of accounts by using, for example, a messaging service, and transmits and receives contents in a group including the plurality of accounts. Here, the grouping means, for example, a group in which each user of a plurality of accounts designated by the user is operated by the user or the like of the terminal 20 (for example, message data between the associated users is not limited, Talk room in which communication can be performed). Each content transmitted and received in the group can be displayed on the screen of the terminal 20.

{Circle around (5)} The control unit 11 causes the storage unit 15 to store the content such as an image transmitted from the terminal 20 to the business operator's bot account by the messaging service. Further, the control unit 11 transmits contents such as images stored in the storage unit 15 to the external server 50 based on a request from the external server 50.

The control unit 11 receives image content such as a moving image and a still image received from the terminal 20 and audio content. Then, the control unit 11 extracts information from the received content. For example, the control unit 11 performs image recognition of a two-dimensional code included in the image from the content of the image, and extracts a character string or the like from the two-dimensional code. The control unit 11 may extract an image of a partial area of the received image from the content of the received image.

The communication I / F 14 (communication unit) transmits and receives data to and from the terminal 20 and the external server 50 according to an instruction from the control unit 11.

<First embodiment>
Next, an outline of processing of the communication system 1 according to the first embodiment will be described first. In the first embodiment, when receiving the first content such as an image from the terminal 20, the server 10 transmits information for acquiring the first content to the external server 50. Then, the server 10 extracts information from the first content based on a request from the external server 50, and transmits the extracted information to the external server 50. Thereby, the information from the user can be more appropriately transmitted to the business operator or the like. Further, the processing load on the server 10 and the external server 50 can be reduced.

<Process>
Next, processing of the communication system 1 according to the first embodiment will be described with reference to FIGS. FIG. 2 is a diagram illustrating an example of a processing sequence of the communication system 1 according to the first embodiment. FIG. 3 is a diagram illustrating a display example of the screen of the terminal 20 according to the embodiment. Note that, before the processing illustrated in FIG. 2, the server 10 performs user authentication and the like to perform an account of a user of the terminal 20 (not a limitation, an example of a first electronic device) (not a limitation, an example of a first account). .) And an external server 50 (an example of a second electronic device, not a limitation) accepts a login from a business account (an example of a second account, not a limitation) and uses the terminal 20 to use a messaging service or the like. And the external server 50 is permitted. In addition, it is assumed that transmission and reception of content using the messaging service provided by the server 10 is performed in a group including an account of a user of the terminal 20 and an account of a business of the external server 50, such as a bot.

<< Process to Extract Based on Request from External Server 50 >>
First, referring to FIG. 2, when the server 10 is requested to extract information from the external server 50, the server 10 extracts information from the first content (an example of first information, not limitation) transmitted from the terminal 20. An example of the process for extracting will be described.

In the process of step S101, the control unit 21 of the terminal 20 receives an operation of transmitting the first content such as an image from the user of the terminal 20. Subsequently, the control unit 21 of the terminal 20 transmits the first content such as an image designated by the user of the terminal 20 using the messaging service provided by the server 10 (Step S102).

Subsequently, the control unit 11 of the server 10 determines the type of the first content received from the terminal 20, and stores the received first content when the type of the received first content is an image or the like (Step S103). ). When the type of the first content is text or the like, the control unit 11 of the server 10 transfers the first content to the external server 50 using a messaging service.

In addition, the control unit 11 of the server 10 determines whether the account of the external server 50 is an account of a predetermined type, and executes the processing after step S103 only when the account of the predetermined type is used. It may be. That is, when the account of the external server 50 is a business account or the like, the external server 50 can acquire the information extracted from the first content from the server 10. On the other hand, if the account of the external server 50 is a user account or the like, the received first content is transferred to the external server 50. Thereby, when the account of the external server 50 is an account of a predetermined type, the processing load of the external server 50 can be reduced.

Subsequently, the control unit 11 of the server 10 transmits information for downloading the stored first content to the external server 50 (Step S104). Here, the information for downloading the first content may include, for example, a URL (Uniform Resource Locator) of the first content. The information for downloading the first content may include identification information of the first content transmitted from the terminal 20. Note that, when the server 10 receives a request (for example, but not limited to, an example of the first request) including the URL of the first content from the external server 50 using a communication protocol such as HTTP, the server 10 transmits data of the first content. Returns a response containing Accordingly, when data of content such as an image is required, the external server 50 can download the content stored in the server 10 by a service different from the messaging service.

Next, the external server 50 determines a process for the first content (Step S105). Here, the external server 50 may analyze, for example, the context of a message transmitted and received between the external server 50 and the terminal 20 by using the AI. Alternatively, the external server 50 may analyze, for example, the content of the message transmitted to the terminal 20 last. Then, for example, since a message such as "Please send a picture of the two-dimensional code of the absence slip" is transmitted to the terminal 20, it is predicted that the first content contains information of a predetermined type such as a two-dimensional code. In this case, the external server 50 determines to extract a predetermined type of information from the first content. Hereinafter, a case will be described in which the external server 50 determines to extract information of a predetermined type from the first content. Note that the processing in step S105 is not essential. For example, when the first content such as an image is transmitted from the terminal 20, the external server 50 may unconditionally perform the process of step S106 without performing the determination of step S105.

Subsequently, the external server 50 transmits to the server 10 a request for extracting information of a predetermined type from the first content stored by the server 10 (information extraction request; an example of a second request, not limitation). Step S106). Accordingly, the server 10 can perform a process of extracting information of a predetermined type from the content when the external server 50 determines that the information included in the content such as an image is necessary.

The external server 50 extracts the information to be extracted in the process of step S105 based on, for example, the context of the message transmitted and received between the external server 50 and the terminal 20 or the content of the last message transmitted to the terminal 20. May be determined. Then, in the process of step S106, the external server 50 may transmit the information extraction request including the information specifying the type of the information to be extracted, in addition to the identification information of the first content transmitted from the terminal 20. . The types of information to be extracted include, for example, an image of a two-dimensional code printed on the subject of the image, information based on the two-dimensional code printed on the subject of the image, information indicating the subject of the image, and information included in the image. Information of the character (scene character) that is being displayed may be specified. Further, as the type of information to be extracted, for example, character string information or the like obtained by converting voice information transmitted from the terminal 20 by voice recognition may be designated. Thus, for example, the external server 50 can specify the type of information extracted from the content based on the context of a message transmitted and received between the external server 50 and the terminal 20.

Next, the control unit 11 of the server 10 extracts information of a predetermined type (not limited, but an example of second information) from the first content (Step S107). Here, the control unit 11 of the server 10 may extract information of the type specified in the information extraction request received from the external server 50. For example, when the type of information to be extracted is not specified from the external server 50, the control unit 11 of the server 10 may extract information of a preset type.

処理 Note that the processing from step S104 to step S106 is not essential. For example, when the first content such as an image is transmitted from the terminal 20, the external server 50 may unconditionally perform the processing of step S107 without performing the processing of steps S104 to S106.

Here, the control unit 11 of the server 10 may extract information of the type designated to the external server 50 from the content of the image using, for example, AI (Artificial Intelligence). Note that the process of step S107 may be executed using, for example, a function of another server connected by a cloud or the like.

Next, the control unit 11 of the server 10 transmits the extracted information to the external server 50 (Step S108). Here, the control unit 11 of the server 10 transmits, for example, information based on the two-dimensional code printed on the subject of the image. As a result, only the character string extracted by image recognition from the image transmitted from the terminal 20 is transferred to the external server 50, so that the external server 50 is compared with the case where the image transmitted from the terminal 20 is transferred. Can be reduced.

制御 The control unit 11 of the server 10 transmits, for example, information indicating the subject in the image. As a result, only the information of the product or the like captured by the terminal 20 is transferred to the external server 50, so that the processing load on the external server 50 can be reduced.

The control unit 11 of the server 10 transmits, for example, information of one or more characters appearing in the image. As a result, only the character information captured by the terminal 20 is transferred to the external server 50, so that the processing load on the external server 50 can be reduced.

{Circle around (4)} The control unit 11 of the server 10 cuts out a rectangular or square area including the two-dimensional code printed on the subject from the image transmitted from the terminal 20, for example, and transmits the cut-out image. Thereby, since only a part of the area of the image transmitted from the terminal 20 is transferred to the external server 50, the processing load on the external server 50 can be reduced.

{Circle around (4)} The control unit 11 of the server 10 transmits, for example, character string information obtained by performing voice recognition on voice information transmitted from the terminal 20 and converting the voice information. As a result, only the character information obtained by converting the voice recorded by the terminal 20 is transferred to the external server 50, so that the processing load on the external server 50 can be reduced.

As described above, the data capacity (data size) of the information extracted by the control unit 11 of the server 10 can be smaller than the data capacity of the first content such as an image transmitted from the terminal 20. Therefore, the processing load on the external server 50 can be reduced as compared with the case where the first content such as the image transmitted from the terminal 20 is transferred to the external server 50. Further, the processing load due to communication when transferring from the server 10 to the external server 50 can be reduced.

Next, the external server 50 transmits the second content such as a message based on the extracted information to the terminal 20 via the server 10 (Step S109). Subsequently, the terminal 20 displays the received second content on a screen (Step S110). Here, the terminal 20 displays the display screen shown in FIG. FIG. 3 shows a display that displays various contents such as messages, images, and stamps transmitted and received by a group including a plurality of accounts in a time series of transmission and reception using a messaging service provided by the server 10. An example of a screen 300 (screen of a talk room) is shown.

In the example of FIG. 3, a message 301 transmitted from the terminal 20 and a message 302 "Please send a picture of the two-dimensional code of the absence slip" transmitted from the bot of the external server 50 are displayed. Further, an image 303 transmitted from the terminal 20 by the processing of step S102 is displayed. Note that the image 303 is, for example, an image photographed by the terminal 20 by a user's operation, and in accordance with an instruction from the external server 50 in the message 302, a delivery slip absence slip to which a printed matter of the two-dimensional code 303A is attached. 303B is shown. In addition, by the process of step S108, the message 304 "request for redelivery received" transmitted from the bot of the external server 50 based on the information of the two-dimensional code extracted from the image 303 is displayed. I have.

<Second embodiment>
Next, an outline of processing of the communication system 1 according to the second embodiment will be described first. In the first embodiment, an example has been described in which after the first content is transmitted from the terminal 20, the external server 50 requests extraction of information from the first content. In the second embodiment, an example will be described in which the external server 50 requests extraction of information from the first content before the first content is transmitted from the terminal 20. Thereby, similarly to the first embodiment, information from the user can be more appropriately transmitted to the business operator or the like. Further, the processing load on the server 10 and the external server 50 can be reduced. The contents described in the second embodiment can be applied to any of the other embodiments.

<Process>
Next, a process of the communication system 1 according to the second embodiment will be described with reference to FIG. FIG. 4 is a diagram illustrating an example of a processing sequence of the communication system 1 according to the second embodiment. Note that the second embodiment is the same as the first embodiment except for a part, and thus the description will be appropriately omitted. In the following, description of parts common to the first embodiment will be omitted, and only different parts will be described.

First, in step S200, the external server 50 determines a process for the first content transmitted from the terminal 20 thereafter. Here, the external server 50 analyzes, for example, the context of the message transmitted and received between the external server 50 and the terminal 20 by using the AI, similarly to the processing of step S105 in FIG. 2 described above. . Then, when it is predicted that the first content such as an image transmitted from the terminal 20 later contains information of a predetermined type such as a two-dimensional code, the information transmitting apparatus transmits an information extraction reservation request to the server 10. Here, the information extraction reservation request may include information specifying the type of information to be extracted.

Subsequently, the external server 50 transmits to the server 10 a request to reserve extraction of information of a predetermined type from the first content (an information extraction reservation request. An example of a second request, not limitation) (step S201). .

Subsequently, the control unit 11 of the server 10 stores the received information extraction reservation request (Step S202). Subsequently, the control unit 21 of the terminal 20 receives an operation of transmitting the first content such as an image from the user of the terminal 20 (Step S203). Subsequently, the control unit 21 of the terminal 20 transmits the first content such as an image designated by the user of the terminal 20 using the messaging service provided by the server 10 (Step S204).

Subsequently, the control unit 11 of the server 10 determines the type of the first content received from the terminal 20, and stores the received first content when the type of the received first content is an image or the like (Step S205). ).

Next, the control unit 11 of the server 10 extracts information of a predetermined type from the first content (Step S206). Here, the control unit 11 of the server 10 may extract information of the type specified in the information extraction reservation request received from the external server 50.

Subsequently, the control unit 11 of the server 10 transmits the stored information for downloading the first content and the extracted information to the external server 50 (Step S207).

Next, the external server 50 transmits the second content such as a message based on the extracted information to the terminal 20 via the server 10 (Step S208). Subsequently, the terminal 20 displays the received second content on the screen (Step S209).

As described above, in the second embodiment, before the first content is transmitted from the terminal 20, the external server 50 requests the server 10 to extract information from the first content. Then, when the server 10 is requested to extract information from the external server 60, upon receiving the first content from the terminal 20, the server 10 extracts information from the first content and transmits the information to the external server 60. Thereby, the information from the user can be more appropriately transmitted to the business operator or the like.

<Third embodiment>
Next, an outline of processing of the communication system 1 according to the third embodiment will be described first. In the second embodiment, an example has been described in which the external server 50 requests the server 10 to extract information from the first content. In the third embodiment, an example will be described in which the external server 50 requests the server 10 via the terminal 20 to extract information from the first content. Thereby, similarly to the first embodiment and the second embodiment, it is possible to more appropriately transmit information from a user to a business operator or the like. Further, the processing load on the server 10 and the external server 50 can be reduced. Further, in the server 10 according to the third embodiment, since it is not necessary to store the information extraction reservation request unlike the server 10 according to the second embodiment, the processing in the server 10 is simplified. can do. The contents described in the third embodiment can be applied to any of the other embodiments.

<Process>
Next, processing of the communication system 1 according to the third embodiment will be described with reference to FIG. FIG. 5 is a diagram illustrating an example of a processing sequence of the communication system 1 according to the third embodiment. Note that the third embodiment is the same as the first embodiment or the second embodiment except for a part, and thus the description will be appropriately omitted. In the following, description of portions common to the first and second embodiments will be omitted, and only different portions will be described.

First, in step S300, the external server 50 determines a process for the first content transmitted from the terminal 20 thereafter. Subsequently, the external server 50 issues, via the server 10, a request for extracting information of a predetermined type from the first content stored by the server 10 (information extraction request; an example of a second request without limitation). The data is transmitted to the terminal 20 (step S301). Here, the external server 50 analyzes, for example, the context of the message transmitted and received between the external server 50 and the terminal 20 by using the AI. Then, if it is predicted that the first content such as an image transmitted from the terminal 20 later contains information of a predetermined type such as a two-dimensional code, the information extraction request is registered in the terminal 20. Here, the information extraction request may include information specifying the type of information to be extracted, as in the first embodiment. The information extraction request according to the third embodiment may include, for example, information such as a flag indicating that the command is not displayed on the screen of the terminal 20.

Next, the control unit 21 of the terminal 20 stores the received information extraction request (Step S302). Subsequently, the control unit 21 of the terminal 20 receives an operation of transmitting the first content such as an image from the user of the terminal 20 (Step S303). Subsequently, the control unit 21 of the terminal 20 transmits the first content such as the image designated by the user of the terminal 20 and the stored information extraction request using the messaging service provided by the server 10. (Step S304). Thereby, for example, in response to the transmission of the first content from the terminal 20, information extracted from the first content is transmitted to the external server 50. Therefore, a reply from the bot of the external server 50 when the first content is transmitted from the terminal 20 can be performed more quickly.

Subsequently, the control unit 11 of the server 10 determines the type of the first content received from the terminal 20, and stores the received first content when the type of the received first content is an image or the like (step S305). ).

Next, the control unit 11 of the server 10 extracts information of a predetermined type from the first content (Step S306). Subsequently, the control unit 11 of the server 10 transmits the stored information for downloading the first content and the extracted information to the external server 50 (Step S307).

Next, the external server 50 transmits the second content such as a message based on the extracted information to the terminal 20 via the server 10 (Step S308). Subsequently, the terminal 20 displays the received second content on the screen (Step S309).

As described above, in the third embodiment, the external server 50 requests the terminal 20 to extract information from the first content. Then, the terminal 20 transmits the information extraction request and the first content to the server 10. Then, the server 10 extracts information from the first content based on the information extraction request, and transmits the information to the external server 60. Thereby, the information from the user can be more appropriately transmitted to the business operator or the like.

<Fourth embodiment>
Next, an outline of processing of the communication system 1 according to the fourth embodiment will be described first. In the fourth embodiment, an example will be described in which the terminal 20 extracts information from the first content based on a request from the external server 50. As a result, similarly to the first to third embodiments, information from a user can be more appropriately transmitted to a business operator or the like. Further, since the information is extracted from the first content in the terminal 20, the processing load on the server 10 can be further reduced. The contents described in the fourth embodiment can be applied to any of the other embodiments.

<Process>
Next, processing of the communication system 1 according to the fourth embodiment will be described with reference to FIG. FIG. 6 is a diagram illustrating an example of a processing sequence of the communication system 1 according to the fourth embodiment. Note that the fourth embodiment is similar to the first, second, or third embodiment except for a part, and thus the description will be appropriately omitted. In the following, description of portions common to the first, second, or third embodiment will be omitted, and only different portions will be described.

First, in step S400, the external server 50 determines a process for the first content transmitted from the terminal 20 thereafter. Subsequently, the external server 50 sends a request to reserve the extraction of information of a predetermined type from the first content (information extraction reservation request. An example of the second request, not limitation) to the terminal 20 via the server 10. It transmits (step S401). Subsequently, the control unit 21 of the terminal 20 stores the received information extraction reservation request (Step S402). Subsequently, the control unit 21 of the terminal 20 receives an operation of transmitting the first content such as an image from the user of the terminal 20 (Step S403).

Next, the control unit 21 of the terminal 20 extracts information of a predetermined type from the first content (Step S404). Note that the process of step S404 may be executed using a function of another server connected by a cloud or the like, for example.

Subsequently, the control unit 21 of the terminal 20 transmits the first content such as the image designated by the user of the terminal 20 and the extracted information using the messaging service provided by the server 10 (Step S405). .

Subsequently, the control unit 11 of the server 10 determines the type of the first content received from the terminal 20, and stores the received first content when the type of the received first content is an image or the like (step S406). ). Subsequently, the control unit 11 of the server 10 transmits the stored information for downloading the first content and the extracted information to the external server 50 (Step S407).

Next, the external server 50 transmits the second content such as a message based on the extracted information to the terminal 20 via the server 10 (Step S408). Subsequently, the terminal 20 displays the received second content on the screen (Step S409).

As described above, in the fourth embodiment, the terminal 20 extracts information from the first content based on a request from the external server 50. Then, the terminal 20 transmits the extracted information and the first content to the server 10. Then, the server 10 transmits the information extracted by the terminal 20 to the external server 60. Thereby, the information from the user can be more appropriately transmitted to the business operator or the like.

<Effects of Embodiment>
In the related art, for example, a bot of a company receives all contents such as images transmitted from users, so that when a large amount of contents such as images are transmitted from a plurality of users or the like, processing such as transmission / reception of contents is performed. The load may increase.

According to at least a part of the embodiment described above, the information extracted from the content selected by the user of the terminal 20 is transmitted to the external server 50. Thereby, the information from the user can be more appropriately transmitted to the business operator or the like. Further, the processing load on the server 10 and the external server 50 can be reduced.

Although the embodiments of the present disclosure have been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various changes and modifications based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present disclosure. By way of example and not limitation, the functions included in each means, each step, etc. can be rearranged so as not to be logically inconsistent, and a plurality of means, steps, etc. may be combined into one or divided. Is possible. Further, the configurations described in the embodiments may be appropriately combined.

1 communication system 10 server 11 control unit 14 communication I / F
15 Storage unit 151 Account information 152 Content information 20 Terminal 21 Control unit 22 Communication I / F
23 I / O unit 50 External server

Claims

An information processing method for an information processing apparatus that provides a messaging service,
Grouping a first account and a second account of the messaging service;
Receiving first information from a first electronic device associated with the grouped first account;
The second information extracted from the first information is transmitted to a second electronic device associated with the second account.
The information processing method according to claim 1, wherein
Upon receiving the first request from the second electronic device, the first information is transmitted to the second electronic device by a service different from the messaging service.
An information processing method according to claim 1 or claim 2,
When receiving the second request from the second electronic device, the second information is transmitted to the second electronic device associated with the second account.
An information processing method according to any one of claims 1 to 3, wherein
When receiving the second request from the first electronic device, the second information is transmitted to the second electronic device associated with the second account.
An information processing method according to claim 3 or claim 4, wherein
The second request includes information specifying the second information extracted from the first information,
The information processing device transmits the second information specified in the second request to a second electronic device associated with the second account.
An information processing method according to any one of claims 1 to 5, wherein
The first information is image information,
The second information is information including at least one of information based on a two-dimensional code of the image, information indicating a subject of the image, and information of characters in the image.
An information processing method according to any one of claims 1 to 5, wherein
The first information is image information including two-dimensional code information,
The second information is information including two-dimensional code information in the image information.
An information processing method according to any one of claims 1 to 7, wherein
The first information is information about a voice,
The second information is information including a character string obtained by converting the voice by voice recognition.
An information processing method according to any one of claims 1 to 8, wherein
The second information is information having a smaller data capacity than the first information.
An information processing device for providing a messaging service,
A control unit for grouping a first account and a second account of the messaging service;
The first information is received from the first electronic device associated with the grouped first account, and the second information extracted from the first information is stored in a second electronic device associated with the second account. A communication unit for transmitting to the electronic device.
A program to be executed by a computer of an information processing device that provides a messaging service,
Grouping a first account and a second account of the messaging service;
A process of receiving first information from a first electronic device with which the grouped first accounts are associated;
Transmitting the second information extracted from the first information to the second electronic device associated with the second account.
An information processing method for an electronic device in which a messaging service is provided from an information processing device,
Receiving a request from a different electronic device from the electronic device associated with the electronic device associated with the first account of the messaging service and associated with the second account of the messaging service;
The second information extracted from the first information is transmitted to an electronic device different from the electronic device in response to a user's operation of transmitting the first information to the electronic device based on the reception of the request.
A program to be executed by a computer of an electronic device provided with a messaging service from an information processing device,
Receiving a request from an electronic device different from the electronic device associated with the electronic device associated with the first account of the messaging service and associated with the electronic device associated with the second account of the messaging service; ,
Transmitting the second information extracted from the first information to an electronic device different from the electronic device in response to a user operation of transmitting the first information to the electronic device based on the reception of the request. Let it run.
An electronic device provided with a messaging service from the information processing device,
A communication unit configured to receive a request from an electronic device different from the electronic device associated with the electronic device associated with the first account of the messaging service and associated with the second account of the messaging service; When,
Second information extracted from the first information via the communication unit to an electronic device different from the electronic device in response to a user operation of transmitting first information to the electronic device based on the reception of the request; And a control unit for performing control for transmitting the data.