JP7371843B1 - Lost and Found Management System and Program - Google Patents

Abstract

[Problem] To provide a lost item management system and program that can search for a lost item using an interaction service that interacts with a user.
[Solution]
The worker terminal registers the lost item registration information, including the captured lost item image, predetermined attributes obtained by image recognition of the lost item image, and predetermined notification items, to the lost item management server, and installs the lost item in the facility. In a user terminal equipped with a dialog section that provides a dialog service provided by the user, the user is asked questions about some or all of the predetermined attributes and/or predetermined matters to be reported, and information about lost items is obtained based on the user's answers. do.
[Selection diagram] Figure 1

Description

Application of Article 30, Paragraph 2 of the Patent Act Presentation materials for ``Lost and Found System - Flow of Lost and Found Registration'' and ``Lost and Found System - How Users Operate''. (December 7, 2020: Shinkansen Maintenance Tokai Co., Ltd. (inside JR Tokai Tokyo Station) Used as presentation material by a person who has the right to obtain a patent.)

TECHNICAL FIELD The present invention relates to a lost item management system and program that can search for lost items using an interaction service that interacts with users.

As a so-called AI chatbot that uses artificial intelligence technology to respond to user's utterances, a method and apparatus for intelligent chat between humans and machines using artificial intelligence is known, for example, as disclosed in Patent Document 1. The technology of Patent Document 1 acquires a user's intention through text data from a multimodal input signal including an audio signal, an image signal, a sensor signal, and/or an event-driven signal, and converts the corresponding answer into a multimodal input signal. Output as an output signal.

JP 2017-010517 Publication

Since AI chatbots can provide appropriate answers to a wide variety of inquiries from users, their usefulness has been recognized in facilities with many users.

2. Description of the Related Art Inquiries regarding lost and found items frequently occur in facilities with a large number of users. In particular, in facilities such as railway facilities, inquiries may be made at a later date at a station building near the user regarding items lost in a train. In such cases, the station staff or other employee in charge of the inquiry must make further inquiries at other station buildings where the lost item may be stored, a task that requires the use of many human resources. Therefore, there was a need for an information processing system that can search for lost items as an interactive service that can interact with AI chatbots and other users.

The present invention has been made in view of the above-mentioned problems, and it is an object of the present invention to provide a lost item management system and a program that can search for lost items through an interactive service that allows users to interact with each other.

In order to solve this problem, the lost item management system according to the invention of claim 1 is a lost item management system that manages lost items in a facility, and performs image recognition of a lost item image obtained by photographing the lost item. a lost item attribute acquisition unit that acquires a predetermined attribute regarding the lost item ; a lost item registration unit that registers lost item information including the predetermined attribute and predetermined submission information; a lost item management server comprising a lost item acquisition unit that acquires the registered lost item information based on part or all of the attributes and/or the predetermined submission information; and a lost item that captures the lost item image. an imaging unit , a lost item reporting information input unit for inputting the predetermined reporting information , a predetermined attribute acquired by the lost item attribute acquisition unit from the image captured by the lost item imaging unit , and the inputted item. A worker terminal including a lost item registration request unit that requests the lost item management server to register the lost item information including predetermined items to be submitted, and a user and a worker terminal that transmits and receives information via video, and/or Alternatively, an interactive unit that provides an interactive service for exchanging information by voice, and outputting information for causing the user to search for the lost item and for causing the user to search for the lost item input by the user. A lost item search condition input /output unit that acquires information , and acquisition of the lost item information by the lost item acquisition unit based on part or all of the inputted predetermined attributes and/or the predetermined submission items. a lost item search unit that presents the storage location of the lost item based on the acquired lost item information;
The lost item search condition input/output unit specifies the predetermined attribute and/or the predetermined notification item registered in the lost item registration unit of the lost item management server. a question presenting section that presents the user with a question to ask the user; and a question answering section that obtains the user's answer to the question presented by the question presenting section, and the question presenting section is configured to include characters, Alternatively, a first question presenting unit generates and presents a question for identifying the lost item information registered in the lost item registration unit of the lost item management server to the user by displaying the video including an image. and a second question presenting unit that generates and presents a question for identifying the lost item information registered in the lost item registration unit of the lost item management server to the user using the voice, The question answering section is configured to respond to the question presented by the first question presenting section or the second question presenting section by answering the user's questions input by a predetermined manual operation using the user's operating means. In response to the question presented by the first question answering unit that obtains an answer, the first question presenting unit, or the second question presenting unit, the user's voice input by the user's utterance is It has a second question answering section that obtains an answer, and the question presenting section is configured to provide the user with the video of the lost item information for identifying the lost item, which is provided by the first question presenting section. and/or the second question presenting unit presents the voice to identify the lost item, and the user receives an answer using the operating means of the user; It is possible to arbitrarily select either an answer that sequentially inputs each piece of lost item information based on the user's utterance, or an answer that inputs multiple pieces of lost item information at once based on the user's utterance. It is characterized by providing .

The invention according to claim 2 is characterized in that, in the invention according to claim 1, the lost item report item input section inputs part or all of the predetermined item to be reported by voice input.

The invention according to claim 3 is characterized in that, in addition to the configuration according to claim 1, the predetermined attributes include a name, type, shape, and color of the lost item.

According to a fourth aspect of the invention, in addition to the configuration described in claim 1, the facility is a railway facility, and the report information includes a found place indicating a place where the lost item was found, and the lost item is a found place. is characterized in that it includes a train name, car number, and seat number when the lost item is found on a train.

According to a fifth aspect of the present invention, in addition to the configuration described in the first aspect, the interactive section displays an avatar on a display section of the user terminal to provide the interactive service.

According to the configuration of the present invention, the lost item information registered by the lost item registration section includes a predetermined attribute and a predetermined notification item, and the user terminal can input the predetermined attribute and/or predetermined notification item via the interaction section. Lost item information is obtained by receiving answers from users regarding some or all of the items. With this configuration, it is possible to search for a lost item using an interactive service that interacts with the user.

1 is a block diagram conceptually showing the overall configuration of a lost item management system according to an embodiment of the present invention. FIG. 2 is a flow diagram showing the flow of lost item registration in the embodiment of the present invention. FIG. 2 is a diagram schematically showing the configuration of an imaging screen in an embodiment of the present invention. FIG. 3 is a diagram schematically showing the configuration of an attribute display screen in an embodiment of the present invention. FIG. 2 is a diagram schematically showing the configuration of a transfer item input screen in an embodiment of the present invention. FIG. 2 is a diagram schematically showing the configuration of a registration completion screen in an embodiment of the present invention. FIG. 3 is a flowchart showing the flow of responding to a lost item inquiry in an embodiment of the present invention. FIG. 3 is a diagram schematically showing the configuration of an interaction screen in an embodiment of the present invention. FIG. 6 is a diagram illustrating an example of presenting a question asking about the type of lost item on the dialog screen according to the embodiment of the present invention. FIG. 6 is a diagram illustrating an example of presenting a question asking about the type of lost item on the dialog screen according to the embodiment of the present invention. FIG. 7 is a diagram illustrating an example of presenting a question asking about the shape of a lost item on the dialog screen according to the embodiment of the present invention. FIG. 6 is a diagram illustrating an example of presenting a question inquiring about the lost time on the dialog screen according to the embodiment of the present invention. FIG. 7 is a diagram illustrating an example of presenting a question asking about the characteristics of a lost item on a dialog screen according to an embodiment of the present invention. FIG. 3 is a diagram schematically showing the configuration of a search execution screen in an embodiment of the present invention. FIG. 3 is a diagram schematically showing the configuration of a search result screen in an embodiment of the present invention.

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram conceptually showing the overall configuration of a lost item management system 1 according to an embodiment of the present invention. As shown in FIG. 1, in the lost item management system 1 according to the present embodiment, a lost item management server 2 is communicably connected to a worker terminal 3 and a user terminal 4 via a network 5. Specifically, the lost item management system 1 in this embodiment is a lost item management system that manages user's lost items found in station buildings, vehicles, and other railway facilities.

The lost item management server 2 is a server device that manages information regarding discovered lost items. In this embodiment, the lost item management server 2 includes a lost item attribute acquisition section 21, a lost item registration section 22, and a lost item acquisition section 23.

In this embodiment, the lost item management server 2 is configured using a well-known server computer. The HDD (Hard Disk Drive), SSD (Solid State Drive), and other storage devices of the server computer are pre-recorded with a program that allows the server computer to function as the lost and found management server 2. By loading it into memory and executing it by a CPU (central processing unit), the server computer functions as the lost item management server 2.

The lost item attribute acquisition unit 21 uses image recognition to acquire predetermined attributes regarding the lost item from a lost item image captured by a lost item imaging unit 31 of the worker terminal 3, which will be described later. In this embodiment, the name, type, shape, and color of the lost item are acquired as predetermined attributes.

The lost item registration unit 22 registers lost item information regarding the lost item in a lost item database (not shown) included in the lost item management server 2. In the present embodiment, the lost item information is information including a lost item image obtained by capturing a lost item, a predetermined attribute, and a predetermined report item. The registered lost item information is information to be acquired by the lost item acquisition unit 23, which will be described later.

The lost item acquisition unit 23 acquires the lost item information registered by the lost item registration unit 22 based on part or all of the predetermined attributes and/or predetermined submission items. As described above, in this embodiment, lost item information is registered in the lost item database by the lost item registration section 22. The lost item acquisition unit 23 searches the lost item database using a predetermined attribute and some or all of the predetermined items as search conditions, and obtains lost item information that matches the search conditions.

The worker terminal 3 is a terminal used by a facility worker. In this embodiment, the facilities are station buildings, rolling stock, and other railway facilities as described above, and the workers are station staff and other employees of the company that operates the railway facilities. The worker terminal 3 includes a lost item imaging unit 31, a lost item attribute display unit 32, a lost item notification information input unit 33, and a lost item registration request unit 34. uses the worker terminal 3 to register lost item information regarding the found lost item in the lost item management server 2.

The lost item imaging unit 31 images a lost item. In the mobile device of this embodiment, the worker terminal 3 is equipped with a camera (not shown) that photographs the front and/or back side of the worker terminal 3, and the lost object imaging unit 31 uses the camera to take an image of the lost object. .

The lost item attribute display section 32 displays predetermined attributes regarding the lost item. As described above, the lost item management server 2 in this embodiment includes the lost item attribute acquisition unit 21, which acquires the name, type, shape, and color of the lost item as predetermined attributes regarding the lost item. The lost item attribute display unit 32 displays the attributes acquired by the lost item attribute acquisition unit 21 on a display included in the worker terminal 3 or other display device (not shown).

The lost item report information input section 33 inputs predetermined report items regarding the lost item. The predetermined notification items may include any information necessary for the management of the lost item, but in this embodiment, the date and time the lost item was found, the location of the discovery, and the facility where the lost item is stored are specified. This will be used as a matter to be conveyed.

The lost item registration requesting unit 34 requests the lost item management server 2 to register lost item information. As described above, the lost item information in this embodiment is information including a lost item image, predetermined attributes, and predetermined notification items, and the lost item registration requesting unit 34 stores the lost item image captured by the lost item imaging unit 31. Generates lost item information including an image, a predetermined attribute displayed on the lost item attribute display section 32, and a predetermined report item inputted through the lost item information input section 33, and stores the generated lost item information as a lost item information. The information is sent to property management server 2 to request registration. Upon receiving the request, the lost item management server 2 registers the lost item information using the lost item registration unit 22.

The worker terminal 3 in this embodiment is configured using a smartphone or other mobile terminal owned by a station staff or other employee who is a worker. A program for making the mobile terminal function as the worker terminal 3 is recorded in the non-volatile memory and other storage areas of the mobile terminal, and by loading the program into the memory of the mobile terminal and executing it by the CPU, the mobile terminal is made to function as a worker terminal 3. Note that although the worker terminal 3 in this embodiment is configured using a smartphone or other mobile terminal owned by the worker, the manner in which the worker terminal 3 is configured is arbitrary; for example, The worker terminal 3 may be configured using a computer installed in a lost item storage area of the station building or other locations.

The user terminal 4 is a terminal used by a user of the facility. The facility in this embodiment is a railway facility as described above, and the users are passengers and other users of the railway facility. In this embodiment, the user terminal 4 is a terminal installed at a predetermined location in the station building, and includes an interaction section 41, a lost item search condition input section 42, and a lost item search section 43.

The dialogue unit 41 provides an interactive service for exchanging information with the user using video and/or audio. The user terminal 4 in this embodiment includes a touch panel display (not shown) as a display device, and an interaction screen described later is displayed on the display device. An avatar is displayed on the dialog screen, and the user receives services while interacting with the avatar. Although any service may be provided, the user terminal 4 in this embodiment provides not only a lost item search service but also a route guidance service to the station building and surrounding locations, and a transfer guidance service in an interactive manner. Provided to users as a service.

The lost item search condition input section 42 allows the user to answer a question posed during the dialog with the user by the above-mentioned dialog section 41, so that the lost item search condition input section 42 can search for some or all of the predetermined attributes and/or predetermined items to be submitted. input. The lost item search condition input section 42 in the present embodiment includes a question presentation section 421 that presents a question regarding any one of a predetermined attribute and/or a predetermined submission item, and a user who responds to the question presented by the question presentation section 421. The computer is equipped with a question answering section 422 for inputting answers by voice or touch panel.

The lost item search unit 43 retrieves the lost item information from the lost item acquisition unit 23 based on part or all of the predetermined attributes and/or predetermined submission items input by the lost item search condition input unit 42 described above. and presents the storage location of the lost item based on the acquired lost item information.

As described above, the user terminal 4 in this embodiment is a terminal placed at a predetermined location in the station building. In this embodiment, the user terminal 4 is a computer equipped with a display or other display device (not shown), and a program stored in a storage device of the computer is loaded into the memory and executed by the CPU. is made to function as a user terminal 4. In this embodiment, the user terminal 4 is a terminal placed at a predetermined location in the station building, but the type of computer used to configure the user terminal 4 may be arbitrarily selected. For example, , the user terminal 4 may be configured using a smartphone owned by the user.

The network 5 connects the lost item management server 2 to the worker terminal 3 and the user terminal 4 in a communicable manner. As the network 5, a well-known computer network can be used. For example, a wide area network such as the Internet, a local LAN (Local Area Network), or a VPN built on a wide area network can be used. (Virtual Private Network) may also be used. Further, the network 5 may be a wired network, a wireless network, or a combination of these networks.

The above is the entire configuration of the lost item management system 1 in this embodiment.

Next, the flow of lost item information registration processing in this embodiment will be explained. FIG. 2 is a flowchart showing the flow of lost item registration in this embodiment. Lost item registration in this embodiment is performed by a station staff or other employee who discovers a lost item in a station building, vehicle, or other railway facility by operating the worker terminal 3.

The worker who found the lost item uses the worker terminal 3 to capture an image of the found lost item. When the worker operates the worker terminal 3 to start registering the lost item, the worker terminal 3 displays a lost item imaging screen on the display device of the worker terminal 3.

FIG. 3 is a diagram schematically showing the configuration of the lost object imaging screen in this embodiment. As shown in FIG. 3, the lost item image display screen W1 in this embodiment includes an image W11 and an image capture button W12. The video W11 is a video showing the imaging range of the lost item imaging unit 31 of the worker terminal 3, and the worker adjusts the position of the worker terminal 3 and the distance from the lost item so that the lost item falls within the imaging range. When the operator presses the imaging button W12, the lost object imaging unit 31 of the worker terminal 3 captures the image W11 at the timing when the imaging button W12 was pressed as a lost object image (see step S11).

When the lost item image is captured, the worker terminal 3 then acquires and displays predetermined attributes regarding the captured lost item (see step S12). When the lost item image is captured in step S<b>11 described above, the worker terminal 3 generates lost item attribute request information including the lost item image and sends it to the lost item management server 2 . When the lost item management server 2 receives the lost item attribute request information, the lost item attribute acquisition unit 21 performs image recognition on the lost item image, acquires a predetermined attribute of the lost item, and transmits it to the worker terminal 3. When the worker terminal 3 receives the predetermined attribute transmitted from the lost item management server 2, the lost item attribute display section 32 of the worker terminal 3 displays an attribute display screen on the display device.

Any well-known feature extraction and retrieval method may be selected as a method for obtaining predetermined information about a lost item. For example, the shape, color, and other features are extracted from a lost item image by image recognition, and the extracted information is extracted. A matching article may be searched from a database that records predetermined characteristics of articles using the search condition. Alternatively, a predetermined attribute may be inferred from the lost item image using an inference model generated by machine learning.

FIG. 4 is a diagram schematically showing the configuration of the attribute display screen in this embodiment. As shown in FIG. 4, the attribute display screen W2 in this embodiment includes a lost item image W21, a name W22, a type W23, a shape W24, a color W25, and a next button W26. In the attribute display screen W2, the lost item image W21 is the lost item image captured in step S11, and the name W22 to color W25 are the predetermined attributes acquired in step S12. In the present embodiment, the predetermined attributes acquired from the lost item management server 2 are displayed on the worker terminal 3, but for example, the worker can arbitrarily change the predetermined attributes on the attribute display screen W2 or otherwise change the predetermined attributes. It may be possible to make corrections. For example, at least one of the name W22, type W23, shape W24, and color W25 on the attribute display screen W2 may be configured as a correction item selection button. In this case, the configuration is such that when the user selects any of the name W22, type W23, shape W24, and color W25 configured as correction item selection buttons, the selected item can be corrected by text input, etc. can.

When the worker operates the worker terminal 3 and presses the next button W26 on the attribute display screen W2, the lost item report input section 33 of the worker terminal 3 displays a report item input screen on the display device of the worker terminal 3. is displayed to prompt the operator to input predetermined transfer matters (step S13).

FIG. 5 is a diagram showing the configuration of the transfer item input screen in this embodiment. As shown in FIG. 5, the transfer matter input screen W3 includes a transfer matter input form W31 and a registration button W32. As mentioned above, the notification information in this embodiment consists of the date and time when the lost item was found, the location where the lost item was found, and the storage location of the lost item, and the notification item input form W31 also includes the date and time when the lost item was found corresponding to the above. It includes a form W31a, a train name form W31b, a car number form W31c, a seat number form W31d, and a storage location form W31e.
The lost item management system 1 in this embodiment is an information system that manages lost items in railway facilities as described above, and the predetermined notification information includes, when a lost item is found on a train, the name of the train as the place where the item was found, It is configured to include the car number and seat number. Note that the information to be included in the predetermined submission information may be arbitrarily selected; for example, a found facility form may be provided in case a lost item is found at a railway facility other than a train.
Furthermore, the predetermined transfer items that the operator is required to input may be changed based on part of the predetermined transfer items. For example, if a lost item is found in a station building, the floor and section of the station building will be entered as the location, and if a lost item is found in a train, the train name, car number, and seat number will be entered as shown in Figure 5. You may also be asked to input it as a location.
Furthermore, in this embodiment, the transfer matter may be configured to be automatically created by the worker terminal 3. For example, lost item information is recorded by the worker terminal 3 by a location information acquisition section (not shown), user information setting section, riding vehicle information setting section, date and time information setting section, etc. set in the worker terminal 3. It may be configured such that information such as the location (including station name, train name, car number name, etc.), date and time, station staff, crew, etc. can be automatically acquired. In this case, it may be configured such that forms corresponding to items that can be automatically set are not displayed among the notification item input form W31 on the notification item input screen W3 shown in FIG. If the date and time can be automatically acquired, the configuration may be such that the found date and time form W31a is not displayed.)

When the worker operates the worker terminal 3 to input predetermined information and presses the registration button W32, the lost item registration request section 34 of the worker terminal 3 requests registration of lost item information (step (See S14). In this embodiment, lost item information including the lost item image captured in step S11, predetermined attributes acquired and displayed in step S12, and predetermined report items input in step S13 is generated, and lost item management is performed. The lost item information is sent to the server 2 to request registration. When the lost item management server 2 receives the request and the lost item information, the lost item registration unit 22 records the lost item information in the lost item database included in the lost item management server 2.

When the registration of the lost item information in step S14 is completed, the worker terminal 3 displays a registration completion screen on the display device. FIG. 6 is a diagram schematically showing the configuration of the registration completion screen in this embodiment. As shown in FIG. 6, the registration completion screen W4 includes a registration completion message W41 and a next shooting button W42. When the next photographing button W42 is pressed, the worker terminal 3 displays the lost item image display screen W1 again on the display device and repeatedly executes the processes of steps S11 to S14.

The above is the flow of lost item registration in this embodiment.

Next, the flow of responding to a lost item inquiry in this embodiment will be explained.

FIG. 7 is a flowchart showing the flow of responding to a lost item inquiry in this embodiment, and FIG. 8 is a diagram schematically showing the configuration of an interaction screen in this embodiment. As described above, the user terminal 4 in this embodiment is a terminal installed at a predetermined location in the station building. The user terminal 4 displays the dialog screen W5 shown in FIG. 8 on the display device of the user terminal 4, and provides dialog services in response to inquiries from users. As shown in FIG. 8, the dialogue screen W5 includes an avatar W51, a selection icon W52, a speech/question display section W53, a voice input icon W54, a volume adjustment icon W55, and a language selection icon W56.

The avatar W51 is a character that interacts with the user. In this embodiment, the avatar W51 performs an animation of nodding or listening while the user speaks, and when the user terminal 4 outputs audio, the avatar W51 utters the audio. Animate it as if it were. Further, when the user terminal 4 outputs audio, the outputted audio content is converted into text and displayed on the utterance/question display section W53.

In the utterance/question display section W53, questions presented to the user by the user terminal 4 and voices uttered by the user are displayed in text form. 8 to 12 show a state in which a question presented to the user by the user terminal 4 is displayed in text on the utterance/question display section W53. FIG. 13 shows a state in which the voice uttered by the user is displayed as text in the utterance/question display section W53.

Note that the utterance/question display section W53 may be configured to sequentially display the question presented to the user and the voice uttered by the user for each process. For example, when the user terminal 4 recognizes the voice uttered by the user, the recognized voice is displayed as text in the utterance/question display section W53, and when the user terminal 4 asks the user a question, the utterance/question The text display of the voice recognition result displayed on the question display section W53 may be configured to switch to the text display of a question to the user.

In this embodiment, the display device of the user terminal 4 is configured with a touch screen type display. In addition to voice, by touching a predetermined location on the dialogue screen W5, the user can press an icon or button at the touched location.

When the user presses the voice input icon W54 and speaks to the effect that he/she wishes to inquire about a lost item, the user terminal 4 starts processing for responding to a lost item inquiry. The lost item inquiry processing in this embodiment includes a lost item search condition input process (see step S21) and a lost item search process (see step S22).

In step S21, a question is presented to the user, and by the user answering the presented question, a part or all of a predetermined attribute and/or a predetermined submission item is input as a search condition. In this embodiment, step S21 is a process performed by the lost item search condition input unit 42 of the user terminal 4.

Specifically, the question presenting unit 421 presents a question to the user by displaying one of a predetermined attribute and/or a predetermined submission item on the dialog screen W5 (see step S211), and responds to the presented question. The user presses the voice input icon W54 to speak or selects one of the selection icons W52 to receive an answer (step S212).

In FIG. 8, a "lost item" button W52a is provided in the selection icon W52. When the user selects the "lost item" button W52a, the lost item management system 1 can execute a process for identifying the lost item. In addition, when the user presses the voice input icon W54 and utters a voice requesting identification of a lost item, such as "I left something behind" or "I'm looking for a lost item," the lost item management system 1 A process for identifying a lost item can be executed.

The user terminal 4 repeats steps S211 and S212 until it becomes possible to identify one or a predetermined number of lost items based on a response input by voice after the user selects the selection icon W52 or selects the voice input icon 54.

As a result, the lost item management system 1 can provide an interactive service to the user of the user terminal 4, that is, the user terminal 4 and the user can ask and answer questions once or multiple times. , it is possible to provide a service desired by the user (in this case, identifying a forgotten item, etc.).

Note that the user terminal 4 is configured so that selection of the selection icon W52 and voice input by speaking can be performed at the same time, and the user can also input information by selecting the selection icon W52 and inputting information by voice input. can.

Note that the method for determining whether a lost item can be identified may be arbitrarily selected. For example, the number of pieces of lost item information corresponding to the lost item management server 2 may be determined based on the answers obtained in steps S211 and S212. It may be configured such that a request to obtain is sent and it is determined whether the number of pieces of lost item information included in the reply from the lost item management server 2 to the request is one or less than a predetermined number. Further, the lost item information is acquired using the lost item search unit 43 or the lost item acquisition unit 23 of the lost item management server 2, and it is determined whether the number of the acquired lost item information is 1 or less than a predetermined number. Good too.

FIGS. 9 to 13 are diagrams showing examples of question presentation on the dialog screen in this embodiment.

The dialog screen W5 in FIG. 9 is an example of a screen that is displayed as a result of pressing the "Lost and Found" button W52a on the dialog screen W5 in FIG. 8. The dialogue screen W5 in FIG. 9 is an example in which a question regarding the type of lost item is presented to the user, and the question display section W53 displays a message "What did you forget?" from the user terminal 4. A question is displayed in text, and the selection icon W52 has a plurality of buttons for selecting the lost item.

In FIG. 9, when the user presses the "wallet" selection button W52b, a question regarding the shape of the lost item is presented on the dialog screen W5, as shown in FIG. In other words, the question display section W53 displays "What kind of 'shape'?" ” is displayed as text from the user terminal 4 to the user, and the selection icon W52 is provided with a plurality of buttons for selecting the shape of the “wallet” of the lost item.

In FIG. 10, when the user presses the "long wallet" selection button W52c, a question regarding the color of the lost item is presented on the dialog screen W5, as shown in FIG. 11. That is, the question display section W53 displays "What kind of 'color'?" ” is displayed as text from the user terminal 4 to the user, and the selection icon W52 is provided with a plurality of buttons for selecting the color of the “long wallet” that is the lost item.

In FIG. 11, when the user presses the "brown" selection button W52d, a question regarding when the lost item was lost is presented on the dialog screen W5, as shown in FIG. That is, a question from the user terminal 4 to the user such as "When did you drop the lost item?" is displayed in text in the question display area W53, and the selection icon W52 is provided with a plurality of buttons for selecting when the lost item was lost. ing. The user identifies the lost item by pressing a corresponding icon from among the selection icons W52, for example, the "yesterday" button W52e indicating that the item was lost yesterday.

As shown in FIGS. 8 to 12, the user terminal 4 allows the user to identify a lost item using an interactive service.

On the other hand, FIG. 13 is an example of the dialog screen W5 displayed when the voice input icon 54 is pressed on the dialog screen W5 of FIG. In FIG. 13, a speech display section W57 is shown instead of the selection icon W52 of FIGS. 9 to 12. Here, a question from the user terminal 4 to the user is displayed in text in the question display section W53, and a result of the user terminal 4 recognizing the user's utterance using the voice recognition function is displayed in the utterance display section W57. Text is displayed. In the dialogue screen 13 of FIG. 13, questions for the user similar to those illustrated in FIGS. 9 to 12 are displayed in text on the question display section 53. The terminal 4 performs voice recognition on the content of the user's utterance and displays it on the utterance display section 57. That is, the user terminal 4 acquires lost item information such as "I'm looking for something I forgot," "It's my brown long wallet," and "I lost it yesterday" by recognizing the user's voice utterance.

As shown in FIGS. 8 and 13, the user terminal 4 allows the user to identify a lost item using an interactive service.

Note that in this embodiment, the input method of the search condition can be arbitrarily selected on the dialog screen W5 of the user terminal 4.

For example, in the user terminal 4, instead of using the selection icon W52 on the dialogue screen W5 shown in FIG. 9, the user may be allowed to enter information about the lost item by free input using text, or the information shown in FIG. On the dialog screen W5, the user can identify the lost item through free speech (first, "wallet", then "long wallet", then "brown", etc.). Instead, the user is asked to say multiple items at once to identify the lost item, such as "I lost my brown long wallet at △△ station on the day of 〇 month." A configuration may be considered in which the recognition function analyzes the item and extracts items necessary to identify the lost item, such as "long wallet" and "brown item".

As described above, the search condition input procedure is performed in step S21.

When the input of the search conditions in step S21 is completed, the user terminal 4 uses the lost item search unit 43 to search for the lost item based on part or all of the predetermined attributes and/or predetermined submission items that are the input search conditions. (Step S22).

Specifically, step S22 in this embodiment includes obtaining lost item information (see step S221) and displaying search results (see step S222).

In step S221, the lost item information is acquired by the lost item acquisition unit 23 of the lost item management server 2 based on part or all of the predetermined attributes and/or predetermined submission items input in step S21.

FIG. 14 is a diagram schematically showing the configuration of the search execution screen W6 in this embodiment. As shown in FIG. 14, the search execution screen W6 includes a search message W61 and a search progress W62. The search execution screen W6 is displayed on the display device of the user terminal 4 while step S221 is being executed.

When the acquisition of the lost item information in step S221 is completed, the user terminal 4 then presents the storage location of the lost item based on the acquired lost item information (step S222).

FIG. 15 is a diagram schematically showing the configuration of the search result screen W7 in this embodiment. As shown in FIG. 15, the search result screen W7 is composed of a storage location W71 and notes W72.

The flow of responding to lost item inquiries in this embodiment has been described above. In this embodiment, the lost item information registered by the worker terminal 3 includes a lost item image, predetermined attributes, and predetermined notification information, When responding to an inquiry, the avatar W51 on the dialog screen W5 interacts with the user, presents questions regarding predetermined attributes and/or predetermined submission items, and receives input of answers. In this embodiment, with this configuration, the information used when a worker who finds a lost item registers the lost item corresponds to the information that is communicated to the user. A search can be conducted.

Although the present embodiment has been described above, the configuration of the present invention is not limited to the above embodiment.

For example, in the above embodiment, the lost item management system 1 is a system for managing lost items in railway facilities, but it can also be used for various means of transportation other than railways, such as omnibuses, sightseeing buses, taxis, airplanes, and passenger ships. It may also be a system used for managing lost items in transportation facilities.

Furthermore, the lost item management system 1 of the present embodiment may be a system used for lost item management at facilities or institutions other than transportation facilities where items may be lost by unspecified users. Specifically, the lost property management system 1 can be used for, for example, community centers, assembly halls, gymnasiums, and parks operated by municipalities, private baseball stadiums, soccer fields, and event halls, and pubs and restaurants operated by chain stores. It may also be a system used for managing lost items at convenience stores, various mass retailers, and the like.

Furthermore, in the above embodiment, the lost item management system 1 is configured such that the user terminal 4 is a railway facility and is installed at a predetermined location in a station building. It is possible.

For example, the user terminal 4 of this embodiment is an electronic bulletin board such as a digital signage installed in a place other than a station building or railway facility, for example, in a street main street, a shopping district, or a public facility such as a park or community center. There may be.

Further, for example, the user terminal 4 of this embodiment is a mobile information terminal such as a smartphone or a tablet owned by the user, and the user can use his or her own mobile information terminal as the user terminal 4 to It is also possible to adopt a configuration in which the lost item management system 1 of the embodiment can be used. Furthermore, for example, the user terminal 4 of this embodiment is capable of communicating with the lost and found management server 2, etc., and provides the user with a virtual space such as a VR (Virtual Reality) system, and within this virtual space. It can also be configured as a device that allows users to search for lost items.

For example, in step S13 in the present embodiment, the operator is prompted to input predetermined transfer items using the transfer item input form W31 on the transfer item input screen W3, but some or all of the predetermined transfer items are input by voice. The information may be input by input.

Other specific configurations are not limited to this embodiment, and various changes can be made without departing from the spirit of the invention.

1 Lost item management system 2 Lost item management server 21 Lost item attribute acquisition unit 22 Lost item registration unit 23 Lost item acquisition unit 3 Worker terminal 31 Lost item imaging unit 32 Lost item attribute display unit 33 Lost item notification information input unit 34 Lost item Property registration request section 4 User terminal 41 Dialogue section 42 Lost item search condition input section 421 Question presentation section 422 Question answering section 5 Network

Claims (5)

A lost item management system for managing lost items in a facility,
a lost item attribute acquisition unit that acquires a predetermined attribute regarding the lost item by performing image recognition of a lost item image obtained by photographing the lost item ;
a lost item registration unit that registers lost item information including the predetermined attributes and predetermined notification items; and a lost item registration unit that registers lost item information including the predetermined attributes and predetermined notification items; Lost and Found Retrieval Department that obtains property information;
a lost and found management server comprising;
a lost item imaging unit that captures the lost item image , and
a lost item report information input section for inputting the predetermined report matters ; and
requesting the lost item management server to register the lost item information including the predetermined attribute acquired by the lost item attribute acquisition unit from the image captured by the lost item imaging unit and the inputted predetermined submission information; Lost property registration request department;
a worker terminal comprising;
an interaction department that provides an interactive service for exchanging information with users through video and/or audio ;
a lost item search condition input/output unit that outputs information for causing the user to search for the lost item and acquires information input by the user for causing the user to search for the lost item ;
The lost item information is acquired by the lost item acquisition unit based on part or all of the inputted predetermined attributes and/or the predetermined submission information, and the lost item information is retrieved based on the acquired lost item information. A lost and found search department that shows you where things are stored;
A user terminal comprising:
The lost item search condition input/output unit asks the user a question for specifying the predetermined attributes and/or the predetermined notification items registered in the lost item registration unit of the lost item management server. comprising a question presenting unit that presents a question, and a question answering unit that obtains the user's answer to the question presented by the question presenting unit,
The question presentation unit generates a question for the user to identify the lost item information registered in the lost item registration unit of the lost item management server by displaying the video including text or images. and a second question presenting unit that generates and presents a question for identifying the lost item information registered in the lost item information registered in the lost item registration unit of the lost item management server to the user using the voice. It has a question presentation section,
The question answering section is configured to respond to the question presented by the first question presenting section or the second question presenting section by the user inputting the question by a predetermined manual operation using the operating means of the user. a first question answering section that obtains an answer to the question, and a first question presenting section or a second question presenting section that answers the question, and the user inputs the voice uttered by the user. has a second question answering section that obtains answers to
The question presenting unit may provide the user with the following information:
Presentation of the lost item information by the video for identifying one of the lost items by the first question presenting unit, and/or presenting of the lost item information by the video for identifying one of the lost items by the second question presenting unit. making the audio presentation;
To the user,
an answer by the user using the operating means, and
It is possible to arbitrarily select either an answer that sequentially inputs each piece of lost item information based on the user's utterance, or an answer that inputs multiple pieces of lost item information at once based on the user's utterance. A lost and found management system characterized by providing . 2. The lost item management system according to claim 1, wherein the lost item report item input unit inputs part or all of the predetermined item to be reported by voice input. 2. The lost item management system according to claim 1, wherein the predetermined attributes include a name, type, shape, and color of the lost item. The facility is a railway facility,
The reported information includes the location where the lost item was found,
The lost item management system according to claim 1, wherein the lost item includes a train name, a car number, and a seat number when the lost item is found on a train. The lost item management system according to claim 1, wherein the interaction unit displays an avatar on a display unit of the user terminal to provide the interactive service.

Images