WO2020204015A1 - Système de traitement d'informations, dispositif de traitement d'informations et programme - Google Patents
Système de traitement d'informations, dispositif de traitement d'informations et programme Download PDFInfo
- Publication number
- WO2020204015A1 WO2020204015A1 PCT/JP2020/014719 JP2020014719W WO2020204015A1 WO 2020204015 A1 WO2020204015 A1 WO 2020204015A1 JP 2020014719 W JP2020014719 W JP 2020014719W WO 2020204015 A1 WO2020204015 A1 WO 2020204015A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- store
- information processing
- customer
- field
- information
- Prior art date
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 claims abstract description 49
- 238000003384 imaging method Methods 0.000 claims abstract description 40
- 230000008569 process Effects 0.000 claims description 28
- 238000012545 processing Methods 0.000 claims description 4
- 238000007726 management method Methods 0.000 description 29
- 238000012544 monitoring process Methods 0.000 description 17
- 238000010586 diagram Methods 0.000 description 16
- 238000004458 analytical method Methods 0.000 description 15
- 238000004088 simulation Methods 0.000 description 15
- 238000004891 communication Methods 0.000 description 12
- 238000013473 artificial intelligence Methods 0.000 description 9
- 238000003860 storage Methods 0.000 description 9
- 238000010276 construction Methods 0.000 description 8
- 230000004044 response Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 235000013305 food Nutrition 0.000 description 6
- 238000009434 installation Methods 0.000 description 6
- 238000011156 evaluation Methods 0.000 description 5
- 239000000463 material Substances 0.000 description 5
- 238000005457 optimization Methods 0.000 description 5
- 238000012384 transportation and delivery Methods 0.000 description 5
- 238000012790 confirmation Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 230000008520 organization Effects 0.000 description 4
- 230000002265 prevention Effects 0.000 description 4
- 238000010411 cooking Methods 0.000 description 3
- 230000000875 corresponding effect Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 3
- 239000010931 gold Substances 0.000 description 3
- 229910052737 gold Inorganic materials 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 239000004615 ingredient Substances 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000002360 preparation method Methods 0.000 description 3
- 238000004378 air conditioning Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000004140 cleaning Methods 0.000 description 2
- 230000002079 cooperative effect Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000012356 Product development Methods 0.000 description 1
- 208000003443 Unconsciousness Diseases 0.000 description 1
- 230000009118 appropriate response Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001364 causal effect Effects 0.000 description 1
- 238000005352 clarification Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 235000012054 meals Nutrition 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000004297 night vision Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/12—Hotels or restaurants
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
Definitions
- the present invention relates to an information processing system, an information processing device, and a program.
- Patent Document 1 in order to enable the store manager to grasp the actual state of customer service, the analysis of the customer service status of the store is based on the data of the captured image captured by the camera that captures the inside of the store. The device that performs the above is described.
- the present invention has been made in view of such a situation, and supports store operations including the work procedure and arrangement of assistants in store operation based on the situation inside the store and the situation outside the store.
- the purpose is to provide a method that can efficiently support the education of assistants.
- the information processing system of one aspect of the present invention is In an information processing system that supports a provider who provides goods or services to a customer at a predetermined place and an assistant of the provider. Equipped with multiple imaging devices and information processing devices, The plurality of image pickup devices It has a generation means for capturing a subject included in a range of 360 degrees in all directions around the subject and generating data of the captured image of the subject.
- the information processing device An acquisition means for acquiring data of an captured image including at least a part of the field and the periphery of the field, which is captured and generated by each of the plurality of image pickup devices.
- an operation support means for executing a first process for supporting an operation performed by the assistant in at least a part of the place and the surroundings of the place, and an operation support means.
- the education support means for executing the second process for supporting the education of the assistant, and the education support means. To be equipped.
- the information processing device is In an information processing device included in an information processing system that supports a provider who provides goods or services to a customer at a predetermined place and an assistant of the provider.
- An acquisition means for acquiring data of an captured image including at least a part of the field and the periphery of the field, which is captured and generated by each of the plurality of image pickup devices.
- an operation support means for executing a first process for supporting an operation performed by the assistant in at least a part of the place and the surroundings of the place, and an operation support means.
- the education support means for executing the second process for supporting the education of the assistant, and the education support means. To be equipped.
- the information processing method and program according to one aspect of the present invention are the processing methods and programs corresponding to the above-mentioned information processing system according to one aspect of the present invention.
- support for store operation including the work procedure and arrangement of assistants in store operation and support for education of assistants are efficiently performed. be able to.
- FIG. 1A It is a figure which shows the outline of the store operation support service which can be realized by the information processing system of this invention. It is a figure which shows the type of a business targeted by this service. It is a figure which shows the effect by providing this service. It is an image diagram which shows the specific example of this service shown in FIG. 1A and FIG. 1B. It is a figure which shows the specific example of a plurality of cameras installed inside and outside a store. It is a flow chart which shows the flow of the proposed service in this service. It is an image diagram which shows the imaging result information.
- FIG. 5 is a functional block diagram showing an example of a functional configuration required for various processes executed by the server of FIG. 9. It is a figure which shows an example of a common infrastructure operation model.
- FIG. 2 is a diagram showing an outline of a store operation support service (hereinafter, referred to as “the service”) that can be realized by the information processing system of the present invention.
- This service is a service that improves productivity by supporting providers who provide goods or services to customers in a predetermined place and their assistants.
- FIG. 2 shows a store manager P who provides food and drink and a customer service to customer C at a store R (predetermined place), and a store which is an assistant thereof.
- An example of supporting staff T is shown.
- the store R is a restaurant operated by the store manager P.
- the store R provides the customer C who visits the store with so-called “local production for local consumption” dishes prepared by cooking ingredients harvested in the area.
- the business partner M is a person who supports the business of the store R as a related business operator who is a business partner of the store R. As described above, the customer C is a user of the store R.
- This service can be realized by the cooperation of the server 1 (cloud), the camera 2, the store terminal 3, the business partner terminal 4, and the customer terminal 5 that constitute the information processing system according to the present invention.
- the server 1 executes various processes for realizing this service while appropriately communicating with the camera 2, the store terminal 3, the business partner terminal 4, and the customer terminal 5.
- the server 1 also functions as a cloud that can be managed by AI (artificial intelligence).
- the server 1 has, for example, information for supporting the operation of the store manager P in the store R (hereinafter referred to as “operation support information”) and store staff based on the data of the captured image transmitted from the camera 2.
- operation support information information for supporting the operation of the store manager P in the store R
- store staff based on the data of the captured image transmitted from the camera 2.
- Generates information for supporting T's education hereinafter referred to as "education support information”
- the operation support information and the education support information generated by the server 1 are presented to at least one of the store manager P and the store staff T.
- the presentation method is not particularly limited, and is presented by displaying the operation support information and the education support information on the manager terminal (not shown) operated by the store manager P or the store terminal 3 described later. May be good.
- other methods for example, presentation by voice or presentation on paper media may be used.
- the server 1 has captured image data (hereinafter, "simulation data”) that would have been obtained if the plurality of cameras 2 had been arranged at each of the plurality of predetermined positions in the store R and its surroundings. To generate). Then, the server 1 generates information (hereinafter, referred to as “proposal information”) indicating the optimum combination as the arrangement location and the number of the plurality of cameras 2 in the store R and its surroundings based on the generated simulation data.
- provisional information information indicating the optimum combination as the arrangement location and the number of the plurality of cameras 2 in the store R and its surroundings based on the generated simulation data.
- the camera 2 is a camera installed at a plurality of locations inside and outside the store R.
- the camera 2 captures a subject included in the periphery of the installation location and generates data of the captured image of the subject.
- the specific configuration of the camera 2 will be described later with reference to FIG. Since the camera 2 is an IoT (Internet of Things) device connected to a predetermined network N (FIG. 8) such as the Internet, the generated image data is uploaded to the cloud (server 1) at any time.
- IoT Internet of Things
- the store terminal 3 is an information processing device connected to a predetermined network N (FIG. 8) such as the Internet, and is connected to a cloud (server 1) like the camera 2.
- the store terminal 3 acquires operation support information, education support information, and the like from the cloud (server 1) and displays these information.
- the store terminal 3 is referred to as a dedicated application program (hereinafter referred to as "staff-only application”) for receiving the provision of a service (hereinafter referred to as "staff support service”) that supports the business of store staff T among the services. Call) is installed.
- the staff support service includes a service for displaying the above-mentioned operation support information and education support information on the store terminal 3.
- the expression "store staff T operates the store terminal 3” it means that the store staff T activates the staff-dedicated application installed on the store terminal 3 to perform various types. It shall mean performing an operation.
- the business partner terminal 4 is an information processing device operated by the business partner M.
- the business partner terminal 4 is a service (hereinafter referred to as "business partner support service") for supporting the business partner M who intends to provide business support (for example, various managements) to the store manager P among the services.
- a dedicated application program (hereinafter referred to as "customer-only application”) for receiving the service is installed.
- the business partner support service includes information to support business strategies, including information on business creation (for example, product development), information to support legal compliance, and information on customer creation.
- a service to be displayed on the business partner terminal 4 is included.
- the business partner M activates the business partner dedicated application installed on the business partner terminal 4. It shall mean that various operations are performed.
- the customer terminal 5 is an information processing device operated by the customer C.
- the customer terminal 5 is provided with a service for promoting the use of the store R and supporting the customer C who actually uses the store R (hereinafter referred to as "customer support service") among the services.
- a dedicated application program (hereinafter referred to as "customer-only application”) is installed.
- the customer support service includes a service for displaying information on the creation of customer satisfaction on the customer terminal 5.
- customer communication including media and CRM (Customer Relationship Management) will be achieved between the store R and the customer C.
- the customer C can use the service that meets various consumer needs, and can contribute to the support of "growth” described later with reference to FIGS. 3A and 3B.
- the expression "customer C operates the customer terminal 5" it means that the customer C activates the customer-specific application installed on the customer terminal 5 and performs various operations. It shall mean to do.
- the "regional information agency” refers to an agency that specializes in acquiring and providing basic data related to a specific region.
- Regional intelligence agencies include, for example, regional versions of intelligence banks.
- regional financial institution refers to a financial institution whose main business base is in a specific area, specifically, regional banks, second regional banks, credit unions, credit unions, agricultural cooperatives, etc. Refers to fishery cooperatives, labor banks, etc.
- Regional information agencies and regional financial institutions that receive various types of information through this service can provide business support to businesses and local communities in other regions based on the provided information. As a result, it is possible to prevent regional revitalization and regional revitalization from becoming a mere ghost.
- FIGS. 3A and 3B are diagrams showing the types of businesses targeted by this service and the effects of providing this service.
- FIG. 3A shows a diagram that visualizes the types of businesses that should be targeted as the target of providing this service.
- the brand value of the business evaluated based on the acquired standards, etc. is defined as the "brand level” (vertical axis), and the business is evaluated temporally as the “business stage” (horizontal axis).
- Business classification is made.
- the "hospitality standard certification” shown in FIG. 3A is certified for each business operator that provides the service based on the standard certification system established to "visualize” the quality of the service. It refers to a standard.
- "redcertification” is a standard that allows businesses enthusiastic about service improvement efforts to receive certification, and is “red certification” and “gold certification.”
- “Navy blue certification”, and “Purple certification” exist.
- the "red certification” shown in FIG. 3A is a standard that is certified by the business operator himself declaring that the conditions for granting conditions are met (conforming).
- HACCP certification whose business stage is after the "transformation period” and whose brand level is “upper” or higher means that HACCP is functioning in the in-house hygiene management system.
- HACCP certification body A business operator evaluated by a person (HACCP certification body).
- the HACCP certification body includes, for example, the industry group to which the business operator belongs, each local government, and the like.
- FIG. 3B shows a growth model of the business receiving this service.
- "strengthening management”, “securing human resources”, and “improving operational efficiency” in the business are required to be “optimized”, and this "optimization” has been realized. By doing so, “surplus funds” are created.
- "growth” is required for “branding”, “customer attraction UP”, and “unit price UP” of products and services in the business, so the above “surplus funds” should be realized in order to realize this "growth”. Is invested.
- a business for example, a store business
- it can eventually contribute to the revitalization of the local economy. ..
- FIG. 4 is an image diagram showing a specific example of the service shown in FIGS. 1A and 1B.
- a plurality of customers C are drawn.
- the cameras 2-1 and 2-2 are cameras installed on the outer wall of the store R, and each capture a predetermined range outside the store R. Specifically, the camera 2-1 captures at least the subject included in the imaging regions A1-1 and A1-2 indicated by the broken line. The camera 2-2 captures at least the subjects included in the imaging regions A2-1 and A2-2 indicated by the broken lines. Cameras 2-3 are cameras installed outside the entrance of the store R, and at least capture a subject included in the imaging region A3 indicated by the broken line. Cameras 2-4 and 2-5 are cameras installed near the ceiling of the floor of the store R, and each capture a predetermined range of the floor of the store R. Specifically, the camera 2-4 captures at least the subject included in the imaging region A4 indicated by the broken line.
- the camera 2-5 captures at least the subject included in the imaging region A5 indicated by the broken line.
- the camera 2-6 is a camera installed in the kitchen (kitchen) of the store R, and at least captures a subject included in the imaging region A6 indicated by the broken line.
- the camera 2-7 is a camera installed in the warehouse of the store R, and at least captures a subject included in the imaging region A7 shown by the broken line.
- the data of the captured images of the cameras 2-1 to 2-7 can be used. Based on any analysis is possible. For example, by performing analysis by AI (artificial intelligence), it is possible to generate operation support information and education support information without blind spots.
- AI artificial intelligence
- the specific installation mode of the cameras 2-1 to 2-7 is not particularly limited, but it is preferable that the camera is installed in consideration of being a camera from a human perspective. In other words, it is preferable that the cameras 2-1 to 2-7 are installed so as to function as a substitute for the line of sight of the store manager P. Specifically, the height of the installation location of the cameras 2-1 to 2-7 from the ground (floor) is preferably about 1.8 m to 2.5 m. As a result, the facial expressions of the store staff T and the customer C can be confirmed more accurately. Further, it is preferable that the imaging regions of the cameras 2-1 to 2-7 are set so that at least a part of them overlap with each other. As a result, the data of the captured images of the cameras 2-1 to 2-7 can be seamlessly connected.
- the following services and the like can be provided to the store staff T of the store R shown in FIG. That is, by monitoring the traffic around the store R using the cameras 2-1 to 2-3 installed on the outer wall or the entrance / exit of the store R, the operation support information most suitable for the store staff T is generated. Can be presented. Specifically, the number and appearance of a plurality of customers C existing as subjects in the imaging areas A1-1 and A2-1, the weather existing as subjects in the imaging areas A1-2 and A2-2, and the vicinity of the store R.
- the hospitality can be improved based on the visit situation of the customer C to the store R. That is, by monitoring the visit status of the customer C using the cameras 2-3 installed at the entrance / exit of the store R, the operation support information and the education support information most suitable for the store staff T are generated and presented. be able to. Specifically, for example, based on the number and state of customer C existing as a subject in the imaging area A3, the flow line of visits from the outdoors, or information based on face recognition using the camera 2-3, for example, customer C visits the store. Guidance of store staff T is performed according to the timing of. As a result, it is possible to avoid the loss of the visit opportunity for the customer C.
- the table service provided by the store staff T it is possible to generate and present the operation support information and the education support information that are optimal for the store staff T.
- guidance to the table according to the number of customers C, instructions for the table set, care by the staff by detecting orders and troubles from customer C who came to the store, appropriate bashing of vacant tableware (work to lower the tableware) ) Is possible.
- the service provision status to the customer C by the store staff T can be monitored and accumulated as a business record. This makes it possible to evaluate the response (customer service) quality in comparison with the customer service manual at store R, propose revisions to the customer service manual based on better quality services, and distribute e-learning content based on the real-time evaluation. Become.
- the cameras 2-4 and 2-5 installed on the floor of the store R are used.
- the following services can be realized. That is, recording of customer C's staying time and behavior during stay, seamless payment corresponding to price multiplexing by face recognition, automatic notification of customer C's dine and dash, etc., customer C's see-off and addition by store staff T Services etc. can be realized.
- the causal relationship between the behavior of the customer C and the status of the customer service provided by the store staff T it is possible to grasp the service pattern that contributes to the sales of the store R and propose effective promotion measures.
- the store staff T by monitoring the status of various operations of the store staff T, it is possible to generate and present the operation support information and the education support information that are optimal for the store staff T. Specifically, using the cameras 2-4 and 2-5 installed on the floor of the store R and the cameras 2-6 installed in the kitchen, the store staff T performs work such as cooking, cleaning, and replenishment, and materials. By monitoring the usage status of the above, the state of the staff, etc., for example, the following services can be realized. That is, a record showing who performed what kind of work and what kind of error occurred, confirmation of whether the work was correct according to the work manual, and work that may cause an error (for example, the wrong equipment or material).
- the delivery work for example, labeling, delivery place
- the delivery company for example, the customer M
- the camera 2-7 installed in the warehouse of the store R.
- the following effects can be expected, for example.
- FIG. 5 is a diagram showing a specific example of a plurality of cameras 2 installed inside and outside the store R.
- the specific configuration of the camera 2 is not particularly limited, but for example, by adopting the camera 2 shown in FIG. 5, this service can be provided in a more suitable environment. That is, it is possible to generate operation support information and education support information with more detailed contents.
- the camera 2 of FIG. 5 is configured to include a main body portion 211 and a lens portion 212, and can capture a subject included in a range of 360 degrees in all directions around the subject, and an captured image of the subject. It is an ultra-high resolution camera that can generate the data of.
- the term "ultra-high resolution" as used herein means that the value indicating the resolution is particularly high, and refers to a camera having a resolution of, for example, 4K (8 million pixels) or more.
- FIG. 6 is a flow chart showing the flow of the proposed service among the services.
- the server 1 generates information (proposal information) indicating the optimum combination as the arrangement location and the number of the plurality of cameras 2 in the store R and its surroundings based on the generated simulation data.
- the generated proposal information is presented to the store manager P.
- a service such a service will be referred to as a "proposal service”.
- the store manager P can efficiently receive the service while maximizing the cost effectiveness.
- the server 1 in the construction in which a plurality of cameras 2 are arranged in the store R, the server 1 generates simulation data before the construction (step SS1), and the server 1 generates simulation data based on the generated simulation data. , Generate proposal information.
- the proposal information generated by the generated server 1 is presented to the store manager P.
- the simulation data can be generated by using, for example, design / simulation software using 3D rendering technology.
- the accumulated past data, the input contents to various parameters, and the face data can be referred to.
- AI artificial intelligence
- the camera 2 can be embedded as the interior of the store R. Further, as an installation mode of the camera 2, it can be installed in a light bulb (pendant light), a table candle, an artificial flower, or the like.
- the communication environment (Wifi, etc.) and power supply environment of the installed camera 2 can be simulated.
- the specific method of proposing the proposal information to the store manager P is not particularly limited. It may be presented by displaying the proposal information on the manager terminal (not shown) operated by the store manager P. In addition, other methods (for example, presentation by voice or presentation on paper media) may be used. In addition, the presentation of the proposal information can be an opt-in type service performed based on a request from the store manager P.
- the store manager P performs the construction based on the proposal information presented from the server 1. That is, the store manager P performs the construction according to the simulation data and the information related to the design included in the presented proposal information.
- the proposed information presented is preferably information that can be proposed business-wise.
- the information on the interior and layout of the store R is information that an architect or a furniture store can propose business-wise.
- the store manager P After the construction (step SS3), the store manager P starts the operation in the store R in which each of the plurality of cameras 2 is installed at a predetermined position.
- the store manager P can smoothly proceed with various preparations from the design of the store R to the actual start of operation, and can be obtained by using this service even after the start of operation. The benefits can be maximized.
- FIG. 7 is an image diagram showing imaging result information.
- the captured image data captured by the plurality of cameras 2 includes information for uniquely identifying the captured image data (hereinafter, referred to as "image ID”) and information regarding the time when the captured image was captured (hereinafter, “Time stamp”).
- image ID information for uniquely identifying the captured image data
- time stamp information regarding the time when the captured image was captured
- location information information regarding the imaged location
- the imaging result information is combined with AI (artificial intelligence) to form the framework of the digital infrastructure required to provide this service.
- the imaging result information includes a history (hereinafter, referred to as “communication log”) regarding communication between the store staff T and the customer C, between the store staff T, and between the customer C. ..
- communication log a history regarding communication between the store staff T and the customer C, between the store staff T, and between the customer C. ..
- sensitivity data information on the sensibilities of the store staff T and the customer C, who are the subjects of communication.
- the extracted Kansei data is used as one of the basis data for generating operation support information and education support information.
- the imaging result information includes not only the store staff T and the customer C, but also the sensing of the subject included in the omnidirectional 360-degree range around each of the plurality of cameras 2 installed inside and outside the store R.
- Data (hereinafter referred to as "sensing log") is included.
- sensing log Data (hereinafter referred to as "sensing log") is included.
- physical data (hereinafter referred to as “physical data") regarding each of the subjects that are the objects of sensing can be extracted.
- the extracted physical data is used as one of the basis data for generating operation support information and education support information.
- the imaging result information includes all the results related to the provision of products or services provided to customer C at store R, it is used for traceability or as marketing material. be able to.
- FIG. 8 is a diagram showing an outline of the configuration of the information processing system of the present invention.
- the information processing system shown in FIGS. 1A and 1B includes a server 1, cameras 2-1 to 2-n (n is an integer value of 1 or more), a store terminal 3, and the like.
- the business partner terminal 4 and the customer terminal 5 are connected to each other via a predetermined network N such as the Internet.
- This system is a system required to provide the above-mentioned service.
- cameras 2-1 to 2-n individually, these are collectively referred to as "camera 2".
- the server 1 is an information processing device managed by the service provider G.
- the server 1 executes various processes in order to manage the operations of the cameras 2-1 to 2-n, the store terminal 3, the business partner terminal 4, and the customer terminal 5.
- Each of the cameras 2-1 to 2-n is a camera installed at a plurality of locations inside and outside the store R.
- Each of the cameras 2-1 to 2-n captures a subject included in the vicinity of the installation location and generates data of the captured image of the subject. Key image IDs, Timestamp information, and Location information are shared and associated with the data of the captured images captured by each of the cameras 2-1 to 2-n, and the imaging result DB181 is linked as the imaging result information. It is stored and managed in.
- the store terminal 3 is an information processing device operated by the store staff T.
- the store terminal 3 is composed of a personal computer, a smartphone, a tablet, and the like.
- the store terminal 3 receives an input operation required for the store staff T to use the staff support service, and transmits information indicating the input content to the management server 1.
- the store terminal 3 displays various information transmitted from the server 1 by itself or under the control of the server 1.
- the business partner terminal 4 is an information processing device operated by the business partner M.
- the business partner terminal 4 is composed of a personal computer, a smartphone, a tablet, and the like.
- the business partner terminal 4 receives an input operation required for the business partner M to use the business partner support service, and transmits information indicating the input content to the management server 1. Further, the business partner terminal 4 displays various information transmitted from the server 1 by itself or under the control of the server 1.
- the customer terminal 5 is an information processing device operated by the customer C.
- the customer terminal 5 is composed of a personal computer, a smartphone, a tablet, and the like.
- the customer terminal 5 receives an input operation required for the customer C to use the customer support service, and transmits information indicating the input content to the management server 1. Further, the customer terminal 5 displays various information transmitted from the server 1 by itself or under the control of the server 1.
- FIG. 9 is a block diagram showing a hardware configuration of the server 1 of FIG.
- the server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, and an input unit 17.
- a storage unit 18, a communication unit 19, and a drive 20 are provided.
- the CPU 11 executes various processes according to the program recorded in the ROM 12 or the program loaded from the storage unit 18 into the RAM 13. Data and the like necessary for the CPU 11 to execute various processes are also appropriately stored in the RAM 13.
- the CPU 11, ROM 12 and RAM 13 are connected to each other via the bus 14.
- An input / output interface 15 is also connected to the bus 14.
- An output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20 are connected to the input / output interface 15.
- the output unit 16 is composed of various liquid crystal displays and the like, and outputs various information.
- the input unit 17 is composed of various hardware leads and the like, and inputs various information.
- the storage unit 18 is composed of a DRAM (Dynamic Random Access Memory) or the like, and stores various data.
- the communication unit 19 communicates with other devices (for example, cameras 2-1 to 2-n in FIG. 8, store terminal 3, customer terminal 4, customer terminal 5) via a network N including the Internet. Control.
- the drive 20 is provided as needed.
- a removable medium 30 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately mounted on the drive 20.
- the program read from the removable media 30 by the drive 20 is installed in the storage unit 18 as needed. Further, the removable media 30 can also store various data stored in the storage unit 18 in the same manner as the storage unit 18.
- the store terminal 3, the customer terminal 4, and the customer terminal 5 also have the above-mentioned hardware configuration.
- FIG. 10 is a functional block diagram showing an example of a functional configuration required for various processes executed by the server 1 of FIG.
- the acquisition unit 101, the operation support unit 102, the education support unit 103, and the proposal unit 104 function.
- the acquisition unit 101 acquires the data of the captured image including at least a part of the field and the periphery of the field, which is captured and generated by each of the plurality of imaging devices. Specifically, the acquisition unit 101 acquires the data of the captured image including at least a part of the store R and the periphery of the store R, which are captured and generated by the cameras 2-1 to 2-n, respectively. As described above, the acquired image data is stored and managed in the image capture result DB 181 as the image capture result information in association with the key image ID, Timestamp information, and Location information.
- the operation support unit 102 executes the first process for supporting the operation performed by the staff in at least a part of the place and the surroundings of the place based on the data of the captured image acquired by the acquisition unit 101. Specifically, the operation support unit 102 generates operation support information based on the image pickup result information stored in the image pickup result DB181. Further, the operation support unit 102 presents the generated operation support information to at least one of the administrator terminal (not shown) and the store terminal 3.
- the education support unit 103 executes the second process for supporting the education of the staff based on the data of the captured image acquired by the acquisition unit 101. Specifically, the education support unit 103 generates education support information based on the image pickup result information stored in the image pickup result DB181. Further, the education support unit 103 presents the generated education support information to at least one of the manager terminal (not shown) and the store terminal 3.
- the proposal unit 104 is based on the data of the captured image that would be obtained if each of the plurality of imaging devices is arranged at the field and the plurality of predetermined positions around the field, and the surroundings of the field and the field. We propose the arrangement location and the number of multiple image pickup devices in. Specifically, the proposal unit 104 generates simulation data and proposal information based on the simulation data, and presents the simulation data to at least one of the manager terminal (not shown) and the store terminal 3.
- the image pickup control unit 201 and the generation unit 202 function.
- the image pickup control unit 201 executes control for photographing a subject included in the vicinity of the installation location of the own machine.
- the generation unit 202 generates the data of the captured image of the captured subject as a result of the control by the image pickup control unit 201.
- the generated captured image data is transmitted to the server 1 at a predetermined timing.
- the timing at which the generated captured image data is transmitted to the server 1 is not particularly limited. It may be transmitted in real time together with the generation of the captured image data, or may be transmitted every few seconds or every few minutes.
- each process related to the provision of this service can be executed.
- the service provider G can provide this service to each of the store manager P, the store staff T, the business partner M, and the customer C.
- FIG. 11 is a diagram showing an example of a common infrastructure operation model.
- the common infrastructure management model is "market”, “target organization”, “management body”, “cooperation between regional financial institutions and VC (venture capital)”, and “collaboration business”.
- This is a consortium-type management model in which "persons (investors)”, “management councils”, and “solution providers” cooperate with each other.
- the "market” in the common infrastructure management model is a place for business activities by "target organizations, etc.”
- the "target organization, etc.” can obtain profit (sales).
- the “solution provider” in the common infrastructure operation model is a person who provides services related to “planning, development, and maintenance” to “target organizations, etc.” As a result, the “solution provider” can obtain profits (development costs, etc.).
- the "operation body” in the common infrastructure operation model provides maintenance services for standard data resources owned by the "target organization, etc.”
- the "operating body” will fund its own data resources owned by the “target organization, etc.”
- the “management body” manages the “management council”. As a result, the "operating body” can obtain profits (returns, operating expenses, etc.).
- the "operation council” in the common infrastructure operation model provides various “certifications” and “support” to “solution providers”. As a result, the “management council” can earn profits (membership fee and certification fee).
- the "collaboration company (investor)” in the common infrastructure management model supports the “management body”.
- the "collaboration business operator (investor)” can obtain profit (revenue share) from the “operating body (investor)”.
- revenue can be obtained from "target organizations, etc.” through "cooperation between regional financial institutions and VC (venture capital)”.
- the following merits can be enjoyed. That is, it is possible to grasp the spatial rendering and the sensitivity information of the store staff T and the customer C. Further, by using the camera 2 as an infrared camera or a night-vision camera, it is possible to support even if the imaging region is dark. Further, when the camera 2 is provided with a temperature sensor, it is possible to grasp the temperature by, for example, far infrared rays. In addition, the discharge state can be grasped by ultraviolet rays. In addition, by linking with an AR (augmented reality) lens, proposal information can be presented using a laser or MAP. In addition, digital support is possible even if the level of work proficiency is low.
- AR augmented reality
- the store R which is a restaurant
- the application target of this service is a restaurant such as a restaurant.
- it can be applied to all places and fields such as warehouses, factories, schools, welfare / medical / nursery facilities, sports / entertainment / craftsmen, events, offices, civil engineering / construction sites, etc.
- the following services can be provided by installing multiple cameras 2 at predetermined positions and monitoring the operating status of the warehouse, the movement of importers and exporters, the inventory status, etc. It can be realized. That is, instructions on the location of inventory items, additional orders according to inventory status, appropriate management of inventory loss such as expiration date by the first-in first-out method, proper allocation of personnel and equipment, impact in the event of trouble such as an accident in the warehouse It is possible to grasp the range and realize the response instruction.
- the following services can be provided by installing multiple cameras 2 at predetermined positions and monitoring the factory operating status, staff movements, inventory status, production status, etc. Can be realized. That is, confirmation of staff work status and placement status (for example, error check), early warning (alert, etc.) in processes where errors can occur, response instructions that minimize loss when an error occurs, automation linked with sensors It is possible to realize automation, transfer of materials according to the operating status, additional orders according to the inventory status, and the like.
- this service When this service is applied to schools, for example, by installing multiple cameras 2 at predetermined positions and monitoring the learning status of children / students, the content of teachers' guidance, the locations of children / students / teachers, etc.
- the following services and the like can be realized. That is, development of an educational environment that is safe for the community and parents, efficient procurement of necessary teaching materials through regional cooperation (for example, sharing, ecology, etc.), and learning support for children and students (for example, if the movement of the hand stops). (Service that teaches), confirmation of whether the teacher's guidance is appropriate, development of a more appropriate teaching method, grasping who is where, prevention of missing persons by guiding personnel, etc. can be realized.
- multiple cameras 2 are installed at predetermined positions to monitor the user status, staff status, user / staff location, etc.
- the following services can be realized. That is, prevention of wandering and safety management of the elderly, reduction of the burden on staff, appropriate response such as express of staff in the event of trouble, immediate response to requests from users (for example, toilets, meals, etc.), when an accident occurs It is possible to realize records of accidents, analysis of their causes, trucks of accident signs, and instructions for accident prevention.
- the status of vacant seats, the status of visitors, and the status of staff can be obtained by installing multiple cameras 2 at predetermined positions or using a drone or other flying object equipped with the cameras 2.
- the following services can be realized. That is, optimization / verification of event management manuals, evaluation of the effects of contents such as halftime shows, analysis / prediction of congestion status and guidance of vacant seats, navigation to seats tailored to visitors, service providers such as drink sales, etc. Instructions, records when troubles occur and prevention by predicting signs of troubles, congestion analysis and securing of flow lines at the end of events, analysis of evacuation routes when disasters occur, management of customer dynamics according to the excitement of contents ( For example, when to go on sale) can be realized.
- this service can be realized by forming a digital network for each of research and development, production, distribution, service, and community. Specifically, for example, linking e-learning, AI speakers, multilingual menus, personal remittances, check-in / check-out systems, ordering systems, traceability systems, high-resolution monitoring systems, communication media, social capital credit evaluation systems, etc. So, this service can be realized.
- FIG. 9 is merely an example for achieving the object of the present invention, and is not particularly limited.
- the functional block diagram shown in FIG. 10 is merely an example and is not particularly limited. That is, it is sufficient that the information processing system is provided with a function capable of executing the above-mentioned series of processes as a whole, and what kind of functional block is used to realize this function is not particularly limited to the example of FIG. ..
- one functional block is not limited to FIG. 10, and may be arbitrary. Further, one functional block may be configured by a single piece of hardware, a single piece of software, or a combination thereof.
- the programs constituting the software are installed on a computer or the like from a network or a recording medium.
- the computer may be a computer embedded in dedicated hardware. Further, the computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose smartphone or a personal computer in addition to a server.
- the recording medium containing such a program is not only composed of removable media, which is distributed separately from the device main body to provide the program to each user, but also is preliminarily incorporated in the device main body to each user. It is composed of the provided recording media and the like.
- the steps for describing a program recorded on a recording medium are not necessarily processed in chronological order according to the order, but are not necessarily processed in chronological order, but in parallel or individually. It also includes the processing to be executed.
- the term of the system means an overall device composed of a plurality of devices, a plurality of means, and the like.
- the information processing system to which the present invention is applied need only have the following configuration, and can take various embodiments. That is, the information processing system to which the present invention is applied is In an information processing system that supports a provider (for example, store manager P) who provides goods or services to a customer (for example, customer C) at a predetermined place, and an assistant (for example, store staff T) of the provider.
- a plurality of imaging devices for example, camera 2) and an information processing device (for example, server 1) are provided.
- the plurality of image pickup devices It has a generation means (for example, generation unit 202 in FIG. 10) that images a subject included in a range of 360 degrees in all directions around the subject and generates data of the captured image of the subject.
- the information processing device An acquisition means (for example, acquisition unit 101 in FIG. 10) for acquiring image data including at least a part of the field and the periphery of the field, which is imaged and generated by each of the plurality of image pickup devices.
- the operation support means for example, the figure
- the operation support means that executes the first process for supporting the operation performed by the assistant in at least a part of the place and the surroundings of the place.
- Operation Support Department 102 Based on the data acquired by the acquisition means, an education support means (for example, the education support unit 103 in FIG. 10) that executes a second process for supporting the education of the assistant, and To be equipped.
- the field is used.
- the proposal means for example, the proposal unit 104 of FIG. 10 that proposes the arrangement location and the number of the plurality of image pickup devices around the place (for example, proposal information). Can be provided.
- the manager of the place can efficiently receive this service while maximizing cost effectiveness.
- the information processing device to which the present invention is applied is In an information processing device included in an information processing system that supports a provider who provides goods or services to a customer at a predetermined place and an assistant of the provider.
- An acquisition means for acquiring data of an captured image including at least a part of the field and the periphery of the field, which is captured and generated by each of the plurality of image pickup devices.
- an operation support means for executing a first process for supporting an operation performed by the assistant in at least a part of the place and the surroundings of the place, and an operation support means.
- the education support means for executing the second process for supporting the education of the assistant, and the education support means.
- the education support means for executing the second process for supporting the education of the assistant, and the education support means.
- Proposal means for proposing the arrangement location and the number of the plurality of image pickup devices in the above can be provided.
- the manager of the place can efficiently receive this service while maximizing cost effectiveness.
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Tourism & Hospitality (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- Economics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Educational Administration (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Development Economics (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- General Health & Medical Sciences (AREA)
- Educational Technology (AREA)
- Game Theory and Decision Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Le problème décrit par la présente invention est de réaliser efficacement un support pour une opération de magasin comprenant une procédure de travail et un agencement d'un assistant dans la gestion de magasin et un support pour l'apprentissage de l'assistant sur la base d'une situation à l'intérieur d'un magasin et d'une situation à l'extérieur du magasin. La solution selon l'invention porte sur un système de traitement d'informations dans lequel une unité de commande d'imagerie 201 d'une caméra 2 procède à l'imagerie d'un objet inclus dans une plage de 360 degrés d'une direction omnidirectionnelle autour de celui-ci. Une unité de génération 202 génère des données d'image imagées de l'objet. Une unité d'acquisition 101 d'un serveur 1 acquiert les données d'image imagées qui ont été imagées et générées par chaque caméra de la pluralité de caméras 2, comprenant au moins une partie de l'intérieur et de l'extérieur d'un magasin R. Une unité de support d'opération 102 affiche des informations de support d'opération pour un personnel de magasin T du magasin R sur la base des données d'image imagées. Une unité de support d'apprentissage 103 affiche des informations de support d'apprentissage pour le personnel de magasin T du magasin R sur la base des données d'image imagées. Le problème susmentionné est par conséquent résolu.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2019066473A JP2020166558A (ja) | 2019-03-29 | 2019-03-29 | 情報処理システム、情報処理装置、及びプログラム |
JP2019-066473 | 2019-03-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020204015A1 true WO2020204015A1 (fr) | 2020-10-08 |
Family
ID=72668499
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2020/014719 WO2020204015A1 (fr) | 2019-03-29 | 2020-03-30 | Système de traitement d'informations, dispositif de traitement d'informations et programme |
Country Status (2)
Country | Link |
---|---|
JP (2) | JP2020166558A (fr) |
WO (1) | WO2020204015A1 (fr) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012023414A (ja) * | 2010-07-12 | 2012-02-02 | Kozo Keikaku Engineering Inc | シミュレーション装置、シミュレーション方法、およびプログラム |
JP2012053705A (ja) * | 2010-09-01 | 2012-03-15 | Toshiba Tec Corp | 店舗システム、売上登録装置及びプログラム |
JP2014052840A (ja) * | 2012-09-07 | 2014-03-20 | Hitachi Ltd | サービス支援方法及びそれを用いたシステム |
JP2014149685A (ja) * | 2013-02-01 | 2014-08-21 | Panasonic Corp | 接客状況分析装置、接客状況分析システムおよび接客状況分析方法 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5631043B2 (ja) * | 2010-04-12 | 2014-11-26 | 三菱電機株式会社 | 来店者通知システム |
-
2019
- 2019-03-29 JP JP2019066473A patent/JP2020166558A/ja active Pending
-
2020
- 2020-03-30 WO PCT/JP2020/014719 patent/WO2020204015A1/fr active Application Filing
-
2024
- 2024-02-19 JP JP2024022629A patent/JP2024045604A/ja active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012023414A (ja) * | 2010-07-12 | 2012-02-02 | Kozo Keikaku Engineering Inc | シミュレーション装置、シミュレーション方法、およびプログラム |
JP2012053705A (ja) * | 2010-09-01 | 2012-03-15 | Toshiba Tec Corp | 店舗システム、売上登録装置及びプログラム |
JP2014052840A (ja) * | 2012-09-07 | 2014-03-20 | Hitachi Ltd | サービス支援方法及びそれを用いたシステム |
JP2014149685A (ja) * | 2013-02-01 | 2014-08-21 | Panasonic Corp | 接客状況分析装置、接客状況分析システムおよび接客状況分析方法 |
Non-Patent Citations (1)
Title |
---|
MURAKAMI, KAZUHITO: "Introduction of robot vision research", EIZOJOHO INDUSTRIAL, vol. 39, no. 8, August 2007 (2007-08-01), pages 67 - 72 * |
Also Published As
Publication number | Publication date |
---|---|
JP2024045604A (ja) | 2024-04-02 |
JP2020166558A (ja) | 2020-10-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Williams et al. | Mgmt4 | |
Palmer | EBOOK: Principles of services marketing | |
Renggli et al. | Design, implementation and evaluation of a national campaign to deliver 18 million free long-lasting insecticidal nets to uncovered sleeping spaces in Tanzania | |
Pizam | International encyclopedia of hospitality management | |
Haber et al. | The cumulative nature of the entrepreneurial process: The contribution of human capital, planning and environment resources to small venture performance | |
Del ChIAPPA | How do meeting organizers choose convention sites based on different types of meetings? An empirical analysis of the Italian meetings industry | |
Fortenberry | Cases in health care marketing | |
Vitali et al. | Trade show visitors and key technological trends: from a literature review to a conceptual framework | |
Haktanır et al. | Future of digital transformation | |
Savy et al. | Australian rural community aged care services: Precarity and capacity | |
Payne | Facilities management: A strategy for success | |
KR20190135187A (ko) | 스포츠 이벤트 관리를 위한 서비스 시스템 및 서비스 장치 | |
Salama | Event project management: principles, technology and innovation | |
WO2020204015A1 (fr) | Système de traitement d'informations, dispositif de traitement d'informations et programme | |
PoP et al. | QUALITY IMPROVEMENT IN MUSEUMS USING ORGANIZATIONAL DIAGNOSIS. | |
Schifferes | Shopping for shared value | |
Thomas et al. | Garden tourism and its potential organization in Canterbury | |
Swann et al. | Taxonomy of interactions and the design of the airport passenger screening process | |
Argan et al. | A case study approach to understanding event dimensions of local kite festival as leisure | |
Williams | Event project management | |
Makanga | Strategic Capabilities as A Source of Competitive Advantage in The Five Star Hotels in Nairobi, Kenya | |
Mateechaipong et al. | Business model for a romantic hotel | |
Hawryszkiewycz | How to Organize Knowledge Needed in Transformation? | |
Rokoni | Digitalising the Retail Ecosystem of Bangladesh | |
Carazo Barbero | Business plan–entrepreneurship |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20782934 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20782934 Country of ref document: EP Kind code of ref document: A1 |