JP6881110B2 - Information processing systems, information processing methods and programs - Google Patents

Description

The present invention relates to an information processing system for processing images, an information processing method, and a program for causing a computer to perform information processing.

As an environment including one or more imaging objects, there are a real estate property having one or more partitioned rooms, a work environment such as construction having one or more work processes, and the like. When introducing this real estate property, it is easy to understand what kind of property it is if there is an image of each room. Further, by saving the image in each work process, the worker can check the work status later.

In view of this, a work status management system that shoots a work scene for each work process according to a shooting plan has been proposed (see, for example, Patent Document 1). In this system, the scene identification information generated based on the process information is sent from the PC to the digital camera, the scene identification information is added to the captured image taken by the digital camera and sent to the PC, and the PC shoots with the scene identification information. Images are classified and managed according to the classification system of the shooting plan.

However, in the above technique, since it is necessary to generate the scene identification information based on the process information, there is a problem that the process for posting the image becomes complicated.

The present invention has been made in view of the above, and an object of the present invention is to provide an information processing system, an information processing method, and a program capable of realizing posting of an image by simple processing.

In order to solve the above-mentioned problems, in one embodiment of the invention, an information processing system for processing an image, an acquisition means for acquiring identification information for identifying one or more imaging targets, and a predetermined imaging order. Provided is an information processing system including a transmission means for associating one or more images to be imaged captured according to the above with identification information and transmitting the identification information to a management device.

According to the present invention, posting of an image can be realized by a simple process.

The figure which showed the configuration example of an information processing system. The figure which illustrated the hardware configuration of the information processing apparatus provided in the information processing system. A cross-sectional view of an omnidirectional camera as an imaging device. The figure which illustrated the hardware composition of the spherical camera. The figure which illustrated the hardware configuration of the management device. The figure which illustrated the functional structure of an information processing apparatus. The figure which illustrated the functional configuration of the image pickup apparatus and the management apparatus. The figure which illustrated the screen for creating the user identification information displayed in a management device. The figure which illustrated the login screen. A flowchart showing the flow of the entire process executed by the information processing device. The figure explaining the first method of acquiring a property ID. The figure explaining the second method of acquiring a property ID. The figure explaining the 3rd method of acquiring a property ID. A flowchart showing the flow of the process of acquiring an image. The figure which illustrated the screen displayed on the information processing apparatus in the process of acquiring an image. The figure which illustrated the screen which is displayed when the image is already registered. The figure which illustrated the preview image. The figure which illustrated the confirmation screen of an image. The flowchart which showed the flow of the process of acquiring an image with the change of the imaging condition. The figure explaining the method of changing the imaging condition. A flowchart showing the flow of processing for acquiring an image with an area change. The figure which exemplifies the screen which is displayed when the upload is successful. The figure which illustrated one screen displayed on a communication terminal. The figure explaining the method of editing a registered image. The figure which illustrated another screen displayed on the communication terminal. A sequence diagram of processing executed in an information processing system. The figure which illustrated the screen which an administrator edits a list.

FIG. 1 is a diagram showing a configuration example of an information processing system. The information processing system includes an information processing device 10 used by a user (user). The information processing system may include only the information processing device 10. Further, the information processing system may have a configuration including an information processing device 10, an imaging device 11, a management device 12, and an information providing system 13. The information processing system may include the information processing device 10, any one or two of the image pickup device 11, the management device 12, and the information providing system 13.

The information processing device 10 and the communication terminal 14 are a PC, a tablet terminal, a smartphone, a PDA (Personal Digital Assistant), or the like. Further, the information processing device 10 and the communication terminal 14 are devices having a communication function and a function of inputting, outputting, and displaying information. The image pickup device 11 is a device that takes an image of an image pickup target. The management device 12 is a device that stores and manages captured images. The information providing system 13 is a server or the like that provides information.

The network 15 connects various devices via LAN (Local Area Network), WAN (Wide Area Network), the Internet, or the like. The network 15 may be a wired network or a wireless network such as Wi-Fi. Further, the network 15 is not limited to one network, and may be composed of two or more networks connected by a relay device such as a router or a proxy server. In addition, various devices and devices other than the information processing system may be connected to the network 15.

The information processing system can be used as a system for providing information on real estate properties as an environment including one or more imaging targets, a system for managing work processes such as construction, and the like. Hereinafter, the information processing system will be described as a system that provides information on real estate properties.

Examples of real estate properties include newly built, used and rented detached houses, condominiums, apartments and other condominiums, stores, offices, warehouses, factories, office buildings, commercial facilities, parking lots and the like. Here, the real estate property is a property having one or more rooms to be imaged, such as a condominium.

The information providing system 13 stores and manages information on a plurality of properties in order to provide information on properties managed by the real estate company. The property information is information such as selling price, rent, price including land price, address, structure of building, occupied area, number of floors, facilities, presence / absence of parking lot, etc., and includes floor plans, exterior photographs, and the like.

For example, a case where a borrower as a user searches for a rental condominium as a real estate property will be described. The borrower inputs information necessary for searching for a real estate property by operating the communication terminal 14. Then, the communication terminal 14 accesses the information providing system 13 via the network 15 to transmit information. The information providing system 13 searches for information on a plurality of properties managed by the information providing system 13 based on the information transmitted from the communication terminal 14. Then, the information of the property desired by the borrower is transmitted to the communication terminal 14 via the network 15. The communication terminal 14 receives the property information and displays it on the screen.

The borrower looks at the property information displayed on the screen of the communication terminal 14 and determines whether or not the property is desired by the borrower. If it is not the desired property, the borrower changes the input information, causes the information providing system 13 to execute the search again, and causes the communication terminal 14 to display the information of another property. In this way, the borrower can find the property he wants.

By looking at the information displayed by the borrower, it is possible to know in detail what kind of property it is from the image of each room without actually going to the site where the property is located. Therefore, it is desirable that the property information includes an image of the room of the property.

In order to realize this, the person in charge of the real estate company carries the image pickup device 11 and goes to the target property to take an image of each room. Then, the person in charge posts the captured image to the information providing system 13, so that the captured image is added as the property information.

However, when posting an image to the information providing system 13, the floor plan differs for each property, which requires time and effort for the person in charge. For example, since the number of images to be captured differs for each property, it takes time and effort to associate the property with the captured image. In addition, it takes time and effort to associate the information of each room such as the living room and the bedroom with the captured image.

Furthermore, the data size of the image is larger than that of characters and figures. Therefore, if images of one or more rooms are posted for each property, the storage area of the storage device included in the information providing system 13 becomes insufficient, and posting becomes impossible. Therefore, a new storage device must be added or replaced with a large-capacity storage device. However, in either case, the system needs to be rebuilt.

In view of this, in the information processing system, posting of an image is realized by a simple process using the information processing device 10. Further, the management device 12 is provided separately from the information providing system 13, and the captured image is stored and managed by the management device 12, so that the reconstruction of the information providing system 13 becomes unnecessary.

Specifically, as a user, the person in charge uses the information processing device 10 to access the information providing system 13 via the network 15. Then, the information processing device 10 acquires a property ID as identification information for identifying one or more imaging targets in order to identify the property managed by the information providing system 13. The property ID is a property management number or the like assigned to each property.

The person in charge inputs the acquired property ID to the information processing device 10, and also inputs the floor plan information of the property as the position information indicating the information on which one or more imaging targets are located. The floor plan information is information indicating the number and type of rooms such as 2DK, 2LDK, 3DK, and 3LDK. By the way, the number 3 in 3LDK represents the number of living rooms that can be used as a bedroom, L represents the living room, D represents the dining room, and K represents the kitchen.

The information processing device 10 identifies a room based on the input floor plan information, and determines the order in which the specified room is imaged based on preset ranking information. As the ranking information, the one ranked from the questionnaire of the room that the general public wants to see first can be adopted. However, since this is an example, the information may be obtained by other methods.

The information processing device 10 notifies the person in charge of the room to be imaged by displaying the imaging order on the screen. Then, the information processing device 10 displays the position where the image pickup device 11 is installed in the room on the screen. The person in charge moves to the room displayed on the screen and installs the image pickup device 11 at the displayed position. Further, the person in charge requests the information processing device 10 to take an image, and the information processing device 10 instructs the image taking device 11 to take an image.

The information processing device 10 receives the image captured from the image pickup device 11 as image data and temporarily holds the image. What is transmitted and received between each device is image data, which will be simply described below as an image.

The information processing device 10 receives an image captured from the image pickup device 11 for each room corresponding to the floor plan information. After that, the information processing device 10 posts the image by associating the property ID with the image and transmitting it to the management device 12. For example, it is possible to generate a folder with the property ID as the folder name, store the images in the folder in the order in which the images were taken, and send each folder. As a result, the management device 12 can save and manage the folder as it is.

When the borrower requests the provision of property information, the information providing system 13 acquires the information of the communication terminal 14 possessed by the borrower from the communication terminal 14. Then, the information providing system 13 transmits the requested property ID of the property and the information of the communication terminal 14 to the management device 12. The information providing system 13 provides the communication terminal 14 with information on the property corresponding to the property ID, and the management device 12 transmits a plurality of images associated with the property ID to the communication terminal 14.

The communication terminal 14 receives the property information provided by the information providing system 13 and displays it on the screen. Further, the communication terminal 14 displays a plurality of images received from the management device 12 at a preset screen position. As for the plurality of images, for example, an image having the first imaging order may be an image of a predetermined size, and a reduced version of all the images (thumbnail image) may be superimposed on a part of the first image and displayed. .. As a result, the borrower can refer to the first image and select the thumbnail image of the other room to check the state of the other room, and enlarge the thumbnail image to a predetermined size for display. The borrower can obtain detailed information on the displayed room, such as the color of the wall, the size and position of the window, the type of lamp, and the position of the outlet.

The information processing device 10, the management device 12, and the information providing system 13 are connected by the network 15 and can communicate with each other via the network 15. The image pickup apparatus 11 may also be connected to the network 15 and communicate with the information processing apparatus 10 via the network 15, but in FIG. 1, it communicates directly with the information processing apparatus 10 by a wireless connection.

The information processing device 10 has a function that the person in charge can possess or move, communicates with the image pickup device 11, the management device 12, and the information providing system 13, receives information from the person in charge, and displays the captured image. Any device may be used as long as it is a device.

As the image pickup device 11, a digital camera, a notebook PC with a camera, a tablet terminal with a camera, a smartphone with a camera, an omnidirectional camera, or the like can be used. The omnidirectional camera is a camera capable of capturing 360 ° omnidirectional images centered on the camera at one time. When trying to image each room from corner to corner with a normal camera, the angle of the camera must be changed and the number of images increases, which is difficult to manage. However, since the omnidirectional camera only needs to take one image for each room and only one image is required, the omnidirectional camera is desirable as the image pickup device 11.

The management device 12 includes a storage device having a storage capacity sufficient to store images of all rooms of all properties managed by the information providing system 13.

The hardware configuration of the information processing apparatus 10 included in the information processing system will be described with reference to FIG. The information processing device 10 includes a CPU (Central Processing Unit) 20, a ROM (Read Only Memory) 21, a RAM (Random Access Memory) 22, a flash memory 23, a connection I / F 24, an operation panel 25, and a camera 26 as hardware. It is configured to include communication I / F27. The CPU 20, ROM 21, RAM 22, flash memory 23, connection I / F 24, and communication I / F 27 are connected to the bus 28 and exchange information and the like with each other via the bus 28.

The CPU 20 is a calculation means and controls the entire information processing apparatus 10. The ROM 21 is a read-only non-volatile storage medium that stores a boot program, firmware, and the like for starting the information processing device 10. The RAM 22 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 20 processes information. The flash memory 23 is a non-volatile storage medium capable of reading and writing information, and stores an OS (Operating System), various applications, programs for executing processing, and the like. Here, the flash memory 23 is adopted as the non-volatile storage medium, but the present invention is not limited to this, and an HDD (Hard Disk Drive) may be adopted.

The connection I / F 24 connects the operation panel 25 and the camera 26 to the bus 28, and controls input of information from the operation panel 25, display of information on the operation panel 25, and input of an image from the camera 26. The operation panel 25 has a touch panel, receives input of information, and displays the information. Here, the operation panel 25 is adopted, but the present invention is not limited to this, and an input device and a display device may be provided and connected to the bus 28 by an input / output I / F. Like the image pickup device 11, the camera 26 has a solid-state image pickup device, converts the received light into an electric signal, and outputs it as image data.

The communication I / F 27 connects to the image pickup device 11, the management device 12, and the information providing system 13 via the network 15 by wire or wirelessly, and controls communication between these devices and the system. Here, the description is made assuming that communication is performed via the network 15, but the present invention is not limited to this, and direct communication may be performed. When communicating wirelessly, communication can be performed using Wi-Fi or the like defined by the IEEE 802.11 standard.

The information processing device 10 may be provided with other hardware, for example, an SD card slot for mounting an external storage medium such as an SD card or a USB (Universal Serial Bus) memory, or an external storage I / F such as a USB connector. Can be prepared. Further, the information processing device 10 can be provided with an image pickup device such as a camera, a voice input device such as a microphone, a voice output device such as a speaker, a GPS (Global Positioning System), various sensors, and the like.

The hardware configuration of the image pickup apparatus 11 included in the information processing system will be described with reference to FIGS. 3 and 4. The image pickup device 11 may be a digital camera or the like, but here, it will be described as an omnidirectional camera. FIG. 3 is a cross-sectional view of an omnidirectional camera, showing a main hardware configuration, and FIG. 4 shows a detailed hardware configuration.

Referring to FIG. 3, the image pickup apparatus 11 has, as main hardware, an image pickup body 30, a housing 31 for holding the image pickup body 30, a controller, a battery, and other parts, and a shutter button 32 provided on the housing 31. And. The image pickup body 30 includes two imaging optical systems 33A and 33B and two solid-state image pickup elements 34A and 34B such as a CCD (Charge Coupled Device) sensor and a CMOS (Complementary Metal Oxide Semiconductor) sensor. Each of the two imaging optical systems 33A and 33B is configured as, for example, a fisheye lens having 7 elements in 6 groups, and the fisheye lens has an angle of view larger than 180 °. Here, a system configured by combining a solid-state image sensor and an imaging optical system one by one is referred to as an imaging optical system.

The two imaging optical systems 33A and 33B have optical elements such as a lens, a prism, a filter, and an aperture diaphragm, and a positional relationship is determined with respect to the two solid-state imaging elements 34A and 34B. Positioning is such that the optical axes of the optical elements of the two imaging optical systems 33A and 33B are positioned orthogonally to the central portion of the light receiving region of the two corresponding solid-state image sensors 34A and 34B, and the light receiving region is located. , It is performed so as to be the image plane of the corresponding fisheye lens. Each of the two solid-state image sensors 34A and 34B is a two-dimensional solid-state image sensor whose light receiving region forms an area area, and converts the light focused by the two combined imaging optical systems 33A and 33B into an image signal. To do.

The two imaging optical systems 33A and 33B have the same specifications and are combined in opposite directions so that their optical axes match. The two image signals converted by the two solid-state image sensors 34A and 34B are output to the image processing means on the controller. The image processing means joins two partial images in the two image signals to generate an image (omnidirectional image) having a solid angle of 4π steradian. Here, it is assumed that an omnidirectional image, which is an image captured in all directions, is generated, but a panoramic image, which is an image captured at 360 ° in the horizontal direction, may be generated.

In the image pickup apparatus 11, since the fisheye lens has an angle of view larger than 180 °, each imaging optical system has an overlapping portion. Therefore, when generating a spherical image, the overlapping portion of the two image signals is used as a reference for image stitching as reference data representing the same image. The spherical image may be generated by the imaging device 11 or the information processing device 10. For example, all the processing by the image processing means of the image pickup apparatus 11 may be performed by the image pickup apparatus 11, or all or part of the processing by the image processing means of the image pickup apparatus 11 may be performed by the information processing apparatus 10. Signals and the like may be transferred.

The whole celestial sphere image can be displayed on, for example, a screen provided in the image pickup device 11 or a screen of an information processing device 10 connected to the image pickup device 11, output to a printing device for printing, or external to an SD card or the like. It can be stored as data in a storage medium or the like.

Referring to FIG. 4, the image pickup apparatus 11 includes, in detail, a processor 40, a lens barrel unit 41, and various components connected to the processor 40. The lens barrel unit 41 includes two imaging optical systems 33A and 33B and two solid-state image sensors 34A and 34B. The two solid-state image sensors 34A and 34B are controlled by a control command from the processor 40.

Various components include SDRAMs 42 and 43 for temporarily storing data, a memory card slot 44 for mounting a memory card, a flash ROM 45, a USB connector 46, and a power switch 47. In addition, various components include a speaker 48 as an audio output device, a microphone 49 as an audio input device, a wireless NIC (Network Interface Card) 50 used for connecting to a network 15 by wireless communication, and an LCD (Liquid Crystal). Display) Monitor 51, 3-axis acceleration sensor 52 and the like are included. Since these are examples, other components may be included.

The processor 40 includes ISPs (Image Signal Processors) 60A and 60B, DMAC (Direct Memory Access Controller) 61, Arbiter (ARBMEMC) 62, MEMC (Memory Controller) 63, and distortion correction / image composition block 64. The ISPs 60A and 60B set the white balance and the gamma for the images input through the signal processing of the solid-state image sensors 34A and 34B. The DMAC61 directly transfers data from the ISP 60A and 60B and the distortion correction / image composition block 64 to the ARBMEMC62, and directly from the ARBMEMC62 to the distortion correction / image composition block 64 without going through the CPU. ARBMEMC62 arbitrates access to memory such as SDRAM 42. MEMC63 controls its memory access.

Distortion correction / image synthesis block 64 uses information from the 3-axis acceleration sensor 52 to perform distortion correction and top-bottom correction for two captured images obtained from two imaging optical systems, and image synthesis. To do. The SDRAM 42 is used to temporarily store data when the ISPs 60A and 60B and the distortion correction / image composition block 64 perform processing.

The processor 40 further includes a DMAC 65, an image processing block 66, a CPU 67, an image data transfer unit 68, an SDRAM C (SDRAM Controller) 69, a memory card control block 70, a USB block 71, and a peripheral block 72. The processor 40 also includes an audio unit 73, a serial block 74, an LCD driver 75, and a bridge 76. The DMAC 65 directly transfers data from the ARB MEMC 62 to the image processing block 66 without going through the CPU 67.

The image processing block 66 uses the resizing block 77, the JPEG (Joint Photographic Experts Group) block 78, the H.264 block 79, and the like to perform various image processing on the image. The resizing block 77 enlarges or reduces the size of the image by interpolation processing. The JPEG block 78 performs JPEG compression and decompression. The H.264 block 79 compresses and decompresses moving images such as H.264. The CPU 67 controls the operation of each part of the image pickup apparatus 11.

The image data transfer unit 68 transfers the image processed by the image processing block 66. The SDRAM C69 controls the SDRAM 43 connected to the processor 40, and sends the image transferred from the image data transfer unit 68 to the SDRAM 43. The SDRAM 43 is used to temporarily store data when performing various processes in the processor 40.

The memory card control block 70 controls reading and writing to the memory card and the flash ROM 45 mounted in the memory card slot 44. The USB block 71 controls USB communication with an external device such as a PC connected via the USB connector 46. A power switch 47 is connected to the peripheral block 72. The voice unit 73 is connected to the speaker 48 and the microphone 49, and controls the input / output of voice. The serial block 74 controls serial communication with an external device such as a PC, and a wireless NIC 50 is connected to the serial block 74. The LCD driver 75 is a drive circuit that drives the LCD monitor 51, and converts it into signals for displaying various states on the LCD monitor 51.

The flash ROM 45 stores a control program and various parameters written in a code that can be deciphered by the CPU 67. When the user operates the power switch 47 to turn on (ON) the power, the control program stored in the flash ROM 45 is loaded into the main memory. The CPU 67 executes a control program loaded in the main memory, controls the operation of each part of the image pickup apparatus 11, and temporarily stores data necessary for the control in the SDRAM 43 and the local SRAM.

Next, the hardware configuration of the management device 12 will be described with reference to FIG. Since the hardware configuration of the information providing server constituting the information providing system 13 is the same as that of the management device 12, the description of the information providing system 13 will be omitted. The management device 12 includes a CPU 80, a ROM 81, a RAM 82, an HDD (Hard Disk Drive) 83, and a communication I / F 84 as hardware. The CPU 80, ROM 81, RAM 82, HDD 83, and communication I / F 84 are connected to the bus 85 and exchange information and the like with each other via the bus 85.

The CPU 80 is a calculation means and controls the entire management device 12. The ROM 81 is a read-only non-volatile storage medium that stores a boot program, firmware, and the like for starting the management device 12. The RAM 82 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 80 processes information. The HDD 83 is a non-volatile storage medium capable of reading and writing information, and stores an OS, various programs, and the like. Here, the HDD 83 is adopted as the non-volatile storage medium, but the present invention is not limited to this, and an SSD (Solid State Drive) or the like may be adopted.

The communication I / F 84 connects to the information processing device 10, the image pickup device 11, and the information providing system 13 via the network 15 by wire or wirelessly, and controls communication between these devices and the system. Here, the description is made assuming that communication is performed via the network 15, but the present invention is not limited to this, and direct communication may be performed. When communicating wirelessly, communication can be performed using Wi-Fi or the like defined by the IEEE 802.11 standard.

The management device 12 may also be provided with other hardware, for example, an SD card slot for mounting an external storage medium such as an SD card or a USB (Universal Serial Bus) memory, or an external storage I / F such as a USB connector. be able to. Further, the management device 12 can be provided with a voice input device such as a microphone, a voice output device such as a speaker, a GPS (Global Positioning System), and the like.

The functional configuration of the information processing apparatus 10 will be described with reference to FIG. It can be said that the information processing device 10 includes the following functional units because the following functional units are generated by the CPU 20 reading the program stored in the flash memory 23 into the RAM 22 and executing the program. Here, each functional part is described as being generated by executing a program, but a part or all of a plurality of functional parts may be realized by hardware such as a dedicated circuit instead of software such as a program. ..

The information processing device 10 includes an acquisition unit 90, a control unit 91, a reception unit 92, a transmission unit 93, a display unit 94, an input reception unit 95, and a storage unit 96 as functional units. The acquisition unit 90 acquires, for example, the property ID that identifies the property including one or more rooms to be imaged and the floor plan information from the input information input by the person in charge. The acquisition unit 90 can acquire the property ID from the information providing system 13 by the information processing device 10 communicating with the information providing system 13. In addition, the acquisition unit 90 can also acquire the property ID from the information contained in the printed matter printed by the person in charge by capturing and reading the printed matter printed by the information processing device 10 with the imaging device included in the information processing device 10.
Alternatively, the person in charge can acquire the property ID by reading the information displayed on the screen of the terminal different from the information processing device 10. Further, the acquisition unit 90 can also acquire the property ID input by the person in charge to the operation panel 25 of the information processing device 10.

The control unit 91 determines the imaging order of the room specified by the floor plan information acquired by the acquisition unit 90 based on the preset ranking information of the imaging target. The ranking information is associated with room information and ranking, for example, 1st place "Living", 2nd place "Dining Room", 3rd place "Bed Room 1", 4th place. 5th place "Bed Room 2", 5th place "Bed Room 3", 6th place "Bed Room 4", 7th place "Kitchen", 8th place "Bath" Room) ”, 9th place“ Entrance ”, etc. The storage unit 96 stores the ranking information of the shooting target. For example, if the floor plan information is 3LDK, there are only 3 bedrooms, so the imaging order from 1st to 5th is as preset, and 6th "Bed Room 4" is skipped. The imaging order in which the 7th to 9th positions are followed is determined. Then, the control unit 91 instructs the display unit 94 to display the imaging order determined by the control unit 91. The display unit 94 receives the instruction and displays the imaging order.

The person in charge looks at the imaging order displayed on the display unit 94, and if it is the first imaging, it moves to the room of the first order, and if it is the second imaging, it moves to the room of the second order.

The input reception unit 95 receives a request from the person in charge to acquire information on the installation position of the image pickup device 11, and the control unit 91 instructs the display unit 94 to display the information on the installation position of the image pickup device 11. The display unit 94 receives an instruction from the control unit 91 and displays information on the installation position such as "Please install in the center of the living room and take a picture".

After installing the image pickup device 11 according to the displayed installation position information, the person in charge requests the image pickup by touching or pressing the image pickup button displayed on the operation panel 25 of the information processing device 10. The input reception unit 95 receives the request, and the control unit 91 instructs the image pickup apparatus 11 to take an image. The input reception unit 95 can also receive changes in imaging conditions such as brightness from the person in charge. When the input receiving unit 95 accepts the change, the control unit 91 instructs the change of the imaging condition.

The person in charge may remotely instruct the image pickup device 11 from the information processing device 10 to request an image pickup or the like, or may directly press the shutter button 32 or the like provided on the image pickup device 11.

The receiving unit 92 receives the image captured from the imaging device 11. The storage unit 96 temporarily stores the image received by the receiving unit 92. The display unit 94 displays the image received by the reception unit 92 as a preview image before being transmitted to the management device 12 and registered. The person in charge looks at the preview image and decides whether to use the image to be transmitted to the management device 12 or to retake the image, and the input receiving unit 95 accepts the judged result as input.

The control unit 91 instructs the image pickup apparatus 11 to take another image according to the result received by the input reception unit 95. Further, the control unit 91 instructs the transmission unit 93 to transmit the captured image to the management device 12 in response to the completion of all the imaging. When the transmission unit 93 receives an instruction to transmit an image, the transmission unit 93 associates the property ID acquired by the acquisition unit 90 with the captured image and transmits the image to the management device 12.

The functional configurations of the imaging device 11 and the management device 12 will be described with reference to FIG. 7. Similar to the information processing device 10, the image pickup device 11 and the management device 12 also have the following functional units because the following functional units are generated by the CPU reading and executing the program stored in the flash ROM or the HDD. It can be said that it is. Here, each functional part is described as being generated by executing a program, but a part or all of a plurality of functional parts may be realized by hardware such as a dedicated circuit instead of software such as a program. ..

As shown in FIG. 7A, the image pickup apparatus 11 includes a reception unit 100, a control unit 101, an image pickup unit 102, an image processing unit 103, and a transmission unit 104 as functional units. The receiving unit 100 receives an imaging instruction from the information processing device 10. In addition to the imaging instruction, the receiving unit 100 also receives an instruction to change the imaging condition. The control unit 101 receives an imaging instruction and instructs the imaging unit 102 to perform imaging. Further, the control unit 101 changes the brightness setting value (EV value) and the like set in the image pickup unit 102 in response to the change in the imaging conditions. The EV value is a numerical value indicating the brightness of the exposure.

The imaging unit 102 receives an instruction from the control unit 101, images a room to be imaged according to a set value, and outputs two captured images. The control unit 101 instructs the image processing unit 103 to perform image processing on the two output captured images. The image processing unit 103 receives the two captured images output from the imaging unit 102, joins the two captured images, generates a spherical image, and outputs the spherical image data. What is transmitted from the image pickup apparatus 11 to the information processing apparatus 10 is spherical image data, which will also be described simply as a spherical image.

The control unit 101 instructs the transmission unit 104 to transmit the output spherical image to the information processing device 10. The transmission unit 104 transmits the spherical image to the information processing device 10 in response to an instruction from the control unit 101.

As shown in FIG. 7B, the management device 12 includes a receiving unit 110, a control unit 111, a storage unit 112, and a transmitting unit 113. The receiving unit 110 receives an image associated with the property ID from the information processing device 10. In addition, the receiving unit 110 receives the image transmission request, the property ID, and the information of the communication terminal 14 from the information providing system 13.

The control unit 111 stores the image received by the reception unit 110 in the storage unit 112, and manages the image by the property ID associated with the image. Further, the control unit 111 receives the transmission request received by the reception unit 110 and searches for the corresponding image from the plurality of images stored in the storage unit 112 based on the property ID. Then, the control unit 111 instructs the information providing system 13 to transmit the searched image to the communication terminal 14 that has requested the property information corresponding to the property ID.

Upon receiving an instruction from the control unit 111, the transmission unit 113 transmits the image searched by the control unit 111 to the communication terminal 14 based on the information of the communication terminal 14 received by the reception unit 110.

The communication terminal 14 displays the image received from the management device 12 together with the property information requested from the information providing system 13. The borrower can not only check the information of rent, management fee, floor plan, address, equipment, etc. by referring to the property information, but also refer to the image, the actual wall color, the position of the door, window, outlet, etc. Can be confirmed.

In order to use the information processing system safely, the system administrator issues a user ID and password as user identification information to the person in charge. The person in charge can enter the issued user ID and password, and if the user authentication is successful, the system can be used.

FIG. 8 is a diagram illustrating a screen for creating user identification information displayed on the management device 12. After logging in to the management device 12 from a PC having management authority, the administrator inputs numbers and alphanumeric characters constituting the user ID in the user name field 120, and configures the password in the password field 121. Enter numbers and alphanumeric characters. The screen has an automatically generated button 122, and by pressing the automatically generated button 122, a user ID and a password are generated and registered.

Further, when the administrator first presses the automatically generated button 122, the management device 12 may automatically allocate numbers, alphanumeric characters, and the like, issue a user ID and password, and register them. Further, the person in charge may transmit the user ID and password issuance request to the management device 12 by accessing the management device 12 from the information processing device 10.

The screen may have only a field for inputting a user name and a password, but a field 123 for authority for operations such as "reference", "edit", and "delete" of an image can be provided. If the "reference" authority is set to "yes", the person in charge can acquire the image already registered from the management device 12 and display it on the information processing device 10 owned by the person in charge.

If the authority is "Yes", even if the person in charge can set either "Yes" for the image of the property in charge and "Yes" for all the images. Good. Information about the authority can be stored and managed in the storage unit 112 included in the management device 12.

The administrator notifies the corresponding person in charge of the user identification information created on the screen. The notification of the user identification information may be verbally notified, may be printed on paper and distributed, or may be notified by e-mail or the like via the network 15. Since the user identification information is confidential information, it can be encrypted and transmitted when notified by e-mail or the like via the network 15. Any encryption method may be adopted as the encryption method, and the encryption algorithm used at that time may be any encryption algorithm.

Next, a method in which the person in charge logs in to the management device 12 using the user identification information will be described. FIG. 9 is a diagram illustrating a login screen.

The person in charge inputs and registers the user identification information in advance in the information processing device 10 used by the person in charge. By this registration, the person in charge can log in by simply pressing the login button 124 on the login screen without inputting the user identification information each time he / she logs in. Note that this login is for performing a process of registering the image captured by the image pickup device 11 in the management device 12.

Next, an outline of the processing executed by the information processing apparatus 10 after login will be described with reference to FIG. When the person in charge presses the login button 124 and the login is successful, the process is started from step 1000. In step 1005, the information processing device 10 accesses the information providing system 13 and searches for a target property. Then, the information processing device 10 acquires the property ID of the property from the information providing system 13. Here, when the information processing device 10 has acquired the property ID, the information processing device 10 may inquire of the management device 12 whether or not the image of the same property ID has already been registered and has been photographed. Further, at the same time as the acquisition of the property ID, the information processing device 10 may acquire the floor plan information of the property. The floor plan information may be input by the person in charge, or some floor plan information may be prepared in advance and the person in charge may select the corresponding floor plan information from among them.

In step 1010, the information processing device 10 determines the imaging order of the room to be imaged by the imaging device 11, and displays the imaging order. The person in charge moves to the room instructed by the imaging order and installs the imaging device 11 in order to perform imaging according to the imaging order. Communication has been established between the information processing device 10 and the image pickup device 11, and the person in charge requests the information processing device 10 to take an image, and the information processing device 10 instructs the image pickup device 11 to take an image. Imaging is performed. The person in charge may directly press the shutter button 32 or the like provided in the image pickup apparatus 11.

In step 1015, the information processing device 10 acquires an image captured from the image pickup device 11. In step 1020, the property ID acquired by the information processing device 10 in step 1005 is associated with the image acquired by the information processing device 10 in step 1015, and transmitted to the management device 12. Then, the process ends in step 1025.

With reference to FIGS. 11 to 13, three methods for acquiring the property ID such as step 1005 in FIG. 10 will be described. The first method of acquiring the property ID will be described with reference to FIG. The first method is to output the property information held by the information providing system 13 to paper or a terminal, read the information of the target property from the output property information by the information processing device 10, and read the information. The method is to obtain the property ID from the inside.

FIG. 11A is a diagram illustrating the output property information, and FIG. 11B is a diagram illustrating a method of reading a code indicating information of the target property with the information processing device 10. Referring to FIG. 11A, the property information includes a property name, an address, a property ID, a floor plan type which is the floor plan information, and at least a barcode including the property ID and the floor plan type. Further, the camera 26 that functions as the image pickup unit of the information processing device 10 captures the barcode of the target property, and the pattern is analyzed from the image of the barcode captured by the acquisition unit 90 to obtain the property ID and the floor plan type. Can be extracted. Then, the information processing device 10 displays the property ID and the floor plan type shown in FIG. 11B on the screen. The information processing device 10 may be provided with a separate analysis unit in order to analyze the barcode. Further, the code indicating the property information is not limited to the barcode, and the property information may be read from a two-dimensional code such as a QR code (registered trademark).

The barcode may include address information in addition to the property ID and floor plan type. By including the address information, it is possible to confirm whether the property is the target property. In addition, instead of the address information, the information obtained by converting the address information into latitude and longitude may be included. By converting to latitude and longitude, the amount of information can be reduced compared to address information.

By pressing the image pickup button 125 on the screen of the information processing device 10, activating the camera 26, and capturing the bar code, the information contained in the bar code can be read.

The smartphone that can be used as the information processing device 10 may have a GPS function. In this case, it is possible to confirm whether the property is the target property by checking whether the latitude / longitude information measured by the GPS function and the latitude / longitude information acquired from the barcode match. Since it is rare that the latitude and longitude information completely match, an error range is provided, and if it is within the error range, it can be determined that they match and it can be confirmed that the property is the target property.

If it is out of the error range, a warning (alert) can be issued. The alert can be output as a warning display on the screen of the information processing device 10 or as a warning sound. If it is out of the error range, it is often a typo, so issuing an alert can prevent typos.

When the information processing device 10 has acquired the property ID, it inquires of the management device 12 whether or not the image of the same property ID has already been registered and has been photographed. When the information processing device 10 receives a reply from the management device 12 that the image has been taken, the information processing device 10 issues an alert such as "This is the property ID that has been taken." The answer from the management device 12 may be only an answer as to whether or not the image has been taken, but it may include information that the image has been taken on what year, month, and day as the shooting date. As a result, the information processing device 10 can display as an alert "It is a property ID taken on XX month XX day".

Further, when the information processing device 10 receives a response including the shooting date from the management device 12, it may determine whether or not a predetermined predetermined period has elapsed from the shooting date. If a certain period of time has passed, you can turn off the alert. As a result, it is possible to reduce the trouble of canceling the alert setting. When the predetermined period has not passed, it is unlikely that the image pickup target has changed, so that it is possible to reduce the time and effort required to take the image again.

The second method is a method of accessing the information providing system 13, searching for a target property from the properties owned by the information providing system 13, and acquiring information on the searched property. In the information processing device 10, the icon 126 for accessing the page provided by the information providing system 13 shown in FIG. 12A is lightly touched (tapped) once with a finger or the like. Next, a screen for searching for the property shown in FIG. 12B is displayed. The person in charge searches for the target property based on the address, property name, etc. In FIG. 12B, two search methods, "search by line" and "search by area", are displayed.

When the target property is searched, the screen for performing the panoramic shooting of the property shown in FIG. 12C can be opened. On this screen, the property ID and the panorama shooting button 127 are displayed. When the person in charge presses the panorama shooting button 127, the person in charge acquires the property ID and the like, instructs the image of the target property, and starts a program for executing the process of posting the captured image.

When the program is started, the screen for selecting the property ID and floor plan type shown in FIG. 12 (d) is displayed. The property ID is searched on the screen shown in FIG. 12 (b) and acquired on the screen shown in FIG. 12 (c). Therefore, on the screen shown in FIG. 12D, the acquired property ID is automatically input. The person in charge selects the floor plan type of the target property from a plurality of preset floor plan types. The floor plan type can be selected by tapping, for example, "1K" in the pull-down menu 128.

In the second method as well, in the same manner as in the first method, when the property ID is acquired, the information processing device 10 inquires the management device 12 whether or not an image having the same property ID has been captured.

The third method is a method in which the person in charge inputs the property ID and selects the floor plan type. The person in charge inputs the property ID field 129 shown in FIG. 13 using a keyboard or the like displayed on the screen of the information processing device 10. The floor plan type can be selected by tapping the desired type in the pull-down menu 128 in the same manner as in the second method.

In the third method as well, in the same manner as in the first method and the second method, when the information processing device 10 acquires the property ID, whether or not an image of the same property ID has already been captured by the management device 12. Inquire.

The process of acquiring an image will be described in detail with reference to FIG. The process starts from step 1400. In step 1405, the person in charge acquires the property ID. The property ID can be obtained by the method shown in FIGS. 11 to 13. In addition, the person in charge selects the floor plan type of the property, and the information processing device 10 accepts the selection of the floor plan type. In step 1410, the room is specified from the floor plan type, it is determined whether or not the floor plan has been acquired, and the process is branched. When the floor plan is acquired, the process proceeds to step 1415, the imaging candidates are displayed, and the imaging order is determined. If the floor plan has not been acquired, the process proceeds to step 1420 to input a location that is a candidate for imaging. The details of the process of inputting the imaging candidates will be described later.

Here, the shooting order will be described with reference to FIG. First, in step 1415, the imaging order is displayed on the screen of the information processing apparatus 10 in FIG. 15A. In FIG. 15 (a), the shooting order is "Living", "Dining Room", "Bed Room 1", "Bed Room 2", "Kitchen", "Bath Room", and "Entrance", which are room information. They are lined up and instructed to take pictures in order from "Living".

In FIG. 15A, since the image has not been captured yet, an image indicating that there is nothing is displayed on the left side of a character string representing a room such as “Living”. If the image has already been captured, a thumbnail of the captured image is displayed. On the right side of the character string representing the room, a shooting button 130 for requesting imaging and a viewing button 131 for displaying after imaging are provided. Further, a post button 132 for posting the captured image, a cancel button 133, and a save button 134 for saving information such as the captured image in the information processing device 10 are also provided.

The person in charge images the rooms in order from the top "Living". The person in charge moves the image pickup device 11 to the room to be imaged.

Returning to FIG. 14, in step 1425, the installation position of the image pickup device 11 is displayed on the screen of the information processing device 10. Upon pressing the shooting button 130, the information processing device 10 displays the installation position of the imaging device 11 in each room according to the shooting order, as shown in FIG. 15B. Then, the person in charge installs the image pickup apparatus 11 at the installation position. The image pickup apparatus 11 can be installed on, for example, a support leg. The display of the installation position of the image pickup apparatus 11 in step 1425 may be omitted. When step 1425 is omitted, the imaging device 11 is installed at a position determined by the person in charge to be suitable for imaging in the imaging room.

The person in charge notifies the information processing apparatus 10 of the response that the installation of the imaging apparatus 11 is completed. For example, the information processing device 10 displays a screen asking the person in charge whether the installation is completed, and the person in charge responds that the installation is completed. Then, the process proceeds to step 1430. In step 1430, the person in charge captures an image using the imaging device 11. For example, a screen as shown in FIG. 15C is displayed, and an image pickup device 11 is instructed to take a picture via the information processing device 10. The person in charge connects the information processing device 10 and the image pickup device 11 when they are not connected, and presses the image pickup button 135 to instruct the image pickup.

When an omnidirectional camera is used as the image pickup device 11, the person in charge is outside the room to be imaged in which the omnidirectional camera cannot be seen in order to prevent the person in charge from being photographed in all directions and being reflected in the omnidirectional image. Imaging can be instructed by moving to. Further, the type of the image pickup apparatus 11 can be used properly for each room. For example, when it is desired to grasp the entire space such as in a living room or a kitchen, an omnidirectional camera is used to image the entire space. When the entire space may be one surface, such as an entrance or a corridor, the image may be taken by the camera 26 of the information processing apparatus 10 or a general digital camera.

If the person in charge presses the button 130 to take a picture, but the picture has been taken and the picture has already been registered in the management device 12, the alert "The picture has already been registered" as shown in FIG. 16 can be displayed. The person in charge can see the alert and decide whether or not to take an image.

Returning to FIG. 14, in step 1435, the information processing device 10 acquires an image from the image pickup device 11. For example, the information processing device 10 receives an image and displays a preview screen for confirming the captured image as shown in FIG. The person in charge looks at the preview screen and determines whether or not the displayed image may be an image to be transmitted to the management device 12. If the captured image includes a person, a part of the image pickup device 11, or the like, the person or the like can be automatically detected and an alert can be issued. The person in charge presses the share button 136 in order to proceed to the next process.

The information processing device 10 receives the pressing of the share button 136 to display the screen shown in FIG. On the screen, a button 137 for discarding the captured image and taking a picture again, and a button 138 for proceeding to the next screen are displayed. The person in charge can select and press any button. The button 137 for discarding and re-imaging is a button for discarding the captured image and re-imaging the image in the same room. The button 138 for proceeding to the next screen is a button for capturing an image of the next room. The input receiving unit 95 accepts that one of the buttons is pressed and selected as an input, and the control unit 91 instructs the display unit 94 to discard the image or display the next screen. ..

In step 1440, the information processing apparatus 10 determines whether the request for re-imaging is received from the person in charge. If it is accepted, the process returns to step 1430, and the imaging device 11 is instructed to perform another imaging. For example, when the person in charge determines that the image is not suitable for transmission to the management device 12, the image is re-imaged. Therefore, the screen shown in FIG. 15C is displayed again. If not accepted, the process proceeds to step 1445. For example, when the person in charge determines that the image may be transmitted to the management device 12, the process proceeds to the imaging of the room shown in the next shooting order. Then, it is determined whether the request for acquisition of the information on the installation position of the imaging device 11 in the other room shown in the next imaging order has been accepted. If accepted, the process returns to step 1425. Then, the processes of steps 1425 to 1440 are repeated.

If not accepted, the process proceeds to step 1450. For example, there may be a case where all the imaging of the rooms indicated in the imaging order is completed, or a case where a part of the imaging indicated in the imaging order is completed and the person in charge determines that the image is once transmitted to the management device 12. Then, in step 1450, the property ID acquired in step 1405 is associated with the image and transmitted to the management device 12. The process ends at step 1455.

The person in charge captures all the images, and when the imaging is completed, presses the post button 132 shown in FIG. 15 (a). Upon pressing the post button 132, the information processing device 10 associates all the captured images with the property ID and transmits the captured images to the management device 12. Posting of an image by transmission to the management device 12 can also be performed after all the captured images are displayed in order and all are confirmed. At this time, the person in charge can confirm whether the order of arranging the images is sufficient, whether there are unnecessary images, and the like.

Here, a process of inputting a location that is a candidate for imaging in step 1420 will be described. Step 1420 is a process to be executed when the information on the floor plan is not acquired, the screen shown in FIG. 15D is displayed, and the imaging candidate is input by the operation of the person in charge. In FIG. 15D, instead of the display of FIG. 15A, an imaging location input field 151 and an input field addition button 152 are displayed. The person in charge can input an arbitrary imaging location in the imaging location input field 151. Further, the person in charge can add and display the imaging location input field 151 by tapping the input field addition button 152, whereby a plurality of imaging locations can be set. In FIG. 15D, the person in charge may input all the imaging candidates in advance and then perform imaging at each imaging location, or may repeat inputting the imaging candidates and imaging. This makes it possible to easily customize the imaging order at the discretion of the person in charge.

Further, in the present embodiment, the imaging location may be added by the operation of the person in charge after displaying as shown in FIG. 15 (e). For example, when searching for a real estate property, the room that the borrower pays attention to is often common, so it is easy to predict the room to be imaged. Therefore, as shown in FIG. 15 (e), locations such as “Living” and “Dining Room” that are expected to be imaged are displayed in advance as imaging candidates, and the person in charge further displays other rooms as imaging locations. May be added as. As a result, the person in charge can reduce the trouble of inputting the imaging location.

The input field addition button 152 may be provided on the display shown in FIG. 15A. As a result, the person in charge can add an imaging location other than the imaging location preset by the floor plan (for example, in the case of a real estate property, a common area or the like). Therefore, the person in charge can customize and set the imaging location and the imaging order.

Each room is instructed to take an image one by one, but if it is desired to take a plurality of images, the rooms can be added to the image taking order. Further, the image pickup apparatus 11 releases the shutter when taking an image, and the image pickup apparatus 11 can transmit the images to be captured to the information processing apparatus 10 continuously or at regular time intervals. Therefore, the information processing apparatus 10 displays images continuously or at regular time intervals, and the person in charge can re-install the images at the optimum positions while checking the imaging positions and instruct the imaging.

When acquiring an image, the imaging conditions can be changed. As the imaging conditions, for example, the brightness (brightness), hue, saturation, etc. of the image can be mentioned. Here, it is described as changing (adjusting) the brightness of the image. The brightness of the image can be adjusted by changing the value (EV value) indicating the brightness of the exposure. The EV value is a value determined by the aperture of the lens (F value) and the exposure time (shutter speed) of the solid-state image sensor.

The process of acquiring an image with a change in the imaging conditions will be described with reference to FIG. Steps 1900 to 1935 are the same as the processes of steps 1400 to 1435 shown in FIG. In step 1940, the person in charge changes the EV value by the information processing device 10 and changes the brightness of the displayed image. The process after step 1945 is the same as the process after step 1440 shown in FIG. The reception of the EV value can be received by the input reception unit 95, and the change of the EV value can be realized by instructing the image pickup device 11 by the control unit 91.

The person in charge can check the image captured on the preview screen, change the imaging conditions on the preview screen, and adjust the brightness of the image and the like. Further, the brightness of the image may be adjusted in advance before instructing the imaging.

A method of changing the imaging conditions on the preview screen will be described with reference to FIG. FIG. 20A is a diagram illustrating a preview screen of the captured image. The preview screen is provided with a slide bar 139 for adjusting the EV value, and the left end of the slide bar 139 shows the smallest value (darkest) and the right end shows the largest value (brightest). Shown.

The person in charge can change the EV value by moving the slide bar 139 toward the left end or the right end. 20 (b) and 20 (c) are screens displaying an image when the EV value is increased by moving the slide bar 139 from the position shown in FIG. 20 (a) toward the right end. Since the EV value increases from FIG. 20 (a) to FIG. 20 (c), it can be seen that the image is brighter.

When a spherical camera is used as the image pickup device 11, the spherical image is captured by using two fisheye lenses having an angle of view larger than 180 °, and the two obtained images are joined together to be generated. .. On the preview screen, only a part of the captured image of one of the spherical images is displayed.

Here, when displaying the property information and the room image on the borrower's communication terminal 14, the initial image displayed first is an image of a part of the area displayed on the preview screen. The person in charge wants to make the property look as good as possible when asking the borrower to rent the property. Therefore, the person in charge can change the area to be suitable as the initial image displayed to the borrower and register it in the management device 12.

The process of acquiring an image accompanied by this area change will be described with reference to FIG. Steps 2100 to 2135 are the same as the processes of steps 1400 to 1435 shown in FIG. 14 and steps 1900 to 1935 shown in FIG. In step 2140, the person in charge changes the area to be displayed on the preview screen by the information processing apparatus 10. The processes after step 2145 are the same as the processes after step 1440 shown in FIG. 14 and after step 1945 shown in FIG. The control unit 91 can instruct the transmission unit 93 to transmit and update the changed image to the management device 12. As a result, the initial image can be displayed as an image changed by the person in charge.

The area can be changed by the person in charge moving (swipe or flick) the screen of the information processing device 10 left and right or up and down while keeping the screen in contact with the screen with a finger. By the way, the area can be reduced or enlarged by the person in charge by moving the screen closer to or further away from the screen (pinch in, pinch out) while keeping the two fingers in contact with the screen.

When the processing of the information processing device 10 shown in FIGS. 10, 14, 19, and 21 is completed, the management device 12 receives the image associated with the property ID. Then, the management device 12 stores the image in the storage unit 112, and when the registration of the image is completed, the management device 12 transmits a registration completion notification to the information processing device 10. Upon receiving the registration completion notification, the information processing device 10 can display the message "upload successful" shown in FIG. Further, since the information processing device 10 causes the person in charge to confirm the uploaded content as the registered content, it is possible to display a message asking whether or not to "confirm with a browser".

In response to this message, the person in charge can select "Yes" or "No", and by selecting "Yes", the uploaded contents can be displayed.

As a method of displaying an image, for example, as shown in FIG. 23, an initial image 140 of a room whose imaging order is first is displayed in a predetermined size. Then, the thumbnail images 141 of each room can be displayed side by side on the initial image 140. Further, a Click to Play button 142 is provided on the initial image 140, and an omnidirectional image can be displayed while changing the area over a certain period of time.

In addition, a sentence (caption) explaining the image can be added to the image. The caption is, for example, "Living" or "Bed Room 1" as room information. The caption can be added when the information processing device 10 receives the image captured from the image pickup device 11 and temporarily stores the image. Room information is included in the imaging sequence. Therefore, the information processing device 10 acquires the information of the room corresponding to the shooting button 124 when the shooting button 124 of the room to be imaged is pressed, and when the captured image is received, the information processing device 10 obtains the room information. It can also be added as a caption.

Here, the person in charge can edit the image after registering the image in the management device 12 when the administrator has given the authority of "edit". Therefore, the person in charge can edit the image so that the image can be easily understood in which direction the image is captured and the initial image is oriented by associating the image with the floor plan. In addition, it will be easier for the borrower to grasp the condition of the property. 24 and 25 show the image editing performed by the person in charge.

First, the person in charge inputs the property ID to be edited on the search screen as shown in FIG. 24 (a). As a result, the management device 12 searches for an image associated with the property ID. Next, the editing screen shown in FIG. 24B is displayed. The searched images can be displayed in order as thumbnail images 141 by pressing the import button 143. Of course, the automatically searched image may be displayed as the thumbnail image 141. FIG. 24B shows a thumbnail image 141 displayed.

The person in charge selects the floor plan by pressing the drag and drop or the import button 144. Then, the floor plan is displayed in the frame indicated by the dotted line on the edit screen. The person in charge can use the link button 145 to associate the image displayed as the thumbnail image 141 with the floor plan. For example, the image corresponding to “Living” in the thumbnail image 141 is selected and associated with the “Living” area in the floor plan. In such an edit, the input reception unit 95 accepts the content of the edit for the image associated with the property ID, and the control unit 91 instructs the transmission unit 93 to acquire the image. Further, it can be realized by instructing the control unit 91 to send the edited image to the management device 12 and update it.

The edited image is shown in FIG. In FIG. 25, the floor plan 146 and the image 147 captured at the imaging position shown in the floor plan 146 are superimposed and displayed. In the floor plan 146, a plurality of imaging positions 148 are shown, and the imaging position of the currently displayed image 147 is shown separately from other imaging positions. Further, in the floor plan 146, the direction and range of the currently displayed image 147 with respect to the imaging position 148 are also shown in a substantially fan shape.

The image 147 indicates the direction of the adjacent imaging position 148, the symbol 149 for displaying the image captured at the imaging position 148, the upper, lower, left and right areas of the spherical image are displayed, and the area is enlarged and expanded. A button 150 for shrinking is shown.

By providing the floor plan 146, the symbol 149, and various buttons 150, the borrower can feel as if he / she is actually there and looking at each room while moving.

By the way, in the present embodiment, the system administrator can register the list of the imaging order. For example, in the case of real estate, it is possible to easily manage the imaging order by associating the floor plan type with each of the configured rooms. That is, when the person in charge selects a floor plan on the screens shown in FIGS. 11 (b), 12 (d), 13 and the like, a list of imaging locations corresponding to the selected floor plan as shown in FIG. 15 (a) is displayed. it can. Here, a process of capturing and registering an image based on the list will be described. FIG. 26 is a sequence diagram of processing executed in the information processing system.

The administrator uses the administrator PC 16 to access the management device 12, register the person in charge, edit the list, and the like. In addition, the person in charge accesses the management device 12 using the information processing device 10 to acquire a list, and uploads an image captured based on the list. The details of each process will be described below.

First, in step 2600, the administrator PC 16 having management authority logs in to the management device 12. Next, in step 2605, the administrator PC 16 registers the user identification information of the person in charge of performing work such as image capturing and uploading in the storage unit 112 of the management device 12. In step 2610, the management device 12 issues the ID and password of the person in charge registered in the storage unit 112. The ID and password may be issued by the method described with reference to FIG.

In step 2615, the administrator notifies each person in charge of the issued ID and password. The ID and password notifications may be given orally directly to the person in charge, printed on paper and distributed, or owned by each person in charge via e-mail or the like via the network 15. It is also possible to notify the information processing device 10 to be used.

After that, the administrator PC 16 registers and edits the list in step 2620. FIG. 27 is a diagram illustrating a screen in which the administrator edits the list. After logging in to the management device 12, the administrator PC 16 transitions to the list editing screen shown in FIG. 27 by selecting an item such as "edit list" from the menu. The list edit screen includes a floor plan type setting pane and an imaging order setting pane. Further, each pane includes an order change button 153, a delete button 154, an item name input field 155, and an item addition button 156.

In the floor plan type setting pane, the floor plan type can be added by inputting the floor plan type in the item name input field 155a and pressing the add button 156a. In addition, the display order of the selected floor plan type can be changed by the order change button 153a of the up arrow or the down arrow. The selected floor plan type item is represented by a dark display, and the selected item can be deleted by pressing the delete button 154a during selection.

Further, in the imaging order setting pane, the imaging location corresponding to the floor plan item selected in the floor plan type setting pane and the imaging order are set. When the item selected in the floor plan type setting pane is changed, the display in the imaging order setting pane is switched. In the imaging order setting pane, the imaging location can be added by inputting the imaging location in the item name input field 155b and pressing the add button 156b. Further, the imaging order can be changed by the order change button 153b of the up arrow and the down arrow. The item of the selected imaging location is represented by a dark display, and the selected item can be deleted by pressing the delete button 154b during selection.

The description returns to FIG. The list created by the administrator PC 16 in step 2620 is stored in the storage unit 112 of the management device 12. The list may be registered before the person in charge of step 2605 is registered.

Next, in step 2625, the information processing device 10 logs in to the management device 12 using the notified ID and password. As an example, login is performed using the screen shown in FIG. When the management device 12 accepts the login, the control unit 111 inquires about the information of the person in charge registered in the storage unit 112, and if the person in charge who has logged in is registered, the management device 12 permits the login.

Upon receiving the login of the person in charge, the management device 12 notifies the information processing device 10 of the list registered in the storage unit 112 in step 2630. The information processing device 10 acquires the list notified from the management device 12 by the acquisition unit 90.

At step 2635, the person in charge images each imaging location based on the imaging sequence displayed in the list. In step 2635, the information processing device 10 may receive an image captured by the receiving unit 92 of an image captured by using the image pickup device 11 or a general digital camera, or the information processing device 10 may receive the image. An image may be taken using the camera 26.

After that, the information processing device 10 uploads the captured image to the management device 12 in step 2640. In step 2640, the transmission unit 93 of the information processing device 10 transmits the captured image after associating it with the property ID. The processes of steps 2635 and 2640 correspond to the processes of steps 1430 to 1450 in FIG. 14 and the like.

The receiving unit 110 of the management device 12 receives the image uploaded in step 2640, and in step 2645, the control unit 111 registers the uploaded image in association with the imaging location of the list and stores it in the storage unit 112. ..

By editing the list as described above, the list can be customized according to the purpose, so that the time and effort required for the person in charge to take an image can be reduced. Also, if each person in charge uses the same list, the notation can be unified. For example, it is possible to eliminate notation fluctuations such as "Living", "LIVING", and "living room", and the convenience of the person in charge and the borrower can be improved.

From the above, by providing the information processing system, the information processing device 10, the information processing method executed by them, and the program for causing the computer to execute the processing, it is possible to realize the posting of images by simple processing. it can. Further, when the image has already been captured and the registered property ID is input, an alert can be issued, so that it is possible to prevent the registration of an erroneous image. For properties for which a predetermined period has passed since the previous registration, it is controlled not to issue an alert, so it is possible to reduce the trouble of checking and canceling the alert.

Although the present invention has been described above with the above-described embodiments as an information processing device, an information processing system, an authentication method, and a program, the present invention is not limited to the above-described embodiments. The present invention can be modified within the range that can be conceived by those skilled in the art, such as other embodiments, additions, changes, deletions, etc. It is included in the scope of the invention.

Therefore, the program is a floppy (registered trademark) disk, CD (Compact Disk), CD-R (Compact Disk Read Only Memory), DVD (Digital Versatile Disk), SD memory in an installable or executable format file. It can be configured to be recorded and provided on a computer-readable recording medium such as a card (SD Memory Card) or a USB memory (Universal Serial Bus Memory). In addition, the above program may be configured to be provided or distributed via a network such as the Internet. Further, the above program may be configured to be provided by being incorporated in ROM or the like in advance together with various other software.

In the above embodiment, in each of the above-mentioned functional units, the CPU reads and executes the program stored in the HDD or the like, so that the program that realizes each functional unit is loaded on the RAM, and each of the above-mentioned functional units is loaded. Has been generated. However, the present invention is not limited to this, and for example, at least a part of each functional unit may be realized by a dedicated hardware circuit (for example, a semiconductor integrated circuit).

10 ... Information processing device, 11 ... Image sensor, 12 ... Management device, 13 ... Information providing system, 14 ... Communication terminal, 15 ... Network, 16 ... Administrator PC, 20 ... CPU, 21 ... ROM, 22 ... RAM, 23 ... Flash memory, 24 ... Connection I / F, 25 ... Operation panel, 26 ... Camera, 27 ... Communication I / F, 28 ... Bus, 30 ... Image sensor, 31 ... Housing, 32 ... Shutter button, 33A, 33B ... Imaging optical system, 34A, 34B ... Solid-state image sensor, 40 ... Processor, 41 ... Lens barrel unit, 42, 43 ... SDRAM, 44 ... Memory card slot, 45 ... Flash ROM, 46 ... USB connector, 47 ... Power switch, 48 ... Speaker, 49 ... Microphone, 50 ... Wireless NIC, 51 ... LCD monitor, 52 ... 3-axis acceleration sensor, 60A, 60B ... ISP, 61 ... DMAC, 62 ... Arbiter, 63 ... MEMC, 64 ... Distortion correction / image synthesis Block, 65 ... DMAC, 66 ... Image processing block, 67 ... CPU, 68 ... Image data transfer unit, 69 ... SDRAM C, 70 ... Memory card control block, 71 ... USB block, 72 ... Peripheral block, 73 ... Audio unit, 74 ... Serial block, 75 ... LCD driver, 76 ... Bridge, 77 ... Resize block, 78 ... JPEG block, 79 ... H.264 block, 80 ... CPU, 81 ... ROM, 82 ... RAM, 83 ... HDD, 84 ... Communication I / F, 85 ... bus, 90 ... acquisition unit, 91 ... control unit, 92 ... receiver unit, 93 ... transmitter unit, 94 ... display unit, 95 ... input reception unit, 96 ... storage unit, 100 ... receiver unit, 101 ... Control unit, 102 ... Imaging unit, 103 ... Image processing unit, 104 ... Transmission unit, 110 ... Reception unit, 111 ... Control unit, 112 ... Storage unit, 113 ... Transmission unit, 120, 121 ... Column, 122 ... Automatic generation button , 123 ... column, 124 ... login button, 125 ... image sensor, 126 ... icon, 127 ... panoramic shooting button, 128 ... pull-down menu, 129 ... column, 130 ... take button, 131 ... view button, 132 ... post button, 133 ... Cancel button, 134 ... Save button, 135 ... Image sensor button, 136 ... Share button, 137 ... Reshoot button, 138 ... Go to next screen button, 139 ... Slide bar, 140 ... Initial image, 141 ... Thumbletter image, 142 ... Click to Play button, 143, 144 ... Import button, 145 ... Link button, 146 ... Floor view, 147 ... Image, 148 ... Image position 149 ... Symbol, 150 ... Button, 151 ... Imaging location input field, 152 ... Input field addition button, 153 ... Order change button, 154 ... Delete button, 155 ... Item name input field, 156 ... Item addition button

Japanese Unexamined Patent Publication No. 2015-35178

Claims (20)

An information processing system that processes images
An acquisition means for acquiring identification information for identifying one or more imaging targets, and
A transmission means for associating the one or more images to be imaged and the identification information captured in a predetermined imaging order and transmitting the identification information to the management device is included.
The image to be imaged is an omnidirectional image captured in all directions, and the initial image displayed first by the display means is an image of a part of the omnidirectional image.
When a request for changing the initial image to an image of another region is received, the initial image is changed to an image of the other region, the image changed to the initial image is transmitted, and the management device manages the image. An information processing system that instructs the transmitting means to update an image to be processed. An information processing system that processes images
An acquisition means for acquiring identification information for identifying one or more imaging targets, and
A transmission means for associating the one or more images to be imaged captured according to a predetermined imaging order with the identification information and transmitting the identification information to the management device.
An input receiving means for receiving the input of the identification information and the content of editing for one or more images associated with the identification information managed by the management device.
Including
The transmission means is instructed to transmit the identification information received by the input receiving means to the management device to acquire one or more images associated with the identification information, and the input receiving means receives the identification information. It instructs the information processing system to one or more image edited according to the content of the editing and update transmits to the management apparatus. An information processing system that processes images
An acquisition means for acquiring identification information for identifying one or more imaging targets, and
A transmission means for associating the one or more images to be imaged captured according to a predetermined imaging order with the identification information and transmitting the identification information to the management device.
Including
The management device receives the identification information and the information of the communication terminal from an information providing system that provides information to the communication terminal, and based on the information of the communication terminal, one or more with which the identification information is associated. transmitting the image to the communication terminal, an information processing system. An imaging means for capturing an image of a code containing at least the identification information is included.
The information processing system according to any one of claims 1 to 3, wherein the acquisition means acquires the identification information from an image of the code captured by the imaging means. An information processing system that processes images
An acquisition means for acquiring identification information for identifying one or more imaging targets, and
A transmission means for associating the one or more images to be imaged captured according to a predetermined imaging order with the identification information and transmitting the identification information to the management device.
Including
The obtaining unit requests the identification information, acquires the identification information from the external device to the external device that holds the identification information, the information processing system. Including means for accepting a request to change the imaging conditions set in the imaging device, including
The information processing system according to any one of claims 1 to 5 , which instructs the imaging apparatus to change the imaging conditions based on the request. A display means for displaying a screen for selecting whether to discard the image of the imaging target and image again or to capture the next imaging target in the imaging sequence is included.
The information processing system according to any one of claims 1 to 6 , which accepts the selection of imaging again or the selection of imaging the next imaging target. Information processing method
An acquisition step for acquiring identification information for identifying one or more imaging targets, and
Includes a transmission step of associating the one or more images to be imaged captured according to a predetermined imaging order with the identification information and transmitting the identification information to the management device.
In the acquisition step, an information processing method for requesting the identification information from an external device having the identification information and acquiring the identification information from the external device. Information processing method
An acquisition step for acquiring identification information for identifying one or more imaging targets, and
A transmission step of associating the one or more images to be imaged captured according to a predetermined imaging order with the identification information and transmitting the identification information to the management device.
Including
The image to be imaged is an omnidirectional image captured in all directions, and the initial image displayed first by the display means is an image of a part of the omnidirectional image.
When a request for changing the initial image to an image of another region is received, the initial image is changed to an image of the other region, the image changed to the initial image is transmitted, and the management device manages the image. An information processing method that executes the transmission step so as to update the image to be processed. Information processing method
An acquisition step for acquiring identification information for identifying one or more imaging targets, and
A transmission step of associating the one or more images to be imaged captured according to a predetermined imaging order with the identification information and transmitting the identification information to the management device.
An input reception step that accepts the input of the identification information and the content of editing for one or more images associated with the identification information managed by the management device.
Including
Regarding the transmission step, the identification information received in the input reception step is transmitted to the management device to instruct to acquire one or more images associated with the identification information, and the identification information is received in the input reception step. An information processing method in which one or more images edited according to the content of editing are transmitted to the management device and instructed to be updated. Information processing method
An acquisition step for acquiring identification information for identifying one or more imaging targets, and
A transmission step of associating the one or more images to be imaged captured according to a predetermined imaging order with the identification information and transmitting the identification information to the management device.
Including
The management device receives the identification information and the information of the communication terminal from an information providing system that provides information to the communication terminal, and based on the information of the communication terminal, one or more with which the identification information is associated. An information processing method for transmitting an image to the communication terminal. A program for causing a computer to execute each step included in the information processing method according to any one of claims 8 to 11. An information processing system that processes images
An acquisition means for acquiring identification information for identifying one or more imaging targets, and
Transmission means for transmitting to the management apparatus in association with the identification information with one or more images obtained by imaging the one or more imaging target
Including
The acquisition means is an information processing system that requests the identification information from an external device that holds the identification information and acquires the identification information from the external device. An information processing system that processes images
An acquisition means for acquiring identification information for identifying one or more imaging targets, and
A transmission means for associating one or more images obtained by capturing one or more imaging targets with the identification information and transmitting the identification information to the management device.
Including
The one or more images associated with the identification information are spherical images captured in all directions, and the initial image displayed first by the display means is an image of a part of the spherical image. ,
When a request for changing the initial image to an image of another region is received, the initial image is changed to an image of the other region, the image changed to the initial image is transmitted, and the management device manages the image. An information processing system that instructs the transmitting means to update an image to be processed. An information processing system that processes images
An acquisition means for acquiring identification information for identifying one or more imaging targets, and
A transmission means for associating one or more images obtained by capturing one or more imaging targets with the identification information and transmitting the identification information to the management device.
An input receiving means for receiving the input of the identification information and the content of editing for one or more images associated with the identification information managed by the management device.
Including
The transmission means is instructed to transmit the identification information received by the input receiving means to the management device to acquire one or more images associated with the identification information, and the input receiving means receives the identification information. An information processing system that transmits one or more images edited according to the contents of the editing to the management device and instructs the management device to update the images. An information processing system that processes images
An acquisition means for acquiring identification information for identifying one or more imaging targets, and
A transmission means for associating one or more images obtained by capturing one or more imaging targets with the identification information and transmitting the identification information to the management device.
Including
The management device receives the identification information and the information of the communication terminal from an information providing system that provides information to the communication terminal, and based on the information of the communication terminal, one or more with which the identification information is associated. An information processing system that transmits images to the communication terminal. Information processing method
An acquisition step for acquiring identification information for identifying one or more imaging targets, and
Look including a transmission step of transmitting to the management apparatus in association with the one or more one or more images of the imaging object imaged and the identification information,
In the acquisition step, an information processing method for requesting the identification information from an external device having the identification information and acquiring the identification information from the external device. Information processing method
An acquisition step for acquiring identification information for identifying one or more imaging targets, and
A transmission step of associating one or more images of one or more imaging targets with the identification information and transmitting the identification information to the management device.
Including
The one or more images associated with the identification information are spherical images captured in all directions, and the initial image displayed first by the display means is an image of a part of the spherical image. ,
When a request for changing the initial image to an image of another region is received, the initial image is changed to an image of the other region, the image changed to the initial image is transmitted, and the management device manages the image. An information processing method that executes the transmission step so as to update the image to be processed. Information processing method
An acquisition step for acquiring identification information for identifying one or more imaging targets, and
A transmission step of associating one or more images of one or more imaging targets with the identification information and transmitting the identification information to the management device.
An input reception step that accepts the input of the identification information and the content of editing for one or more images associated with the identification information managed by the management device.
Including
Regarding the transmission step, the identification information received in the input reception step is transmitted to the management device to instruct to acquire one or more images associated with the identification information, and the identification information is received in the input reception step. An information processing method in which one or more images edited according to the content of editing are transmitted to the management device and instructed to be updated. Information processing method
An acquisition step for acquiring identification information for identifying one or more imaging targets, and
A transmission step of associating one or more images of one or more imaging targets with the identification information and transmitting the identification information to the management device.
Including
The management device receives the identification information and the information of the communication terminal from an information providing system that provides information to the communication terminal, and based on the information of the communication terminal, one or more with which the identification information is associated. An information processing method for transmitting an image to the communication terminal.

Images