WO2013118460A2 - Server, client terminal, system, and program - Google Patents

Server, client terminal, system, and program Download PDF

Info

Publication number
WO2013118460A2
WO2013118460A2 PCT/JP2013/000466 JP2013000466W WO2013118460A2 WO 2013118460 A2 WO2013118460 A2 WO 2013118460A2 JP 2013000466 W JP2013000466 W JP 2013000466W WO 2013118460 A2 WO2013118460 A2 WO 2013118460A2
Authority
WO
WIPO (PCT)
Prior art keywords
information
image data
information processing
orientation
processing system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2013/000466
Other languages
English (en)
French (fr)
Other versions
WO2013118460A3 (en
Inventor
Takatoshi Nakamura
Yoichiro Sako
Mitsuru Takehara
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Priority to KR1020147018378A priority Critical patent/KR101998903B1/ko
Priority to EP13706752.6A priority patent/EP2813067A2/en
Priority to CN201380007622.0A priority patent/CN104255022B/zh
Priority to US14/370,139 priority patent/US9635234B2/en
Publication of WO2013118460A2 publication Critical patent/WO2013118460A2/en
Publication of WO2013118460A3 publication Critical patent/WO2013118460A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21—Intermediate information storage
    • H04N1/2104—Intermediate information storage for one or a few pictures
    • H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
    • H04N1/2129—Recording in, or reproducing from, a specific memory area or areas, or recording or reproducing at a specific moment
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/635—Region indicators; Field of view indicators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2101/00—Still video cameras

Definitions

  • the present disclosure relates to a server, a client terminal, a system, and a program.
  • PTL 1 a digital camera capable of acquiring a past or future image of a specific target image is proposed. Specifically, when a user has specified a past date, the digital camera described in the following PTL 1 uploads the specified date, position information of the digital camera, and the like to a server and acquires a corresponding past image from the server. The digital camera displays the acquired past image when a shutter button is pressed.
  • the digital camera described in the above-described PTL 1 displays a past/future image of a currently viewed landscape, thereby enabling the user to experience virtual time travel.
  • a display can be performed by approaching a remote landscape according to a telescopic function, but there is a limit in a zoom factor.
  • it is difficult to display optically invisible landscapes such as landscapes of an opposite side of a subject.
  • remote landscapes can be sequentially displayed infinitely according to a zoom operation, the user can experience virtual world travel.
  • the disclosure is directed to an information processing system comprising: one or more processing units that acquire position information corresponding to a position of an information processing apparatus; acquire orientation information corresponding to an orientation of the information processing apparatus; obtain image data based on the position information and orientation information; and outputs the obtained image data.
  • the information processing apparatus may be one of a video camera, a smart phone, a personal digital assistant, a personal computer, a portable phone, a portable music player, a portable video processing device, a portable gaming device, a telescope and binoculars.
  • the one or more processing units may obtain the image data by searching a database that includes image data associated with position information and direction information
  • the one or more processing units may recognize a position in the vicinity of an axis extending from the position of the information processing apparatus in a direction determined based on the orientation information, and obtain the image data by searching a database that includes image data associated with position information and identifying image data that matches the recognized position.
  • the disclosure is directed to a method performed by an information processing system, the method comprising: acquiring position information corresponding to a position of an information processing apparatus; acquiring orientation information corresponding to an orientation of the information processing apparatus; obtaining, by one or more processing units of the information processing system, image data based on the position information and orientation information; and outputting the obtained image data.
  • the disclosure is directed to a non-transitory computer-readable medium including computer program instructions, which when executed by an information processing system, causes the information processing system to perform a process including: acquiring position information corresponding to a position of an information processing apparatus; acquiring orientation information corresponding to an orientation of the information processing apparatus; obtaining image data based on the position information and orientation information; and outputting the obtained image data.
  • Fig. 1 is a diagram illustrating an outline of an infinite zoom system in accordance with an embodiment of the present disclosure.
  • Fig. 2 is a block diagram illustrating a configuration of a server in accordance with an embodiment of the present disclosure.
  • Fig. 3 is a diagram illustrating an example of data stored in an image database (DB).
  • Fig. 4 is a diagram illustrating a search of image data corresponding to a position and direction of a digital camera.
  • Fig. 5 is a block diagram illustrating a configuration of a digital camera in accordance with an embodiment of the present disclosure.
  • Fig. 6 is a sequence diagram illustrating a display control process in accordance with this embodiment.
  • Fig. 7 is a screen transition diagram illustrating an example of display screen switching in accordance with this embodiment.
  • Fig. 8 is a diagram illustrating an example of screen transition in accordance with this embodiment.
  • Fig. 9 is a diagram illustrating an example in which a photographer of image data is designated by text.
  • the infinite zoom system in accordance with the embodiment of the present disclosure has a server 1 and a digital camera 2 (a client terminal).
  • the server 1 and the digital camera 2 are connectable via a network 3.
  • image data to which position information indicating a position in a direction in which the client terminal is directed is added is displayed in order from a position closer to the client terminal according to the zoom operation.
  • the digital camera 2 in accordance with this embodiment images a landscape at hand
  • an image obtained by imaging a subject is displayed on the display unit 31.
  • the image of the subject is gradually enlarged according to the telescopic function.
  • the digital camera 2 transmits position information and direction information (for example, an imaging direction) of the digital camera 2 to the server 1, and receives remote image data in the imaging direction searched by the server 1.
  • the digital camera 2 displays remote image data of the imaging direction received from the server 1 on the display unit 31.
  • an image I1 of Tokyo of a present point and remote image data in the west direction for example, an image I3 of Seoul and an image I5 of Roma, are sequentially displayed according to the zoom operation.
  • the forward zoom operation zoom-in operation
  • an image of a back view of the user acquired from a video of a surrounding monitoring camera or the like may be finally displayed after the circulation around the earth.
  • the client terminal in accordance with this embodiment is not limited thereto, and may be, for example, a video camera, a smart phone with a camera, a personal digital assistant (PDA), a personal computer (PC), a portable phone, a portable music player apparatus, a portable video processing apparatus, a portable game device, a telescope, or binoculars, or the like.
  • the client terminal in accordance with this embodiment is not limited to an apparatus with the camera.
  • any apparatus capable of acquiring position information and/or direction information of the apparatus such as an apparatus with a global positioning system (GPS) or a direction sensor can be applied.
  • GPS global positioning system
  • any apparatus capable of manually inputting position information and/or direction information of the apparatus can be applied even when there is no GPS or direction sensor.
  • Server Fig. 2 is a block diagram illustrating a configuration of the server 1 in accordance with an embodiment of the present disclosure. As illustrated in Fig. 2, the server 1 has a central processing unit (CPU) 10, a read only memory (ROM) 11, a random access memory (RAM) 12, an image database (DB) 13, a search unit 14, and a network interface (I/F) 15.
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • DB image database
  • search unit 14 a network interface
  • the image DB 13 stores image data in association with information such as position information (for example, longitude/latitude and the like indicating an imaging point) and direction information (for example, an imaging direction).
  • position information for example, longitude/latitude and the like indicating an imaging point
  • direction information for example, an imaging direction
  • the image DB 13 in accordance with this embodiment stores the image data in a state in which the image data is associated with position information P, direction information D, and image data I (in a state in which the position information P and the direction information D are added to the image data I).
  • image data I1-2 captured in a different direction D1-2 from the same position P1, and the like are stored.
  • Information on the altitude of the imaging point, an imaging date, an imaging time band, weather during imaging, and the like may be associated with the image data I.
  • the image DB 13 may store thumbnail images for the image data I.
  • the search unit 14 searches for image data from among image data stored in the image DB 13 based on position information and direction information of the digital camera 2 received from the digital camera 2.
  • a specific search method by the search unit 14 will be described with reference to Fig. 4.
  • Fig. 4 is a diagram illustrating a search of image data corresponding to a position A and a direction B of the digital camera 2.
  • the search unit 14 recognizes a position in the vicinity of an axis M extending in the direction B indicated by the direction information of the digital camera 2 from the position A indicated by the position information of the digital camera 2.
  • the search unit 14 recognizes positions P1, P4, P5, and P8 within a range of a predetermined angle C from the axis M as positions in the vicinity of the axis M.
  • the search unit 14 searches the image DB 13 for image data to which position information indicating a position in the vicinity of the axis M is added and direction information indicating a direction substantially the same as the direction B of the digital camera 2 are added.
  • the search unit 14 in accordance with this embodiment as described above performs a search while also considering direction information added to the image data, thereby giving the user a sense of a virtual infinite zoom in which a zoom continues in a direction toward the digital camera 2 more realistically.
  • the search unit 14 may search for image data of a situation closer to a current situation in which the user captures an image based on the information.
  • the search unit 14 can provide the user with a sense that the user travels around the world in real time by searching for image data in consideration of a time difference, a difference in weather, and the like.
  • the network I/F 15 is a communication module for transmitting/receiving data to/from the digital camera 2 over the network 3.
  • the network I/F 15 in accordance with this embodiment receives position information and direction information or transmits one or more image data searched by the search unit 14.
  • the ROM 11 stores a software program or the like for searching for image data using the above-described search unit 14 or transmitting the searched image data to the digital camera 2 through the network I/F 15.
  • the CPU 10 executes a process using the RAM 12 as a work area according to the above-described software program stored in the ROM 11.
  • Fig. 5 is a block diagram illustrating the configuration of the digital camera 2 in accordance with this embodiment.
  • the digital camera 2 has a CPU 20, a ROM 21, a RAM 22, a direction sensor 23, a GPS positioning unit 24, a camera module 25, an operation detection unit 26, a captured image memory 33, a display control unit 30, a display unit 31, and a network I/F 32.
  • a CPU 20 a central processing unit 20
  • ROM 21 a read-only memory 22
  • RAM 22 a random access memory 22
  • direction sensor 23 a sensor for detecting the digital camera 2
  • GPS positioning unit 24 a GPS positioning unit 24
  • a camera module 25 a camera module 25
  • an operation detection unit 26 a captured image memory 33
  • a display control unit 30 a display unit 31
  • a network I/F 32 a network I/F 32.
  • the ROM 21 stores a program for transmitting position information and direction information to the server 1, acquiring image data searched from the server 1 based on the position information and the direction information, and displaying/recording the acquired image data in addition to a program for performing an imaging function.
  • the CPU 20 executes the program stored in the ROM 21 using the RAM 22 as the work area.
  • the direction sensor 23 senses a direction of an optical axis of a lens optical system of the camera module 25, that is, an imaging direction, and outputs information (direction information) on the sensed imaging direction.
  • the digital camera 2 having the camera module 25 as an example of the client terminal is included here, the client terminal in accordance with this embodiment is not limited to an apparatus with a camera as described above.
  • the direction sensor 23 may output a direction in which a specific portion of the client terminal is directed as direction information.
  • the GPS positioning unit 24 receives radio waves from a GPS satellite, senses a position at which the digital camera 2 is located, and outputs information on the sensed position.
  • the GPS positioning unit 24 is an example of a position information acquisition unit that senses the position of the digital camera 2 based on a signal acquired from an outside.
  • the position information acquisition unit may sense a position, for example, using wireless fidelity (Wi-Fi) communication, transmission/reception to/from a portable phone, a personal handy-phone system (PHS), or a smart phone, or near distance communication, or the like.
  • Wi-Fi wireless fidelity
  • PHS personal handy-phone system
  • the camera module 25 includes an imaging element, an imaging optical system including an imaging lens, and a captured image signal processing unit, and outputs data of a captured image of a digital signal.
  • the imaging element is implemented, for example, by a charge coupled device (CCD) imager or a complementary metal oxide semiconductor (CMOS) imager.
  • CCD charge coupled device
  • CMOS complementary metal oxide semiconductor
  • the operation detection unit 26 is a touch panel 29 or the like that detects an operation on a physical key group of a button, a switch, a dial, and the like or a key group displayed on the display unit 31 for detecting various operations by a user.
  • the CPU 20 executes a process corresponding to the user's operation detected by the operation detection unit 26 according to the program of the ROM 21.
  • a zoom dial 27, a shutter button 28, and the like are included as a key group for operating the camera.
  • the detection of the zoom operation in accordance with this embodiment is not limited to the zoom dial 27 illustrated in Fig. 5.
  • an operation detection unit by other physical structures such as a zoom switch, a button, and the like may perform the detection.
  • a zoom operation screen is displayed on the display unit 31 and an operation on the zoom operation screen may be detected by the touch panel 29.
  • the display control unit 30 controls a display of display content of a display screen displayed on the display unit 31 according to control by the CPU 20 based on the program of the ROM 21.
  • the display control unit 30 controls the display unit 31 provided in the digital camera 2 in the examples illustrated in Figs. 1 and 5, the display control unit 30 in accordance with this embodiment is not limited thereto, and may control a display in a connected external display apparatus.
  • the display control unit 30 in accordance with this embodiment controls searched remote image data to be sequentially displayed according to a zoom operation. This display control will be described in detail in ⁇ 3. Display Control>.
  • the display unit 31 displays an image of a subject output from the camera memory 25 in real time in addition to a menu screen, various operation screens, and the like, or displays a captured image stored in the captured image memory 33.
  • the display unit 31 is implemented, for example, by a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
  • the display unit 31 in accordance with this embodiment displays remote image data received from the server 1.
  • the network I/F 32 is a communication module for performing data transmission/reception to/from the server 1 over the network 3.
  • the network I/F 32 in accordance with this embodiment transmits position information output from the GPS positioning unit 24 and direction information output from the direction sensor 23 or receives searched image data.
  • the captured image memory 33 for example, a flash memory such as a card memory is used.
  • the captured image memory 33 may be a recording medium such as a digital versatile disc (DVD).
  • the captured image memory 33 may be a hard disk apparatus instead of such a removable memory medium.
  • the captured image memory 33 may store an image of a subject continuously output from the camera module 25 as a captured image according to a timing of a shutter operation detected by the shutter button 28.
  • the captured image memory 33 may record position information output from the GPS positioning unit 24, direction information output from the direction sensor 23, and the like together as meta-information.
  • the captured image memory 33 in accordance with this embodiment may store the displayed image data as a captured image according to a timing at which the shutter button 28 has been operated. Thereby, the user can cause a landscape viewed in a virtual world travel destination (image data displayed on the display unit 31) to be stored in the captured image memory 33 at a desired timing.
  • Fig. 6 is a sequence diagram illustrating a display control process in accordance with this embodiment. As illustrated in Fig. 6, first, in step S103, the digital camera 2 detects direction information using the direction sensor 23 and detects position information using the GPS positioning unit 24.
  • step S106 the digital camera 2 transmits the position information and the direction information to the server 1.
  • step S109 the search unit 14 of the server 1 searches for image data to which position information in the vicinity of a direction in which the digital camera 2 is directed is added based on the position information and the direction information received from the digital camera 2.
  • step S112 the server 1 transmits one or more thumbnail images of searched image data to the digital camera 2.
  • the transmitted thumbnail images are temporarily stored (cached) in the digital camera 2.
  • the digital camera 2 can recognize a position in which there is image data by pre-transmitting the thumbnail images.
  • step S115 if the operation detection unit 26 of the digital camera 2 detects a zoom operation in step S115, the digital camera 2 requests an image data acquisition to the server 1 according to the zoom operation in the subsequent step S118.
  • the digital camera 2 when a zoom-in operation has been performed, the digital camera 2 requests the image data acquisition to the server 1 in order from original data (image data) of a thumbnail image to which position information indicating a position closer to the digital camera 2 is added among one or more thumbnail images transmitted from the server 1.
  • the digital camera 2 requests the image data acquisition to the server 1 in order from original data (image data) of a thumbnail image to which position information indicating a position closer to the digital camera 2 than a position indicated by position information of currently displayed image data is added.
  • the digital camera 2 may provide notification indicating that there is no image data by performing an alarm display to the user and provide the user with notification indicating that there is no image data in advance.
  • step S121 the server 1 transmits image data in response to the acquisition request from the digital camera 2.
  • the server 1 may perform transmission in order from image data to which position information indicating a position closer to the digital camera 2 is added among the image data searched in the above-described step S109 according to the acquisition request by the digital camera 2.
  • step S124 the digital camera 2 controls switching of an image (display target image) displayed on the display unit 31 to image data received in the above-described step S121.
  • the switching control by the display control unit 30 will be described below.
  • the display control unit 30 may perform switching control with a transition effect that switching of a screen is smoothly viewed.
  • a transition effect that switching of a screen is smoothly viewed.
  • Fig. 7 is a screen transition diagram illustrating an example of display screen switching.
  • a captured image 45 output from the camera module 25 is displayed in real time.
  • the display control unit 30 may also display a map indicator 42, which works with a zoom operation.
  • the map indicator 42 includes a map and a present location indication 43 indicating a present location.
  • the display control unit 30 switches a display screen by performing fade-out/fade-in while enlarging a captured image 45 and image data 47 (which may be a thumbnail image) as illustrated in a display screen 31-2.
  • the display control unit 30 may control a map and a zoom position indication 44 included in the map indicator 42 to work with the zoom operation, and display a point to which a zoom is made from the present location.
  • image data 47 of a landscape optically invisible from the present point is displayed according to the zoom operation as illustrated in a display screen 31-3, the user can perform the zoom operation in a sense that the user actually approaches a distant point.
  • alpha value display control may be used in addition to the above-described enlargement display control or in combination with the enlargement display control.
  • the display control unit 30 may change a speed or type of transition effect according to a distance between a present point and a zoom point (a position indicated by position information added to image data of a switch target).
  • the search unit 14 may designate the image data of the inside of the building as a search target.
  • an infinite zoom in accordance with this embodiment starts from the inside of the building will be described with reference to Fig. 8.
  • Fig. 8 is a diagram illustrating an example of screen transition in the display unit 31 of the digital camera 2.
  • a captured image 45 output from the camera module 25 is first displayed in real time on a display screen 31-5.
  • a range optically visible from a present position inside the building is displayed on the display screen 31-5.
  • the camera module 25 performs normal zoom imaging. Further, the infinite zoom system in accordance with this embodiment displays image data zoomed to an optically invisible position.
  • the search unit 14 searches for image data to which position information indicating a position, which is inside the building, in the vicinity of the imaging direction of the digital camera 2 is added.
  • image data obtained by imaging the exit of the building from an inside as on a display screen 31-6 is searched and displayed.
  • image data of an outside of the building is displayed as illustrated on a display screen 31-7. From here, images of external appearances of the building are sequentially displayed according to the zoom operation as illustrated in Figs. 1 and 7 described above.
  • the display control unit 30 may filter and then display the image data in consideration of the classification information. For example, the display control unit 30 can sequentially display only image data of a famous spot based on the classification information according to the zoom operation.
  • the display control unit 30 may perform display control so that it can be visually discriminated whether the displayed image data has been created by a user himself/herself, another user, or a community the user has joined based on the creator information.
  • a visible discrimination method for example, may be performed by a text display, an illustration display of a person, a face photo display, a frame display (discrimination by color), or the like.
  • a text display an illustration display of a person
  • a face photo display a face photo display
  • a frame display discrimination by color
  • Fig. 9 is a diagram illustrating an example in which a photographer of image data is designated by text. As illustrated in Fig. 9, text 52 indicating as "Photo; USER” is displayed when image data 50 is an image captured by the user himself/herself, and text 56 indicating as "Photo; ANOTHER” is displayed when image data 54 is an image captured by another person.
  • the infinite zoom system in accordance with this embodiment can provide experience as if the user travels around the world by sequentially displaying remote images optically invisible in a direction in which a client terminal is directed according to a zoom operation.
  • a process in accordance with this embodiment is not limited thereto.
  • image data itself searched by the server 1 may be transmitted.
  • the digital camera 2 can display image data temporarily stored in a cache of the digital camera 2 on the display unit 31 without having to perform processes of steps S118 and S121.
  • steps S106 and S109 are performed before step S115 in the process illustrated in Fig. 6, a sequence of the process in accordance with this embodiment is not limited thereto. For example, after step S115, a process of steps S106, S118, S109, and S121 may continue.
  • image data searched by the search unit 14 of the above-described server 1 is not limited to a still image, and may be, for example, a moving image.
  • the digital camera 2 in accordance with this embodiment may also capture and record a moving image in addition to a still image.
  • a scale factor calculated based on a position (zoom position) indicated by position information to be added to image data to be displayed may be displayed as a zoom factor display.
  • an acquisition destination of image data in accordance with this embodiment is not limited to a specific server.
  • the acquisition destination of the image data may be, for example, an unspecified number of servers or PCs on the Internet having functions of the image DB 13 and the search unit 14.
  • the configuration of the client terminal in accordance with this embodiment is not limited to the example illustrated in Fig. 5.
  • the client terminal in accordance with this embodiment may further have the image DB and the search unit.
  • the client terminal can search for image data from a local image DB.
  • the infinite zoom system in accordance with this embodiment is not limited thereto.
  • an image of a galaxy may be displayed if images of the sky, moon, sun, and the like are sequentially displayed according to the zoom operation and the zoom operation continues in an upward direction.
  • images in the ground (or the sea), images of the mantle, and images of an opposite side of the earth through the mantle may be sequentially displayed according to the zoom operation.
  • An information processing system comprising: one or more processing units that acquire position information corresponding to a position of an information processing apparatus; acquire orientation information corresponding to an orientation of the information processing apparatus; obtain image data based on the position information and orientation information; and outputs the obtained image data.
  • the information processing apparatus is one of a video camera, a smart phone, a personal digital assistant, a personal computer, a portable phone, a portable music player, a portable video processing device, a portable gaming device, a telescope and binoculars.
  • the one or more processing units obtain the image data by searching a database that includes image data associated with position information and direction information.
  • the one or more processing units recognize a position in the vicinity of an axis extending from the position of the information processing apparatus in a direction determined based on the orientation information.
  • a database including image data associated with position information, direction information, and creator information identifying a creator of the image data wherein the one or more processing units obtain the image data by searching the database for image data matching the acquired position and orientation information and filtering a result of the search based on the creator information.
  • the information processing system is a server.
  • the information processing apparatus includes an imaging unit that captures image data; an orientation sensor that detects the orientation of the information processing apparatus; a position determining unit that determines the position of the information processing apparatus; a first communication interface that outputs the position information corresponding to the position of the information processing apparatus and the orientation information corresponding to the orientation of the information processing apparatus; and a display that displays the obtained image data.
  • the information processing apparatus includes a user interface that receives a user input instructing a zoom in or zoom out operation of the imaging unit; and a second processing unit of the one or more processing units that controls the first communication interface to transmit a request for image data to the server based on a zoom in or zoom out operation performed by the imaging unit.
  • the information processing apparatus includes an imaging unit that captures image data; a user interface that receives a user input instructing a zoom in or zoom out operation of the imaging unit; a display; and a first processing unit of the one or more processing units that controls the display to display at least one of the captured image data and the obtained image data.
  • the first processing unit controls the display to display the captured image data and, upon receiving a user input instructing a zoom in operation of the imaging unit, controls the display to display the obtained image data.
  • a method performed by an information processing system comprising: acquiring position information corresponding to a position of an information processing apparatus; acquiring orientation information corresponding to an orientation of the information processing apparatus; obtaining, by one or more processing units of the information processing system, image data based on the position information and orientation information; and outputting the obtained image data.
  • a non-transitory computer-readable medium including computer program instructions, which when executed by an information processing system, causes the information processing system to perform a process including: acquiring position information corresponding to a position of an information processing apparatus; acquiring orientation information corresponding to an orientation of the information processing apparatus; obtaining image data based on the position information and orientation information; and outputting the obtained image data.
  • a server comprising: a reception unit configured to receive position information indicating a position of a client terminal and direction information indicating a direction in which the client terminal is directed from the client terminal; a search unit configured to search for a plurality of pieces of image data to which position information indicating a position in the vicinity of an axis extending in the direction indicated by the direction information from the position indicated by the position information and direction information that is substantially the same as the direction information are added; and a transmission unit configured to transmit the plurality of pieces of image data searched by the search unit to the client terminal.
  • a client terminal comprising: a transmission unit configured to transmit position information indicating a position of the client terminal and direction information indicating a direction in which the client terminal is directed to a server; a reception unit configured to receive a plurality of pieces of image data to which position information indicating a position in the vicinity of an axis extending in the direction indicated by the direction information from the position indicated by the position information is added from the server; and a display control unit configured to display the plurality of pieces of image data received by the reception unit.
  • the display control unit performs control so that the plurality of pieces of image data are sequentially displayed from image data to which position information indicating a position closer to the position of the client terminal indicated by the position information is added.
  • the client terminal according to any one of (28) to (33), wherein the reception unit receives a plurality of pieces of image data to which position information indicating a position in the vicinity of an axis extending in the direction indicated by the direction information from the position indicated by the position information and direction information that is substantially the same as the direction information are added from the server.
  • the display control unit controls a display so that a user of the client terminal or another user can be visually discriminated to be a creator based on the creator information of image data to be displayed.
  • a system comprising: a search unit configured to search for a plurality of pieces of image data to which position information indicating a position in the vicinity of an axis extending in a direction indicated by direction information indicating the direction in which a client terminal is directed from a position indicated by position information indicating a position of the client terminal is added; and a display control unit configured to display the plurality of pieces of image data searched by the search unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Library & Information Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
PCT/JP2013/000466 2012-02-08 2013-01-29 Server, client terminal, system, and program Ceased WO2013118460A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
KR1020147018378A KR101998903B1 (ko) 2012-02-08 2013-01-29 서버, 클라이언트 단말, 시스템 및 프로그램
EP13706752.6A EP2813067A2 (en) 2012-02-08 2013-01-29 Server, client terminal, system, and program
CN201380007622.0A CN104255022B (zh) 2012-02-08 2013-01-29 为相机添加虚拟变焦能力的服务器、客户终端、系统和可读介质
US14/370,139 US9635234B2 (en) 2012-02-08 2013-01-29 Server, client terminal, system, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012-024772 2012-02-08
JP2012024772A JP2013161390A (ja) 2012-02-08 2012-02-08 サーバ、クライアント端末、システム、およびプログラム

Publications (2)

Publication Number Publication Date
WO2013118460A2 true WO2013118460A2 (en) 2013-08-15
WO2013118460A3 WO2013118460A3 (en) 2013-10-03

Family

ID=47754924

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/000466 Ceased WO2013118460A2 (en) 2012-02-08 2013-01-29 Server, client terminal, system, and program

Country Status (6)

Country Link
US (1) US9635234B2 (enExample)
EP (1) EP2813067A2 (enExample)
JP (1) JP2013161390A (enExample)
KR (1) KR101998903B1 (enExample)
CN (1) CN104255022B (enExample)
WO (1) WO2013118460A2 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3422212A4 (en) * 2016-02-26 2019-09-11 Nec Corporation IMAGE DISPLAY SYSTEM, TERMINAL, METHOD AND PROGRAM

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014156257A1 (ja) 2013-03-29 2014-10-02 ソニー株式会社 表示制御装置、表示制御方法および記録媒体
US9332285B1 (en) 2014-05-28 2016-05-03 Lucasfilm Entertainment Company Ltd. Switching modes of a media content item
US9591349B2 (en) * 2014-12-23 2017-03-07 Intel Corporation Interactive binocular video display
CN107238920B (zh) * 2017-05-04 2020-04-14 深圳市元征科技股份有限公司 一种基于望远镜设备的控制方法及装置
WO2020044646A1 (ja) * 2018-08-30 2020-03-05 日本電気株式会社 画像処理装置、画像処理方法及びプログラム
AU2021246501A1 (en) * 2020-04-02 2022-10-06 Dawn Ella Pierne Acoustic and visual energy configuration systems and methods

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006260338A (ja) 2005-03-18 2006-09-28 Sony Corp タイムシフト画像配信システム、タイムシフト画像配信方法、タイムシフト画像要求装置および画像サーバ

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09200666A (ja) 1996-01-11 1997-07-31 Nippon Telegr & Teleph Corp <Ntt> 記録位置付き画像生成表示方法および装置
JP2000050123A (ja) * 1998-07-27 2000-02-18 Sony Corp 撮像装置、ナビゲーション装置、ｉｃカード及び静止画像の表示方法
JP2003256803A (ja) * 2002-03-04 2003-09-12 Fuji Photo Film Co Ltd 画像管理方法および装置並びにプログラム
JP2003323440A (ja) * 2002-04-30 2003-11-14 Japan Research Institute Ltd 携帯端末を用いた撮影画像の情報提供システム、撮影画像の情報提供方法、およびその方法をコンピュータに実行させるプログラム
US7872669B2 (en) * 2004-01-22 2011-01-18 Massachusetts Institute Of Technology Photo-based mobile deixis system and related techniques
JP4363642B2 (ja) * 2004-07-02 2009-11-11 富士フイルム株式会社 地図表示システム及びデジタルカメラ
JP5184217B2 (ja) * 2007-05-31 2013-04-17 パナソニック株式会社 画像撮影装置、付加情報提供サーバ及び付加情報フィルタリングシステム
JP4697210B2 (ja) * 2007-10-02 2011-06-08 ソニー株式会社 地図表示装置及び地図表示方法
JP5034880B2 (ja) * 2007-11-09 2012-09-26 株式会社ニコン 電子カメラ、画像表示装置
US20090193021A1 (en) * 2008-01-29 2009-07-30 Gupta Vikram M Camera system and method for picture sharing based on camera perspective
JP5088216B2 (ja) * 2008-04-16 2012-12-05 株式会社ニコン 電子カメラ
JP5024181B2 (ja) * 2008-05-21 2012-09-12 カシオ計算機株式会社 撮像装置、及び画像表示方法、画像表示プログラム
JP2010129032A (ja) * 2008-12-01 2010-06-10 Nippon Telegr & Teleph Corp <Ntt> 画像検索装置および画像検索プログラム
US8274571B2 (en) * 2009-05-21 2012-09-25 Google Inc. Image zooming using pre-existing imaging information
JP2011244058A (ja) * 2010-05-14 2011-12-01 Sony Corp 情報処理装置、情報処理システム、及びプログラム
US8659667B2 (en) * 2011-08-29 2014-02-25 Panasonic Corporation Recipe based real-time assistance for digital image capture and other consumer electronics devices

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006260338A (ja) 2005-03-18 2006-09-28 Sony Corp タイムシフト画像配信システム、タイムシフト画像配信方法、タイムシフト画像要求装置および画像サーバ

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3422212A4 (en) * 2016-02-26 2019-09-11 Nec Corporation IMAGE DISPLAY SYSTEM, TERMINAL, METHOD AND PROGRAM
US10922838B2 (en) 2016-02-26 2021-02-16 Nec Corporation Image display system, terminal, method, and program for displaying image associated with position and orientation

Also Published As

Publication number Publication date
US9635234B2 (en) 2017-04-25
KR101998903B1 (ko) 2019-07-10
US20140340535A1 (en) 2014-11-20
EP2813067A2 (en) 2014-12-17
WO2013118460A3 (en) 2013-10-03
KR20140130663A (ko) 2014-11-11
CN104255022B (zh) 2018-06-19
CN104255022A (zh) 2014-12-31
JP2013161390A (ja) 2013-08-19

Similar Documents

Publication Publication Date Title
US9721392B2 (en) Server, client terminal, system, and program for presenting landscapes
KR101977703B1 (ko) 단말의 촬영 제어 방법 및 그 단말
JP5891843B2 (ja) クライアント端末、サーバ、およびプログラム
CN103369234B (zh) 服务器、客户终端和系统
JP5194650B2 (ja) 電子カメラ
US9635234B2 (en) Server, client terminal, system, and program
JP6231387B2 (ja) サーバ、クライアント端末、システム、および記録媒体
US20090278949A1 (en) Camera system and method for providing information on subjects displayed in a camera viewfinder
CN103312958A (zh) 客户机终端、服务器以及程序
JP5007631B2 (ja) 電子カメラ
JP2013021473A (ja) 情報処理装置、情報取得方法およびコンピュータプログラム
JP2008252930A (ja) 電子カメラおよび画像表示装置および画像表示方法
JP5387723B2 (ja) 画像表示装置、及び画像表示方法、画像表示プログラム
JP2010134881A (ja) 撮影画像表示システムおよび撮影画像表示方法
JP2012227717A (ja) 表示装置、表示プログラムおよび表示方法
JP2011041167A (ja) 撮像装置及び位置情報付加装置
JP2014230198A (ja) デジタルカメラ
JP2012094955A (ja) カメラ

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13706752

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 14370139

Country of ref document: US

ENP Entry into the national phase

Ref document number: 20147018378

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2013706752

Country of ref document: EP