JP6394729B2 - Information processing apparatus, music data extraction method in information processing apparatus, program, and information processing system - Google Patents

Description

  The present invention relates to an information processing apparatus in which image data and music data are stored in a storage unit, a music data extraction method in the information processing apparatus, a program, and an information processing system.

  As represented by a communication device generally called a smartphone, some information processing devices in recent years have a function of capturing a subject and acquiring image data and a function of reproducing music data. ing. Some recent information processing apparatuses are equipped with a GPS (Global Positioning System) module that acquires current position specifying data for specifying the current position of the information processing apparatus. .

  In such an information processing apparatus having an image data acquisition function, a music data playback function, and a current position specifying data acquisition function, the current position specifying data at the time of music data playback and an image captured on the same day as the music data playback date A technique is disclosed in which data is stored in association with music data, and the music data associated with the image data is played back when the image data is played back (see Patent Document 1). Similarly, in an information processing apparatus having an image data acquisition function, a music data playback function, and a current position specifying data acquisition function, image data is stored in association with imaging date / time information and imaging point information, and music data is played back with a frequency of playback. Information and reproduction date / time information are stored in association with each other, image data having imaging point information within a predetermined distance from the current position specifying data is presented, and the image data is reproduced most frequently within a predetermined time range from the imaging date / time information. A technique for presenting music data is disclosed (see Patent Document 2).

JP 2008-279929 A JP 2008-39573 A

  By displaying the image data at the position where the image data was captured, it is possible to remind the user who actually performed the imaging operation of memories related to the imaging position. Similarly, the music data is reproduced at the position where the music data is reproduced, so that the user who has performed the reproduction operation in the past can recall the memories related to the reproduction position. As described above, by displaying and reproducing the image data and the music data in association with a specific position and point as an index, it is possible to effectively remind the user of unique memories.

  The present invention has been made in view of the above-described problems, and is an information processing apparatus that can extract music data that can effectively remind a user of memories associated with image data, and music in the information processing apparatus. One of the purposes is to provide a data extraction method, a program, and an information processing system.

  The present invention is applied to an information processing apparatus having a storage unit in which image data associated with position specifying data at the time of acquisition and music data are stored. Then, the position specifying data acquisition unit for acquiring the current position specifying data of the position where the information processing device is located, and the current position specifying data acquired by the position specifying data acquisition unit when the music data is reproduced in the information processing device A music route table creating unit that creates a music route table in which a route is associated with the music data and stores the music route table in the storage unit, and the music route table based on the position specifying data associated with the image data. An extraction unit that extracts music data associated with the route of the current position specifying data within a predetermined range centered on and a reproduction control unit that reproduces the music data extracted by the extraction unit in association with image data is provided Thus, at least one of the above-mentioned problems is solved.

  The music route table creating unit creates a music route table that associates the route of the current position specifying data acquired by the position specifying data acquisition unit with the music data when the music data is reproduced in the information processing apparatus, and stores the music route table. To store. Then, the music data associated with the path of the current position specifying data within the predetermined range centered on the position specifying data is referred to based on the extracting unit and the position specifying data associated with the image data. To extract. As a result, it is possible to extract music data associated with the path of the current position specifying data within the predetermined range centered on the position specifying data, using the position specifying data associated with the image data as an index.

  Here, based on the position specifying data associated with the image data, the information processing apparatus acquires representative point position specifying data related to the representative point located within a predetermined range centered on the position specifying data. A data acquisition unit is provided, and the extraction unit refers to the music route table based on the representative point position specifying data and is associated with the route of the current position specifying data within a predetermined range centered on the representative point position specifying data. It is preferable to extract music data.

  Further, the music route table creation unit stores, in the music route table, the number-of-times data relating to the number of times the music data is reproduced in the path of the current position specifying data for each path of the current position specifying data. When there are multiple pieces of music data associated with the route of the current position specifying data within a predetermined range centered on the position specifying data, the music data is extracted based on the frequency data relating to the music data stored in the music route table. It is preferable to do.

  Further, when there are a plurality of music data associated with the route of the current position specifying data within a predetermined range centered on the position specifying data, the extracting unit specifies the current position related to the position specifying data and the music data. It is preferable to extract music data based on the distance to the data path.

  Then, the music route table creation unit sets the current position specifying data acquired by the position specifying data acquisition unit when the music data is started to be played back in the information processing apparatus as the start point of the path of the current position specifying data. The current position specifying data acquired by the position specifying data acquisition unit when reproduction is finished in the processing device is set as the end point of the path of the current position specifying data, and the current position specifying data of the start point and the end point is used as the path of the current position specifying data. Is preferably stored in the music route table.

  Further, the present invention is applied to a music data extraction method in an information processing apparatus having a storage unit that stores image data associated with position specifying data at the time of acquisition and music data. Then, a step of acquiring current position specifying data at a position where the information processing device is located and a music route table in which a route of the current position specifying data when the music data is reproduced in the information processing device are associated with the music data are created. And storing it in the storage unit, referring to the music route table based on the position specifying data associated with the image data, and associating with the route of the current position specifying data within a predetermined range centered on the position specifying data At least one of the above-mentioned problems is solved by providing a step of extracting the extracted music data and a step of reproducing the extracted music data in association with the image data.

Furthermore, the present invention is applied to a program executed by a computer having a storage unit in which image data associated with position specifying data at the time of acquisition and music data are stored. When this program is executed by a computer, a step of acquiring current position specifying data at a position where the information processing apparatus is located and a path of the current position specifying data when the music data is reproduced in the information processing apparatus are obtained. A step of creating a music route table associated with the music data and storing it in the storage unit, and referring to the music route table based on the position specifying data associated with the image data, and a predetermined range centered on the position specifying data At least one of the above-mentioned problems by executing a step of extracting music data associated with a path of current location specifying data within and a step of reproducing the extracted music data in association with image data. It has been solved.
Furthermore, the present invention is configured to be communicable with an information processing apparatus having a first storage unit that stores image data associated with position specifying data at the time of acquisition, and stores music data. The present invention is applied to an information processing system having a server device having a second storage unit. Then, the information processing apparatus is provided with a position specifying data acquisition unit that acquires current position specifying data of the position where the information processing apparatus is located, and the position specifying data is obtained when the music data is reproduced in the information processing apparatus. A music route table creating unit that creates a music route table that associates the route of the current position specifying data acquired by the acquiring unit with the music data and stores the music route table in the second storage unit; and a position specifying data that is associated with the image data Based on the music route table, the extraction unit extracts the music data associated with the route of the current position specifying data within the predetermined range centered on the position specifying data, and the music data extracted by the extracting unit By providing a playback control unit that plays back in the information processing apparatus in association with image data, at least one of the above-described problems Solution to that.

  According to the present invention, the music route table creation unit associates the route of the current position specifying data acquired by the position specifying data acquisition unit with the music data when the music data is reproduced in the information processing apparatus. Is created and stored in the storage unit. Then, the music data associated with the path of the current position specifying data within the predetermined range centered on the position specifying data is referred to based on the extracting unit and the position specifying data associated with the image data. To extract. This makes it possible to extract music data associated with the path of the current position specifying data within a predetermined range centered on the position specifying data, using the position specifying data associated with the image data as an index. On the other hand, it is possible to provide an information processing apparatus, a music data extraction method in the information processing apparatus, a program, and an information processing system that can extract music data that can effectively recall memories associated with image data.

It is a block diagram which shows schematic structure of the information processing apparatus which is 1st Embodiment of this invention. It is a functional block diagram which shows the function structure of the information processing apparatus of 1st Embodiment. It is a figure which shows the data structure of the image file stored in the memory | storage part of the information processing apparatus of 1st Embodiment. It is a figure which shows the data structure of the music file stored in the memory | storage part of the information processing apparatus of 1st Embodiment. It is a figure which shows the table structure of the music route table stored in the memory | storage part of the information processing apparatus of 1st Embodiment. It is a figure for demonstrating an example of the music file extraction method in the information processing apparatus of 1st Embodiment. It is a figure for demonstrating the other example of the extraction method of the music file in the information processing apparatus of 1st Embodiment. It is a figure for demonstrating the other example of the extraction method of the music file in the information processing apparatus of 1st Embodiment. It is a figure for demonstrating the other example of the extraction method of the music file in the information processing apparatus of 1st Embodiment. It is a flowchart for demonstrating an example of operation | movement of the information processing apparatus of 1st Embodiment. It is a flowchart for demonstrating the other example of operation | movement of the information processing apparatus of 1st Embodiment. It is a flowchart for demonstrating another example of operation | movement of the information processing apparatus of 1st Embodiment. It is a flowchart for demonstrating an example of operation | movement of the information processing apparatus which is 2nd Embodiment of this invention. It is a block diagram which shows schematic structure of the information processing system which is 3rd Embodiment of this invention. It is a functional block diagram which shows the function structure of the information processing system of 3rd Embodiment.

Hereinafter, an embodiment of an information processing apparatus of the present invention will be described with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram showing a schematic configuration of an information processing apparatus 1 according to the first embodiment of the present invention. 1, the information processing apparatus 1 includes a CPU (Central Processing Unit) 10, a ROM (Read Only Memory) 11, a RAM (Random Access Memory) 12, a liquid crystal driver 130, a liquid crystal panel 131, a module driver 140, a camera module 141, Mobile communication module 150, audio interface (I / F) 151, microphone 152, speaker 153, antenna 154, input interface (I / F) 160, touch panel 161, internal storage unit 17, GPS module 180, GPS antenna 181, USB (Universal Serial Bus) controller 190 and USB connector 191, CPU 10, ROM 11, RAM 12, liquid crystal driver 130, wireless LAN module 140, mobile communication module 150, input interface 160, internal interface The storage unit 17, the GPS module 180, and the USB controller 190 are connected by a common bus.

  The CPU 10 executes a program such as firmware stored in the ROM 11 after being expanded in the RAM 12, thereby controlling the operation of the entire information processing apparatus 1 and performing the functions shown in the functional units shown in FIG. Run. Each functional unit shown in FIG. 2 will be described later. Further, the CPU 10 includes an internal clock (not shown). The ROM 11 stores programs such as the above-described firmware and various setting data. The RAM 12 operates as a work memory of the information processing apparatus 1 and temporarily stores various programs and data.

  The liquid crystal panel 131 is provided with its display surface exposed on the surface of the information processing apparatus 1. When the data constituting the display screen is supplied from the CPU 10 to the liquid crystal driver 130, the liquid crystal driver 130 drives the liquid crystal panel 131 to display a desired display screen on the display surface of the liquid crystal panel 131.

  The camera module 141 can image a subject existing outside the information processing apparatus 1, and includes an imaging element and an imaging unit such as a lens for imaging the subject on the imaging element. Preferably, the imaging unit includes a driving unit that drives an imaging element such as a lens. The module driver 140 controls the operation of the image sensor and the imaging unit of the camera module 141. Further, the module driver 140 receives an output signal from the camera module 141, and generates and outputs image data obtained by capturing an image of the subject based on the output signal.

  The mobile communication module 150 performs mobile radio communication with the mobile communication network 4 (see FIG. 14) via the antenna 154 in accordance with, for example, the IMT (International Mobile Telecommunication) -2000 standard. That is, the mobile communication module 150 causes the audio signal obtained by decoding the radio wave received from the base station of the mobile communication network 4 to be generated from the speaker 153 via the audio interface 151, and via the audio interface 151. The sound collected by the microphone 152 is encoded and transmitted as a radio wave to the base station of the mobile communication network 5 via the antenna 154. The mobile communication module 150 performs data communication by transmitting and receiving packetized data to and from the base station of the mobile communication network 4. The standards supported by the mobile communication module 150 include at least one of 3G / HSDPA (3rd Generation / High-Speed Downlink Packet Access), LTE (Long Term Evolution), and WiMAX (Worldwide Interoperability for Microwave Access). It can be done.

  In the present embodiment, the touch panel 161 is provided so as to be superimposed on the upper surface of the display surface of the liquid crystal panel 131 and has substantially the same size as the display surface of the liquid crystal panel 131. When the user touches the surface of the touch panel 161, that is, when a specific position on the surface of the touch panel 161 is touched by the user, the specific position on the surface of the touch panel 161 is detected as a two-dimensional coordinate position. It is output via the interface 160.

  The internal storage unit 17 includes an internal storage 171 and an internal storage interface (I / F) 170. The internal storage 171 is a nonvolatile semiconductor memory such as a flash memory, for example, and stores application programs used in the information processing apparatus 1. In particular, the internal storage 171 of the present embodiment appropriately stores an image file 40, a music file 41, and a music route table 42 associated with position specifying data at the time of acquisition, that is, at the time of imaging by the information processing apparatus 1. Details of the image file 40, the music file 41, and the music route table 42 will be described later. The internal storage interface 170 controls the entire internal storage 171 and performs read / write control of data when a data read / write command is issued to the internal storage 171 and outputs the read data. . The internal storage 171 may be a detachable nonvolatile memory card such as microSD. In this case, the internal storage interface 170 further includes a memory card slot in which the memory card is inserted.

  The GPS module 180 is based on radio waves from GPS satellites received through the GPS antenna 181, and includes latitude information, longitude information, and current position specifying data indicating the current position of the information processing apparatus 1 in accordance with a predetermined positioning procedure. Calculate altitude information. Further, the GPS module 180 acquires data for correcting the internal clock built in the CPU 10 based on the radio wave received from the GPS satellite.

  The USB controller 190 transmits / receives data (including content data) to / from a USB device connected via the USB connector 191 in accordance with the USB 2.0 or USB 3.0 standard. The USB connector 191 is a so-called female USB connector (USB receptacle), and both are configured so that a male USB connector (USB plug) of a USB cable (not shown) can be inserted.

(Functional configuration of the information processing apparatus of the first embodiment)
FIG. 2 is a functional block diagram illustrating a functional configuration of the information processing apparatus 1 according to the first embodiment. In FIG. 2, the information processing apparatus 1 according to the present embodiment includes a control unit 20, a storage unit 21, an input unit 22, and an output unit 23.

  The storage unit 21 appropriately stores an image file 40, a music file 41, and a music route table 42 associated with position specifying data at the time of imaging. Details of the image file 40, the music file 41, and the music route table 42 will be described later.

  The control unit 20 includes a file selection unit 24, a position specification data acquisition unit 25, a representative point position specification data acquisition unit 26, a music route table creation unit 27, an imaging processing unit 28, an extraction unit 29, and a playback control unit 30.

  The file selection unit 24 searches the image file 40 and the music file 41 stored in the storage unit 21 based on a list display instruction from the user input via the input unit 22. Next, the file selection unit 24 displays a list of the image file 40 and the music file 41 in the storage unit 21 via the output unit 23 and waits for selection input of at least one of the image file 40 and the music file 41 by the user. When the file selection unit 24 receives selection input of at least one of the image file 40 and the music file 41 by the user via the input unit 22, the file selection unit 24 extracts the selected image file 40 and the representative point position specifying data acquisition unit 26. The selected music file 41 is provided to the music route table creation unit 27 and the playback control unit 30.

  The position specifying data acquisition unit 25 acquires the current position specifying data of the position where the information processing apparatus 1 is located. More specifically, the position specifying data acquisition unit 25 receives from each part of the information processing apparatus 1 such as the playback start and end of playback of the music file 41 by the playback control unit 30 and the current position specifying data acquisition request from the imaging processing unit 28. Based on the instruction, latitude information, longitude information, and altitude information, which are current position specifying data of the position where the information processing apparatus 1 is located at that time, are calculated and acquired. Then, the position specifying data acquisition unit 25 provides the acquired current position specifying data of the information processing device 1 to each unit of the information processing device 1 such as the music route table creation unit 27 and the imaging processing unit 28.

  Based on the position specifying data associated with the image file 40, the representative point position specifying data acquisition unit 26 acquires the representative point position specifying data related to the representative point located within a predetermined range centered on the position specifying data. More specifically, the representative point location specifying data acquisition unit 26 receives the image file 40 provided from the file selection unit 24, extracts location specifying data associated with the image file 40, and focuses the location specifying data on the center. The representative point position specifying data relating to the representative point located within the predetermined range is acquired. Here, the representative point is a point where a building, a facility, a park, or the like called a landmark is located.

  The method for obtaining the representative point position specifying data is arbitrary. For example, a database in which the name of the representative point and the representative point position specifying data related to the representative point are associated and stored in the storage unit 21 is stored, and the representative point position specifying data is stored. The acquisition unit 26 may search the database in the storage unit 21 to acquire representative point position specifying data. Alternatively, the representative point position specifying data acquisition unit 26 accesses the database that stores the name of the representative point and the representative point position specifying data related to the representative point, which are located outside the information processing apparatus 1, via the output unit 23. Then, the database may be searched to obtain representative point position specifying data. When the representative point position specifying data acquisition unit 26 acquires a plurality of representative point position specifying data by the above-described method, the acquisition date and time of the image file 40 associated with the image file 40, in other words, the imaging date and time data and the representative point You may select the representative point position specific data regarding the representative point with near completion date. Information relating to the completion date and time of the representative point may be appropriately obtained from, for example, a change history of the map database existing outside the information processing apparatus 1 or a database relating to the representative point.

  Then, the representative point position specifying data acquisition unit 26 provides the extracting unit 29 with the representative point current position specifying data related to the acquired representative point.

  The music route table creation unit 27 associates the route of the current position specifying data acquired by the position specifying data acquisition unit 25 with the music file 41 when the music file 41 is reproduced in the information processing apparatus 1. Is stored in the storage unit 21. More specifically, the music route table creation unit 27 receives the music file 41 selected by the user from the file selection unit 24, and starts and stops the reproduction of the music file 41 from the position specifying data acquisition unit 25. The current position specifying data acquired as a trigger is received. Then, the music route table creation unit 27 uses the current position specifying data when the reproduction of the music file 41 is started as the starting point of the path of the current position specifying data, and the current position specifying data when the reproduction of the music file 41 is finished. Is used as the end point of the path of the current position specifying data, and the current position specifying data of the start point and the end point is set as the path of the current position specifying data, and the music route table 42 is created in association with the music file 41 and stored in the storage unit 21. . However, the route of the current position specifying data created by the song route table creation unit 27 is not limited to the one constituted only by the start point and the end point, and the start point at the start of playback of the song file 41 and at the end of playback. In addition to the current position specifying data related to the end point of the music file 41, the current position specifying data may be constituted by a sequence of current position specifying data at regular intervals from the start of reproduction of the music file 41.

  Further, when the music route table creation unit 27 has a function of referring to a map database existing outside the information processing apparatus 1, for example, the current position specifying data when the reproduction of the music file 41 is started and the current position when the music file 41 is ended Specific data may be provided to the map database, a route on the map having the current position specifying data as a start point and an end point may be obtained and stored in the music route table 42 as a route of the current position specifying data. In this case, since the route of the current position specifying data is likely to be a route along a road or the like, there is a high possibility that a route close to the route actually traveled by the user can be obtained.

  Further, the current position specifying data when the reproduction of the music file 41 is started due to the user getting on the subway while operating the information processing apparatus 1 or entering the building, or the current position when the music file 41 is ended. There is a possibility that the position specifying data acquisition unit 25 cannot acquire any of the specific data. In this case, the music route table creation unit 27 instructs the position specifying data acquisition unit 25 to periodically repeat the acquisition of the current position specifying data so that the position specifying data acquisition unit 25 can acquire the current position specifying data. The current position specifying data at which the current position is reached may be set as the start point or the end point of the route of the current position specifying data.

  Furthermore, when a plurality of music files 41 are continuously reproduced by the output unit 23 described later, for example, because the user gets on the subway while operating the information processing apparatus 1 or enters the building, The position specifying data acquisition unit 25 may not be able to acquire any of the current position specifying data when the reproduction of the music file 41 starts and the current position specifying data when the music file 41 ends. In this case, the music route table creation unit 27 is configured to start reproduction of one of the music files 41 that the position specifying data acquisition unit 25 can acquire among the plurality of music files 41 that are continuously reproduced. Using the current position specifying data and the current position specifying data when reproduction of any of the music files 41 that can be acquired by the position specifying data acquisition unit 25 is completed, the current position specifying data of the plurality of music files 41 is used. The starting point and the end point of the current position specifying data of the music file 41 that could not be acquired may be estimated using the reproduction time of each music file 41 and the like.

  In addition, the music route table creation unit 27 stores, in the music route table 42, the number-of-times data related to the number of times the music file 41 has been reproduced in the current position specifying data path for each path of the current position specifying data.

  The imaging processing unit 28 receives an imaging instruction input from the user input via the input unit 22, images an object outside the information processing apparatus 1 based on the imaging instruction input, and an image obtained by imaging the object An image file 40 including data is created. Further, when imaging the subject outside the information processing apparatus 1, the imaging processing unit 28 requests the position specifying data acquisition unit 25 to acquire the current position specifying data, and is sent from the position specifying data acquisition unit 25. The current position specifying data is associated with the image file 40 as position specifying data. Further, the imaging processing unit 28 requests acquisition of current time data from an internal clock (not shown) of the control unit 20 and associates the current time data sent from the internal clock with the image file 40 as imaging date / time data. The image file 40 in which the position specifying data and the imaging date / time data are associated is sent to the storage unit 21 and stored therein.

  The extraction unit 29 refers to the music route table 42 based on the position specifying data associated with the image file 40, and the music associated with the route of the current position specifying data within a predetermined range centered on the position specifying data. The file 41 is extracted. More specifically, the extraction unit 29 receives the image file 40 selected by the user by the file selection unit 24, and extracts position specifying data associated with the image file 40. Next, the extraction unit 29 searches the music route table 42 stored in the storage unit 21 based on the position specifying data extracted from the image file 40, and the current position within a predetermined range centered on the position specifying data. The route of the specific data is determined, and the music file 41 associated with the determined route is extracted. Then, the extraction unit 29 reads the extracted music file 41 from the storage unit 21 and sends it to the reproduction control unit 30.

  The extraction unit 29 refers to the music route table 42 based on the representative point position specifying data, and the music file associated with the route of the current position specifying data within a predetermined range centered on the representative point position specifying data. 41 is extracted. More specifically, the extraction unit 29 receives the representative point position specifying data provided from the representative point position specifying data acquisition unit 26, and the music route table stored in the storage unit 21 based on the representative point position specifying data. 42 is searched. Next, the extraction unit 29 determines the route of the current position specifying data within a predetermined range centered on the representative point position specifying data, and extracts the music file 41 associated with the determined route. Then, the extraction unit 29 reads the extracted music file 41 from the storage unit 21 and sends it to the reproduction control unit 30 together with the image file 40.

  Here, when there are a plurality of music files 41 associated with the route of the current position specifying data within the predetermined range centered on the position specifying data, the extracting unit 29 is in the music route table 42 in the storage unit 21. The music file 41 is extracted based on the frequency data relating to the music file 41 stored in the music route table 42. In addition, when the music route table 42 in the storage unit 21 has a plurality of music files 41 associated with the route of the current position specifying data within the predetermined range centered on the position specifying data, the extracting unit 29 The music file 41 is extracted based on the distance between the position specifying data and the path of the current position specifying data associated with the music file 41. A method of extracting the music file 41 based on the number of times data related to the music file 41 stored in the music route table 42 or the distance between the path of the current position specifying data and the position specifying data by the extracting unit 29 is arbitrary. In addition to the example described above, there is a method of converting the frequency data and distance into weighting values and extracting the music file 41 using the weighting values.

  The reproduction control unit 30 reproduces the music file 41 extracted by the extraction unit 29 in association with the image file 40. More specifically, the reproduction control unit 30 extracts and extracts the image file 40 transmitted from the file selection unit 24 via the extraction unit 29 based on the user's selection input and the image file 40 selected by the user. The music file 41 extracted and sent out by the unit 29 is received, a display screen generation signal for generating a display screen for displaying the image file 40 is generated, and a music reproduction signal for reproducing the music file 41 is generated. These display screen generation signal and music reproduction signal are sent to the output unit 23. At this time, it is preferable that the reproduction control unit 30 controls the output unit 23 so that the image file 40 and the music file 41 are simultaneously displayed and reproduced.

  Further, the reproduction control unit 30 receives the music file 41 selected by the file selection unit 24 and generates a music reproduction signal for reproducing the music file 41. This music reproduction signal is sent to the output unit 23. Then, the playback control unit 30 notifies the position specifying data acquisition unit 25 that the playback of the music file 41 has started. Further, when receiving the playback stop instruction input of the music file 41 input via the input unit 22, the playback control unit 30 stops the music playback signal generation operation of the music file 41 currently being played back, and the music file 41. Is notified to the position specifying data acquisition unit 25.

  The input unit 22 receives information from input devices in the information processing apparatus 1 including the input interface 160, the module driver 140, the mobile communication module 150, and the GPS module 180, and also from external input devices connected via the USB controller 190. The input of various data input to the processing device 1 is accepted, and the input various data is input to the control unit 20 or stored in the storage unit 21. The output unit 23 supplies the display screen generation signal described above to the liquid crystal driver 130 to generate a display screen on the display surface of the liquid crystal panel 131, and supplies the music playback signal described above to the mobile communication module 150 and the like. The music is reproduced from the speaker 153, and various data in the control unit 20 or the storage unit 21 are output to an external output device connected via the USB controller 190.

  In the above configuration, the control unit 20 and the file selection unit 24, the position specifying data acquisition unit 25, the representative point position specifying data acquisition unit 26, the music route table creation unit 27, the extraction unit 29, and the playback control unit that constitute the control unit 20 30 is mainly configured by the CPU 10, the imaging processing unit 28 is mainly configured by the CPU 10, the module driver 140 and the camera module 141, and the storage unit 21 is mainly configured by the ROM 11, the RAM 12 and the internal storage unit 17, and the input unit 22. Mainly includes a module driver 140, a camera module 141, a mobile communication module 150, an audio interface 151, a microphone 152, an antenna 154, an input interface 160, a touch panel 161, a GPS module 180, a GPS antenna 181, and a USB controller. 190 and a USB connector 191, and an output unit 23 mainly includes a liquid crystal driver 130, a liquid crystal panel 131, a mobile communication module 150, an audio interface (I / F) 151, a speaker 153, an antenna 154, a USB controller 190, and a USB connector. 191. The operation of each functional unit of the information processing apparatus 1 shown in FIG. 2 will be described in detail later.

(Data structure of image file)
FIG. 3 is a diagram illustrating an example of a data structure of the image file 40 stored in the internal storage 171 of the information processing apparatus 1 according to the present embodiment. The image file 40 according to the present embodiment has a file format defined by the Exif (Exchangeable image file format) standard, tag information is stored in the header portion 50, and a thumbnail image area 51 in which thumbnail image data is stored, and An image data area 52 in which the image data 40a is stored is provided. In the image file 40 of the present embodiment, the tag information stored in the header portion 50 is described in a predetermined area of the header portion 50 of the image file 40 by the imaging processing unit 28 of the information processing apparatus 1 at the time of subject imaging.

  In the header portion 50 of the image file 40, an ID area 53 in which a unique value for specifying the image file 40 is described, a pixel number area 54 in which the number of pixels of the image data 40a is described, and the shooting date and time of the image file 40 The shooting date / time area 55 in which the imaging date / time data is described, the model name area 56 in which the model name of the information processing apparatus 1 in which the image file 40 is captured, and the image data 40a of the image file 40 are captured. The position specifying data acquisition unit 25 acquires the position where the information processing apparatus 1 is located when various information of the information processing apparatus 1, for example, the shooting information area 57 describing the aperture value and the focal length, and the image file 40 are captured. The GPS information area 58 in which position specifying data (for example, latitude, longitude, altitude information) is described, and the user of the information processing apparatus 1 arbitrarily describes various information. User-defined area 59 is provided for. Of course, it is optional to provide a region other than this in the header portion 50 of the image file 40.

  Here, various information described in each area of the header portion 50 will be described with an example. In the shooting date and time area 55, referring to the internal clock of the information processing apparatus 1, the date and time when the image data 40a of the image file 40 is taken, that is, the shooting time data indicating the shooting date and time is, for example, “2011/12. / 08 10:15:24 ", that is, described as the date and time in seconds. In the model name area 56, the model name of the information processing apparatus 1 is data defined by the manufacturer of the information processing apparatus 1, and is described as “XYZ-O” as an example. In the shooting information area 57, various information of the information processing apparatus 1 when the image data 40a of the image file 40 is captured is described as “aperture value F = 8, shutter speed 1/125” as an example. In the GPS information area 58, the position specifying data acquired by the position specifying data acquisition unit 25 at the position where the information processing apparatus 1 is located when the image file 40 is generated, more specifically, the position where the information processing apparatus 1 is located. As an example, latitude information, longitude information, and altitude information are described as “lat = + 35.09.36.266, lon = + 136.54.21.114, alt = 50”.

(Data structure of music file)
FIG. 4 is a diagram illustrating an example of a data structure of the music file 41 stored in the internal storage 171 of the information processing apparatus 1 according to the present embodiment. The music file 41 of this embodiment has a file format of mp3 (MPEG Audio Layer-3) format, tag information is stored in the header portion 60 in accordance with the format defined by the ID3 tag, and thumbnail image data is further stored. A stored thumbnail image area 61 and a music data area 62 in which music data 41a are stored are provided. In the music file 41 of the present embodiment, the tag information stored in the header portion 60 is inquired from a CDDB (Compact Disc Data Base) such as Gracenote when a music file 41 is created by an unillustrated PC (Personal Computer) or the like. The tag information returned from the CDDB is described by the PC or the like stored in a predetermined area of the header portion 60. Therefore, it is assumed that the tag information stored in the header portion 60 is already described in a predetermined area of the header portion 60 of the music file 41 when the music file 41 is taken into the information processing apparatus 1.

  In the header portion 60 of the music file 41, an ID area 63 in which an ID for uniquely managing the music file 41 in the information processing apparatus 1 is described, a music name area 64 in which the music name of the music file 41 is described, a music file The artist name area 65 in which the name of the artist who produced 41 is described, the album name area 66 in which the name of the album in which the music file 41 is recorded, and the release in which the year in which the music file 41 was released are described The year area 67, the genre area 68 where the genre to which the music file 41 belongs is described, the songwriter area 69 where the name of the songwriter of the music file 41 is described, and the composer area where the name of the composer of the music file 41 is described 70, when the music file 41 is acquired from a music CD, an identifier uniquely assigned to the music CD is described. Music CD identifier area 71, and the user information processing apparatus 1 the user-defined area 72 for arbitrarily describe various types of information are provided. Naturally, it is optional to provide a region other than this in the header portion 60 of the music file 41.

(Table structure of music route table)
FIG. 5 is a diagram illustrating an example of a table configuration of the music route table 42 stored in the internal storage 171 of the information processing apparatus 1 according to the present embodiment. In the music route table 42 of the present embodiment, a route area 80 in which a route ID for uniquely managing the route of the current position specifying data is described, and the music file 41 associated with the route of the current position specifying data are specified. Therefore, the music ID area 81 in which the ID of the music file 41 is described, the current position specifying data when the music file 41 is started to be reproduced by the information processing apparatus 1, that is, the current position corresponding to the start point of the current position specifying data The start point area 82 in which the specific data is described, the current position specifying data when the music file 41 is played back by the information processing apparatus 1, that is, the end point in which the current position specifying data corresponding to the end point of the current position specifying data is described In the path of the current position specifying data specified by the area 83 and the path ID, the music file associated with this path Number area 84 is provided with the number of 1 is reproduced is written.

(Outline of operation of this embodiment)
Next, an outline of the operation of the information processing apparatus 1 according to the present embodiment will be described with reference to FIGS. FIG. 6 shows the relationship between the position specifying data associated with the specific image file 40, the current position specifying data when the music file 41 stored in the storage unit 21 of the information processing apparatus 1 is reproduced, and the route thereof. FIG. In FIG. 6, position specifying data G associated with a specific image file 40 is positioned on a two-dimensional plane specified by latitude LA and longitude LO. The surface of the earth is strictly a curved surface, but here, the description will proceed on a two-dimensional plane specified by latitude LA and longitude LO. Similarly, the paths R1 to R5 of the current position specifying data when the music file 41 is played are positioned on the two-dimensional plane specified by the latitude LA and the longitude LO. In the example shown in FIG. 6, routes R1 to R5 exist in a circle C having a predetermined distance, for example, a radius of 50 m, centered on the position specifying data G (at least part of the routes R1 to R5 exists in the circle C). As shown, there are five. The routes R1 to R5 respectively have start points S1 to S5 and end points E1 to E5 of the current position specifying data. In the present embodiment, the straight lines L1 to L5 that respectively connect the start points S1 to S5 and the end points E1 to E5 of the routes R1 to R5 are also handled as the route of the music file 41.

  When reproduction of the music file 41 selected by the file selection unit 24 is started by the reproduction control unit 30 and the output unit 23, the position specifying data acquisition unit 25 acquires the current position specifying data at that time, and creates a music route table. The unit 27 describes the current position specifying data acquired by the position specifying data acquiring unit 25 in the music route table 42 as the start points S1 to S5 of the paths L1 to L5 of the current position specifying data. Similarly, when the reproduction of the music file 41 by the reproduction control unit 30 and the output unit 23 is finished, the position specifying data acquisition unit 25 acquires the current position specifying data at that time, and the music route table creation unit 27 The current position specifying data acquired by the specific data acquisition unit 25 is described in the end point area 83 of the music route table 42 as the end points E1 to E5 of the paths L1 to L5 of the current position specifying data, and the music ID of the music file 41 is ID. Read from the area 63 and describe in the music ID area 81.

  In addition, start points S1 to S5 and end points E1 to E5 that can be regarded as the same as the start points S1 to S5 and the end points E1 to E5 of the route of the current position specifying data acquired by the position specifying data acquisition unit 25 are registered in the music route table 42, respectively. If so, the extraction unit 29 increases the number of times described in the number of times area 84 of the music route table 42 by one. Here, “can be regarded as the same” means that a plurality of paths L1 to L5 of the current position specifying data in which the start points S1 to S5 and the end points E1 to E5 are close to each other are registered in the music route table 42. A number of very close paths L1 to L5 are registered in the music route table 42. Such a situation causes an increase in the amount of data, and may cause a possibility that the music file 41 determination procedure described later cannot be performed appropriately. The ranges that can be regarded as the same can be arbitrarily set, and may be determined based on a relative relationship with the predetermined distance that is the radius of the circle C described above. As an example, if the radius of the circle C is 50 m as described above, the range within 1 m can be regarded as the same. Or you may determine the range which can be considered the same according to the acquisition precision of the present position specific data by the position specific data acquisition part 25. FIG.

  When the image file 40 is selected by the file selection unit 24, the extraction unit 29 refers to the GPS information area 58 of the image file 40 and extracts the position specifying data G described in the GPS information area 58. Next, the extraction unit 29 searches the music route table 42 in the storage unit 21 and specifies the current position where any of the start points S1 to S5 or the end points E1 to E5 exists in the circle C at a predetermined distance from the position specifying data G. Data paths L1 to L5 are extracted. Then, the extracting unit 29 determines and stores specific current position specifying data paths L1 to L5 that are considered most relevant to the image file 40 from the extracted paths L1 to L5 of the current position specifying data. The music route table 42 in the unit 21 is searched, and the music file 41 corresponding to the route IDs of the routes L1 to L5 of this specific current position specifying data is extracted. Thereafter, the extraction unit 29 sends the image file 40 and the music file 41 to the reproduction control unit 30.

  A procedure for determining the paths L1 to L5 of specific current position specifying data that is considered to be most closely related to the image file 40 by the extracting unit 29 will be described below with reference to FIGS.

  The extraction unit 29 includes the position specifying data G and the path among the paths L1 to L5 of the current position specifying data in which any one of the start points S1 to S5 or the end points E1 to E5 exists in the circle C at a predetermined distance from the position specifying data G. The paths L1 to L5 having the shortest distance between L1 to L5 are determined as the paths L1 to L5 of the specific current position specifying data that is considered to be most closely related to the image file 40.

  Here, the distance between the position specifying data G and the paths L1 to L5 in the present embodiment is the position on the two-dimensional plane specified by the latitude LA and the longitude LO as shown in FIG. The foot F of the perpendicular P drawn from the specific data G toward the route L (representing the route L1 to L5 in FIG. 7) is represented by the start point S of the route L (representing S1 to S5 in FIG. 7). And the end point E (representing E1 to E5 in FIG. 7 and the end point being represented by the symbol E) in FIG. The distance D to the route L is assumed to be. Further, as shown in FIG. 7B, the foot F of the perpendicular P drawn from the position specifying data G toward the route L is not located between the start point S and the end point E of the route L, and the route L When the position is closer to the starting point S than the end point E, the length of the line segment SG connecting the position specifying data G and the starting point S is set as a distance D between the position specifying data G and the route L. Furthermore, as shown in FIG. 7 (c), the foot F of the perpendicular P drawn from the position specifying data G toward the path L is not positioned between the start point S and the end point E of the path L, and When the position is closer to the end point E than the start point S of the route L, the length of the line segment SG connecting the position specifying data G and the end point E is set as the distance D between the position specifying data G and the route L. .

  Alternatively, the extraction unit 29 includes the music route table 42 among the current position specifying data paths L1 to L5 in which any of the start points S1 to S5 or the end points E1 to E5 exists within the circle C at a predetermined distance from the position specifying data G. The paths L1 to L5 of the current position specifying data having the largest number of times described in the number of times area 84 are determined as the paths L1 to L5 of the specific current position specifying data considered most relevant to the image file 40.

  Further, the extraction unit 29 converts the distance between the position specifying data G and the paths L1 to L5 and the number of reproductions of the music file 41 in the paths L1 to L5 into weightable values that can be compared with each other. The paths L1 to L5 of specific current position specifying data considered to be most closely related to the image file 40 depending on the size may be determined. By determining the routes L1 to L5 of the current position specifying data using the weight values, more comprehensive and appropriate routes L1 to L5 of the current position specifying data can be determined.

  As an example, the extraction unit 29 converts the distance between the position specifying data G and the routes L1 to L5 into a weight value that increases as the distance decreases. As an example of the weight value conversion method, there is a method of calculating the weight value W1 by W1 = r / D, where r is the predetermined distance described above, that is, the radius of the circle C. This weighting value W1 is a value that increases (inversely proportional) as the paths L1 to L5 approach the position specifying data G.

  As another example, the extraction unit 29 converts the number of reproductions of the music file 41 in the paths L1 to L5 into a weighting value that increases as the number of times increases. As an example of the weight value conversion method, there is a method of calculating by weight value W2 = 1 + 0.2 × (N−1) (where N is the number of reproductions of the music file 41). The weighting value W2 is a value that increases (proportional) as the number of times the music file 41 is played back increases.

  Then, the extraction unit 29 may calculate the final weight value W using these weight values W1 and W2. As an example of a method for calculating the weighting value W, a value obtained by adding the weighting value W1 for each music file 41 (referred to as ΣW1) and a weighting value W2 related to the music file 41, that is, W = ΣW1 × W2 There is a method of calculating. In this case, the extraction unit 29 can directly extract the music file 41 having the largest weighting value W as the music file 41 to be extracted.

  Or the extraction part 29 calculates the weighting value which considered the direction of the path | routes L1-L5, when converting the distance between the positional specific data G and the path | routes L1-L5 into a weighting value. That is, when the routes L1 to L5 are considered as vectors connecting the start points S1 to S5 and the end points E1 to E5, it is considered whether the direction of the vector is a direction approaching or moving away from the position specifying data G. To calculate the weight value. This is the probability that the memory when the user is moving in the direction approaching the position specifying data G is the memory related to the position specifying data G than the memory when the user is moving away from the position specifying data G This is based on the prediction that is high.

  As an example, the extraction unit 29 draws a triangle composed of the start point S1 and the end point E1 of the route L1 (here, the route L1 will be described as an example) and the position specifying data G as shown in FIG. The areas of the two triangles T1 and T2 divided by the perpendicular P drawn from the position specifying data G toward the path L1 are calculated. If the area of the triangle T1 including the start point S1 is larger than the area of the triangle T2 including the end point E1, the extraction unit 29 determines that the vector of the route L1 is in the direction toward the position specifying data G. Determine the weight value. In the example illustrated in FIG. 8, the area of the triangle T1 related to the route L1 is smaller than the area of the triangle T2, and therefore the extraction unit 29 determines that the vector of the route L1 is away from the position specifying data G.

  As another example, the extraction unit 29 virtually draws a cone CC having the position specifying data G as a vertex as shown in FIG. Then, the extraction unit 29 calculates an angle formed by a vector connecting the start points S1 to S5 and the end points E1 to E5 to a plane including the start points S1 to S5 and parallel to the two-dimensional plane specified by the latitude LA and the longitude LO. calculate. The calculated angle takes a positive value if the vectors of the paths L1 to L5 are in the direction toward the position specifying data G, and is negative if the vectors of the paths L1 to L5 are away from the position specifying data G. Take the value. Accordingly, the extraction unit 29 can determine whether the vectors of the routes L1 to L5 are in the direction toward the position specifying data G or away from the angle based on the above-described angle, and based on this, the weighting value is determined. To decide. The radius of the bottom surface of the cone CC is preferably larger than the radius of the circle C described above. Thereby, it is possible to appropriately determine the routes L1 to L5 where the start points S1 to S5 and the end points E1 to E5 are not located in the circle C.

  Although the extraction unit 29 can calculate the weight values in consideration of the directions of the routes L1 to L5, as an example, when the vectors of the routes L1 to L5 are in the direction toward the position specifying data G, the weight values described above are used. When W1 is employed as it is and the vectors of the paths L1 to L5 are away from the position specifying data G, a method in which a value obtained by negating the sign of the weighting value W1 described above is used as a new weighting value can be cited.

(Operation of this embodiment)
Next, the operation of the information processing apparatus 1 of the present embodiment will be described with reference to the flowcharts of FIGS.

  FIG. 10 is a flowchart for explaining the music file 41 playback operation by the information processing apparatus 1 of this embodiment. The flowchart shown in FIG. 10 starts when a user inputs a music file 41 playback operation start instruction input to the information processing apparatus 1 via the input unit 22. First, in step S <b> 1, the file selection unit 24 searches the music file 41 stored in the storage unit 21 based on a list display instruction from the user input via the input unit 22. Next, the file selection unit 24 displays a list of the music file 41 in the storage unit 21 via the output unit 23 and waits for the user to select and input the music file 41. Next, in step S <b> 2, the file selection unit 24 receives a selection input of the music file 41 by the user via the input unit 22, and provides the selected music file 41 to the music route table creation unit 27 and the playback control unit 30.

  In step S3, based on an instruction to start playback of the music file 41 from the playback control unit 30, the position specifying data acquisition unit 25 is latitude information and longitude information that are current position specifying data of the position where the information processing apparatus 1 is located at that time. And altitude information is calculated and acquired. Then, the position specifying data acquisition unit 25 provides the acquired current position specifying data of the information processing apparatus 1 to the music route table creation unit 27. In step S4, the music route table creation unit 27 uses the current position specifying data of the information processing apparatus 1 provided from the position specifying data acquisition unit 25 as the start point of the route of the current position specifying data, and the start point area 82 of the music route table 42. Describe in. The music route table creation unit 27 extracts the music ID from the ID area 63 of the music file 41 provided from the file selection unit 24, and describes this music ID in the music ID area 81.

  In step S5, the reproduction control unit 30 waits until receiving a reproduction stop instruction input of the music file 41 input via the input unit 22, and when the reproduction stop instruction input is received (YES in step S5), the program is Proceed to step S6.

  In step S6, based on the reproduction end instruction of the music file 41 from the reproduction control unit 30, the position identification data acquisition unit 25 is the current position identification data of the position where the information processing apparatus 1 is located at that time. And altitude information is calculated and acquired. Then, the position specifying data acquisition unit 25 provides the acquired current position specifying data of the information processing apparatus 1 to the music route table creation unit 27. In step S7, the music route table creation unit 27 uses the current position specifying data of the information processing apparatus 1 provided from the position specifying data acquisition unit 25 as the end point of the route of the current position specifying data, and the end point area 83 of the music route table 42. Describe in.

  Next, FIG. 11 is a flowchart for explaining the display operation of the image file 40 by the information processing apparatus 1 of the present embodiment. The flowchart shown in FIG. 11 starts when the user inputs an instruction to start the display operation of the image file 40 to the information processing apparatus 1 via the input unit 22. In step S <b> 10, the file selection unit 24 searches the image file 40 stored in the storage unit 21 based on a list display instruction from the user input via the input unit 22. Next, the file selection unit 24 displays a list of the image files 40 in the storage unit 21 via the output unit 23 and waits for a selection input of the image file 40 by the user. Next, in step S11, the file selection unit 24 inputs selection input of the image file 40 by the user based on the user selecting one of the image files 40 by viewing the list display of the image file 40 displayed in step S10. The image file 40 received and selected via the input unit 22 is provided to the extraction unit 29.

  In step S <b> 12, the extraction unit 29 receives the image file 40 selected by the user by the file selection unit 24, and extracts position specifying data described in the GPS area 58 of the image file 40. Next, in step S13, the extraction unit 29 searches the music route table 42 stored in the storage unit 21 based on the position specifying data extracted from the image file 40, and within a predetermined range centered on the position specifying data. The route of the current position specifying data is determined, and the music file 41 associated with the determined route is extracted. Then, the extraction unit 29 reads the extracted music file 41 from the storage unit 21 and sends it to the reproduction control unit 30 together with the image file 40. Details of the operation in step S13 will be described later with reference to FIG.

  In step S14, a reproduction start instruction for the music file 41 is given by the reproduction control unit 30, and in step S15, based on the reproduction start instruction for the music file 41 in step S14, the position specifying data acquisition unit 25 at that time is the information processing apparatus. Latitude information, longitude information, and altitude information, which are current position specifying data of the position where 1 is located, are calculated and acquired. Then, the position specifying data acquisition unit 25 provides the acquired current position specifying data of the information processing apparatus 1 to the music route table creation unit 27. In step S <b> 16, the music route table creation unit 27 uses the current position specifying data of the information processing apparatus 1 provided from the position specifying data acquisition unit 25 as the starting point of the route of the current position specifying data, and the start point area 82 of the music route table 42. Describe in.

  In step S17, it is determined whether or not the playback control unit 30 has received a display stop instruction input for the image file 40 input via the input unit 22, and the display stop instruction input is received (YES in step S17). The program proceeds to step S18, and if the display stop instruction input is not accepted (NO in step S17), the program proceeds to step S20.

  In step S20, it is determined whether or not the playback control unit 30 has received a playback stop instruction input for the music file 41 input via the input unit 22, and if a playback stop instruction input has been received (YES in step S20) The program proceeds to step S18, and if the reproduction stop instruction input is not accepted (NO in step S20), the program returns to step S17.

  In step S18, based on the display / reproduction end instruction of the image file 40 or the music file 41 from the reproduction control unit 30, the position identification data acquisition unit 25 uses the current position identification data of the position where the information processing apparatus 1 is located at that time. Certain latitude information, longitude information, and altitude information are calculated and acquired. Then, the position specifying data acquisition unit 25 provides the acquired current position specifying data of the information processing apparatus 1 to the music route table creation unit 27. In step S19, the music route table creation unit 27 uses the current position specifying data of the information processing apparatus 1 provided from the position specifying data acquisition unit 25 as the end point of the route of the current position specifying data as the end point area 83 of the music route table 42. Describe in.

  FIG. 12 is a flowchart for explaining a music file extraction operation in the information processing apparatus 1 according to this embodiment. First, in step S30, the extraction unit 29 reads the path of the current position specifying data stored in the music route table 42 based on the position specifying data extracted from the image file 40, and the path and position of each current position specifying data. The distance between specific data is calculated. Next, in step S <b> 31, the extraction unit 29 calculates the route of each current position specifying data or the weight value of the music file 41. In step S32, the music file 41 to be reproduced in association with the image file 40 is determined. Since the details of the procedure of FIG. 12 have already been described with reference to FIGS. 6 to 9, detailed description thereof is omitted here.

(Effect of 1st Embodiment)
As described above in detail, according to the information processing apparatus 1 of the present embodiment, the music file 41 associated with the route of the current position specifying data within the predetermined range centered on the position specifying data of the image file 40 is stored. Since the music file 41 is extracted and reproduced in association with the image file 40, the image file 40 and the music file can be displayed and reproduced in association with the position specifying data of the image file 40 as an index. Thereby, it is possible to extract a music file that can effectively recall the memories associated with the image file 40 to the user.

  In particular, in the information processing apparatus 1 of the present embodiment, the music file 41 is extracted using information that takes into account the passage of time as the path of the current position specifying data. Compared with the case where a music file is extracted using information that takes into account only (instant), it is possible to extract a music file 41 that can make the user remember memories more effectively. As an example, in the information processing apparatus 1 of this embodiment, a straight line connecting the start point and the end point of the music file 41 playback is used as a route, and the music file 41 is extracted using the distance between the straight line and the position specifying data of the image file 40. doing. When a music file is extracted using the distance between the location where the music file is played and the position specifying data of the image file, the music file is usually listened to for a certain period of time. Even if the music file is being listened to at a location that matches the position specifying data of the image file, the music file is not necessarily extracted depending on which playback location is used. On the other hand, in the information processing apparatus 1 according to the present embodiment, the music file 41 is extracted using the path of the current position specifying data, so that the music file 41 passes through the very vicinity of the position specifying data of the image file 40 during reproduction. If so, the music file 41 can be extracted with priority. Therefore, according to the present embodiment, it is possible to extract the music file 41 that allows the user to recall memories more effectively. This effect is obtained when the path of the current position specifying data is a set of straight lines obtained by acquiring the current position specifying data at regular intervals from the starting point of reproduction of the music file 41 or a two-dimensional path consisting of curves. Since the user's movement path can be traced more precisely, it is possible to extract the music file 41 that can cause the user to recall memories more effectively.

(Second Embodiment)
Next, FIG. 13 is a flowchart for explaining an image file display operation by the information processing apparatus according to the second embodiment of the present invention. The details of the information processing apparatus of the present embodiment are the same as those of the information processing apparatus 1 of the first embodiment described above, and only the operation is different. Accordingly, the same components are denoted by the same reference numerals, and the description thereof is simplified.

  In FIG. 13, steps S40 to S42 are the same as steps S10 to S12 in FIG. 11 of the first embodiment described above. In step S43, the representative point position specifying data acquisition unit 26 is based on the position specifying data of the image file 40 extracted in step S42, and the representative point position specifying data located within a predetermined range centered on the position specifying data. To get. Then, the representative point position specifying data acquisition unit 26 provides the acquired representative point position specifying data to the extraction unit 29.

  Thereafter, the information processing apparatus 1 performs the same operations as steps S13 to S20 in FIG. 11 in steps S44 to S51 in FIG. However, in this embodiment, instead of the “position specifying data” used in steps S13 to S20 in FIG. 11, various operations are performed using “representative point position specifying data” in steps S44 to S51 in FIG. .

  Accordingly, the present embodiment can provide the same effects as those of the first embodiment described above. In particular, in the present embodiment, the music file 41 is extracted from the position specifying data of the image file 40 using the position specifying data of the representative points within a predetermined distance, so that memories can be recalled more effectively to the user. The music file 41 that can be played is extracted. In addition to memories related to the position specifying data of the image file 40, that is, imaging point data, the user often has memories about representative points such as landmarks in the vicinity of the imaging point data. In addition, since the music file 41 is extracted using the path of the representative point position specifying data and the current position specifying data within a predetermined distance, the relationship between the representative point position specifying data and the playback path of the music file 41 is represented. Appropriate judgment can be made and an appropriate music file 41 can be extracted. Thereby, the music file 41 which can make a user recall the memory more effectively can be extracted.

(Third embodiment)
FIG. 14 is a block diagram showing a schematic configuration of an information processing system according to the third embodiment of the present invention, and FIG. 15 is a functional block diagram showing a functional configuration of the information processing system according to the third embodiment.

  An information processing system 2 according to the present embodiment includes an information processing apparatus 1 and a server apparatus 5 that is communicably connected to the information processing apparatus 1 via a mobile communication network 3 and the Internet 4. The schematic configuration of the information processing apparatus 1 in the information processing system 2 of the present embodiment is substantially the same as that of the information processing apparatus 1 of the first embodiment described above, but differs in function and operation. Accordingly, the same components are denoted by the same reference numerals, and the description thereof is simplified.

  FIG. 15 is a functional block diagram showing a functional configuration of the information processing system 2 of the present embodiment. The information processing system 2 of the present embodiment stores the image file 40 in the first storage unit 21a in the information processing apparatus 1 in the information processing apparatus 1 of the first embodiment described above, while the music file 41 and the music route. The table 42 is stored in the second storage unit 32 of the server device 5, and the representative point position specifying data acquisition unit 26, the music route table creation unit 27, the extraction unit 29, and the reproduction control unit 30 are stored in the server device 5. The control part 31 is different. The input unit 22 and the output unit 23 of the information processing apparatus 1 and the input unit 33 and the output unit 34 of the server apparatus 5 exchange information between the information processing apparatus 1 and the server apparatus 5.

  In the above configuration, the file selection unit 24 of the information processing device 1 searches for the music file 41 stored in the second storage unit 32 of the server device 5, and the music file 41 is output to the output unit 23 of the information processing device 1. 41 lists are displayed. When one of the music files 41 is selected from the displayed list by the user, a selection input signal is transmitted to the control unit 31 of the server device 5 via the output unit 23 and the input unit 33. And the reproduction | regeneration control part 30 of the server apparatus 5 produces | generates the signal for music reproduction of the selected music file 41, and transmits to the information processing apparatus 1, and based on this signal for music reproduction, the music file 41 is the information processing apparatus 1. When the reproduction is started by the output unit 23, the position specifying data acquisition unit 25 acquires the current position specifying data at that time, and transmits the current position specifying data to the server device 5. The music route table creation unit 27 of the server device 5 describes the current position specifying data transmitted from the information processing device 1 in the music route table 42 as the starting point of the route of the current position specifying data. Similarly, when the reproduction of the music file 41 by the reproduction control unit 30 and the output unit 23 is finished, the position specifying data acquisition unit 25 acquires the current position specifying data at that time, and uses this current position specifying data as the server device 5. Send to. The music route table creation unit 27 of the server device 5 describes the current position specifying data transmitted from the information processing device 1 as the end point of the route of the current position specifying data in the start point area 82 and the end point area 83 of the music route table 42, respectively. At the same time, the music ID of the music file 41 is read from the ID area 63 and described in the music ID area 81.

  When the image file 40 is selected by the file selection unit 24 of the information processing apparatus 1, the control unit 20 refers to the first storage unit 21 a and extracts the ID described in the ID area 53 of the image file 40. Then, this ID is transmitted to the server device 5. Based on the transmission of the ID, the extraction unit 29 of the server device 5 stores the GPS information area 58 of the image file 40 selected by the user stored in the first storage unit 21a of the information processing device 1. The location specifying data described in the GPS information area 58 is extracted and acquired. Next, the extraction unit 29 searches the music route table 42 in the second storage unit 32 and extracts the route of the current position specifying data where either the start point or the end point exists within a predetermined distance from the position specifying data. Then, the extraction unit 29 determines a path of specific current position specifying data that is considered to be most relevant to the image file 40 from the extracted paths of the current position specifying data, and stores in the second storage unit 32. The music route table 42 is searched, and the music file 41 corresponding to the route of the specific current position specifying data is extracted. Thereafter, the extraction unit 29 sends the extracted music file 41 to the reproduction control unit 30, and the reproduction control unit 30 transmits a music reproduction signal to the information processing apparatus 1, and the music reproduction signal is selected. The reproduced image file 40 is reproduced by the output unit 23.

  Therefore, the present embodiment can achieve the same effects as those of the first embodiment described above.

(Modification)
The information processing apparatus 1 of the present invention is not limited to the above-described embodiments, and various modifications can be made. As an example, in each of the above-described embodiments, the information processing apparatus 1 images a subject using the camera module 141 and generates the image file 40 using the module driver 140. An image file captured by another image capturing apparatus, for example, a digital still camera, is loaded into the storage unit 21 of the information processing apparatus 1, and the music file 41 extraction operation is performed on the captured image file in the same manner as in the above embodiments. You may go.

  Among various functions performed by the control unit 20 of the information processing apparatus 1, at least the position specifying data acquisition unit 25, the representative spot position specifying data acquisition unit 26, the music route table creation unit 27, the extraction unit 29, and the reproduction control unit 30. One is executed by the server apparatus 5 outside the information processing apparatus 1, and communication between the server apparatus 5 and the information processing apparatus 1 is performed, thereby allowing the information processing apparatus 1 and the server apparatus to work together. You may perform the same operation | movement as each above-mentioned embodiment. For one of such examples, the third embodiment has already been described. In addition, in the third embodiment described above, both the image file 40 and the music file 41 are stored in the second storage unit 32. If the user instructs to reproduce the image file 40 stored in the second storage unit 32 of the server device 5 from the information processing apparatus 1, the same operation as in the third embodiment described above may be performed. . Alternatively, only the thumbnail image for browsing the image file 40 is stored in the first storage unit 21 a of the information processing apparatus 1, and the thumbnail image is stored in the second storage unit 32 of the server device 5. Link information or the like for accessing the image file 40 may be associated. In addition, the server device 5 not only communicates with the information processing device 1 via the Internet 4, but the information processing device 1 and the server device 5 may be disposed in the same home network.

  In each of the above-described embodiments, the program for operating the information processing apparatus 1 is provided by being stored in the ROM 11, the internal storage unit 17, etc., but the optical disk drive (not shown), the internal storage interface 170, and the USB controller 190 are provided. Even if a DVD (Digital Versatile Disc), a USB flash memory device, a memory card or the like storing a program is connected using the USB connector 191 or the like, the program is read from the DVD or the like into the information processing device 1 and operated. Good. Alternatively, a program may be stored in a device on the Internet, and this program may be read into the information processing device 1 via the mobile communication module 150 and operated. Further, in each of the above-described embodiments, the information processing apparatus 1 is configured by a plurality of hardware elements. However, the CPU 10 can also realize some operations of these hardware elements by the operation of a program.

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 2 Information processing system 4 Internet 5 Server apparatus 10 CPU
11 ROM
12 RAM
17 Internal storage unit 20, 31 Control unit 21 Storage unit 21a First storage unit 22, 33 Input unit 23, 34 Output unit 24 File selection unit 25 Location specifying data acquisition unit 26 Representative point location specification data acquisition unit 27 Music route table Creation unit 28 Imaging processing unit 29 Extraction unit 30 Playback control unit 32 Second storage unit 40 Image file 40a Image data 41 Music file 41a Music data 42 Music route table 130 Liquid crystal driver 131 Liquid crystal panel 140 Module driver 141 Camera module 150 Moving object Communication module 151 Audio interface 152 Microphone 153 Speaker 154 Antenna 160 Input interface 161 Touch panel 170 Internal storage interface 171 Internal storage 180 GPS module 181 GP S antenna 190 USB controller 191 USB connector D distance G position specifying data R1 to R5, L1 to L5 route

Claims (6)

An information processing system including an information processing device and a server device that is configured to be communicable with the information processing device and includes a storage unit that stores image data and music data associated with position specifying data at the time of acquisition. And
The information processing apparatus includes a position specifying data acquisition unit that acquires current position specifying data of a position where the information processing apparatus is located,
The server device
When the music data is reproduced in the information processing apparatus, a music route table is created in which the route of the current position specifying data acquired by the position specifying data acquisition unit is associated with the music data and stored in the storage unit A music route table creation section to perform,
The music route table is referred to based on the position specifying data associated with the image data, and the music data associated with the path of the current position specifying data within a predetermined range centered on the position specifying data is An extractor for extracting;
A reproduction control unit that causes the information processing apparatus to reproduce the music data extracted by the extraction unit in association with the image data;
Based on the position specifying data associated with the image data, a representative point position specifying data acquiring unit for acquiring representative point position specifying data relating to a representative point located within a predetermined range centered on the position specifying data; Prepared,
The extraction unit refers to the music route table based on the representative point position specifying data, and the music associated with the route of the current position specifying data within a predetermined range centered on the representative point position specifying data. An information processing system characterized by extracting data . A server device configured to be able to communicate with an information processing device that acquires current location specifying data of a location,
A storage unit for storing image data and music data associated with the position specifying data at the time of acquisition;
When the music data is reproduced in the information processing device, a music route table is created in which the route of the current position specifying data acquired by the information processing device is associated with the music data and stored in the storage unit. A route table creation unit;
The music route table is referred to based on the position specifying data associated with the image data, and the music data associated with the path of the current position specifying data within a predetermined range centered on the position specifying data is An extractor for extracting;
A reproduction control unit that causes the information processing apparatus to reproduce the music data extracted by the extraction unit in association with the image data;
Based on the position specifying data associated with the image data, a representative point position specifying data acquiring unit for acquiring representative point position specifying data relating to a representative point located within a predetermined range centered on the position specifying data; Prepared,
The extraction unit refers to the music route table based on the representative point position specifying data, and the music associated with the route of the current position specifying data within a predetermined range centered on the representative point position specifying data. A server device that extracts data . The music route table creation unit sets the current position specifying data acquired by the information processing apparatus when the music data is started to be played back in the information processing apparatus as a starting point of the path of the current position specifying data, and the music The current position specifying data acquired by the information processing apparatus when the reproduction of data is finished in the information processing apparatus is set as the end point of the path of the current position specifying data, and the current position specifying data of the start point and the end point are Provided to a map database existing outside the information processing apparatus, obtains a route on the map having the current position specifying data as a start point and an end point, and uses this route as the route of the current position specifying data as the music route table The server device according to claim 2, wherein the server device is stored in the server. The music route table creation unit sets the current position specifying data acquired by the information processing apparatus when the music data is started to be played back in the information processing apparatus as a starting point of the path of the current position specifying data, and the music The current position specifying data acquired by the information processing apparatus when the reproduction of data is finished in the information processing apparatus is set as the end point of the path of the current position specifying data, and the current position specifying data of the start point and the end point are While storing in the music route table as a route of the current position specifying data,
For each of the current position specifying data paths, the number of times data relating to the number of times the music data has been reproduced in the current position specifying data path is stored in the music route table,
The extraction unit registers the start point and the end point of the current position specifying data that can be regarded as the same as the start point and the end point of the route of the current position specifying data acquired by the information processing apparatus in the music route table, respectively. The server device according to claim 2, wherein the number-of-times data in the music route table is incremented by one when it is set. The music route table creation unit sets the current position specifying data acquired by the information processing apparatus when the music data is started to be played back in the information processing apparatus as a starting point of the path of the current position specifying data, and the music The current position specifying data acquired by the information processing apparatus when the reproduction of data is finished in the information processing apparatus is set as the end point of the path of the current position specifying data, and the current position specifying data of the start point and the end point are Store in the music route table as a route of the current position specifying data,
When there are a plurality of pieces of music data associated with the route of the current position specifying data within a predetermined range centered on the position specifying data, the extracting unit considers the direction of the path and The weighting value based on the distance between the specific data and the path of the current position specifying data associated with the music data is calculated, and the music data is extracted based on the magnitude of the weighting value. Server device. A server device configured to be able to communicate with an information processing device that acquires current position specifying data of a location where
A storage unit for storing image data and music data associated with the position specifying data at the time of acquisition;
When the music data is reproduced in the information processing device, a music route table is created in which the route of the current position specifying data acquired by the information processing device is associated with the music data and stored in the storage unit. Route table creation part,
The music route table is referred to based on the position specifying data associated with the image data, and the music data associated with the path of the current position specifying data within a predetermined range centered on the position specifying data is An extraction unit to extract,
A reproduction control unit that causes the information processing apparatus to reproduce the music data extracted by the extraction unit in association with the image data; and
Based on the position specifying data associated with the image data, a representative point position specifying data acquisition unit for acquiring representative point position specifying data related to a representative point located within a predetermined range centered on the position specifying data.
Function as
When functioning as the extraction unit, the music route table is referred to based on the representative point position specifying data and associated with the route of the current position specifying data within a predetermined range centered on the representative point position specifying data. A program for extracting the recorded music data .

Images