JP2005222111A - Portable terminal for av equipment, av equipment and server device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically reproduce a musical piece matched to the behavior history of a user. <P>SOLUTION: The portable terminal 10 controlling the AV equipment 20 comprises a position detection part 12 such as GPS and a personal identification part 13 authenticating the user. When the user goes out with the portable terminal 10, behavior history information composed of a set of position information detected by the position detection part 12 every predetermined time and the time information is stored in a memory within the portable terminal 10. When the user comes home, the behavior history information stored in the portable terminal 10 is transmitted to the AV equipment 20, and the AV equipment 20 transmits the user ID and the behavior history information to the server device 40. The server device 40 analyzes the place where the user has stayed for a predetermined time or more from the behavior history information, determines, based on information such as an event held there, a musical piece matched thereto, and delivers data for the musical piece in streaming form to the AV equipment 20. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an AV device such as an audio playback device, a portable terminal of the AV device, and a server device connected to the AV device via a network.

Various AV (Audio Visual) devices such as a television receiver, a CD player, a DVD player, and an audio playback device can usually be controlled using a remote control device.
In order to cause such AV devices to perform operations corresponding to individual users, a remote control device having a function of discriminating individuals has been proposed (Patent Document 1).
According to this proposed remote control device, a user can be identified using a fingerprint authenticator or the like, and control corresponding to the identified individual user can be performed.
JP 2001-128253 A

According to the proposed remote control device, device control corresponding to each user can be performed. However, the same control is performed every day according to the setting information of each user.
The user's behavior is not always the same. If the device is controlled according to the behavior history, the control based on the personal information can be enhanced.

  Accordingly, an object of the present invention is to provide a portable terminal of an AV device, an AV device, and a server device that can perform control according to a user's action history.

In order to achieve the above object, a portable terminal of an AV device according to the present invention is a portable terminal capable of controlling an AV device, and includes a personal authentication unit, a position detection unit, and the position detection unit at predetermined time intervals. An action history information storage unit that stores the position information and time information detected in step S3, and a transmission unit that transmits the personal authentication information and the action history information stored in the action history information storage unit to the AV device. is there.
The AV device according to the present invention is an AV device connected to a server device, and includes means for receiving user personal authentication information and action history information from a portable terminal, personal identification information for identifying the user, and the action history. Means for transmitting information to the server device, and music reproducing means for reproducing music data streamed from the server device in correspondence with the transmitted personal identification information and action history information.

Furthermore, the server device of the present invention is a server device connected to an AV device via a network, a song database storing song data of a plurality of songs, and personal identification information for identifying a user from the AV device. And means for receiving the action history information of the user, action history song determining means for selecting music corresponding to the action history based on the received action history information, and music selected by the action history song determining means For reproducing with the AV device.
Furthermore, the behavior history music discriminating means analyzes the behavior history information and selects music related to the place where the user stayed in the order of the longest time the user stayed.
Furthermore, it has a personal information database that stores information related to each user's musical preferences, and the behavior history song determination means selects the music corresponding to the behavior history when the user's music history is selected. It is designed to reflect the tastes of people.
Further, the means for reproducing the music selected by the action history music discriminating means on the AV device is a means for streaming the music data of the music to the AV device.

According to the portable terminal of the AV device, the AV device, and the server device of the present invention, it is possible to automatically record the personal action history by carrying the portable terminal when going out.
Then, after returning home, the user can listen to the music corresponding to the action history.
In addition, since personal authentication is possible with the mobile terminal, each user can use the same mobile terminal and store each action history.

FIG. 1 is a diagram showing an overall configuration of an AV system including a mobile terminal, an AV device, and a server device according to the present invention.
In this figure, 10 is a portable terminal (mobile controller) for remotely controlling the AV device 20, 20 is a network compatible AV device, 30 is a network such as the Internet, and 40 is a server device connected to the network 30, A song database 41 storing song data of a plurality of songs and a personal information database 42 storing user personal information are provided. In the music database 41, music data of a plurality of music can be searched based on various attribute information such as artist name, album name, keywords related to the music, genre to which the music belongs, and music tone of the music. Stored as you can. Also, in the personal information database 42 storing the personal information of the user, for each user registered in the AV device 20 under management, at least for each personal ID, the genre and preference of the favorite song Information on the user's musical preference, such as the artist name of, is stored.
As shown in the figure, the portable terminal 10 and the AV device 20 can perform wireless communication via a wireless LAN or the like, and the AV device 20 is connected to the server device via a network 30. (Action history song determination server) 40 can be connected.

The mobile terminal 10 includes a position detection unit 12 such as a GPS (Global Positioning System) processing unit that detects a position where the mobile terminal 10 exists, and personal authentication for identifying a user using the mobile terminal. A personal authentication unit 13 for obtaining information is provided, and not only control information for the AV device 20 but also personal authentication information such as fingerprint authentication data and user action history information are transmitted to the AV device 20 as described later. The personal ID information indicating the user authentication result from the AV device 20 and the information for designating the GUI (graphical user interface) for the user set in advance by the user. (Personal GUI number) and information (personal activation sound number) for specifying the activation sound for the user are received.
The AV device 20 is configured to transmit the user's personal ID and the user's action history information received from the mobile terminal 10 to the server device 40 via the network 30, and the server device 40 will be described later. As described above, based on the user's behavior history information received from the AV device 20, music that matches what the user has experienced that day is selected, and the music data of the music is streamed to the AV device 20. This makes it possible to automatically make music that matches the user's action history of the day from the AV device 20.

FIG. 2 is a block diagram showing a main configuration of the mobile terminal 10.
In this figure, 11 is a central control unit for controlling the portable terminal 10, and 12 is a position detecting unit for detecting the position of the portable terminal. For example, by a GPS processing unit having a GPS signal receiving circuit and a signal processing circuit. It is configured. Reference numeral 13 denotes a personal authentication unit for detecting who is operating the portable terminal, for example, a fingerprint sensor. 14 shows various data such as a control program of the central control unit 11, personal information of the detected user, and action history information storing the position information and time information detected by the position detection unit 12 every predetermined time. A memory serving as a storage area or a work area, 15 a display unit, 16 an operation unit, 17 a music playback unit that generates a startup sound, 18 a wireless LAN circuit that transmits and receives various signals to and from the AV device 20, etc. A wireless communication unit 19 is a bus that performs data transmission between the components.

  This AV system is used at home, for example, and the portable terminal 10 is shared by a plurality of users. A personal authentication unit 13 is provided in the mobile terminal 10 of the present invention. As will be described later, when a user holds the mobile terminal 10 and performs personal authentication by the personal authentication unit 13 (fingerprint sensor), the user Is set in advance (a file storing information related to the appearance of application software), and a GUI screen dedicated to the user is displayed on the display unit 15. In addition, a startup sound registered in advance by the user is emitted from the music playback unit 17. Thus, control according to each user is performed.

FIG. 3 is a block diagram showing a main configuration of the network-compatible AV device 20.
In this figure, 21 is a central control unit for controlling the entire AV equipment 20, 22 is a memory for storing control programs and various data, 23 is a display unit, 24 is a hard disk device for storing music data and the like. A capacity storage device (hereinafter simply referred to as “hard disk device”), 25 is a music playback unit for playing back and outputting music data stored in the hard disk device 24 and music data streamed from the server device 40, 26 Is a wireless communication (wireless LAN) unit for transmitting / receiving data to / from the portable terminal 10, 27 is a network interface unit for connecting to a network 30 such as the Internet, and 28 is for data transmission between the components. The bus. Although not shown, a CD drive device or the like is also provided so that song data ripped from a CD or song data downloaded from the network can be stored in the hard disk device 24.

The hard disk device 24 also stores a personal information management table in which information about users registered in the AV device 20 is recorded.
FIG. 4 is a diagram showing an example of information stored in the personal information management table. As shown in this figure, in the personal information management table, personal authentication information (fingerprint authentication data (fingerprint characteristic data)), musical preference (preferred music genre), user for each user's personal ID Information such as a number for designating the GUI selected by, and the number of the startup sound selected by the user is stored. The user registers personal authentication information (fingerprint authentication data), a favorite music genre, a favorite GUI number, a favorite start-up sound number, etc., in the personal registration process executed when the mobile terminal 10 is first used. You can change your registration at any time. In the above, an example is shown in which a favorite music genre is set as a musical preference, but other information such as a favorite artist name and a favorite song name can also be set.
The contents of this personal information management table are transmitted to the server device 40 and stored in the personal information database 42.

Regarding the operation of the AV system of the present invention configured as described above, FIG. 5 showing the operation sequence of the portable terminal 10, FIG. 6 showing the operation sequence of the AV device 20, FIG. 7 showing the personal registration sequence, and the server device A description will be given with reference to each flowchart of FIG.
In FIG. 5, first, when a user picks up the mobile terminal 10 and places a finger on the fingerprint sensor of the personal authentication unit 13 to read the fingerprint, fingerprint data is acquired, and personal authentication information ( Fingerprint authentication data) is generated and transmitted to the AV device 20 through a wireless LAN or the like (step S1).
This signal is received by the AV device 20 (step S11 in FIG. 6). Upon receiving this fingerprint authentication data, the AV device 20 performs personal authentication processing (step S12). That is, the received fingerprint authentication data is compared with the fingerprint authentication data of each user in the personal information management table (FIG. 4) stored in the hard disk device 24 to determine whether there is a match. If there is something to do, the user's personal information (GUI number and startup sound number selected by the user) is transmitted to the portable terminal 10 together with a personal ID for identifying the user, assuming that the authentication is successful ( Step S13).

On the other hand, when fingerprint authentication data that matches the fingerprint authentication data received in step S11 is not stored in the personal information management table, it is determined that the user is a new user, and the process proceeds to a personal registration sequence (S20). In this personal registration sequence, first, an initial registration screen of the user is transmitted to the mobile terminal 10.
If the portable terminal 10 receives the initial registration screen data from the AV device 20 after transmitting the fingerprint authentication data to the AV device 20 in the step S1, it is assumed that the personal authentication could not be performed. The process proceeds to the sequence (S20) (step S2).

FIG. 7 is a flowchart showing the flow of processing executed by the portable terminal 10 and the AV device 20 in this personal authentication sequence (S20).
When the personal authentication is not successful in step S12, the AV device 20 transmits information on an initial registration screen for initial registration of the user to the portable terminal 10 (step S21).
In the portable terminal 10, this initial registration screen is displayed on the display unit 15, and the user uses the screen to specify information for specifying a GUI used by the user, information for specifying a startup sound to be used, and music. Enter personal information such as the above preferences. The portable terminal 10 transmits the input personal information to the AV device 20 together with the fingerprint authentication data acquired in step S1 (step S22). Note that the AV device 20 may transmit only personal information by using the fingerprint authentication data received in step S11.
When receiving the personal information and the fingerprint authentication data transmitted from the mobile terminal 10, the AV device 20 assigns a personal ID for identifying the individual to the personal information management table of the hard disk device 24 (step). S23). The contents of the personal information management table are transmitted to the server device 40 and stored in a personal information database 42 provided in the server device 40.
As a result, personal information could be registered. After completing the personal registration sequence (S20), the AV device 20 transmits the personal information (personal ID, personal GUI number and activation sound number) to the portable terminal 10 (step S13 in FIG. 6).

When the personal authentication is successful or after the personal registration sequence is completed, the mobile terminal 10 receives the personal ID, personal GUI number, and startup sound number transmitted from the AV device 20 in step S13 of FIG. When they are received, the operation is started using them (step S3 in FIG. 5). That is, the music playback unit 17 reproduces the startup sound designated by the startup sound number, and the skin designated by the personal GUI number is selected and displayed on the display unit 15 for the user's exclusive use. The mobile terminal 10 is activated in the environment.
Thereafter, the user can use the mobile terminal 10 to operate the AV device 20 and enjoy playing music stored in the hard disk device 24.

Thereafter, it is assumed that the user goes out with the portable terminal 10 (step S4). As described above, the mobile terminal 10 is provided with the position detection unit 12 such as a GPS processing unit, and position information (latitude information and longitude information) indicating the current position at predetermined time intervals (for example, every 10 minutes). Can be acquired and stored in the memory 14 together with time information at that time. Hereinafter, information including a plurality of sets of position information and time information stored in the memory 14 will be referred to as action history information.
Here, the start / end of the recording operation of the action history information in the memory 14 may be manually performed by the user or may be automatically performed. When performing automatically, the position information of the user's home is stored in the memory 14 in advance, and the position information detected by operating the position detection unit 12 every predetermined time is obtained from the position of the user's home. When it becomes a predetermined distance (for example, 100 m) or more, the recording of the behavior history information is started, and the position detected by the position detection unit 12 is within a predetermined distance from the user's home. The recording may be terminated at the time of recording. Alternatively, it is assumed that the user has gone out when the received electric field strength measured by the wireless communication unit (wireless LAN unit) 18 is equal to or lower than a predetermined threshold (for example, a value at which communication is not possible). After starting the recording of information, after starting the recording operation, it is determined that the received electric field strength exceeds the predetermined threshold value, and the recording of the action history information is stopped. Also good.
Further, the time interval at which the position detection unit 12 is activated and the action history information is recorded may be arbitrarily set by the user. Furthermore, the action history information storage form does not need to be a set of position information and time information every predetermined time as described above, and can determine the position where the user stayed and the time (from when to when). Anything is possible. For example, when the user stays at a certain location, the storage time required can be reduced by storing the arrival time at the location and the time when the user moved from the location together with the location information of the location. Can do.

When a user who goes out with the mobile terminal 10 returns home, the action history information recording operation is stopped automatically or by a user operation, and the action history information stored in the memory 14 is transmitted to the AV device 20. (Step S5). At this time, the personal ID of the user is also transmitted to the AV device 20 together with the action history information.
When receiving the action history information (step S14 in FIG. 6), the AV device 20 transmits the received action history information and personal ID to the server device 40 (step S15).

FIG. 8 is a flowchart showing an operation sequence of the server device 40.
When the server apparatus 40 receives the action history information and the personal ID transmitted from the AV device 20 (step S31), the server apparatus 40 performs an action history song determination process for determining a song that matches the user action history. That is, the action history information is analyzed, and the positions where the user has stayed for a long time are taken out in the order of the long stay time (step S32). Next, based on the position information taken out by the action history analysis process, A music discrimination process for selecting a music corresponding to the music is performed (step S33). For example, the location where the user has stayed for a long time is identified with reference to the map information, it is determined whether there is a song closely related to the location, and when the song can be identified, the song information is distributed to the distribution list. Register with. When the song information is registered in the distribution list (YES in step S34), the song data of the song is streamed to the AV device 20 (step S35). On the other hand, when the music cannot be specified by the music discrimination process in step S33 and no music information is registered in the distribution list (NO in step S34), the AV device 20 indicates that the music discrimination has failed. (Step S36).

  When the AV device 20 receives data from the server device 40 and receives song data that has been successfully stream-distributed by the server device 40 (YES in step S16 of FIG. 6), the song Is reproduced by streaming (step S17). As a result, music that is closely related to what the user experienced on that day is automatically played from the music playback unit 25 of the AV device 20. When the server device 40 receives a notification indicating that the song determination has failed (NO in step S16), the display unit 23 displays the notification (step S18).

The action history song determination process will be further described with reference to FIGS. 9 and 10.
FIG. 9 is a flowchart showing a flow of the action history analysis process (S32).
In this action history analysis process, action history information consisting of a set of position information and time information consisting of latitude and longitude information sent from the AV device 20 is sequentially read out, and the value of latitude and longitude is within a predetermined range set in advance. It is determined whether or not the user has stayed for a certain period of time (for example, within 50 m) (step S42). And when staying in a predetermined narrow range for a certain time (for example, 30 minutes) or more, the stay time (the elapsed time from the first time to the last time in the range) and the center position of the range Is stored as action history analysis data (step S43). The behavior history is analyzed to the end of the behavior history information sent in this way, and behavior history analysis data including the stay time and the center position is acquired (step S41).
Then, the action history analysis data acquired in this way is sorted in the order of longer staying time (step S44) and passed to the subsequent song determination process (S33).
For example, it is assumed that, as a result of steps S41 to S43, it is analyzed that the user was at position A from 15:00 to 17:00, position B from 18:00 to 21:00, and position C from 22:00 to 23:00. In step S44, sorting is performed according to the length of time spent by the user, and data in the order of position B, position A, and position C is output.

FIG. 10 is a flowchart showing the flow of the song determination process (S33).
In this process, action history analysis data rearranged in descending order of stay time obtained in the action history analysis process (S33) is sequentially extracted, and map data is referred to from the position information (position information of the center position). The place is specified (step S52). Then, based on the specified location, an attempt is made to acquire information related to an event that was performed at the time when the user stayed at the location. For example, if it is determined as a result of step S52 that the place is a concert hall or the like, it is performed at the time when the user stayed at that place with reference to a database recording various events. Get information about a concert. Alternatively, if the place is a movie theater, the information about the movie that was shown at the time when the user stayed is acquired by referring to the database that stores the movie screening schedule. In this way, when information about the event can be obtained from the specified place and time (YES in step S53), the user's personal information (musical preference) is referred to related to the event. Thus, the music information considering the user's preference is acquired. For example, when the event is a concert, the artist's song is selected, and the user's favorite genre is selected as necessary. When the event is a movie, the song of the sound track is selected. Thus, when the music information related to the event can be acquired (YES in step S54), the music information is registered in the distribution list for registering the music to be distributed to the AV device 20 (step S56). .

On the other hand, when the information regarding the event could not be acquired (NO at step S53), or when the song information related to the event and taking into account personal preferences could not be acquired (step S54) NO) tries to acquire music information in consideration of the location specified in step S52 and the user's preference. For example, when the location specified in step S52 is a coast, a song that suits the user's preference is selected from the song database 41 provided in the server device 40 among the songs related to the sea. In this way, when the acquisition of the music information in consideration of the specified place and personal preference is successful (step S55 is YES), the music information is registered in the distribution list (step S56).
When the selected song information is added to the distribution list (S56), or when the song information considering the specified location and personal preference cannot be obtained (NO in step S55), A similar song determination process is performed for the action history analysis data, and the process is performed for all the action history analysis data (step S51).
In this way, music information that matches the user's action history is registered in the distribution list.

For example, in the above example, it is assumed that the position B is specified as the concert venue, the position A as the movie theater, and the position C as the sea (S52). At this time, a database storing concert information is searched using the concert venue at the position B and the user's stay time as a key, and as a result, it is specified that the concert of the band D has been performed (S53). The music information of the band D is added to the distribution list (S54, S56). In addition, with reference to the database providing the movie screening schedule for the movie theater at position A, if the movie being shown at that time is identified as E (S53), the movie E Related music information is registered in the distribution list (S54, S56). Further, if it is assumed that specific event information could not be specified for the sea at position C (NO in step S53), when a music related to the sea is selected from the music database 41 and a plurality of music is obtained. Are registered in the distribution list (S55, S56) by the user's favorite artist included in the personal information database 42.
Thus, the music data of the music registered in the distribution list is sequentially delivered to the AV device 20, and the music that matches the user's action history is automatically reproduced.
Thus, since the related music is arranged in the distribution list in the order of the longest time that the user stayed, the music is distributed from the music related to the place where the most time was spent in the day.

In the embodiment described above, the action history information analysis process (FIG. 9) is performed in the server device 40. However, in the portable terminal 10 or the AV device 20, the action history information analysis process is performed. May be performed.
In the above, the music selected in the music discrimination process (FIG. 10) is streamed from the server device 40 to the AV device 20, but the present invention is not necessarily limited to this. When the music name is notified to the AV device 20, the music is streamed only when the selected music is not stored in the hard disk device 24 of the AV device 20 and stored in the hard disk device 24. The data may be read from the hard disk device 24 and played back.
Further, in the above, personal authentication information (fingerprint authentication data) is transmitted from the mobile terminal 10 to the AV device 20 and personal authentication is performed by the AV device 20. It is also possible to store authentication data and perform personal authentication with the mobile terminal 10.
Furthermore, the personal ID of the user may be transmitted from the mobile terminal 10 to the AV device 20 without providing the personal authentication unit 13 such as a fingerprint sensor in the mobile terminal 10. For example, a user selection switch is provided in the mobile terminal 10 so that each user selects his / her ID by operating the user selection switch, and the data transmitted from the mobile terminal 10 to the AV device 20 is included in the user's personal information. An ID may be added for transmission.
Furthermore, in the above description, music that matches the user's action history is played on the AV device 20, but video that matches the user's action history can also be played on the AV device. In this case, the server device 40 may perform video discrimination processing instead of song discrimination so that the selected video is played back on the AV device.

1 is a diagram illustrating an overall configuration of an AV system including a mobile terminal, an AV device, and a server device of the present invention. 2 is a block diagram illustrating a configuration example of a mobile terminal 10. FIG. 2 is a block diagram illustrating a configuration example of an AV device 20. FIG. It is a figure which shows an example of the information memorize | stored in a personal information management table. 4 is a flowchart showing an operation sequence of the mobile terminal 10. 3 is a flowchart showing an operation sequence of the AV device 20. It is a flowchart which shows the flow of a personal registration sequence. 4 is a flowchart showing an operation sequence of the server device 40. 4 is a flowchart showing a flow of action history analysis processing executed by the server device 40. 4 is a flowchart showing a flow of music discrimination processing executed in the server device 40.

Explanation of symbols

  10: mobile terminal, 11: central control device, 12: position detection unit, 13: personal authentication unit, 14: memory, 15: display unit, 16: operation unit, 17: music playback unit (start-up sound), 18: wireless Communication unit 20: AV equipment 21: Central control unit 22: Memory 23: Display unit 24: Hard disk device 25: Music playback unit 26: Network communication unit 27: Wireless communication unit 30: Network 40: Server device, 41: Music database, 42: Personal information database

Claims (6)

A portable terminal capable of controlling an AV device,
A personal authentication department;
A position detector;
An action history information storage unit that stores position information and time information detected by the position detection unit every predetermined time;
A portable terminal comprising: a personal authentication information; and a transmission unit that transmits the behavior history information stored in the behavior history information storage unit to the AV device. AV equipment connected to the server device,
Means for receiving user personal authentication information and action history information from a mobile terminal;
Means for transmitting personal identification information for identifying a user and the action history information to the server device;
An AV apparatus comprising: music playback means for playing back music data streamed from the server device in correspondence with the transmitted personal identification information and action history information. A server device connected to an AV device via a network,
A music database storing song data of multiple songs;
Means for receiving personal identification information for identifying a user and action history information of the user from the AV device;
Based on the received action history information, action history song determination means for selecting music corresponding to the action history;
And a means for playing back the music selected by the action history music discrimination means on the AV device.   4. The behavior history song determination means analyzes the behavior history information, and selects music related to the place where the user stayed in the order of long time the user stayed. Server device.   Furthermore, it has a personal information database that stores information related to each user's musical preference, and when the behavior history song determination means selects a song corresponding to the behavior history, the user's musical preference 5. The server apparatus according to claim 3, wherein the server apparatus is also reflected.   6. The means for reproducing the music selected by the action history music discriminating means on the AV device is a means for streaming the music data of the music to the AV device. The server device described in 1.

Images