JP2010068247A - Device, method, program and system for outputting content - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily and effectively share content among users of a plurality of electronic devices. <P>SOLUTION: A content recorder 1-X acquires, from other content recorder 1-Y, having the ID of a friend device registered in a storing part 12-X, that is, a sharing destination device, additional information, such as recording date and time information, recording position information and the total number of content records of content recorded by the sharing destination device. The content recorder 1-X collates these additional information, with the additional information of content recorded by the content recorder 1-X, and transmits the content recorded by the content recorder 1-X to the content recorder 1-Y according to the result. Furthermore, the content may be shared according to the collation result of additional information recorded when the content is shared and browsed other than the additional information, when the content is recorded. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an apparatus, a method, a program, and a system for outputting content including images and audio to a desired counterpart device.

  In Patent Document 1, a plurality of devices share a result of editing image data of each device among a plurality of devices (such as a digital still camera).

  In Patent Document 2, the importance level for the photographer is determined based on the size and position of a person's face in the image.

Patent Document 3 relates to data sharing between electronic albums, detects the feature amount of a transmission source / destination image group, and transmits an image having a feature amount of a certain value or more to the other party.

In Patent Document 4, a captured image file captured from a digital camera includes digital camera identification information. This captured image file is stored in the HDD. The electronic album creation device extracts an image based on the identification information and creates an electronic album. Thereby, an electronic album for each participant can be easily created.
JP 2007-158563 A JP 2007-201980 A JP 2006-79458 A JP 2003-18513 A

  In recent years, digital content recording devices such as digital still cameras, digital video cameras, digital audio recorders, camera-equipped mobile phones with recording functions, and the like have become widespread as the capacity of recording media increases. The effort for organizing and classifying still images, moving images, and sounds recorded in large amounts on a recording medium using these devices has become very large accordingly. Furthermore, in recent years, services for sharing digital contents over a network have also become widespread, and the recording media stored by each user include contents recorded by themselves and contents downloaded from computers managed by other users. If this is the case, the time and effort for organizing and classifying them will increase further.

  In this regard, Patent Document 1 discloses a technique for sharing image editing contents performed by one unit with another device when sharing an image between a plurality of devices. However, the editing is only performed after the image is shared, and there is no mention of how to share the image.

  In Patent Document 2, importance is determined based on the position and size of a face in an image. As an image sharing method using such importance determination (feature amount detection), Patent Literature 3 can be cited, but sharing using only the feature amount of an image is not always attractive to the user. For example, if you share a picture of a person you don't know, you won't feel happy. Conversely, even if content recorded by a certain user does not have any characteristics, other users may want to share it, but Patent Document 3 cannot cope with this.

  In addition to current digital still cameras, mobile phones capable of recording still images, audio, or moving images with audio are also widely used, and it is routine for one user to carry one digital content recording device. Therefore, it is required to effectively share contents useful for other users among the contents that are recorded by each user.

  An object of the present invention is to simplify and effectively share content among users of a plurality of electronic devices.

  A content output device according to the present invention relates to a content recording unit that records content including at least one of an image and sound, and a situation that includes at least one of recording, browsing, and sharing of content by the content recording unit A content status information recording unit that records content status information in association with the content, an output unit that can output the content to another device, an input unit that inputs current or past status information acquired by the other device, Compare the status information of the other device input by the input unit with the content status information recorded by the content status information recording unit, and output the content recorded by the content recording unit to another device according to the comparison result A control unit for controlling the unit.

  The content status information includes location information at the time of recording the content, the status information of other devices includes the current location information, and the control unit records the location information of the other devices input by the input unit and the content status information. The output unit is controlled to output the content recorded by the content recording unit to another device based on the distance between the position information recorded by the unit and the position information.

  The content status information includes position information at the time of recording the content, the status information of other devices includes the position information at the time of recording of content by other devices, and the control unit includes the other device input by the input unit. The output unit is controlled to output the content recorded by the content recording unit to another device according to whether or not the position information and the position information recorded by the content status information recording unit match.

  The control unit controls the output unit to output the content recorded by the content recording unit to another device according to the difference between the total number of content recorded by the content recording unit and the total number of content recorded by the position information of the other device. To do.

  The control unit outputs the content recorded by the content recording unit to another device according to the proximity of the position information when the content recording unit records the content and the position information when the other device records the content. Control the output unit.

  The content status information includes date / time information at the time of content recording, the status information of other devices includes date / time information at the time of recording of content by other devices, and the control unit The output unit is controlled to output the content recorded by the content recording unit to another device according to whether the date / time information and the date / time information recorded by the content status information recording unit match.

  The content recording unit includes an imaging unit that records an image, and the control unit determines whether there is another device within the imaging range of the image recorded by the imaging unit, and determines whether the imaging unit is in accordance with the determination result. The output unit is controlled to output the recorded image to another device.

  The content recording unit includes an imaging unit that records an image, and the control unit determines whether or not the image recorded by the imaging unit and an image acquired by another device have an overlapping portion, and according to the determination result The output unit is controlled to output the image recorded by the imaging unit to another device.

  A registration unit for registering identification information of a desired device is provided, the input unit inputs identification information of another device, and the control unit matches the identification information registered by the registration unit with the identification information input by the input unit. The output unit is controlled to output the content recorded by the content recording unit to another device according to the determination result.

  The content output method according to the present invention includes a step in which a computer records content including at least one of an image and sound, and content status information relating to a status including at least one of content recording, browsing, and sharing Is recorded in association with the content, the step of inputting the current or past status information acquired by the other device, the status information of the other device that has been input and the recorded content status information are compared. Outputting the recorded content according to the result to another device.

  A program for causing a computer to execute the content output method is also included in the present invention.

  According to the present invention, the status information of the counterpart device is compared with the status information at the time of recording the content, and the content is output to the counterpart device according to the result. Content can be automatically shared.

<First Embodiment>
FIG. 1 is a schematic configuration diagram of a content sharing system according to a preferred embodiment of the present invention. This system includes a plurality of content recording devices 1. The image sharing system in FIG. 1 includes a digital still camera 1a, a mobile phone 1b, and a PDA 1c that can record still images and moving images with sound. There is no essential difference in that these devices are included in the content recording device 1 including an electronic circuit capable of recording still images, moving images, and audio.

  FIG. 2 is a block diagram of the content recording device 1. The content recording device 1 includes a data transmission / reception unit (communication I / F) 11 composed of a well-known data communication means such as a USB port, a wire, a wireless LAN adapter, and electrodes for inputting and outputting a weak current for human body communication, a RAM, The storage unit 12 includes a portable recording medium such as a ROM, a hard disk, a memory card, and a DVD.

  The content recording device 1 is output from an imaging lens that forms a subject image on the light receiving surface of the imaging device, an imaging device such as a CCD or CMOS that photoelectrically converts the subject image into an analog image signal, and an imaging device. An imaging unit 15 including an AD conversion unit that converts an analog image signal into digital image data, an image for changing the number of pixels of image data output from the imaging unit 15, sharpness correction, gamma correction, contrast correction, white balance correction, and the like A processing unit 14 is included.

  Further, the content recording device 1 performs data processing such as a microphone for collecting sound, an analog audio signal acquired from the microphone, converted into digital data after amplification, and compressed in a predetermined compression recording format (such as MPEG4), A recording unit 16 that stores compressed audio in the storage unit 12 together with the still image or moving image acquired by the imaging unit 15 or separately from the image is included.

  The storage unit 12 stores image data (still images, moving images) obtained by shooting, audio data obtained by recording, data (for example, MP4 files) recorded both, supplementary information or other content described in text data. For example, a memory card called smart media is used. The form of the recording medium is not limited to this, and may be a PC card, a compact flash (registered trademark), a magnetic disk, an optical disk, a magneto-optical disk, a memory stick, etc., electronic, magnetic, optical, or a combination thereof A readable / writable medium can be used in accordance with the above-described method. A configuration in which a plurality of media can be mounted regardless of different types or the same type of recording media may be adopted. Further, the storing means is not limited to a removable removable medium, but may be a built-in recording medium (built-in memory). In addition, device information (ID) unique to each content recording device 1 is recorded in the storage unit 12.

  In addition, the content recording device 1 is stored in advance in a nonvolatile storage medium (ROM, magnetic disk, etc.) of the storage unit 12 or stored in the recording unit 16, such as sound, operation sound, shutter sound, and AF in-focus sound. The audio processing circuit 17 performs various data processing such as analog audio signal conversion and amplification on the various audio data and outputs them to the speaker.

  An RTC (real time clock) 18 outputs current date and time information. This current time information can be stored in the storage unit 12 as the shooting date / time information of the image to be recorded by the imaging unit 15 together with the content such as an image or sound, for example, as meta information or header information described in text data. . Information derived from the shooting date / time information, for example, time zone information such as morning, afternoon, daytime, evening, night, and morning, and seasonal information such as spring / summer / autumn / winter can also be included in the shooting date / time information.

  The position information acquisition unit 19 is composed of a GPS receiver, and obtains current position information by receiving radio waves from GPS satellites and measuring the distance from the orbit. This current position information can be stored in the storage unit 12 as, for example, meta information or header information described in text data, together with contents such as images and sound, as shooting position information of an image for recording by the imaging unit 102. . The acquisition source of the current position information may not be a GPS receiver, but the position information notification is received from the nearest position notification server within the communication range of the content recording device 1, and this is the outline of the content recording device 1. The position information can also be used.

  The information processing unit (CPU) 30 controls each circuit in the content recording device 1 based on instructions input from various buttons and keys of the operation unit 20 including a release switch, a mode dial, and a numeric keypad to the user operation member. Can be controlled. A program executed by the information processing unit 30 is stored in a ROM, a DVD, or the like of the storage unit 12, and is appropriately loaded into the RAM for execution. However, the program may be received from the external program distribution server (not shown) via the communication I / F 11 and executed by the CPU 30, and the program may not always be stored in the storage unit 12 as local data. .

  The program executed by the information processing unit 30 includes a sharing presence / absence determination unit 31, a user information registration unit 32, a number check unit 33, a position check unit 34, a timing check unit 35, and an image composition possibility check unit 36. The contents of processing realized by these programs will be described later.

  The display unit 13 includes a decoder and a display, and displays a video according to an instruction from the information processing unit 30.

  The digital still camera 1a, the mobile phone 1b, and the PDA 1c are all provided with the respective blocks shown in FIG. 2, but may have other circuit configurations. For example, the mobile phone 1b includes a communication circuit that communicates with a mobile telephone communication network, a reproduction circuit that amplifies an audio signal received by the communication circuit, a digital voice that is collected by a microphone, and a desired other party telephone through the communication circuit. A transmission circuit for transmitting to the terminal is provided.

  Hereinafter, in order to distinguish common blocks individually provided in different content recording devices 1 such as the digital still camera 1a, the mobile phone 1b, and the PDA 1c, the codes of these blocks are denoted by “a”, “b”, “c”, A subsuffix such as “A” or “B” may be added. For example, the sharing presence / absence determination unit 31a indicates a block included in the digital still camera 1a.

  FIG. 3 shows a first usage pattern of this system. Each user of the camera 1a, the mobile phone 1b, and the PDA 1c owns the ID of the content recording device 1 possessed by another user who recognizes each other or unilaterally as a friend via the operation unit 20 or the communication I / F 11. Input to the content recording device 1. The user information registration unit 32 stores the input ID of the content recording device 1 of the other user in the storage unit 12 as “friend device information”.

  The form of inputting the friend device information is not particularly limited. If the operation unit 20 of the camera 1a has a touch panel, the display unit 13 displays a list of other content recording devices 1 that have accessed the camera 1a and requested registration of friend device information, for example, the mobile phone 1b and the PDA 1c. Then, when the friend device information is touched from the inside, the ID of the touched device is stored in the storage unit 12 of the camera 1a as the friend device information. Alternatively, the camera 1a is connected to a personal computer via the communication I / F 11, and the ID transmitted from the personal computer to the camera 1a is stored in the storage unit 12a of the camera 1a as friend device information. Alternatively, another content recording device 1, which has requested wireless connection to the communication I / F 11 of the camera 1a, for example, the mobile phone 1b, the PDA 1c, sends the genuine password or other connection code issued in advance by the camera 1a to the camera 1a. If transmitted, the ID of the content recording device 1 that sent the genuine connection code is stored in the storage unit 12a of the camera 1a as friend device information.

  In addition, the camera 1a may store the desired ID selected via the operation unit 20 among the IDs sent from the other content recording devices 1 by e-mail or human body communication as friend device information in the storage unit 12a. Good. Since mail and human body communication are personal communication means and are assumed to be performed between users who have established a certain degree of human relationship, they are suitable for sending and receiving friend device information.

  The friend device information can further be associated with individual contents or identification information thereof. However, if certain friend device information is stored in the storage unit 12 without being associated with individual contents, it is considered that the friend device information is associated with any content.

  Here, in the storage unit 12a of the camera 1a, the ID “B” of the mobile phone 1b is stored in association with the image I1 as friend device information, and the ID “C” of the PDA 1c is stored in the image I3 as a friend. Assume that the device information is stored in association with each other. Further, it is assumed that the ID “A” of the camera 1a is associated with the image I2 as friend device information and stored in the storage unit 12 in the storage unit 12b of the mobile phone 1b. Since the PDA 1c does not store the ID of the camera 1a or the mobile phone 1b in the storage unit 12b as friend device information, the content recorded by the PDA 1c is not shared by the camera 1a or the mobile phone 1b. If the ID is stored in the storage unit 12b as friend device information, sharing is possible.

  However, the friend device information is not necessarily local information in the storage unit 12 of each content recording device 1 and is stored in a server (not shown), and each content recording device 1 accesses the server and corresponds to its own device ID. Only the ID of the friend device information to be used may be referred to.

  The sharing presence / absence determination unit 31 of the content recording device 1 (share source device) serving as the content provider refers to the friend device information stored in the storage unit 12 and the still image or video recorded by the imaging unit 15 or the recording unit 16. In addition to the voice recorded in the above, when it is input from the operation unit 20 as information accompanying it (for example, a photographer's comment) or specified by the information processing unit 30 (for example, when an imaging instruction is input from the operation unit 20) The content recording device 1 (sharing destination device) to be shared with the content including the text data including the supplementary information) is determined. Then, the sharing presence / absence determining unit 31 controls the communication I / F 11 to transmit the content to the determined sharing destination device. In addition, the sharing presence / absence determining unit 31 of the sharing source device may determine the content sharing partner after receiving the content sharing request from the content recording device 1 of the sharing partner.

  For example, it is assumed that the camera 1a has recorded the image I1 via the imaging unit 15a. In this case, the sharing presence / absence determination unit 31a refers to the friend device information corresponding to the image I1 in the storage unit 12a, and determines the content recording device 1 that is the other party to share the image I1 recorded by the imaging unit 15a. Specifically, the sharing presence / absence determination unit 31a determines the content recording device 1 having the same device information as the friend device information corresponding to the image I1 in the storage unit 12a, that is, the mobile phone 1b, as the sharing partner of the image I1. . Then, the camera 1a transmits the image I1 to the mobile phone 1b via the communication I / F 11a. If audio information or incidental information is attached to the image I1, it is sent together with the image I1.

  Alternatively, it is assumed that the mobile phone 1b records the image I2 via the imaging unit 15b. In this case, the sharing presence / absence determination unit 31b refers to the friend device information corresponding to the image I2 in the storage unit 12b, and determines the content recording device 1 to be a sharing partner of the image I2 recorded by the imaging unit 15b. Specifically, the sharing presence / absence determination unit 31b sets the content recording device 1 having the same device information as the friend device information corresponding to the image I1 stored in the storage unit 12b, that is, the camera 1a as the sharing partner of the recorded image I1. decide. Then, the mobile phone 1b transmits the image I2 to the camera 1a via the communication I / F 11b. If audio information or incidental information is attached to the image I2, it is also sent together with the image I2.

  Alternatively, it is assumed that the camera 1a records the image I3 via the imaging unit 15a. In this case, the sharing presence / absence determination unit 31a refers to the friend device information corresponding to the image I3 in the storage unit 12a, and determines the content recording device 1 to be a sharing partner of the image I1 recorded by the imaging unit 15a. Specifically, the sharing presence / absence determination unit 31a determines the content recording device 1 having the same device information as the friend device information corresponding to the image I3 in the storage unit 12a, that is, the mobile phone 1b, as the sharing partner of the image I3. . Then, the camera 1a transmits the image I3 to the mobile phone 1b via the communication I / F 11a. If audio information or incidental information is attached to the image I3, it is also sent together with the image I3. The images I1 and I3 may be the same. In this case, the same image I1 is transmitted from the camera 1a to both the mobile phone 1b and the PDC 1c.

  In this way, the user can share the recorded content only with the content recording device 1 owned by another user who the user himself / herself recognizes as a friend, and the operation of manually sending the content afterwards can be omitted.

  Various image transmission modes are employed. For example, a still image file, a moving image file, or an audio file itself may be downloaded, or the receiving side may only be able to reproduce but not the data itself, such as streaming distribution.

  FIG. 4 shows a second usage pattern of the present system. Here, the content recording device 1 such as the camera 1a, the mobile phone 1b, and the PDC 1c constitutes this system. Similar to the system of FIG. 3, each content recording device 1 stores desired friend device information in the storage unit 12. Here, it is assumed that the ID “B” of the mobile phone 1b and the ID “C” of the PDA 1c are stored in the storage unit 12a of the camera 1a in association with each other as friend device information.

  The sharing presence / absence determination unit 31 of the sharing source device refers to the friend device information in the storage unit 12, and the still image or moving image recorded by the imaging unit 15, the voice recorded by the recording unit 16, or information accompanying them As input from the operation unit 20 (for example, a photographer's comment) or specified by the information processing unit 30 (for example, the current time information of the RTC 18 when the imaging instruction is input from the operation unit 20 or the position information acquisition unit 19 (Position information) The content recording device 1 to be the other party to share the content including the text data including the accompanying information is determined.

  Next, the location check unit 34 of the sharing source device requests the determined sharing destination device to transmit the current location information via the communication I / F 11. The content recording device 1 of the sharing partner acquires the current position information from the position information acquisition unit 19 in response to receiving the position information transmission request via the communication I / F 11, and uses this as the content providing source. Transmit to the recording device 1.

  Next, the location check unit 34 of the sharing source device acquires the current location information from its own location information acquisition unit 19 (or from the supplementary information of the recorded content), and receives the current location information from the sharing destination device. Compare with location information. As a result of the comparison, when the distance between the two is less than a predetermined threshold (for example, 5 m), the sharing presence / absence determining unit 31 of the sharing source device controls the communication I / F 11 to transmit the content to the sharing destination device. .

  In FIG. 4, the camera 1a is a sharing source device, and the mobile phone 1b and the PDA 1c are sharing destination devices as viewed from the camera 1a. However, the distance from the camera 1a to the mobile phone 1b is not within a predetermined threshold range, and the content recorded by the camera 1a is not transmitted to the mobile phone 1b. On the other hand, the PDA 1c has a distance from the camera 1a within a predetermined threshold range, and the content recorded by the camera 1a is transmitted to the PDA 1c.

  As a result, when content is sent according to the comparison result of the current location information of both the sharing source device and the sharing destination device, the content is sent when friends who are acting together such as going on a trip are nearby Will be. In addition, when the content is transmitted according to the result of comparing the current position information recorded in the incidental information of the content recorded by the sharing source device and the current position information of the sharing destination device, the previous user has already recorded the content. The content will be sent when the friend device of the user comes near the place where he went.

  FIG. 5 shows a third usage pattern of the present system. Here, the content recording device 1 such as the camera 1a, the mobile phone 1b, and the PDC 1c constitutes this system. Similar to the system of FIG. 3, each content recording device 1 stores friend device information in the storage unit 12. Here, it is assumed that the ID “C” of the PDA 1c is stored as friend device information in the storage unit 12a of the camera 1a. In addition, it is assumed that the ID “A” of the camera 1a and the ID “B” of the mobile phone are stored as friend device information in the storage unit 12a of the PDA 1c.

  The sharing presence / absence determination unit 31 of the sharing source device refers to the friend device information in the storage unit 12, and the still image or moving image recorded by the imaging unit 15, the voice recorded by the recording unit 16, or information accompanying them As input from the operation unit 20 (for example, a photographer's comment) or specified by the information processing unit 30 (for example, the current time information of the RTC 18 when the imaging instruction is input from the operation unit 20 or the position information acquisition unit 19 (Position information) The content recording device 1 that is the other party to share the content including the text data including the accompanying information is determined.

  Next, the location check unit 34 of the sharing source device accepts a content exchange request from the determined sharing destination device. The content recording device 1 of the sharing partner acquires the current position information from the incidental information of the content recorded by itself and transmits it to the content recording device 1 that is the content provider.

  Next, the position check unit 34 of the sharing source device acquires the current position information from the incidental information of the recorded content to be shared, and uses this as the current position information of the incidental information of the content received from the sharing destination device. Compare. As a result of the comparison, if the two match (or even if they do not match completely, it is within a predetermined error, for example, within a range of 1 m), the sharing presence / absence determining unit 31 of the sharing source device The communication I / F 11 is controlled so as to transmit the content. The sharing presence / absence determination unit 31 of the sharing destination device controls the communication I / F 11 to transmit the content recorded by itself to the sharing source device that has accepted the content exchange request. Thereby, the content recorded at the same place can be provided to each other between the friend devices, and the memories obtained at the same place can be shared with the friends.

  For example, as shown in FIG. 5 (a), the camera 1a records an image I1, and the incidental information of the image I1 includes shooting position information “aabbb” and shooting date and time “2008/8/1”. Assume that information is recorded. On the other hand, as shown in FIG. 5 (b), the PDA 1c records an image I4. The incidental information of the image I4 includes shooting position information “aaabb” and shooting date / time information “2008/9/1”. Is recorded.

  The PDA 1c determines the camera 1a and the mobile phone 1b as the sharing destination devices. When an image exchange request with the image I1 and its accompanying information attached is transmitted from the camera 1a to the PDA 1c, the PDA 1c receives the position information of the accompanying information of the image I1 and the accompanying information of the image I4. The position information is compared, and it is determined whether or not they match (or whether they are within the predetermined error range even if they do not match completely). Here, since both are “aaabb” and match, the PDA 1c permits the image exchange request, transmits the image I1 to the camera 1a, and also accepts the image I4 from the camera 1a. In this content exchange, the content recording devices 1 may actually transmit and receive content to and from each other. However, if a server is interposed between the content recording devices 1, the sharing destination device The content stored in the server corresponding to the ID of the server and the content stored in the server corresponding to the ID of the sharing source device may be exchanged.

  In this way, it is possible to exchange contents such as images recorded near the same place.

  FIG. 6 shows a fourth usage pattern of the present system. Here, in addition to the content recording device 1 such as the camera 1a and the PDC 1c, the external storage 2 configured by a server computer or the like constitutes the present system. Similar to the system of FIG. 3, each content recording device 1 stores friend device information in the storage unit 12. Here, in the database of the external storage 2, the image I1 uploaded from the camera 1a, the ID “A” of the upload source of the image I1, that is, the sharing source device, and the destination device of the image I1 are designated from the camera 1a. It is assumed that the ID “C” of the PDA 1c is stored as friend device information. Further, it is assumed that the storage unit 12c of the PDA 1c stores the ID “A” friend device information of the camera 1a.

  In the first to third usage forms, the content recording device 1 itself records the friend device information and the content and transmits the content by itself. However, the external storage 2 may substitute the function. . That is, information necessary for access (access information) such as the address of the external storage 2 is stored in the storage unit 12a of the camera 1a, and content sharing for image sharing indicating the ID of the PDA 1c from the PDA 1c to the camera 1a is performed. When requested, the camera 1a connects to the external storage 2 according to the access information, and the ID “C” of the sharing destination device (PDA1c) received from the PDA 1c and the ID “A” of itself (camera 1a that is the sharing source device). To request sharing decision and content transmission accordingly.

  When the external storage 2 receives the request, the external storage 2 refers to the database and extracts the friend device ID corresponding to the sharing source device “A” attached to the request. Then, the extracted friend device ID is compared with the sharing destination device attached to the request, and if the two match, the image or other content corresponding to the extracted friend device ID is displayed as the extracted friend device ID. To the sharing destination device. Here, since the ID “C” of the PDA 1c is extracted as the friend device ID from the database, it matches the ID “C” of the PDA 1c that is the sharing destination device attached to the request of the camera 1a, and is transferred from the external storage 2 to the PDA 1c. The image I1 stored in the database in association with the camera 1a “A” is transmitted. Further, similarly to the sharing source device in the second or third usage mode, the external storage 2 may collate the position information with each other in addition to the friend device ID, and send the images if the two match.

  Although the details are omitted, if the incidental information including the position information is stored in the image I1 and the position information is included in the sharing request from the PDA 1c, the proximity of the positions of the two is compared with the external storage 2. By substituting with, it is possible to determine whether or not the content can be shared according to the proximity of the camera 1a and the PDA 1c, or the proximity of the recording location of the content recorded by both, and the corresponding external storage 2 to the sharing destination device Can be sent.

  In the third or fourth usage mode, the proximity of the position information recorded by both content recording devices 1 is combined with conditions based on parameters other than the position information, and the combination conditions are satisfied. In this case, content may be exchanged for the first time.

  For example, as shown in FIG. 7, the difference D (the distance between both positions) between the shooting position information of the images recorded by the sharing destination device and the sharing source device indicates the number of shots of the images recorded by the sharing destination device and the sharing source device. The conditions based on the absolute value N of the difference (the size of both sheets) are combined. Here, the threshold value for the difference between the shooting positions is D0, and the threshold value for the absolute value of the difference in the number of shots is N0. D0 and N0 are arbitrarily set. For example, D0 = 5 m and N0 = 10. The position check unit 34 compares D and D0, and the sheet number check unit 33 compares N and N0.

  The sharing source device determines whether sharing is possible according to the sharing condition matrix of FIG. 7 stored in the storage unit 12. That is, if D <D0 and N <N0 (condition R1), they are shared. This is because the users of the sharing destination device and the sharing source device are shooting close to each other and acting together, so take similar photos separately regardless of the size difference Save waste.

  If D <D0 and N ≧ N0 (condition R2), share. This is because the users of the sharing destination device and the sharing source device are shooting close to each other and acting together, thereby eliminating the need to take similar pictures separately.

  If D ≧ D0 and N <N0 (condition R3), they are not shared. This is because the users of the sharing destination device and the sharing source device take pictures at a distance from each other and act separately, so that it is more efficient to share after the number of shots of each other has accumulated to some extent.

  If D ≧ D0 and N ≧ N0 (condition R4), they are shared. This is because the users of the sharing destination device and the sharing source device are shooting at a distance from each other, but the number of shots of either one is significantly greater than the other, and the interest of the user who has taken such a lot of shooting This is because a high interest can be shared by sharing with a friend's user.

  If N0 = ∞, it is the same as in FIG. 4 in which sharing / not sharing is determined only by the distance from the shooting location (only by the condition R1 / R3). The matrix in FIG. 7 is merely an example, and it is possible to arbitrarily set which combination of conditions is linked to sharing / not sharing. The contents of the matrix may be arbitrarily set from the operation unit 20 of the sharing source device.

  Alternatively, as a fifth usage mode, the timing check unit 35 of the sharing source device compares the shooting date / time information, the recording date / time information and other recording dates / times of the content recorded by the sharing destination device / share source device, and both are the same. If the error is less than a predetermined value (for example, less than 5 minutes), it is determined to be shared, and if the error is equal to or greater than a predetermined value, it is determined not to be shared. In this way, it is possible to grasp from the shared content where and what the friend is doing when the content is recorded. The sharing destination device may reproduce the content recorded at the same time in association with each other. For example, the sharing destination device may display the image received from the sharing source device and the image recorded at the same recording date and time as the recording date and time recorded in the supplementary information of the image on the display unit 13 in parallel. .

  Further, as a sixth usage mode, when the sharing destination device is included in the shooting range of the image taken by the sharing source device, the image is transmitted to the sharing destination device.

  When a user decides whether or not to share an image with a friend, whether or not the friend is reflected in the image is one of important judgment criteria. Thus, for example, if such a determination is automatically made by a computer, it can be determined whether to share or not to share depending on whether or not the face of the friend is detected from the image. However, for example, as shown in FIG. 8, the image of a friend photographed as the subject SB1 is too small to detect the face of the friend SB1, or the person subject SB2 unrelated to the friend is the face of the friend SB1. If it is misrecognized, there arises a problem that an image to be shared is not shared or an image that may not be shared is shared. Alternatively, as shown in FIG. 9, even if a friend's subject SB3 is included in the image, face detection cannot be performed unless the subject SB3 faces the front, and the image is not shared.

  Therefore, the sharing destination device compares the position information of the sharing destination device with the shooting angle of view of the sharing source device, and if the sharing destination device is within the shooting angle of view, the image shot at the shooting angle of view. Share the destination device.

  Specifically, for example, the sharing source device 1-Y communicates with the sharing destination device prior to the start of imaging by the imaging unit 15-Y, and acquires position information of the sharing destination device. The sharing source device determines the shooting direction based on a difference in position information acquired from a device that detects the shooting direction, for example, an electronic compass that detects geomagnetism, or a plurality of GPS receivers installed at different positions in the sharing source device. It has an estimation device.

  Next, the sharing source device 1-Y has the image capturing range of the image capturing unit 15-Y of the own image capturing unit 15-Y based on the own position information, the imaging direction, and the position information of the sharing destination device 1-X. Judge whether it is in or not. As shown in FIG. 10, the direction of the optical axis l is determined from the imaging direction, and the angle of view θ is based on the optical axis (strictly speaking, there are two types of angle of view: elevation angle and azimuth angle). Based on this, the photographing range R is determined. Then, it is determined whether or not the position information P of the sharing destination device 1-X is included in the shooting range R of the sharing source device 1-Y, and if the position information P is included in the shooting range R, the sharing destination It is determined that the device 1-X is within the imaging range of its own imaging unit 15-Y. As is well known, the focal length of the imaging lens changes according to the zooming amount of the zoom lens of the imaging unit 15-Y, the angle of view θ of the imaging lens also changes, and the imaging range also changes.

  Then, an image showing the position information of the sharing destination device 1-X having the position information P in the shooting range R is generated by the OSD circuit 40-Y, and is superimposed on the through image periodically output by the imaging unit 15-Y. May be displayed on the display unit 13-Y.

  FIG. 11 is an example of a through image. Assume that the through image displayed on the display unit 13 includes two subjects SB4 and SB5, and the location information of the sharing destination device 1-X is located at the location of the subject SB4.

  In this case, if the position information of the sharing destination device 1-X is displayed on the display unit 13-Y, it is convenient for the photographer to recognize that the friend is within the photographing range. The display form of the location information of the sharing destination device may be anything.

  For example, as shown in FIG. 12, the person subject closest to the position information of the sharing destination device 1-X is detected from the through image, and the frame F surrounding the person subject or the shading covering the person subject, etc. A video (friend identification video) for identifying that the detected human subject is a friend is generated by the OSD circuit 40-Y, combined with the through image, and displayed on the display unit 13-Y. A known method (such as edge detection) may be used as a method for detecting a human subject.

  Alternatively, as illustrated in FIG. 13, a graphic G such as an icon or a mark indicating the sharing destination device 1 -X is generated by the OSD circuit 40 -Y, and on the through image corresponding to the position information of the sharing destination device 1 -X. This graphic G is synthesized with the coordinates and displayed on the display unit 13-Y.

  When a plurality of friend device information are registered in the sharing source device and a plurality of content recording devices 1 corresponding to the plurality of friend device information are included in the shooting range, which content recording device 1 from the sharing source device It may be possible to select from the operation unit 20 whether to be a sharing destination device.

  For example, as shown in FIG. 14, the display unit 13 of the sharing source device includes the shooting range of the sharing source device among the content recording devices 1 corresponding to the friend device information registered in the storage unit 12 of the sharing source device. Friend identification videos F1, F2, and F3 corresponding to the position information of all the content recording devices 1 included are displayed.

  As one of the operation units 20, a touch panel laminated on the display unit 13 is prepared, and when the touch panel detects that a desired display portion of the friend identification images F1, F2, and F3 is touched, the touch panel is shared. The presence / absence determination unit 31 determines the content recording device 1 that has sent the position information corresponding to the touched display portion as a sharing destination device, and downloads the desired content in the storage unit 12 to the determined sharing destination Allow to equipment.

  As a seventh usage mode, images are shared according to the relevance of images recorded by the two content recording devices 1.

  For example, it is assumed that a content recording device 1-A captures images X1, X2, and X3 in a shooting scene as shown in FIG. In addition, it is assumed that the content recording device 1-B is registered as friend device information in the content recording device 1-A.

  In this case, as in the first usage pattern, the content recording device 1-A determines that the content recording device 1-B is a sharing destination device according to the registered friend device information, and selects the images X1, X2, and X3. Transmit to the content recording device 1-B. The content recording device 1-B receives the images X1, X2, and X3 and stores them in the storage unit 12. The images X1, X2, and X3 received by the content recording device 1-B from the content recording device 1-A are referred to as sharing candidate images. The sharing candidate image is used only for collation with a check image described later, and the sharing destination device cannot be freely displayed or stored, but the sharing source device completely shares the sharing candidate image with the sharing destination device. If you allow it, it will be possible.

  The content recording device 1 -B displays a through image continuously output by the imaging unit 15 on the display unit 13 in response to the setting of the shooting mode from the operation unit 20. At this time, the image composition enable / disable check unit 36 at a predetermined timing from the through image obtained from the imaging unit 15 (preferably at the same timing as the through image output cycle, but in order to reduce the processing load, The above period may be used) to acquire an image. This image is called a check image.

  The image composition possibility check unit 36-B of the content recording device 1-B collates the check image with the sharing candidate image and determines whether there is an overlapping pixel region. This may be performed in the same manner as the determination of overlapping pixels when a known panoramic image is synthesized. If there is an overlapping pixel area, the image composition possibility check unit 36 notifies the content recording device 1-A via the communication I / F 11 and requests permission for complete sharing of the sharing candidate image. In response to this request, the image compositing availability check unit 36-A of the content recording device 1-A transmits to the content recording device 1-B a notification that the display of the sharing candidate image is permitted. The image compositability check unit 36-B of the content recording device 1-B that has received the notification sets the share candidate image as a shared image, and the OSD circuit 40 displays a video indicating an overlapping area between the shared image and the check image. Generate and combine it with the check image.

  Contrary to the above, a check image is sent from the content recording device 1-B to the content recording device 1-A, and the content recording device 1-A collates the check image with the sharing candidate image, thereby overlapping pixel regions. If there is, the sharing candidate image may be sent to the content recording device 1-B as a shared image. In this way, there is no sharing candidate image that is not permitted to be shared, and unintentional unauthorized use of the image can be prevented.

  In FIG. 16, regions corresponding to the share candidate images X1, X2, and X3 in the through image are indicated by a dotted frame image.

  Alternatively, an overview of the entire photographic scene can be shown using the through image and the shared image.

  For example, it is assumed that the content recording device 1-A records the image X4 as shown in FIG. 17A and the content recording device 1-B acquires the image X5 as shown in FIG. 17B as a through image. . These images have an area OR in which pixels overlap each other. As described above, the content recording device 1-B notifies the content recording device 1-A that there is an overlap, and in response to this, the content recording device 1-A sends permission, so that the image X5 becomes a shared image. It is transmitted from the content recording device 1-A to the content recording device 1-B.

  The image compositability check unit 36 of the content recording device 1-B detects an overlapping area OR between the received image X4 and the through image, and creates a panoramic image W by superimposing the areas OR of the images X4 and X5. Then, the panorama image W is displayed on 13.

  FIG. 18 shows an example of a panoramic image W in which the images X4 and X5 are superimposed. When the panoramic image W is shown as a pop-up screen of a through image already displayed on the display unit 13, it is convenient to compare the relationship between the current shooting range and the overlapping portion of the shared image received from a friend. However, only the panoramic image W may be displayed on the display unit 13.

  The positions and compositions of the illustrated images X1, X2, X3, X4, and X5 are merely examples, and are not limited to those illustrated. The same processing can be performed with two or less shared images. In addition, the image to be compared with the shared image (for example, the image X5 described above) may be a recorded image instead of a through image.

  FIG. 19 shows a flowchart of content sharing processing executed in the present system. This process is controlled by the CPU 30 of the content recording device 1 (share source device). A program defining this processing is stored in the storage unit 12 of the sharing source device. This process is a content that combines the above-described usage forms.

  In S0, a still image or a moving image is captured by the imaging unit 15 in response to an imaging instruction input to the operation unit 20, or a recording is performed by the recording unit 16 in response to a recording instruction input to the operation unit 20, and the obtained content is recorded. Store in the storage unit 12. At the same time, the recording date and time information output from the RTC 18, the recording position information output from the position information acquisition unit 19, and other RAM information (focal length, aperture value, shutter speed, comment, etc.) designated by the CPU 30 are added to the content. Information is stored in the storage unit 12 as header, metadata, or tag information of a file whose content is main body data. However, as long as both are related by identification information etc., you may memorize | store as separate data.

  In S <b> 1, the user information registration unit 32 registers the ID of the friend device input via the operation unit 20, the communication I / F 11, or a portable recording medium in the storage unit 12. The sharing presence / absence determination unit 31 acquires the recording date / time information, the recording position information, and the total number of recorded contents of the content recorded by the sharing destination device from the content recording device 1 having the registered ID of the friend device, that is, the sharing destination device. To do. However, in the sharing destination device, the content recording process must be performed as in S0.

  In S2, the position check unit 34 compares the recording position information of the incidental information of the content stored in its own storage unit 12 with the recording position information acquired from the sharing destination device, and the difference between the two is within a predetermined error range. It is determined whether or not they are substantially the same. If yes, go to S3, if no, go to S5.

  In S3, the number check unit 33 compares the total number of contents stored in the storage unit 12 of the sharing source device with the total number of content recordings acquired from the sharing destination device, and the absolute value of the difference between them is a predetermined threshold value. It is determined whether this is the case. If Yes, the process proceeds to S6. If No, the process proceeds to S4. The number of images is not limited to the number of still images, and may be the number of moving images or the number of audio files.

  In S4, the image composition possibility check unit 36 of the sharing destination device determines whether or not there is an overlapping area between the share candidate image and the through image or the recorded image. Then, the image compositability check unit 36 of the sharing destination device transmits a sharing permission request according to the determination. The timing check unit 35 of the sharing source device determines whether or not a sharing permission request has been received. If yes, go to S6, if no, go to S5.

  In S5, the timing check unit 35 compares the recording date / time information of the supplementary information of the content stored in its own storage unit 12 with the recording date / time information acquired from the sharing destination device, and the difference between the two is within a predetermined range. It is judged whether it is in. If yes, go to S3, if no, go to S5. Since it is rare that all of the recording date / time information (year / month / day / minute / second) matches, it may be possible to set in advance from the operation unit 20 which part is determined to match. For example, the parameters are determined by comparing parameters of years, months, days, years and months, years, months and days.

  In S6, the content is sent from the sharing source device to the sharing destination device. As described above, when there are a plurality of sharing destinations, a desired one is selected from them and the content is sent only to the selected device. If it is determined Yes in S4 and the process proceeds to S6, a sharing permission is transmitted.

  In S7, content is not sent from the sharing source device to the sharing destination device. If it is determined No in S4 and S5 and the process proceeds to S7, sharing permission is not transmitted.

  Except for S4, the type of content recorded by the sharing destination device and the type of content recorded by the sharing destination device may be the same or different. For example, one recorded content is still image, the other is audio, one is still image, the other is video, one is video, the other is audio, or both are still images, audio, video Any of the cases may be used. However, in order to simplify the shared contents, both may share only when the same type of contents is acquired.

  The determinations of S2, S3, S4, and S5 can be arbitrarily combined as a logical sum or a logical product. For example, in FIG. 19, if Yes in S5, the process proceeds to S6. However, if Yes in S5 and the same determination as in S3 is performed (Yes), the process may proceed to S6. It is only an example.

<Other embodiments>
The sharing destination device does not need to include the imaging unit 15 and the recording unit 16 except when the sharing destination device is the sharing source device. Further, when the shared device does not display content or reproduce sound, it is not necessary to have the display unit 13 or the audio processing circuit 17. For example, the external storage 2 as shown in FIG. 6 is an example.

  Furthermore, the content recording devices 1 do not have to be directly connected to each other. For example, as shown in FIG. 20, a camera 1a that is a sharing source device and a PDA 1c that is a sharing destination device are connected via an external storage 2. Then, the shared image once uploaded to the external storage 2 from the camera 1a may be downloaded to the PDA 1c and used for various uses such as image browsing and audio reproduction.

  The contents of the processes executed by the sharing presence / absence determination unit 31, the user information registration unit 32, the number check unit 33, the position check unit 34, the timing check unit 35, and the image composition possibility check unit 36 are directly related to content recording. Since it is not related, it can be executed by a general computer other than the content recording device 1, for example, an information processing device (CPU and RAM or other peripheral devices) of the external storage 2.

  In the above embodiment, the status information such as the recording position information and recording time information of the content acquired from the sharing destination device is compared with the status information such as the recording position information and recording time information of the content of the sharing source device. If the two match, they were sharing. However, in this situation information, in addition to recording position information and recording time information, the content of the sharing source device is accessed from the sharing destination device, downloaded or actually played back (if it is an image or text, it is displayed on the display unit 13 of the sharing destination device. It is also possible to include the current time information output from the RTC 18 or the current position information output from the position information acquisition unit 19 when there is a display or sound (reproduction in the sound processing circuit 17 of the sharing destination device). The information processing unit 30 of the sharing source device or the sharing destination device records the current time information and the current position information as incidental information of the content when the content is accessed or actually downloaded from the sharing destination device. By doing so, it is possible to determine whether or not to collate with the status information acquired from another device and to share the content according to the collation.

  In this way, in addition to the incidental information at the time of content recording, if the content was shared according to the collation result of the incidental information recorded at the time of content sharing or browsing, it was seen, heard or shared with someone You can share the content with someone else.

Schematic configuration diagram of content sharing system Block diagram of content recording equipment The figure which shows the 1st usage pattern of this system Diagram showing the second usage pattern of this system Diagram showing the third usage pattern of this system Diagram showing the fourth usage pattern of this system Diagram showing an example of a sharing condition matrix The figure which shows an example of the image which made the friend the subject The figure which shows another example of the image which made the friend a subject A diagram schematically showing the shooting range Diagram showing an example of a through image A figure showing an example of a friend identification image The figure which shows an example of the graphic which shows a share destination apparatus The figure which shows an example of several friend identification image | video Diagram showing an example of a shooting scene The figure which illustrated the through picture in which the field equivalent to a share candidate picture is shown with the picture of the dotted frame The figure which shows an example of the through image which the image which the share origin apparatus recorded, and the share destination apparatus acquired Diagram showing an example of a panoramic image Flow chart of content sharing process A diagram showing an example of a sharing source device and a sharing destination device connected via an external storage

Explanation of symbols

1: Content recording device, 11: Data transmission / reception unit (communication I / F), 12: Storage unit, 13: Display unit, 15: Imaging unit, 16: Recording unit, 17: Audio processing circuit, 18: RTC, 19: Position information acquisition unit, 20: operation unit, 30: CPU

Claims (12)

A content recording unit for recording content including at least one of image and sound;
A content status information recording unit that records content status information related to a status including at least one of at the time of recording, browsing, and sharing of content by the content recording unit, in association with the content;
An output unit capable of outputting the content to another device;
An input unit for inputting current or past situation information acquired by the other device;
The status information of the other device input by the input unit is compared with the content status information recorded by the content status information recording unit, and the content recorded by the content recording unit is compared with the other device according to the comparison result. A control unit that controls the output unit to output to
A content output device comprising: The content status information includes location information at the time of recording the content,
The status information of the other device includes current position information,
The control unit is configured to record content recorded by the content recording unit based on a distance between position information of another device input by the input unit and position information recorded by the content status information recording unit. The content output device according to claim 1, wherein the output unit is controlled so as to output to the content. The content status information includes location information at the time of recording the content,
The status information of the other device includes position information at the time of recording content by the other device,
The control unit determines the content recorded by the content recording unit according to whether or not the position information of another device input by the input unit matches the position information recorded by the content status information recording unit. The content output apparatus according to claim 1, wherein the output unit is controlled to output to a device.   The control unit outputs the content recorded by the content recording unit to the other device according to a difference between the total number of content recorded by the content recording unit and the total number of content recorded by position information of the other device. The content output apparatus according to claim 3, wherein the output unit is controlled.   The control unit determines the content recorded by the content recording unit according to the proximity of the position information when the content recording unit records the content and the position information when the other device records the content. The content output device according to claim 3, wherein the output unit is controlled so as to output to the other device. The content status information includes date and time information at the time of recording the content,
The status information of the other device includes date and time information at the time of recording the content by the other device,
The control unit determines the content recorded by the content recording unit according to whether the date / time information of another device input by the input unit matches the date / time information recorded by the content status information recording unit. The content output apparatus according to claim 1, wherein the output unit is controlled to output to a device. The content recording unit includes an imaging unit for recording an image,
The control unit determines whether or not the other device exists within the imaging range of the image recorded by the imaging unit, and determines the image recorded by the imaging unit according to the result of the determination. The content output device according to claim 1, wherein the output unit is controlled so as to output to the content. The content recording unit includes an imaging unit for recording an image,
The control unit determines whether an image recorded by the imaging unit and an image acquired by the other device have an overlapping portion, and the image recorded by the imaging unit is determined according to the determination result. The content output apparatus according to claim 1, wherein the output unit is controlled to output to the other device. A registration unit for registering identification information of a desired device;
The input unit inputs identification information of the other device,
The control unit determines whether the identification information registered by the registration unit matches the identification information input by the input unit, and the content recorded by the content recording unit is determined according to a result of the determination. The content output device according to claim 1, wherein the output unit is controlled to output to another device. Computer
Recording content including at least one of image and sound;
Recording content status information related to a status including at least one of when recording, browsing, and sharing the content in association with the content;
Inputting the current or past status information acquired by the other device;
Comparing the input status information of the other device with the recorded content status information, and outputting the recorded content to the other device according to the result of the comparison;
Content output method to execute.   A program causing a computer to execute the content output method according to claim 10. The content output device according to any one of claims 1 to 9,
Another device for inputting status information to the content output device;
Content output system including

Images