JP2020144378A - Head-mounted display device - Google Patents

Abstract

To improve usability of an image capturing device in a content viewing environment while protecting content.SOLUTION: A head-mounted display device is provided, comprising: an image information acquisition unit configured to acquire image information generated through photoelectric conversion; an image storage processing unit configured to generate an image file based on the acquired image information and store the file in a storage medium; and a control unit configured to control to bring about a state where acquisition of image information is possible but storage of a corresponding image file is prohibited.SELECTED DRAWING: Figure 5

Description

The present invention relates to an imaging device and an imaging system.

As a background technology in this technical field, there is Japanese Patent Application Laid-Open No. 2012-234086 (Patent Document 1). This publication includes "a receiving unit that receives a signal that prohibits a specific operation transmitted from an external device and an imaging unit that captures a subject image, and the specific operation is prohibited according to the signal, and the specific operation is imaged. It is characterized by an imaging operation of a unit. "

Japanese Unexamined Patent Publication No. 2012-234086

Content such as images shown in movie theaters, live scenes at concert venues, and paintings exhibited in museums are protected by copyrights and are often prohibited from being filmed. In an environment where such content for which shooting is prohibited is viewed, voyeurism of the content is regarded as a problem.

In Patent Document 1, for the purpose of preventing content voyeurism, a radio wave carrying a predetermined prohibition signal is transmitted from a transmitting device into a predetermined shooting prohibited area, and when the prohibition signal is received, shooting is prohibited. An imaging device has been proposed.

However, in the image pickup apparatus disclosed in Patent Document 1, since the acquisition of image information from the camera module is completely prohibited in the shooting prohibited area, the information obtained by acquiring the image information cannot be obtained, which is convenient. Is bad. For example, the image pickup apparatus disclosed in Patent Document 1 acquires image information of a subject such as a painting through a camera module in a museum or the like where photography of contents is prohibited, and obtains augmented reality (AR). Cannot be used to superimpose and display information about the subject on the subject.

The present invention has been made in view of the above problems, and an object of the present invention is to improve the convenience of an imaging device while protecting the contents in an environment in which the contents are viewed.

In order to solve the above problems, the present invention includes a control unit that can acquire image information and controls the storage of the image file in a restricted state.

According to the present invention, it is possible to improve the convenience of the imaging device while protecting the content in an environment in which the content is viewed. Issues, configurations and effects other than those described above will be clarified by the description of the following embodiments.

It is a figure which shows the example of the operation form of the image pickup system which concerns on embodiment of this invention. It is a block diagram which illustrates the hardware composition of the image pickup apparatus 1 which concerns on embodiment of this invention. It is a block diagram which illustrates the functional structure of the image pickup apparatus 1 which concerns on embodiment of this invention. It is a figure which illustrates the kind of the processing restriction state by the image pickup unit and the image processing unit which concerns on embodiment of this invention. It is a flowchart which illustrates the control operation based on the restriction signal by the control part which concerns on embodiment of this invention. It is a figure which illustrates the operation state display image which concerns on embodiment of this invention. It is a figure which illustrates the display screen which is displayed on the display part of the image pickup apparatus according to the operation state which concerns on embodiment of this invention. It is a block diagram which illustrates the functional structure of the information processing apparatus which concerns on embodiment of this invention. It is a figure which illustrates the position information list which concerns on embodiment of this invention. It is a figure which illustrates the operation mode of the image pickup system which connects an image pickup apparatus and an information processing apparatus via the base station which concerns on embodiment of this invention. It is a figure which illustrates the MAC address list which concerns on embodiment of this invention. It is a flowchart which illustrates the operation of each component part of the information processing apparatus in the case of storing the captured image which was imaged and generated by the imaging apparatus which concerns on embodiment of this invention in the information storage part of an information processing apparatus. (A) is a figure exemplifying a captured image imaged and generated by the imaging unit according to the embodiment of the present invention, and (b) illustrates a restored image obtained by restoring the captured image of (a). It is a figure. It is a flowchart which illustrates the operation of each component part of the information processing apparatus which concerns on Example 2 of Embodiment of this invention. An example shows the operation of the information processing device when a specific information processing device different from the information processing device that performs the image restoration processing and the image analysis processing according to the second embodiment of the present invention is connected via a network. It is a flowchart. It is a block diagram which illustrates the functional structure of the image pickup apparatus which concerns on Example 3 of Embodiment of this invention. It is a flowchart which illustrates the operation of the optical information processing unit and the control unit which concerns on Example 3 of the Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The following description is for explaining one embodiment of the present invention, and does not limit the scope of the present invention. Therefore, those skilled in the art can adopt embodiments in which each or all of these elements are replaced with equivalent ones, and these embodiments are also included in the scope of the present invention.

[Example 1]
Hereinafter, Example 1 will be described in detail with reference to the drawings. FIG. 1 is a diagram showing an example of an operation mode of the imaging system according to the present embodiment. As shown in FIG. 1, the imaging system according to the present embodiment is configured by connecting the imaging device 1 and the information processing device 2 via a network 4 such as the Internet or a LAN (Local Area Network).

For example, when the image pickup device 1 and the information processing device 2 are connected by a wireless LAN, the image pickup device 1 communicates with the access point 3 as shown in FIG. The access point 3 connects to the network 4 via a router (not shown). As a result, the image pickup device 1 and the information processing device 2 are connected via the network 4 to transmit and receive information such as an image signal.

The image pickup apparatus 1 has an image pickup function, and generates an image capture image by imaging an image pickup target which is a subject. The image pickup device 1 is, for example, a wearable terminal such as an HDMI (Head Mounted Display) equipped with a camera or a wristwatch type terminal, a mobile terminal provided with a camera, and a digital camera.

The information processing device 2 is a device that processes an captured image transmitted from the imaging device 1. For example, the information processing device 2 generates display information for displaying information about a subject included in the received captured image on the display unit of the image pickup device 1 by augmented reality (AR), or the received captured image. Is stored in a storage medium, an external server, etc., and captured images are stored.

Next, the hardware configuration constituting the imaging device 1 and the information processing device 2 included in the imaging system according to the present embodiment will be described. FIG. 2 is a block diagram illustrating a hardware configuration of the image pickup apparatus 1 according to the present embodiment. Although FIG. 2 shows the hardware configuration of the image pickup apparatus 1, the information processing apparatus 2 has the same configuration. The image pickup device 1 includes an engine for realizing an image pickup function and the like in addition to the hardware configuration shown in FIG.

As shown in FIG. 2, the image pickup apparatus 1 according to the present embodiment has the same configuration as a general PC (Personal Computer), a server, or the like. That is, in the image pickup apparatus 1 according to the present embodiment, the CPU (Central Processing Unit) 10, the RAM (Random Access Memory) 20, the ROM (Read Only Memory) 30, the HDD (Hard Disk Drive) 40, and the I / F 50 are bus 80s. It is configured to be connected via. Further, an LCD (Liquid Crystal Display) 60 and an operation unit 70 are connected to the I / F 50.

The CPU 10 is a calculation means and controls the operation of the entire image pickup apparatus 1. The RAM 20 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 10 processes information. The ROM 30 is a read-only non-volatile storage medium, and stores programs such as firmware. The HDD 40 is a non-volatile storage medium capable of reading and writing information, and stores an OS (Operating System), various control programs, application programs, and the like.

The I / F 50 connects and controls the bus 80 with various hardware, networks, and the like. The LCD 60 is a visual user interface for the user to confirm the state of the imaging device 1. The operation unit 70 is a user interface for the user to input information to the image pickup apparatus 1, such as a keyboard, a mouse, various hard buttons, and a touch panel. When the information processing device 2 is operated as a server for image processing, these user interface devices can be omitted.

In such a hardware configuration, the software control unit is configured by the CPU 10 performing an operation according to a program stored in the ROM 30 or a program read in the RAM 20. The combination of the software control unit and the hardware configured in this way constitutes a functional block that realizes the functions of the image pickup device 1 and the information processing device 2 included in the image pickup system according to the present embodiment.

Next, the function of the image pickup apparatus 1 according to the present embodiment will be described. FIG. 3 is a block diagram illustrating the functional configuration of the image pickup apparatus 1 according to the present embodiment. As shown in FIG. 3, the image pickup apparatus 1 includes a control unit 101, a voice processing unit 102, a voice input / output unit 103, a communication processing unit 104, a communication input / output unit 105, a position information processing unit 106, and a position information input unit 107. It includes an image processing unit 108, an imaging unit 109, a display control unit 110, and an image storage unit 111.

Further, the communication input / output unit 105 is composed of 105a, 105b, and 105c. The communication input / output units 105a, 105b, and 105c are described as using different communication methods, but are not limited to three types. Communication methods include those that connect to networks via wireless LAN and communication base stations of mobile phone companies, short-range wireless communication such as Bluetooth (registered trademark) and IC (Integrated Circuit) tags, and ETC (Electronic Toll Collection System). ) Etc., such as dedicated narrow-range communication, etc., may be used.

Further, in the present embodiment, a case where the image pickup device 1 is directly connected to the network to exchange information will be described, but another information display terminal (not shown) connects to the network, and the information display terminal and the image pickup device 1 are connected. The imaging device 1 may be configured to indirectly connect to the network by communicating with and.

The control unit 101 controls to limit the processing by the image processing unit 108 and the imaging unit 109 by exchanging information with the image processing unit 108, the voice processing unit 102, the position information processing unit 106, and the communication processing unit 104. The image processing unit 108 and the image pickup unit 109 are controlled based on the acquired restriction signal and the release signal for releasing the restriction of processing by the limit signal. Details of the limit signal and the release signal will be described later.

The voice processing unit 102 acquires voice information input from a voice input / output unit 103 such as a microphone or earphone. Further, when the acquired voice information is a limit signal or a release signal, the voice processing unit 102 outputs it to the control unit 101. Details of the acquisition of the limit signal or the release signal by the voice processing unit 102 will be described later.

The communication processing unit 104 exchanges information with other devices such as the information processing device 2 connected via the network via the communication input / output unit 105, and also exchanges information with each component of the image pickup device 1. .. Further, when the acquired information is a limit signal or a release signal, the communication processing unit 104 outputs the information to the control unit 101. Details of the acquisition of the limit signal or the release signal by the communication processing unit 104 will be described later.

The position information processing unit 106 acquires the position information input from the position information input unit 107 such as GPS (Global Positioning System). Further, when the position information processing unit 106 acquires the limit signal or the release signal based on the acquired position information, the position information processing unit 106 outputs it to the control unit 101. Details of the acquisition of the limit signal or the release signal by the position information processing unit 106 will be described later.

The image capturing unit 109 is an image information acquisition unit that acquires an image signal of a subject as image information under the control of the control unit 101. Specifically, the image pickup unit 109 generates and acquires an image signal by converting the image of the subject into an electric signal by photoelectric conversion, and outputs the image signal to the image processing unit 108. Hereinafter, in the present embodiment, the process of acquiring the image signal generated by the photoelectric conversion by the imaging unit 109 will be referred to as “imaging process”. Further, the captured image information which is an image signal generated by photoelectric conversion is referred to as an “captured image”.

Further, when the image pickup unit 109 is controlled by the control unit 101 by the limit signal, the image pickup process is prohibited. For example, when the control unit 101 stops transmitting the image pickup command signal to the image pickup unit 109, the image pickup unit 109 does not perform the image pickup process. Further, when the control unit 101 controls by the release signal, the image pickup unit 109 releases the restricted state of the image pickup process.

The image processing unit 108 determines whether or not the captured image output from the imaging unit 109 contains a limiting signal. When the captured image contains a limit signal, the image processing unit 108 outputs the limit signal to the control unit 101. The details of the mode in which the captured image includes the limiting signal will be described later. If the captured image contains a limiting signal, the image processing unit 108 processes the acquired captured image based on the limiting signal.

For example, the image processing unit 108 generates an image file, which is a data format managed by the file system, based on the acquired captured image, and stores it in the image storage unit 111, which is a storage medium. In the present embodiment, the process in which the image processing unit 108 generates an image file based on the captured image and stores it in the storage medium is referred to as “image storage process”. That is, the image processing unit 108 functions as an image storage processing unit.

The image information acquired by the image pickup process by the image pickup unit 109 described above is, for example, data temporarily stored in the RAM 20 or the like in order to generate information for performing AR display. On the other hand, the image file stored in the storage medium by the image storage process by the image processing unit 108 is data stored in the HDD 40 or the like and can be viewed as a file. In the present embodiment, a process of acquiring image information (imaging process) and a process of generating an image file from the image information and storing it in a storage medium (image storage process) are distinguished, and each of these processes is used as a limiting signal. It is the gist of the present embodiment to limit accordingly. Details of processing of the captured image based on the restriction signal by the image processing unit 108 will be described later.

When the image processing unit 108 generates an image file from the image information, the image processing unit 108 may generate the image file by converting the image information into the file system format as it is, or may perform some compression processing or the like on the image information. The image file may be generated after the processing. Further, in the following description, the image file stored in the image storage unit 111 by the image storage process is also referred to as "captured image". That is, the fact that the image processing unit 108 stores the captured image in the image storage unit 111 means that the captured image is stored in the image storage unit 111 in the form of an image file.

Further, when the control unit 101 controls the image processing unit 108 by the limit signal, the image processing unit 108 processes the captured image according to the control. The processing of the captured image according to the control by the control unit 101 is the same as the processing of the captured image based on the limiting signal included in the captured image, and the details will be described later.

Further, the image processing unit 108 acquires image information from the communication processing unit 104 and the image storage unit 111, and performs processing according to the acquired image information. For example, when the image processing unit 108 is display information for displaying information about a subject acquired by the imaging unit 109, the image processing unit 108 generates a display image based on the display information and causes the display control unit 110 to generate a display image. And output.

Further, for example, when additional information is added to the acquired image, the image processing unit 108 transmits the captured image to another device via the communication processing unit 104 according to the additional information. The display control unit 110 outputs the captured image, and the image storage unit 111 stores the captured image. The details of the processing according to such additional information will be described later.

The display control unit 110 acquires the image information input from the image processing unit 108, and displays the acquired image information on a display unit such as an LCD 60. The image storage unit 111 is a storage medium for storing the captured image input from the image processing unit 108. In the present embodiment, the case where the image storage unit 111 is included in the image pickup device 1 has been described as an example, but this is an example. The image pickup device 1 is provided with an interface for a storage medium, and an SD card or the like is provided. The captured image may be stored in an external storage medium.

Next, the details of the restriction signal acquired by the control unit 101 from the voice processing unit 102, the communication processing unit 104, the position information processing unit 106, and the image processing unit 108 will be described. FIG. 4 is a diagram illustrating the types of processing restricted states by the image pickup unit 109 and the image processing unit 108. As shown in FIG. 4, the restricted state of the imaging process by the imaging unit 109 and the image storage processing by the image processing unit 108 is predetermined according to the value of the limiting signal, and is not shown in a state in which the control unit 101 can refer to it. It is stored in a storage medium or the like.

As shown in FIG. 4, when the limiting signal is not acquired (“−”) or “0”, the imaging unit 109 can perform both imaging processing and image storage processing, and this state is referred to as “normal operating state”. And. When the limiting signal is "1", both imaging processing and image storage processing are possible, but at the time of image storage processing, a specific command is added to the captured image to be stored and stored in the image storage unit 111. This state is referred to as "specific operation state 1".

The specific command is information indicating the limitation of processing on the captured image. For example, the captured image stored in the image storage unit 111 is transmitted to another device connected to the network via the communication processing unit 104. This is a command for prohibiting the above and a command for viewing only by the user who owns the image pickup apparatus 1. In addition, for example, the specific command can transmit the captured image to another device connected to the network via the communication processing unit 104, but personal authentication (for example, user ID and password) is used to view the captured image. Is a necessary request or a command to block other devices that have received a signal from being published on the Internet. That is, the captured image to which the specific command is added is stored in the image storage unit 111 only for personal use. Further, the specific command includes information on the limiting signal acquired by the control unit 101 from the voice processing unit 102 or the like.

By storing the captured image to which the specific command is added as additional information in the image storage unit 111 in this way, it is possible to prevent the content stored as the captured image from leaking and protect the content. The method of adding the specific command may be any method as long as it is paired with the captured image, such as adding it to the header portion of the captured image.

When the limiting signal is "2", the image pickup process is possible, but the image storage process is not possible, and this state is referred to as "specific operation state 2". When the limiting signal is "3", neither imaging processing nor image storage processing is possible, and this state is referred to as "specific operation state 3". The control unit 101 identifies which of the operating states shown in FIG. 4 the acquired limiting signal is, and operates the image pickup unit 109 and the image processing unit 108 so as to operate according to the specified state. To control. That is, the restriction signal is restriction information indicating a combination of the presence / absence of restriction in each of the imaging process and the image storage process, and the control unit 101 functions as a restriction information acquisition unit for acquiring the restriction information.

As described above, for example, it is a gist of the embodiment of the present invention to control the operation state of each of the image pickup process by the image pickup unit 109 and the image storage process by the image processing section 108 according to the type of the limitation signal described above. .. Next, the processing of the control unit 101 that performs such control will be described. FIG. 5 is a flowchart illustrating a control operation based on the limit signal by the control unit 101.

As shown in FIG. 5, the control unit 101 controls the image pickup unit 109 and the image processing unit 108 as the “normal operation state” shown in FIG. 4 in an initial state such as when the power is turned on to the image pickup device 1 (S501). ). The control unit 101, which controls the image pickup unit 109 and the image processing unit 108 as the “normal operation state”, waits (S502 / NO) until the limit signal is acquired from the audio processing unit 102 or the like (S502 / YES).

When the control unit 101 acquires the limit signal (S502 / YES), the control unit 101 determines whether or not the acquired limit signal is “1” (S503). When the acquired limit signal is "1" (S503 / YES), the control unit 101 controls the image processing unit 108 as the "specific operation state 1" shown in FIG. 4 to specify the acquired image. A command is added to set the image storage unit 111 in a restricted state (S504).

On the other hand, when the acquired restriction signal is not "1" (S503 / NO), the control unit 101 controls the image processing unit 108 to prohibit the image storage unit 111 from storing the acquired captured image ( S505). When the limiting signal is not "1", the specific operation state is "specific operation state 2" or "specific operation state 3", and it is prohibited to store the acquired captured image in the image storage unit 111. Is.

When the acquired limit signal is "3" (S506 / YES), the control unit 101 that controls the image storage unit 111 for prohibiting the storage of the captured image has the "specific operation state 3" shown in FIG. The image pickup unit 109 is controlled so that the image pickup process cannot be executed (S507).

On the other hand, when the acquired limit signal is "2" (S506 / NO), the control unit 101 controls the image pickup unit 109 to a state in which the image pickup process can be executed as the "specific operation state 2" shown in FIG. To do. That is, for example, in a museum, when a user uses the image pickup device 1 to image a painting as a subject by the image pickup device 109, it is possible to display information on the imaged painting on the display unit or the like of the image pickup device 1 by AR. However, the captured image of the captured painting cannot be stored in the image storage unit 111.

The control unit 101, which controls to limit the processing operations of the imaging unit 109 and the image processing unit 108 according to the acquired restriction signal, displays the operation state indicated by the acquired restriction signal to the image processing unit 108. Notify to generate the operation state display image of (S508).

FIG. 6 is a diagram illustrating an operating state display image. As shown in FIG. 6, the operating state display image is, for example, an imaging process by an icon 600 with a key mark and an imaging unit 109 in the shape of a floppy disk indicating that a specific command is added during the storage processing of the captured image. The image pickup icon 601 indicating a state in which the image is possible, the storage prohibition icon 602 in which the storage process of the captured image is prohibited, and the image pickup prohibition icon 603 in which the image pickup process by the image pickup unit 109 is prohibited.

FIG. 7 is a diagram illustrating a display screen displayed on the display unit of the image pickup apparatus 1 according to the operating state. The image processing unit 108 generates an icon of the operation state display image shown in FIG. 6 according to the operation state indicated by the restriction signal acquired by the control unit 101, and displays the icon on the LCD 60 or the like via the display control unit 110. For example, on the display screen shown in FIG. 7, since the image pickup icon 601 and the storage prohibition icon 602 are displayed, the operation state is “specific operation state 2”.

In addition, when the operating state is "specific operating state 1", the icon 600 with a key mark and the imaging icon 601 are displayed, and when the operating state is "specific operating state 3", the storage prohibition icon 602 and the imaging prohibition icon 603 are displayed. Will be done.

Then, when the control unit 101 acquires the release signal from the voice processing unit 102 or the like (S509 / YES), the control unit 101 releases the specific operation state by the acquired restriction signal (S510), and ends the process. The release signal is a signal for releasing a specific operation state different from the restriction signal input from the voice processing unit 102 or the like. In addition, the release signal may be a limit signal having a value of "0".

On the other hand, when the control unit 101 does not acquire the release signal (S510 / NO), a predetermined time (for example, 2 hours) has elapsed since the transition from the normal operation state to the specific operation state. When not (S511 / NO), the specific operating state is maintained. On the other hand, even when the control unit 101 does not acquire the release signal (S510 / NO), when the time from the transition from the normal operation state to the specific operation state elapses for a predetermined time (S511 /). YES), the specific operating state based on the acquired limiting signal is released (S510).

The predetermined time may be a fixed time, but time information may be added to the limit signal acquired by the control unit 101. As a result, the control unit 101 can set the time for maintaining the specific operating state based on the added time information. Therefore, for example, the control unit 101 maintains the specific operating state according to the screening time of the movie in the movie theater. Can be done. Further, in the present embodiment, a case where the specific operation state is released when a predetermined time elapses after the transition from the normal operation state to the specific operation state has been described as an example. In addition, the specific operating state may be released when the imaging device 1 is separated from the position where the imaging device 1 has transitioned to the specific operating state to a position equal to or longer than a predetermined distance.

Next, the details of the acquisition processing of the restriction signal and the release signal by the voice processing unit 102, the image processing unit 108, the communication processing unit 104, and the position information processing unit 106 will be described.

The voice processing unit 102 analyzes the voice information input from the voice input / output unit 103. More specifically, when a high-frequency voice that is difficult for the human ear to hear is input, the voice processing unit 102 acquires the voice information as a limit signal and a release signal. Since the frequency of sound that can be heard by humans is approximately 20 Hz to 20 kHz, for example, a sound having a frequency in the vicinity of 20 kHz is input as a limit signal or a release signal. Further, by changing the frequency of the input sound, maintaining the frequency of the input sound, and giving a change such as a sound generation cycle, that is, repeating ON / OFF of the input sound in time, a plurality of identifications described above can be specified. It becomes possible to correspond to the operating state.

By installing the device that generates such sound at the entrance gate of the environment for viewing the content protected by the copyright or the like, the image pickup device 1 can be transitioned to the specific operating state without contact. Further, by installing a device that generates a sound corresponding to the release signal at the exit gate, it is possible to transition the image pickup device 1 from the specific operation state to the normal operation state without contact.

The image processing unit 108 analyzes the captured image acquired from the imaging unit 109. More specifically, when a specific image object is detected from the captured image, it is acquired as a limiting signal. For example, the specific image object includes two-dimensional information such as a QR code (registered trademark) (Quick Response Code) indicating imaging prohibition, an imaging prohibition mark, an imaging prohibition character, or the like. In particular, when presenting video information such as in a movie theater, the imaging device 1 is transitioned to a specific operating state by inserting an image for prohibiting imaging once in several frames in the video content to prevent spy shots. It becomes possible to do. Since the imaging frequency of the imaging unit and the frame frequency of the video content are generally different, it is necessary to insert the image for prohibiting imaging in the video content multiple times, but it is almost imperceptible to the human eye. It is possible to prevent voyeurism without any problem.

Further, the specific image object may include a storage processing prohibition mark and a storage processing prohibition character of the captured image. The image processing unit 108 acquires a limiting signal corresponding to the combination of these objects from the captured image. In addition, the specific image object may be a digital watermark. When the captured image contains a digital watermark, it looks the same as the original data at first glance, but when the image processing unit 108 detects the digital watermark by performing the digital watermark detection process, the detected digital watermark Information is acquired as a limiting signal.

Further, the image processing unit 108 uses the detected specific object as, for example, two-dimensional information such as a QR code indicating imaging permission, an imaging permission mark, an imaging permission character, a storage processing permission mark, a storage processing permission character, or the like. If there is, the detected specific object is acquired as a release signal.

The communication processing unit 104 passively or actively acquires the limit signal and the release signal. An example of using an IC tag as a communication method that operates passively will be described. When the IC tag is used, the limit signal and the release signal can be transmitted to the image pickup apparatus 1 without contact. More specifically, the passively operating communication method is a method using electromagnetic induction defined by ISO / IEC18000-3 or a method using the UHF band established by SO / IEC18000-3.

By installing such an IC tag and a device for transmitting and receiving data at the entrance gate of an environment for viewing copyright-protected content, it is possible to transition the imaging device 1 to a specific operating state without contact. It becomes. Further, by installing a device for transmitting and receiving IC tags and data at the exit gate, it is possible to shift the imaging device 1 from a specific operating state to a normal operating state without contact. In the present embodiment, the communication using the IC tag has been described, but this is an example, and any communication method may be used as long as the image pickup apparatus 1 passively operates.

Further, as an example of a communication method that actively operates, an acquisition process using a wireless LAN will be described. When using a wireless LAN, the communication processing unit 104 can confirm the ESID and modulation method of the access point by another device by acquiring the beacon signal transmitted from the access point 3. In the case of the network configuration as shown in FIG. 1, the imaging device 1 actively acquires the beacon signal transmitted from the access point 3, and after mutual confirmation of the ESID and the modulation method, authentication, association, and data exchange are performed. After that, it connects to the network 4. Here, by multiplexing the limit signal and the release signal in the beacon signal, the image pickup apparatus 1 can actively acquire the limit signal and the release signal.

The position information processing unit 106 acquires a limit signal and a release signal via the information processing device 2. FIG. 8 is a block diagram illustrating the functional configuration of the information processing device 2 according to the present embodiment. As shown in FIG. 8, the information processing device 2 includes a communication processing unit 201, an image processing unit 202, a control unit 203, a communication input / output unit 204, and an information storage unit 205.

The position information processing unit 106 outputs the position information acquired to the communication processing unit 104 via the control unit 101. The communication processing unit 104 transmits position information to the information processing device 2 via the communication input / output unit 105. The communication processing unit 201 of the information processing device 2 acquires the position information transmitted from the image pickup device 1 via the communication input / output unit 204 and outputs the position information to the control unit 203.

The control unit 203 refers to the acquired position information and the position information list stored in the information storage unit 205, and determines whether to transmit the limit signal or the release signal to the image pickup apparatus 1. FIG. 9 is a diagram illustrating a location information list. As shown in FIG. 9, the position information list is configured by associating position information (for example, longitude / latitude) and signal type. When the control unit 203 has a signal type that matches the acquired position information in the position information list shown in FIG. 9, the control unit 203 transmits the signal of the signal type to the image pickup apparatus 1. When the information processing apparatus 2 transmits a limit signal or release signal, the position information processing unit 106 acquires the transmitted limit signal or release signal and outputs the transmitted limit signal or release signal to the control unit 101.

In this way, the control unit 101 acquires the restriction information based on the input information input according to the place where the imaging process is performed, such as voice information, captured images, wireless signals such as IC tags and beacons, and position information. To do.

As described above, the image pickup apparatus 1 according to the present embodiment can acquire the image captured by the image pickup unit 109, and the storage process of the image file generated based on the image captured by the image processing unit 108 is limited. Control to the state. That is, according to the image pickup apparatus 1 according to the present embodiment, in an environment for viewing content for which shooting is prohibited, image information of the content is acquired via the image pickup unit 109, and the content is related based on the image information. Although the information can be acquired, the image file of the acquired image information cannot be generated and saved, and the content cannot be viewed or distributed later. This makes it possible to improve the convenience of the image pickup device while protecting the content in the environment in which the content is viewed.

In the present embodiment, as shown in FIG. 5, the initial state of the image pickup apparatus 1 is set to the “normal operating state”, and the “specific operating state 1”, “specific operating state 2”, and “specific operating state 2” are set based on the acquired limiting signal. An example of setting to any of the "specific operating states 3" has been described. In addition, the initial state of the image pickup apparatus 1 is set to "specific operation state 3" in which neither the image pickup process by the image pickup unit 109 nor the image storage process by the image processing unit 108 is possible, and based on the acquired limit signal and release signal, " It may be configured to be in any of "normal operation state", "specific operation state 1", and "specific operation state 2".

In this case, for example, when the voice processing unit 102 acquires the limit signal or the release signal, the voice generator installed at the entrance gate may set the limit signal to "specific operation state 1" or "specific operation state 2" or "specific operation state 2". The voice information acquired as a release signal for setting the "normal operating state" is generated. Then, the voice information acquired as the limiting signal for the "specific operation state 3" is generated from the voice generator installed at the exit gate. When the environment for viewing the content is "specific operation state 3", it is not necessary to prepare a gate or the like for acquiring the limit signal or the release signal.

That is, in this case, from the state where the restrictions on the image pickup unit 109 and the image processing unit 108 are the strictest, the restrictions are weakened or released according to the environment in which the content is viewed. For example, when the user needs to launch a dedicated application installed in the image pickup apparatus 1 in order to acquire a limiting signal from the voice processing unit 102 or the like, if the initial state is the "normal operating state", the user Since the imaging process and the image storage process cannot be restricted unless the application is launched by itself, it is conceivable that the user for the purpose of voyeurizing the content does not launch the application. On the other hand, if the initial state is "specific operation state 3", the strictest restriction state is reached unless the user launches the application, so that it becomes easier to prevent voyeurism of the content.

Further, in the present embodiment, the case where the position information processing unit 106 uses the position information input from the position information input unit 107 such as GPS has been described as an example. In addition, the position information may be the MAC (Media Access Control) address of the access point 3 around the image pickup device 1. With a wireless LAN-equipped device, MAC address information and radio wave strength information of surrounding wireless LAN devices can be acquired without authentication. Therefore, the information processing device 2 can use the MAC address of the access point 3 around the image pickup device 1 as position information.

Further, in the present embodiment, the case where the image pickup apparatus 1 actively transmits the position information to the information processing apparatus 2 has been described as an example, but this is an example. FIG. 10 is a diagram illustrating an operation mode of an imaging system in which the imaging device 1 and the information processing device 2 are connected via a base station. For example, when data is transmitted / received to / from the information processing device 2 via the base station 5-1 shown in FIG. 10, the base station 5-1 may add position information to the data from the image pickup device 1. By doing so, the information processing device 2 can acquire the position information of the image pickup device 1 even when the GPS function of the image pickup device 1 is disabled or even in a room or underground where GPS signals cannot be received. , It becomes possible to appropriately transmit the limit signal and the release signal to the image pickup apparatus 1. The base station 5-1 acquires the position information based on the communication strength with the other base stations 5-2 and 5-3.

In addition, when the imaging device 1 transmits / receives data to / from the information processing device 2 via the access point 3, the control unit 203 includes the MAC address of the access point 3 and the MAC address list stored in the information storage unit 205. To determine whether to transmit a limit signal or a release signal to the image pickup apparatus 1 with reference to. FIG. 11 is a diagram illustrating a MAC address list. As shown in FIG. 11, the MAC address list is configured by associating the MAC address and the signal type.

If there is a signal type that matches the MAC address of the access point 3 in the MAC address list shown in FIG. 11, the control unit 203 transmits a signal of that signal type to the image pickup apparatus 1. When the information processing apparatus 2 transmits a limit signal or release signal, the position information processing unit 106 acquires the transmitted limit signal or release signal and outputs the transmitted limit signal or release signal to the control unit 101. By doing so, the information processing device 2 can appropriately transmit the limit signal and the release signal to the image pickup device 1 that uses a specific communication network.

Further, in the present embodiment, a case where the image processing unit 108 of the image pickup apparatus 1 determines whether or not the captured image includes a limit signal or a release signal has been described as an example. In addition, such processing by the image processing unit 108 may be performed in the information processing device 2.

In this case, the image pickup device 1 transmits the captured image acquired by the image pickup unit 109 to the information processing device 2 via the network. When the captured image is transmitted from the image pickup device 1, the communication processing unit 201 of the information processing device 2 shown in FIG. 8 acquires the transmitted captured image and outputs it to the image processing unit 202.

The image processing unit 202 extracts feature information from the captured image output from the communication processing unit 201 and transmits it to the control unit 203. The control unit 203 compares the feature information acquired from the image processing unit 202 with the feature information of the specific image object stored in the information storage unit 205, and transmits a limit signal and a release signal to the image pickup apparatus 1. To decide. For example, the specific image object is two-dimensional information such as a QR code, a mark for prohibiting imaging, characters for which imaging is prohibited, and a copyrighted painting stored in the information storage unit 205. The feature information of the painting is a numerical value of features such as size, hue, composition, and display form. By doing so, it is possible to realize a usage method in which the painting is specified by imaging the painting and the information about the painting is presented to the user by AR while protecting the copyright of the painting.

Further, the specific image object may include a storage processing prohibition mark and a storage processing prohibition character of the captured image. The image processing unit 202 acquires a limiting signal corresponding to the combination of these objects from the captured image. In addition, the specific image object may be a digital watermark. When the captured image contains a digital watermark, it looks the same as the original data at first glance, but when the image processing unit 202 detects the digital watermark by performing the digital watermark detection process, the detected electrons The watermark information is acquired as a limiting signal.

Further, the image processing unit 202 uses the detected specific object as, for example, two-dimensional information such as a QR code indicating imaging permission, an imaging permission mark, an imaging permission character, a storage processing permission mark, a storage processing permission character, or the like. If there is, the detected specific object is acquired as a release signal.

Since it is not necessary for the image pickup apparatus 1 to perform the determination process of whether or not the captured image contains the limit signal or the release signal by such a process, the circuit scale of the image pickup apparatus 1 can be reduced or the process can be performed. The required memory capacity can be reduced.

Further, in the present embodiment, the voice processing unit 102, the communication processing unit 104, the position information processing unit 106, and the image processing unit 108 have been described as examples of the components for acquiring the limit signal and the release signal. However, it is not essential that all of these components perform the process of acquiring the limit signal and the release signal, and if any one of the components can perform the process of acquiring the limit signal and the release signal, the other components It is not necessary for the component unit to perform this process.

Further, in the present embodiment, the case where the image processing unit 108 stores the captured image in the image storage unit 111 included in the image capturing device 1 according to the operating state based on the limit signal or the release signal has been described as an example. In addition, the image processing unit 202 of the information processing device 2 to which the captured image is transmitted from the image pickup device 1 determines the image pickup device 1 such as the information storage unit 205 of the information processing device 2 according to the operation state based on the limit signal or the release signal. The captured image may be stored in an external storage medium or server.

FIG. 12 is a flowchart illustrating the operation of each component of the information processing device 2 when the captured image acquired by the image pickup device 1 is stored in the information storage unit 205 of the information processing device 2. As shown in FIG. 12, the communication processing unit 201 waits (S1201 / NO) until the captured image is acquired from the image pickup device 1 (S1201 / YES) via the communication input / output unit 204.

When the communication processing unit 201 acquires the captured image (S1201 / YES), the control unit 203 determines whether or not a limiting signal is added to the acquired captured image (S1202). The limiting signal is a limiting signal acquired from the audio processing unit 102 or the like of the image pickup apparatus 1 described above, and when the audio processing unit 102 or the like acquires the limiting signal, the captured image to which the acquired limiting signal is added is displayed. It shall be transmitted to the information processing device 2.

When it is determined that the restriction signal is added (S1202 / YES), the control unit 203 determines whether or not the added restriction signal is "1" (S1203). When the limiting signal is "1" (S1203 / YES), the control unit 203 controls the image processing unit 202 with the operation state as the "specific operation state 1" shown in FIG. 4 to generate a specific command. (S1204), the image is added to the acquired image (S1205), and the information storage unit 205 is stored in the restricted state.

Then, the control unit 203 notifies the communication processing unit 201 to transmit information for displaying that the added restriction signal indicates “specific operation state 1” to the image pickup apparatus 1 (S1206). .. As a result, the display unit of the image pickup apparatus 1 displays an operation state display image indicating "specific operation state 1".

In the present embodiment, the case where the image processing unit 108 of the image pickup apparatus 1 generates an operation state display image based on the information transmitted from the communication processing unit 201 is taken as an example, but the image processing unit 202 of the information processing apparatus 2 The operating state display image may be generated and transmitted to the image pickup apparatus 1. Further, if the operating state can be specified when the limiting signal is acquired by the imaging device 1, the information processing device 2 does not have to transmit information for displaying the operating state to the imaging device 1.

The image processing unit 202 controlled by the control unit 101 to the “specific operation state 1” stores the captured image to which the specific command is added in the information storage unit 205 (S1207). That is, in this case, the information storage unit 205 plays the same role as the image storage unit 111. The processing of S1206 and the processing of S1207 are not restricted in context and may be executed in the reverse order or in parallel.

On the other hand, when the limiting signal added to the captured image is not "1" (S1203 / NO), the acquired captured image is discarded (S1208). When the limiting signal is not "1", the specific operation state is the "specific operation state 2" or the "specific operation state 3" shown in FIG. 4, so that the acquired image is stored in the information storage unit 205. Is prohibited.

Then, the control unit 203 transmits information to the communication processing unit 201 to indicate to the communication processing unit 201 that the added restriction signal indicates the “specific operation state 2” or the “specific operation state 3”. Notify to do (S1209). As a result, the display unit of the image pickup apparatus 1 displays an operation state display image indicating "specific operation state 2" or "specific operation state 3". The processing of S1208 and the processing of S1209 are not restricted in context, and may be executed in the reverse order or in parallel.

On the other hand, when it is determined that the limiting signal is not added (S1202 / NO), the operating state is the "normal operating state" shown in FIG. 4, so the image processing unit 202 uses the acquired captured image as it is in the information storage unit 205. Is stored in (S1207).

Even with such a configuration, it is possible to improve the convenience of the imaging device while protecting the content in an environment in which the content is viewed. Further, since the captured image is not stored in the image storage unit 111 included in the image pickup device 1, the amount of the storage medium used in the image pickup device 1 can be reduced. Further, since the imaging device 1 can be configured not to include a storage medium for storing the captured image, the weight of the imaging device 1 can be reduced.

[Example 2]
Next, Example 2 will be described. In the first embodiment described above, the captured image captured and generated by the imaging unit 109 is an image captured and generated by a general camera, that is, an image in which what is captured can be recognized. The case was explained. The imaging device 1 according to the second embodiment has an imaging unit 109 that generates an imaging image in which it is not possible to recognize what is being imaged.

More specifically, the imaging unit 109 intentionally generates an unrecognizable captured image by WFC (Wave-front Coding) technology or the like. In WFC technology, since the phase plate is inserted into the image pickup unit 109 to expand the depth of focus, the captured image itself becomes unrecognizable, but by adding appropriate image processing to the obtained image, It is a technology that can be converted into a recognizable image.

The imaging device 1 according to the second embodiment has an imaging unit 109 that generates an image that cannot be recognized as an image unless appropriate image processing is applied. In other words, it can be said that the imaging unit 109 itself has an encryption means. FIG. 13 (a) is a diagram illustrating an captured image imaged and generated by the imaging unit 109 in the present embodiment, and FIG. 13 (b) is a restoration in which the captured image of FIG. 13 (a) is restored. It is a figure which illustrates the image. As described above, the user cannot recognize the restored image of FIG. 13 (b) from the captured image shown in FIG. 13 (a).

Hereinafter, a configuration for processing an captured image as shown in FIG. 13A encrypted by the imaging unit 109 in this way will be described as Example 2. In the second embodiment, the captured image encrypted by the imaging unit 109 is transmitted from the imaging device 1 to the information processing device 2 via the network, and the captured image encrypted by the information processing device 2 is restored. It is assumed that the captured image restored according to the operating state based on the limit signal and the release signal is stored in the information storage unit 205.

FIG. 14 is a flowchart illustrating the operation of each component of the information processing apparatus 2 in the second embodiment. As shown in FIG. 14, the communication processing unit 201 waits (S1401 / NO) until the captured image is acquired from the image pickup device 1 (S1401 / YES) via the communication input / output unit 204. The captured image acquired by the communication processing unit 201 in the present embodiment is an captured image as shown in FIG. 13A encrypted by the imaging unit 109.

When the communication processing unit 201 acquires the captured image (S1401 / YES), the image processing unit 202 restores the acquired captured image in response to a request from the imaging device 1 (S1402). The request from the image pickup apparatus 1 includes information for restoring the captured image, and for example, when WFC technology is used, the information for restoration is the focal position information of the restored image and the like. Further, the request from the imaging device 1 may be information indicating the encryption means used in the imaging unit 109.

The image processing unit 202 that restored the captured image analyzes the restored captured image (S1403). Specifically, the image processing unit 202 detects a specific image object from the captured image as in the first embodiment. When the image processing unit 202 detects a specific image object from the captured image, it detects it as a limiting signal and acquires it.

When the limiting signal is detected (S1404 / YES), the control unit 203 subsequently performs the same processing as the processing of S1203 to S1209 shown in FIG. 12 (S1405 to S1411). On the other hand, when the limiting signal is not detected (S1404 / NO), the control unit 203 performs the same processing as the processing of S1207 shown in FIG. 12 (S1409).

With such a configuration, the captured image encrypted by the imaging unit 109 needs to be transmitted to the information processing device 2 connected to the imaging device 1 via the network and restored. Therefore, even if there are a plurality of image pickup devices 1, the captured images generated by each of the image pickup devices 1 are transmitted to the information processing device 2 connected via the network, so that the captured images in the information processing device 2 Can be centrally managed.

In this embodiment, a plurality of encrypted captured images may be acquired and the acquired plurality of captured images may be analyzed. For example, when WFC technology is used, by restoring captured images at various focal positions acquired, it becomes possible to detect specific image objects that could not be detected by one captured image, and detection of specific image objects. Accuracy is improved.

Further, in the present embodiment, the case where the information processing apparatus 2 performs image restoration processing, image analysis processing, and image storage processing has been described as an example. However, this is only an example, and the image restoration processing and the image analysis processing may be performed by a specific information processing device different from the information processing device 2.

FIG. 15 is a flowchart illustrating the operation of the information processing device 2 when a specific information processing device different from the information processing device 2 that performs image restoration processing and image analysis processing is connected via a network. As shown in FIG. 15, the communication processing unit 201 waits (S1501 / NO) until the captured image is acquired from the image pickup device 1 (S1501 / YES) via the communication input / output unit 204. The captured image acquired by the communication processing unit 201 in the present embodiment is an captured image as shown in FIG. 13A encrypted by the imaging unit 109.

When the communication processing unit 201 acquires the captured image (S1501 / YES), the control unit 203 determines whether or not transmission instruction information indicating transmission to the specific information processing device is added to the acquired captured image. (S1502). The transmission instruction information is, for example, a specific transmission signal such as a position information indicating the position of the image pickup apparatus 1 that has transmitted the acquired captured image and a transmission command.

The transmission instruction information is added to the captured image generated by being captured in a specific space (location) predetermined by any of the imaging device 1, the base station 5-1 and the access point 3, for example. To do. In addition, the limit signal and the release signal acquired by the voice processing unit 102 and the like described in the first embodiment may be used as a specific transmission signal.

When it is determined that the transmission instruction information is added (S1502 / YES), the communication processing unit 201 transmits the captured image to the specific information processing device via the communication input / output unit 204 (S1503). As a result, the specific information processing device performs the above-mentioned image restoration processing and image analysis processing on the captured image transmitted from the information processing device 2, and transmits the analyzed captured image to the information processing device 2. After that, the control unit 203 performs the same processing as the processing of S1404 to S1411 shown in FIG. 14 (S1506 to S1514).

On the other hand, when it is determined that the transmission instruction information is not added (S1502 / NO), each component of the information processing apparatus 2 subsequently performs the same processing as S1402 to S1411 shown in FIG. 14 (S1504 to S1504 to). S1513).

With such a configuration, the captured image generated by being captured in a specific space (place) is transmitted to the specific information processing device connected to the image pickup device 1 and the information processing device 2 via the network, and the image is restored and the image is imaged. Since the analysis is performed, it becomes possible to centrally manage the captured images generated by being captured in a specific space.

[Example 3]
Next, Example 3 will be described. In the first and second embodiments, the control unit 101 acquires the limit signal and the release signal based on the information generated outside the image pickup device 1 such as the captured image, the voice information, the radio signal, and the position information. In the third embodiment, the control unit 101 acquires a limit signal and a release signal from the information generated by the image pickup apparatus 1 alone.

FIG. 16 is a block diagram illustrating the functional configuration of the image pickup apparatus 1 according to the third embodiment. As shown in FIG. 16, in the imaging device 1 according to the third embodiment, an optical information processing unit 112 and an optical information input / output unit 113 are added to the components of the imaging device 1 according to the first embodiment shown in FIG. Take the configuration. Hereinafter, only a configuration different from the configuration portion shown in FIG. 3 will be described, and description of other configurations will be omitted. The optical information input / output unit 113 is composed of a light emitting unit that is a light emitting element such as an LED (Light Emitting Diode) and a light receiving unit that is a light receiving element such as a PD (Photodiode).

FIG. 17 is a flowchart illustrating the operation of the optical information processing unit 112 and the control unit 101. As shown in FIG. 17, the optical information processing unit 112 receives a light emitting command from the control unit 101 and performs a light emitting process for lighting the light emitting element of the optical information input / output unit 113 (S1701). In the present embodiment, when the imaging process by the imaging unit 109 is started, the processing of S1701 causes a light emitting element such as a visible red LED or an infrared infrared LED in the vicinity of the imaging unit 109 to emit light. And. That is, the light emitting element acts as an indicator indicating that imaging is in progress. As a result, it is possible to easily recognize that the image pickup device 1 is in the process of imaging by a device for visually detecting or detecting infrared light from the outside.

When the optical information processing unit 112 that has performed the light emission processing detects that the light receiving element of the optical information input / output unit 113 receives the reflected light by bouncing the light from the light emitting element of the optical information input / output unit 113 to the object ( S1702), the control unit 101 is notified that the detection has been performed. This is because, for example, when a user starts an imaging process using the imaging device 1 in a movie theater or a museum where shooting is prohibited, the light emitting element near the imaging unit 109 emits light and images are taken as described above. Since it is possible to easily recognize that the image is being taken from the outside, the user tries to hide the light from the light emitting element by hand or the like so that the image is not revealed. In such a case, it is detected that the hand becomes a reflective object, the light from the light emitting element bounces off, and the reflected light is received by the light receiving element.

The control unit 101 that receives the notification from the optical information processing unit 112 controls to limit the processing of the image pickup unit 109 and the image processing unit 108 (S1703). Specifically, for example, the control unit 101 stops the transmission of the image pickup command signal to the image pickup unit 109 and controls the image pickup unit 109 to disable the image pickup process (that is, the “imaging process” shown in FIG. Specific operating state 3 "). In addition, for example, the control unit 101 may control the image pickup unit 109 and the image processing unit 108 so as to be in any of the "specific operation state 1" and "specific operation state 2" shown in FIG. ..

Further, when the control unit 101 transitions from the normal operation state to the specific operation state, the control unit 101 displays to the image processing unit 108 which specific operation state is in the same manner as the processing of S508 shown in FIG. You may be notified to generate an operation status display image for the purpose.

In this way, the detection of the reception of the reflected light from the light emitting element means that the limiting signal is acquired. That is, the control unit 101 according to the third embodiment acquires a limiting signal from the information generated by the image pickup apparatus 1 alone.

Further, when the light receiving element stops receiving the reflected light, the control unit 101 may release the restricted state of the image pickup unit 109 and the image processing unit 108. In this case, the release signal is acquired when the light receiving element no longer receives the reflected light. That is, the control unit 101 according to the third embodiment acquires a release signal from the information generated by the image pickup apparatus 1 alone.

By providing such a light emitting element, it becomes possible to recognize from the outside that imaging is in progress with a simple configuration. Further, with such a configuration, when the user intentionally hides the light emitting element for the purpose of voyeurism, it is possible to limit the imaging process and the storage process of the captured image and prevent the voyeurism of the content.

In the present embodiment, when the reflected light is detected by the light receiving element, the control unit 101 controls to limit the operation of the image pickup unit 109 and the image processing unit 108 as an example. In addition, when the reflected light is detected by the light receiving element, the optical information processing unit 112 first measures the time from when the light emitting element emits light until the reflected light is received, and the light emitting element according to the measured time. The distance from the light to the reflecting object is calculated, and the calculated distance is output to the control unit 101.

When the distance output from the optical information processing unit 112 is equal to or less than a predetermined distance (for example, 30 cm), the control unit 101 controls to limit the processing of the imaging unit 109 and the image processing unit 108. The time measured by the optical information processing unit 112 may be output to the control unit 101, and the distance from the light emitting element to the reflecting object may be calculated based on the time output by the control unit 101.

This is because when the distance from the light emitting element to the reflecting object is relatively short, the reflecting object is considered to be an object for intentionally hiding the light emitting element such as a hand. On the other hand, when the distance from the light emitting element to the reflecting object is relatively long, it is considered that the light is accidentally reflected by some reflecting object such as a wall instead of an object for intentionally hiding the light emitting element. With such a configuration, it is possible to prevent the spy shot of the content more accurately.

The present invention is not limited to the above-described examples, and includes various modifications. For example, the above-described embodiment has been described in detail in order to explain the present invention in an easy-to-understand manner, and is not necessarily limited to those having all the described configurations. Further, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment of the configuration of one embodiment. Further, it is possible to add / delete / replace a part of the configuration of each embodiment with another configuration.

Further, each of the above configurations, functions, processing units, processing means and the like may be realized by hardware by designing a part or all of them by, for example, an integrated circuit. Further, each of the above configurations, functions, and the like may be realized by software by the processor interpreting and executing a program that realizes each function. Information such as programs, tables, and files that realize each function can be stored in a memory, a hard disk, a recording device such as an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD.

In addition, the control lines and information lines indicate those that are considered necessary for explanation, and do not necessarily indicate all the control lines and information lines in the product. In practice, it can be considered that almost all configurations are interconnected.

1 Image pickup device 2 Information processing device 3 Access point 4 Internet 5 Base station 101 Control unit 102 Voice processing unit 103 Voice input / output unit 104 Communication processing unit 105 Communication input / output unit 106 Position information processing unit 107 Position information input unit 108 Image processing unit 109 Imaging unit 110 Display control unit 111 Image storage unit 112 Optical information processing unit 113 Optical information input / output unit 201 Communication processing unit 202 Image processing unit 203 Control unit 204 Communication input / output unit 205 Information storage unit

The present invention relates to a head-mounted display device .

In order to solve the above problems, the present invention is a head-mounted display device that displays an image in the viewing direction of a user, an imaging unit that captures an image of a subject and acquires image information, and the acquired image information. An image storage processing unit that generates an image file and stores it in a storage medium based on the above, a communication processing unit that acquires information via a network, and a display screen arranged in the viewing direction of the user display an image. A display control unit and a control unit that controls the operation of the components of the head-mounted display device are provided, and the control unit indicates a combination of whether or not there are restrictions on the acquisition of the image information and the storage of the image file. The image pickup unit and the image storage processing unit can be controlled in a state in which the restriction information is acquired, the image information can be acquired based on the restriction information, and the storage of the image file is prohibited. In this state, the display control is performed so that the first image based on the image information and the second image based on the related information about the subject acquired from the network via the communication processing unit are displayed on the display screen. It is characterized by controlling the part .

Claims (13)

An image information acquisition unit that acquires image information generated by photoelectric conversion,
An image storage processing unit that generates an image file based on the acquired image information and stores it in a storage medium.
An image pickup apparatus including a control unit capable of acquiring the image information and controlling the storage of the image file in a restricted state. Acquisition of the image information and storage of the image file A restriction information acquisition unit for acquiring restriction information indicating a combination of the presence or absence of each restriction is included.
The imaging device according to claim 1, wherein the control unit controls the image information in a state in which the image information can be acquired and the storage of the image file is restricted based on the acquired restriction information. .. The state in which the storage of the image file is restricted is a state in which the image file to which information indicating the restriction of processing for the image file is added can be stored in the storage medium. The imaging apparatus according to. The imaging device according to claim 1, wherein the state in which the storage of the image file is restricted is a state in which the storage of the image file in the storage medium is prohibited. The imaging device according to claim 2, wherein the restriction information acquisition unit acquires the restriction information based on input information input according to a place where the image information is acquired. The imaging device according to claim 5, wherein the input information is voice information. The imaging device according to claim 5, wherein the input information is the image information. The imaging device according to claim 5, wherein the input information is a wireless signal transmitted from another device. The imaging device according to claim 5, wherein the input information is position information. A light emitting unit that emits light during acquisition of the image information,
Including a light receiving part that receives light
The control unit is characterized in that when the light receiving unit receives the reflected light of the light from the light emitting unit, the image information can be acquired and the storage of the image file is restricted. The imaging device according to claim 1. The imaging apparatus according to claim 1, further comprising a display control unit for displaying an image indicating a state of limitation of acquisition of the image information and storage of the image file on the display unit. An image information acquisition unit that acquires image information generated by photoelectric conversion,
An image storage processing unit that generates an image file based on the acquired image information and stores it in a storage medium.
An image pickup system including a control unit capable of acquiring the image information and controlling the storage of the image file in a restricted state. The image information acquisition unit
The image information is encrypted
The encrypted image information is output to an information processing device different from the image pickup device including the image information acquisition unit.
The information processing device restores the encrypted image information and
The imaging system according to claim 12, wherein the image storage processing unit generates an image file based on the restored image information and stores it in the storage medium included in the information processing apparatus.

Images