JP5280185B2 - Portable terminal and electronic camera - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a novel terminal and an electronic camera, which can prevent a snapshot from being easily taken secretly. <P>SOLUTION: A portable terminal 10 has a camera control circuit 36 and an image sensor 38, by which the terminal can execute a camera function. The portable terminal 10 also can receive information (data) based on visible light communication with use of the camera control circuit 36 and the image sensor 38. When receiving inhibition information by the visible light communication, the terminal 10 inhibits shooting based on the camera function. When receiving light signal containing the inhibition information, the terminal 10 can prevent secrete shooting by inhibiting shooting based on the camera function. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to a mobile terminal, and more particularly to a mobile terminal capable of taking an image, for example.

  2. Description of the Related Art Conventionally, for example, a portable terminal capable of taking an image is known, and an example of this type of device is disclosed in Patent Document 1. In the imaging device of this background art, imaging is converted into a digital signal by a camera sensor, and further, digital processing is performed by a digital signal processing unit to obtain an image signal. Moreover, the imaging device includes a voyeurism prevention information detection unit. The photographing device prevents voyeurism by the user by turning off the power when the voyeurism prevention information detecting unit detects voyeurism prevention information generated by the voyeurism prevention information generating device attached to the subject.

Patent Document 2 discloses a mobile phone with a digital camera. In this mobile phone with a digital camera, when a printed matter on which a photographing information code having photographing prohibition information is printed is photographed, a message for warning to stop photographing is displayed on the display unit.
JP 2001-169175 [H04N 5/232, G06T 1/00, H04M 3/00, H04M 3/42, H04M 11/00] JP2005-217777 [H04N 5/225, G03B 17/18, H04N 5/232, H04N 101: 00]

  However, in the imaging device disclosed in Patent Document 1, when the copy is a printed matter or the like, a voyeurism prevention information generating device must be attached to all the printed matter, which is not realistic. In addition, when voyeurism prevention information is transmitted by wireless signal, it is not necessary to attach the voyeurism prevention information generating device to all printed matter, but it is difficult to limit the place where the wireless signal is transmitted. A new problem arises that it becomes impossible to shoot even in a place where it is not necessary to prevent this.

  In addition, in the mobile phone with a digital camera in Patent Document 2, if the shooting information code printed on the printed matter is hidden with a finger or the like, voyeurism cannot be prevented. In addition, an example has been described in which an imaging information code is made invisible by pasting a film using infrared reflection or absorption on a printed material. However, if the film is pasted on all printed materials, Problems such as an increase in cost are newly generated, which is not realistic as in the imaging apparatus disclosed in Patent Document 1.

  Therefore, a main object of the present invention is to provide a novel portable terminal and electronic camera.

  Another object of the present invention is to provide a portable terminal and an electronic camera that can prevent voyeurism that can be easily executed.

  The present invention employs the following configuration in order to solve the above problems. The reference numerals in parentheses, supplementary explanations, and the like indicate the corresponding relationship with the embodiments described in order to help understanding of the present invention, and do not limit the present invention.

The first invention is a photographing means for photographing an image including an optical signal from a light source, a centralized sampling means for centrally sampling a part of an image photographed by the photographing means, and a partial image that is centrally sampled by the centralized sampling means. , when it is determined to contain an optical signal including control information by determining means, and determination means for determining if there is any optical signal including control information, limit means to limit the photographing by the photographing means It is a portable terminal provided with.

According to the first invention, since photographing is restricted when an optical signal including control information is photographed , that is, when light is received, voyeurism easily performed using a portable terminal can be prevented. In addition, a store clerk such as a bookstore and a store manager can prevent voyeurism by using lighting provided on the ceiling in a place where photographing in the store is prohibited. Note that the voyeurism in the present invention includes not only the case of being hidden from an administrator or the like but also the case of shooting without being hidden from the administrator or the like .

  A second invention is dependent on the first invention and further comprises a recording means for recording an image photographed by the photographing means, and the restricting means includes a recording restricting means for restricting recording of the photographed image.

  In the second invention, the recording means (28) records an image such as compressed image data or MPEG data. The recording restriction means (20, S55) restricts images such as compressed image data and MPEG data from being recorded on the recording means.

  According to the second invention, in the portable terminal, it is possible to limit only the recording of images by photographing. That is, in the mobile terminal, recording of an image (through image) temporarily recorded (stored) is not limited.

  A third invention is according to the first invention, further comprising an input device for inputting a photographing operation for causing the photographing means to photograph, and the restricting means for photographing that invalidates the photographing operation inputted to the input device Operation invalidation means is included.

  In the third invention, in the input device (22) including the photographing key, the photographing key is pressed as a photographing operation. Then, the shooting operation invalidating means (20, S71) does not accept a shooting instruction issued when the shooting key is pressed.

  According to the third invention, the portable terminal can restrict the photographing by invalidating the photographing operation.

  A fourth invention is according to any one of the first to third inventions, and notifies that photographing is restricted when the photographing means is operated in a state where photographing is restricted by the restricting means. Notification means for performing the operation.

  In the fourth invention, the notifying means (20, S57) displays a pop-up (66) on the LCD monitor (26) or the like to notify that photographing is restricted.

According to the fourth invention, the mobile terminal can notify the user that shooting is restricted. Thereby, the user can recognize clearly that photography is restricted.
A fifth invention is according to any one of the first to fourth inventions, and further comprises a first releasing means for releasing the restriction by the restricting means when the photographing means is stopped.
According to the fifth aspect of the present invention, the user can cancel the photographing restriction by terminating the camera function.

A sixth invention is according to any of the first invention to the fifth invention, the optical signal including the control information by the imaging means is no longer taken, further a second canceling means for canceling the restriction by the restricting means Prepare.

In the sixth invention, the second release means (20, S35) releases the restriction by the restriction means when the mobile terminal is moved to a place where an image including an optical signal including control information cannot be taken .
According to the sixth aspect of the invention, the user can remove the restriction on photographing by moving to a place where the prohibition information is not transmitted. Therefore, convenience for the user is improved.

A seventh invention is according to any one of the first to sixth inventions, and the light source is a light source that emits visible light.

According to the seventh aspect of the invention, for example, when preventing voyeurism at a bookstore or the like, a store clerk and a store manager such as a bookstore can easily recognize the range in which shooting is restricted from the emitted visible light. become. Furthermore, since visible light can be used as illumination, it is not necessary to install a monitoring device or the like at a place where a light source is installed, and the aesthetic appearance is maintained.

According to an eighth aspect of the present invention, when a processor of a portable terminal having a photographing means for photographing an image and a receiving means for receiving an optical signal from a light source receives an optical signal including control information by the receiving means, photographing by the photographing means This is a photographing control program that functions as a releasing means for releasing the restriction by the restricting means when the restricting means for restricting the photographing and the photographing means are stopped.
A ninth invention is an imaging control method for a portable terminal having an imaging unit for imaging an image and a receiving unit for receiving an optical signal from a light source, and when the optical signal including control information is received by the receiving unit, This is a shooting control method in which shooting by the shooting means is restricted, and the restriction is released when the shooting means is stopped.

According to a tenth aspect of the present invention, photographing means (36, 38) for photographing an image including an optical signal from a light source , centralized sampling means for centrally sampling a part of an image photographed by the photographing means, and centralized sampling by the centralized sampling means. When a part of the image is judged to contain an optical signal containing control information , and when the judgment part judges that the optical signal containing the control information is contained , photographing by the photographing means is performed. comprising a restriction to restrict manual stage (20, S33), an electronic camera.

In the tenth invention, as with the first invention, since photographing is restricted when an optical signal including control information is photographed , that is, when light is received, it is possible to prevent voyeurism easily performed using an electronic camera. it can.

  According to the present invention, when an optical signal including control information is received, that is, when an optical signal is received, photographing is limited, so that it is possible to prevent voyeurism that is easily executed.

  The above object, other objects, features, and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

<First embodiment>
Referring to FIG. 1, mobile terminal 10 includes a CPU (also referred to as a processor or a computer) 20, a key input device 22 that is an input device, and a touch panel 34 that is controlled by a touch panel control circuit 32. The CPU 20 controls the radio communication circuit 14 corresponding to the CDMA system and outputs a call signal. The output call signal is transmitted from the antenna 12 and transmitted to the mobile communication network including the base station. When the other party performs a response operation, a call ready state is established.

  When a call end operation is performed by the key input device 22 or the touch panel 34 after the transition to the call enabled state, the CPU 20 controls the wireless communication circuit 14 to transmit a call end signal to the other party. Then, after transmitting the call end signal, the CPU 20 ends the call process. Also, when the call end signal is received from the call partner first, the CPU 20 ends the call process. Further, the CPU 20 ends the call process even when a call end signal is received from the mobile communication network regardless of the call partner.

  When a call signal from a call partner is captured by the antenna 12 while the mobile terminal 10 is activated, the wireless communication circuit 14 notifies the CPU 20 of an incoming call. Further, the CPU 20 controls the LCD monitor 26 which is a display device by the LCD driver 24 and causes the LCD monitor 26 to display the caller information described in the incoming call notification. Then, the CPU 20 outputs a ring tone from an incoming call notification speaker (not shown).

  In the call ready state, the following processing is executed. The modulated audio signal (high frequency signal) sent from the other party is received by the antenna 12. The received modulated audio signal is subjected to demodulation processing and decoding processing by the wireless communication circuit 14. The obtained received voice signal is output from the speaker 18. On the other hand, the transmission voice signal captured by the microphone 16 is subjected to encoding processing and modulation processing by the wireless communication circuit 14. Then, the generated modulated audio signal is transmitted to the other party using the antenna 12 as described above.

  The touch panel 34 is a pointing device for instructing an arbitrary position on the screen of the LCD monitor 26. When the touch panel 34 is operated by pressing, sliding (striking), or touching the upper surface with a finger, the touch panel 34 detects the operation. When the touch panel 34 detects a touch, the touch panel control circuit 32 specifies the position of the operation and outputs coordinate data of the operated position to the CPU 20. That is, the user can input an operation direction, a figure, or the like to the mobile terminal 10 by pressing, sliding (rubbing), or touching the upper surface of the touch panel 34 with a finger.

  The touch panel 34 is a method called a capacitance method that detects a change in capacitance between electrodes generated when a finger approaches the surface of the touch panel 34, and one or more fingers touch the touch panel 34. Detect that. Specifically, the touch panel 34 has a projection-type capacitance method that detects a change in capacitance between electrodes caused by the approach of a finger by forming an electrode pattern on a transparent film or the like. It has been adopted. As the detection method, a surface type capacitance method may be employed, or a resistance film method, an ultrasonic method, an infrared method, an electromagnetic induction method, or the like may be used.

  Here, an operation in which the user touches the upper surface of the touch panel 34 with a finger is referred to as “touch”. On the other hand, the operation of releasing the finger from the touch panel 34 is referred to as “release”. The operation of rubbing the surface of the touch panel 34 is referred to as “slide”. The coordinates indicated by the touch are referred to as “touch points”, and the coordinates indicated by the release are referred to as “release points”. Further, an operation in which the user touches the upper surface of the touch panel 34 and subsequently releases it is referred to as “touch and release”. An operation performed on the touch panel 34 such as touch, release, slide, and touch-and-release is generally referred to as “touch operation”. In order to perform the operation, a dedicated touch pen or the like may be provided. The touch point when touching with the finger is the barycentric coordinate of the area of the finger touching the touch panel 34.

  The portable terminal 10 can execute a camera function by causing the camera control circuit 36 and the image sensor 38 to function as photographing means. The camera function records photographic image data focused on the subject by autofocus processing. Specifically, when an operation for executing a camera function is performed by the key input device 22 or the touch panel 34, the CPU 20 gives a command necessary for executing the camera function to the camera control circuit 36. The camera control circuit 36 controls the image sensor 38 and the focus lens 40 to convert the optical image of the show field acquired by the image sensor 38 into photographic image data. Then, the CPU 20 converts the photographic image data obtained from the camera control circuit 36 and focused on the subject into compressed image data, and records the compressed image data in the flash memory 28 serving as a recording unit. Further, with this camera function, the size of a photograph image to be taken can be selected from WQVGA (240 × 400), VGA (640 × 480), and UXGA (1600 × 1200). Of course, in the present invention, the size of the photographic image to be taken is not limited to these, and other sizes can be used as appropriate.

  Further, in a state where the camera function is executed, a process of displaying a real-time moving image of the object scene (hereinafter referred to as a through image) on the LCD monitor 26 is performed. Specifically, the CPU 20 activates an image sensor driver built in the camera control circuit 36 and instructs the image sensor driver to perform an exposure operation and a charge readout operation corresponding to a designated readout region.

  The image sensor driver performs exposure of the imaging surface of the image sensor 38 and reading of electric charges generated by the exposure. As a result, a raw image signal is output from the image sensor 38. The raw image signal output from the image sensor 38 is input to the camera control circuit 36. The camera control circuit 36 performs processes such as color separation, white balance adjustment, and YUV conversion on the input raw image signal to generate image data in YUV format. The CPU 20 receives YUV format image data.

  The YUV format image input to the CPU 20 is temporarily stored in the RAM 30 by the CPU 20. Further, the stored YUV format image data is provided from the RAM 30 to the LCD driver 24 via the CPU 20. At the same time, the CPU 20 issues a thinning readout command to the LCD driver 24. Then, the LCD driver 24 outputs YUV format image data to the LCD monitor 26 in accordance with the thinning readout command issued from the CPU 20. Therefore, a low-resolution through image representing the object scene is reproduced on the LCD monitor 26.

  In YUV format image data, Y means luminance, U means a color difference obtained by subtracting luminance from blue, and V means a color difference obtained by subtracting luminance from red. That is, the YUV format image data is composed of luminance signal (Y) data, blue color difference signal (U) data, and red color difference signal (V) data.

  In addition, the camera function can capture not only still images but also moving images. Specifically, when an operation for capturing a moving image is performed, the CPU 20 activates an MPEG-4 codec (not shown), and reads YUV format image data stored in the RAM 30 for each frame. Further, the CPU 20 applies compression processing according to the MPEG-4 format to the read image data in the YUV format to generate MPEG data. The MPEG data is temporarily stored in the RAM 30 and then recorded in the flash memory 28.

  Note that the through image update cycle is 1000 fps, and the image sensor 38 is a CMOS image sensor that can output a raw image signal at high speed.

  2A and 2B are illustrative views showing the appearance of the mobile terminal 10. 2A is a front external view of the mobile terminal 10, and FIG. 2B is a back external view of the mobile terminal 10. With reference to FIG. 2A, the portable terminal 10 has a case C formed in a plate shape. A microphone 16 and a speaker 18 (not shown in FIG. 2A) are built in the case C. The opening OP2 leading to the built-in microphone 16 is provided on one main surface in the length direction of the case C, and the opening OP1 leading to the built-in speaker 18 is provided on the other main surface in the length direction of the case C. That is, the user listens to the sound output from the speaker 18 through the opening OP1, and inputs the sound to the microphone 16 through the opening OP2.

  The key input device 22 includes three types of keys, a call key 22a, a menu key 22b, and an end call key 22c. Each key is provided on the main surface of the case C. The LCD monitor 26 is attached so that the monitor screen is exposed on the main surface of the case C. Further, a touch panel 34 is provided on the upper surface of the LCD monitor 26.

  The user performs a response operation by operating the call key 22a, and performs a call end operation by operating the call end key 22c. Further, the user operates the menu key 22b to display the menu screen on the LCD monitor 26. Then, the power-on / off operation of the mobile terminal 10 can be performed by long-pressing the end call key 22c. The menu key 22b functions as a shooting key if the camera function is executed. That is, when the camera function is being executed, the user performs a shooting operation by pressing the menu key 22b, and causes the flash memory 28 to record image data.

  The optical sensor 42 is provided on the other side in the length direction so that the sensor portion is exposed on the main surface of the case C. The sensor portion of the optical sensor 42 has a plurality of photodiodes integrated in an array and is covered with a lens.

  2B, the image sensor 38 and the focus lens 40 (not shown in FIG. 2B) are built in the case C, and communicate with the built-in image sensor 38 and the focus lens 40. The opening OP3 is provided on the other surface in the longitudinal direction of the case C. That is, the user can shoot an arbitrary subject by directing the opening OP3 provided on the back side of the LCD monitor 26 and the optical sensor 42 toward the subject. For the purpose of protecting the focus lens 40, the opening OP3 may be covered with a transparent plastic cover or the like.

  Here, in the present embodiment, it is determined whether or not prohibition information is transmitted from the visible light communication source. If the prohibition information is transmitted from the visible light communication source, photographing by the camera function is restricted.

  Specifically, it is determined whether or not the light source emits light with a luminance equal to or higher than a predetermined value included in the through image, and if it is a visible light communication source, prohibition information is transmitted. Determine whether or not. When the prohibition information is received, the compressed image data or MPEG data is not recorded in the flash memory 28 by the photographing operation.

  First, a procedure for detecting a visible light communication source included in a through image will be described. Here, in order to detect a visible light communication source in the through image, a raster scan is performed from the upper left end, and visible light having a luminance of a predetermined value or more is detected. In addition, the through image to be raster scanned is not a moving image but an arbitrarily selected still image. Hereinafter, each still image constituting the through image is referred to as a through still image.

  The origin of the display coordinates of the LCD monitor 26 and the touch position coordinates of the touch panel 34 is the upper left corner. That is, the abscissa increases as it proceeds from the upper left corner to the upper right corner, and the ordinate increases as it proceeds from the upper left corner to the lower left corner.

  FIG. 3A is an illustrative view showing a display example of the LCD monitor 26 that displays a through image captured by the camera function. Referring to FIG. 3A, LCD monitor 26 includes a status display area 50, a function display area 52, and a key display area 54. In the status display area 50, the radio wave reception status by the antenna 12, the remaining battery capacity of the rechargeable battery, the current date and time, and the like are displayed. In the function display area 52, a through image captured by the camera function is displayed.

  The key display area 54 includes a switching key 56 and a function key 58. A switching key 56 switches between a still image shooting mode and a moving image shooting mode. In the still image shooting mode, the designated YUV format image data is converted into compressed image data and recorded in the flash memory 28. In the moving image shooting mode, each image data in the YUV format is converted into MPEG data and recorded in the flash memory 28.

  Further, when the other function key 58 is operated, a menu screen for changing the size of an image to be taken is displayed. In other words, the user operates the function key 58 when setting the camera function.

  Here, the through image shown in FIG. 3A includes a plurality of light sources (lighting) in a certain office and paper P distributed only in the certain office. Each of the plurality of light sources emits (emits) visible light including an optical signal as a visible light communication source, and “confidential” is printed on the surface of the paper P. Hereinafter, visible light emitted from each of the plurality of light sources is referred to as visible light 60, visible light 62, and visible light 64. Further, the visible light 62 and the visible light 64 illustrated in FIG. 3A have substantially the same luminance. However, the luminance of visible light 60 is higher than the luminance of visible light 62 and visible light 64. In addition, although a some light source is a fluorescent lamp, if it is illumination which can be utilized for visible light communications, such as LED illumination and organic EL illumination, another lighting fixture may be sufficient.

  Then, a raster scan is performed on the through still image, and a light source that emits light with a luminance equal to or higher than a predetermined value is searched. Further, when a light source that emits light with a luminance of a predetermined position or higher is found by raster scanning, it is determined by concentrated sampling whether the light source is a visible light communication source.

  In the raster scan, the visible light having the luminance equal to or higher than the predetermined value is searched by determining whether the luminance is higher than the predetermined value based on the luminance signal data for each pixel. For example, if the luminance of the visible light 60 is equal to or higher than a predetermined position, when searching up to the upper part S of the visible light 60 (see FIG. 3B), concentrated sampling is performed within a certain range from the upper part S of the visible light 60. Is called.

  FIG. 3B is an illustrative view showing a state in which concentrated sampling is performed in the region A of FIG. Referring to FIG. 3B, a rectangular concentrated sampling area CSA is set such that the upper part S indicating the current search position by the raster scan is the midpoint of a certain side. That is, the concentrated sampling area CSA is set with the upper part S as a reference. Then, the through image is updated only in the concentrated sampling area CSA, and it is determined whether or not the visible light 60 includes an optical signal necessary for visible light communication.

  Note that the updated through image is not displayed on the LCD monitor 26 only in the concentrated sampling area CSA. Further, although the shape of the concentrated sampling area CSA is a quadrangle, it may be another figure. Furthermore, in visible light communication, communication is possible if an optical signal can be identified, and therefore it is not necessary that all visible light is contained in the concentrated sampling area CSA.

  If the optical signal necessary for visible light communication is included, the transmitted information (data) is acquired, and the center of gravity of the region where the luminance of a predetermined value or more is detected in the concentrated sampling region CSA is calculated. . An icon indicating a visible light communication source may be displayed based on the calculated coordinates of the center of gravity.

  For example, in FIG. 3B, if the visible light 60 includes an optical signal necessary for visible light communication, the center of the visible light 60 is calculated as the center of gravity G, and stored in the RAM 30 together with the acquired information. . When the intensive sampling is completed in the intensive sampling area CSA, it is determined whether or not the acquired information is prohibited information. If it is prohibited information, a process of recording compressed image data or MPEG data in the flash memory 28 is performed. Restrict. That is, the portable terminal 10 can restrict only recording of image data by photographing. Further, since the through image is only temporarily stored in the RAM 30, it is not limited.

  When the concentrated sampling is finished, the raster scan is restarted from the upper part S. At this time, the area coordinates of the concentrated sampling area CSA are temporarily stored in the RAM 30 so that the concentrated sampling area CSA is not raster scanned. When the raster scan is resumed, the latest through still image is used. In other words, any through still image selected to start the raster scan first is updated to the latest through still image.

  Note that the status display area 50, function display area 52, key display area 54, switching key 56, function key 58, visible light 60-64, and paper P shown in FIG. 3A are the same in other drawings. Therefore, detailed description is omitted in other drawings.

  Next, processing when a shooting operation is performed in a state where prohibition information has been acquired will be described. For example, when the menu key 22b functioning as a shooting key is pressed in a state where the prohibition information has been acquired, a pop-up 66 including a character string “shooting is prohibited” on the through image as shown in FIG. Is displayed. As a result, the paper P printed as confidential is prevented from being taken by the camera function of the mobile terminal 10. That is, the mobile terminal 10 notifies the user that shooting is restricted. Note that the pop-up 66 is deleted when a predetermined time elapses.

  Further, even in a state where photographing is restricted, the mobile terminal 10 can acquire information from a visible light communication source that emits visible light 62 and visible light 64. That is, the user can acquire information transmitted from another visible light communication source even in a state where photographing by the camera function is restricted.

  Here, a plurality of layers constituting the display of the LCD monitor 26 will be described. Specifically, two layers (the lowermost layer and the uppermost layer) are overlapped, and in the virtual space, the uppermost layer is provided on the starting point side (user side), and the lowermost layer is arranged in a direction away from the starting point. The In the present embodiment, a through image is displayed on the lowermost layer, and a pop-up 66 is displayed on the uppermost layer. As a result, as shown in FIG. 4, the pop-up 66 can be easily drawn so as to overlap the through image. Note that the number of layers constituting the display of the LCD monitor 26 may be three or more.

  FIG. 5 is an illustrative view showing a memory map of the RAM 30. Referring to FIG. 5, memory map 300 of RAM 30 includes a program storage area 302 and a data storage area 304. A part of the program and data is read from the flash memory 28 all at once or partially and sequentially as necessary, stored in the RAM 30, and then processed by the CPU 20 or the like.

  The program storage area 302 stores a program for operating the mobile terminal 10. A program for operating the mobile terminal 10 includes a visible light communication program 310, a prohibition information confirmation program 312 and a camera function processing program 314. The visible light communication program 310 is a program for acquiring information (data) transmitted from a visible light communication source. The prohibition information confirmation program 312 is a subroutine of the visible light communication program 310, and is a program for determining whether or not prohibition information is included in information (data) acquired by visible light communication. The camera function processing program 314 is a program for executing a camera function, and restricts recording of compressed image data or MPEG data in the flash memory 28 in a state where prohibition information is received.

  In addition, although illustration is abbreviate | omitted, the program for operating the portable terminal 10 contains the program for performing a telephone call, etc.

  In the data storage area 304, a touch buffer 320, a through image buffer 322, a raster scan buffer 324, a concentrated sampling buffer 326, and a visible light communication buffer 328 are provided. In the data storage area 304, touch coordinate map data 330, prohibition signal confirmation data 332, and GUI image data 334 are stored, and a prohibition flag 336 and a touch flag 338 are provided.

  The touch buffer 320 is a buffer for temporarily storing an input result such as a touch detected by the touch panel 34, and temporarily stores, for example, coordinate data of a touch point and a release point. The through image buffer 322 is a buffer in which YUV format image data read from the camera control circuit 36 is temporarily stored (stored once). The raster scan buffer 324 is a buffer for temporarily storing the through still image and coordinates indicating the current search position when performing a raster scan on the through still image.

  The concentrated sampling buffer 326 is a buffer for temporarily storing coordinates serving as a reference for setting the concentrated sampling area CSA and coordinates (area coordinates) indicating the area of the concentrated sampling area CSA. The visible light communication buffer 328 is a buffer for temporarily storing information (data) acquired by visible light communication.

  The touch coordinate map data 330 is data for associating coordinates such as a touch point on the touch panel 34 specified by the touch panel control circuit 32 with a display position of the LCD monitor 26. That is, the CPU 20 can associate the result of the touch operation performed on the touch panel 34 with the display on the LCD monitor 26 based on the touch coordinate map data 328. The prohibition information confirmation data 332 is data for determining whether information acquired by visible light communication is prohibition information. The GUI image data 334 is data composed of image data of the switching key 56 and the function key 58 shown in FIG.

  The prohibition flag 336 is a flag for determining whether recording of compressed image data or MPEG data by shooting is restricted. For example, the prohibition flag 336 is composed of a 1-bit register. When the prohibition flag 336 is turned on (established), a data value “1” is set in the register. On the other hand, when the prohibition flag 336 is turned off (not established), a data value “0” is set in the register.

  The touch flag 338 is a flag for determining whether or not the touch panel 34 is touched (touched). Further, since the configuration of the touch flag 338 is the same as that of the prohibition flag 336, detailed description thereof is omitted.

  Although illustration is omitted, the data storage area 304 is provided with a buffer for temporarily storing MPEG data and other counters and flags necessary for the operation of the mobile terminal 10.

  Under the control of an RTOS (real-time operating system) such as “Linux” and “REX”, the CPU 20 performs the visible light communication process shown in FIG. 6, the prohibited information confirmation process shown in FIG. 7, and the camera function process shown in FIG. Execute multiple tasks in parallel including

  FIG. 6 is a flowchart showing visible light communication processing. For example, when the user performs an operation of acquiring a through image, the through image is acquired in step S1. That is, the YUV format image data output from the camera control circuit 36 is temporarily stored in the through image buffer 322. Subsequently, in step S3, the through still image is raster scanned. That is, a through still image arbitrarily selected from the through images temporarily stored in the through image buffer 322 is temporarily stored in the raster scan buffer 324, and raster scanning is started on the through still image.

  Subsequently, in step S5, it is determined whether or not luminance of a predetermined value or more is detected. That is, it is determined by raster scanning whether or not the brightness of each pixel of the through still image is equal to or higher than a predetermined value. If “NO” in the step S5, that is, if a luminance of a predetermined value or more cannot be detected, the process proceeds to a step S13. On the other hand, if “YES” in the step S5, that is, if a luminance of a predetermined value or more is detected, concentrated sampling is performed in a step S7. That is, as shown in FIGS. 3A and 3B, a concentrated sampling area CSA is set based on the coordinates of a pixel in which a luminance of a predetermined value or more is detected, and the through image is updated in the concentrated sampling area CSA. To do.

  Subsequently, in step S9, it is determined whether the source is a visible light communication source. That is, it is determined whether or not the light source included in the set concentrated sampling area CSA includes an optical signal for performing visible light communication. If “NO” in the step S9, that is, if it is not a visible light communication source, the process proceeds to a step S13. On the other hand, if “YES” in the step S9, that is, if the visible light communication is performed, data transmitted from the visible light communication source is acquired in a step S11. For example, data transmitted from a light source that emits visible light 60 shown in FIGS. 3A and 3B is received, and the received data is stored in the visible light communication buffer 328.

  In step S13, a prohibition information confirmation process is executed. The process in step S13 will be described in detail with reference to the flowchart showing the prohibition information confirmation process shown in FIG. Subsequently, in step S15, it is determined whether or not an end operation is performed. For example, it is determined whether or not the end call key 22c has been operated. If “NO” in the step S15, that is, if an end operation is performed, the visible light communication process is ended. On the other hand, if “YES” in the step S15, that is, if it is not an end operation, it is determined whether or not the raster scan is ended in a step S17. That is, it is determined whether or not the coordinates indicating the current search position read from the raster scan buffer 324 are the lower right coordinates of the display coordinates of the LCD monitor 26.

  If “NO” in the step S17, that is, if the raster scan is not ended, the coordinates indicating the current search position by the raster scan are read from the raster scan buffer 324, and the process returns to the step S3. On the other hand, if “YES” in the step S17, that is, if the raster scan is completed, the visible light communication buffer 328 is reset, and the process returns to the step S1.

  FIG. 7 is a flowchart showing the prohibition information confirmation process shown in step S13 (see FIG. 6). When the process of step S13 is executed, the CPU 20 determines whether or not photographing prohibition information has been acquired in step S31. That is, it is determined whether or not the data stored in the visible light communication buffer 328 matches the prohibition signal confirmation data 332. If “YES” in the step S31, that is, if the prohibition information is acquired, the prohibition flag 336 is turned on in a step S33, and the process proceeds to the step S37. On the other hand, if “NO” in the step S31, the prohibition flag 336 is turned off in a step S35, and the process proceeds to the step S37. That is, when the prohibition information is not transmitted from the visible light communication source or when the user leaves the visible light communication source that transmits the prohibition information and no prohibition information is received, the prohibition flag 336 is turned off. That is, the user can release the restriction of photographing by moving to a place where the prohibition information is not transmitted, and the convenience for the user is improved.

  In step S37, it is determined whether the camera function is terminated. For example, it is determined whether or not an end operation for pressing the end call key 22c has been performed. If “YES” in the step S37, that is, if the camera function is ended, the prohibition flag 336 is turned off in a step S39. That is, the restriction on shooting by the camera function is canceled when the camera function ends. That is, since the user can cancel the restriction of photographing by terminating the camera function, the convenience for the user is improved.

  And if the process of step S39 is complete | finished or if it is "NO" in step S37, it will return to a visible light communication process. In addition, CPU20 which performs the process of step S33 functions as a limiting means. Further, the CPU 20 that executes step S35 functions as a first release unit, and the CPU 20 that executes the process of step S39 functions as a second release unit.

  FIG. 8 is a flowchart showing camera function processing that is processed in parallel with the visible light communication processing described above (see FIG. 6). The CPU 20 determines whether or not a shooting operation has been performed. That is, it is determined whether or not the menu key 22b is pressed. If “NO” in the step S51, that is, if the photographing operation is not performed, the process proceeds to a step S61. On the other hand, if “YES” in the step S51, that is, if a photographing operation is performed, it is determined whether or not the prohibition flag 336 is turned on in a step S53. That is, it is determined whether or not recording of compressed image data or MPEG data by shooting is restricted.

  If “NO” in the step S53, that is, if the prohibition flag 336 is turned off, the process proceeds to a step S59. On the other hand, if “YES” in the step S53, that is, if the prohibition flag 336 is turned on, recording of image data by photographing is restricted in a step S55. That is, the compressed image data or the MPEG data is limited not to be recorded in the flash memory 28. Specifically, in the still image shooting mode, the CPU 20 does not convert photographic image data into compressed image data even when a shooting instruction is issued by another task. In the moving image shooting mode, the CPU 20 does not convert the through image into MPEG data even when a shooting instruction is issued by another task. The CPU 20 that executes the process of step S55 functions as a recording restriction unit.

  Subsequently, in step S57, a shooting prohibition pop-up 66 is displayed, and the process proceeds to step S61. That is, as shown in FIG. 4, a pop-up 66 including a character string “photographing is prohibited” is displayed on the LCD monitor 26. As a result, the user can recognize that shooting is restricted. In addition, CPU20 which performs the process of step S57 functions as a notification means.

  In step S59, image data is recorded. That is, the compressed image data or MPEG data is recorded in the flash memory 28 according to the shooting mode.

  In step S61, it is determined whether the operation is an end operation. For example, it is determined whether or not the end call key 22c has been operated. If “NO” in the step S61, that is, if the end operation is not performed, the process returns to the step S51. On the other hand, if “YES” in the step S61, that is, if an end operation is performed, the camera function process is ended.

  Here, in the present invention, the shooting operation may be invalidated without limiting the compressed image data or the MPEG data not to be recorded in the flash memory 28. Specifically, the process of step S71 shown in FIG. 9 is executed instead of the process of step S55 in the camera function process shown in FIG. Hereinafter, the processing for invalidating the shooting operation will be described in detail with reference to FIG. 9, but the processing that has already been described will be omitted for simplicity.

If “YES” in the step S53, the photographing operation is invalidated in a step S71. Specifically, in the still image shooting mode and the moving image shooting mode, the CPU 20 does not accept the issued shooting instruction even when the menu key 22b is pressed. Then, when the process of step S71 ends, the process proceeds to step S57. As described above, the mobile terminal 10 can limit the shooting by the camera function by invalidating the shooting operation. The CPU 20 that executes the process of step S71 functions as a photographing operation invalidating unit.
<Second embodiment>
In the second embodiment, when the prohibition information is acquired from the visible light communication source by the optical sensor 42 instead of the camera control circuit 36 and the image sensor 38, the photographing by the camera function is limited. That is, in the second embodiment, the optical sensor 42 is used as a receiving means for visible light communication.

  In the second embodiment, the configuration of the mobile terminal 10 in FIG. 1 and the external view of the mobile terminal 10 in FIG. 2 in the first embodiment are shown in FIGS. 3 (A), 3 (B) and FIG. The illustration of the through image displayed on the LCD monitor 26 shown in FIG. 5 and the memory map 300 of the RAM 30 shown in FIG.

  Referring to FIG. 10, visible lights 60a-60e are emitted from lighting provided on the ceiling of a certain office, and each of the visible lights 60a-60e is prohibited information as in the first embodiment. including. The imaging surface of the image sensor 38 is directed to the paper P through the opening OP3, and a through image including the paper P 'is displayed on the LCD monitor 26. The optical sensor 42 receives the visible light 60b.

  Since the visible light 60b including the prohibition information is received by the optical sensor 42, even if the menu key 22b is pressed, the pop-up 66 shown in FIG. The compressed image data or MPEG data of the scene is not recorded in the flash memory 28. That is, even if the image sensor 38 does not receive the visible light 60b, the mobile terminal 10 can limit the shooting by the camera function, as in the first embodiment. In the portable terminal 10 shown in FIG. 10, except for the LCD monitor 26 and the optical sensor 42, illustration is omitted for simplicity.

  In addition, since the sensor part of the optical sensor 42 includes a plurality of photosensors, information can be acquired from a plurality of visible light communication sources by switching the photosensors to be used. That is, the mobile terminal 10 in the second embodiment can acquire information from other visible light communication sources even in a state where the prohibition information is acquired, as in the first embodiment.

  Further, in the second embodiment, even when the optical sensor 42 is hidden by the user's finger, it is possible to restrict shooting by the camera function. Specifically, when the luminance value output from the optical sensor 42 becomes the minimum value, shooting by the camera function is limited. Further, in the second embodiment, as in the first embodiment, the photographing operation may be invalidated.

  As in the first embodiment, the CPU 20 in the second embodiment performs the visible light communication process shown in FIG. 11 and the prohibited information confirmation process shown in FIG. 12 under the control of RTOS such as “Linux” and “REX”. A plurality of tasks including the camera function processing shown in FIG. Note that the camera function processing shown in FIG. 8 is omitted for the sake of simplicity.

  FIG. 11 is a flowchart showing visible light communication processing in the second embodiment. For example, when the user performs an operation to execute the camera function, in step S81, it is determined whether or not visible light communication has been received. That is, it is determined whether or not visible light 60a-60e including an optical signal is received by the optical sensor 42. If “NO” in the step S81, that is, if the visible light communication is not received, the process proceeds to a step S85. On the other hand, if “YES” in the step S81, that is, if the visible light communication is received, the data transmitted from the visible light communication source is acquired in a step S83. That is, the optical signal included in the visible light is decoded, and the decoded information (data) is stored in the visible light communication buffer 328.

  In step 85, a prohibition information confirmation process is executed. The process of step S85 will be omitted here because it will be described in detail with reference to the flowchart showing the prohibition information confirmation process shown in FIG. In step S87, it is determined whether the operation is an end operation. In step S87, as in step S15 of the first embodiment, it is determined whether or not an end operation has been performed. If “NO” in the step S87, that is, if the end operation is not performed, the process returns to the step S81. On the other hand, if “YES” in the step S87, that is, if an end operation is performed, the visible light communication process is ended.

  FIG. 12 is a flowchart showing prohibition information confirmation processing in the second embodiment. When the process of step S85 is executed, the CPU 20 determines whether or not the value of the optical sensor 42 is the minimum value in step S91. That is, it is determined whether or not the optical sensor 42 is covered with a finger or the like and cannot receive visible light. If “YES” in the step S91, the prohibition flag 336 is turned on in a step S33. On the other hand, if “NO” in the step S91, it is determined whether or not the prohibition information is acquired in a step S31. In the prohibition information confirmation process in the second embodiment, the processes in steps S31 to S39 are the same as those in the first embodiment, and detailed description thereof is omitted.

  In the second embodiment, when the value output from the optical sensor 42 reaches the minimum value, shooting by the camera function is limited. However, even when the value output from the optical sensor 42 changes suddenly. You may make it restrict | limit the imaging | photography by a camera function. In addition, it is also possible to use the value output from the optical sensor 42 to detect work on the optical sensor 42 and limit the shooting by the camera function.

  Further, the portable terminal 10 of the second embodiment enables the prohibition information to be acquired in the same manner as the first embodiment, and the prohibition information is obtained by any one of the image sensor 38 and the camera control circuit 36 or the optical sensor 42. If acquired, shooting by the camera function may be restricted.

  As can be seen from the above description, the mobile terminal 10 includes the camera control circuit 36 and the image sensor 38, and can execute the camera function. The mobile terminal 10 can receive information (data) from a visible light communication source using the camera control circuit 36 and the image sensor 38 or the optical sensor 42. And the portable terminal 10 will restrict | limit imaging | photography with a camera function, if prohibition information is received using visible light communication.

  Thereby, when the portable terminal 10 receives the optical signal including the prohibition information, the portable terminal 10 can prevent the voyeurism that is easily executed by restricting the photographing by the camera function.

  In addition, a store clerk such as a bookstore and a store manager can prevent voyeurism using lighting provided on the ceiling in a place where photographing in the store is prohibited. Furthermore, since visible light 60-64 can be used as illumination, it is not necessary to install a monitoring device in a bookstore where a light source is installed, and the beauty is maintained.

  And since prohibition information is transmitted using visible light, a store clerk and a store manager who set prevention of voyeurism can easily recognize the range where photography is restricted.

  In this embodiment, the through image update cycle is set to 1000 fps, but may be set to 15 fps to reduce the processing load of the CPU 20 and the update cycle may be set to 1000 fps only when concentrated sampling is performed. A dedicated SDRAM may be provided for the camera function.

  Further, by providing the image sensor 38 capable of photographing infrared light, visible light communication may be performed using a light source that emits infrared light. Further, the image sensor 38 may be a CCD image sensor instead of a CMOS image sensor.

  Further, the pop-up 66 may not be deleted unless it is touched and released within the display area of the pop-up 66. Further, the value output from the optical sensor 42 may be used for control for adjusting the brightness of the LCD monitor 26.

Further, the communication method of the mobile terminal 10 is not limited to the CDMA method, but may be a W-CDMA method, a TDMA method, a PHS method, a GSM method, or the like. Not only the portable terminal 10 but also a portable information terminal such as a PDA (Personal Digital Assistant) having a camera function may be used. Furthermore, visible light communication may be performed by attaching a WEB camera, a mobile camera, or the like to the portable terminal 10 that does not have a camera function, and installing camera function software.
Further, the mobile terminal 10 shown in the first embodiment and the second embodiment may be an electronic camera. In the electronic camera to which the first embodiment is applied, the optical sensor 42 may not be provided. Moreover, although the portable terminal 10 shown in 1st Example and 2nd Example was demonstrated as a thing provided with the touch panel 34, as a portable terminal of this invention, you may not be provided with a touch panel.

  In addition, as an example of a place to prevent voyeurism, a bookstore was mentioned in the above description, but a place to prevent voyeurism according to the present invention is not limited to a bookstore, and besides this, a company, a movie theater, a concert It may be other appropriate places such as a venue, a station, and a school.

FIG. 1 is a block diagram showing a portable terminal of the present invention. FIG. 2 is an illustrative view showing an appearance of the portable terminal shown in FIG. FIG. 3 is an illustrative view showing one example of raster scan processing by the CPU shown in FIG. FIG. 4 is an illustrative view showing a position display example of a through image displayed on the LCD monitor shown in FIG. FIG. 5 is an illustrative view showing one example of a memory map of the RAM shown in FIG. FIG. 6 is a flowchart showing visible light communication processing of the CPU shown in FIG. FIG. 7 is a flowchart showing the prohibition information confirmation processing of the CPU shown in FIG. FIG. 8 is a flowchart showing camera function processing of the CPU shown in FIG. FIG. 9 is a flowchart showing a part of another camera function process of the CPU shown in FIG. FIG. 10 is an illustrative view showing a state in which visible light communication is performed using the optical sensor shown in FIG. FIG. 11 is a flowchart showing the visible light communication process of the second embodiment of the CPU shown in FIG. FIG. 8 is a flowchart showing the prohibition information confirmation process of the second embodiment of the CPU shown in FIG.

Explanation of symbols

10 ... Mobile terminal 20 ... CPU
22 ... Key input device 26 ... LCD monitor 28 ... Flash memory 30 ... RAM
36 ... Camera control circuit 38 ... Image sensor 42 ... Optical sensor

Claims (10)

Photographing means for photographing an image including an optical signal from a light source ;
Centralized sampling means for centrally sampling a part of an image photographed by the photographing means;
Determining means for determining whether a part of the image that has been sampled by the concentrated sampling means includes an optical signal including control information; and
When it is determined to contain an optical signal including control information by said determining means comprises a limiting means to limit the photographing by the imaging means, the portable terminal. Recording means for recording an image photographed by the photographing means;
The portable terminal according to claim 1, wherein the limiting unit includes a recording limiting unit that limits recording of a photographed image. An input device for inputting a photographing operation for causing the photographing means to photograph;
The portable terminal according to claim 1, wherein the limiting unit includes a shooting operation invalidating unit that invalidates a shooting operation input to the input device.   The portable terminal according to any one of claims 1 to 3, further comprising notification means for notifying that photographing is restricted when the photographing means is operated in a state where photographing is restricted by the restriction means. . The portable terminal according to any one of claims 1 to 4, further comprising a first release unit that releases the restriction by the restriction unit when the photographing unit is stopped. When an optical signal including the control information by the imaging means is no longer taken, further comprising a mobile terminal according to any one of claims 1 to 5 the second releasing means for releasing the restriction by the restricting means. The light source is a light source emitting visible light, a portable terminal according to any one of claims 1 to 6. A processor of a portable terminal having a photographing means for photographing an image including an optical signal from a light source ;
Centralized sampling means for centrally sampling a part of an image photographed by the photographing means;
Determining means for determining whether a part of the image that has been sampled by the concentrated sampling means includes an optical signal including control information; and
When it is determined to contain an optical signal including control information by said determining means, limited hand stage and to be functional, the imaging control program to limit the photographing by the photographing means. A photographing control method for a portable terminal, having photographing means for photographing an image including an optical signal from a light source ,
Concentrated sampling of a part of an image photographed by the photographing means,
It is determined whether a part of the centrally sampled image includes an optical signal including control information, and when it is determined that an optical signal including control information is included , shooting by the imaging unit is controlled. Limited shooting control method. Photographing means for photographing an image including an optical signal from a light source ;
Centralized sampling means for centrally sampling a part of an image photographed by the photographing means;
Determining means for determining whether a part of the image that has been sampled by the concentrated sampling means includes an optical signal including control information; and
When it is determined to contain an optical signal including control information by said determining means comprises a limiting means to limit the photographing by the imaging means, an electronic camera.

Images