JP5864927B2 - IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, AND PROGRAM - Google Patents

Description

  The present invention relates to an imaging apparatus having a function of acquiring position information.

In recent years, there are imaging apparatuses such as digital still cameras and digital video cameras equipped with wireless communication functions such as GPS (Global Positioning System) and wireless LAN in order to acquire position information at the time of shooting. In such an imaging apparatus, position information at the time of imaging is acquired and recorded as attribute information of imaging data.
However, if communication by GPS or wireless LAN is always performed, power consumption by such wireless communication increases, and particularly when the imaging device is driven by a battery, battery consumption is accelerated.
Therefore, there is a technique for reducing power consumption by acquiring position information by wireless communication only while the imaging device is imaging, and not acquiring position information by wireless communication while not imaging. (Patent Document 1).

JP 2006-339723 A

However, when acquiring location information using the wireless communication function during imaging, a large amount of power is consumed in wireless communication. Therefore, when the imaging device is driven by a battery, the power for imaging is stable. There was a risk that it could not be supplied.
The present invention has been made in view of the above problems, and has an object to obtain position information during imaging and reduce power consumption during imaging.

  In order to achieve the above object, an imaging apparatus of the present invention is an imaging apparatus having imaging means, and an acquisition means for acquiring the position of the imaging apparatus based on a radio signal transmitted from a first external device. A measuring unit that measures the movement of the imaging device by a sensor included in the imaging device, a calculating unit that calculates a position of the imaging device based on a measurement result by the measuring unit, and an imaging operation by the imaging unit. And a switching unit that switches from acquisition of the position of the imaging device by the acquisition unit to calculation of the position of the imaging device by the calculation unit.

  According to the present invention, position information can be acquired during imaging, and power consumption during imaging can be reduced.

1 is a network configuration diagram according to an embodiment of the present invention. Block diagram of digital video camera 101 Block diagram of mobile phone 102 Flow chart realized by the digital video camera 101 Flow chart realized by the digital video camera 101 Sequence chart for terrain data acquisition Flow chart realized by the mobile phone 102

  FIG. 1 shows a system configuration diagram of the present embodiment. The system according to this embodiment includes a digital video camera 101, a mobile phone 102, a GNSS satellite 103, and a mobile phone base station 104. Here, GNSS is an abbreviation for Global Navigation Satellite Systems, and is a general term for GPS, GLONASS, GALILEO, and the like.

  The digital video camera 101 and the mobile phone 102 receive the GNSS signal from the GNSS satellite 103, thereby calculating and acquiring the respective position information. In addition, the digital video camera 101 and the mobile phone 102 establish a wireless LAN 106 and perform wireless communication conforming to the IEEE 802.11 series. Instead of this, for example, wireless communication based on wireless USB, MBOA, Bluetooth (trademark), UWB, or ZigBee, or wired communication may be performed. Here, MBOA is an abbreviation for Multi Band OFDM Alliance.

  Further, the mobile phone 102 can be connected to the Internet 105 via the mobile phone base station 104.

  FIG. 2 shows a functional block configuration of the digital video camera 101. A GNSS control unit 201 performs various controls for receiving a GNSS signal via the GNSS antenna 202. A control unit (CPU) 203 controls the entire digital video camera 101 by executing a program stored in the storage unit 204. Reference numeral 204 denotes a storage unit (memory) that stores programs executed by the control unit 203 and various types of information such as communication parameters. Various operations of the digital video camera 101 to be described later are realized by the control unit 203 executing a program stored in the storage unit 204.

  A power supply unit (battery) 205 supplies power to the digital video camera 101. Reference numeral 206 denotes an operation unit for the user to operate the digital video camera 101, and includes an imaging button and the like. Reference numeral 207 denotes a display unit that performs various displays, and has a function capable of outputting sound such as a speaker in addition to outputting visually recognizable information such as an LCD or LED. Reference numeral 208 denotes an imaging unit, and reference numeral 209 denotes a packet transmission / reception unit that transmits and receives packets related to various communications.

  A wireless LAN control unit 210 performs various types of control of wireless LAN communication via the wireless LAN antenna 211. A position information acquisition unit 212 acquires position information (current position) of the digital video camera 101 using GNSS or wireless LAN. Reference numeral 213 denotes a terrain data acquisition unit which acquires terrain data (map information) including the current location of the digital video camera 101 and its surroundings from the mobile phone 102.

  A sensor control unit 214 controls the acceleration sensor 215, the electronic compass 216, and the atmospheric pressure sensor 217, and measures the movement of the digital video camera 101. A position calculation unit 218 calculates position information of the digital video camera 101 using the terrain data and the motion sensor information.

  Note that it is more power-consuming to acquire position information (current location) using these motion sensors than to acquire position information (current location) of the digital video camera 101 using wireless communication such as a GNSS signal or wireless LAN. Has been confirmed to decrease.

  FIG. 3 shows a functional block configuration of the mobile phone 102. A wireless LAN control unit 301 performs various types of control of wireless LAN communication via the wireless LAN antenna 302. A control unit (CPU) 303 controls the entire mobile phone 102 by executing a program stored in the storage unit 304. Reference numeral 304 denotes a storage unit (memory) that stores programs executed by the control unit 303 and various types of information such as communication parameters. Various operations of the mobile phone 102 to be described later are realized by the control unit 303 executing programs stored in the storage unit 304.

  A power supply unit (battery) 305 supplies power to the mobile phone. Reference numeral 306 denotes an operation unit for the user to operate the mobile phone 102. The operation unit 306 includes operation buttons and the like for inputting to the mobile phone 102. Reference numeral 307 denotes a display unit that performs various displays, and has a function capable of outputting sound such as a speaker in addition to outputting visually recognizable information such as an LCD or LED. A call unit 308 is used by the user to make a call using the mobile phone 102. A packet transmission / reception unit 309 transmits / receives a packet related to various types of communication. Reference numeral 310 denotes a public radio control unit that performs various controls of public radio communication via the public radio antenna 311. Public wireless communication is, for example, communication that conforms to the International Multimedia Communications (IMT) standard or the Long Term Evolution (LTE) standard.

  Reference numeral 312 denotes a GNSS control unit that performs various controls of GNSS signal reception via the GNSS antenna 313. Reference numeral 314 denotes a position information acquisition unit that acquires position information of the mobile phone 102 using GNSS, wireless LAN, or public wireless. Reference numeral 315 denotes a terrain data generation unit that acquires maps and floor information from an external device on the Internet 105 and generates terrain data.

  Note that the functional blocks described above have a mutual relationship in terms of software or hardware. Further, the functional block is an example, and a plurality of functional blocks may constitute one functional block, or any functional block may be further divided into blocks that perform a plurality of functions.

  FIG. 4 shows a flowchart realized when the control unit 203 of the digital video camera 101 reads a program stored in the storage unit 204.

  First, when the digital video camera 101 is turned on, the GNSS control unit 201 and the wireless LAN control unit 210 start operating (S401). Then, the operation unit 206 determines whether or not the imaging button is pressed by the user (S402). If the imaging button is pressed, the process proceeds to S407, and if not, the process proceeds to S403. Note that the processing may advance to S407 when the imaging start time set in advance is reached, or when the imaging target object exists in the imaging area, and may advance to S403 if not.

  In step S <b> 403, the position information acquisition unit 212 determines whether a predetermined time has elapsed from the previous acquisition time of the position information (current location) of the digital video camera 101. If the predetermined time has elapsed, the process proceeds to S404, and if not, the process returns to S402. If no position information has been acquired in the past, the process proceeds to S404. In S404, the position information acquisition unit 212 performs position information acquisition processing. Next, position information acquisition processing will be described with reference to FIG.

  First, the GNSS control unit 201 determines whether or not the position information of the digital video camera 101 can be acquired using the GNSS signal from the GNSS satellite 103 (S501). Here, it is determined whether or not the position information of the digital video camera 101 can be acquired by receiving GNSS signals from a plurality of GNSS satellites 103 and performing three-dimensional positioning calculation. When the position information can be acquired using the GNSS signal, the position information acquisition unit 212 acquires the position information (current position) of the digital video camera 101 based on the GNSS signal from the GNSS satellite 103 (S502).

  On the other hand, when the location information cannot be acquired using the GNSS signal, the wireless LAN control unit 210 searches the surroundings and determines whether or not there is a wireless LAN base station (access point, hereinafter referred to as AP). (S503). If there is no AP around, the process shown in FIG. 5 is terminated. On the other hand, if there are APs around, the position information acquisition unit 212 acquires position information (current location) of the digital video camera 101 based on the detected AP (S504). Specifically, the digital video camera 101 transmits the detected MAC address of the AP to an external device on the Internet 105. The external device refers to a database in which the MAC address and AP position information are associated with each other, and transmits position information corresponding to the transmitted MAC address to the digital video camera 101. The digital video camera 101 acquires the position information transmitted from the external device as the position information of the digital video camera 101.

  Note that the method for acquiring the position information of the digital video camera 101 is not limited to this. For example, position information can be acquired as follows. The digital video camera 101 requests location information from the mobile phone 102. The mobile phone 102 that has received the request acquires the location information of the mobile phone 102 based on the information of one or more mobile phone base stations 104 existing around the mobile phone 102. For example, the mobile phone 102 may transmit the device identifier of the mobile phone base station 104 existing in the vicinity to an external device on the Internet 105, and acquire the location information associated with the device identifier.

  The mobile phone 102 transmits the position information acquired in this way to the digital video camera 101, and the digital video camera 101 acquires the position information transmitted by the mobile phone 102 as the position information of the digital video camera 101. Further, the mobile phone 102 may acquire position information using a GNSS signal.

  When the position information (current location) of the digital video camera 101 is acquired in this way, in S405, the terrain data acquisition unit 213 determines whether or not the current location of the digital video camera 101 and terrain data around it are held. To do. If the terrain data is retained, the process returns to S402, and if the terrain data is not retained, the process proceeds to S406. In S406, the terrain data acquisition unit 213 performs terrain data acquisition processing. Next, the terrain data acquisition process will be described with reference to FIG.

  First, the wireless LAN control unit 210 connects to the mobile phone 102 using communication parameters for communicating with the mobile phone 102 stored in advance in the storage unit 204 (M601). Note that the communication parameters for communicating with the mobile phone 102 are acquired by executing, for example, user input via the operation unit 206 or WPS (Wi-Fi Protected Setup), and stored in the storage unit 204. I can leave it to you.

  When the connection between the digital video camera 101 and the mobile phone 102 is completed, the terrain data acquisition unit 213 requests the terrain data from the mobile phone 102 in order to acquire terrain data including the current location of the digital video camera 101 and its surroundings ( M602). Here, the request includes the position information of the digital video camera 101, the scale ratio of the requested terrain data, and the necessity of building information.

  Here, for example, when the imaging unit 208 of the video camera 101 captures an angle of view including the sky, a wide range of terrain data can be acquired by reducing the scale ratio of the requested terrain data. In addition, when the imaging unit 208 of the video camera 101 captures an angle of view that does not include the sky, detailed terrain data can be obtained by increasing the scale ratio of the requested terrain data and requiring building information. Can be obtained.

  When the cellular phone 102 is requested for terrain data, it performs a terrain data generation process (M603). Hereinafter, the terrain data generation process will be described with reference to FIG. FIG. 7 is a flowchart realized when the control unit 303 of the mobile phone 102 reads the program stored in the storage unit 304.

  In step S <b> 701, the terrain data generation unit 315 determines whether the location information of the digital video camera 101 is included in the terrain data request. If position information is included, the process proceeds to S706, and if not included, the process proceeds to S702. In step S <b> 702, the terrain data generation unit 315 determines whether the mobile phone 102 holds its own position information. If the position information of the mobile phone 102 is held, the process proceeds to S703, and if not, the process proceeds to S705. In step S <b> 703, the terrain data generation unit 315 determines whether the position information of the mobile phone 102 is highly accurate. Here, when the GNSS signal is used to acquire the position information of the mobile phone 102, and the number of GNSS satellites 103 that transmitted the GNSS signal used to acquire the position information is greater than a predetermined number, the accuracy is high. Is determined to be high. If it is determined that the accuracy is high, the process proceeds to S704, and if it is determined that the accuracy is low, the process proceeds to S705.

  In step S <b> 704, the position information acquisition unit 314 determines whether a predetermined time has elapsed since the previous acquisition time of the position information of the mobile phone 102. If the predetermined time has elapsed, the process proceeds to S705, and if not, the process proceeds to S706. In step S <b> 705, the position information acquisition unit 314 performs position information acquisition processing. As for the position information acquisition process, the position information acquisition unit 314 performs the same process as the process shown in FIG. The cellular phone 102 recognizes the position information (current location) acquired in this way as the current location of the digital video camera 101.

  When the acquisition of the position information of the mobile phone 102 is completed, the process proceeds to S706. In step S <b> 706, the terrain data generation unit 315 determines whether or not the mobile phone 102 holds terrain data including the current location of the digital video camera 101 and its surroundings. If it is held, the process proceeds to S708, and if it is not held, the process proceeds to S707. In S707, the terrain data generation unit 315 obtains terrain data. For example, it connects to an external device existing on the Internet 105 using public radio, and acquires map information and building information. When the acquisition of the terrain data is completed, the terrain data generation unit 315 generates the terrain data in S708. Here, the map information is enlarged / reduced according to the scale ratio included in the terrain data request, and unnecessary building information is deleted.

  If neither the digital video camera 101 nor the mobile phone 102 can acquire the current location, the terrain data is acquired based on the position information previously acquired by the digital video camera 101 or the mobile phone 102. Here, when the current location cannot be acquired in this way, the area of the terrain data to be acquired is increased compared to the case where the current location can be acquired. Thereby, when the present location can be newly acquired after that, it is possible to increase the probability of having the newly acquired topographic data of the current location.

  When the terrain data generation process is completed in this way, the mobile phone 102 transmits the terrain data to the digital video camera 101 (M604). If the location information of the digital video camera 101 is not included in the request for the terrain data, the location information acquired by the mobile phone 102 is added to the terrain data and transmitted. In this way, the digital video camera 101 can obtain position information. Thereafter, the digital video camera 101 and the mobile phone 102 perform a disconnection process (M605). Note that the cutting process may be performed in response to the start of imaging in the digital video camera 101.

  Next, a case where it is determined in S402 that the imaging button has been pressed will be described. In S407, the GNSS control unit 201 and the wireless LAN control unit 210 stop the wireless communication. In step S <b> 408, the sensor control unit 214 activates the acceleration sensor 215, the electronic compass 216, and the atmospheric pressure sensor 217. Note that all these motion sensors may not be activated in accordance with the remaining battery level of the digital video camera 101. For example, the atmospheric pressure sensor 217 is not activated when the remaining battery level is low. Further, when the imaging unit 208 of the video camera 101 captures an angle of view that does not include the sky, the acceleration sensor 215 and the electronic compass 216 are not activated. In this way, power consumption can be further suppressed.

  When the activation of the motion sensor is completed, the process proceeds to S409, and the imaging unit 208 starts imaging processing. Then, the position calculation unit 218 calculates the position of the digital video camera 101 (S410). Here, first, from the information of the acceleration sensor 215 and the electronic compass 216, the traveling direction and the movement amount of the digital video camera 101 from the time when the position information is obtained in S404 are calculated, and the digital video is calculated from the change of the atmospheric pressure sensor 217. A change in altitude of the camera 101 is calculated. Then, the current location of the digital video camera 101 is calculated based on the positional information of the digital video camera 101 obtained in S404, the calculated traveling direction and movement amount, and the change in altitude. Further, the position calculation unit 218 corrects the position information of the digital video camera 101 with reference to the terrain data. For example, in the case where the outside of the building is indicated as a result of the position calculation by the motion sensor despite being on the third floor of the building, the position information is corrected in the building. Further, as a result of the position calculation by the motion sensor, if the vehicle suddenly deviates from the road despite having traveled on the road so far, the correction is made on the road. The imaging unit 208 stores the position information of the digital video camera 101 obtained in this way in the storage unit 204 in association with the captured image (S411).

  In step S412, the operation unit 206 determines whether or not the imaging button has been pressed again by the user. If the imaging button is pressed, the process proceeds to S414, and if not, the process proceeds to S413. Note that the process may advance to S414 when the preset imaging end time is reached, or when the imaging target object no longer exists in the imaging area, and may proceed to S413 otherwise.

  In step S <b> 413, the position information acquisition unit 212 determines whether a predetermined time has elapsed since the previous calculation time of the position information (current location) of the digital video camera 101. If the predetermined time has elapsed, the process proceeds to S410, and if not, the process proceeds to S411.

  In S414, the sensor control unit 214 stops the acceleration sensor 215, the electronic compass 216, and the atmospheric pressure sensor 217, and returns to S401.

  As described above, the digital video camera 101 switches from acquisition of a position by wireless communication to acquisition of a position by a motion sensor according to an imaging operation. Therefore, power consumption can be reduced by stopping the wireless communication function during the imaging process, and the position during imaging can be acquired because the position of the subject is calculated using the motion sensor.

  In addition, when the position information acquisition process by wireless communication has failed a certain number of times or more (in the case of No in both S501 and S503), the position information acquisition process by the motion sensor may be switched. Thereby, even if it is difficult to acquire position information by wireless communication, position information can be acquired.

  In this embodiment, acquisition of position information by wireless communication is started in response to power-on of the digital video camera 101. Although acquisition of position information by wireless communication may take time, the position at the start of imaging can be obtained in the manner described above. Further, the present invention is not limited to this, and acquisition of position information by wireless communication may be started in response to the imaging standby state. As a result, the power consumption can be further reduced.

  In this embodiment, the digital video camera 101 stops the wireless communication function during the imaging process. However, when capturing a still image, the wireless video communication 101 is not stopped and the position information acquisition by the wireless communication is continued. You may do it. Thereby, the overhead which switches the acquisition method of position information from acquisition by wireless communication to acquisition by a motion sensor can be eliminated. Even in this case, when capturing a moving image, power consumption can be reduced by stopping acquisition of position information by wireless communication.

  In the present embodiment, the digital video camera 101 stops acquiring position information through wireless communication in response to the start of imaging. However, the present invention is not limited to this, and in response to the start of imaging, the digital video camera 101 performs the position information acquisition process (S403) by wireless communication again, and then stops the acquisition of position information by wireless communication and activates the motion sensor. You may make it start. As a result, the position of the digital video camera 101 at the start of imaging can be accurately acquired, so that the accuracy of position information at the time of shooting can be increased. Moreover, since the acquisition of position information by wireless communication is stopped thereafter and the motion sensor is activated, power consumption during imaging can be reduced.

101 Digital Video Camera 102 Mobile Phone 103 GNSS Satellite 104 Mobile Phone Base Station 105 Internet 106 Wireless LAN

Claims (11)

An imaging device having imaging means,
Acquiring means for acquiring the position of the imaging device based on a radio signal transmitted from the first external device;
Measuring means for measuring movement of the imaging device by a sensor included in the imaging device;
Calculation means for calculating a position of the imaging device based on a measurement result by the measurement means;
Switching means for switching from acquisition of the position of the imaging device by the acquisition means to calculation of the position of the imaging device by the calculation means in response to an imaging operation by the imaging means;
An imaging device comprising:   The imaging apparatus according to claim 1, wherein measurement by the measurement unit is started in response to start of imaging by the imaging unit.   The calculating means is based on the position of the imaging device acquired before the acquisition by the acquiring means is stopped and the measurement result by the measuring means after the acquisition by the acquiring means is stopped. The imaging device according to claim 1, wherein the imaging device is calculated.   The switching unit acquires the position of the imaging device by the acquisition unit in response to the start of imaging by the imaging unit, and then acquires the position of the imaging device by the acquisition unit and then the imaging device by the calculation unit. The imaging apparatus according to claim 1, wherein the imaging device is switched to calculation of the position of the imaging device.   The information processing apparatus further includes an association unit that associates the position of the imaging device acquired by the acquisition unit or the information of the position of the imaging device calculated by the calculation unit with an image captured by the imaging unit. Item 5. The imaging device according to any one of Items 1 to 4. When capturing a moving image by the imaging unit, stop acquiring the position of the imaging device by the acquisition unit,
The imaging apparatus according to claim 1, wherein when the still image is captured by the imaging unit, the acquisition unit continues to acquire the position of the imaging apparatus.   The imaging apparatus according to claim 1, wherein the measuring unit measures movement of the imaging apparatus using an acceleration sensor or an atmospheric pressure sensor. A receiving means for receiving terrain information from the second external device;
The said calculating means calculates the position of the said imaging device based on the measurement result by the said measuring means, and the said topographic information received by the said receiving means, The any one of Claim 1 thru | or 7 characterized by the above-mentioned. The imaging device described. In addition to notifying the second external device of the position information of the imaging device, further comprising request means for requesting terrain information,
The imaging apparatus according to claim 8, wherein the receiving unit receives terrain information corresponding to a position of the imaging apparatus from the second external device. A method for controlling an imaging apparatus,
An acquisition step of acquiring the position of the imaging device based on a wireless signal transmitted from an external device;
A measurement step of measuring movement of the imaging device by a sensor included in the imaging device;
A calculation step of calculating a position of the imaging device based on a result of the measurement;
A switching step of switching from acquisition of the position of the imaging device in the acquisition step to calculation of the position of the imaging device in the calculation step according to an imaging operation by the imaging device;
A control method characterized by comprising:   The program for making a computer perform each process of Claim 10.

Images