JP2017146347A - Display device and display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device and a display system capable of clearly showing each image by using various information associated with image data. SOLUTION: A mobile information terminal 1 stores one or more image data from an image data storage unit 32 that stores image data in which an ID capable of specifying an image data acquisition position and additional information at the time of image data acquisition are associated with each other. The image extraction unit 22 that extracts the image data, the map extraction unit 23 that extracts the map data based on the ID associated with the extracted image data from the map data storage unit 33, and the mark of the number of image data extracted by the image extraction unit 22. An image is provided with an image arranging unit 24 for arranging the 91 at a position corresponding to the map data extracted by the map extracting unit 23, and a map display unit 25 for outputting the map data on which the mark 91 is arranged to the touch panel display 40. The arrangement unit 24 changes the arrangement position of the mark 91 according to additional information so that the marks 91 do not overlap. [Selection diagram] FIG. 10

Description

  The present invention relates to a display device and a display system.

Conventionally, in a construction site or the like, a construction record is photographed with a camera or the like and recorded. In such a field, images are taken from various positions and angles at a number of shooting points, and a number of images are recorded. However, when the recorded image is viewed later, it is a similar image, so it may not be known where the image was taken.
In view of this, for example, an image reproducing apparatus is disclosed in which position information at the time of shooting is associated with image data, and a coordinate mark corresponding to the read position information is displayed on a map (for example, Patent Documents). 1).

Japanese Patent No. 3742141

  By associating the position information with the image data, it becomes clear where the image data was taken. On the other hand, there is a need to clarify each image even when the same position information is associated with a plurality of image data.

  An object of the present invention is to provide a display device and a display system that can clearly show each image using various information associated with image data.

The present invention solves the above problems by the following means.
The first invention is an image storing the image data in which map information storage means for storing map information, information capable of specifying the acquisition position of image data, and additional information at the time of acquisition of the image data are associated with each other. Storage means, image extraction means for extracting one or more image data from the image storage means, and map information based on the information associated with the image data extracted by the image extraction means from the map information storage means Map extracting means for extracting, image placement means for placing the number of symbols of the number of image data extracted by the image extracting means at corresponding positions in the map information extracted by the map extracting means, and symbols generated by the image placing means Map display means for outputting the arranged map information to the display means, wherein the image placement means uses the additional information so that the symbols do not overlap. The Te varying the position of each symbol is a display device characterized.
According to a second aspect of the present invention, in the display device according to the first aspect, the additional information includes a radio wave intensity of a radio wave transmitter received at the time of acquiring image data, and the image placement unit is set at a distance specified by the radio wave intensity. The display device is characterized in that the symbol is arranged at a corresponding position.
According to a third aspect of the present invention, in the display device of the second aspect, the image arranging means enlarges or reduces the map information corresponding to the distance, and arranges the symbol at a corresponding position in the map information. This is a display device characterized by the above.
According to a fourth invention, in any one of the display devices from the first invention to the third invention, the additional information includes azimuth information related to a azimuth at the time of image data acquisition, and the image arrangement means includes the azimuth information The symbol is arranged at a position based on the display device.
A fifth invention is the display device according to the fourth invention, wherein the map display means outputs the map information rotated by the direction information to the display means.
According to a sixth invention, in any one of the display devices from the first invention to the fifth invention, the additional information includes angle information related to an angle at the time of image data acquisition, and the image arrangement means includes the angle information. The display device is characterized in that at least one of the shape and the color is different from each other.
According to a seventh invention, in any one of the display devices from the first invention to the sixth invention, radio wave receiving means for receiving the information and radio wave intensity transmitted from the radio wave transmitter, the transmitted information, Storage means for associating and storing position information; and radio wave position acquisition means for acquiring position information of the radio wave transmitter by referring to the storage means from information received by the radio wave reception means, the image The extraction unit is a display device characterized in that the image data associated with the information acquired by the radio wave position acquisition unit is extracted from the image storage unit.
According to an eighth aspect of the present invention, in the display device according to any one of the first to seventh aspects, the image storage unit further stores the image data associated with supplementary information input when the image data is acquired. A supplementary extraction means for extracting the supplementary information associated with the image data stored and extracted by the image extraction means; and a display of a supplementary information list in which the supplementary information extracted by the supplementary extraction means is listed. And a supplemental display means for displaying on the display.
According to a ninth invention, in the display system comprising any one of the display devices from the first invention to the eighth invention, and a data storage device connected to the display device so as to be communicable, the data storage The apparatus is a display system including at least one of the map information storage unit and the image storage unit.

  ADVANTAGE OF THE INVENTION According to this invention, the display apparatus and display system which can show each image clearly using the various information linked | related with image data can be provided.

It is a figure which shows the example of application of the image management system which concerns on this embodiment. It is a functional block diagram of the portable information terminal concerning this embodiment. It is a functional block diagram of a beacon terminal and a server concerning this embodiment. It is a figure which shows the example of the memory | storage part of the server which concerns on this embodiment. It is a flowchart which shows the main process in the portable information terminal which concerns on this embodiment. It is a figure which shows the example of a display with the portable information terminal which concerns on this embodiment. It is a flowchart which shows the recording process with the portable information terminal which concerns on this embodiment. It is a figure which shows the example of the image file produced | generated by the recording process which concerns on this embodiment. It is a flowchart which shows the browsing process with the portable information terminal which concerns on this embodiment. It is a figure which shows the example of the map data after the mark arrangement | positioning process in the browsing process which concerns on this embodiment. It is a flowchart which shows the vicinity data map display process in the portable information terminal which concerns on this embodiment. It is a figure which shows the example of a display with the portable information terminal which concerns on this embodiment.

DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. This is merely an example, and the technical scope of the present invention is not limited to this.
(Embodiment)
<Overall Configuration of Image Management System 100>
FIG. 1 is a diagram illustrating an application example of an image management system 100 according to the present embodiment.
FIG. 2 is a functional block diagram of the portable information terminal 1 according to the present embodiment.
FIG. 3 is a functional block diagram of the beacon terminal 5 and the server 7 according to the present embodiment.
FIG. 4 is a diagram illustrating an example of the storage unit 75 of the server 7 according to the present embodiment.

For example, as shown in FIG. 1, the image management system 100 is used for a work in which a construction record or the like is taken with a photograph at a construction site in a building or underground, and the record is recorded with the image.
The image management system 100 includes a portable information terminal 1, one or more beacon terminals 5 (radio wave transmitters), and a server 7 (external server).
A user (a person in charge at a construction site) first installs one beacon terminal 5 near the photographing point. The beacon terminal 5 is, for example, a device that is large enough to get on the palm of a person. The beacon terminal 5 has a unique ID (IDentifier) (information), and the radio wave transmitted from the beacon terminal 5 includes the ID.

Next, the user captures an image of the shooting point using the portable information terminal 1. When the portable information terminal 1 receives a radio wave transmitted by the beacon terminal 5 during imaging (hereinafter, a radio wave transmitted by the beacon terminal 5 is also referred to as a beacon radio wave), the mobile information terminal 1 receives the image data obtained by imaging. The ID included in the beacon radio wave is associated and stored.
When there are a plurality of shooting points, the user performs the same operation by installing another beacon terminal 5 near another shooting point. By using other beacon terminals 5, different IDs are associated with the image data.
Then, when the user views the image data stored in the portable information terminal 1 later, the portable information terminal 1 displays a map with a mark (symbol) related to the acquisition position of the image data. Then, when the user selects a mark shown on the map, the portable information terminal 1 outputs the target image data.

Next, the configuration of each device will be described.
<Portable information terminal 1>
The mobile information terminal 1 is, for example, a mobile phone or the like having a computer function represented by a smartphone. The portable information terminal 1 may be a tablet terminal.
The portable information terminal 1 can perform short-range wireless communication with the beacon terminal 5 using, for example, Bluetooth (registered trademark).

As shown in FIG. 2, the portable information terminal 1 includes a control unit 10, a storage unit 30, a touch panel display 40 (display unit), a camera 41 (imaging unit), a sensor unit 42, and a Bluetooth antenna 48 (radio wave). Receiving means) and a communication interface unit 49.
The control unit 10 is a central processing unit (CPU) that controls the entire portable information terminal 1. The control unit 10 executes various functions in cooperation with the hardware described above by appropriately reading and executing an operating system (OS) and application programs stored in the storage unit 30.
The control unit 10 includes a recording processing unit 11 and a browsing processing unit 21.

The recording processing unit 11 is a control unit that acquires and records image data via the camera 41.
The recording processing unit 11 includes a photographing instruction receiving unit 12, an image input unit 13, a radio wave processing unit 14 (radio wave processing unit), a sensor processing unit 15, an association unit 16 (associating unit, information receiving unit), and a supplement. A processing unit 17 (supplement reception unit) and a file name generation unit 18 (file name generation unit) are provided.
The shooting instruction receiving unit 12 receives an instruction to capture a shooting point via the touch panel display 40.
The image input unit 13 receives image data captured by the camera 41.
The radio wave processing unit 14 performs processing related to beacon radio waves.

The sensor processing unit 15 performs processing related to the sensor unit 42. The sensor processing unit 15 includes an orientation acquisition unit 15a (azimuth acquisition unit) and an angle acquisition unit 15b (angle acquisition unit).
The bearing acquisition unit 15a acquires bearing data related to the bearing detected by the sensor unit 42.
The angle acquisition unit 15b acquires angle data related to the inclination detected by the sensor unit 42.
The associating unit 16 associates the image data received by the image input unit 13 with various data and stores them in the storage unit 30. Various data will be described later.
The supplement processing unit 17 performs processing related to supplement data.
The file name generation unit 18 generates a file name so that various types of data are included in the file name of the image data.

The browsing processing unit 21 is a control unit that performs processing for browsing the image data stored in the storage unit 30.
The browsing processing unit 21 includes an image extraction unit 22 (image extraction unit), a map extraction unit 23 (map extraction unit), an image arrangement unit 24 (image arrangement unit), a map display unit 25 (map display unit), A radio wave position acquisition unit 26 (radio wave position acquisition means) and a supplemental display processing unit 27 (supplementary extraction means, supplemental display means) are provided.
The image extraction unit 22 extracts image data stored in the image data storage unit 32 (image storage unit).
The map extraction unit 23 extracts map data including the position indicated by the ID associated with the image data extracted by the image extraction unit 22 from the map data storage unit 33 (map information storage unit).
The image placement unit 24 places a mark indicating the image data on the map data extracted by the map extraction unit 23.
The map display unit 25 causes the touch panel display 40 to display the map data on which the mark is arranged by the image arrangement unit 24.
The radio wave position acquisition unit 26 acquires an ID included in the beacon radio wave.
The supplement display processing unit 27 extracts supplement data associated with the image data extracted by the image extraction unit 22. Then, the supplement display processing unit 27 creates supplement list data from the extracted supplement data and causes the touch panel display 40 to display the supplement list.

The storage unit 30 is a storage area such as a semiconductor memory element for storing programs, data, and the like necessary for the control unit 10 to execute various processes.
The storage unit 30 includes a program storage unit 31, an image data storage unit 32, and a map data storage unit 33.
The program storage unit 31 is a storage area for storing various application programs. The program storage unit 31 includes a recording browsing program 31a (program).
The record browsing program 31 a is a program for executing various functions of the control unit 10 of the portable information terminal 1. The record browsing program 31a is connected to an application distribution server (not shown) via the communication network N, downloaded from the application distribution server, and installed in the portable information terminal 1 in advance.

The image data storage unit 32 is a storage area for storing image data associated with various types of data by the recording processing unit 11.
The map data storage unit 33 is a storage area for storing map data. The map data is, for example, map data of a construction site. The map data stored in the map data storage unit 33 may be a part of the map data stored in the map database 76 stored in the server 7 described later.

The touch panel display 40 has a function as a display unit configured by a liquid crystal panel or the like and a function as an input unit that detects a touch input by a user's finger or the like.
The camera 41 is a device for imaging a shooting point.
The sensor unit 42 includes various sensors such as a geomagnetic sensor 42a (azimuth detecting means) and an angle sensor 42b (tilt detecting means).
The Bluetooth antenna 48 can perform short-range wireless communication with the beacon terminal 5 based on the Bluetooth standard. The Bluetooth antenna 48 receives a beacon radio wave and sends data to the radio wave processing unit 14 and the radio wave position acquisition unit 26.
The communication interface unit 49 is an interface unit for performing communication with the server 7 via the base station Bs and the communication network N.

<Beacon terminal 5>
The beacon terminal 5 is a device that transmits radio waves. As shown in FIG. 1, the beacon terminal 5 is installed in the vicinity of the shooting point during imaging.
As shown in FIG. 3A, the beacon terminal 5 includes a control unit 50, a storage unit 55, and a radio wave transmission unit 57.
The control unit 50 is a CPU that controls the entire beacon terminal 5. The control unit 50 executes various functions in cooperation with the hardware described above by appropriately reading and executing the OS and application programs stored in the storage unit 55.
The storage unit 55 is a storage area such as a semiconductor memory element for storing programs, data, and the like necessary for the control unit 50 to execute various processes.
The storage unit 55 stores an ID for specifying the beacon terminal 5.

  The radio wave transmission unit 57 transmits a radio wave including an ID under the control of the control unit 50. The radio wave transmitted by the radio wave transmission unit 57 may correspond to, for example, Bluetooth Class 2. This can be received by the portable information terminal 1 if, for example, the portable information terminal 1 exists within a radius of 10 m with the beacon terminal 5 as the center. The beacon radio wave includes radio wave intensity data (radio wave intensity) that changes according to the reception position. The radio wave intensity data is a negative value indicated by dBm, and the closer to “0”, the closer the distance to the beacon terminal 5 is.

<Server 7>
The server 7 stores map data and various cluster data. Further, the server 7 stores the position of the installed beacon terminal 5.
As illustrated in FIG. 3B, the server 7 includes a control unit 70, a storage unit 75, and a communication interface unit 79.
The control unit 70 is a CPU that controls the entire server 7. The control unit 70 executes various functions in cooperation with the hardware described above by appropriately reading and executing the OS and application programs stored in the storage unit 75.
The storage unit 75 is a storage area such as a hard disk or a semiconductor memory element for storing programs, data, and the like necessary for the control unit 70 to execute various processes.
The storage unit 75 stores a map database 76, a cluster correspondence table 77, and a beacon management table 78.

The map database 76 is a database that stores various map data. In the map database 76, for example, map data of a construction site used in the image management system 100 is stored. The map database 76 may store an outdoor map or an indoor map map data.
The cluster correspondence table 77 is a table in which various data values are associated with name data. As shown in FIG. 4A, the cluster correspondence table 77 includes a radio wave intensity correspondence table 77a, a geomagnetic sensor correspondence table 77b, and an angle sensor correspondence table 77c. The radio wave intensity correspondence table 77a is a table in which radio wave intensity data is associated with its name data. The geomagnetic sensor correspondence table 77b is a table in which the azimuth data, which is a value indicated by the geomagnetic sensor, is associated with the name data. The angle sensor correspondence table 77c is a table in which angle data, which is a value indicated by the angle sensor, is associated with its name data.

The beacon management table 78 is a table in which the ID of the beacon terminal 5 is associated with position data (position information) indicating the installation position of the beacon terminal 5 as shown in FIG. In the example of FIG. 4B, the position data is latitude / longitude data.
Returning to FIG. 3B, the communication interface unit 79 is an interface unit for performing communication with the portable information terminal 1 via the communication network N.

Returning to FIG. 1, the base station Bs performs relaying for communication between the portable information terminal 1 and the server 7. The base station Bs is, for example, a wireless LAN (Local Area Network) base station or a base station for a mobile terminal communication network of a communication carrier.
The communication network N is a network between the server 7 and the base station Bs, such as an Internet line or a mobile terminal communication network.

<Preliminary work>
Next, a description will be given of preliminary work for performing processing in the image management system 100.
(1) The user prepares the beacon terminals 5 by the number of shooting points. The plurality of beacon terminals 5 to be prepared differ only in ID, and the radio wave intensity transmitted from each beacon terminal 5 is of the same magnitude.
(2) Decide which beacon terminal 5 is installed at which shooting point, and register the association between the ID of the beacon terminal 5 and the shooting point (position) in the server 7. For registration to the server 7, a dedicated device may be used, or the user may register the server 7 by manual input. The server 7 stores the ID of the beacon terminal 5 and the position data in the beacon management table 78 in association with each other.
(3) The beacon terminal 5 is installed at a predetermined shooting point, and the beacon radio wave is transmitted.

<Processing of Image Management System 100>
Next, processing by the image management system 100 will be described.
FIG. 5 is a flowchart showing main processing in the portable information terminal 1 according to the present embodiment.
FIG. 6 is a diagram showing a display example on the portable information terminal 1 according to the present embodiment.

In step S (hereinafter simply referred to as “S”) 10 in FIG. 5, the control unit 10 of the portable information terminal 1 causes the main menu screen 60 to be displayed on the touch panel display 40 when the user performs an activation operation of the recording browsing program 31a. Is displayed.
FIG. 6A shows an example of the main menu screen 60. The main menu screen 60 includes buttons 60a to 60c. On the main menu screen 60, as the main menu of the image management system 100, recording or browsing can be selected.
Returning to FIG. 5, in S <b> 11, the control unit 10 determines whether or not recording is selected. The case where recording is selected refers to a case where the “Record” button 60a is selected on the main menu screen 60 (FIG. 6A). If recording is selected (S11: YES), the control unit 10 moves the process to S12. On the other hand, when the recording is not selected (S11: NO), the control unit 10 moves the process to S13.
In S12, the control unit 10 (recording processing unit 11) performs a recording process. The recording process is a process for storing data related to beacon radio waves received together with image data in association with each other. Details of this recording process will be described later. Thereafter, the control unit 10 moves the process to S10.

On the other hand, in S13, the control unit 10 determines whether browsing has been selected. The case where browsing is selected refers to the case where the “view recording” button 60b is selected on the main menu screen 60 (FIG. 6A). When browsing is selected (S13: YES), control part 10 moves processing to S14. On the other hand, when browsing is not selected (S13: NO), the control part 10 moves a process to S15.
In S14, the control unit 10 (browsing processing unit 21) performs a browsing process. Browsing processing refers to displaying recorded image data. Details of this browsing process will be described later. Thereafter, the control unit 10 moves the process to S10.
In S15, the control unit 10 determines whether or not to end. The case of ending means the case where the “END” button 60c is selected on the main menu screen 60 (FIG. 6A). In the case of ending (S15: YES), the control unit 10 ends the execution of the recording / viewing program 31a and ends this process. On the other hand, when not ending (S15: NO), control part 10 moves processing to S11.

<Recording process>
Next, the recording process will be described.
FIG. 7 is a flowchart showing recording processing in the portable information terminal 1 according to the present embodiment.
FIG. 8 is a diagram illustrating an example of an image file generated by the recording process according to the present embodiment.
In S <b> 20 of FIG. 7, the control unit 10 activates the camera 41 and causes the touch panel display 40 to output a through image captured by the camera 41.
Thus, the user determines the position of the camera 41 by adjusting the position of the portable information terminal 1 so that image data in the vicinity of the beacon terminal 5 can be acquired while viewing the through image displayed on the touch panel display 40.
FIG. 6B shows a through screen 61 when the camera 41 is activated and the position of the camera 41 is determined. The through screen 61 includes a through image portion 61a, a shooting instruction button 61b, and a “return” button 61c. The through image portion 61a is an area for displaying a through image. The shooting instruction button 61b is a button for acquiring image data. The “return” button 61c is a button for returning to the main menu screen (FIG. 6A).

Returning to FIG. 7, in S21, the control unit 10 (shooting instruction receiving unit 12) determines whether or not a shooting instruction has been received. The control unit 10 determines that the shooting instruction has been received when the shooting instruction button 61b (FIG. 6B) is selected by the user. When the imaging instruction is accepted (S21: YES), the control unit 10 moves the process to S22. On the other hand, when the imaging instruction has not been received (S21: NO), the control unit 10 moves the process to S30.
In S <b> 22, the control unit 10 (image input unit 13) receives image data captured by the camera 41. Then, the control unit 10 causes the touch panel display 40 to output a storage result screen 62 including the received image data.
FIG. 6C shows a storage result screen 62. The storage result screen 62 includes an image part 62a and buttons 62b and 62c. The image part 62a is an area for displaying an image indicated by the image data received in S22. The button 62b is a button for the user to input supplementary data. The button 62c is a button for displaying the through screen 61 shown in FIG.

Returning to FIG. 7, in S <b> 23, the control unit 10 (the radio wave processing unit 14) acquires data related to the beacon radio wave received by the Bluetooth antenna 48. Specifically, the control unit 10 acquires an ID from a beacon radio wave. Further, the control unit 10 acquires radio wave intensity data of beacon radio waves.
In S24, the control unit 10 (sensor processing unit 15) acquires the value detected by the sensor unit 42. Specifically, the control unit 10 (azimuth acquisition unit 15a) acquires azimuth data that is a value detected by the geomagnetic sensor 42a. Moreover, the control part 10 (angle acquisition part 15b) acquires the angle data which is the value which the angle sensor 42b detected.

In S <b> 25, the control unit 10 (the radio wave processing unit 14 and the association unit 16) communicates with the server 7 and acquires external data (name information and position information).
For example, the control unit 10 receives the name data from the server 7 by transmitting the radio wave intensity data of the beacon radio wave acquired in S23 and the azimuth data and angle data acquired in S24 to the server 7.
In the server 7, the control unit 70 corresponds to the radio wave intensity data with reference to the radio wave intensity correspondence table 77a (FIG. 4A) in response to, for example, reception of the radio wave intensity data (for example, dBm). , “Near”, “Medium”, “Far”, etc. are acquired. Here, the radio wave intensity is a “closer” position as the strength is higher, and a “far” position as the strength is lower. When the control unit 70 receives the azimuth data, the control unit 70 refers to the geomagnetic sensor correspondence table 77b and corresponds to the azimuth data, “north”, “east”, “south”, “west”. Name data such as “” is acquired. Further, when the control unit 70 receives the angle data, the control unit 70 refers to the angle sensor correspondence table 77c, and names such as “upper”, “front”, “lower” and the like corresponding to the angle data. Get the data. Then, the control unit 70 of the server 7 transmits the acquired name data to the portable information terminal 1.

Moreover, the control part 10 receives map data from the server 7 by transmitting ID of the beacon terminal 5 acquired by S23 to the server 7, for example.
In the server 7, the control unit 70 refers to the beacon management table 78 (FIG. 4B), acquires position data corresponding to the ID, and acquires map data corresponding to the position data from the map database 76. And the control part 70 of the server 7 synthesize | combines a mark with the part of the positional data corresponding to ID with the acquired map data, and transmits the map data after a synthesis | combination to the portable information terminal 1. FIG.

  In S <b> 26, the control unit 10 (association unit 16, file name generation unit 18) associates the image data received in S <b> 22 with the name data acquired in S <b> 25 and stores them in the image data storage unit 32. At that time, the control unit 10 includes, for example, the file name of the image data including the name data acquired in S25. Further, the control unit 10 combines (associates) the map data acquired in S25 with the image data. Thus, the control unit 10 associates various data such as name data and map data with the image data. Further, the control unit 10 stores the name data acquired in S25 as metadata in the image data. Note that the metadata may be the data itself acquired in S23 and S24, not the name data acquired in S25.

  FIG. 8A shows the image data 80 associated by the association process. In this example, the image data 80 includes an image part 80a, a map part 80b, and a metadata part 80c. The image part 80a is an area for displaying the image data received by the control unit 10 in S22. The map part 80b is an area for displaying the map data acquired in S25. In the map data displayed on the map unit 80b, the position of the beacon terminal 5 is indicated as a mark 80m. The metadata unit 80c is an area for displaying metadata of image data. The image data 80 is associated with a file name 80d. The file name 80d is a name obtained by combining the name data acquired in S25. This is an image obtained by capturing the image data 80 “front” that is “close” to the beacon terminal 5 whose ID is “A16”, “east”, and the mobile information terminal 1 is not tilted. Represents something.

FIG. 8B shows image data 81 similarly generated by the association process. The image data 81 includes an image part 81a, a map part 81b, and a metadata part 81c. The image data 81 is an image captured with the ID “A16” of the beacon terminal 5 being “far”, facing “north”, and tilting the portable information terminal 1 in the “up” direction. Represent.
In FIG. 8B, the map data displayed on the map portion 81b is reduced and displayed as compared with FIG. 8A. This is because it is determined that the radio wave intensity data associated with the image data in FIG. 8B is “far”, which is easier to understand than “far”. Moreover, since the azimuth | direction at the time of imaging differs, the direction of map data respond | corresponds to a azimuth | direction.

  Returning to FIG. 7, in S27, the control unit 10 determines whether or not to input memo data. For example, in FIG. 6C, when the “Make a note” button 62b is selected, the control unit 10 can determine that the memo data is input. When the memo data is input (S27: YES), the control unit 10 moves the process to S28. When the memo data is not input (S27: NO), the control unit 10 moves the process to S21.

  In S28, the control unit 10 (supplementary processing unit 17) performs supplementary processing. Specifically, the control unit 10 outputs a supplemental data input screen 63 shown in FIG. Then, the control unit 10 receives supplementary data (memo data) via the supplementary data input screen 63. The supplemental data may be received by receiving character data by key input, or by acquiring voice from a microphone of the portable information terminal 1 (not shown) and receiving voice data. Then, the control unit 10 (association unit 16) further associates the received supplemental data with the image data. As an example of associating supplementary data with image data, the control unit 10 stores supplementary data in metadata of image data, for example. And the control part 10 outputs the process result screen 64 as shown, for example in FIG.6 (E). The processing result screen 64 includes information indicating that supplementary data has been received and a “next” button. When the “next” button is selected, the control unit 10 displays a through screen 61 shown in FIG. 6B on the touch panel display. Thereafter, the control unit 10 moves the process to S21.

On the other hand, in S30, the control unit 10 determines whether or not to end the process. The termination of the process means, for example, a case where the “return” button 61c is selected on the through screen 61 shown in FIG. When the process is terminated (S30: YES), the control unit 10 moves the process to S31. On the other hand, when the process is not terminated (S30: NO), the control unit 10 moves the process to S21.
In S31, the control unit 10 ends the activation of the camera 41, ends the process, and moves the process to FIG.

<Browsing process>
Next, the browsing process will be described.
FIG. 9 is a flowchart showing a browsing process in the portable information terminal 1 according to the present embodiment.
FIG. 10 is a diagram illustrating an example of map data after the mark placement process in the browsing process according to the present embodiment.
FIG. 11 is a flowchart showing the neighborhood data map display process in the portable information terminal 1 according to the present embodiment.
FIG. 12 is a diagram showing a display example on the portable information terminal 1 according to the present embodiment.

In S <b> 40 of FIG. 9, the control unit 10 (browsing processing unit 21) displays the browsing menu screen 65 on the touch panel display 40.
FIG. 6F shows a browsing menu screen 65. The browsing menu screen 65 includes buttons 65a to 65c. The “save data” button 65 a is used when displaying all image data stored in the storage unit 30 of the portable information terminal 1. Further, the “Nearby data” button 65b is used when displaying image data associated with a nearby position by a beacon radio wave received by the portable information terminal 1 during browsing.
Returning to FIG. 7, in S41, it is determined whether or not the stored data is accepted. The case where the stored data is accepted refers to a case where the “save data” button 65a in FIG. 6F is selected by the user. When the stored data is received (S41: YES), the control unit 10 moves the process to S42. On the other hand, when the storage data is not received (S41: NO), the control unit 10 moves the process to S48.

In S <b> 42, the control unit 10 (image extraction unit 22) extracts the image data stored in the image data storage unit 32.
In S43, the control unit 10 (map extraction unit 23) extracts map data associated with the extracted image data from the map data storage unit 33.
In S44, the control unit 10 (image arrangement unit 24) arranges marks corresponding to the number of image data at corresponding positions in the map data.

Here, the arrangement by the image arrangement unit 24 will be described in detail based on FIG.
FIG. 10A shows map data 90 in which marks of image data are arranged using radio wave intensity data, azimuth data, and angle data. In the map data 90, a mark 90a and a plurality of marks 91 (91a to 91g) are arranged. The mark 90a indicates the position of the beacon terminal 5 determined based on the ID of the beacon terminal 5. One mark 91 represents one image data. The size of the mark 91 corresponds to the value of the radio wave intensity data. The mark 91 having a large size is determined as “near” by the radio wave intensity data, and the mark 91 having a small size is determined as “far” by the radio wave intensity data. The direction of the mark 91 corresponds to the value of the azimuth data. Further, the color of the mark 91 corresponds to the value of the angle data.

The arrangement by the image arrangement unit 24 may be other.
For example, map data 92 as shown in 10 (B) may be used. In the map data 92, a mark 92a, concentric circles 92b to 92d, and a plurality of marks 93 are arranged. The mark 92 a indicates the position of the beacon terminal 5 determined based on the ID of the beacon terminal 5. The mark 93 is arranged according to the radio wave intensity data associated with the image data. Thus, even when only the radio wave intensity data associated with the image data is used, one mark 93 represents one image data, so that the image data can be identified.

  Further, map data 94 as shown in FIG. In the map data 94, a mark 94a and a plurality of marks 95 are arranged. The mark 94a indicates the position of the beacon terminal 5 determined based on the ID of the beacon terminal 5. The mark 95 is arranged by azimuth data associated with image data. In this way, since only one azimuth data associated with the image data represents one image data, the image data can be identified.

Returning to FIG. 7, in S45, the control unit 10 (map display unit 25) causes the touch panel display 40 to display the map data in which the mark corresponding to the image data is arranged in S44. Although not shown, when the user selects one mark representing the image data from the map data displayed on the touch panel display 40, the image data corresponding to the mark may be displayed. The image data to be displayed may be as shown in FIG. 8, for example. When the user selects one mark representing image data, the file name may be displayed in a pop-up.
In addition to the map data display area, a “return” button is displayed on the touch panel display 40 (not shown). When the “return” button is selected, the touch panel display 40 is shown in FIG. A browsing menu screen 65 is displayed.
Further, in the example shown in FIG. 10, the image data related to one ID is described, but the same applies to a plurality of IDs. Therefore, the map data to be displayed may include a mark indicating a position corresponding to a plurality of beacon terminals 5 and a mark indicating image data.

  In S46, the control unit 10 determines whether or not to end this process. For example, when the selection of the “return” button 65c shown in FIG. 6F is accepted, the control unit 10 determines to end this process. When this process is finished (S46: YES), the control unit 10 moves the process to FIG. On the other hand, when this process is not terminated (S46: NO), the control unit 10 moves the process to S40.

On the other hand, in S48, the control unit 10 determines whether or not neighborhood data has been received. The case of accepting near data refers to the case where the “neighbor data” button 65b in FIG. 6F is selected by the user. When the neighborhood data is received (S48: YES), the control unit 10 moves the process to S49. On the other hand, when the neighborhood data is not received (S48: NO), the control unit 10 moves the process to S46.
In S49, the control unit 10 performs a neighborhood data map display process.

Here, the neighborhood data map display process will be described with reference to FIG.
In S <b> 50 of FIG. 11, the control unit 10 (the radio wave position acquisition unit 26) determines whether a beacon radio wave has been received via the Bluetooth antenna 48. When the beacon radio wave is received (S50: YES), the control unit 10 moves the process to S51. On the other hand, when the beacon radio wave is not received (S50: NO), the control unit 10 moves the process to S58.
In S51, the control unit 10 (the radio wave position acquisition unit 26) acquires an ID from the received beacon radio wave.

In S <b> 52, the control unit 10 (image extraction unit 22) extracts the image data associated with the acquired ID from the image data storage unit 32.
In S53, the control unit 10 (supplementary display processing unit 27) acquires supplementary data associated with the extracted image data.
In S54, the control unit 10 (supplementary display processing unit 27) generates supplementary list data based on the acquired supplementary data.
The processing of S55 and S56 is the same as the processing of S43 and S44 of FIG.
In S57, the control unit 10 (map display unit 25, supplement display processing unit 27) causes the touch panel display 40 to display an image confirmation screen 96 including map data and supplement list data.

FIG. 12 shows an example of the image confirmation screen 96.
The image confirmation screen 96 includes a map data part 96a, a supplementary list part 96b, and a “return” button 96c. The map data portion 96a is an area for displaying map data. The supplement list 96b is an area for displaying a list of supplement data associated with the image data. In the map data displayed on the map data portion 96a, the position of the image data associated with the same ID as the ID of the beacon radio wave received by the portable information terminal 1 is displayed as a mark. If the supplementary data is audio data, the audio may be output from a speaker (not shown) by selecting a link indicating the audio data.
Returning to FIG. 11, after that, the control unit 10 moves the process to S46 of FIG.
On the other hand, in S58, the control unit 10 displays on the touch panel display 40 that there is no data to be displayed. Thereafter, the control unit 10 moves the process to S46 of FIG.

Thus, according to the image management system 100 of the present embodiment, the following effects are obtained.
(1) When the portable information terminal 1 captures an image with the camera 41 and acquires image data, the portable information terminal 1 receives the radio wave transmitted by the beacon terminal 5 to obtain the ID of the beacon terminal 5 and the radio wave intensity data as an image. Can be associated with data. Therefore, since both the ID and the radio wave intensity data are associated with the image data, the identification can be made based on the distance from the beacon terminal 5 by the radio wave intensity data even if the ID is the same.
(2) When acquiring the image data, the portable information terminal 1 can associate the azimuth data and the angle data with the image data based on the sensor value detected by the sensor unit 42 of the portable information terminal 1. Therefore, since various data at the time of image data acquisition are associated with the image data, it is possible to facilitate subsequent image management using various information at the time of image data acquisition.

(3) Since the portable information terminal 1 accepts the input of memo data and associates the supplementary data with the image data, when viewing the image data later, the supplementary data can be viewed. Can be shown. Therefore, convenience is improved by referring to supplementary data when classifying image data.
(4) The portable information terminal 1 can easily indicate the position where the image data is acquired by associating the map data with the image data.
(5) The portable information terminal 1 associates metadata of various data with image data, and can refer to the metadata to check the situation when the image data is acquired.

(6) By using various data for the file name of the image data, the portable information terminal 1 can know at what position the image data is captured without opening the image data. Therefore, it is possible to save the trouble of displaying the image data and to easily classify.
(7) The portable information terminal 1 acquires various data from the server 7. Therefore, it is not necessary for the portable information terminal 1 to have various data, and the used capacity of the storage unit 30 can be suppressed. In addition, for example, by using the beacon management table 78 in which the ID of the beacon terminal 5 is associated with the position data, the beacon management table 78 can be centrally managed by the server 7 and when the beacon management table 78 is maintained, etc. Can be easy to work and manage.

(8) Since the portable information terminal 1 displays the image data associated with various data on the map by changing the position, shape, size, color, etc. of the mark based on the contents of the various data. The image data can be shown in an easy-to-understand manner.
(9) When the mobile information terminal 1 receives a beacon radio wave, the mobile information terminal 1 displays only the mark related to the image data associated with the ID of the received beacon radio wave on the map, so only the necessary image data mark is displayed. Can be displayed.
(10) Since the portable information terminal 1 displays image data by selecting a mark on the map, the image data can be easily confirmed.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above. In addition, the effects described in the embodiments are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments. In addition, although embodiment mentioned above and the deformation | transformation form mentioned later can also be used in combination as appropriate, detailed description is abbreviate | omitted.

(Deformation)
(1) In the present embodiment, an example has been described in which a beacon terminal is installed, nearby image data is acquired, and stored in association with an ID included in the beacon radio wave. However, the present invention is not limited to this. Any radio wave transmitter that transmits data for specifying the position may be used. For example, a wireless LAN access point such as Wi-Fi may be used.
(2) In this embodiment, an example in which map data is combined with image data has been described, but the present invention is not limited to this. Map data may be incorporated in the image data. Further, although one map data is synthesized, a plurality of map data may be synthesized or incorporated, for example, in addition to indoor map data, such as synthesizing outdoor map data.
(3) In this embodiment, an example in which metadata is combined with image data has been described, but the present invention is not limited to this. The metadata may not be combined with the image data. Further, information described in the metadata may be incorporated into the image data as text data.
(4) In the present embodiment, the example in which the ID of the beacon terminal is associated with the image data has been described as an example, but the present invention is not limited to this. For example, an area name or the like may be associated with the ID, a beacon management table may be stored, and the area name or the like may be associated.

(5) In the present embodiment, the name correspondence data is acquired from the radio wave intensity data, the azimuth data, and the angle data using the cluster correspondence table, and the name data is associated with the image data. However, the present invention is not limited to this. . The values indicated by the radio wave intensity data, the azimuth data, and the angle data may be stored in association with the image data. In such a case, name data may be acquired using a cluster correspondence table at the time of browsing.
(6) Although the present embodiment has been described using the cluster correspondence table of the server, the present invention is not limited to this. The portable information terminal may have a cluster correspondence table. By doing so, since it is not necessary to communicate with the server, the name data can be acquired even in an environment where communication is not possible.
(7) In the present embodiment, the beacon management table included in the server has been described. However, the present invention is not limited to this. The portable information terminal may have a beacon management table. In that case, the beacon management table in the server may be downloaded, or the association between the ID and the position data may be registered in this portable information terminal. By doing so, it is not necessary to communicate with the server during imaging.

(8) Although the present embodiment has been described as acquiring image data in a state in which only one beacon terminal transmits radio waves, the present invention is not limited to this. For example, it may be a case where radio waves are transmitted from a plurality of beacon terminals. In such a case, the portable information terminal may identify the nearest beacon terminal based on the radio wave intensity data and the azimuth data, and associate the identified beacon terminal ID with the image data.
(9) In the present embodiment, the memo data is input after the image data is acquired. However, the present invention is not limited to this. For example, it may be performed before acquiring image data, or memo data may be input in order for a plurality of image data after acquiring a plurality of image data.
(10) Although the present embodiment has been described with reference to an example of browsing and displaying image data stored in the storage unit of the portable information terminal, the present invention is not limited to this. For example, image data stored in a server may be used.

(11) Although the present embodiment has been described as displaying a mark corresponding to a beacon terminal and a mark corresponding to image data at the time of browsing display, the present invention is not limited to this. The mark corresponding to the beacon terminal may not be displayed. Further, the mark corresponding to the image data described in the embodiment is an example, and may be a thumbnail or the like, for example.
(12) Although the present embodiment has been described with reference to an example of browsing and displaying image data captured by a portable information terminal, the present invention is not limited to this. Other image data may be used as long as various types of data are associated with the image data.

(13) In the present embodiment, the browsing menu screen is displayed uniformly, and for example, when the user has selected to display nearby data, for example, it is determined whether or not a beacon radio wave can be received. It is not limited to this. Before displaying the browsing menu screen, it is determined whether or not a beacon radio wave can be received, and a selection button for displaying nearby data may be displayed or hidden depending on whether or not a beacon radio wave can be received.
(14) In the present embodiment, as the browsing of the vicinity data, the description has been made of browsing and displaying the image data associated with the ID of the received beacon radio wave, but the present invention is not limited to this. For example, image data to be browsed and displayed may be further narrowed down, and only image data with the same radio wave intensity data or image data with the same azimuth data may be browsed and displayed. By doing so, when viewing the image later, it is narrowed down to the image data that has the same condition, so it is possible to easily compare the past image data with the present.

(15) In the present embodiment, an example using a portable information terminal has been described, but the present invention is not limited to this. For example, a camera provided with a display means or a radio wave receiving means may be used.
(16) In the present embodiment, the position is specified by the ID included in the radio wave transmitted by the beacon terminal. However, the present invention is not limited to this. Even if the beacon terminal transmits coordinate data, latitude / longitude data, area name data, and the like, and the portable information terminal receives a radio wave including these data, the same operation can be performed.
(17) In the present embodiment, description has been given of acquiring image data, but the image data may be still image data or moving image data. For example, in the case of moving image data, a beacon radio wave received at the start or end of imaging may be associated.

DESCRIPTION OF SYMBOLS 1 Portable information terminal 5 Beacon terminal 7 Server 10, 50, 70 Control part 11 Recording process part 14 Radio wave process part 15a Direction acquisition part 15b Angle acquisition part 16 Association part 17 Supplementary process part 18 File name production | generation part 21 Browsing process part 22 Image Extraction unit 23 Map extraction unit 24 Image arrangement unit 25 Map display unit 26 Radio wave position acquisition unit 27 Supplemental display processing unit 30, 55, 75 Storage unit 31a Record browsing program 32 Image data storage unit 33 Map data storage unit 40 Touch panel display 41 Camera 42a Geomagnetic sensor 42b Angle sensor 48 Bluetooth antenna 76 Map database 77 Cluster correspondence table 78 Beacon management table 100 Image management system Bs Base station N Communication network

Claims (9)

Map information storage means for storing map information;
Image storage means for storing the image data in which information capable of specifying an acquisition position of image data and additional information at the time of acquisition of the image data are associated;
Image extraction means for extracting one or more of the image data from the image storage means;
Map extraction means for extracting map information based on the information associated with the image data extracted by the image extraction means from the map information storage means;
Image placement means for placing the symbol of the number of image data extracted by the image extraction means at a corresponding position in the map information extracted by the map extraction means;
Map display means for outputting map information on which symbols are arranged by the image arrangement means to display means;
With
The image placement means changes the placement position of each symbol according to the additional information so that the symbols do not overlap;
A display device. The display device according to claim 1,
The additional information includes the radio wave intensity of the radio wave transmitter received when acquiring the image data,
The image arrangement means arranges the symbol at a position corresponding to the distance specified by the radio field intensity;
A display device. The display device according to claim 2,
The image arrangement means enlarges or reduces the map information corresponding to the distance, and arranges the symbol at a corresponding position in the map information;
A display device. The display device according to any one of claims 1 to 3,
The additional information includes orientation information related to the orientation at the time of image data acquisition,
The image arranging means arranges the symbol at a position based on the orientation information;
A display device. The display device according to claim 4,
The map display means outputs the map information rotated by the orientation information to the display means;
A display device. The display device according to any one of claims 1 to 5,
The additional information includes angle information related to the angle at the time of image data acquisition,
The image arrangement means arranges the symbols in a form in which at least one of a shape and a color differs according to the angle information;
A display device. The display device according to any one of claims 1 to 6,
Radio wave receiving means for receiving the information and radio wave intensity transmitted from the radio wave transmitter;
Storage means for associating and storing the transmitted information and position information;
Radio wave position acquisition means for acquiring position information of the radio wave transmitter with reference to the storage means from information received by the radio wave reception means;
With
The image extraction means extracts the image data associated with the information acquired by the radio wave position acquisition means from the image storage means;
A display device. The display device according to any one of claims 1 to 7,
The image storage means further stores the image data associated with supplementary information input at the time of acquisition of the image data,
Supplementary extraction means for extracting the supplementary information associated with the image data extracted by the image extraction means;
Supplementary display means for displaying a supplementary information list in which the supplementary information extracted by the supplementary extraction means is listed on the display means;
Providing
A display device. A display device according to any one of claims 1 to 8,
A data storage device communicably connected to the display device;
In a display system comprising:
The data storage device comprises at least one of the map information storage means and the image storage means;
A display system characterized by

Images