WO2024189717A1 - Data shaping apparatus, data shaping system, user terminal apparatus, data shaping method, and data shaping program - Google Patents

Abstract

A data shaping apparatus (100) shapes table data (51). A storage unit (170) stores semantic information (52) in which child data and parent data representing the meaning of the child data are registered in association with each other. An analysis unit (120) determines whether or not field data to which a column name is not assigned is registered in the semantic information (52) as child data. If the field data to which the column name is not assigned is not registered in the semantic information (52) as child data, a detection unit (140) detects the field data to which the column name is not assigned as unshaped data. A registration unit (160) receives an input of parent data when the unshaped data is defined as child data, and registers the received parent data as parent data of the unshaped data in the semantic information (52).

Description

DATA FORMING DEVICE, DATA FORMING SYSTEM, USER TERMINAL DEVICE, DATA FORMING METHOD, AND DATA FORMING PROGRAM

The present disclosure relates to a data shaping device, a data shaping system, a user terminal device, a data shaping method, and a data shaping program.

There are cases where the field values of columns in table data are arbitrary text, category names, or label names, or the meaning of the table data has changed during operation. In such cases, applications or systems that refer to the table data in the database may refer to unexpected data and cause errors.
To avoid such errors, data formatting is required to organize the column names of the table data and assign the data to the appropriate columns.

Patent Document 1 discloses a semantic inference system that infers the meaning of a column included in a table using a concept that represents the meaning of information. The semantic inference system of Patent Document 1 selects candidate meanings for the column, and calculates a score indicating the similarity between the selected candidate meaning and the meaning of each column included in the table other than the column to be inferred. The semantic inference system of Patent Document 1 then uses the calculated score to identify the meaning of the column to be inferred from among the candidate meanings of the column.

Patent No. 6988991

In the technology of Patent Document 1, if there is no information matching the contents of a column in a concept, a column name with low similarity to the contents of the column may be assigned, which poses the problem of not being able to correctly infer the meaning.

The purpose of this disclosure is to achieve accurate data formatting by providing a mechanism for registering parent data, which is a concept that expresses the meaning of information, for information that does not have a column name assigned to it.

The data shaping device according to the present disclosure is a data shaping device that shapes table data,
a storage unit that stores semantic information used for shaping the table data, in which child data and parent data representing the meaning of the child data are associated with each other and registered;
an analysis unit that uses the semantic information to determine whether or not field data to which a column name is not assigned among field data included in the setting data set in the table data is registered as child data in the semantic information;
a detection unit that detects the field data to which a column name is not assigned as unformatted data if the field data to which a column name is not assigned is not registered in the semantic information as child data;
The data processing device further includes a registration unit that receives input of parent data when the unformatted data is treated as child data, and registers the received parent data in the semantic information as parent data of the unformatted data.

In the data shaping device according to the present disclosure, parent data, which is a concept expressing meaning, can be registered for child data, which is field data to which no column name is assigned, in the semantic information used to shape table data. Therefore, the data shaping device according to the present disclosure has the effect of being able to appropriately enrich the semantic information and realize accurate data shaping.

FIG. 1 is a diagram showing an example of the overall configuration of a data shaping system according to a first embodiment. 1 is a diagram showing an example of the configuration of a data shaping device according to a first embodiment; FIG. 2 is a diagram showing a configuration example of a user terminal device according to the first embodiment; 4 is a flow diagram showing the operation of the data shaping system according to the first embodiment. 5A to 5C are schematic diagrams showing an example of data shaping processing according to the first embodiment; 7 is a schematic diagram showing another example of the data shaping process according to the first embodiment; FIG. 4 is a diagram showing an example of a presentation screen according to the first embodiment. FIG. 13 is a diagram showing an example of the configuration of a data shaping device according to a modified example of the first embodiment. FIG. 11 is a flow diagram showing the operation of the data shaping system according to the second embodiment. FIG. 11 is a schematic diagram showing a data shaping process according to the second embodiment. FIG. 13 is a diagram showing an example of a correction screen according to the second embodiment.

The present embodiment will be described below with reference to the drawings. In each drawing, the same or corresponding parts are given the same reference numerals. In the description of the embodiment, the description of the same or corresponding parts will be omitted or simplified as appropriate. The arrows in the drawings mainly indicate the flow of data or the flow of processing.

Embodiment 1.
***Configuration Description***
FIG. 1 is a diagram showing an example of the overall configuration of a data shaping system 500 according to the present embodiment.
FIG. 2 is a diagram showing an example of the configuration of the data shaping device 100 according to the present embodiment.
FIG. 3 is a diagram showing an example of a configuration of the user terminal device 200 according to the present embodiment.

The data shaping system 500 according to this embodiment includes a data shaping device 100 and a user terminal device 200 .
The data shaping device 100 is a device that shapes the table data 51 .
The user terminal device 200 is a device used by a user.
The data formatting device 100 and the user terminal device 200 communicate with each other via a network.

The data shaping device 100 is a computer. The data shaping device 100 includes a processor 910, as well as other hardware such as a memory 921, an auxiliary storage device 922, an input interface 930, an output interface 940, and a communication device 950. The processor 910 is connected to the other hardware via signal lines and controls the other hardware.

The data shaping device 100 includes, as functional elements, an acquisition unit 110, an analysis unit 120, a shaping unit 130, a detection unit 140, a presentation unit 150, a registration unit 160, and a storage unit 170. The storage unit 170 stores table data 51 and semantic information 52.

The user terminal device 200 is a computer. The user terminal device 200 includes a processor 910, as well as other hardware such as a memory 921, an auxiliary storage device 922, an input interface 930, an output interface 940, and a communication device 950. The processor 910 is connected to the other hardware via signal lines and controls the other hardware.

The user terminal device 200 has a screen display unit 210 and a memory unit 220 as functional elements.

Hereinafter, the data shaping device 100 and the user terminal device 200 may be referred to as each device of the data shaping system 500 .
For ease of explanation, the same reference numerals are used for the hardware of each device in the data shaping system 500. However, it is self-evident that each device in the data shaping system 500 has its own hardware.
In the following, the hardware will be described using the data shaping device 100 as an example. The same description as for the data shaping device 100 can also be applied to the hardware of the user terminal device 200.

The functions of the acquisition unit 110, analysis unit 120, shaping unit 130, detection unit 140, presentation unit 150, and registration unit 160 are realized by software. The storage unit 170 is provided in the memory 921. Note that the storage unit 170 may be provided in the auxiliary storage device 922, or may be provided separately in the memory 921 and the auxiliary storage device 922.

The processor 910 is a device that executes a data shaping program. The data shaping program is a program that realizes the functions of the acquisition unit 110, the analysis unit 120, the shaping unit 130, the detection unit 140, the presentation unit 150, and the registration unit 160.
The processor 910 is an IC that performs arithmetic processing. Specific examples of the processor 910 are a CPU, a DSP, and a GPU. IC is an abbreviation for Integrated Circuit. CPU is an abbreviation for Central Processing Unit. DSP is an abbreviation for Digital Signal Processor. GPU is an abbreviation for Graphics Processing Unit.

The memory 921 is a storage device that temporarily stores data. Specific examples of the memory 921 are SRAM and DRAM. SRAM is an abbreviation for Static Random Access Memory. DRAM is an abbreviation for Dynamic Random Access Memory.
The auxiliary storage device 922 is a storage device that stores data. A specific example of the auxiliary storage device 922 is a HDD. The auxiliary storage device 922 may also be a portable storage medium such as an SD (registered trademark) memory card, a CF, a NAND flash, a flexible disk, an optical disk, a compact disk, a Blu-ray (registered trademark) disk, or a DVD. Note that HDD is an abbreviation for Hard Disk Drive. SD (registered trademark) is an abbreviation for Secure Digital. CF is an abbreviation for CompactFlash (registered trademark). DVD is an abbreviation for Digital Versatile Disk.

The input interface 930 is a port that is connected to an input device such as a mouse, keyboard, or touch panel. Specifically, the input interface 930 is a USB terminal. The input interface 930 may also be a port that is connected to a LAN. USB is an abbreviation for Universal Serial Bus. LAN is an abbreviation for Local Area Network.

The output interface 940 is a port to which a cable of a display device 941 such as a display is connected. Specifically, the output interface 940 is a USB terminal or an HDMI (registered trademark) terminal. Specifically, the display is an LCD. The output interface 940 is also called a display interface. HDMI (registered trademark) is an abbreviation for High Definition Multimedia Interface. LCD is an abbreviation for Liquid Crystal Display.

The communication device 950 has a receiver and a transmitter. The communication device 950 is connected to a communication network such as a LAN, the Internet, a telephone line, or Wi-Fi (registered trademark). Specifically, the communication device 950 is a communication chip or NIC. NIC is an abbreviation for Network Interface Card.

The data shaping program is executed in the data shaping device 100. The data shaping program is loaded into the processor 910 and executed by the processor 910. Memory 921 stores not only the data shaping program but also the OS. OS is an abbreviation for Operating System. Processor 910 executes the data shaping program while executing the OS. The data shaping program and the OS may be stored in the auxiliary storage device 922. The data shaping program and the OS stored in the auxiliary storage device 922 are loaded into the memory 921 and executed by the processor 910. Note that part or all of the data shaping program may be incorporated into the OS.

The data shaping device 100 may include multiple processors that replace the processor 910. These multiple processors share the task of executing the data shaping program. Each processor is a device that executes the data shaping program in the same way as the processor 910.

The data, information, signal values and variable values used, processed or output by the data shaping program are stored in memory 921, auxiliary storage device 922, or in a register or cache memory within processor 910.

The "parts" of the acquisition unit 110, analysis unit 120, shaping unit 130, detection unit 140, presentation unit 150, and registration unit 160 may be read as "circuits,""steps,""procedures,""processes," or "circuitry." The data shaping program causes a computer to execute acquisition processing, analysis processing, shaping processing, detection processing, presentation processing, and registration processing. The "processes" of the acquisition processing, analysis processing, shaping processing, detection processing, presentation processing, and registration processing may be read as "programs,""programproducts,""computer-readable storage media storing programs," or "computer-readable recording media recording programs." The data shaping method is a method performed by the data shaping device 100 executing the data shaping program.
The data shaping program may be provided by being stored in a computer-readable recording medium. Also, the data shaping program may be provided as a program product.

*** Operation Description ***
Next, the operation of each device of the data shaping system 500 according to the present embodiment will be described. The operation procedure of each device of the data shaping system 500 corresponds to a data shaping method. Also, the program that realizes the operation of each device of the data shaping system 500 corresponds to a data shaping program.

FIG. 4 is a flow diagram showing the operation of the data shaping system 500 according to this embodiment.

<Acquisition process>
In step S101, the acquisition unit 110 of the data shaping device 100 acquires table data 51 to be subjected to the data shaping process.
For example, the acquiring unit 110 acquires table data 51 input by a user. The user inputs the table data to the data shaping device 100 by placing the table data in a network storage. Alternatively, the user may cause the data shaping device 100 to refer to the table data by operating a web application.
The table data 51 may be data in a relational database format, or may be text data in a CSV format defined by the user (CSV is an abbreviation for comma-separated values).

The acquisition unit 110 acquires the table data 51 and stores it in the storage unit 170. Note that the acquisition unit 110 may acquire the table data 51 in any manner as long as it can acquire the table data 51 that is the target of the data shaping process.

The acquisition unit 110 also determines which columns in the table data 51 are to be processed for data reformatting. For example, the columns to be processed for data reformatting are specified by the user.

FIG. 5 is a schematic diagram showing an example of the data shaping process according to the present embodiment.
An example of table data 51 according to the present embodiment will be described with reference to FIG.
The table data 51 is data in a table format as shown in FIG.
In the table data 51 in FIG. 5, the column names are set as date and time, X[G], Y[G], and Z[G] indicating acceleration, and remarks.

The data set in each row of each column is called setting data.
Moreover, the data included in the setting data set in each row of each column is called field data.
For example, the setting data for "column name: X[G]" at "date and time: 7/1" is "0.1." The setting data for "column name: remarks" at "date and time: 7/1" is "No abnormalities." The setting data for "column name: remarks" at "date and time: 7/2" is "Board failure due to power outage."
The field data included in the setting data "Board failure due to power outage" is, for example, "power outage" and "board." The field data included in the setting data "no abnormality" is, for example, "no abnormality" itself.
The method for determining the field data will be described later.

In the example in Figure 5, the column named "Notes" is specified by the user as the column to be processed for data formatting.

Next, an example of the semantic information 52 according to the present embodiment will be described with reference to FIG.
The semantic information 52 is used to format the table data 51 .
As shown in FIG. 5, child data and parent data representing the meaning of the child data are registered in association with each other.

Semantic information 52 is expressed in a tabular format, with field data, which is the words written in the fields of the table data, as child data, and the concept that expresses the meaning of the field data as parent data. Semantic information 52 may also be data in which parent data and child data are organized in a graph structure or other format.

<Analysis Process: Steps S102 and S103>
In step S102, the analysis unit 120 determines whether or not there is field data to which a column name is not assigned in each row of the column to be shaped in the table data 51.
When performing data shaping processing on table data 51 for the first time, analysis unit 120 extracts words from the setting data of each row of the column to be shaped in table data 51. Then, analysis unit 120 determines each of the extracted words as field data to which a column name is not assigned.

In step S103, the analysis unit 120 uses the semantic information 52 to determine whether or not field data contained in the setting data set in the table data 51 that does not have a column name assigned thereto is registered in the semantic information 52 as child data.
Specifically, the following applies:

When performing data shaping processing on table data 51 for the first time, analysis unit 120 extracts words from the setting data of each row of the column to be shaped in table data 51. Analysis unit 120 extracts words using a method such as morphological analysis, for example. Other methods may be used as long as they can extract words from the setting data of each row of the column to be shaped in table data 51.

In the example in Figure 5, "No abnormalities" and "Board failure due to power outage" in "Column name: Notes" are the setting data for each row of the column that is the target of data formatting. Then, as shown in Figure 5, "No abnormalities" is extracted from the setting data "No abnormalities" as "field data with no column name assigned." In addition, "Power outage" and "Board" are extracted from the setting data "Board failure due to power outage" as "field data with no column name assigned."

The words extracted from the setting data vary depending on the method used for extraction, and any words may be extracted. In this embodiment, "power outage" and "board" are extracted as "field data with no column name assigned" from the setting data "board failure due to power outage". However, "power outage", "board", and "failure" may be extracted from the setting data "board failure due to power outage".
In the example of FIG. 5, "No abnormality", "Power outage", and "Board" are field data to which no column name is assigned.

If there is field data to which a column name has not been assigned, the process proceeds to step S103.
If there is no field data to which a column name has not been assigned, the process ends.

Next, the analysis unit 120 uses the semantic information 52 to determine whether or not field data to which a column name is not assigned is registered in the semantic information 52 as child data.
In the example of FIG. 5, the analysis unit 120 determines whether or not each of the field data items "no abnormality", "power outage", and "circuit board" is registered in the semantic information 52 as child data.
In FIG. 5, "power outage" and "circuit board" are registered in the semantic information 52, but "no abnormality" is not registered.

For "field data to which no column name is assigned" registered in the semantic information 52, the process proceeds to step S104, where data shaping processing is performed.
On the other hand, for "field data to which no column name is assigned" that is not registered in the semantic information 52, the process proceeds to step S105, where the data is processed as unformatted data.

<Shaping process: step S104>
The formatting process is a process performed when field data to which no column name is assigned is registered in the semantic information 52 .
In step S104, the shaping unit 130 treats the field data to which a column name is not assigned as child data. The shaping unit 130 selects parent data corresponding to the child data registered in the semantic information 52 as the column name of the field data to which a column name is not assigned. The shaping unit 130 then shapes the table data 51 by allocating the field data to which a column name is not assigned to the selected column name.

The example in FIG. 5 shows the first data shaping process.
In the example of FIG. 5, the field data “power outage” and “circuit board” that are not assigned a column name are registered in the semantic information 52 .
The shaping unit 130 selects the parent data "Cause" corresponding to the child data "Power Outage" registered in the semantic information 52 as the column name of "Power Outage". The shaping unit 130 also selects the parent data "Faulty Part" corresponding to the child data "Circuit Board" registered in the semantic information 52 as the column name of "Circuit Board".
Then, the shaping unit 130 assigns "power outage" to the selected column name "cause". The shaping unit 130 also assigns "circuit board" to the selected column name "fault location". Specifically, the shaping unit 130 creates a new column in the table data 51, and shapes the table data 51 by assigning "power outage" to the column name "cause" and "circuit board" to the column name "fault location".

When step S104 is completed, the process returns to step S102 and repeats the process until there is no field data to which a column name has not been assigned in the column being processed.

<Detection process: step S105>
The detection process is a process performed when field data to which a column name is not assigned is not registered in the semantic information 52 .
The detection unit 140 detects, as the unformatted data 31, “field data to which no column name is assigned” that is not registered in the semantic information 52, that is, that is not registered in the semantic information 52.

FIG. 6 is a schematic diagram showing another example of the data shaping process according to the present embodiment.
In the example of FIG. 6, the process is shown for a case where “normal” which is “field data to which no column name is assigned” is not registered in the semantic information 52 .
In the example of FIG. 6, the detection unit 140 detects “no abnormality” as the unformatted data 31, which is “field data to which no column name is assigned” that is not registered in the semantic information 52.

<Presentation process: step S106>
In step S<b>106 , the presentation unit 150 transmits a presentation screen 211 presenting the unformatted data 31 to the user terminal device 200 .

FIG. 7 is a diagram showing an example of a presentation screen 211 according to the present embodiment.
As shown in FIG. 7, the presentation screen 211 displays the current table data 51 in which “No abnormalities” is highlighted as unformatted data, and the current semantic information 52 .
Then, the presentation screen 211 displays a message such as, "Please add parent data that expresses the meaning of child data 1: No abnormalities to the semantic information. Also, if there is child data that corresponds to the added parent data, please add it to child data 2 and onwards. Press the edit button to add it."

In this way, presentation screen 211 is a screen that prompts the user to input parent data that represents the concept or meaning of child data for which parent data is not registered, and child data related to the parent data.
In the example of Figure 7, the presentation screen 211 prompts the user to input parent data that represents the concept or meaning of the child data ``No abnormalities'' for which no parent data is registered, and child data related to the parent data.

<Input Reception Processing: Step S107>
In step S107, the screen display unit 210 of the user terminal device 200 displays the presentation screen 211 on the display device 941. The screen display unit 210 then accepts input of parent data when the unformatted data 31 is child data via the presentation screen 211. The screen display unit 210 may also accept input of child data related to the unformatted data 31 and corresponding to the parent data, together with the parent data when the unformatted data 31 is child data, via the presentation screen 211.

The presentation screen 211 accepts user operations. The user registers parent data and additional child data in the row of child data 1 "No abnormality" presented in the current semantic information 52. Here, the semantic information 52 is in a table format, but the user would similarly register parent data and additional child data even if the semantic information 52 were in a graph format. The registration method may be keyboard input of words, drag-and-drop of words, or voice operation.
7, "Analysis result" is input as parent data of child data 1 "No abnormality". In addition, child data 2 "No problem" and child data 3 "Normal" are input as child data related to child data 1 "No abnormality".

Then, the screen display unit 210 of the user terminal device 200 transmits the parent data, which is the child data of the unformatted data 31 and which has been accepted via the presentation screen 211, to the data shaping device 100 via the communication device 950. If input of child data related to the unformatted data 31 is also accepted together with the parent data, the screen display unit 210 transmits the child data related to the unformatted data 31 together with the parent data to the data shaping device 100 via the communication device 950.

In the example of FIG. 7, "Analysis results" is sent to the data shaping device 100 as parent data that represents the meaning of the unformatted data 31 "No abnormalities" as child data. In addition, "No problems" and "Normal" are sent to the data shaping device 100 as child data related to the unformatted data 31 "No abnormalities."

<Registration process: step S108>
The registration unit 160 receives input of parent data when the unformatted data 31 is treated as child data, and registers the received parent data in the semantic information 52 as parent data of the unformatted data 31 .
Specifically, parent data when unformatted data 31 is child data is input by the user from presentation screen 211 and transmitted to data shaping device 100. Then, registration unit 160 registers the parent data when unformatted data 31 is child data input by the user in semantic information 52. When receiving input of child data related to unformatted data 31 together with parent data, registration unit 160 registers the child data related to unformatted data 31 together with parent data in semantic information 52.
6, "analysis result" is registered as parent data expressing the meaning when "no abnormality" which is the unformatted data 31 is treated as child data. In addition, "no problem" and "normal" are registered as child data related to "no abnormality" which is the unformatted data 31.

When step S108 is completed, the process returns to step S102 and repeats the process until there is no field data in the column being processed that does not have a column name assigned to it.

The data shaping process will be further described using the example of FIG.
The example of FIG. 6 shows an example of the data shaping process from the second time onwards.
In the example of FIG. 6, the detection unit 140 detects that the unformatted data is "normal" (step S105).
The presentation unit 150 transmits a presentation screen 211 to the user terminal device 200 to prompt the user to input parent data corresponding to the unformatted data "normal" and child data other than "normal" corresponding to the parent data (step S106).
The parent data "Analysis result" received via the presentation screen 211 and the child data "No problem" and "Normal" related to the unformatted data "No abnormality" are transmitted to the data shaping device 100 (step S107).
Then, the registration unit 160 receives the parent data "Analysis result" accepted via the presentation screen 211 and the child data "No problem" and "Normal" related to the unformatted data "No abnormalities", and registers them in the semantic information 52 (step S108).

Thereafter, the process is repeated from step S102.
The analysis unit 120 determines that there is "No abnormality" as field data to which a column name is not assigned (step S102). In the table data 51 after the first data shaping process is completed, a column name is not assigned to the field data "No abnormality". For example, if "No abnormality" is not assigned to any of the columns added in the previous data shaping process, the analysis unit 120 determines that "No abnormality" is field data to which a column name is not assigned.

The analysis unit 120 determines that the field data "No abnormality" to which no column name is assigned is registered as child data in the semantic information 52 (step S103).
Then, the shaping unit 130 uses the semantic information 52 to select the parent data "Analysis Results" as the column name of the field data "No Abnormality" to which no column name is assigned. As a result of the first data shaping process, the parent data "Analysis Results" and the child data "No Problem" and "Normal" related to "No Abnormality" are registered in the semantic information 52 for the child data "No Abnormality". The shaping unit 130 then creates a new column in the table data 51 and shapes the table data 51 by assigning "No Abnormality" to the column name "Analysis Results" (step S104).

***Other configurations***
<Modification 1>
In the present embodiment, the data shaping device 100 has been described as displaying the presentation screen 211 on the user terminal device 200. Thus, input from the user, such as parent data of the unshaped data and child data related to the unshaped data, is transmitted from the user terminal device 200 via a network. However, the data shaping device 100 may be configured to display the presentation screen 211 on a display device. In this case, the registration unit 160 of the data shaping device 100 accepts input from the user via the presentation screen 211 displayed on the display device of the data shaping device 100.

<Modification 2>
In this embodiment, the functions of each device in data shaping system 500 are realized by software. As a modification, the functions of each device in data shaping system 500 may be realized by hardware.
Specifically, each device in data shaping system 500 includes electronic circuitry 909 in place of processor 910 .
In the following, the data shaping device 100 will be described as an example, but the same description can also be applied to the user terminal device 200.

FIG. 8 is a diagram showing an example of the configuration of a data shaping device 100 according to a modified example of this embodiment.
The electronic circuit 909 is a dedicated electronic circuit for realizing the functions of the acquisition unit 110, the analysis unit 120, the shaping unit 130, the detection unit 140, the presentation unit 150, and the registration unit 160. Specifically, the electronic circuit 909 is a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, a logic IC, a GA, an ASIC, or an FPGA. GA is an abbreviation for Gate Array. ASIC is an abbreviation for Application Specific Integrated Circuit. FPGA is an abbreviation for Field-Programmable Gate Array.

The functions of the acquisition unit 110, analysis unit 120, shaping unit 130, detection unit 140, presentation unit 150, and registration unit 160 may be realized by a single electronic circuit, or may be distributed across multiple electronic circuits.

As another variation, some of the functions of the acquisition unit 110, analysis unit 120, shaping unit 130, detection unit 140, presentation unit 150, and registration unit 160 may be realized by electronic circuits, and the remaining functions may be realized by software. Also, some or all of the functions of the acquisition unit 110, analysis unit 120, shaping unit 130, detection unit 140, presentation unit 150, and registration unit 160 may be realized by firmware.

Each of the processor and electronic circuit is also called processing circuitry. In other words, the functions of the acquisition unit 110, analysis unit 120, formatting unit 130, detection unit 140, presentation unit 150, and registration unit 160 are realized by the processing circuitry.

***Description of Effects of This Embodiment***
As described above, the data shaping system according to the present embodiment provides a mechanism for allowing the user to add meaning or concept to field values or words to which no column name has been assigned. This allows the data shaping device 100 according to the present embodiment to perform data shaping using appropriate semantic information, thereby realizing accurate data shaping.

In the data reformatting system according to this embodiment, when there is information in the field value that is not linked to the defined meaning or concept, the user is prompted to add semantic information, allowing for accurate column naming and making data reformatting more efficient.

In the data shaping system according to this embodiment, after the first data shaping, the field data of a record in which field data has not been assigned to any of the added columns is detected as unshaped data. Then, in the data shaping system according to this embodiment, the unshaped data is presented to the user, and the user is prompted to add parent data that represents a meaning or concept. Then, once the parent data entered by the user is registered in the semantic information, data analysis and data shaping are performed again. Then, this process is repeated until there are no records in which field data has not been assigned to the added columns. As a result, the data shaping device 100 according to this embodiment can perform data shaping using the appropriate semantic information entered by the user, thereby achieving accurate data shaping.

Embodiment 2.
In this embodiment, differences from and additions to the first embodiment will be mainly described.
In this embodiment, components having the same functions as those in the first embodiment are given the same reference numerals, and the description thereof will be omitted.

***Configuration Description***
The configurations of the data shaping system 500, data shaping device 100, and user terminal device 200 according to this embodiment are the same as those in the first embodiment.
In this embodiment, the detection unit 140 determines whether or not the field data assigned to the column names of the table data 51 spans two or more column names, based on the table data 51 and the semantic information 52. If the detection unit 140 determines that the field data is assigned across two or more column names, it detects the field data as suspicious data 32.
The presentation unit 150 also highlights the suspicious data 32 and transmits a correction screen 212 that accepts corrections to the suspicious data 32 .
The registration unit 160 reflects the correction of the suspicious data 32 in the table data 51 .

*** Operation Description ***
Next, the operation of each device of the data shaping system 500 according to the present embodiment will be described. The operation procedure of each device of the data shaping system 500 corresponds to a data shaping method. Also, the program that realizes the operation of each device of the data shaping system 500 corresponds to a data shaping program.

FIG. 9 is a flow diagram showing the operation of the data shaping system 500 according to the present embodiment.
The data shaping process according to this embodiment is performed, for example, after the data shaping process according to the first embodiment is completed.

In step S201, the detection unit 140 determines whether the field data assigned to a column name in the table data 51 spans two or more column names.

FIG. 10 is a schematic diagram showing the data shaping process according to the present embodiment.
In the semantic information 52 of Fig. 10, child data such as "power outage,""flooding,""collision,""circuitboard," etc. are registered for parent data "cause." Furthermore, child data such as "circuit board,""sensor,""motor," etc. are registered for parent data "fault location." When data shaping processing is performed using this semantic information 52, two field data, "power outage" and "circuit board," are registered for the column name "cause," as in table data 51 after the first shaping in Fig. 10. In other words, the field data "circuit board" is distributed across two column names, "cause" and "fault location."

The detection unit 140 determines whether the field data assigned to the column names in the table data 51 spans two or more column names.
In the example of FIG. 10, the field data "PCB" is distributed across two column names, "Cause" and "Faulty Location".

When the detection unit 140 determines that the field data is distributed across two or more column names, it detects the field data as suspicious data 32 .
In the example of FIG. 10, the detection unit 140 detects the field data “PCB” that is set across two column names “Cause” and “Faulty Part” as suspicious data 32 .

In step S202, the presentation unit 150 highlights the suspicious data 32 and transmits to the user terminal device 200 a correction screen 212 that accepts corrections to the suspicious data 32.

FIG. 11 is a diagram showing an example of the correction screen 212 according to the present embodiment.
The correction screen 212 accepts corrections to the suspicious data 32 .
11, the correction screen 212 displays table data 51 after the data shaping process of the first embodiment is completed, and semantic information 52. Then, suspicious data 32 in the table data 51 is highlighted.
Also, a message is displayed to the user to prompt him/her to correct the data requiring attention in the table data 51. For example, a message such as "Two or more pieces of data are set in the column name 'Cause'. If you wish to correct the data, please press the Correct button and make the correction. If you wish to correct the semantic information, please press the Correct button and make the correction" is displayed.

In step S 203 , the screen display unit 210 of the user terminal device 200 displays the correction screen 212 on the display device 941 , and accepts corrections to the suspicious data 32 in the table data 51 via the correction screen 212 .
For example, the user performs an operation to correctly rewrite the table data 51 on the correction screen 212. The operation method may be keyboard input of words, drag and drop of words, or voice operation.
In the example of FIG. 11, the screen display unit 210 accepts a correction such as deleting "Circuit Board" from the two field data "Power Outage" and "Circuit Board" set in the column name "Cause".

Then, the screen display unit 210 of the user terminal device 200 transmits the corrections to the suspicious data 32 in the table data 51 received via the correction screen 212 to the data shaping device 100 via the communication device 950.

In step S204, the registration unit 160 receives the correction of the suspicious data 32 in the table data 51 from the user terminal device 200. Then, the registration unit 160 reflects the correction of the suspicious data 32 in the table data 51 in the table data 51.
In the example of FIG. 11, a correction is reflected that deletes the field data "Substrate" from the column name "Cause".

***Other configurations***
<Modification 3>
As shown in FIG. 11, the correction screen 212 may display a message urging the user to correct suspicious data in the table data, and also indicating that semantic information can be corrected.
The screen display unit 210 may accept a correction to the semantic information together with the correction of the suspicious data via the correction screen 212. Then, the screen display unit 210 may transmit the correction to the semantic information together with the correction of the suspicious data accepted via the correction screen 212 to the data shaping device.

***Description of Effects of This Embodiment***
As described above, in the data shaping system according to the present embodiment, when the field value allocated to the added column may not be allocated to the correct column in the shaped table data, it detects it as suspicious data. Then, the detected suspicious data is presented to the user, and the user can edit the shaped table data. In this way, in the data shaping system according to the present embodiment, after the data shaping process of the first embodiment, the user's correction can be further reflected in the table data. Therefore, the data shaping system according to the present embodiment can realize more accurate data shaping.

In the above first and second embodiments, each unit of each device of the data shaping system is described as an independent functional block. However, the configuration of each device of the data shaping system does not have to be the configuration as in the above-mentioned embodiment. The functional block of each device of the data shaping system may have any configuration as long as it can realize the functions described in the above-mentioned embodiment. In addition, each device of the data shaping system may be a system composed of multiple devices, not just one device.
In addition, a combination of multiple parts of the first and second embodiments may be implemented. Alternatively, one part of these embodiments may be implemented. In addition, any combination of these embodiments may be implemented, either as a whole or in part.
That is, in the first and second embodiments, the respective embodiments can be freely combined, or any of the components in each embodiment can be modified, or any of the components in each embodiment can be omitted.

The above-described embodiments are essentially preferred examples, and are not intended to limit the scope of the present disclosure, the scope of application of the present disclosure, or the scope of use of the present disclosure. The above-described embodiments can be modified in various ways as necessary. For example, the procedures described using flow charts or sequence diagrams may be modified as appropriate.

31 Unformatted data, 32 Data requiring caution, 51 Table data, 52 Semantic information, 100 Data formatting device, 110 Acquisition unit, 120 Analysis unit, 130 Formatting unit, 140 Detection unit, 150 Presentation unit, 160 Registration unit, 170, 220 Storage unit, 200 User terminal device, 210 Screen display unit, 211 Presentation screen, 212 Correction screen, 500 Data formatting system, 909 Electronic circuit, 910 Processor, 921 Memory, 922 Auxiliary storage device, 930 Input interface, 940 Output interface, 941 Display device, 950 Communication device.

Claims (10)

A data formatting device for formatting table data, comprising:
a storage unit that stores semantic information used for shaping the table data, in which child data and parent data representing the meaning of the child data are associated with each other and registered;
an analysis unit that uses the semantic information to determine whether or not field data to which a column name is not assigned among field data included in the setting data set in the table data is registered as child data in the semantic information;
a detection unit that detects the field data to which a column name is not assigned as unformatted data if the field data to which a column name is not assigned is not registered in the semantic information as child data;
a registration unit that receives an input of parent data when the unformatted data is treated as child data, and registers the received parent data in the semantic information as parent data of the unformatted data. The data shaping device comprises:
2. The data shaping device according to claim 1, further comprising a shaping unit that, if registered in the semantic information, selects parent data corresponding to the registered child data as a column name of field data to which the column name is not assigned, and shapes the table data by allocating the field data to which the column name is not assigned to the selected column name. The analysis unit is
A data shaping device as described in claim 2, which extracts words from the setting data of each row of a column to be shaped in the table data, selects each of the extracted words as field data to which a column name is not assigned, and determines whether the field data to which a column name is not assigned is registered as child data in the semantic information. The data shaping device comprises:
a presentation unit that transmits a presentation screen for presenting the unformatted data;
The registration unit is
4. The data shaping device according to claim 1, further comprising: a display screen that displays a display of the unshaped data and a display of the parent data. The registration unit is
A data shaping device as described in claim 4, which accepts input of child data related to the unformatted data and corresponding to the parent data, along with parent data when the unformatted data is treated as child data, via the presentation screen, and registers the accepted parent data and the child data corresponding to the parent data in the semantic information. The detection unit is
determining whether or not field data assigned to a column name in the table data spans two or more column names based on the table data and the semantic information, and if it is determined that the field data spans two or more column names, detecting the field data as suspicious data;
The presentation unit is
highlighting the suspicious data and transmitting a correction screen for accepting corrections to the suspicious data;
The registration unit is
6. The data shaping device according to claim 4, wherein correction of the suspicious data is reflected in the table data. A data shaping system including a data shaping device that shapes table data and a user terminal device that is used by a user and communicates with the data shaping device,
The data shaping device comprises:
a storage unit that stores semantic information used for shaping the table data, in which child data and parent data representing the meaning of the child data are associated with each other and registered;
a detection unit that detects, if field data to which a column name is not assigned among field data included in the setting data set in the table data is not registered as child data in the semantic information, the field data to which a column name is not assigned as unformatted data;
a presentation unit that transmits a presentation screen that presents the unformatted data to the user terminal device;
The user terminal device
a screen display unit that displays the presentation screen and receives input of parent data when the unformatted data is set as child data via the presentation screen;
The data shaping device further comprises:
A data shaping system comprising a registration unit that registers parent data, when the unshaped data accepted via the presentation screen is treated as child data, in the semantic information. A user terminal device communicates with a data formatting device that formats table data and is used by a user,
A user terminal device comprising: a screen display unit that receives a presentation screen presenting the unformatted data from the data shaping device, the screen display unit being used to shape the table data and including semantic information in which child data and parent data representing the meaning of the child data are registered in correspondence with each other; and a screen display unit that displays the presentation screen, accepts input of parent data when the unformatted data is treated as child data via the presentation screen, and transmits the parent data when the unformatted data is treated as child data, which was accepted via the presentation screen, to the data shaping device via a communication device, if field data included in setting data set in the table data and to which a column name is not assigned is not registered in the semantic information as child data, the data shaping device detects the field data to which a column name is not assigned as unformatted data. A data shaping method for use in a data shaping device for shaping table data, comprising:
a computer uses semantic information used for shaping the table data, in which child data and parent data expressing the meaning of the child data are associated and registered, to determine whether or not field data to which a column name is not assigned, among field data included in setting data set in the table data, is registered as child data in the semantic information;
if the field data to which a column name is not assigned is not registered as child data in the semantic information, the computer detects the field data to which a column name is not assigned as unformatted data;
A data formatting method in which a computer receives an input of parent data when the unformatted data is treated as child data, and registers the received parent data in the semantic information as parent data of the unformatted data. A data shaping program for use in a data shaping device for shaping table data, comprising:
a storage process for storing semantic information used in shaping the table data, the semantic information being registered in association with child data and parent data representing the meaning of the child data;
an analysis process using the semantic information to determine whether or not field data to which a column name is not assigned among field data included in the setting data set in the table data is registered as child data in the semantic information;
a detection process for detecting the field data to which a column name is not assigned as unformatted data if the field data to which a column name is not assigned is not registered as child data in the semantic information;
a data shaping program that causes a computer to execute a registration process of accepting input of parent data when the unformatted data is treated as child data, and registering the accepted parent data in the semantic information as parent data of the unformatted data.

Images