Evaluating the harmonisation potential of diverse cohort datasets.

Bauermeister S., Phatak M., Sparks K., Sargent L., Griswold M., McHugh C., Nalls M., Young S., Bauermeister J., Elliott P., Steptoe A., Porteous D., Dufouil C., Gallacher J.

Data discovery, the ability to find datasets relevant to an analysis, increases scientific opportunity, improves rigour and accelerates activity. Rapid growth in the depth, breadth, quantity and availability of data provides unprecedented opportunities and challenges for data discovery. A potential tool for increasing the efficiency of data discovery, particularly across multiple datasets is data harmonisation.A set of 124 variables, identified as being of broad interest to neurodegeneration, were harmonised using the C-Surv data model. Harmonisation strategies used were simple calibration, algorithmic transformation and standardisation to the Z-distribution. Widely used data conventions, optimised for inclusiveness rather than aetiological precision, were used as harmonisation rules. The harmonisation scheme was applied to data from four diverse population cohorts.Of the 120 variables that were found in the datasets, correspondence between the harmonised data schema and cohort-specific data models was complete or close for 111 (93%). For the remainder, harmonisation was possible with a marginal a loss of granularity.Although harmonisation is not an exact science, sufficient comparability across datasets was achieved to enable data discovery with relatively little loss of informativeness. This provides a basis for further work extending harmonisation to a larger variable list, applying the harmonisation to further datasets, and incentivising the development of data discovery tools.

DOI

10.1007/s10654-023-00997-3

Type

Journal article

Journal

Eur J Epidemiol

Publication Date

06/2023

Volume

38

Pages

605 - 615

Keywords

C-surv data model, Cohort, Data discovery, Data harmonisation, Data visualisation, Datasets, Humans, Reference Standards, Datasets as Topic, Knowledge Discovery

Permalink Original publication