Next Article in Journal
Recent Advances in Supervised Dimension Reduction: A Survey
Previous Article in Journal
Evaluation of ARIMA Models for Human–Machine Interface State Sequence Prediction
Previous Article in Special Issue
The Winning Solution to the IEEE CIG 2017 Game Data Mining Competition
Article Menu

Export Article

Open AccessArticle
Mach. Learn. Knowl. Extr. 2019, 1(1), 312-340; https://doi.org/10.3390/make1010019

Causal Discovery with Attention-Based Convolutional Neural Networks

Faculty of EEMCS, University of Twente, PO Box 217, 7500 AE Enschede, The Netherlands
*
Author to whom correspondence should be addressed.
Received: 5 November 2018 / Revised: 26 December 2018 / Accepted: 27 December 2018 / Published: 7 January 2019
(This article belongs to the Special Issue Women in Machine Learning 2018)
Full-Text   |   PDF [1802 KB, uploaded 10 January 2019]   |  

Abstract

Having insight into the causal associations in a complex system facilitates decision making, e.g., for medical treatments, urban infrastructure improvements or financial investments. The amount of observational data grows, which enables the discovery of causal relationships between variables from observation of their behaviour in time. Existing methods for causal discovery from time series data do not yet exploit the representational power of deep learning. We therefore present the Temporal Causal Discovery Framework (TCDF), a deep learning framework that learns a causal graph structure by discovering causal relationships in observational time series data. TCDF uses attention-based convolutional neural networks combined with a causal validation step. By interpreting the internal parameters of the convolutional networks, TCDF can also discover the time delay between a cause and the occurrence of its effect. Our framework learns temporal causal graphs, which can include confounders and instantaneous effects. Experiments on financial and neuroscientific benchmarks show state-of-the-art performance of TCDF on discovering causal relationships in continuous time series data. Furthermore, we show that TCDF can circumstantially discover the presence of hidden confounders. Our broadly applicable framework can be used to gain novel insights into the causal dependencies in a complex system, which is important for reliable predictions, knowledge discovery and data-driven decision making. View Full-Text
Keywords: convolutional neural network; time series; causal discovery; attention; machine learning convolutional neural network; time series; causal discovery; attention; machine learning
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Nauta, M.; Bucur, D.; Seifert, C. Causal Discovery with Attention-Based Convolutional Neural Networks. Mach. Learn. Knowl. Extr. 2019, 1, 312-340.

Show more citation formats Show less citations formats

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Mach. Learn. Knowl. Extr. EISSN 2504-4990 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top