每日简报

机器学习预测不确定性估计综述AI 解读

Predictions and forecasts of machine learning models should take the form of probability distributions, aiming to increase the quantity of information communicated to end users. Although applications of probabilistic prediction and forecasting with machine learning models in academia and industry are becoming more frequent, related concepts and methods have not been formalized and structured under a holistic view of the entire field. Here, we review the topic of predictive…

基于二元时间序列的期望最大化网络重构及适用网络类型AI 解读

Based on the binary time series data of social infection dynamics, we propose a general framework to reconstruct 2-simplex complexes with two-body and three-body interactions by combining the maximum likelihood estimation in statistical inference and introducing the expectation maximization. In order to improve the code running efficiency, the whole algorithm adopts vectorization expression. Through the inference of maximum likelihood estimation, the vectorization expression…

W-Transformers：基于小波的单变量时间序列预测框架AI 解读

Deep learning utilizing transformers has recently achieved a lot of success in many vital areas such as natural language processing, computer vision, anomaly detection, and recommendation systems, among many others. Among several merits of transformers, the ability to capture long-range temporal dependencies and interactions is desirable for time series forecasting, leading to its progress in various time series applications. In this paper, we build a transformer model for…

哪些模型有用？迈向统一的贝叶斯模型分类体系AI 解读

Probabilistic (Bayesian) modeling has experienced a surge of applications in almost all quantitative sciences and industrial areas. This development is driven by a combination of several factors, including better probabilistic estimation algorithms, flexible software, increased computing power, and a growing awareness of the benefits of probabilistic learning. However, a principled Bayesian model building workflow is far from complete and many challenges remain. To aid…

高维鞅差假设检验AI 解读

In this paper, we consider testing the martingale difference hypothesis for high-dimensional time series. Our test is built on the sum of squares of the element-wise max-norm of the proposed matrix-valued nonlinear dependence measure at different lags. To conduct the inference, we approximate the null distribution of our test statistic by Gaussian approximation and provide a simulation-based approach to generate critical values. The asymptotic behavior of the test statistic…

PromptCast：基于提示的时间序列预测范式AI 解读

This paper presents a new perspective on time series forecasting. In existing time series forecasting methods, the models take a sequence of numerical values as input and yield numerical values as output. The existing SOTA models are largely based on the Transformer architecture, modified with multiple encoding mechanisms to incorporate the context and semantics around the historical data. Inspired by the successes of pre-trained language foundation models, we pose a…

不同变量范式下深度学习因果发现的综述与路线图AI 解读

Understanding causality helps to structure interventions to achieve specific goals and enables predictions under interventions. With the growing importance of learning causal relationships, causal discovery tasks have transitioned from using traditional methods to infer potential causal structures from observational data to the field of pattern recognition involved in deep learning. The rapid accumulation of massive data promotes the emergence of causal search methods with…

分析连续时间系统的深度学习方法AI 解读

Scientists often use observational time series data to study complex natural processes, but regression analyses often assume simplistic dynamics. Recent advances in deep learning have yielded startling improvements to the performance of models of complex processes, but deep learning is generally not used for scientific analysis. Here we show that deep learning can be used to analyze complex processes, providing flexible function approximation while preserving…

结合变分因果推断与细化关系信息预测细胞响应AI 解读

Predicting the responses of a cell under perturbations may bring important benefits to drug discovery and personalized therapeutics. In this work, we propose a novel graph variational Bayesian causal inference framework to predict a cell's gene expressions under counterfactual perturbations (perturbations that this cell did not factually receive), leveraging information representing biological knowledge in the form of gene regulatory networks (GRNs) to aid individualized…

重新审视广义 Beta 分布族AI 解读

We approach the Generalized Beta (GB) family of distributions using a mean-reverting stochastic differential equation (SDE) for a power of the variable, whose steady-state (stationary) probability density function (PDF) is a modified GB (mGB) distribution. The SDE approach allows for a lucid explanation of Generalized Beta Prime (GB2) and Generalized Beta (GB1) limits of GB distribution and, further down, of Generalized Inverse Gamma (GIGa) and Generalized Gamma (GGa)…

混杂马尔可夫决策过程中的工具变量离线强化学习AI 解读

We study the offline reinforcement learning (RL) in the face of unmeasured confounders. Due to the lack of online interaction with the environment, offline RL is facing the following two significant challenges: (i) the agent may be confounded by the unobserved state variables; (ii) the offline data collected a prior does not provide sufficient coverage for the environment. To tackle the above challenges, we study the policy learning in the confounded MDPs with the aid of…

新冠疫情后的通胀情绪分析AI 解读

We implement traditional machine learning and deep learning methods for global tweets from 2017-2022 to build a high-frequency measure of the public's sentiment index on inflation and analyze its correlation with other online data sources such as google trend and market-oriented inflation index. We use manually labeled trigrams to test the prediction performance of several machine learning models(logistic regression,random forest etc.) and choose Bert model for final…

微生物组数据中组成型中介效应选择的贝叶斯联合模型AI 解读

Analyzing multivariate count data generated by high-throughput sequencing technology in microbiome research studies is challenging due to the high-dimensional and compositional structure of the data and overdispersion. In practice, researchers are often interested in investigating how the microbiome may mediate the relation between an assigned treatment and an observed phenotypic response. Existing approaches designed for compositional mediation analysis are unable to…

含交互固定效应的线性多维回归AI 解读

This paper studies a linear model for multidimensional panel data of three or more dimensions with unobserved interactive fixed-effects. The main estimator uses a Neyman-orthogonal approach, and requires two preliminary steps. First, the model is embedded within a two-dimensional panel framework where factor model methods in Bai (2009) lead to consistent, but slowly converging, estimates. The second step develops a weighted-within transformation that is robust to…

交叉试验重复测量的半参数广义估计方程AI 解读

A model for cross-over designs with repeated measures within each period was developed. It is obtained using an extension of generalized estimating equations that includes a parametric component to model treatment effects and a non-parametric component to model time and carry-over effects; the estimation approach for the non-parametric component is based on splines. A simulation study was carried out to explore the model properties. Thus, when there is a carry-over effect or…

线性动态系统观测预测中的公平性AI 解读

In machine learning, training data often capture the behaviour of multiple subgroups of some underlying human population. This behaviour can often be modelled as observations of an unknown dynamical system with an unobserved state. When the training data for the subgroups are not controlled carefully, however, under-representation bias arises. To counter under-representation bias, we introduce two natural notions of fairness in time-series forecasting problems: subgroup…

高维环境下的局部投影推断AI 解读

In this paper, we estimate impulse responses by local projections in high-dimensional settings. We use the desparsified (de-biased) lasso to estimate the high-dimensional local projections, while leaving the impulse response parameter of interest unpenalized. We establish the uniform asymptotic normality of the proposed estimator under general conditions. Finally, we demonstrate small sample performance through a simulation study and consider two canonical applications in…

改进的因果森林AI 解读

Uncovering the heterogeneity of causal effects of policies and business decisions at various levels of granularity provides substantial value to decision makers. This paper develops estimation and inference procedures for multiple treatment models in a selection-on-observed-variables framework by modifying the Causal Forest approach (Wager and Athey, 2018) in several dimensions. The new estimators have desirable theoretical, computational, and practical properties for…

处理水平可增长且组规模不同时设计型因果推断的 Berry–Esseen 界AI 解读

Neyman (1923/1990) introduced the randomization model, which contains the notation of potential outcomes to define causal effects and a framework for large-sample inference based on the design of the experiment. However, the existing theory for this framework is far from complete, especially when the number of treatment levels diverges and the treatment group sizes vary. We provide a unified discussion of statistical inference under the randomization model with general…

无序多值处理的工具变量：理论与专业学习收益证据AI 解读

We revisit the identification argument of Kirkeboen et al. (2016) who showed how one may combine instruments for multiple unordered treatments with information about individuals' ranking of these treatments to achieve identification while allowing for both observed and unobserved heterogeneity in treatment effects. We show that the key assumptions underlying their identification argument have testable implications. We also provide a new characterization of the bias that may…

通过最优标签置换分类进行类别数据的二元因果发现AI 解读

Causal discovery for quantitative data has been extensively studied but less is known for categorical data. We propose a novel causal model for categorical data based on a new classification model, termed classification with optimal label permutation (COLP). By design, COLP is a parsimonious classifier, which gives rise to a provably identifiable causal model. A simple learning algorithm via comparing likelihood functions of causal and anti-causal models suffices to learn…

利用GWAS汇总数据推断非线性因果效应AI 解读

Large-scale genome-wide association studies (GWAS) have offered an exciting opportunity to discover putative causal genes or risk factors associated with diseases by using SNPs as instrumental variables (IVs). However, conventional approaches assume linear causal relations partly for simplicity and partly for the availability of GWAS summary data. In this work, we propose a novel model {for transcriptome-wide association studies (TWAS)} to incorporate nonlinear relationships…

样本选择下异质性治疗效应的界：社交媒体与政治极化应用AI 解读

We propose a method for estimation and inference for bounds for heterogeneous causal effect parameters in general sample selection models where the treatment can affect whether an outcome is observed and no exclusion restrictions are available. The method provides conditional effect bounds as functions of policy relevant pre-treatment variables. It allows for conducting valid statistical inference on the unidentified conditional effects. We use a flexible debiased/double…

异质节点网络向量自回归模型的联合估计与分组识别AI 解读

Individuals or companies in a large social or financial network often display rather heterogeneous behaviors for various reasons. In this work, we propose a network vector autoregressive model with a latent group structure to model heterogeneous dynamic patterns observed from network nodes, for which group-wise network effects and timeinvariant fixed-effects can be naturally incorporated. In our framework, the model parameters and network node memberships can be…