Publications

We introduce physics-informed multimodal autoencoders (PIMA)-a variational inference framework for discovering shared information in multimodal datasets. Individual modalities are embedded into a shared latent space and fused through a product-of-experts formulation, enabling a Gaussian mixture prior to identify shared features. Sampling from clusters allows cross-modal generative modeling, with a mixture-of-experts decoder that imposes inductive biases from prior scientific knowledge and thereby imparts structured disentanglement of the latent space. This approach enables cross-modal inference and the discovery of features in high-dimensional heterogeneous datasets. Consequently, this approach provides a means to discover fingerprints in multimodal scientific datasets and to avoid traditional bottlenecks related to high-fidelity measurement and characterization of scientific datasets.

Machine learning is on a bit of a tear right now, with advances that are infiltrating nearly every aspect of our lives. In the domain of materials science, this wave seems to be growing into a tsunami. Yet, there are still real hurdles that we face to maximize its benefit. This Matter of Opinion, crafted as a result of a workshop hosted by researchers at Sandia National Laboratories and attended by a cadre of luminaries, briefly summarizes our perspective on these barriers. By recognizing these problems in a community forum, we can share the burden of their resolution together with a common purpose and coordinated effort.