Symposium GI01 : Machine Learning and Data-Driven Materials Development and Design

The aim of this The aim of this presentation is to show how Material Informatics can transform the existing paradigm of accelerated materials discovery and multiscale design. We discuss ways of approaching materials design that searches for the best pathways for future discoveries and not be limited to only searching among massive data libraries built on high throughput computation and /or experiments. We show that these pathways help to bridge the gap between fundamental materials properties and structure and materials performance. This presentation will focus on how data science methods can discover new pathways for the chemical design of glasses/ ceramics as well as uncover hidden information in molecular scale structure of amorphous solids.

A fundamental challenge in materials design is linking building block attributes to crystal structure. Addressing this challenge is particularly difficult for systems that exhibit emergent order, such as entropy-stabilized colloidal crystals. We combine recently developed techniques in inverse design with machine learning to construct a model that correctly classifies the crystals of more than ten thousand polyhedral shapes into 13 different structures with a predictive accuracy of 96% using only two geometric shape measures. With three measures, 98% accuracy is achieved. We test our model on previously reported colloidal crystal structures for 71 symmetric polyhedra and obtain 92% accuracy. Our findings (1) demonstrate that entropic colloidal crystals are controlled by surprisingly few parameters, (2) provide a quantitative model to predict these crystals solely from the geometry of their building blocks, and (3) suggest a prediction paradigm that easily generalizes to other self-assembled materials.

It has been long suggested that present synthetic techniques of polymers afford an excessive strain on resources, and efforts should be undertaken to devise new methods to predictively design polymers based on their desired properties.[1] One of such properties include phase behavior. Phase behavior is a unique characteristic of polymers which afford interesting assemblies and microstructure of polymer solutions, blends and films,[2] which are in turn influenced by the four key fundamentals of polymer architecture: (a) topology; (b) molecular weight; (c) composition; (d) functionality. Efforts were made by Hoogenboom and co-workers[3],[4] to systematically vary composition and molecular weight for poly(oxazoline)s so as to ascertain their relationship with cloud points – a temperature dependent phase behavior. A 3D curve of best fit was obtained correlating 2 of the numerous design parameters to cloud point.

However, a 3D curve is an inaccurate correlation as there is no model that suitably fits the data, resulting in a poor fit with a loss of detail. Most importantly, the 3D curve does not cover all the parameters and is incapable of identifying the feature importance of the design parameters. In this paper, we will demonstrate the use of modern machine learning techniques which are able to correlate the various parameters describing polymer architecture, to its associated cloud point. We will demonstrate how the algorithm was trained using polymers synthesized at varying levels of precision. Finally we will demonstrate the attempt towards building an inverse design problem capable of designing a poly(oxazoline) architecture based on a required cloud point.


[1] Nature, 2016, 536, 266-268, doi:10.1038/536266a

[2] Nature Mat, 2010, 9, 101-113, doi:10.1038/nmat2614

[3] Chem Commun, 2008, 44, 5758-5760, doi:10.1039/B813140F

[4] Polym Chem, 2014, 52, 3118-3122, doi: 10.1002/pola.27364

The true potential of additive manufacturing (AM) as a next-generation production technology will only be realized by synergy of automated machinery with predictive models of process and material performance. I will discuss our recent efforts to improve the performance of extrusion AM technology, including the design of a desktop system that achieves ~10X greater build rate than commercial benchmarks, implementation of feed-forward motion control algorithms to mitigate trajectory errors, and development of graph-based toolpath planning algorithms enabling continuous printing of lattice structures. In-process thermal imaging is used to calibrate toolpath planning algorithms for large-scale extrusion AM, mitigating deformation and strength loss due to local thermal gradients during printing. I will close with commentary on the opportunities and challenges toward autonomous manufacturing systems wherein AM is a cornerstone, and machine learning is an essential, yet currently primitive, component.

Toyota Research Institute (TRI) was founded in order to develop technology for a new world of mobility - with an overall mission to use artificial intelligence (AI) to improve the quality of human life. In the coming decades, our society will continually need better and more environmentally sustainable sources of energy storage for mobility and transportation. At TRI, the Accelerated Materials Design and Discovery (AMDD) program will accelerate discovery of energy materials through new tools, technologies, and methodologies that leverage advances in AI. The research program consists of efforts to 1) create extensive and dynamic databases of materials knowledge via high-throughput computing, high-throughput experimentation, and mining of existing literature data, 2) develop software tools to aid the human expert in extracting knowledge from large databases and 3) develop novel automated materials discovery systems by integrating simulation, machine learning, artificial intelligence, and robotics. The AMDD program is comprised of our research scientists, software engineers, and an extensive network of funded collaborators at a number of universities and research institutions. This talk will describe the vision of our research program, progress to date, challenges and early successes in applying AI to materials research for the discovery of catalysts and battery materials, and future opportunities at the intersection of materials and computer science.

The vast compositional space of metallic materials provides ample opportunity to design stronger, more ductile and cheaper alloys. However, the substantial complexity surrounding microstructural deformation makes simulating new microstructures exceedingly difficult. Instead, tedious experiments are conducted to optimize properties without tools to predict how microstructures will perform. Here, we exploit recent developments in data collection capabilities and develop a purely empirical model to forecast microstructural performance in advance, entirely bypassing the challenges associated with physics based simulations.

In-situ experiments are conducted using a scanning electron microscope in order obtain detailed microstructural information. 6400 12.5 μm square microstructural regions are tracked using a quasi digital image correlation algorithm and imaged throughout deformation in order to obtain sufficient data to train the model. Detailed analysis is conducted on three experimental datasets, two of dual-phase steel and one of bearing steel. The models are trained to predict crack nucleation and crack growth, a complex process with an intricate relationship to microstructural geometry. Multiple machine learning approaches are compared and contrasted including a n-point statistics and principle component analysis algorithm based on grain boundaries, a support vector machine approach, and a convolutional neural network.

Using this approach, significant predictive ability is achieved and the model can accurately predict crack nucleation and crack size on a new microstructure. For example, 84.8% of microstructures predicted to crack, actually crack. Artificial microstructures with idealized properties are constructed and fed into the model in order to understand how it makes its prediction. For example, there is a major difference in cracking probability for grain boundaries aligned with the loading direction (12%) and inclined at 45° to the loading direction (72%). These results demonstrate the success of this approach and paves the pathway for use of this framework in alloy design to predict a range of behaviors.

Microscale spatial and material heterogeneities in 3D printed electrical devices present significant challenges to predictable electrical performance and device reliability. High permittivity particles are often added to dielectric inks to tailor the macro level permittivity of printed dielectric substrates and coatings. However the combined role of particle morphology, discrete spatial arrangement and material properties on variance is difficult to distinguish experimentally, due to the large parameter space of processing variables and electrical sensitivity to local heterogeneities. To address this challenge, we developed a 3D, high-fidelity finite element model of an interdigitated capacitor (IDC) with a dielectric coating of distinct spatial distributions of discrete dielectric particles. The volume fraction, particle size and permittivity distributions for each IDC was then encoded into the genome of a genetic algorithm (GA) with the objective of identifying combinations of these properties that generate high variance in the capacitance of the IDC. In addition, the genetic algorithm was guided by an artificial neural network (ANNs) that recursively trains on the data produced by GA and sends suggestions back to the GA to accelerate the identification of optimized properties. This autonomous and robust optimization approach allows us to build a database with strong likelihood of high variance mechanisms, while saving on computational costs. Preliminary results indicate that large particles in dilute volume fractions generate high variability in capacitance, due to heighten influence these particles positions on excluding the electric field. Classification-based machine learning techniques were also applied to the spatial distributions of the dielectric particles to determine whether a critical spacing parameter or local clustering was a component in driving up the variance. Collectively, the study provides a useful framework to correlate electrical performance with both macro- and microstructural variation sources, which is key to accelerating the development of 3D printing materials.

Electronic levels introduced by impurities and defects in the middle of the band gap are critically important in semiconductors for optoelectronic, photovoltaic (PV) and quantum sensing applications. While “deep” defect levels can prove catastrophic for PV performance by causing non-radiative carrier recombination^[1], impurity levels in the band gap could also be entangled for quantum sensing or lead to increased absorption of sub-gap photons which can enhance efficiencies^[2]. Predicting formation energies and charge transition levels for defects in semiconductors is thus paramount; density functional theory (DFT) calculations have been widely applied for such studies^[3] to overcome experimental bottlenecks. However, the requirement of large supercells and inclusion of charged states make these computations very expensive, and trends and knowledge from previous calculations are not exploited in subsequent ones. In this work, we use DFT to generate a substantial computational dataset of the formation energies and transition levels of vacancy, interstitial and substitutional point defects in many lead-based pure and mixed halide hybrid perovskites (MAPbX₃, where MA = methylammonium and X = Cl/Br/I)^[4]. These computations help determine the dominant intrinsic defects in any perovskite, the equilibrium Fermi level (and thus the nature of conductivity) for different chemical potential conditions, and the stable extrinsic substituents (atoms selected by screening across the periodic table) that compensate for intrinsic defects and change the equilibrium Fermi level. Further, we apply machine learning to extract crucial design rules and predictive models from the data, via the intermediate process of numerically representing any defect in terms of easily calculated structural and electronic properties of defect atoms, their known compounds and their hypothetical 12 atom perovskite unit cells. Using coefficients of linear correlation and popular regression techniques like ridge regression and LASSO, we obtain accurate predictive models for formation energy and every relevant transition level that require only a handful of descriptors as input. For example, the 0/-1 transition level of any substitution defect can be predicted using only the bond length and band edge information from an inexpensive unit cell calculation, bringing down computational cost by nearly two orders of magnitude, while simultaneously providing physical insights for the origin of these defect levels. The machine learning results derived here can lead to accelerated prediction of defect states in lead-based hybrid perovskites and allow efficient materials design of defect-tolerant semiconductors as well as semiconductors with suitably placed defect levels.

REFERENCES
[1] Y. Yan et al., Springer IP. 79-105 (2016).
[2] M.D. Sampson et al., J. Mater. Chem. A. 5, 3578 (2017).
[3] Freysoldt et al., Rev. Mod. Phys. 86, 253 (2014).
[4] T. Shi et al., Appl. Phys. Lett. 106, 103902 (2015).

In this contribution we present an approach to predict Organic Solar Cells Efficiency based on Machine Learning.
We present a data set of small molecule donor-acceptor pairs gathered from the literature (between 2013 and 2017), for which equilibrium geometries and electronic properties have been computed at DFT level. We used electronic data in combination with Scharber's model to calculate photovoltaic parameters of the organic solar cells. Comparison with experimental data reveals a disappointing performance of DFT. It has been shown that DFT data can be refined through Machine Learning to improve the performance of Scharber's model to predict experimental photovoltaic parameters.
In this contribution, we adopt a similar procedure to predict photovoltaic parameters from structural information only, expressed in terms of molecular fingerprints. This allows to bypass a high number of DFT calculations, obtaining similar results to those reported in the literature and based on electronic data exclusively.
Finally, with a similar approach, we obtain direct predictions of solar cell efficiencies. We show that considering only electronic or structural parameters leads again to similar results, while considering both parameters at the same time results in improved predictions, allowing to obtain direct predictions of solar cells efficiency with a reasonable level of accuracy.
Finally, we critically assess the usefulness of the proposed approach for the discovery of new materials that have not been synthesized yet.

Many of the most relevant chemical properties of matter depend explicitly on atomistic and electronic details, rendering a first principles approach to chemistry mandatory. Alas, even when using high-performance computers, brute force high-throughput screening of compounds is beyond any capacity for all but the simplest systems and properties due to the combinatorial nature of chemical space, i.e. all compositional, constitutional, and conformational isomers. Consequently, efficient exploration algorithms need to exploit all implicit redundancies present in chemical space. I will discuss recently developed machine learning approaches for interpolating quantum mechanical observables in compositional and constitutional space. Results for our models indicate remarkable performance in terms of accuracy, speed, universality, and size scalability.

Phosphorescent organic light emitting diodes (OLEDs) have been paid attention due to their theoretical internal quantum efficiency of nearly 100% compared with just 25% in fluorescent OLEDs. For the commercialization of phosphorescent OLED, the discovery of promising organometallic complexes as phosphorescent emitters is critical not only to facilitate the intersystem crossing between singlet and triplet states but also to secure sufficient durability. Although many studies have been conducted to find potent emitters for red, green, and blue colors, they still depend on prior knowledge about specific coordinating ligand structures and their atomic composition regarding the target photophysical properties. And the overall potential and limits of candidate materials in feasible chemical space have not yet been figured out through a systematic investigation. To answer this and to shed a light on the energy landscape of the emitters, we have built a complete library of all possible core structures of homoleptic Iridium(III)-complexes, which are representative phosphorescent OLED dopants possessing a short triplet lifetime, good thermal stability, and high quantum yields, by devising a novel graph-based enumeration method. While each atom is treated as a node and each bond as an edge in conventional graph-based molecular generation, ring structure was considered as a node and the fusion between the rings as an edge in our case since the cores of cyclometallated complexes consist of polycyclic rings attached to the metal atom. By referring to the mathematically established planar graphs, entire polycyclic carbon ring structures were enumerated. And further substitution of the carbons with up to five nitrogen atoms generated about 10 million molecular structures consisting of 3-5 rings. To examine the distribution of light emitting wavelengths, T₁ energy level for each entry was predicted with the help of a deep neural network (DNN) model. The iterative execution of first-principle excited state calculations for carefully selected set of molecules (5.6×10⁴) followed by an update of the DNN model allowed accurate and efficient prediction of the triplet energies with a mean absolute error of 0.061 eV, and we successfully identified subsets of candidate structures in terms of spectral ranges. For example, the number of molecules in blue color regime accounted for only 1.04% of the total compared with 22.4% in red and green regimes. We expect that the above database can serve as a complete baseline for the development of high-performance OLED emitters. And the proposed graph-based enumeration would be a versatile tool for systematic exploration of whole chemical space in various organic materials developments.

Metal-organic frameworks (MOFs) are promising solid-state adsorbents thanks to their high gravimetric capacities. However, realizing a high volumetric H₂ adsorption capacity, balanced with a high gravimetric density, is one of the main barriers of the successful application of MOFs as solid-state adsorbents. A large database of half-a-million MOFs consisting of real and hypothetical compounds was compiled and screened using semi-empirical and atomistic (grand canonical Monte Carlo) techniques. Several machine learning (ML) algorithms were benchmarked for their ability to predict hydrogen storage in MOFs at multiple conditions. The top performing algorithm, extremely randomized trees, was applied to rapidly identify MOFs with high usable H₂ storage capacities across the entire database. A combinatorial approach was then used to understand the importance of crystallographic properties and training set size. This approach identifies the number and combination of crystallographic features needed to achieve the most accurate predictions. Finally, we assess multilinear regression models for their ability to out-perform the well-known Chahine rule for predicting H₂ uptake.

The tremendous improvements in computational resources, coupled with software development during the last decades, real materials properties can now be calculated from quantum mechanics – much faster than they can be measured. A result of this paradigm change are databases like the Materials Project (www.materialsproject.org) which is harnessing the power of supercomputing together with state of the art quantum mechanical theory to compute the properties of all known inorganic materials and beyond, design novel materials and offer the data for free to the community together with online analysis and design algorithms. The software infrastructure carries out thousands of calculations per week – enabling screening, predictions, characterization and even synthesis suggestions - for both novel solid as well as molecular species with target properties. This growing body of data has finally reached the stage where automated learning algorithms can be effectively trained and utilized to accelerate analyses. To exemplify the approach of data-driven materials design, we will survey a few case studies – from prediction, to synthesis and characterization - showcasing rapid iteration between ideas, computations, insight and new materials development.

Defects and impurities introduce localized heterogeneities in solids and decisively control the behavior of a wide range of energy technologies. Fuel cell materials, especially proton conducting fuel cells, are a quintessential example in this regard. Designing and developing solid oxide materials that can selectively transport protons will enable us to develop the next generation proton conducting solid oxide fuel cells. Protons require less activation energy compared to oxygen ions which results in a lower operating temperature, higher operating efficiency and better material reliability. In this work [1,2,3,4] we focus obtaining fundamental insights on how properties of host material structure along with dopants, disorder and strain influences proton transport properties in solid oxides by coupling high-throughput computations with functional imaging, neutron spectroscopy and transport measurements.

We initially focus on the perovskite family of compounds (such as doped BaZrO₃). We benchmark our calculations against a wide range of experimental measurements such as kelvin probe force microscopy (KPFM), inelastic neutron scattering (INS) and atom probe tomography (APT). To obtain better insights on why certain cubic perovskite/dopant combinations are better at conducting protons compared to others, we developed a high-throughput framework to perform ab initio calculations. The high-throughput framework can scale massively to tens of thousands of nodes to fully exploit the computational capability of Titan at OLCF supercomputing facility. We employ this approach to calculate proton transport properties in several cubic perovskite materials with different host atoms and dopants. The results obtained from these calculations enables us to obtain better insights on how material structure – such as atomic properties (electronegativity, ionic radius) and lattice properties (sub-lattice distortion) influences proton transport. The results obtained from this high-throughput analysis is being employed to develop a machine learning framework to predict structure-property correlations on a larger set of perovskites materials. Finally, we explore the role of disorder on proton transport by studying for example fluorite based lanthanum tungstate materials.
[1] “Defect Genome of Cubic Perovskites for Fuel Cell Applications”, Journal of Physical Chemistry C, 121, 26637 (2017)
[2] “The Influence of Local Distortions on Proton Mobility in Acceptor Doped Perovskites”, (Chemistry of Materials, accepted)
[3]“The Influence of the Local Structure on Proton Transport in a Solid Oxide Proton Conductor La0.8Ba1.2GaO3.9”, J. Mat. Chem. A, 5, 15507 (2017)
[4] “Influence of Non-Stoichiometry on Proton Conductivity in Thin Film Yttrium-doped Barium Zirconate”, ACS Appl. Mater. Interfaces, 2018, 10 (5), pp 4816–4823

The recent successes of the Materials Genome Initiative has opened up new opportunities for data-centric informatics approaches in several subfields of materials research, including in polymer science and engineering. Polymers, being inexpensive and possessing a broad range of tunable properties, are widespread in many technological applications. The vast chemical and morphological complexity of polymers though gives rise to challenges in the rational discovery of new materials for specific applications. The nascent field of polymer informatics seeks to provide tools and pathways for accelerated property prediction (and materials design) via surrogate machine learning models built on reliable past data. We have carefully accumulated a dataset of organic polymers whose properties were obtained either computationally (bandgap, dielectric constant, refractive index and atomization energy) or experimentally (glass transition temperature, solubility parameter and density). A fingerprinting scheme that captures atomistic to morphological structural features was developed to numerically represent the polymers. Machine learning models were then trained by mapping the fingerprints (or features) to properties. Once developed, these models can rapidly predict properties of new polymers (within the same chemical class as the parent dataset) and can also provide uncertainties underlying the predictions. Since different properties depend on different length-scale features, the prediction models were built on an optimized set of features for each individual property. Furthermore, these models are incorporated in a user friendly online platform named Polymer Genome (www.polymergenome.org). Systematic and progressive expansion of both chemical and property spaces are planned to extend the applicability of Polymer Genome to a wide range of technological domains.

High-Throughput Quantum-Mechanics computation of materials properties by ab initio methods has become the foundation of an effective approach to materials design, discovery and characterization. This data driven approach to materials science currently presents the most promising path to the development of advanced technological materials that could solve or mitigate important social and economic challenges of the 21st century. In particular, the rapid proliferation of computational data on materials properties presents the possibility to complement and extend materials property databases where the experimental data is lacking and difficult to obtain.
Enhanced repositories such as AFLOWLIB open novel opportunities for structure discovery and optimization, including uncovering of unsuspected compounds, metastable structures and correlations between various properties. The practical realization of these opportunities depends almost exclusively on the the design of efficient algorithms for electronic structure simulations of realistic material systems beyond the limitations of the current standard theories. In this talk, I will review recent progress in theoretical and computational tools for data generation and advanced characterization, and in particular, discuss the development and validation of novel functionals within Density Functional Theory and of local basis representations for effective ab-initio tight-binding schemes.

Effective research and development efforts in the field of electroactive materials are critically dependent of the characterization methods that can generate information about the physical properties at the relevant scale. When the scope of these efforts includes engineering materials, fundamentally new challenges arise as the intrinsic complexity of industrial-grade samples requires decoupling of the observed phenomena. The characterization of the materials response in this case is impossible to be directly reflected using a single parameter. In order to tackle this challenge, we adopted a different strategy which included expanded representation of the analyzed materials with subsequent multivariate analysis. Its results were used to extract relevant features that may be intrinsic to a specific composition or instead may span across the sample library. We demonstrate this feature-centric approach for the rapid identification of the materials ability to develop triboelectric charge, observation of the electric charge migration on industrial-grade polyethylene terephthalate (PET) samples and property-driven analysis of effective piezoelectric coefficients observed across PZT-PZO (lead zirconate titanate - lead zirconate) phase diagram. We have employed multivariate adaptive regression splines, principal component analysis, large-scale molecular dynamics simulations, finite element analysis, multivariate Naïve Bayes classifier as parts of our method. Resulting insights allow for the isolation of the common features of the dataset reflecting specific piezoelectric and electrostatic phenomena as well as identification of the samples satisfying certain criteria. We believe that feature-base analytics demonstrated in this work can be successfully applied in other materials science fields where the nanoscale behavior of the relevant materials needs to the understood.
References:
1) Nikolay Borodinov et al, Probing static discharge of polymer surfaces with nanoscale resolution, available at arxiv.org/abs/1806.05169
This research was carried out at the Center for Nanophase Materials Sciences, a US Department of Energy Office of Science User Facility. The scope of the work was under a CRADA between Proctor & Gamble Co. and Oak Ridge National Laboratory. This research also used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725.

Despite our increasing demand for renewable energy materials over the past decade, as well as recent advances in photovoltaics and transparent electronics, progress in the field of high-performing p-type transparent conductors (TCs) has been relatively slow. All TCs used in industry are still n-type, since state-of-the-art n-type TCs have figures of merit orders of magnitude higher than p-type analogues due to the localized, 2p character of valence bands and doping difficulties in wide-gap oxides. Both n-type and p-type TCs are conventionally oxides but, due to energetics of the chalcogen 2p orbitals, chalcogenide (S, Se, Te) semiconductors have shown promise of higher hole transport and greater p-type doping propensity than oxides (in exchange for a decreased band gap).

Here, we use high throughput computation to screen a large database of over 10,000 chalcogenide compounds for binary, ternary, and quaternary chalcogenides likely to have a high hole conductivity and high optical transparency. The first round of screening uses GGA and GGA+U functionals from the Materials Project database to calculate band gaps and hole effective mass derived from the BoltzTraP code. Refined screenings use additional transport and HSE calculations. Our ultimate goal is to synthesize promising compounds in the laboratory for use in stable devices, so we also apply a proxy for structural thermodynamic stability.

From these criteria, we discover a large set of computationally stable multi-anionic compounds. Several compounds studied previously as TCs emerge from our screening, including ZnS and sulvanites TaCu3X4 (X = S, Se, Te). We further pare down this list for synthesis by selecting only single anionic compounds, removing compounds with toxic and highly reactive elements, and estimating p-type dopability. A refined list of ten top experimentally-favorable candidates emerges and includes spinel ZnAl2S4, distorted rocksalt BaSnS2, and several other rocksalt structures.

We delve deeper into the bonding characteristics of the valence band that give each predicted candidate its low calculated effective mass, and discuss these computed structures and our screening metrics in the context of state-of-the-art p-type and n-type transparent conductors. Additionally, we discuss defect calculations and dopant selection for the most promising structures, present our initial attempts to combinatorially synthesize and characterize a few of the candidates, and lay out a roadmap for a future high-throughput screening, synthesis, characterization, and device paradigm for new p-type transparent conducting chalcogenides.

Development of two-dimensional materials, including graphene and 2D transition metal dichalcogenides (TMDs), has greatly advanced. For example, engineered defective structures are of interest, where graphene meshes were used for sensing, while defective monolayer TMDs exhibited single-photon emission, potentially useful for quantum information processing. Here, we first discuss the theoretical prediction of defect-induced Raman signatures in graphene by a combined first principles-tight binding approach, to be integrated within a data-driven experimental system for defect engineering. Our predictions of D and D’ Raman band intensities demonstrated that it is possible to distinguish between defect types, which also assists in characterization of realistic materials. Next, we note that to overcome limitations in photon-extraction efficiency and integration within photonic circuits when using bulk solid-state materials, the 2D geometry emerged as potentially useful as a single-photon source. In aiming to achieve localized excitons in monolayer WSe₂ due to defects, we found theoretically that calculated defect excitons red-shift significantly for experimentally observed patterns. However, although this computational analysis will inspire experimental defect engineering, materials informatics could uncover further improvements. Yet, although development of databases of 2D materials beyond graphene is progressing, so far the focus is on discovery of materials with low exfoliation energies. We provide a perspective on database development and machine learning for 2D materials with defects.

Applications of inorganic scintillators—activated with lanthanide dopants, such as Ce—are found in diverse fields. As a strict requirement to exhibit scintillation, the 4f ground state (with the electronic configuration of [Xe]4f^{n} 5d⁰) and 5d₁ lowest excited state (with the electronic configuration of [Xe]4f^{n-1}5d¹) levels induced by the activator must lie within the host bandgap. This talk will discuss a new machine learning (ML) based screening strategy that relies on a high throughput prediction of the lanthanide dopants’ ground and excited state energy levels with respect to the host valance and conduction band edges for efficient chemical space explorations to discover novel inorganic scintillators [1]. Building upon well-known physics-based chemical trends for the host dependent electron binding energies within the 4f and 5d₁ energy levels of lanthanide ions and available experimental data [2,3], the developed ML model can rapidly and reliably estimate the relative positions of the activator's energy levels relative to the valance and conduction band edges of any given host chemistry. Using a set of perovskite oxides and elpasolites (a class of double perovskite halides) as examples, it will be demonstrated that the developed approach is able to (i) capture systematic chemical trends across host chemistries and (ii) effectively screen promising compounds in a high-throughput manner. While a number of other application-specific performance requirements need to be considered for a viable scintillator, the present scheme can be a practically useful tool to systematically down-select the most promising candidate materials in a first line of screening for a subsequent in-depth investigation.


[1] G. Pilania, K. J. McClellan, C. R. Stanek, and B. P. Uberuaga, J. Chem. Phys. 148, 241729 (2018).
[2] P. Dorenbos, Phys. Rev. B 85, 165107 (2012).
[3] P. Dorenbos, J. Lumin. 151, 224 (2014).

A number of proposals have been put forward to describe the properties required to improve the efficiency in organic solar cell. The number of experimental data available allow an evaluation of these proposal in a strict statistical sense, e.g. a good sampling of the space of the experiment can provide support to a given physical hypothesis. Alternatively, one can abandon any hope of physical insight and use a battery of machine learning approaches trying to correlate descriptor and photovoltaic efficiency. This lecture compares the two approaches and consider two specific problems (i) identification of high efficiency electron-acceptor and (ii) identification of high efficiency electron-donors.

[1] Alina Kuzmich, Daniele Padula, Haibo Ma, Alessandro Troisi, Trends in the electronic and geometric structure of non-fullerene based acceptors for organic solar cells, Energy and Environmental Science, 2017,10, 395-401
[2] Harikrishna Sahu, Weining Rao, Alessandro Troisi,and Haibo Ma, Towards Predicting Efficiency of Organic Solar Cells via Machine Learning and Improved Descriptors, Advanced Energy Materials (in press 2018).

The convergence of high-throughput computing, automation, and machine learning is poised to disrupt traditional fields including medical diagnosis, investment banking, legal discovery, and shipping. In this talk, I’ll discuss the potential impacts these technologies may have on energy materials development RD&D within the next ten years, using my background in photovoltaics (PV) as a testbed, and emphasizing future applications in other applications.

Across many disciplines, it historically takes 15–25 years to bring a new material to market, in part because of the lengthy and inefficient feedback loop linking material, process, and characterization. We have successfully combined high-throughput computing, Bayesian inference, and a non-destructive test (a variant of traditional current-voltage measurements) for PV devices, to reduce the diagnosis time for novel devices by 10–100x, often with an increase in precision. We have recently begun expanding this methodology to other energy systems with collaborators, including thermoelectrics. Already, this diagnostic technique has enabled progress toward a closed process optimization feedback loop. In the future, in combination with machine learning and automation, it may be possible to reduce the timeline to novel materials development to 3–5 years, within the time horizon for value capture of most investors.

Robotics and autonomous systems require formal knowledge representations of the environment they function in, the entities they operate with, and the processes they are involved with. I will discuss knowledge representations for the robot scientists ‘Adam’ and ‘Eve”. These robotic systems are designed to run (semi-) autonomous biomedical experiments. Adam was the first system to autonomously discover new scientific knowledge, and Eve has identified potential drugs for treating neglected tropical diseases. The underpinning technology of robot scientists is transferable to other application domains. I will present several ontologies, the Eve ontology for the description of Eve experiments, the EXACT ontology for the description of experimental protocols, etc. I will also demonstrate the importance of such formal knowledge representations of complex systems using the example of AdaLab, a (semi-) autonomous system for knowledge discovery. AdaLab is based on the robot scientist Eve, and includes several distributed Machine Learning components for hypotheses generation, experiment planning, and refining systems models. The interaction between AdaLab components and interpretation of the experimental results relies on underpinning knowledge representations. The AdaLab system has the potential to advance biomedical knowledge.

The use of machine learning techniques to expedite the discovery and development of new materials is an essential step towards the acceleration of a new generation of domain-specific highly functional material systems. In this paper, we use the test case of bulk metallic glasses to highlight the key issues in the field of high throughput predictions and propose a new probabilistic analysis of rules for glass forming ability using rough set theory. We demonstrate the use of automated machine learning methods that go far beyond text recognition approaches by also being able to interpret phase diagrams. When combined with structural descriptors, this approach provides the foundations to develop a hierarchical probabilistic predication tool that can rank the feasibility of glass formation.

In the past decade, first-principles methods for high-throughput computational screening and design of new materials have proven to be effective and indispensable for various applications [Curtarolo et al. Nature, 2013; Curtarolo et al. Phys. Rev. Lett. 2003]. Moreover, the design and optimization of novel materials has been transformed by the emergence of genomic approaches, where materials properties of many tens of thousands of materials can be modeled, catalogued in searchable databases, and analyzed for trends.
However, knowing the structure and properties of a novel material is not enough for its successful production. Often, even knowing what material to make, an obstacle emerges how to make it, which results in the slow and tedious experimental process of trials and errors due to high complexity of materials synthesis procedure. Therefore, predicting conditions under which a specific compound or crystal structure can be synthesized is an unresolved and fundamental problem in materials science, which imposes significant constrains on facile design and production of novel advanced materials. Yet, no any universal theory of synthesis exists which would relate synthesizability of materials and their obtained and computable parameters.
In our work, we approach the predictive synthesis problem by trying to answer the question how well synthesis can be learned from existing data. To address it, we developed a data mining pipeline which extracts information about synthesis of inorganic compounds from available scientific publications using machine learning techniques. The most important steps of pipeline include: i) collecting of research articles available on-line, ii) extraction of experimental sections and identification of paragraphs describing ceramics synthesis, iii) extraction of so-called “codified recipes” of the synthesis procedures, iv) accumulating all recipes in the database and their mining.
In this work, we focused specifically on solid state synthesis of materials and used various natural-language processing [Collobert el al. J. Mach. Learn. Res. 2011] techniques to a) find relevant synthesis paragraphs, b) resolve materials entities referring to starting compounds, environment and final products, yet to c) obtain synthesis operations and firing temperatures. As a preliminary result of our work, we extracted 17,500 papers describing solid state synthesis procedure and obtained ~16,000 unique codified recipes. We analyzed these recipes using deep learning algorithms to relate materials features and their synthesis conditions. Our results present a first step toward predictive synthesis theory, and provide insights into further development.

Polymer nanocomposites have great advantages in achieving improved performance with relative low cost compared with traditional materials. By integrating material science, informatics and information technology, efforts on Material Genome Initiative (MGI) have produced different database infrastructures, material data schemas and ontologies as well as material design tools across different material fields including polymer nanocomposite materials. Under the concept of MGI, we have developed a nanocomposite data resource: NanoMine, which consists an online material database, data-driven analysis tools and physics-based simulation tools for polymer nanocomposite data sharing, analysis and design. To appropriately capture the full suite of possible data for nanocomposites, a nanocomposite schema is designed and served as the templates to ingest data from scientific literatures and in-house experiments. The data schema consists six major sections: data source, materials, processing, characterization, property and microstructure. The current database population and curation mainly relies on the manual data abstraction from scientific literatures by humans with expert knowledge, which is an expensive, labor-intensive and error-prone process.
In order to accelerate the data curation, reduce the possible errors and provide more insights on nanocomposite material synthesis, we take a step toward fully automated data extraction by applying recent machine learning and natural language processing methods and develop an end-to-end framework to extract material processing and synthesis information from full-length journal articles. Our method starts from building a paragraph classifier which is able to select the relevant paragraphs containing the material processing information from the whole paper. Then, individual sentences from those relevant paragraphs are further classified into different categories (e.g., material characteristics, experimental action, irrelevant information etc.) using a hierarchical attention neural network based on their semantic meanings. The network is trained on a set of over one hundred human annotated literatures created by material scientist while reading through the material synthesis sections. Lastly, the learning from the attention network is combined with the outputs from grammar parser and different heuristic rules are applied in order to extract the material processing actions and parameters. The extracted material processing steps and parameters are then postprocessed in order to create a machine readable and compatible data structure (XML in our case) so that the data is ready to be populated to the database.

The majority of all materials data is currently scattered across the text, tables and figures of millions of scientific publications. We present recently developed natural language processing and machine learning techniques to extract materials knowledge by textual analysis of the abstracts of several million journal articles. We describe our use of Word2Vec to map words in our corpus to vector representations, which we then use as inputs to named entity recognition (NER) classifiers to extract materials, structures, properties, applications, synthesis methods, and characterization techniques from the abstracts in our database. With this information, we have created new tools for materials literature review such as: searching within chemical systems, filtering articles by experiment/theory, summarizing the known attributes of a material, or finding similar materials to a target. Furthermore, we report how these techniques can be used not only to automatically summarize existing knowledge, but enable new ways of discovering novel materials such as thermoelectrics or ion-conductors by revealing previously undiscovered relationships between materials and their properties.

A Robot Scientist is a physically implemented robotic system that applies techniques from artificial intelligence to execute cycles of automated scientific experimentation. A Robot Scientist can automatically execute cycles of hypothesis formation, selection of efficient experiments to discriminate between hypotheses, execution of experiments using laboratory automation equipment, and analysis of results. The motivation for developing Robot Scientists is to better understand the scientific method, and to make scientific research more efficient. The Robot Scientist ‘Adam’ was the first machine to autonomously discover scientific knowledge: it formed and experimentally confirmed novel hypotheses. Adam worked in the domain of yeast functional genomics. The Robot Scientist ‘Eve’ was originally developed to automate early-stage drug development, with specific application to neglected tropical disease such as malaria, African sleeping sickness, etc. More recently we have adapted Eve to work on yeast systems biology, and cancer. We are also teaching Eve to autonomously extract information from the scientific literature.

We have developed a first-of-its-kind Autonomous Research System, ARES, capable of designing, executing, and analyzing its own experiments autonomously using artificial intelligence (AI) and Machine Learning (ML). The closed loop, iterative method enables ARES to design new experiments based on prior results dynamically, after each experiment; a first for materials research.

We are applying this method to understand and control the synthesis of single wall carbon nanotubes, in this case optimizing growth rate in (7) - dimensional parameter space. We use automated in situ Raman spectroscopy characterization of growth rate for CVD synthesis of carbon nanotubes as a metric for a target objective used by our AI planner. We use a random forest learning approach which models experimental results, and a genetic algorithm planner to propose new experiments expected to achieve the targeted growth rate.

We expect ARES to be a disruptive advance in the near future, combining advances in robotics, AI, data sciences and operando methods to enable us to attack high dimensional research problems that were previously intractable by current research processes. We are applying the ARES method to multiple problems, including Additive Manufacturing and defect engineering in graphene. Human-robot research teams have to potential to redefine the research process and lead to a Moore’s Law for the speed of research.

Additive manufacturing presents numerous possibilities for design due to the high level of control afforded by the 3D fabrication processes. However, each new design choice introduced by the flexibility of the processing represents a decision that could have important implications on performance. While structures can be optimized for many types of mechanical performance, improving failure properties is particularly challenging due to the stochastic nature of failure and the difficulty in reliably predicting the influence of the microstructure introduced by processing. Here, we explore the degree to which machine learning can guide physical experimentation to produce tough 3D-printed structures in as few experiments as possible. Specifically, we present an experimental optimization of a parametric structure to maximize specific toughness as a model figure of merit that is central to the realization of energy-absorbing structures. Utilizing Bayesian optimization with Gaussian process regression, the mechanical performance of each new design is predicted based on previous experiments in order to continuously predict the optimal design with all available data. Of particular importance, we study the influence of the decision policy, or the algorithm by which subsequent experiments are selected, on convergence to an optimum design. We investigate the effectiveness of policies such as pure exploration, expected improvement, maximum variance, and Bayesian D-optimality in optimizing specific toughness. These approaches are benchmarked against classical design of experiments. The application of these machine learning approaches to an experimental system forces the accommodation of real-world artifacts such as defects introduced through printing, variability between printers, and the stochastic nature of failure. In addition to aiding in the development of high-performance materials and structures, the lessons described will assist in the selection of decision policies for broader classes of experimental optimizations in a manner that facilitates the convergence of machine learning, physical experimentation, and design.

As with most advanced manufacturing (AM) systems, analysis of AM sensor data currently occurs post-build, rendering process monitoring and rectification impossible. Supervised machine learning offers a route to convert sensor data into real-time assessments; however, this requires a wealth of labeled sensor data that traditionally is too time-consuming and/or expensive to assemble. In this work, we solve this critical issue in a variety of AM systems. We develop and implement machine learning (ML) algorithms for the purposes of automated quality assessment and, in some cases, rectification. We discuss ML-based algorithms capable of automated detection in a host of AM technologies such as Laser Powder Bed Fusion and Direct Ink Write and also microfluidic platforms that are used for feedstock production. The common thread within these systems is that routinely collected sensor data (e.g. high-speed video, pressure gauges, etc.) contains pertinent information about the state of the system that can be converted into actionable information in real-time via ML. Successful implementation of these machine learning algorithms will reduce time and cost during process by automating quality assessment and lead to process control.


This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344.

Many new materials have been suggested, either by first principles theory or by heuristic inference, as having critical enabling properties for technologies such as Li-ion batteries, transparent conductors, and photochemical energy capture. Yet theory has not provided adequate guidance regarding the conditions, if any, under which they can be synthesized. Traditional synthesis of novel compounds often involves laborious and slow manual iterative exploration of composition and processing space. We are radically transforming the ability to identify and synthesize new materials using innovative AI-based strategies for reasoning and conducting science, including the representation, planning, optimization, and learning of materials knowledge. The logical structure of our approach, SARA (Scientific Autonomous Reasoning Agent), is based on a community of software agents that cooperatively generate hypotheses and autonomously test them through autonomous execution of the materials discovery/development process, and is enabled through concomitant development of robotic processing and characterization tools, on-the-fly DFT calculations, and AI-based algorithms. Our approach is further augmented with human insights so that the artificial intelligence leverages the human intelligence of expert scientists, creating an unprecedented platform for human-machine collaboration. SARA includes methods and methodologies for the rational design of functional materials and for discovering the requisite synthesis parameters for both stable and metastable materials.

Synthetic biology is an emerging manufacturing method of materials and precursors, such as those typically derived from fossil fuels. However, controlling synthesis pathways to optimize product yield remains a significant challenge in process maturation and scale up. Current strategies rely on laboratory experimentation. Depending on the design of experiments, this can be time and resource intensive, and results are not guaranteed. A metabolic synthesis pathway is typically a multistep process with dozens of degrees of freedom, such as cofactor concentrations and homologue variants. This describes a parameter space intractable to exhaustively explore through experiments. Machine learning provides a means to intelligently and efficiently explore this parameter space by building and optimizing models which describe the synthesis process and guide state-of-the-art cell-free experiments. We adapted principles from our previous work on the Autonomous REsearch System (ARES) in which an autonomous system iteratively performed experiments, analyzed results, and applied machine learning models to automatically design and execute a new set of experiments, drastically reducing the experimental time needed to optimize a chemical synthesis process. Here, we applied our approach to synthetic biology pathway modeling and optimization. We used two machine learning approaches – neural networks and parameter-fit ordinary differential equations (ODEs) – to build models of a 5-step metabolic process for butanol production. These models were used to inform a series of cell free experiments, resulting in a 3-fold improvement in butanol yield over prior trial-and-error experimentation. We found a trade between model interpretability and optimization ability: The ODEs required very little initial information and were interpretable, but fell short of the neural networks’ ability to suggest optimized conditions.

At the interface of two semiconductors, where bulk band structures merge into each other, an electronic transition region forms, with band-edge discontinuities that are confined to not more than a few atomic layers near the interface. These discontinuities, also known as valence- and conduction-band offsets, naturally occur at the interface of materials with different band gaps. While their signs decide whether the interface acts as a barrier or conductor for electrons or holes, their magnitudes determine how good of a barrier/conductor the interface is. Such heterojunctions are at the heart of many modern semiconductor devices with tremendous societal impact: Light-emitting diodes shape the future of energy-efficient lighting, solar cells are promising for renewable energy, and photo-electrochemistry seeks to optimize efficiency of the water-splitting reaction.

Unfortunately, design of heterojunctions, e.g. to find optimal electron- and hole-transport layers for new active-component materials, is difficult due to the limited number of materials for which band alignment is known and the experimental as well as computational difficulties associated with obtaining this data. At the same time, the dependence of band alignment on intrinsic properties of the involved materials turns the design of heterojunctions with specific alignment into an interesting materials-design or materials-selection optimization problem. In order to tackle this problem, we show that band alignment based on branch-point energies is a good and efficient approximation that can be obtained exclusively using data from existing electronic-structure databases. To this end, we shows that errors associated with this approach are comparable to those of expensive first-principles computational techniques as well as experiment.

We then incorporate branch-point energy alignment into a framework that is capable of rapidly screening existing online databases to design semiconductor heterojunctions. We showcase our technique for different prototype cases, including successful predicitons of electron- and hole transport layers for CdSe- and InP-based LEDs as well as for novel CH3NH3PbI3- and nanoparticle PbS-based solar absorbers. From our results we show that our framework addresses the challenge of accomplishing fast materials selection for heterostructure design by tying together first-principles calculations and existing online materials databases. We show that it can be used to directly design desired semiconductor heterostructures, or, at least, to reduce the vast candidate search space.

The study of gas adsorption in microporous solids is vitally important for addressing the crises facing modern society including climate change (carbon dioxide capture) and energy production (hydrogen storage). Whilst databases of possible materials[1] and software for performing Grand Canonical Monte Carlo (GCMC) simulation of these[2] have been created, to date there is no framework for performing the fully autonomous computational screening of these materials.

In this contribution we present a freely available software package, GCMCWorkflow [3], which allows fully autonomous computational modeling of materials in a reliable, repeatable and reproducible way. The package is built upon the Fireworks[4] package and acts as a controller of existing GCMC tools, in this case Raspa[5].

Building upon previous work into the quantification of uncertainty of these simulations and what constitutes “enough” sampling[6], the package is able to adaptively start more simulations as required to achieve the defined sampling. Other features such as restarting simulations after crashes and the massively parallel scale enabled by Fireworks allows GCMCWorkflow to make performing large scale screening on high performance computing clusters far less user intensive.

Finally we show how the abstraction layer this automation provides allows multiple GCMC simulations to be programmed into larger machine learning pipelines. In the first example we show how genetic algorithms can be used to derive force field parameters in a top down approach to match data gathered from experiments. In another example, we show how we can search for adsorption capacities of materials where the exploration of sampling space is automated through data-driven algorithms.

References:

[1] Yongchul G. Chung et al. (2014) Computation-Ready, Experimental Metal–Organic Frameworks: A Tool To Enable High Throughput Screening of Nanoporous Crystals, Chemistry of Materials, 26 (21), pp 6185–6192 DOI: 10.1021/cm502594j

[2] David Dubbeldam et al. (2013) On the inner workings of Monte Carlo codes, Molecular Simulation, 39:14-15, 1253-1292 DOI: 10.1080/08927022.2013.819102

[3] Richard J. Gowers (2018) GCMCWorkflow https://github.com/richardjgowers/GCMCworkflow DOI: 10.5281/zenodo.1289897.

[4] Anubhav Jain et al. (2015) FireWorks: a dynamic workflow system designed for high throughput applications, Concurrency Computat.: Pract. Exper., 27: 5037–5059. DOI: 10.1002/cpe.3505

[5] David Dubbeldam et al. (2015) RASPA: molecular simulation software for adsorption and diffusion in flexible nanoporous materials, Molecular Simulation, 42:2, 81-101 DOI: 10.1080/08927022.2015.1010082

[6] Richard J. Gowers et al. (2017) Automated analysis and benchmarking of GCMC simulation programs in application to gas adsorption, Molecular Simulation, 44:4, 309-321 DOI: 10.1080/08927022.2017.1375492

Artificial intelligence (AI) is beginning to show significant potential for accelerating research in materials science and engineering. In particular, single-particle three-dimensional (3D) reconstruction of cryo-electron microscopy (cryo-EM) images using machine learning computer algorithms has recently emerged as a powerful tool in structural biology for revealing high-resolution information of biological structures, including virus, protein, and DNA assemblies. However, to the best of our knowledge such AI-based approaches have not yet been successfully applied to synthetic materials discovery. In this contribution, we describe how such machine learning approaches resulted in the discovery of an ultrasmall (~10 nm diameter) dodecahedral silica nanocage, or ‘silicage’ [1].

In the study, tens of thousands of single-particle cryo-EM images were collected on early formation stages of surfactant self-assembly directed silica nanostructures. However, the well-defined structures could not be identified from regular TEM and cryo-EM observations. In contrast, feeding the cryo-EM images into machine learning algorithms for single-particle 3D reconstruction revealed a previously unidentified dodecahedral silica cage. The dodecahedron is the highest symmetry structure of the five Platonic solids known since antiquity and extensively studied by the ancient Greeks. Details of the reconstruction provided insights into possible formation mechanism of these cages around self-assembled surfactant micelles. Cage structures were not limited to silica, but were also observed from other materials including metals and transition metal oxides. Such materials may find a plethora of applications in areas including catalysis and nanomedicine. This discovery, facilitated by artificial intelligence, not only provides novel insights into the fundamental understanding of molecular self-assembly, but also paves the way for the search of related structures with different symmetry and from different materials.

[1] K. Ma, Y. Gong, T. Aubert, M. Z. Turker, T. Kao, P. C. Doerschuk, U. Wiesner, Nature 2018, in press.

In this talk, I will describe our group's efforts to build a general framework for performing data mining on materials properties based on structure and composition. I will introduce matminer (https://hackingmaterials.github.io/matminer/), an open-source code capable of extracting materials data, generating thousands of crystal structure and compositional descriptors, and quickly reproducing and extending existing machine learning studies. I will demonstrate how new structural features implemented in matminer based on local environment can be used for machine learning and classification. I will also describe our group's effort to create a "black-box" machine learning model that can be applied to any property and that can be used as a benchmark comparison for machine learning efforts. Finally, I will describe multiple applications, including the prediction of electronic properties, bulk metallic glass behavior, and an effort to learn the properties of materials from unstructured text.

The high throughput exploration of materials space has been recognized as a new paradigm in materials design and discovery. However, typical high throughput exploration methods deliver high dimensional datasets that pose the challenge of extracting the key features and trends that could guide the discovery process. To address this challenge, we develop data analytics tools to extract irreducible representation of the high throughput exploration data.

We develop computational tools to perform feature extraction from high throughput electro-chemistry experiments. We leverage non-linear dimensionality reduction techniques to project a high dimensional set of cyclic voltammetry (CV) experiments into a lower dimensional space. The main advantage of our approach is the mathematically rigorous extraction of the inherent dimensionality of a given data set. This is in contrast to the traditional Engineering Figure of Merit used to interpret CV curves. To demonstrate the performance of our approach, we analyze CV curves for a compositional library of perovskies devices subjected to a series of various electrochemical tests. Each device's current response to cyclic voltammetry test is recorded over several time points (considered as dimensions from here on). In all these cases, we discovered the inherent dimensionality to be as low as 3 (comparing to input 4200 dimensions) with over
90% variance explained. Moreover, we observed a strong compositional dependency of the current responses. Finally, we unraveled the dominant structure hidden in the data as belonging to two types of manifolds regardless of the noise present in the data.

Our method has capability to inform the iterative design process of linking theory, modeling, and experiments for improvement and acceleration of materials design.

The creation of hybrid organic-inorganic perovskite thin films is frequently made in solution to promote energy-inexpensive sustainable processing. Unfortunately, the inclusion of solvent molecules greatly increases the computational expense during simulations of the solubilization and subsequent crystallization of said thin films. Implicit solvation models represent a solvent as a continuous medium instead of individual atomically “explicit” solvent molecules, and are commonly used in order to allow for larger-scale studies of solvent-solute interactions in DFT. The Joint Density Functional Theory (JDFTx) is a Density Functional Theory (DFT) software written by Prof. Tomás Arias (Physics, Cornell). JDFTx specializes in its implementation of solvation models, such as the charge-asymmetric nonlocally-determined local-electric solvation model (CANDLE), which has been shown to be particularly efficient and accurate [R. Sundararaman et al., 2014].

Despite the efficiency and accuracy of the model, the solvent parametrization process is tedious. We are working to apply an automated Bayesian Optimization algorithm towards parametrization of CANDLE Models on other organic solvents. This novel approach, as applied to molecular simulations, will make the parametrization process more readily accessible to the scientific community at large. Bayesian Optimization searches for the best combination of the parameter set to maximize an objective function, which is set to be the mean absolute error (MAE) between the experimental solvation energy and the calculated solvation energy of a set of solute molecules. To allow for robustness, solute molecules studied include neutral, anionic, and cationic species.

We present an open-source code SMACT[1] to perform rapid screening of known and hypothetical materials. It combines elemental descriptors and chemical heuristics to navigate large numbers of compounds, which can be fed into machine learning procedures or other materials design workflows.

Forming a four-component compound from the first 103 elements of the periodic table results in more than 10^12 combinations. Such a materials space is intractable to high-throughput experiment or first-principles computation. We introduce a framework to address this problem and quantify how many materials can exist. We apply principles of valency and electronegativity to filter chemically implausible compositions, which reduces the inorganic quaternary space to 10^10 combinations [2]. We demonstrate that estimates of bandgaps and absolute electron energies can be made simply based on the chemical composition and apply this to search for new semiconducting materials to support the photoelectrochemical splitting of water [3].

The applicability to crystal structure prediction by analogy with known compounds is shown, including exploration of the phase space for ternary combinations that form a perovskite lattice. Computer screening reproduces known perovskite materials and predicts the feasibility of thousands more. Due to the simplicity of the approach, large-scale searches can be performed on a single workstation. For example, we have been able to assign likely crystal structures to all hypothetical quaternary oxide compositions produced by SMACT, constituting a database of over 2 million compounds. The stability and properties of these compounds are then assessed methodically using high-throughput workflows for first-principles calculations.

1. https://github.com/WMD-group/SMACT
2. D. W. Davies et al, Chem, 1, 617 (2016)
3. D. W. Davies et al, Chem. Sci., 9, 1022 (2018)

Predicting the glass forming ability of metallic alloys is an active area of research due to the many existing and potential uses of metallic glasses. Many descriptors accounting for the thermodynamics and kinetics of the vitrification process have been proposed to quantify the likelihood of glass formation for an alloy. A particularly widely used class of descriptors involve simple functions of the glass transition temperature (T_g), the liquidus temperature (T_l), and the crystallization temperature (T_x). The descriptors we focus on in this work include T_rg = T_g/T_l, γ = T_x/(T_g + T_l), and ω = T_g/T_x - 2T_g/(T_g + T_l). It is of interest to predict these descriptors quickly for new alloy systems. We note that these transition temperatures are also of interest in their own right, separate from their ability to predict glass forming ability, as they control important design properties of alloys. Accurately predicting these transition temperatures could also prevent the need to first make a glass to calculate the value of any of the descriptors. In this work we have used a random forest machine learning method to model these descriptors as a function of simple elemental properties. We used two approaches to model the value of the glass forming descriptors. First, we modeled T_rg, γ, and ω directly. Second, we modeled the transition temperatures and used the resulting predictions to calculate the glass forming descriptors. Interestingly, the latter approach was significantly more accurate. In addition to predicting the glass forming descriptors, we assessed the applicability of the model in various compositional domains by examining the error and uncertainty on predictions of alloys with varying degrees of representation in the training data set.

In this study, we describe a computational approach where we ingrain the underlying theoretical constructs behind these and subsequently use the underlying physical descriptors to expand and extend the database of known catalytic reactions. To this end, we use spectral clustering methods to identify key physical regimes underlying volcano plots by using the volcano plot for ammonia synthesis rate as a function of nitrogen adsorption energy as our case study. The application of dimensionality reduction techniques and graph networks to these catalytic systems is illustrated by applying to elemental and binary transition metal alloys to predict the positions of these systems on volcano plots.

Materials science is undergoing profound changes, driven by continual improvements to instrumentation that have resulted in an explosion in the data volume, dimensionality, complexity, and variety, in addition to increased accessibility to high-performance computing (HPC) resources, and more sophisticated computer algorithms. These changes are especially prominent in the functional imaging of materials. However, the current software typically do not provide access to advanced or user-defined data analysis routines, and store measurement data in proprietary file formats. These proprietary software and file formats not only impede data analysis but also hinder continued research and instrument development, especially in the era of “big data”. Therefore, moving to the forefront of data-intensive materials research requires general and unified data curation and analysis platforms that are HPC-ready and open source.

We have developed a free and open-source python package called Pycroscopy for analyzing, visualizing and storing data. Pycroscopy is freely available via popular software repositories, and therefore lifts any financial burden for interrogating data. Pycroscopy describes data in an instrument-agnostic structure that allows it to represent data of any size, dimensionality, or complexity acquired on a regular grid of positions or random positions as in compressed sensing. This data model is stored in open hierarchical data format files (HDF5) that can be interrogated using any programming language, scale well from kilobyte to terabyte sized datasets, and can readily be used in HPC environments unlike proprietary data formats. As a consequence, Pycroscopy-formatted data files are curation-ready and therefore both meet the guidelines for data sharing issued to federally funded agencies and satisfy the implementation of digital data management as outlined by the United States Department of Energy. The generalized data format allows data processing and analysis algorithms to be generalized in-turn allowing a single version of the algorithm to be applied to data collected from instruments from different brands or even modalities. The simple structure and comprehensive documentation in pycroscopy enable even novice programmers to easily translate physical or chemical problems into computational problems. Unlike many other open-source packages that focus on analytical or processing routines specific to an instrument, the general definition of the Pycroscopy data format can be readily adopted for different microscopy techniques. Furthermore, the generality of Pycroscopy provides material scientists access to a vast and growing library of community-driven data processing and analysis routines that far exceed those provided by instrument manufacturers and are desperately needed in the age of big data. This research was conducted at the Center for Nanophase Materials Sciences, which is a US DOE Office of Science User Facility.

In order to improve the magnetic properties of the compounds forming the main phase of the soft-magnetic materials, we study the magnetization (M_s) and the magneto-striction constant (λ₀₀₁) of ternary alloy compounds consisting of 3d transition-metal elements by using the first principles calculation and the machine learning technique.
First we prepare totally 1393 training data using first-principles calculation for bcc/fcc-(Fe,Co,Ni)-based ternary compounds. We obtain 36 promising compounds after manual screening of 1393 compounds under several conditions such as | λ₀₀₁ | < 2 x 10^-5.
We expect magnetic permeability (μ) of these compounds is large due to a correlation between μ and λ₀₀₁.
Next we classify the calculated 1393 data by using the machine learning technique. We use new descriptors based on the Voronoi-polygons, in addition to the common descriptors for materials informatics, such as lattice constants, ionization energy, atomic angular momentum L, S, J. Nonlinear regression with a Gaussian kernel and sparse modelling accurately reproduces the values M_s of 1393 compounds. The relevant descriptors for prediction of M_s are L, S, J and Voronoi volumes. On the other hand, prediction of λ₀₀₁ is poor at present, some new descriptors may be necessary.
We demonstrate how the first-principles calculation and the regression-based model selection technique can be utilized for classifying new materials.

Over the past few decades, the Kohn-Sham scheme of density functional theory (KS-DFT) has become the customary method to probe solid-state properties of materials. Despite its preeminence, the computational cost of this methodology renders it intractable for large-scale calculations involving thousands/millions of atoms. The simulation of mesoscale properties of polymers is one such example where this limitation is most apparent. Here we propose a method to accurately predict charge densities of organic systems (both molecules and polymers) by learning from pre-calculated examples of smaller systems. We start with creating a database of organic compounds which cover a wide range of configurational and bonding environments. Further, we introduce a novel fingerprinting scheme which maps the charge density to the local atomic environment using deep neural networks. The model thus obtained is systematically improved (both in terms of accuracy and transferability) by selectively training on poorly predicted local environments encountered in new configurations. Following the proposed methodology, we develop a robust model that can rapidly predict the charge density of large organic systems. This charge density can then be used as input to orbital free density functional theory scheme to swiftly access a broad range of materials properties, thus bypassing the need to explicitly solve the Kohn-Sham equation.

We introduce an integrated computational chemistry/ informatics approach to accelerate the design and discovery of new complex materials. Our approach involves coupling topological data (TDA) analysis classification methods with Hirshfeld Surface Analysis (HSA). 3-dimensional Hirshfeld surfaces, encode both chemical bonding and molecular geometry information; while TDA captures the “shape” of data in a multiscale manner to probe for hidden correlations between crystallographic structure and electronic structure. When applied collectively, we show how new classifications and insights into crystal chemistry can be revealed.

Recently, fast material development and design is highly in-demand due to the needs of high performance materials. Microstructure-property relation, a key in material development, has long been investigated qualitatively. For example, controlling crystal structure and crystal size can manipulate material strength and anti-corrosion properties in alloys. To achieve highly-efficient experimental planning such as process tuning and controlling trade-off of multiple properties, the quantitative and large volume of datasets of microstructure-property relation is required. However, a method that accurately and automatically provide microstructure features in a short time is still a challenge.
For alloys, the microstructure i.e. crystal phase and orientation, is usually evaluated by electron back-scattered diffraction (EBSD) measurement [1]. The measurement needs highly-skilled technicians and long time limiting the automation for lots of samples. Backscattered electron (BSE) images acquired from scanning electron microscope (SEM) also provide crystal information. Using Z-contrast in BSE images, crystal phase information can be simply obtained due to different average atomic density [2]. In comparison to EBSD, using BSE images is promising since it can be acquired within few minutes and easy to operate. Hence, an approach to realize microstructure-property using BSE images should be considered.
In this research, we propose a method to utilize microstructure features in alloy from BSE images. By applying machine learning i.e. DNN-based segmentation, microstructure features, such as the amount of each phase present are extracted and are used for evaluation of microstructure-property relation. We evaluated the relation of microstructure and mechanical properties in Cr-duplex alloy. In addition, we study the detail of preparation of training data for the DNN-based segmentation under different measurement conditions of BSE images.
The result suggested that by applying DNN-based segmentation on BSE images of Cr-duplex alloy, accurate phase distinction was performed with 90% accuracy in average resulting in reliable extraction of microstructure features i.e. the amount of each phase. The extracted amount of each phase is well-agreed with the result of EBSD measurement. The relation of the microstructure features and mechanical properties such as Vickers hardness, abrasion loss, and 0.2% yield strength of Cr-based duplex alloy was evaluated using regression model. Using the relation, prediction of the mechanical properties was performed and the error was less than 10%. From these results, we have demonstrated a method to utilize microstructure features from BSE images leading to fast and easy evaluation of microstructure-property relation in duplex alloy.
References
[1] A.J. Wilkinson et.al., Mater. Today 15, 9 (2012) 366.
[2] L. Reimer, Scanning Electron Microscopy, 2nd ed., Springer (1988).

The controllable incorporation of strain on materials merits unfold scientific and technological potential, yet poses a challenge of exploring the vast six-dimensional space of admissible elastic strains. Here we demonstrate that systematic machine learning can make the problem of representing electronic structure as a function of six-dimensional strain computationally tractable. Specifically, we develop a number of general methods for surrogate modeling of elastic strain engineering which, relying on a limited amount of data from ab initio calculations, can be used to fit the required properties with sufficient accuracy. In particular, an artificial neural network predicts the band structure within the accuracy of 19 meV in case of three-dimensional strain.

Mean field approach has been employed to consider random distribution of atoms in solid solutions [1]. The mean field approach, however, shows averaged characteristics of the solid solutions, and, therefore, cannot represent energetically favorable solid solutions. We studied Ce_0.75Zr_0.25O₂ solid solutions using genetic algorithm and density functional theory (DFT) [2]. Initial population, fitness function, selection, crossover, and mutation were varied in genetic algorithm to find an energetically favorable solid solution. In this study, we employed lattice dynamics to increase the calculation speed and to consider temperature effect. The increased calculation speed also allowed us to consider bigger systems. The bond strengths of the oxygen atoms in the favorable solid solution structure should vary because each oxygen atom is surrounded by Ce and/or Zr atoms differently; the oxygen atom with weak bond strength would be removed first under reducing conditions. We employed genetic algorithm again to find easily removable oxygen atoms in the solid solution under reducing conditions.

References
[1] G. Balducci, M. S. Islam, J. Kaspar, P. Fornasiero, and M. Graziani, Chem, Mater. 2003, 15, 3781.
[2] J. Kim, D.-H. Kim, J.-S. Kim, and Y.-C. Kim, Comput. Mat. Sci., 2017, 138, 219.

Spectroscopy is one of the most promising techniques to reveal atomic and electronic structures of material inside and surface. Among a variety of spectroscopy, core-loss spectroscopy using electron (ELNES) and X-ray (XANES) has nano- or sub nano-scaled spatial resolution and nano- or femto-scaled temporal resolution, enabling to analyze lattice defects and chemical reaction. However, interpreting ELNES/XANES spectra is not straightforward, and therefore comparing experimental spectra with those in database, namely, “experimental fingerprint”, has been generally used. While such a large database has been constructed, we often come across an unknown spectrum which isn’t contained by the database. To overcome the infeasibility of interpreting an unknown spectrum, theoretical calculation must be effective. Devoting a lot of effort enabled to calculate ELNES/XANES spectra of most of elements and atomic configurations, whereas calculating just single spectrum requires much computation time. Since the spatial and temporal resolutions of ELNES/XANES can generate a thousand of spectra in an experiment, such one by one “theoretical fingerprint” is impracticable. In that situation, utilizing the correlations between the spectra and atomic information discovered from the database can be an alternative method.
Here, we developed a new interpretation approach based on machine leaning which can deal with a big data and be implemented without the theoretical calculation.
First, a spectra database was constructed by the theoretical calculation. Then, hierarchical clustering was performed on the database, resulting in categorizing similar spectra into clusters. Spectral similarity was measured by cosine distance. Cutting the hierarchical tree at an arbitrary threshold makes some clusters of the spectra. We successively lowered the cutting threshold to each branch point, resulting in making two clusters at every branch point. At those branch points, we repeatedly implemented decision tree analysis considering the newly generated two clusters of the spectra as the training label and their structure information as the descriptors.
The queries of the constructed decision trees can provide the best (most characteristic) features for distinguishing each of the clusters. These features are also believed to be physically important, and detailed comparison of the two types of spectra in the clusters can endow the origins of the differences between these two types of spectra.
We applied this approach to approximately a lot of O-K edge ELNES spectra of SiO₂ polymorphs. The results will be discussed in my presentation.

We present a machine-learning approach to a long-standing issue in quantum many-body physics, namely, analytic continuation. This notorious ill-conditioned problem of obtaining spectral function from imaginary time Green's function has been a focus of new method developments for past decades including many numerical approaches; such as maximum entropy method [1,2], stochastic method [3], Pade approximation [4]. Here we demonstrate the usefulness of modern machine-learning techniques including convolutional neural networks and the variants of stochastic gradient descent optimizer. Machine-learning continuation kernel is successfully realized without any `physical domain knowledge' and the outstanding performance is achieved for both insulating and metallic band structure [5]. Unlike other methods, our method is additional parameter free fully automatic approach with no further human intervention. Our machine-learning-based approach not only provides the more accurate spectrum than the conventional methods in terms of peak positions and heights but is also more robust against the noise which is the required key feature for any continuation technique to be successful. Furthermore, the ML-based kernel is 10⁴-10⁵ faster than conventional analytic continuation algorithms and more robust to noise from Green’s function. Our approach to tackling ill-posed problems by statistical data-based ML shows the applicability of ML in other ill-posed physical problems.



[1] Jarrell, M. & Gubernatis, J. E. Bayesian inference and the analytic continuation of imaginary-time quantum Monte Carlo data. Physics Reports 269, 133–195 (1996).
[2] Bergeron, D. & Tremblay, A.-M. S. Algorithms for optimized maximum entropy and diagnostic tool for analytic continuation. Phys. Rev. E 94, 023303 (2016).
[3] Sandvik, A. W. Stochastic method for analytic continuation of quantum Monte Carlo data. Phys. Rev. B 57, 10287 (1998).
[4] Vidberg, H. J. & Serene, J. W. Solving the Eliashberg equations by means of N-point Padé approximants. J. Low Temp. Phys. 29, 179 (1977).
[5] Yoon, H., Sim, J.-H. & Han, M. J. Analytic continuation via ‘domain-knowledge free’ machine learning. ArXiv1806.03841 Cond-Mat Physics (2018).

Molecular dynamics simulation is a powerful tool to understand the underlying physics of dynamic behavior of materials. However, its application is greatly limited by the availability of accurate force fields. Here we demonstrate machine learning as a strong tool to combine the accuracy of first-principles density functional theory and low-cost MD simulations. By learning the database generated from density functional theory calculations, we are able to generate accurate and effective force fields. We will show a few interesting examples of our method for elemental materials and 2D materials where the generated force fields can capture both energetic and structural properties.

Numerical model of battery performance is indispensable for developing and optimization of battery materials and structures. Since Newman-model built one-dimensional model based on electrochemical reactions and ion transport, a numerical simulation to evaluate a charge/discharge characteristics as well as a capacity-voltage curve of lithium ion batteries have been widely applied in the field of battery research. It is difficult to know, however, all needed parameters in the model only from the experiments. Moreover, the induction of unknown parameters mostly depends on the experience of expert researchers. We have studied a numerical model for describing a charge/discharge characteristics of lithium air battery where the precipitation of discharged compound, lithium peroxide, on the surface of carbon is modeled in which the deposition rate and distribution on the carbon surface are considered as the parameters [1]. There are more than 20 parameters in this numerical model. It would takes a lot of time to obtain all of them only from the experiments. In this study, we inducted the parameters needed for the numerical model for describing the charge and discharge or capacity voltage curves of lithium ion and lithium air batteries using a machine-learning. Used learning method is the neural network (NN) that shows remarkable progress in the field machine learning. NN has a layered structure, and between layers are formed by multiply-add operation with a weighting factor. In this research, NN learnings is carried out to induct parameters used in the numerical model. Training-data (capacity-voltage or discharge-capacity curves) are generated by employing the numerical model calculation with various different input parameters. For instance, we constructed a deduction model using 24 charge using NN and discharge curves as a training set and confirmed the reasonable accuracy. In addition, we also check the accuracy for the induction of multiple parameters such are the reaction rate and temperature, etc. The accuracy of induction tends to depend on the number of kind of unknown parameters, the accuracy and their dependency on the detailed algorithm of NN will be presented and discussed. Consequently, machine learning is useful tool for quickly determination of unknown parameters in the numerical model that are sometimes difficult to measure directly.

[1] Wataru Yamamoto, Md. Khorshed Alam, Hiromitsu Takaba, ECS Transactions, 61(13) (2014) 55-61.

Thermoelectrics, which can convert heat into electrical power based on the Seebeck effect and vice-versa based on the Peltier effect can be a very useful alternative source of both electrical and thermal power. So far, machine learning approaches have only been used to predict promising new thermoelectric compositions from density functional theory calculations, building upon open-source databases towards the discovery of high performance materials. Further, high-throughput materials screening approaches are still rudimentary, limited by the lack of universally defined material and thermoelectric transport descriptors. Finally, rapid and accurate materials characterization that can directly measure these descriptors are arduous (for example, method of four coefficients) or do not exist. Our work discloses a rapid and accurate way to determine the material and transport descriptors of thermoelectric performance by feeding simple single-leg power-load experimental data to a Bayesian machine learning algorithm using Boltzmann transport theory. The accurate generalized forward model we have developed allows the use of Bayesian inference demonstrating its utility as an ideal machine-learning (ML) tool for material diagnostics. Employing only two input parameters (temperature gradient and external load resistance) and the observed power output, the Bayesian inference algorithm is able to extract thermoelectric parameters ranging from material-layer properties (Seebeck coefficient, electrical resistivity) to transport-layer characteristics (energy-dependent scattering parameter, band gap offset, etc.) as well as extrinsic contributions such as parasitic contact resistance. In addition, systematic error from measurement can also be identified and corrected. This is made possible since we have devised an experimental setup developed in-house that can generate temperature-dependent data for ML-enabled characterization. Hence, we are able to predict band and transport descriptors that can be measured directly using experiments for the first time. While these reveal the complex dynamics of scattering in thermoelectric materials, we envision that they will also provide universal screening criteria for high performance thermoelectrics in the near future.

Ab initio molecular dynamics (MD) is a powerful tool for accurately probing the dynamics of molecules and solids, but it is limited to system sizes on the order of 1000 atoms and time scales on the order of 10 ps. We present a scheme for rapidly training a machine learning (ML) model of the interatomic force field that approaches the accuracy of ab initio force calculations but can be applied to larger systems over longer time scales. Gaussian Process (GP) models are trained “on-the-fly”, with density-functional theory (DFT) calculations of the atomic forces performed whenever the model encounters atomic configurations sufficiently far outside of the training set. This active learning scheme includes a principled means of deciding when to run additional DFT calculations, accelerating the model's exploration of parameter space while reducing the time spent training the model. Furthermore, we demonstrate that additional ML models can be trained in parallel to predict other quantities of interest, including the ground state energy and charge density, making it possible to efficiently capture with ML the wealth of information provided by full DFT calculations. We demonstrate the flexibility of our approach by testing it on a range of single- and multi-component molecular and solid-state systems, including benzene, silicon, and silicon carbide.

In recent years, an inverse analysis that can predict materials with desired physical properties has attracted attention as a method that enables rapid design of materials [1].
Bayesian optimization is one of the approaches which efficiently design optimal materials [2]. For examples, numerous successful studies have been reported on Bayesian optimization in inorganic material design [3] and automatic laboratory robots [4]. However, although it is important for industries, there are only a few reports on Bayesian optimization in polymer design. In this study, to confirm the effectiveness of Bayesian optimization for polymer design, we performed the case study on the prediction of repeat unit of polymer with optimal glass transition temperature. To evaluate the number of trial and error for achieving optimal physical properties, a trial and error test was conducted using a known data set. Here, the prediction model was constructed by a part of prepared dataset, and the optimal polymer was explored for the rest dataset. The prediction model was made from the features of structural formulas [5] and the glass transition temperatures of polymers, by using Gaussian process regression. As the result, we found that the Bayesian optimization could significantly reduce the number of trial and error in the prediction of repeat unit of polymer, compared to the random search.

[1] A. Agrawal and A. Choudhary, APL Materials, 4, 053208 (2016).
[2] J. Snoek, et. al., Advances in Neural Information Processing Systems, 25, 2951 (2012).
[3] A. Seko, et. al., Phys. Rev. Lett. 115, 205901 (2015).
[4] D. P. Tabor, et. al., Nature Reviews Materials, 3, 5 (2018).
[5] T. Minami, Y. Okuno, MRS Advances. DOI: 10.1557/adv.2018.454.

Extending from the micron to the atomic scale transmission electron microscopy is a powerful research tool for structural and chemical analysis for materials research. The breadth of data collected simultaneously in the latest generation of scanning transmission electron microscopes presents challenges and opportunities for advancements in microscopy, multi-modal data analytics, image-based forensics, and materials research. Recent advancements in deep learning have made it possible to analyze these massive data sets and perform complex imaging tasks. However, deep learning and augmented analysis have not yet disrupted the microscopy and microanalysis community like they have the computer vision community. Breakthroughs in automating and augmenting microscopy data collection and analysis could more than halve research cycle times in fields that rely on microscopy including materials and biological research.

The goal of recent technological developments and research is to create a suite of tools to expand the real-time analytic capabilities of microscopy as well as post-hoc analysis for diffraction-based tools. By applying cutting edge deep learning, computer vision, and signal processing techniques, our team aims to make real-time event tracking and automation of imaging, diffraction, and spectroscopy acquisition a reality in the future. This suite of computational tools and analytical packages is being developed in collaboration with commercial partners, national laboratories, and universities/academia. The software has now been publicly released and designed to draw from standard materials libraries including the Materials Project database and the Open Crystallography database, but also can be further enhanced by research and experimental data from the greater materials community.

In this late breaking poster, we will present our developments and look to the community to further evaluate our emerging real-time augmented feedback framework for materials prediction. This includes pending developments that utilize hybridized first principal and deep learning models for augmented analysis of material properties, spectroscopy, and diffraction patterns. We further look forward to discussing the growing potential of automating data collection from materials-centric data feeds for real-time event tracking and potentially prediction.

We present the use of deep learning methods to develop automated methods for the deconvolution of time of flight spectra in atom probe tomography. This work describes the nature of the algorithms underlying the deep learning methods. This new automated process of labeling of atoms replaces the manual process of ranging and shows high accuracy.

Computing components are being aggressively inserted into electronic, optical, sensing, robotic, bio-system or energy transport devices, to perform multitudes of data-centric operations at high rates. Modern fabrication techniques have reached the sizes of quantum confinement regime, therefore making it possible to model electronic properties of device components with first principle calculations. The contact interfaces between these components dictate the device performance, especially as the device dimension approaches nanoscale. These interfaces are often marked by point defects, dislocations and additional strains due to lattice mismatch between the components. Ab initio methods become expensive and infeasible to predict electronic properties of integrated architectures with such a great number of compositional and configurational degrees of freedom. In recent years, there has been a large effort in the materials science community to employ data driven methods to accelerate materials discovery or to develop new understanding of materials behavior. However, the number of efforts, employing first-principle based data-driven methods to predict device performance incorporating processing variability, is almost non-existent.

In this study, we employ machine learning (ML) algorithms to predict electronic structure and transport properties of non-ideally fabricated multilayered thin film Si/Ge nanostructures. The ML model is trained on inexpensive ~200 DFT calculations of SixGe1-x substitutional alloys: the training data set is populated exploiting the relationship between geometrical features or local atomic environments in these systems and their electronic structure properties. The predictor variables are obtained with Voronoi tessellation approach and the response variables are calculated with the decision tree regression algorithm. [1] This approach has successfully predicted formation energies to expedite materials discovery. [2] Our ML model trained on random alloys, has shown remarkable ability to predict electronic band structures and Onsager electronic transport coefficients of large non-ideal thin film Si/Ge superlattices. We show the predictive power of our model by comparing the predicted band structures learned from small 16-atom alloy unitcells with the electronic states of large Si/Ge superlattices unfolded to 4x4 monolayer superlattice Brillouin zones [3]. The ML framework has been especially effective in capturing crucial trends in electronic properties for a range of multilayered structures. Our ML framework will facilitate the development of inverse design approach to engineer interface profiles of integrated semiconductor architectures, to accomplish desired device performance and functionalities.

[1] L. Breiman, Mach. Learn. 45, 5 (2001)
[2] L. Ward, R. Liu, A. Krishna, V. I. Hegde, A. Agrawal, A. Choudhary, and C. Wolverton, Phys. Rev. B 96, 024104 (2017)
[3] V. Popescu and A. Zunger, Phys. Rev. B 85, 085201 (2012)

Perovskite solar cells have recently reached power conversion efficiency > 22%, representing a promising option for high-performance and low-cost photovoltaic (PV) devices [1]. Yet, their performance is dynamic, varying as a function of time under intrinsic (bias, temperature, and light) and extrinsic (water and oxygen) parameters [2,3]. Because the influence of each stressor on device response depends on the perovskite chemical composition (>9000 options with potential application in PV) and on the order of exposure and the value range of each parameter, an extremely large number of possible combinations is expected. Therefore, we propose a machine learning (ML) paradigm based on an artificial neural network (ANN) to determine the optimal conditions for the perovskites operation, including their ‘reap’, ‘rest’ and ‘recovery’ phases [3]. ‘Reap’ is required for harvesting energy (PV device operation), while both ‘rest’ and ‘recovery’ stages are needed for assuring that the changes in the optical and electrical responses are reversible, preventing material/device degradation and maximizing long-term performance [4]. The successful implementation of the ANN routine for ultimate unsupervised learning relies on our suggested ‘knowledge-shared’ tactic, where researchers from academia, national laboratories and companies will gather positive and negative experimental results in a shared data repository. We highlight that while most ML efforts applied to perovskites focus on screening thermodynamically stable options; our artificial intelligence approach targets the dynamic response of this promising class of material, never exploited before. Our ML strategy will accelerate monitoring and controlling of device performance recovery, paving the way for the fast development of stable perovskites and its commercialization.


[1] E. M. Tennyson et al., ACS Energy Letters 2, 1825 (2017). Invited Perspective
[2] J. M. Howard et al., J. Phys. Chem. Letters 9, 3463 (2018)
[3] J. L. Garrett et al., Nano Letters 17, 2554 (2017)
[4] J. M. Howard et al., Submitted (2018)

Nanoporous materials play a key role as components in a vast number of applications from energy to drug delivery and to agriculture. However, a comprehensive analysis to analytically measure and quantify salient features e.g.: surface structure, pore shape, and size, remain limited, or prohibitively expensive. The most common approach is gas absorption, where volumetric gas absorption and desorption are measured. The gas absorption approach has a few fundamental drawbacks such as low sample throughput and a lack of direct surface visualization. In this work, we demonstrate Helium Ion Microscopy (HIM) for imaging and quantification of pores in industrially relevant SiO₂ catalyst supports. We start with the fundamental principles of ion-sample interaction, and expand to experiment; where we observe and quantify pores on the surface of the catalyst support by using the HIM, and image data analytics. We contrast our experimental results to gas absorption and demonstrate full statistical agreement between two techniques. The principles behind the theoretical, experimental, and analytical framework presented herein offer an automated framework for visualization and quantification of pore structures in a wide variety of materials, and offer data processing solutions to automate these types of imaging workflows.

Acknowledgements
The HIM imaging, image analytics, and simulations portion of this research was conducted at the Center for Nanophase Materials Sciences, which is a DOE Office of Science User Facility. This research was funded by the Center for Nanophase Materials Sciences, which is a U.S. Department of Energy Office of Science User Facility (H.H., A.V.I., P.D.R., O.S.O.), part of the data analytics work was supported by the Laboratory Directed Research and Development Program (A.B.), and the ExxonMobil Chemical Company (M.J.B.). The authors acknowledge Robert Colby, David Abmayr, Sergey Yakovlev, Lubin Luo, and Bill Lamberti from the Exxon Mobil Corporation for much appreciated input and helpful discussions.

The use of materials in society cannot be underestimated. Indeed, it is often said that our ability to use materials has developed civilizations throughout human history and this is even reflected in how we name historical ages, for example the stone age and the bronze age. As we have developed ever better scientific understanding so has our knowledge base on materials and ways to use them increased. We are now at an age where we are beginning to deal with materials in terms of their processing and properties at the atomic scale. At the same time there is an important drive to discover complex materials and be able to manipulate their properties with an ever grater efficiency. This is leading to an immense drive for instrument automation, data interpretation the development of new ways to do this both with existing and novel instrument and equipment.
In our quest to achieve these goals, particularly at the atomic level, it is clear one of the more important techniques will be microscopy, with electron microscopy based techniques probably playing key roles. The automation and interpretation of data from electron microscopy is enormously challenging. That said, approaches toward these goals are being developed and are expected to grow rapidly in the next decades.
In this presentation some of the advances in automation and data interpretation are presented. Numerous challenges in achieving automation, data interpretation, sample preparation and measurement are discussed. The importance of this for new materials discovery (viz. synthesis (including combinatorial materials science) and structure-property relationships at the atomic scale) are also discussed and early ideas and approaches, such as the development of ins situ/in operando electron microscopy are presented.

Three-dimensional (3D) characterization at the nano- and meso-scale using scanning / transmission electron microscope (S/TEM) is now possible[1,2] but high-throughput tomography still requires innovative tools for reconstruction and visualization of large datasets. Currently, the best tomographic reconstructions are obtained from algorithms that are slow and iterative and will run from hours to days depending upon the size of the data set and the algorithm(s) employed. Thus, it has been a longstanding desire to see a reconstruction and begin 3D analysis before it completes. Continuous feedback provides high-throughput and early diagnoses for 3D structure or opportunity to optimize experimental parameters for maximal reconstruction quality.

Here we demonstrate interactive 3D visualization displayed in real time as tomographic reconstructions proceed and as new data arrives using the open-source tool, tomviz. In the actual software, the 3D visualizations are dynamically updated throughout the computation. This means that scientists need not wait for a reconstruction to complete, or all data to be collected before beginning the interpretation of results. The iterative nature of tomographic methods allows tomviz to show intermediate results with minimal impact on performance. This enables interactive 3D analysis of the current reconstruction state while the reconstruction proceeds on a separate thread. A robust graphical interface allows objects to be rendered as shaded contours or volumetric projections and these objects can be rotated, cropped, or sliced[3]. Experimental nanomaterial datasets were made public and used to validate live reconstruction[4].

Additionally, tomviz visualizes new data as it arrives. As aligned projections are provided from each new specimen tilt, the tomographic reconstruction quality improves in real-time. tomviz accomplishes this by monitoring data / directories for change, and upon arrival of new data, the data is imported and all associated 3D data visualizations are dynamically updated. If data processing routines are present in the pipeline—such as alignment, preprocessing, and reconstruction—all steps will automatically rerun. This capability opens radically new possibilities for developing high-throughput, real-time tomographic reconstruction algorithms. Ultimately, interactive real-time visualization will allow researchers to make early judgments to best answer scientific questions or guide experimental design.

tomviz is publically available for download at www.tomviz.org

[1] D. De Rosier, A. Klug, A. Nature 217, 130-134 (1968)
[2] P.A. Midgley, et al., Chemical Communications, 10, 907-908 (2001)
[3] B. D.A. Leven, Y. Jiang, E. Padgett, S. Waldon, et al. Microscopy Today, 1, 12-16 (2018)
[4] E. Padgett, R. Hovden, J. C. DaSilva, et al, Microscopy and Microanalysis 23, 1150-1158 (2017)
[5] tomviz is supported from DOE Office of Science contract DE-SC0011385.

Dynamic imaging instruments are transforming the landscape of manufacturing. They impart an unprecedented capability to directly observe and control structuring of matter down to the atomistic scale. A critical bottleneck is the lack of data science frameworks capable of converting this high volume, high velocity and complex dynamic data to machine intelligible information. The National Nanotechnology Initiative also identifies the same as one major technical roadblock impeding the design and discovery of new nanoscale materials, namely that "existing methods are time-consuming, expensive, and require high-tech infrastructure and high skill levels to perform." What is pressingly needed is to establish a mathematical and statistical foundation, to formulate relevant data science problems, and to devise machine learning solutions, for enabling reliable and automated processing of dynamic image data and leading to in-process control.

In this talk, we will discuss some recent efforts in formulating dynamic imaging as a foundational data science problem, which is to model, estimate, track, and online update a time-varying, nonparametric probability density function. Material scientists care more about the collective changes in the distribution of nano objects, because the collective change can be connected with the governing dynamics based on foundational physical principles, whereas the change exhibited by any single nano object may not be representative. The collective changes observed by dynamic imaging instruments are supposed to be reflected in this time-varying, nonparametric distribution function. Both retrospective analysis and prospective analysis have been studied in our effort. The retrospective analysis centers on off-line video data, to signal possible change points delineating the stages of growth; doing so produces strong clues about where to concentrate one’s effort to understand the highly stochastic material evolving processes and enable discovery of the unexpected. The prospective analysis is to develop a dynamic and forward-looking model that can track the growth trajectory of a material characteristic, anticipate an upcoming change, and, design specific interventions, to steer the course of the material production towards the designed target through “on the fly” changes of process variables. These data science methods, when successfully developed and validated, should be able to benefit material scientists and manufacturing engineers in their practice of discovery, design, and control.

Defects, nanoscale structures, interfaces, surfaces, or multi-scale heterogeneities in materials have important impacts on materials properties but are difficult to study. Pair distribution Function (PDF) analysis of x-ray and neutron powder diffraction data is a powerful approach for studying such non-periodic structural signals. However, the degraded information obtained in experiments from defective materials introduces challenges in both modeling and experimental interpretation during PDF analysis. From the modeling aspect, we need a way of generating models that capture signals emerging from the imperfections, and from the experimental aspect, a systematic approach to quantify information content encapsulated in the measured signals is needed. In this presentation, we will introduce a machine-learning aided approach of generating candidate structures used in PDF analysis and we will also propose a statistics approach for quantifying uncertainties of information extracted from PDF analysis.

Spectroscopy and diffraction techniques are essential for understanding structural, chemical and functional properties of complex and heterogeneous materials system. Beyond data collection, quantitative insight relies on experimentally assembled, or computationally derived spectra. Inference on the chemical or physical properties (such as crystallographic order, chemical functionality, etc.) of a heterogeneous material (for example, inorganic vs organic phases, polytypes, etc.) is based on fitting unknown spectra and comparing the fit with consolidated databases. The complexity of fitting highly convoluted spectra, often limits the ability to infer chemical characteristics, and limits the throughput for extensive datasets. A particularly complex example is the identification of phases and facies from both natural and synthetic mineral systems. With the emergence of heuristic approaches to pattern recognitions though machine learning, in this work we investigate the possibility and potential of using supervised deep neural networks trained on available public spectroscopic database to directly infer and classify materials phases and inferred properties from unknown spectra. Using Raman spectra of minerals from publicly available databases, we train neural network models to classify mineral and organic compounds (pure or mixtures). As expected, the accuracy of the inference is strongly dependent on the quality and extent of the training data. We will identify a series of requirements and guidelines for the training dataset needed to achieve consistent high accuracy inference, along with methods to compensate for limited of data. The flexibility of the approach and the tools developed, can be extended beyond Raman spectra to be applied to any spectroscopy or diffraction technique.

SmFe₁₂ is one of the candidate of the main phase in rare-earth permanent magnets[1]. The origin of intrinsic properties emerging at high temperature as well as that of the phase stability has not yet been clarified well. Introducing Ti and Zr to substitute Fe and Sm is found to improve the magnetic properties and the phase stability. To clarify the mechanism how the substitutions improve the properties, it is desired to identify substituted sites and its amount quantitatively, preferably with high throughput efficiency for accelerating the 'materials tuning'. Motivated by the above, we have developed a machine learning clustering technique to distinguish powder XRD patterns to get such microscopic identifications about the atomic substitutions.

Ab initio calculations are used to generate supervising references for the machine learning of XRD patterns: We prepared several possible model structures with substituents located on each different sites over a range of substitution fractions. Geometrical optimizations for each model give slight different structures each other. Then we generated many XRD patterns calculated from each structure. We found that the DTW (dynamic time wrapping) analysis can capture slight shifts in XRD peak positions corresponding to the differences of each relaxed structure, distinguishing the fractions and positions of substituents. We have established such a clustering technique using Ward's analysis on top of the DTW, being capable to sort out simulated XRD patterns based on the distinction.

The established technique can hence learn the correspondence between XRD peak shifts and microscopic structures with substitutions over many supervising simulated data. Since the ab initio simulation can also give several properties such as magnetization for each structure, the correspondence in the machine learning can further predict functional properties of materials when it is applied to the experimental XRD patterns, not only being capable to distinguish the atomic substitutions. The 'machine learning technique for XRD patterns' developed here has therefore the wider range of applications not limited only on magnets, but further on those materials which properties are tuned by the atomic substitutions.

[1] K. Kobayashi et al., J. Magn. Magn. Mater. 426, 273 (2017).

Inverse problems in imaging constitute some of the most interesting and challenging tasks, with examples ranging from tomographic reconstruction to protein structure determination. Here, we present an approach to tackling the inverse problem in imaging via large-scale forward modeling of many physically realizable examples, and then using these simulations to train deep neural networks to learn the inverse mapping. We show this method with two test cases: in the first, we introduce a deep convolutional neural network trained on simulated 2D diffraction patterns, to perform a classification task to sort each diffraction pattern into one of the five possible Bravais lattice types. The DCNN is tested on experimental imaging data from both scanning transmission electron microscopy and scanning tunneling microcopy, and is found to be robust, providing advantages over more traditional thresholding-based methods and is largely insensitive to both scale and rotations of the lattice. By using Monte-Carlo dropout on the predictions, a confidence estimate is obtained for each symmetry classification.

In the second example, we train a 3D convolutional neural network on hundreds of gigabytes of simulated convergent beam electron diffraction patterns of the LaAlO₃-SrTiO₃ interface. The network is trained on simulated data to classify whether the interface is diffuse or stepped in nature and shows extremely high accuracy on a simulated validation set. The approach outlined here is general to any situation where forward simulations exist, but wherein the inverse is difficult to obtain using traditional means.

The work was supported by the U.S. Department of Energy, Office of Science, Materials Sciences and Engineering Division. Research was conducted at the Center for Nanophase Materials Sciences, which also provided support and is a US DOE Office of Science User Facility. This research used resources of the Compute and Data Environment for Science (CADES) at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725.

To effectively use high-throughput experiments (HTE) as envisioned in the Materials Genome Initiative (MGI) requires not only rapid experiments but also the ability to efficiently transform the resultant large sets into usable knowledge. To address this issue, we are developing machine learning based tools to address the specific challenge of rapid analysis of large amounts of x-ray diffraction (XRD) data including factoring and clustering analysis along with custom data visualizations. These capabilities will be demonstrated by application to both combinatorially grown Co-Zn-Ni-O thin film and bulk powdered Fe-N-C catalyst materials. The composition-gradient thin-film libraries were grown on glass substrates using off-axis co-sputtering and the powdered Fe-N-C materials were synthesized by pyrolysis of Fe substituted ZIFs. XRD patterns were measured using a commercial (Bruker D-8 Discover) diffractometer equipped with either a 2D detector (thin film libraries) or a point detector (bulk powder samples). The developed tools are built in Python and leverage the machine learning algorithms available in scikit-learn (scikit-learn.org). After testing a variety of algorithms, we are currently using Orthogonal Matching Pursuit (OMP) for factoring analysis and Spectral Clustering for clustering analysis. Reference XRD patterns for factoring are pulled from the ICSD for known materials as well as from MatDB (materials.nrel.gov) and the Materials Project (materialsproject.org) for unknown or unmeasured materials. Experimental data can be pulled from HTEM-DB (htem.nrel.gov), a recently-launched public-facing database of experimental synthesis and property data for inorganic thin film materials with more than 50,000 entries. Select data visualization and machine learning based tools have been implemented in unmix_xrd, our custom Python package which combines the analysis and visualization into simple single line command calls to facilitate use. For deployment, we are testing locally hosted and cloud hosted Jupyter notebooks with the latter aimed at creating free standing analysis tools intended for deployment on the Energy Materials Network (EMN) such as via the ElecroCAT datahub (datahub.electrocat.org). In addition, this analytics package can be run from within program capable of issuing a system command which we will demonstrate using Igor Pro, a commercial analysis program widely used at NREL. The overall result is a scientist-friendly extensible analysis environment with project specific machine learning analysis and data visualizations.

In the traditional materials optimization paradigm, a material system is characterized by forming many different samples across different compositions and measuring their properties as a function of e.g. temperature or pressure to produce a phase diagram. As such, each measurement represents a single point in chemical space, and spanning the phase diagram requires many samples and measurements which are time-consuming and expensive. At the same time, small fluctuations in the samples are considered a hindrance and limiting factor to the interpretation of the results. Here, we present an alternative approach that instead exploits this fact, leveraging statistical physics to take atomic observations of structural and chemical fluctuations to map them into generative lattice models that have predictive power. We use a newly developed statistical distance framework to perform model optimization based from imaging data, and then use the model to produce configurations for a range of compositions and temperatures. We apply the method to understand segregation in FeSe_xTe_1-x single crystal, attempting to identify the segregation tendency of the chalcogen atom, as well as the divalent cation segregation in a manganite thin film. The generative model produces configurations that well approximate those observed, and further are run for different temperatures and compositions. A variational autoencoder is then applied on the simulated configurations to map the observations to a single latent parameter, allowing easy visualization of any anomalies in the phase diagram. In this way, a measurement of a single point in chemical space is turned into a prediction across a finite range of chemical space. This method is general and can be used to add to the current materials design paradigm, providing more information on microscopic driving forces, and reducing the need to finely sample the chemical space.

The work was supported by the U.S. Department of Energy, Office of Science, Materials Sciences and Engineering Division (R. K. V., S. V. K., L.V). Research was conducted at the Center for Nanophase Materials Sciences, which is a DOE Office of Science User Facility.

The microstructure of a material intimately affects the performance of a device made from this material. The microstructure, in turn, is affected by the processing pathway used to fabricate the device. This forms the process–structure–property triangle that is central to materials science. There has been growing interest to comprehensively understand and subsequently exploit process–structure–property (PSP) relationships to design processing pathways for optimal microstructures. However, unraveling process–structure–property relationships usually requires systematic and tedious combinatorial search of process and system variables to identify the microstructures while generating high dimensional datasets. This is further complicated by the necessity to interrogate the properties of the huge set of corresponding microstructures. Motivated by this challenge, we focus on developing a generic methodology to establish and explore PSP pathways.

We leverage recent advances in cloud computing to execute high throughput exploration of PSP spaces. Our key idea is that PSP exploration can be naturally formulated in terms of a standard paradigm in cloud computing, namely the MapReduce programming model. We show how reformulating PSP exploration into a MapReduce workflow enables us to take advantage of advances in cloud computing while requiring minimal specialized knowledge of high performance computing.

To address high dimensionality challenge related to microstructure evolution during processing we develop a novel nonlinear manifold learning methodology that overcomes the presence of strong temporal correlation among observations belonging to the same process pathways. Although the methodology is applicable to any dynamic process, in this talk I show how mapping data obtained through simulations to a low-dimensional manifold facilitates better understanding of the underlying processes, and ultimately their optimization.

Both key ingredients of general methodology will be illustrated through relevant questions in the area of organic electronics.

Coordination environments (e.g, tetrahedra and octahedra) are powerful descriptors of the structure of a solid. An automatic and robust detection of these environment is an important step towards the data mining of the large databases (experimental or theoretical) currently available to materials scientists. In this work, we present a tool to automatically determine coordination environments in a given structure. The identification is performed based on the sole consideration of the geometrical knowledge of the structure. Distortions are taken into account and we allow the description of an environment as a mixture of several environments. After outlining our algorithm, we will illustrate the approach by presenting a statistical analysis of coordination environments for all oxides from the Inorganic crystal structure database (ICSD). We will discuss the implication of our study to the understanding of crystal chemistry in oxides and outline how this tool can be used to accelerate the materials design process.

Salt hydration reactions show great promise for thermal energy storage (TES) due to their high energy densities, cost effectiveness, and potential for reversible operation at moderate temperatures. While a number of salt hydrate compositions have been investigated previously for TES, many have yet to be explored. The goal of this work is to identify hypothetical salt hydrate structures that are thermodynamically stable and can out-perform known materials. All 25 distinct crystal structures of the form MX_m●nH₂O (where M^m+ is a metal cation, X^1- is a halide, and n ≥ 6) found in the Inorganic Crystal Structure Database were used as structural templates. A total of 1,824 hydrate structures were generated from systematic cation and anion substitution and were characterized by Density Functional Theory calculations according to their energy densities and operating temperature range. A variety of classification and regression machine learning (ML) algorithms were trained on the data to predict stability as well as TES performance. Thousands of mathematical combinations of the basic ionic and structural properties were generated and the most promising features were selected from this list to be used in the ML algorithms. In addition to identifying new, promising materials for TES, our study identified which features are relevant to TES performance as well as predictive models that can be used to further accelerate our screening of hypothetical salt hydrate structures for TES.

Finding new materials with targeted properties with as few experiments as possible has been a goal of the materials genome initiative. The enormous complexity due to the interplay of structural, chemical and microstructural degrees of freedom in materials makes the rational design of new materials rather difficult. Machine learning and optimization, used in industry for solving complex problems, are increasingly being adapted for the design of new materials by learning from past data and making smart decisions about what the test next. However, the number of well characterized samples available as sources of data to learn from is often relatively small. I will review how we have utilized Bayesian Global Optimization to iteratively guide experiments to discover new alloys and ceramics.

In the search for materials with exceptional mechanical properties, we have developed a machine-learning model to predict the elastic moduli of inorganic materials, which act as a proxy for hardness. Materials project database of elastic moduli has been used as the training set and the machine learning model is developed using support vector regression method implementing 150 compositional and structural variables. Further, a genetic algorithm-based variable selection is performed using partial least square regression method resulting in a cross-validated root mean square error (RMSE) of 17.2 GPa and 16.5 GPa for bulk and shear modulus respectively. Subsequently, 118,287 compounds from crystalline databases are screened regardless of their chemical composition and atomic disorder for compounds with high bulk and shear moduli having potential for superhardness. We then identified compounds of two interest, a ternary rhenium tungsten carbide and a quaternary molybdenum tungsten borocarbide for experimental investigation. These materials synthesized using arc melting and characterized with high-pressure diamond anvil cell measurements to confirm the machine learning predictions with <10% error. Vickers microhardness measurements revealed the extremely high hardness nature of these compounds making these the hardest transition metal carbide and borocarbide reported. The successful identification of these superhard materials using state-of-art machine learning and materials screening techniques emphasizes the effectiveness of these methods in materials discovery and development.

Interfaces are a lattice defect inside materials, and influence to the overall material properties. For instance, interfaces in polycrystalline materials, i.e., grain boundaries (GB), determine ion transportation properties and high-temperature mechanical properties. The fact that interfaces have different properties from the bulk is a consequence of the fact that they have different atomic configurations from that inside the bulk. Thus, for a comprehensive understanding of the interface properties, determination of the atomic structure of the interface is crucial.
However, extensive calculations are necessary to determine even one interface structure because of the geometrical freedom of the interface. The number of atomic configurations to be considered often reaches 10,000 in even the simplified coincidence site lattice grain boundary, namely Σ grain boundaries. To accelerate interface structure searching, very efficient methods based on machine learning techniques, including virtual screening and Bayesian optimization have been proposed by the present authors.
We applied the virtual screening method to [001] symmetric tilt GB of Cu. The predictor was constructed using two Σ5 and two Σ17 GBs, and totally 83 descriptors related to the geometrical data, such as a bond length and atom density, were used. The constructed predictor successfully determined other 12 GBs of Cu, Σ13 ~ Σ125 [1].
In addition to the virtual screening, we have developed an alternative and powerful method with the aid of a geostatistics approach called kriging[2]. Kriging is an effective interpolation method based on a Bayesian optimization and Gaussian process governed by prior covariance. The kriging method has been applied and demonstrated to determine the grain boundaries of fcc-Cu, bcc-Fe, MgO, rutile-TiO₂, and CeO₂ GBs [3-4].
The details of those studies will be shown in my presentation.
[1] S. Kiyohara, H. Oda, T. Miyata, and T. Mizoguchi, Sci. Adv. 2(11), e1600746 (2016).
[2] S. Kiyohara, H. Oda, K. Tsuda, and T. Mizoguchi, Jpn. J. Appl. Phys. 55(4), 2 (2016).
[3] H. Oda, S. Kiyohara, K. Tsuda, and T. Mizoguchi, J. Phys. Soc. Japan 86(12), 123601 (2017).
[4] S. Kikuchi, H. Oda, S. Kiyohara, and T. Mizoguchi, Physica B, 532 (2018) 24-28.
[5] This study is supported by JST-PRESTO, MEXT, and Tenkai-kenkyu.

Fast charging protocols for lithium-ion batteries are critical for widespread adaptation of electric vehicles. However, a limited understanding of battery degradation modes during fast charging and the large manufacturing variability of commercial lithium-ion batteries are major challenges to the development of high-performing fast charging protocols. In this work, we optimize a three-step charging protocol for commercial 18650 lithium-ion batteries that achieves 80% state of charge in ten minutes. We employ two key elements to reduce the optimization cost: early prediction of failure, which uses cycling data from the first 100 cycles to predict cycle lives that reach up to 1200 cycles, and adaptive Bayesian optimal experimental design, which significantly reduces the number of experiments required. We identify promising fast charging protocols with identical charging times but lifetimes that exceed the baseline charging protocol out of a candidate pool of nearly 180 protocols. This method can be extended to accelerate development of other tasks in battery manufacturing and deployment, such as formation cycling and state-of-health estimation.