~/aixsci
weekly updates

learn/model families

Gradient-boosted trees

Gradient-boosted trees are a prediction method that adds up many simple decision trees, each new tree fitted to correct the errors left over by the ones before it.

What it is

A decision tree is a chain of yes-or-no questions about a row of numbers. Is this quantity above some threshold? Then go left, and ask again. At the end of the chain the tree gives a number or a label. One small tree is a crude predictor. Boosting builds many of them in sequence. The first tree makes a rough guess for every row in the training data. The leftover error, the gap between the guess and the true answer, becomes the target for the second tree. The third tree attacks what is still wrong, and so on. The final prediction is the sum of all the trees.

The trees are deliberately kept shallow, and each one's contribution is shrunk by a small factor, so the method creeps towards the answer rather than leaping at it. The gradient in the name refers to how the leftover error is measured: the method follows the direction in which the chosen error measure falls fastest. The main settings a researcher chooses are how many trees to add, how deep each may grow and how much of each to keep. Several widely used software packages implement this, including the one named XGBoost.

Why scientists use it

Most scientific data arrives as a table: one row per sample, one column per measured or computed quantity. Gradient-boosted trees are good at tables. They do not care that one column is a temperature and the next a dimensionless ratio, since each tree only compares values with thresholds. They pick up effects that depend on combinations of columns without being told which combinations to look for. They work with modest amounts of data, train quickly on an ordinary computer, and often match or beat more elaborate methods on this kind of input.

What they stand in for is a formula nobody has written down. A scientist may suspect that an outcome depends on a set of properties, without knowing the relationship. Fitting trees to examples supplies a usable stand-in: feed in the properties, get an estimate. That estimate can then guide the next experiment or calculation, in chemistry, in biology and in astronomy alike.

In the record

Limits

Trees only compare values with thresholds learned from the training set, so outside the range of that set the prediction simply flattens out rather than continuing sensibly. Predictions also change in steps, which is wrong if the real relationship is smooth. If the training table is skewed, say towards materials that happened to be published, the model inherits that skew. Add too many trees and it memorises noise. It offers no mechanism, and the rankings of which columns mattered can mislead when columns are correlated. Raw spectra, images and waveforms usually need other methods.

Written by AIxSci: the background from general knowledge, the examples from checked records.

By field

Named models

Every article

34articles
11structural-biology
14materials-chemistry
4astronomy
5climate-weather

aix-00286

AI fills gaps in river temperature records to track overlapping heatwaves

property predictionforecasting

climate-weather · ai-result · Nature Geoscience · 2026

aix-00288

Machine learning turns satellite cloud images into hourly rainfall maps for central Vietnam

classificationproperty prediction

climate-weather · ai-result · PLoS ONE · 2026

aix-00289

Machine learning points to filter loading as main driver of levoglucosan desorption temperature

property prediction

climate-weather · ai-result · Environmental Science & Technology · 2026

aix-00281

Bacteria-derived aerosol matter made to produce oxidants, then modelled from its optical fingerprints

property prediction

climate-weather · ai-supporting · Environmental Science & Technology · 2025

aix-00293

Machine learning used to predict fine particle emissions at a Greek regional airport

property prediction

climate-weather · ai-supporting · Toxics · 2025

aix-00279

Machine learning predicts where dopant atoms sit in hexaferrite crystals before refinement

classificationproperty prediction

materials-chemistry · ai-result · Advanced Science · 2026

aix-00273

Deep learning model flags bacterial proteins likely to drive infection

classificationstructure determination

structural-biology · ai-result · Bioinformatics · 2026

aix-00271

Machine learning predicts galaxy 'relicness' from survey measurements, cutting spectroscopy demand

property predictionclassification

astronomy · ai-result · Monthly Notices of the Royal Astronomical Society · 2026

aix-00238

Classifiers label individual TESS brightness readings as planet transits or not

classificationdetectionanomaly detection

astronomy · ai-result · arXiv · 2026

aix-00210

Language models suggest ingredients and firing temperatures for inorganic materials recipes

candidate generationproperty prediction

materials-chemistry · ai-result · ACS Applied Materials & Interfaces · 2025

aix-00206

Neural network designs five hard metallic glasses, all confirmed by experiment

property predictioncandidate generationsimulation surrogate

materials-chemistry · ai-result · Nature Communications · 2026

aix-00163

Peptides designed by simulation and machine learning sit at condensate surfaces

simulation surrogateproperty predictioncandidate generationexperimental design

structural-biology · ai-result · Nature Communications · 2026

aix-00170

Machine learning predicts strength of PLA plastic filled with boron nitride flakes

property prediction

materials-chemistry · ai-supporting · Polymers · 2026

aix-00133

Regression models predict how graphene loading changes aluminium's electron emission

property prediction

materials-chemistry · ai-result · Scientific Reports · 2025

aix-00181

Protein language model embeddings used to predict succinylation sites in proteins

classification

structural-biology · ai-result · Scientific Reports · 2022

aix-00184

Machine learning scores short protein stretches that mark proteins for destruction

classification

structural-biology · ai-result · Briefings in Bioinformatics · 2024

aix-00188

Machine learning sorts antibody heavy chains by the germ they target

classification

structural-biology · ai-result · PLoS ONE · 2026

aix-00124

Software predictors compare protein floppiness across retinal disease protein sets

property prediction

structural-biology · ai-result · Journal of Proteins and Proteomics · 2025

aix-00121

Machine learning sorts mitochondrial proteins into three compartments from sequence alone

classification

structural-biology · ai-result · Journal of Environmental and Public Health · 2022

aix-00117

Deep learning model predicts polymer heat-softening across 48,208 designed candidates

property prediction

materials-chemistry · ai-result · arXiv · 2026

aix-00107

Machine learning sorts plant protein sequences into disease-resistance proteins or not

classification

structural-biology · ai-result · Frontiers in Plant Science · 2022

aix-00090

Machine learning reads planet-forming disk masses from archival ALMA observations

property predictionsimulation surrogate

astronomy · ai-result

aix-00081

Language models trained on protein sequences used to predict sugar-attachment sites

classification

structural-biology · ai-result · Bioinformatics Advances · 2024

aix-00071

Simulations map how surface atoms rearrange in alloys when molecules attach

property prediction

materials-chemistry · ai-supporting · The Journal of Physical Chemistry C · 2023

aix-00068

Machine learning predicts marine steel corrosion from seawater conditions and alloy make-up

property predictioncandidate generation

materials-chemistry · ai-result · Materials · 2025

aix-00066

Machine learning sifts 25,000 known materials for quantum-technology host candidates

classification

materials-chemistry · ai-result · npj Computational Materials · 2022

aix-00051

Ultrasound-treated clay bleaches cooking oil, with machine learning picking the settings

property predictionexperimental design

materials-chemistry · ai-supporting · Food Science & Nutrition · 2024

aix-00050

Machine learning tool flags protein helices likely to bind DNA or RNA

classification

structural-biology · ai-result · Journal of Chemical Information and Modeling · 2025

aix-00049

Eight machine learning methods sorted supernova gravitational wave signals by nuclear physics model

classification

astronomy · ai-result · Machine Learning Science and Technology · 2024

aix-00040

Statistical model of 5,441 perovskite solar cells predicts efficiency and suggests recipes

property predictioncandidate generationexperimental design

materials-chemistry · ai-result · Journal of Chemical Information and Modeling · 2026

aix-00035

GPT-4 reads band gap values from paper sentences to train better predictors

literature synthesisclassificationproperty prediction

materials-chemistry · ai-result · arXiv · 2023

aix-00025

Machine learning picks a new metal mixture, which casting and X-rays confirm

classification

materials-chemistry · ai-result · Scientific Reports · 2023

aix-00010

Robotic lab with machine learning proposes and runs 353 inorganic synthesis experiments

candidate generationproperty predictionclassificationexperimental design

materials-chemistry · ai-result · Nature · 2023

aix-00002

Deep learning turns raw NMR spectra into protein structures without human intervention

detectionproperty predictionstructure determination

structural-biology · ai-result · Nature Communications · 2022