learn/model families
Autoencoder
An autoencoder is a pair of neural networks trained to squeeze data down to a compact summary and then rebuild the original from that summary alone.
What it is
A neural network is a mathematical function with many adjustable numbers inside it, tuned by showing it examples. An autoencoder joins two such networks back to back. The first, the encoder, takes a piece of data and reduces it to a short list of numbers, often called the latent code. The second, the decoder, takes only that short list and tries to produce the original data again. Training consists of comparing the output with the input and nudging both networks until the two match more closely. No labels are needed. The data is its own answer, which is why this is called self-supervised learning.
Because the code is much smaller than the input, the networks cannot simply copy. They must discard what is incidental and keep what matters for reconstruction. What survives tends to be the structure that repeats across the collection. Variants change what the code looks like. A variational autoencoder learns a spread of plausible codes rather than one, so that new codes can be drawn and decoded into new, unseen examples. Other variants add noise to the input, or force most of the code to stay near zero, to push the summary towards something simpler.
Why scientists use it
Scientific measurements are usually far larger than the handful of quantities a scientist actually cares about. A spectrum, an image or a simulated structure may hold thousands of numbers that are heavily redundant. An autoencoder offers a way to find a smaller set of coordinates for such data without being told in advance what those coordinates should mean. Those coordinates can then be used for comparing, sorting or clustering observations, for spotting the odd one out, or as compact input to a further model. Anything the decoder cannot reproduce stands out, which makes the method useful for flagging unusual measurements.
The decoder is valuable in its own right. Once it can turn a short code into a full object, it can be asked to produce objects nobody measured, by feeding it codes from regions of the compact space that no real example occupies. This is how autoencoders are used to propose candidate molecules, protein shapes or materials. It stands in, loosely, for a hand-built summary. Where scientists once chose a few descriptive measures from theory, the network is left to work out its own, which can capture relationships nobody thought to write down.
In the record
Limits
The compact code is not an explanation. Its individual numbers rarely correspond to anything a scientist can name, and two codes being close together need not mean the underlying systems are physically similar. Good reconstruction only shows that the data could be rebuilt, not that the summary captured the quantity of interest, which may be a faint detail the network learned to discard. Decoders asked for codes far from any training example return confident nonsense: outputs that look plausible but may be physically impossible. Results also shift with the chosen code size and preprocessing.
Written by AIxSci: the background from general knowledge, the examples from checked records.
By field
Every article
aix-00276
Machine learning sorts a simulated polymer into ordered and disordered beads
aix-00206
Neural network designs five hard metallic glasses, all confirmed by experiment
aix-00136
Diffusion model generates synthetic images of the Sun sorted by flare strength
aix-00132
Five codes measured galaxy shapes in simulated Euclid images, one using neural networks
aix-00123
Neural networks swap places with black hole image simulations, both directions
aix-00111
Zero-padding lets one neural network encode crystals with differing element counts
aix-00093
Neural network predicts gas pressure in galaxy clusters from dark matter alone
aix-00084
Neural networks read simulated galaxy cluster catalogues to estimate cosmological parameters
aix-00083
A compact neural network learns to generate shape-shifting protein structures
aix-00076
Neural network strips mains-power hum from LIGO data in about a second
aix-00045
Neural network reads simulated quasar light curves to estimate black hole properties
aix-00042
Two unsupervised methods compress fast radio burst spectra into a handful of numbers
aix-00039