AI & ML Tech Glossary
Clear definitions of 500+ AI, ML, and systems terms, built for professionals.
S
Self-Consistency Decoding
Self-consistency decoding samples multiple reasoning outputs from an LLM and selects the most consistent final answer using voting or aggregation. It often improves accuracy on...
Structured Outputs
HotStructured outputs constrain an LLM to produce schema-valid, machine-readable results (often JSON), improving reliability for extraction, automation, and tool-using agents by reducing parsing errors.
Speculative Decoding
HotSpeculative decoding speeds up LLM inference by having a small draft model propose several next tokens and a larger target model verify them in batches....