AI21 Labs launches Jamba, an AI model that integrates two architectures: transformer and Mamba, which is based on the Structured State Space model (Kyle Wiggers/TechCrunch)

Kyle Wiggers / TechCrunch:
AI21 Labs launches Jamba, an AI mannequin that integrates two architectures: transformer and Mamba, which relies on the Structured State House mannequin  —  More and more, the AI business is shifting towards generative AI fashions with longer contexts.  However fashions with giant context home windows are typically compute-intensive.