Skip to content
Back to Insights
AI / ML

CELLama — foundation model for single-cell and spatial transcriptomics by cell embedding leveraging language model abilities

CELLama turns cell data into sentences that capture gene expression and metadata, then uses language-model embeddings as a universal cellular representation — flexible cell typing and spatial-context analysis without manual reference selection.

DL
Daeseung Lee August 1, 2024 - 10 min read
Share
CELLama — language-model-based cell embedding for scRNA-seq and spatial transcriptomics
CELLama — language-model-based cell embedding for scRNA-seq and spatial transcriptomics

doi: 10.1101/2024.05.08.593094

Abstract

Large-scale single-cell RNA sequencing (scRNA-seq) and spatial transcriptomics (ST) have transformed biomedical research into a data-driven field, enabling the creation of comprehensive data atlases. These methodologies facilitate detailed understanding of biology and pathophysiology, aiding in the discovery of new therapeutic targets. However, the complexity and sheer volume of data from these technologies present analytical challenges, particularly in robust cell typing, integration, and understanding complex spatial relationships of cells.

To address these challenges, we developed CELLama (Cell Embedding Leverage Language Model Abilities), a framework that leverages language models to transform cell data into “sentences” that encapsulate gene expressions and metadata, enabling universal cellular data embedding for various analyses. CELLama, serving as a foundation model, supports flexible applications ranging from cell typing to the analysis of spatial contexts, independently of manual reference data selection or intricate dataset-specific analytical workflows.

Our results demonstrate that CELLama has significant potential to transform cellular analysis in various contexts, from determining cell types across multi-tissue atlases and their interactions to unraveling intricate tissue dynamics.

Authors: Choi H, Park J, Kim S, Kim J, Lee D, Bae S, Shin H, Lee D

Recommended reads