Skip to content

Imageomics: Bringing machine learning to life.

The Imageomics Institute GitHub organization hosts the development and distribution of a collection of open-source ML tools used to study the biological information encoded in images and videos integrated with structured biological knowledge. All Imageomics code, data, models, and demos hosted on GitHub or Hugging Face are searchable through the Imageomics Catalog:

Screenshot of Imageomics Catalog, organized by most likes/stars

What is the Imageomics Institute?

The Imageomics Institute is funded by the US National Science Foundation's Harnessing the Data Revolution (HDR) program under Award #2118240 (Imageomics: A New Frontier of Biological Information Powered by Knowledge-Guided Machine Learning). It started in Oct 2021.

You can find a full mission, vision, and abstract under the Imageomics website's About page. In short, the vision of the Institute is to "establish a new scientific field called imageomics that harnesses revolutions in data science and computing, as well as the rapidly expanding collections of biological image data, in order to accelerate biological understanding of phenotypic traits extracted from images of organisms."

History leading to the Institute

History

The inception and research of the Imageomics Institute builds heavily on the "Biology-Guided Neural Networks for Discovering Phenotypic Traits" (BGNN) project, also funded by the US National Science Foundation. BGNN itself built in part on the Phenoscape project (funded by NSF multiple times), which started in 2007 and was incubated at the NSF-funded National Evolutionary Synthesis Center (NESCent).

Imageomics repositories held at predecessor organizations

Due to the history (see above) and highly collaborative and cross-disciplinary nature of the Institute, important software products and other code repositories are distributed over several organizations in GitHub, in addition to the ones found here. These early imageomics projects are listed and linked below under their organizations.


Disclaimer: Any opinions, findings and conclusions or recommendations expressed in the materials here are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

Pinned Loading

  1. bioclip-2 bioclip-2 Public

    Repository for the BioCLIP 2 model project. [NeurIPS'25 Spotlight] BioCLIP 2 is a biological foundation model trained on TreeOfLife-200M. Despite the narrow training objective, BioCLIP 2 yields ext…

    Python 98 12

  2. Collaborative-distributed-science-guide Collaborative-distributed-science-guide Public template

    Template guide to collaborative work, including GitHub and Hugging Face workflows. Co-developed with the Imageomics Guide.

    Python 1 1

  3. emb-explorer emb-explorer Public

    An interactive tool for classifying images with a pretrained model and exploring clustering results in 2D space.

    Python 7

  4. pybioclip pybioclip Public

    Python package and CLI that simplifies using the BioCLIP family of foundation models.

    Python 67 14

  5. SST SST Public

    Official repo for paper "Static Segmentation by Tracking: A Frustratingly Label-Efficient Approach to Fine-Grained Segmentation". Ideal for specimen image trait segmentation.

    Jupyter Notebook 15 4

  6. TaxonoPy TaxonoPy Public

    A Python package for efficiently aligning organismal taxonomic hierarchies using the Global Names Verifier

    Python 20

Repositories

Showing 10 of 141 repositories
  • imageomics.github.io Public

    Repository to host the Imageomics Institute's website.

    Imageomics/imageomics.github.io's past year of commit activity
    HTML 0 CC-BY-4.0 0 1 1 Updated Sep 30, 2026
  • bioclip Public

    This is the repository for the BioCLIP model and the TreeOfLife-10M dataset [CVPR'24 Oral, Best Student Paper].

    Imageomics/bioclip's past year of commit activity
    Python 279 26 3 0 Updated Sep 29, 2026
  • catalog Public template

    Catalog app for Imageomics code, data, models, and spaces hosted on GitHub and Hugging Face. Designed for improved discoverability of Imageomics products, the content is updated in real-time through calls to the GitHub and Hugging Face APIs. This repository also serves as a template for others looking to create a similar website.

    Imageomics/catalog's past year of commit activity
    JavaScript 10 MIT 0 6 5 Updated Sep 29, 2026
  • TaxaAdapter Public

    TaxaAdapter

    Imageomics/TaxaAdapter's past year of commit activity
    1 MIT 0 0 0 Updated Sep 28, 2026
  • OpenCite Public

    Web-based tool for generating consistent CITATION.cff and .zenodo.json files from a single structured input form, reducing metadata inconsistencies across research releases.

    Imageomics/OpenCite's past year of commit activity
    JavaScript 0 MIT 0 13 7 Updated Sep 27, 2026
  • Collaborative-distributed-science-guide Public template

    Template guide to collaborative work, including GitHub and Hugging Face workflows. Co-developed with the Imageomics Guide.

    Imageomics/Collaborative-distributed-science-guide's past year of commit activity
    Python 1 CC0-1.0 1 14 (1 issue needs help) 1 Updated Sep 27, 2026
  • saev Public

    Sparse autoencoders for vision

    Imageomics/saev's past year of commit activity
    Python 67 MIT 12 7 21 Updated Sep 25, 2026
  • MAVRIC Public

    Video-based Animal Reidentification Pipeline

    Imageomics/MAVRIC's past year of commit activity
    Python 0 MIT 0 0 0 Updated Sep 25, 2026
  • lca Public Forked from WildMeOrg/wbia-plugin-lca

    An independent implementation of the Local Clusters and their Alternatives (LCA) graph-based ID curation algoritihm

    Imageomics/lca's past year of commit activity
    Jupyter Notebook 1 Apache-2.0 6 0 0 Updated Sep 25, 2026
  • GGR_pipeline Public

    This work presents a modular software pipeline and end-to-end workflow for video-based animal re-identification, which assigns consistent individual IDs by clustering multiview spatio-temporal tracks with minimal human intervention.

    Imageomics/GGR_pipeline's past year of commit activity
    Jupyter Notebook 1 MIT 1 9 1 Updated Sep 25, 2026