Skip to content
View royxforge's full-sized avatar
:shipit:
Learning
:shipit:
Learning

Highlights

  • Pro

Block or report royxforge

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
royxforge/README.md

Sourav Roy

Typing SVG

Website LinkedIn ORCID

Profile views


About

I build and evaluate LLM-based systems: retrieval-augmented generation, parameter-efficient fine-tuning, multi-agent pipelines, and the monitoring/uncertainty infrastructure that keeps them trustworthy in production. My work leans empirical: most repositories below report benchmark numbers rather than just claims, because I care about results that replicate.

I'm currently preparing applications for research-oriented graduate study (MS/PhD), with interests spanning uncertainty quantification, model evaluation methodology, and efficient adaptation of large models. Open to research collaborations, co-authored write-ups, and conversations with labs working in these areas.


Research Interests

  • Uncertainty & confidence estimation in deep networks (label-free and unsupervised methods)
  • Evaluation methodology for LLM/RAG systems (faithfulness, hallucination, retrieval quality)
  • Parameter-efficient fine-tuning and adaptation of large models
  • Multi-agent LLM systems with verification / critique loops
  • Production ML monitoring: distribution drift, model degradation over time

Selected Projects

Evaluation & Uncertainty

  • rag-evaluation-framework: Faithfulness, hallucination, retrieval precision, and answer relevance metrics for RAG pipelines, including UCM, an unsupervised confidence metric that requires no ground-truth labels.
  • unsupervised-confidence-estimation: Benchmarks MSP, MC Dropout, Evidential Deep Learning, and Deep Ensembles against a novel label-free uncertainty metric on CIFAR-10.
  • production-drift-detection: KL divergence, PSI, MMD, and ADWIN drift detectors with empirical benchmarks and a FastAPI monitoring dashboard.

Model Adaptation

  • parameter-efficient-fine-tuning: QLoRA fine-tuning across 2B-70B parameter LLMs; on small-data regimes, LoRA reaches 21% better perplexity than full fine-tuning while updating 421x fewer parameters (full benchmark setup and baselines in repo).
  • multi-objective-feature-selection: NSGA-II based feature selection on medical tabular data; 9 of 30 features match full-feature baseline accuracy (94.74%) at 70% dimensionality reduction.
  • loss-landscape-analysis: Empirical comparison of MSE vs. cross-entropy on MNIST, with gradient norm analysis explaining the convergence gap.

Multimodal & Applied Systems

  • multimodal-medical-vqa: Cross-attention fusion of BioViL-T and Mistral-7B (QLoRA) for clinical visual question answering, with MC Dropout confidence and Grad-CAM explainability.
  • multi-agent-research-system: Researcher/Analyst/Critic agent loop in LangGraph with a hallucination and citation validation gate; cached-search retrieval measured at a 10,184x speedup over uncached calls in repeated-query benchmarks.

Tech

Python PyTorch scikit-learn LangChain FastAPI TypeScript Next.js


GitHub stats GitHub streak

Popular repositories Loading

  1. unsupervised-confidence-estimation unsupervised-confidence-estimation Public

    Label-free confidence estimation for neural networks - benchmarking MSP, MC Dropout, EDL, and Deep Ensembles with a novel unsupervised uncertainty metric.

    Jupyter Notebook 1

  2. multi-objective-feature-selection multi-objective-feature-selection Public

    NSGA-II multi-objective feature selection on medical tabular data. 9 of 30 features at 94.74% accuracy - matching full-feature baselines with 70% feature reduction.

    Python 1

  3. royxforge royxforge Public

  4. parameter-efficient-fine-tuning parameter-efficient-fine-tuning Public

    QLoRA fine-tuning platform for LLMs 2B-70B. LoRA achieves 21% better perplexity than full fine-tuning on small datasets with 421x fewer trainable parameters and 3.5x faster training.

    Python

  5. multi-agent-research-system multi-agent-research-system Public

    Autonomous research system with Researcher/Analyst/Critic agents in a LangGraph feedback loop. Hallucination and citation validation gate every report, with a 10,184x cached-search speedup.

    TypeScript

  6. loss-landscape-analysis loss-landscape-analysis Public

    Empirical comparison of MSE vs Cross-Entropy on MNIST. CE reaches 97% accuracy in 4 epochs vs 13 for MSE - gradient norm analysis confirms the saturation mechanism.

    Python