Research & Engineering

Building and understanding intelligent systems.

I'm interested in large language models, efficient model architectures, training systems, and machine learning infrastructure. I use this space to share my implementations, experiments, open-source contributions, and technical writing.

Python PyTorch LLM Architectures CUDA Distributed Training Model Optimization

Selected Projects

Implementations, experiments, and engineering work.

DeepSeek-V3-Inspired Implementation

Exploring Mixture of Experts (MoE), Multi-head Latent Attention (MLA), multi-token prediction, and language model training.

View repository ↗

Sparsflow

Add a concise description of your project, the problem it solves, its technical approach, and your experimental results.

View repository ↗
View all projects →

Open Source

Contributions to machine learning libraries and infrastructure.

LLM & ML Systems Contributions

Explore my pull requests, bug fixes, implementation improvements, and technical investigations. Each contribution should link directly to the relevant issue or pull request.

View GitHub activity ↗
View contributions →

Technical Writing

Articles and explanations about LLMs, research, and engineering.

DeepSeek-V3: Architecture and Training

Replace this description with the actual topic and key takeaway from one of your published articles.

Read article ↗

More Technical Articles

Browse my writing on attention mechanisms, model architectures, training, and machine learning systems.

Read all articles ↗
Browse article collection →

About

My interests include LLM architecture design, efficient training, GPU computing, distributed systems, and open-source machine learning. I enjoy understanding systems from first principles, implementing technical ideas, and investigating performance bottlenecks.