Skip to content
View Omc12's full-sized avatar
💭
Js 😭
💭
Js 😭

Highlights

  • Pro

Block or report Omc12

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Omc12/README.md

Hi there 👋

I'm an AI researcher focused on large language model inference, transformer memory systems, and efficient long-context evaluation. I build research systems that bridge algorithmic ideas with practical GPU and inference engineering, with an emphasis on reproducibility and open implementations.

My current research includes DKV (Differential KV Cache Compression), a training-free approach to reducing KV-cache memory through anchor representations, low-rank differential reconstruction, and exact residual preservation. DKV combines compression techniques with optimized inference runtimes and is currently under review at IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI).

I'm also developing CRBench, a method-agnostic and resource-aware framework for evaluating long-context LLM systems. It evaluates contextual capability retention against dense reference models while accounting for memory efficiency and inference performance. The current release is an initial research release, with a full version being prepared for TMLR submission.

Beyond these projects, I work on LLM inference optimization, GPU systems, KV-cache architectures, long-context evaluation, model serving, and AI benchmarking. I enjoy taking ideas from first principles, validating them experimentally, and turning them into systems that others can reproduce and extend.

Current Work

Currently exploring adaptive KV-cache compression, memory-efficient transformer inference, long-context evaluation, and GPU-optimized LLM serving.

Open Source

I believe research is more useful when it can be reproduced, inspected, and extended. My projects aim to provide complete implementations, benchmarks, documentation, and reproducible experiments wherever possible.

Find me here

Pinned Loading

  1. Differential-KV Differential-KV Public

    Differential-KV (DKV) is a sparse KV-cache inference runtime designed for high-efficiency, memory-bounded long-context Large Language Model (LLM) inference across Apple Silicon (MLX) and CUDA GPUs.

    Python 19 3

  2. CRBench CRBench Public

    CRBench is a method-agnostic benchmark for long-context LLMs that measures contextual capability retained relative to a dense reference alongside memory and system resource efficiency.

    Python

  3. RAG-Evaluation---Ablation-Study RAG-Evaluation---Ablation-Study Public

    RAG retrieval ablation study (semantic/hybrid/MMR) for stock-news QA; evaluates coverage, grounding, relevance. Zenodo: https://zenodo.org/records/19086005

    Python

  4. Company-Intelligence-Engine Company-Intelligence-Engine Public

    AI-powered analysis of SEC filings that produces structured company intelligence (risks, strengths, competitive advantage, outlook) using a hybrid retrieval + reranking pipeline and LLM reasoning c…

    Python 1 1