I am a member of technical staff at xAI. I lead the Data Scaling team, working across pre-training data, data infrastructure, batch inference, synthetic data generation, multi-agent systems, and agentic search.
I obtained my Ph.D. in computer science from the University of California, Berkeley in 2024. I was advised by Professor Ion Stoica. My dissertation is on An Extensible Architecture for Distributed Heterogeneous Processing. Before that, I worked at Facebook from 2017 to 2019. I obtained my bachelor's degrees in computer science and statistics from the University of Chicago in 2017.
I am an instrument-rated private pilot with over 500 hours of flight experience.
xAI
Member of Technical Staff
Anthropic
Member of Technical Staff
Wayo
Co-founder & CTO
UC Berkeley
Ph.D. in Computer Science
Research Engineer
SketchMe
Co-founder & CTO
University of Chicago
B.S. in Computer Science & B.A. in Statistics
Frank Sifei Luan, Ron Yifeng Wang, Yile Gu, Ziming Mao, Charlotte Lin, Amog Kamsetty, Hao Chen, Cheng Su, Balaji Veeramani, Scott Lee, SangBin Cho, Clark Zinzow, Eric Liang, Ion Stoica, Stephanie Wang
arXiv (Jan 2025)
A hybrid of batch and streaming that enables efficient and fault-tolerant heterogeneous execution, implemented in Ray Data.
Frank Sifei Luan
UC Berkeley EECS Technical Reports (Dec 2024)
My Ph.D. dissertation.
Sifei Luan, Samyukta Yagati, Stephanie Wang, Sean Kim, Kenneth Lien, Isaac Ong, Tony Hong, SangBin Cho, Eric Liang, Ion Stoica
SIGCOMM 2023 (Sep 2023)
An extensible shuffle architecture that offers competitive performance and scalability as well as greater flexibility than monolithic shuffle systems.
Sifei Luan, Samyukta Yagati, Stephanie Wang, Sean Kim, Kenneth Lien, Isaac Ong, Tony Hong, SangBin Cho, Eric Liang, Ion Stoica
arXiv (Jan 2023)
Winner of the 2022 CloudSort Benchmark (Indy category) for sorting 100TB data at $0.97/TB.
Zongheng Yang, Wei-Lin Chiang, Sifei Luan, Gautam Mittal, Michael Luo, Ion Stoica
SIGMOD 2022 (Jun 2022)
A query optimizer built by deep reinforcement learning.
Stephanie Wang, Eric Liang, Edward Oakes, Ben Hindman, Sifei Luan, Audrey Cheng, Ion Stoica
NSDI 2021 (Apr 2021)
A decentralized object metadata ownership system for fine-grained distributed tasks.
Johannes Bader, Sonia Seohyun Kim, Sifei Luan, Satish Chandra, Erik Meijer
IEEE Software (Feb 2021)
Three productivity tools that learn patterns from software artifacts that we deployed at Facebook.
🏆 2021 IEEE Computer Society IEEE Software Magazine Best Paper Award
Zongheng Yang, Amog Kamsetty, Sifei Luan, Eric Liang, Yan Duan, Xi Chen, Ion Stoica
VLDB 2020 (Jun 2020)
A join cardinality estimator that builds a single neural density estimator over an entire database.
Sifei Luan, Di Yang, Celeste Barnaby, Koushik Sen, Satish Chandra
OOPSLA 2019 (Oct 2019)
A tool and technique for code recommendation in big code corpora to improve developer productivity.
🏆 2019 ACM SIGPLAN Distinguished Paper Award
Saksham Sachdev, Hongyu Li, Sifei Luan, Seohyun Kim, Koushik Sen, Satish Chandra
MAPL 2018 (Jun 2018)
A technique for searching over large codebases using natural language queries.
Stephanie Wang, Frank Luan
Oct 2023
This talk covers the history and design of the Ray dataplane, its role in Ray Data and related libraries, and how it enabled breaking the Cloudsort world record by sorting 100 TB for less than $1 per TB in the cloud.
Frank Luan, Celeste Barnaby
Jul 2019
We created two techniques that apply machine learning to code discovery problems: Neural Code Search (NCS) and Aroma.
Johannes Bader, Satish Chandra, Sonia Seohyun Kim, Frank Luan
May 2019
At Facebook, we use machine learning to discover patterns in code and build tools that improve developer productivity.