cv
Bio
Name | Rachel Teo Si Yan |
rachel.tsy@u.nus.edu | |
Phone | +65 8366 4184 |
Url | https://github.com/rachtsy |
Summary | A 2nd-year PhD student doing machine learning at the National University of Singapore. |
Work
-
May 2018 - Nov 2018 Intern
SINAPSE
- Used Principle Component Analysis (PCA) and Linear Discriminant Analysis (LDA) in Matlab to reduce dimensions of large datasets and perform classification analysis.
- Datasets consisted of spike trains of neurons in monkeys' brains that were recorded as they performed a working memory task.
- Simple classification analysis was used to understand the mechanism of neurons during the engagement of working memory.
-
Jun 2019 - Jul 2019 Intern
DBS Bank
- Contributed to the building of an acquisition model for Paylah! customers in the Consumer Banking Analytics department.
- Used SAS and SQL to extract and create the variables discussed from the DBS database.
-
Aug 2019 - Dec 2019 Intern
Axis Capital
- Worked full-time under the Catastrophe Modelling (CAT) team in re-insurance.
- Ran Catastrophe models and performed preliminary analytical reports using industry-specific software.
- Used various internal tools to assist the pricing process within the CAT team.
- Created tools and scripts with Python to ease the process of data extraction for use in the model and analysis.
-
2021 - 2023 Full-time Industrial Engineer
Murata Electronics Singapore
- Performed data analysis for the cost management of the manufacturing of ceramic capacitors.
- Innovated new methods to understand the cost structure and effectively manage profit/loss statements.
- Presented and explained to management the linkage of profit/loss statements to production operations.
- Improved efficiency and productivity of analysis through programming.
Education
-
2023 - present Singapore
-
2017 - 2021 Singapore
B.S. in Applied Mathematics
National University of Singapore
Specialization in Mathematical Modeling and Data Analysis
Awards
- Dec 2018
- May 2021
Publications
-
2024.10.30 Elliptical Attention
Stefan Nielsen*, Laziz Abdullaev*, Rachel S.Y. Teo, Tan M. Nguyen
In Conference on Neural Information Processing Systems (NeurIPS), 2024.
-
2024.10.30 Unveiling the Hidden Structure of Self-Attention via Kernel Principal Component Analysis
Rachel S.Y. Teo, Tan M. Nguyen
In Conference on Neural Information Processing Systems (NeurIPS), 2024
-
2024.10.30 MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts
Rachel S.Y. Teo, Tan M. Nguyen
In Conference on Neural Information Processing Systems (NeurIPS), 2024
Skills
Pytorch |
JAX |
Tensorflow |
R |
Matlab |
SQL/SAS |
Microsoft | |
Excel | |
Powerpoint | |
Word |
Languages
English | |
Native speaker |
Chinese | |
Adequate |
Interests
Deep Learning | |
Transformers | |
Mixture of Experts | |
Parameter Efficient Fine-Tuning |