Thanh Loi Hoang
Graduate Research Engineer · Software Engineer · Seoul, South Korea
Summary
I work on the GPU layer underneath Kubernetes AI workloads. GPUs are the scarcest resource in a cluster and the hardest to divide well, so the work runs across three connected problems: sharing one device between workloads, scheduling those workloads onto hardware that suits them, and making GPU behavior visible once they are running.
I'm at the Cloud Native x AI Laboratory in Seoul, building the ML platform and researching how GPUs are shared and scheduled across heterogeneous hardware, and how their usage is monitored and profiled per workload.
Kubernetes since 2024, AI infrastructure since 2025. Before Seoul I was a system engineer in Hanoi, deploying OpenShift clusters for banking environments and designing VMware virtualization architectures with customers. Earlier, as a student researcher, I worked on SDN, network devices, and OpenStack.
Experience
Software Engineer & Technical Partner
Jul 2026 — PresentHyeraEdu · Remote
- Designed the end-to-end technical architecture of a multi-service web platform supporting learning, content, and service-oriented workflows.
- Engineered, developed, and integrated the platform's application components.
- Containerized and deployed the platform, managing the application stack and production environment.
Graduate Research Engineer
Mar 2025 — PresentCloud Native x AI Laboratory, Soongsil University · Seoul, South Korea
- Worked on the design and development of a Kubernetes-based platform for machine learning workloads.
- Built internal tools to make common workflows easier to use and manage.
- Integrated core infrastructure components for deployment, data handling, and workload execution.
- Evaluated different approaches to managing compute-intensive workloads and improving resource efficiency.
- Added monitoring capabilities to improve visibility into platform and workload behavior.
System Engineer
Jun 2024 — Feb 2025FPT IS · Hanoi, Vietnam
- Assessed customers' existing infrastructure and collaborated with stakeholders to design tailored VMware virtualization architectures for each deployment.
- Deployed and configured VMware-based virtualization environments, including servers, storage, and physical-to-virtual or virtual-to-virtual migrations.
- Performed end-to-end OpenShift cluster deployments for banking environments, from VM preparation and prerequisite configuration to cluster installation and platform component setup.
DevOps Engineer
Jul 2023 — Dec 2023Viettel Networks · Hanoi, Vietnam
- Developed a data pipeline to retrieve personal activity and fitness data through authenticated Strava API requests, transform it, and store it in MySQL.
- Built a web-based interface to query and visualize stored activity data, containerized with Docker Compose for reproducible deployment.
Student Researcher
Oct 2022 — Sep 2023Telecommunication System Laboratory · Hanoi, Vietnam
- Implemented a small-scale software-defined networking (SDN) testbed using physical hosts and network switches.
- Deployed and integrated OpenDaylight and Tungsten Fabric with OpenStack, and evaluated system and inter-VM network performance.
Education
Integrated M.S.–Ph.D., Information Technology and Telecommunications
Mar 2025 — PresentSoongsil University · Seoul, South Korea
- GPA:
- 4.34/4.5
- Advisor:
- Prof. Young-Han Kim
- GPU Sharing & Scheduling
- Cloud-Native Infrastructure
- ML Systems
B.S., Computer Systems Networking and Telecommunications
Sep 2020 — Jun 2024Vietnam National University · Hanoi, Vietnam
- Advisor:
- Assoc. Prof. Dinh Thi Thai Mai
- Computer Networks
- Virtualization
- Software-Defined Networking
Publications
Synchronous Distributed Training with Runtime-Adaptive Mechanisms in Hybrid Cloud Environments
T. A. Vuong, T. L. Hoang, H. Le, Y. H. Kim
IEEE Access · 2026
A Design for Continuous Low-Overhead CUDA-API Observability in Kubernetes GPU-Sharing Systems
T. L. Hoang, Y. H. Kim
KICS Summer Conference · 2026
A Design of Cloud-based Personal Machine Learning Workspace
T. L. Hoang, T. N. D. Thong, Y. H. Kim
KICS Summer Conference · 2025
A Comparison of Two SDN Controllers Integration in OpenStack Environment
T. L. Hoang, D. Q. Pham, T. T. M. Dinh
International Conference on Intelligent Systems & Networks (ICISN) · 2025
Performance Evaluation of OpenStack Cloud Integrated with SDN Controller
M. T. T. Dinh, T. L. Hoang, Q. D. Pham, D. N. Nguyen
REV Journal on Electronics & Communications · 2024
Evaluation of Network Performance between Virtual Machines on Cloud Computing integrating SDN Controllers on Virtual Environments (in Vietnamese)
T. L. Hoang, Q. D. Le, T. P. D. Chu, T. T. M. Dinh
REV-ECIT · 2023
Honors & Awards
- 2025Fully Funded Scholarship, Integrated M.S.–Ph.D. Program — Soongsil University, Seoul, South Korea
- 2024Excellence in Graduation Thesis Defense — Vietnam National University, Hanoi, Vietnam
- 2023Academic Incentive Scholarship — Vietnam National University, Hanoi, Vietnam
- 2022Academic Incentive Scholarship — Vietnam National University, Hanoi, Vietnam
Skills
GPU & Accelerators
- CUDA
- GPU Sharing
- GPU Scheduling
- GPU Telemetry
Kubernetes
- Kubernetes
- OpenShift
- Helm
- Batch Scheduling
- ML Platforms
Observability
- Prometheus
- Grafana
- CUDA API Tracing
Infrastructure & Networking
- Docker
- Ansible
- VMware ESXi
- vCenter
- OpenStack
- SDN
Architecture & Design
- Solution Architecture
- Systems Design
- Technical Documentation
Languages
- Go
- Python
- C/C++
- Bash
- MySQL
Certifications
- Python for Everybody — Coursera, 2025
Languages
- VietnameseNative
- EnglishProfessional working proficiency
- KoreanBeginner