Thanh Loi Hoang

Graduate Research Engineer · Software Engineer · Seoul, South Korea

Download

Summary

I work on the GPU layer underneath Kubernetes AI workloads. GPUs are the scarcest resource in a cluster and the hardest to divide well, so the work runs across three connected problems: sharing one device between workloads, scheduling those workloads onto hardware that suits them, and making GPU behavior visible once they are running.

I'm at the Cloud Native x AI Laboratory in Seoul, building the ML platform and researching how GPUs are shared and scheduled across heterogeneous hardware, and how their usage is monitored and profiled per workload.

Kubernetes since 2024, AI infrastructure since 2025. Before Seoul I was a system engineer in Hanoi, deploying OpenShift clusters for banking environments and designing VMware virtualization architectures with customers. Earlier, as a student researcher, I worked on SDN, network devices, and OpenStack.

Experience

  1. Software Engineer & Technical Partner

    Jul 2026 — Present

    HyeraEdu · Remote

    • Designed the end-to-end technical architecture of a multi-service web platform supporting learning, content, and service-oriented workflows.
    • Engineered, developed, and integrated the platform's application components.
    • Containerized and deployed the platform, managing the application stack and production environment.
  2. Graduate Research Engineer

    Mar 2025 — Present

    Cloud Native x AI Laboratory, Soongsil University · Seoul, South Korea

    • Worked on the design and development of a Kubernetes-based platform for machine learning workloads.
    • Built internal tools to make common workflows easier to use and manage.
    • Integrated core infrastructure components for deployment, data handling, and workload execution.
    • Evaluated different approaches to managing compute-intensive workloads and improving resource efficiency.
    • Added monitoring capabilities to improve visibility into platform and workload behavior.
  3. System Engineer

    Jun 2024 — Feb 2025

    FPT IS · Hanoi, Vietnam

    • Assessed customers' existing infrastructure and collaborated with stakeholders to design tailored VMware virtualization architectures for each deployment.
    • Deployed and configured VMware-based virtualization environments, including servers, storage, and physical-to-virtual or virtual-to-virtual migrations.
    • Performed end-to-end OpenShift cluster deployments for banking environments, from VM preparation and prerequisite configuration to cluster installation and platform component setup.
  4. DevOps Engineer

    Jul 2023 — Dec 2023

    Viettel Networks · Hanoi, Vietnam

    • Developed a data pipeline to retrieve personal activity and fitness data through authenticated Strava API requests, transform it, and store it in MySQL.
    • Built a web-based interface to query and visualize stored activity data, containerized with Docker Compose for reproducible deployment.
  5. Student Researcher

    Oct 2022 — Sep 2023

    Telecommunication System Laboratory · Hanoi, Vietnam

    • Implemented a small-scale software-defined networking (SDN) testbed using physical hosts and network switches.
    • Deployed and integrated OpenDaylight and Tungsten Fabric with OpenStack, and evaluated system and inter-VM network performance.

Education

Integrated M.S.–Ph.D., Information Technology and Telecommunications

Mar 2025 — Present

Soongsil University · Seoul, South Korea

GPA:
4.34/4.5
Advisor:
Prof. Young-Han Kim
  • GPU Sharing & Scheduling
  • Cloud-Native Infrastructure
  • ML Systems

B.S., Computer Systems Networking and Telecommunications

Sep 2020 — Jun 2024

Vietnam National University · Hanoi, Vietnam

Advisor:
Assoc. Prof. Dinh Thi Thai Mai
  • Computer Networks
  • Virtualization
  • Software-Defined Networking

Publications

  1. Synchronous Distributed Training with Runtime-Adaptive Mechanisms in Hybrid Cloud Environments

    T. A. Vuong, T. L. Hoang, H. Le, Y. H. Kim

    IEEE Access · 2026

  2. A Design for Continuous Low-Overhead CUDA-API Observability in Kubernetes GPU-Sharing Systems

    T. L. Hoang, Y. H. Kim

    KICS Summer Conference · 2026

  3. A Design of Cloud-based Personal Machine Learning Workspace

    T. L. Hoang, T. N. D. Thong, Y. H. Kim

    KICS Summer Conference · 2025

  4. A Comparison of Two SDN Controllers Integration in OpenStack Environment

    T. L. Hoang, D. Q. Pham, T. T. M. Dinh

    International Conference on Intelligent Systems & Networks (ICISN) · 2025

  5. Performance Evaluation of OpenStack Cloud Integrated with SDN Controller

    M. T. T. Dinh, T. L. Hoang, Q. D. Pham, D. N. Nguyen

    REV Journal on Electronics & Communications · 2024

  6. Evaluation of Network Performance between Virtual Machines on Cloud Computing integrating SDN Controllers on Virtual Environments (in Vietnamese)

    T. L. Hoang, Q. D. Le, T. P. D. Chu, T. T. M. Dinh

    REV-ECIT · 2023

Honors & Awards

  • 2025Fully Funded Scholarship, Integrated M.S.–Ph.D. Program — Soongsil University, Seoul, South Korea
  • 2024Excellence in Graduation Thesis Defense — Vietnam National University, Hanoi, Vietnam
  • 2023Academic Incentive Scholarship — Vietnam National University, Hanoi, Vietnam
  • 2022Academic Incentive Scholarship — Vietnam National University, Hanoi, Vietnam

Skills

GPU & Accelerators

  • CUDA
  • GPU Sharing
  • GPU Scheduling
  • GPU Telemetry

Kubernetes

  • Kubernetes
  • OpenShift
  • Helm
  • Batch Scheduling
  • ML Platforms

Observability

  • Prometheus
  • Grafana
  • CUDA API Tracing

Infrastructure & Networking

  • Docker
  • Ansible
  • VMware ESXi
  • vCenter
  • OpenStack
  • SDN

Architecture & Design

  • Solution Architecture
  • Systems Design
  • Technical Documentation

Languages

  • Go
  • Python
  • C/C++
  • Bash
  • MySQL

Certifications

  • Python for Everybody — Coursera, 2025

Languages

  • VietnameseNative
  • EnglishProfessional working proficiency
  • KoreanBeginner