Research Experience

Research Showcase

Dynamic Path Planning

Panomera Image Segmentation

LLM-based EKF Fusion

Feature Extraction & Matching

Indoor Camera Positioning via Spherical Panorama, BIM and LLMs Integration

Dynamic Sensor Weighting for Seamless Positioning with Multimodal Large Language Models

A Wind Tunnel Study of Airflow through Horticultural Crops

Time: July 2024 – August 2024
Location: Research Group Sustainable Thermo-Fluid Energy Systems, Ghent University, Belgium
Supervisor: Wito Plas, PhD Candidate, Prof. Michel De Paepe

Duties

Training in the LabView environment
Understanding the existing LabView program and program to record experiment data
Tuning PiD’s for smooth operation of the setup
Performing lab tests in wind tunnel, collect data and do data processing in order to verify the CFD model

Automated Data Standardization using Large Language Models

Time: March 2024 – now (in progress)
Co-author: Max Lee (PhD Candidate at the IPN Lab)
Supervisor: Dr. Li-ta Hsu
Output: Conference Paper (IPIN 2024, IEEE/ION 2025), JCR Q1 Journal (working)
Open-sourced dataset: https://github.com/Thorkee/IntelliSP (will be public soon)

Duties

Implementing Ultra-Wideband (UWB) positioning systems, including data acquisition via serial port communication with ROS Noetic, and ensuring real-time data transfer using application programming interfaces (APIs).
Developing a process for the automated transmission of images from an iPhone using APIs, leveraging the Shortcuts app for workflow automation.
GNSS data API streaming from U-blox F9P to API endpoint using self-construct python script.
Enhancing the capabilities of Large Language Models, which encompasses the fine-tuning of models such as GPT-35 Turbo, GPT-4 with vision, and Claude 3-opus, and prompt engineering to achieve sensor data format standardization. The finetuning dataset will be open-sourced.
Define and refine the unit tests for data integrity.
Experiment environment setup and testing.
Assist in sensor fusing using Extended Kalman Filter, or Factor Graph Optimization, frontend UI/UX building.
and more…

AI, AR/VR & UI/UX Development Intern for Drone Tech

Company: LifeSparrow Solutions Limited
Time: March 2024 – August 2024
Location: Unit 1007, 10/F, Building 19W, 19 Science Park W Ave, Pak Shek Kok, N.T., Hong Kong

Duties

Assist in developing AI models for drone imagery using Python, and NVIDIA DeepStream SDK.
Participate in AR/VR simulations for enhancing AI training processes.
Contribute to crafting intuitive UI/UX for web interfaces that interact with drone data.
Collaborate on diverse projects, gaining a holistic experience across various tech spectrums.