Research Experience

FusionFly: Intelligent Positioning Data Standardization and Fusion System Using Large Language Models

Time: Mar. 2024 – now (in progress)
Collaborator: Max LEE (PhD Candidate at IPNL)
Supervisor: Dr. Li-ta HSU
Phase I: Expected to publish and present at International Conference on Indoor Positioning and Indoor Navigation (IPIN) 2024
Phase II: Patented & Tier 1 journal publication

Phase I Duty

Implementing Ultra-Wideband (UWB) positioning systems, including data acquisition via serial port communication with ROS Noetic, and ensuring real-time data transfer using application programming interfaces (APIs).
Developing a process for the automated transmission of images from an iPhone using APIs, leveraging the Shortcuts app for workflow automation.
Enhancing the capabilities of Large Language Models, which encompasses the fine-tuning of models such as GPT-4 with vision features, and Claude 3-opus, and prompt engineering to achieve sensor data format standardization.
Experiment environment setup and tuning.
Assist in sensor fusing, UI/UX building.
and more…

Company: LifeSparrow Solutions Limited
Time: Mar. 2024 – May 2024
Location: Unit 1007, 10/F, Building 19W, 19 Science Park W Ave, Pak Shek Kok, N.T., Hong Kong

Duty

Assist in developing AI models for drone imagery using Python, and NVIDIA DeepStream SDK.
Participate in AR/VR simulations for enhancing AI training processes.
Contribute to crafting intuitive UI/UX for web interfaces that interact with drone data.
Collaborate on diverse projects, gaining a holistic experience across various tech spectrums.