portfoliodev

Tapon Kumer Ray — Research Portfolio
// Researcher · Builder · Collaborator

Tapon
Kumer Ray

Final-year CSE undergraduate at VIT-AP, India. Focused on Human-Computer Interaction, AR Interfaces, and Intelligent Agents. Publishing in multimodal AI, context-aware systems, and adaptive UX.

Human-Computer Interaction AR Interfaces Multimodal AI Reinforcement Learning User-Centered Design Intelligent Agents

7
Research Papers
8.2
GPA / 10.0
2+
Years Research Exp.
3
Intl. Conferences

01

Research Experience

MAY 2024 – DECEMBER 2025
Undergraduate Research Assistant
AIR Center · VIT-AP University, Amaravati — Advisor: Dr. Rajkumar Yesuraj
  • Implemented AR-based simulation frameworks in Unity + ROS + OpenCV to support experiments on context-aware adaptive interfaces.
  • Developed data pipelines for multimodal input (speech, gesture, visual signals) and performed statistical analysis using Python/SPSS.
  • Integrated prototype adaptive decision-making models with reinforcement learning and rule-based policies for proof-of-concept testing.
AUGUST 2023 – JULY 2024
Project Assistant
IIEC Center · VIT-AP University, Amaravati — Advisor: Dr. Guruprakash Jayabalasamy
  • Investigated adaptive user interface models in AR-supported human-robot collaboration environments.
  • Conducted a structured literature review for a survey on vision-language interaction models in HCI.
  • Collaborated on experiment design for evaluating multimodal adaptive systems.

02

Publications

01
Synchronous Emotional Dynamics in Human-AI Collaborative Networks: A Temporal Graph Neural Network Approach
IEEE CICN · Conference Proceedings · 2025
Published
02
XMACNet: An Explainable Lightweight Attention based CNN with Multi-Modal Fusion for Chili Disease Classification
Springer LNICST · Conference Proceedings · 2025
Published
03
Segment-Based Dynamic Programming for Optimal Binary Search Trees: A Sub-Cubic Algorithm (NCUR 2026)
National Conference on Undergraduate Research (NCUR) · Presentation · 2026
Presented
04
A Comprehensive Survey on Human Behavior Prediction by Speech, Emotion and Gesture using Deep Learning
Journal of Ambient Intelligence and Humanized Computing · Under Review
Under Review
05
Context-Aware Emotionally Adaptive Voice Assistants: A Multi-Modal Framework for Empathetic Human-Agent Interaction
Journal of Automation and Intelligence · Under Review
Under Review
06
Interactive Ethical Constraint Specification for LLM Decision Support: A Human-Centered Algorithmic Framework
Autonomous Agents and Multi-Agent Systems · Under Review
Under Review
07
Segment-Based Dynamic Programming for Optimal Binary Search Trees: A Sub-Cubic Algorithm with Hierarchical Weight Partitioning
Springer Algorithmica · Under Review · 2026
Under Review

03

Projects

🧠
Context-Aware Decision Making Agent for Smart Assistants

Capstone project deploying multimodal signal fusion (voice, wearables) with on-device processing and RL-based adaptive policies, ensuring real-time, privacy-preserving smart assistant interactions.

PyTorch RL On-Device AI Multimodal
🤖
AR-Enhanced Human-Robot Collaboration Interface

Multimodal interface design using Unity and ROS to support spatial collaboration and task-switching with context-aware feedback in AR-supported environments.

Unity ROS OpenCV AR
👁
Machine Vision-Based Third Eye for Safe Driving

Non-invasive eye-tracking interaction model using WebGazer.js and OpenCV to enable navigation in constrained environments, developed as part of Engineering Clinics.

WebGazer.js OpenCV Eye-Tracking HCI

04

Technical Skills

Languages
Python Java R JavaScript MATLAB SQL
Frameworks
PyTorch TensorFlow Keras Scikit-learn Hugging Face StyleGAN
Tools & Platforms
NumPy Pandas SciPy SPSS RStudio Unity OpenCV ROS
Design & Workflow
Figma Adobe XD Tableau Git LaTeX Jupyter Mendeley Zotero

05

Awards & Recognition

2026
🌎
Selected — Student Mentoring Workshop (SMeW), ICSE 2026 · Rio de Janeiro, Brazil
International
2026
✏️
Student Volunteer — POPL 2026 (Principles of Programming Languages) · Rennes, France
Volunteer
2023
🏆
Finalist — National Level MARK-XXIV Hackathon · Woxsen University, India
Finalist
2022
🎓
Merit-Based — International Scholarship for Education & Enrichment (I-SEE) · VIT University, India
Scholarship

Let's Collaborate

// Open to research collaborations, internships & PhD positions