Multi-Modal Deep Learning

Knee Osteoarthritis Prediction and Progression

A unified decision-support system integrating medical imaging, clinical biomarkers, and wearable IoT sensors for early detection and long-term monitoring of Knee Osteoarthritis.

KneeCare Technology
Vibration Analysis
AI-Driven Grading

Research Domain

Bridging clinical assessment, medical imaging, and continuous patient monitoring through advanced AI.

Literature Survey

Analysis of AI in KOA diagnosis using clinical databases, blood biomarkers, and CNN-based radiographic assessment (Kellgren-Lawrence grading).

Research Gap

Conventional methods rely on single-modality info and lack continuous monitoring, making real-life progression tracking difficult.

Research Problem

High cost of MRI/X-ray and impracticality of frequent hospital visits for elderly patients requiring long-term monitoring.

Research Objectives

Developing low-cost, explainable monitoring systems using IoT sensors and multimodal data fusion for clinical decision support.

Methodology

Phased approach: Clinical prediction (XGBoost), Binary Classification (YOLOv8), Severity Grading (EfficientNetB0), and IoT Wearable Monitoring.

Technologies Used

Python, TensorFlow, YOLOv8, XGBoost, ESP32, MPU6050 (Vibration), and MLX90614 (Thermal) sensors.

Project Milestones

Following our journey from the initial proposal to the final assessment. Each milestone represents a key phase in our research, design, and development process.

February 2025
Milestone 1

Project Proposal

Initial project proposal presentation outlining the research problem, objectives, and feasibility analysis.

May 2025
Milestone 2

Progress Presentation 1

First progress review covering literature survey completion, system design, and initial prototype development.

September 2025
Milestone 3

Progress Presentation 2

Second progress review demonstrating ML model training results, system integration, and testing outcomes.

January 2026
Milestone 4

Final Assessment

Final project assessment with complete system demonstration, evaluation metrics, and documentation review.

April 2026
Milestone 5

Viva & Demonstration

Final viva voce examination presenting research contributions, findings, and future recommendations.

Downloads

Access our collection of documents and presentations available in PDF and PPTX format. Click on any file to download.

Project Charter

TAF_25-26J-112.pdf

PDF Document

Proposal Documents

IT22223708_Proposal_Report.pdf

PDF Document

IT22188472_Proposal_Report.pdf

PDF Document

IT22582942_Proposal_Report.pdf

PDF Document

IT22606792_Proposal_Report.pdf

PDF Document

Check List Documents

Master Sheet - Studied Papers.xlsx

Excel Document

Data Analysis Report.pdf

PDF Document

Final Documents

No documents available yet.

Presentations

PP1.pptx

PowerPoint Presentation

Research Team

The innovators behind the KneeCare platform.

Supervisor

Jenny Krishara

Supervisor

Co-supervisor

Thamali Dassanayake

Co-supervisor

Fernando W.D.A

Fernando W.D.A

Full stack developer

IT22223708

Jayasinghe J.M.N.S.

Jayasinghe J.M.N.S.

Data Analyst

IT22582942​

Perera B.B.A.R

Perera B.B.A.R

ML Engineer

IT22606792​

Gamage D.M.G.P.K

Gamage D.M.G.P.K

IoT Developer

IT22188472​

Contact Us

For research collaborations or inquiries regarding the KneeCare system.

+94 11 234 5678
info@kneecare.edu
National Hospital, Colombo, Sri Lanka