LapTeach

Tele-Scope-Mentoring for LapMan

CLIENT: Medsys, as a Multitel Research Engineer

DESCRIPTION
The LapTeach application was requested by Medsys as part of their training solutions.
It is a module developed for the LapMan to enable Tele-Scope-Mentoring (TSM).
It allows the mentor to visualise the images from the operation room in real-time, and to remotely take control of the LapMan to share expertise with the surgeon at work. It also allows users to draw simple 2D shapes in real-time overlayed to the video in order to provide directions to other users.

ROLE
As a Software Developer, I was mostly responsible for the server side of the application. Its role was to receive the video streams, encode them and transfer them to the connected clients.
Additionally to the video, data streams were handled, containing 2D geometric data created by users (to be added as overlay on the video in real-time on the client-side).
I also did some work on the client side, related to the user interface and visual overlays.
The server side part of the application was developed in C++ (using the ffmpeg library for encoding/decoding), the client side was developed in Java (using Java OpenGL binding API).