MIT: Independent Activities Period: IAP

IAP 2017



Build your own multi-touch pad (learn laser-cutting, basic electronics, and computer vision in 2 afternoons)

Stefanie Mueller, Assistant Professor EECS / MechE

Enrollment: Maximum 24 Participants.
Sign-up by 01/16
Limited to 24 participants
Attendance: Participants must attend all sessions
Prereq: hardware: none, software: basic programming knowledge

Learn laser cutting, electronics breadboard prototyping, soldering, and computer vision in only two afternoons. In this hands-on IAP, we will build a multi-touch pad using the principles of FTIR (Frustrated Total Internal Reflection).

In the first session, we are going to build the hardware of your device. In the second session, we will add the software, i.e., the finger tracking and gesture recognition. All you need to bring is your laptop, we take care of the rest.

You can find more information (including an image of what you will build) here:

http://groups.csail.mit.edu/hcie/iap-multitouch-pad.html

This IAP is organized by the HCI Engineering Group (HCIE). We are a new group at MIT CSAIL (starting January 2017) and build interactive software and hardware systems with a focus on advancing personal fabrication technologies.

Sponsor(s): Electrical Engineering and Computer Science
Contact: Stefanie Mueller, 32-312, STEFANIE.MUELLER@MIT.EDU


Hardware: Laser cutting / Electronics

Jan/19 Thu 02:00PM-06:00PM 32-311, bring your laptop

In the first session, you will build the hardware for your multi-touch pad. First, you will laser cut an acrylic sheet and use a heat gun to bend it into shape. After that, you will solder the USB connector, the LEDs and add a switch for turning the LEDs on/off. We will provide you with basic knowledge in electronics and give an intro to Arduino. Finally, you will add a camera that we will use for tracking the fingers.


Gesture Recognition / Computer Vision

Jan/20 Fri 02:00PM-06:00PM 32-311, bring your laptop

In the second session, you will use computer vision to track finger gestures on your multi-touch pad using the attached camera. For this, we will give an intro to computer vision with OpenCV (color-space conversions, thresholding, blob detection). At the end, we will host a contest for the best example application with some unique prizes for the most creative solutions.