BioGlass: Seeing Your Inner State with Google Glass [website]

What if you could see what calms you down or increases your stress as you go through your day? What if you could see clearly what is causing these changes for your child or another loved one? People could become better at accurately interpreting and communicating their feelings, and better at understanding the needs of those they love. This project explores the possibilities of integrating biosensing technologies with Google Glass to enable fundamental advances for Affective Computing research in real-life settings. The first prototype enables people to see and respond to their autonomic stress in new ways with the ultimate goal of increasing (self-)awareness and improving regulation of stress in daily life.





Under Pressure: Sensing Stress of Computer Users [paper]

Recognizing when computer users are stressed can help reduce their frustration and prevent a large variety of negative health conditions associated with chronic stress. However, measuring stress non-invasively and continuously at work remains an open challenge. This work explores the possibility of using a pressure-sensitive keyboard and a capacitive mouse to discriminate between stressful and relaxed conditions in a laboratory study.





AutoEmotive: Bringing empathy to the driving experience [website, paper]

Regardless the emotional state of drivers, current cars feel impassive and disconnected. We believe that by adding emotion sensing technologies inside the car, we can dramatically improve the driving experience while increasing the safety of drivers. This work explores the landscape of possible applications when incorporating stress sensing devices in the car.





Enabling Visual Exploration of Long-term Physiological Data [paper]

With the recent development of wearable and comfortable biosensors, larger datasets of physiological data are being collected in challenging real-life scenarios. In order to gain insight from these datasets, behavioral scientists need tools that enable agile and efficient data exploration. In this work, we designed and implemented two visualization tools for large-scale time-based datasets, and combined the lessons learned to create a more general-purpose tool.




Reflecting on Your Inner State [paper, video]

This project presents a novel sensor system and interface that enables an individual to capture and reflect on their daily activities. The wearable system gathers both physiological responses and visual context through the use of a wearable biosensor and a cell-phone camera, respectively. Collected information is locally stored and securely transmitted to a novel digital mirror. Through interactive visualizations, this interface allows users to reflect not only on their outer appearance but also on their inner physiological responses to daily activities.





Measuring the Engagement of TV Viewers [paper]

This work studies the feasibility of using visual information to automatically measure the engagement level of TV viewers. Previous studies usually utilize expensive and invasive devices (e.g., eye trackers or physiological sensors) in controlled settings. This work differs by only using an RGB video camera in a naturalistic setting, where viewers move freely and respond naturally and spontaneously.




AMA: a tool for Annotation, Monitoring and Analysis of Challenging Behaviors
[paper, poster, software, abstract]

People diagnosed with Autism Spectrum Disorders (ASD) often have challenging behaviors (CBs), such as self-injury or property destruction, which negatively impacts their quality of life as well as that of those around them. Recent advances in mobile and ubiquitous technologies provide an opportunity to efficiently and accurately capture such behavioral information. The ability to obtain this type of data will help with both intervention and behavioral phenotyping efforts. With the collaboration of behavioral scientists and therapists, we identified the main design requirements and created an easy-to-use mobile application for collecting, labeling, and sharing in-situ CB data in individuals diagnosed with ASD.





Automatic Stress Recognition in Real-Life Settings
[paper, video, presentation]

Technologies to automatically recognize stress, are extremely important to prevent chronic psychological stress and the pathophysiological risks associated to it. The introduction of comfortable and wearable biosensors have created new opportunities to measure stress in real-life environments, but there is often great variability in how people experience stress and how they express it physiologically. In this project, we explore the use of pattern recognition to predict stress levels of call center employees.





MIT Mood Meter [paper, website, video, talk]

MIT Mood Meter is designed to assess and display the overall mood of the MIT community, by placing cameras at four different prime spots on the MIT campus. The cameras are equipped with affect-sensing software that counts number of people and whether they are smiling or not. This project is intended to raise awareness of how our own smiles can positively affect the surrounding environment, and to assess how congenial MIT is as a community. The dynamic, real-time information may lead to answers to questions such as: “Are people from one department happier than others?”, “Do midterms lower the mood?”, or “Does warmer weather lead to happiness?”







Multimodal Computational Behavior Analysis [website]

This project will define and explore a new research area we call Computational Behavior Science. More specifically, we hope to: (1) Enable widespread screening of autism by allowing non-experts to easily collect high-quality behavioral data and perform an initial assessment of risk status; (2) Improve behavioral therapy through increased availability and improved quality, by making it easier to track the progress of an intervention and follow guidelines for maximizing learning progress; and (3) Enable longitudinal analysis of a child's development based on quantitative behavioral data, using new tools for visualization.




Swinging with IMUs [paper]

Understanding if a movement is being executed correctly is important to a number of manipulation tasks. We present a preliminary study using inertial measurement units (IMUs) to evaluate the correct execution of squash swings, as well as discriminating them from similar racquet sport swings such as tennis and badminton. Additionally, we show some preliminary results that suggest that it is possible to detect at what point in time the movement was done incorrectly and why.




Reflective Agents with Distributed Adaptive Reasoning [website]

This project is funded by The Defense Advanced Research Projects Agency (DARPA) and seeks to create a "smart" computer that captures and evaluates ways in which expert users perform certain tasks. The computer then uses this knowledge in order to increase the productivity of non-expert users performing the same tasks.




Audio Analytic System for Gunshot Detection

The aim of this project is to develop an expert system capable of recognizing gunshots in audio files. We explore different types of audio features (e.g. Fast Fourier Transform, RASTA PLP) that are capable of characterizing the acoustic signatures of gunshots such as N-wave. Moreover, we compare the performance of Hidden Markov Models and Support Vector Machines.




Expert Combination for Result Forecasting [paper]

Standard ensemble methods do not explicitly consider the performance of experts to be variable across the problem domain. In contrast, this work proposes Specialized Weighted Majority. Specialists for each area of the feature space are created by augmenting experts with a classifier that chooses on which samples to vote.




Hot Flash Detection In Menopausal Women [paper 1, paper 2]

The hot flash is a sensation ranging from warmth to intense heat around the face, head, and neck. Populations experiencing hot flashes include male and female cancer patients, and most notably, women transitioning through menopause. Hot flashes are associated with impairments in quality of life and increased treatment seeking, and include contributions of both psychological and physiological factors in their experience and reporting. The goal of this project is to research temporal classifiers to predict hot flashes using several physiological measures (e.g. skin conductance, skin temperature, heat flux) and to understand which of the physiological factors are the most informative.




Forecasting the Anterior Cruciate Ligament Rupture Patterns

Complex knee injuries are common, often resulting from multiple forces (e.g. rotational, varus-valgus loading, anterior/posterior displacement). Identification of the specific injury pattern of the ACL (Anterior Cruciate Ligament) and other knee structures using non-invasive methods may improve pre-operative planning and guide treatment, reducing costs and facilitating high quality patient care. The main goal of this project is to present a classification system based on a set of non-invasive measures and state-of-the-art Machine Learning techniques to preempt the exact ACL rupture pattern. Standard classification techniques as Support Vector Machines (SVM) and Genetics Algorithms are combined for this purpose.




Reading Faces with Conditional Random Fields [paper]

The purpose of this work is to explore the use of Conditional Random Fields (CRFs) in the automatic recognition of the basic units of facial expression (aka. Action Units). Facial expression recognition is a complex problem aggravated by variability between the subjects and variability in the dynamics of expression. The discriminative nature of CRFs and their ability to capture temporal dependencies makes them well suited to tackle these two difficulties. To aid the recognition of subtle expressions, a combination of shape and appearance features is used.




Horse Recognition with Maximum Margin Classifiers

This work intends to develop a new kernel-based algorithm for horse recognition. The intuition behind this approach is that each horse has a set of distinctive features which may be different from other horses such as facial markings or color. With a unique structured sparse regularization, the proposed algorithm can be formulated as a non-smooth convex optimization problem.




Detecting Facial Features with Linear Programing [paper]

Identifying facial features (e.g. eye corners) on images is an important task for many computer vision applications like face recognition, facial expression recognition, tracking, and 3D face modeling from 2D images. Some of the current methods to detect facial keypoints are based on sophisticated classifiers. This project proposes a purely data-driven approach based on template matching. The novelty of this method is finding a final template which will be a linear combination of other templates.




Detection of Transparent Objects in Video [schematics, video]

This project aims to perform transparent object segmentation on cluttered environments from a sequence of images. The main idea is that standard algorithms such as MeanShift do not perform well with transparent objects due to their properties. Because of that, we use standard algorithms to detect possible outliers and find the transparent object.




Web application for human resources management [paper]

This project aims to develop a customized solution for managing the human resources of the 'Research Group in Intelligent Systems' from Ramon Llull University. With the objective of facilitating access to the application by all of its members, this project proposes a client-server implementation using LAMP (Linux + Apache + MySql + PhP). This project became my B.S thesis and earned an A with honors.