Design and implementation of a 3D computer game controller using inertial MEMS sensors

Though 3D computer graphics has seen tremendous advancement in the past two decades, most available mechanisms for computer interaction in 3D are high cost and targeted for industry and virtual reality applications. Recent advances in Micro-Electro-Mechanical-System (MEMS) devices have brought forth a variety of new low-cost, low-power, miniature sensors with high accuracy, which are well suited for hand-held devices. In this work a novel design for a 3D computer game controller using inertial sensors is proposed, and a prototype device based on this design is implemented. The design incorporates MEMS accelerometers and gyroscopes from Analog Devices to measure the three components of the acceleration and angular velocity. From these sensor readings, the position and orientation of the hand-held compartment can be calculated using numerical methods. The implemented prototype is utilizes a USB 2.0 compliant interface for power and communication with the host system. A Microchip dsPIC microcontroller is used in the design. This microcontroller integrates the analog to digital converters, the program memory flash, as well as the core processor, on a single integrated circuit. A PC running Microsoft Windows operating system is used as the host machine. Prototype firmware for the microcontroller is developed and tested to establish the communication between the design and the host, and perform the data acquisition and initial filtering of the sensor data. A PC front-end application with a graphical interface is developed to communicate with the device, and allow real-time visualization of the acquired data.

Inductive-Capacitive Resonant Circuit Sensors for Structural Health and Environmental Monitoring

Inductive-capacitive (LC) resonant circuit sensors are low-cost, wireless, durable, simple to fabricate and battery-less. Consequently, they are well suited to sensing applications in harsh environments or in situations where large numbers of sensors are needed. They are also advantageous in applications where access to the sensor is limited or impossible or when sensors are needed on a disposable basis. Due to their many advantages, LC sensors have been used for sensing a variety of parameters including humidity, temperature, chemical concentrations, pH, stress/pressure, strain, food quality and even biological growth. However, current versions of the LC sensor technology are limited to sensing only one parameter. The purpose of this work is to develop new types of LC sensor systems that are simpler to fabricate (hence lower cost) or capable of monitoring multiple parameters simultaneously. One design presented in this work, referred to as the multi-element LC sensor, is able to measure multiple parameters simultaneously using a second capacitive element. Compared to conventional LC sensors, this design can sense multiple parameters with a higher detection range than two independent sensors while maintaining the same overall sensor footprint. In addition, the two-element sensor does not suffer from interference issues normally encountered while implementing two LC sensors in close proximity. Another design, the single-spiral inductive-capacitive sensor, utilizes the parasitic capacitance of a coil or spring structure to form a single layer LC resonant circuit. Unlike conventional LC sensors, this design is truly planar, thus simplifying its fabrication process and reducing sensor cost. Due to the simplicity of this sensor layout it will be easier and more cost-effective for embedding in common building or packaging materials during manufacturing processes, thereby adding functionality to current products (such as drywall sheets) while having a minor impact on overall unit cost. These modifications to the LC sensor design significantly improve the functionality and commercial feasibility of this technology, especially for applications where a large array of sensors or multiple sensing parameters are required.

DESIGN AND IMPLEMENT DYNAMIC PROGRAMMING BASED DISCRETE POWER LEVEL SMART HOME SCHEDULING USING FPGA

With the development and capabilities of the Smart Home system, people today are entering an era in which household appliances are no longer just controlled by people, but also operated by a Smart System. This results in a more efficient, convenient, comfortable, and environmentally friendly living environment. A critical part of the Smart Home system is Home Automation, which means that there is a Micro-Controller Unit (MCU) to control all the household appliances and schedule their operating times. This reduces electricity bills by shifting amounts of power consumption from the on-peak hour consumption to the off-peak hour consumption, in terms of different “hour price”. In this paper, we propose an algorithm for scheduling multi-user power consumption and implement it on an FPGA board, using it as the MCU. This algorithm for discrete power level tasks scheduling is based on dynamic programming, which could find a scheduling solution close to the optimal one. We chose FPGA as our system’s controller because FPGA has low complexity, parallel processing capability, a large amount of I/O interface for further development and is programmable on both software and hardware. In conclusion, it costs little time running on FPGA board and the solution obtained is good enough for the consumers.

Automatic Food Intake Assessment Using Camera Phones

Obesity is becoming an epidemic phenomenon in most developed countries. The fundamental cause of obesity and overweight is an energy imbalance between calories consumed and calories expended. It is essential to monitor everyday food intake for obesity prevention and management. Existing dietary assessment methods usually require manually recording and recall of food types and portions. Accuracy of the results largely relies on many uncertain factors such as user's memory, food knowledge, and portion estimations. As a result, the accuracy is often compromised. Accurate and convenient dietary assessment methods are still blank and needed in both population and research societies. In this thesis, an automatic food intake assessment method using cameras, inertial measurement units (IMUs) on smart phones was developed to help people foster a healthy life style. With this method, users use their smart phones before and after a meal to capture images or videos around the meal. The smart phone will recognize food items and calculate the volume of the food consumed and provide the results to users. The technical objective is to explore the feasibility of image based food recognition and image based volume estimation. This thesis comprises five publications that address four specific goals of this work: (1) to develop a prototype system with existing methods to review the literature methods, find their drawbacks and explore the feasibility to develop novel methods; (2) based on the prototype system, to investigate new food classification methods to improve the recognition accuracy to a field application level; (3) to design indexing methods for large-scale image database to facilitate the development of new food image recognition and retrieval algorithms; (4) to develop novel convenient and accurate food volume estimation methods using only smart phones with cameras and IMUs. A prototype system was implemented to review existing methods. Image feature detector and descriptor were developed and a nearest neighbor classifier were implemented to classify food items. A reedit card marker method was introduced for metric scale 3D reconstruction and volume calculation. To increase recognition accuracy, novel multi-view food recognition algorithms were developed to recognize regular shape food items. To further increase the accuracy and make the algorithm applicable to arbitrary food items, new food features, new classifiers were designed. The efficiency of the algorithm was increased by means of developing novel image indexing method in large-scale image database. Finally, the volume calculation was enhanced through reducing the marker and introducing IMUs. Sensor fusion technique to combine measurements from cameras and IMUs were explored to infer the metric scale of the 3D model as well as reduce noises from these sensors.

DESIGN AND IMPLEMENTATION OF HOME USE PORTABLE SMART ELECTRONICS

The widespread of low cost embedded electronics makes it easier to implement the smart devices that can understand either the environment or the user behaviors. The main object of this project is to design and implement home use portable smart electronics, including the portable monitoring device for home and office security and the portable 3D mouse for convenient use. Both devices in this project use the MPU6050 which contains a 3 axis accelerometer and a 3 axis gyroscope to sense the inertial motion of the door or the human hands movement. For the portable monitoring device for home and office security, MPU6050 is used to sense the door (either home front door or cabinet door) movement through the gyroscope, and Raspberry Pi is then used to process the data it receives from MPU6050, if the data value exceeds the preset threshold, Raspberry Pi would control the USB Webcam to take a picture and then send out an alert email with the picture to the user. The advantage of this device is that it is a small size portable stand-alone device with its own power source, it is easy to implement, really cheap for residential use, and energy efficient with instantaneous alert. For the 3D mouse, the MPU6050 would use both the accelerometer and gyroscope to sense user hands movement, the data are processed by MSP430G2553 through a digital smooth filter and a complementary filter, and then the filtered data will pass to the personal computer through the serial COM port. By applying the cursor movement equation in the PC driver, this device can work great as a mouse with acceptable accuracy. Compared to the normal optical mouse we are using, this mouse does not need any working surface, with the use of the smooth and complementary filter, it has certain accuracy for normal use, and it is easy to be extended to a portable mouse as small as a finger ring.

Development and characterization of fluorescent pH sensors based on porous silica and hydrogel support matrices

The hydrogen ion activity (pH) is a very important parameter in environment monitoring, biomedical research and other applications. Optical pH sensors have several advantages over traditional potentiometric pH measurement, such as high sensitivity, no need of constant calibration, easy for miniaturization and possibility for remote sensing. Several pH indicators has been successfully immobilized in three different solid porous materials to use as pH sensing probes. The fluorescent pH indicator fluorescein-5-isothiocyanate (FITC) was covalently bound onto the internal surface of porous silica (pore size ~10 nm) and retained its pH sensitivity. The excited state pK* a of FITC in porous silica (5.58) was slightly smaller than in solution (5.68) due to the free silanol groups (Si-OH) on the silica surface. The pH sensitive range for this probe is pH 4.5 - 7.0 with an error less than 0.1 pH units. The probe response was reproducible and stable for at least four month, stored in DI water, but exhibit a long equilibrium of up to 100 minutes. Sol-gel based pH sensors were developed with immobilization of two fluorescent pH indicators fluorescein-5-(and-6)-sulfonic acid, trisodium salt (FS) and 8-hydroxypyrene- 1,3,6-trisulfonic acid (HPTS) through physical entrapment. Prior to immobilization, the indicators were ion-paired with a common surfactant hexadecyltrimethylammonium bromide (CTAB) in order to prevent leaching. The sol-gel films were synthesized through the hydrolysis of two different precursors, ethyltriethoxysilane (ETEOS) and 3- glycidoxypropyltrimethoxysilane (GPTMS) and deposited on a quartz slide through spin coating. The pK a of the indicators immobilized in sol-gel films was much smaller than in solutions due to silanol groups on the inner surface of the sol-gel films and ammonium groups from the surrounding surfactants. Unlike in solution, the apparent pK a of the indicators in sol-gel films increased with increasing ionic strength. The equilibrium time for these sensors was within 5 minutes (with film thickness of ~470 nm). Polyethylene glycol (PEG) hydrogel was of interest for optical pH sensor development because it is highly proton permeable, transparent and easy to synthesize. pH indicators can be immobilized in hydrogel through physical entrapment and copolymerization. FS and HPTS ion-pairs were physically entrapped in hydrogel matrix synthesized via free radical initiation. For covalent immobilization, three indicators, 6,8-dihydroxypyrene-1,3- disulfonic acid (DHPDS), 2,7-dihydroxynaphthalene-3,6-disulfonic acid (DHNDS) and cresol red were first reacted with methacrylic anhydride (MA) to form methacryloylanalogs for copolymerization. These hydrogels were synthesized in aqueous solution with a redox initiation system. The thickness of the hydrogel film is controlled as ~ 0.5 cm and the porosity can be adjusted with the percentage of polyethylene glycol in the precursor solutions. The pK a of the indicators immobilized in the hydrogel both physically and covalently were higher than in solution due to the medium effect. The sensors are stable and reproducible with a short equilibrium time (less than 4 minutes). In addition, the color change of cresol red immobilized hydrogel is vivid from yellow (acidic condition) to purple (basic condition). Due to covalently binding, cresol red was not leaching out from the hydrogel, making it a good candidate of reusable "pH paper".

AGENT BASED, DISTRIBUTED CONTROL STRATEGIES AND OPTIMIZATION OF PLUG-IN ELECTRIC VEHICLES ON SMART/MICROGRID ARCHITECTURES

This thesis will present strategies for the use of plug-in electric vehicles on smart and microgrids. MATLAB is used as the design tool for all models and simulations. First, a scenario will be explored using the dispatchable loads of electric vehicles to stabilize a microgrid with a high penetration of renewable power generation. Grid components for a microgrid with 50% photovoltaic solar production will be sized through an optimization routine to maintain storage system, load, and vehicle states over a 24-hour period. The findings of this portion are that the dispatchable loads can be used to guard against unpredictable losses in renewable generation output. Second, the use of distributed control strategies for the charging of electric vehicles utilizing an agent-based approach on a smart grid will be studied. The vehicles are regarded as additional loads to a primary forecasted load and use information transfer with the grid to make their charging decisions. Three lightweight control strategies and their effects on the power grid will be presented. The findings are that the charging behavior and peak loads on the grid can be reduced through the use of distributed control strategies.