Support Vector Machines: Training and Applications

The Support Vector Machine (SVM) is a new and very promising classification technique developed by Vapnik and his group at AT&T Bell Labs. This new learning algorithm can be seen as an alternative training technique for Polynomial, Radial Basis Function and Multi-Layer Perceptron classifiers. An interesting property of this approach is that it is an approximate implementation of the Structural Risk Minimization (SRM) induction principle. The derivation of Support Vector Machines, its relationship with SRM, and its geometrical insight, are discussed in this paper. Training a SVM is equivalent to solve a quadratic programming problem with linear and box constraints in a number of variables equal to the number of data points. When the number of data points exceeds few thousands the problem is very challenging, because the quadratic form is completely dense, so the memory needed to store the problem grows with the square of the number of data points. Therefore, training problems arising in some real applications with large data sets are impossible to load into memory, and cannot be solved using standard non-linear constrained optimization algorithms. We present a decomposition algorithm that can be used to train SVM's over large data sets. The main idea behind the decomposition is the iterative solution of sub-problems and the evaluation of, and also establish the stopping criteria for the algorithm. We present previous approaches, as well as results and important details of our implementation of the algorithm using a second-order variant of the Reduced Gradient Method as the solver of the sub-problems. As an application of SVM's, we present preliminary results we obtained applying SVM to the problem of detecting frontal human faces in real images.

A Note on Support Vector Machines Degeneracy

When training Support Vector Machines (SVMs) over non-separable data sets, one sets the threshold $b$ using any dual cost coefficient that is strictly between the bounds of $0$ and $C$. We show that there exist SVM training problems with dual optimal solutions with all coefficients at bounds, but that all such problems are degenerate in the sense that the "optimal separating hyperplane" is given by ${f w} = {f 0}$, and the resulting (degenerate) SVM will classify all future points identically (to the class that supplies more training data). We also derive necessary and sufficient conditions on the input data for this to occur. Finally, we show that an SVM training problem can always be made degenerate by the addition of a single data point belonging to a certain unboundedspolyhedron, which we characterize in terms of its extreme points and rays.

Supporting graduate development through work based learning

The genesis of this innovation lies in the commitment of a national Irish business enterprise to the professional development of its staff in general, and to the enhancement of its Information Technologies (IT) staff specifically, in collaboration with a national Higher Education (HE) provider. A postgraduate degree, awarded by the HE provider, seeks to bring coherence and cohesion to the education and training provision for newly recruited IT graduate staff of the business enterprise, simultaneously acting both as an induction process for new staff and as a professional capacity building exercise, thereby enhancing the enterprise’s organisational learning and collective competence in the areas of information technologies, IT security and technical service management. The curriculum was designed by the HE provider in collaboration with the business enterprise to offer it to circa sixteen IT staff per cycle of delivery through a model known generally as the new apprenticeship for professional practice which uses a combination of college-based, block release taught elements, regular day release seminars and substantial work-based learning, supported by the academic staff of the HE provider and work-based support staff/mentors of the business enterprise. Academic quality assurance, pedagogical, assessment and accreditation responsibilities remain with the HE provider. (...)

Multidimensional Adaptations for Open Learning Management Systems

Our work is focused on alleviating the workload for designers of adaptive courses on the complexity task of authoring adaptive learning designs adjusted to specific user characteristics and the user context. We propose an adaptation platform that consists in a set of intelligent agents where each agent carries out an independent adaptation task. The agents apply machine learning techniques to support the user modelling for the adaptation process

Adaptive intelligent agent approach to guide the web navigation on the PLAN-G distance learning platform

Hypermedia systems based on the Web for open distance education are becoming increasingly popular as tools for user-driven access learning information. Adaptive hypermedia is a new direction in research within the area of user-adaptive systems, to increase its functionality by making it personalized [Eklu 961. This paper sketches a general agents architecture to include navigational adaptability and user-friendly processes which would guide and accompany the student during hislher learning on the PLAN-G hypermedia system (New Generation Telematics Platform to Support Open and Distance Learning), with the aid of computer networks and specifically WWW technology [Marz 98-1] [Marz 98-2]. The PLAN-G actual prototype is successfully used with some informatics courses (the current version has no agents yet). The propased multi-agent system, contains two different types of adaptive autonomous software agents: Personal Digital Agents {Interface), to interacl directly with the student when necessary; and Information Agents (Intermediaries), to filtrate and discover information to learn and to adapt navigation space to a specific student

Support for International Students

International student experience video - this video is 20 minutes long and has been devised by Bill Brooks, Hazel Chauhan and Karin Frydenlund, with support from the University's Learning and Teaching Enhancement Fund. It includes contributions from a number of international students and from members of staff with particular expertise in this area.

Assessment and Feedback for the CIP: learning technologies

This 11-minute video provides some guidance on the learning technologies available at Southampton that can be used to support assessment and feedback. It was produced using the Panopto lecture capture system. The first link is to the native Panopto podcast, which requires the Silverlight player to be installed. The second link is the MP4 video version of the podcast, which should play on all PCs, Macs and suitable mobile devices. This share also provides a link to the video's script.

Technology Enhanced Learning Guide

Technology is changing how students learn and how we research. Perhaps you want to use technology to enhance communication or improve student support. You may want create a distance learning activity, a flexibly delivered module or indeed a whole course. You may simply want to find out where to find authoritative information, or to see what support exists for this type of work. The University is committed to delivering high quality learning and teaching, using technology where appropriate, in order to offer a distinctive Southampton educational experience. Technology Enhanced Learning (TEL), also known as e‑learning, is becoming increasingly important to students, teaching staff and the institution. This guide highlights some of the most important matters to consider. It is intended to help you to tackle the key issues that determine the success of TEL projects and to work on those projects in a considered way. Written with the input of colleagues from around the University, it prompts you to ask important questions and points you to sources of up-to-date knowledge and advice. Technology changes rapidly. This guide is about managing the work in a practical way. The University supports the use of a variety of TEL approaches for teaching and learning and colleagues are ready to offer their experience and advice. Each person has distinctive skills and specific experiences. No single person will have all the answers you are looking for. Be ready to investigate alternative approaches that suit you and your students’ needs in different ways. - Madeline Paterson, University of Southampton

Online Practicals to Support Labs - Matthew Bellamy

This is one of a series of short case studies describing how academic tutors at the University of Southampton have made use of learning technologies to support their students.

Using wikis to support a field trip - Joel Parker

This is one of a series of short case studies describing how academic tutors at the University of Southampton have made use of learning technologies to support their students.

Discovery-Based Learning - Daniel Rowan

This is one of a series of short case studies describing how academic tutors at the University of Southampton have made use of learning technologies to support their students.

Problem-Based Learning Using CaseMaker - Richard Collier

This is one of a series of short case studies describing how academic tutors at the University of Southampton have made use of learning technologies to support their students.

Pearson e-book to support students - Patrick Doncaster

This is one of a series of short case studies describing how academic tutors at the University of Southampton have made use of learning technologies to support their students.

Using video markschemes to support self-assessment in Chemistry

A video markscheme was created using a combination of Camtasia screen capture (on a Tablet PC) and 'live action' video taken with a camcorder. The resulting video supported students in the self-assessment of an organic chemistry exercise which had been set over the Easter vacation break. Feedback was collected from the students after the exercise and was overwhelmingly positive. The video won the 2010 award for 'Most Effective Use of Video in an Educational Context' from the Assocation for Learning Technology. DOWNLOAD THE ZIP FOLDER AND EXTRACT THE FILES TO ACCESS THEM.

Institutional Personal Learning Environments – Paradise or Paradox? A Digital Literacies Perspective

This was my keynote presentation at Computer Supported Education (CSEDU) 2012, in Porto. It looks at the importance of digital literacies and how VLEs do not support their developmeng and looks at iPLEs as an alternative.