Extracting Salient Curves from Images: An Analysis of the Saliency Network

The Saliency Network proposed by Shashua and Ullman is a well-known approach to the problem of extracting salient curves from images while performing gap completion. This paper analyzes the Saliency Network. The Saliency Network is attractive for several reasons. First, the network generally prefers long and smooth curves over short or wiggly ones. While computing saliencies, the network also fills in gaps with smooth completions and tolerates noise. Finally, the network is locally connected, and its size is proportional to the size of the image. Nevertheless, our analysis reveals certain weaknesses with the method. In particular, we show cases in which the most salient element does not lie on the perceptually most salient curve. Furthermore, in some cases the saliency measure changes its preferences when curves are scaled uniformly. Also, we show that for certain fragmented curves the measure prefers large gaps over a few small gaps of the same total size. In addition, we analyze the time complexity required by the method. We show that the number of steps required for convergence in serial implementations is quadratic in the size of the network, and in parallel implementations is linear in the size of the network. We discuss problems due to coarse sampling of the range of possible orientations. We show that with proper sampling the complexity of the network becomes cubic in the size of the network. Finally, we consider the possibility of using the Saliency Network for grouping. We show that the Saliency Network recovers the most salient curve efficiently, but it has problems with identifying any salient curve other than the most salient one.

Recovery of Three-Dimensional Objects from Single Perspective Images

Any three-dimensional wire-frame object constructed out of parallelograms can be recovered from a single perspective two-dimensional image. A procedure for performing the recovery is given.

Separating Reflections from Images Using Independent Components Analysis

The image of an object can vary dramatically depending on lighting, specularities/reflections and shadows. It is often advantageous to separate these incidental variations from the intrinsic aspects of an image. Along these lines this paper describes a method for photographing objects behind glass and digitally removing the reflections off the glass leaving the image of the objects behind the glass intact. We describe the details of this method which employs simple optical techniques and independent components analysis (ICA) and show its efficacy with several examples.

Recovering Intrinsic Images from a Single Image

We present an algorithm that uses multiple cues to recover shading and reflectance intrinsic images from a single image. Using both color information and a classifier trained to recognize gray-scale patterns, each image derivative is classified as being caused by shading or a change in the surface's reflectance. Generalized Belief Propagation is then used to propagate information from areas where the correct classification is clear to areas where it is ambiguous. We also show results on real images.

Automatically Recovering Geometry and Texture from Large Sets of Calibrated Images

Three-dimensional models which contain both geometry and texture have numerous applications such as urban planning, physical simulation, and virtual environments. A major focus of computer vision (and recently graphics) research is the automatic recovery of three-dimensional models from two-dimensional images. After many years of research this goal is yet to be achieved. Most practical modeling systems require substantial human input and unlike automatic systems are not scalable. This thesis presents a novel method for automatically recovering dense surface patches using large sets (1000's) of calibrated images taken from arbitrary positions within the scene. Physical instruments, such as Global Positioning System (GPS), inertial sensors, and inclinometers, are used to estimate the position and orientation of each image. Essentially, the problem is to find corresponding points in each of the images. Once a correspondence has been established, calculating its three-dimensional position is simply a matter of geometry. Long baseline images improve the accuracy. Short baseline images and the large number of images greatly simplifies the correspondence problem. The initial stage of the algorithm is completely local and scales linearly with the number of images. Subsequent stages are global in nature, exploit geometric constraints, and scale quadratically with the complexity of the underlying scene. We describe techniques for: 1) detecting and localizing surface patches; 2) refining camera calibration estimates and rejecting false positive surfels; and 3) grouping surface patches into surfaces and growing the surface along a two-dimensional manifold. We also discuss a method for producing high quality, textured three-dimensional models from these surfaces. Some of the most important characteristics of this approach are that it: 1) uses and refines noisy calibration estimates; 2) compensates for large variations in illumination; 3) tolerates significant soft occlusion (e.g. tree branches); and 4) associates, at a fundamental level, an estimated normal (i.e. no frontal-planar assumption) and texture with each surface patch.

Pose-Invariant Face Recognition Using Real and Virtual Views

The problem of automatic face recognition is to visually identify a person in an input image. This task is performed by matching the input face against the faces of known people in a database of faces. Most existing work in face recognition has limited the scope of the problem, however, by dealing primarily with frontal views, neutral expressions, and fixed lighting conditions. To help generalize existing face recognition systems, we look at the problem of recognizing faces under a range of viewpoints. In particular, we consider two cases of this problem: (i) many example views are available of each person, and (ii) only one view is available per person, perhaps a driver's license or passport photograph. Ideally, we would like to address these two cases using a simple view-based approach, where a person is represented in the database by using a number of views on the viewing sphere. While the view-based approach is consistent with case (i), for case (ii) we need to augment the single real view of each person with synthetic views from other viewpoints, views we call 'virtual views'. Virtual views are generated using prior knowledge of face rotation, knowledge that is 'learned' from images of prototype faces. This prior knowledge is used to effectively rotate in depth the single real view available of each person. In this thesis, I present the view-based face recognizer, techniques for synthesizing virtual views, and experimental results using real and virtual views in the recognizer.

Recognizing 3-D Objects Using 2-D Images

We discuss a strategy for visual recognition by forming groups of salient image features, and then using these groups to index into a data base to find all of the matching groups of model features. We discuss the most space efficient possible method of representing 3-D models for indexing from 2-D data, and show how to account for sensing error when indexing. We also present a convex grouping method that is robust and efficient, both theoretically and in practice. Finally, we combine these modules into a complete recognition system, and test its performance on many real images.

Finding Edges and Lines in Images

The problem of detecting intensity changes in images is canonical in vision. Edge detection operators are typically designed to optimally estimate first or second derivative over some (usually small) support. Other criteria such as output signal to noise ratio or bandwidth have also been argued for. This thesis is an attempt to formulate a set of edge detection criteria that capture as directly as possible the desirable properties of an edge operator. Variational techniques are used to find a solution over the space of all linear shift invariant operators. The first criterion is that the detector have low probability of error i.e. failing to mark edges or falsely marking non-edges. The second is that the marked points should be as close as possible to the centre of the true edge. The third criterion is that there should be low probability of more than one response to a single edge. The technique is used to find optimal operators for step edges and for extended impulse profiles (ridges or valleys in two dimensions). The extension of the one dimensional operators to two dimentions is then discussed. The result is a set of operators of varying width, length and orientation. The problem of combining these outputs into a single description is discussed, and a set of heuristics for the integration are given.

Fragments of place : revealing sense of place through shared phone images.

Is an interactive new media art installation that explores how the sharing of images, normally hidden on mobile phones, can reveal more about people's sense of place and this ultimately shared experience. Traditional views on sense of place, as exemplified by Wagner (1972) and Relph (1976), characterise the experience as a fusion of meaning, act and context. Indeed, Relph suggests that it is not just the identity of a place that is important, but also the identity that a person or group has with that place, in particular whether they are experiencing it as an ‘insider’ or ‘outsider’. This work stimulates debate concerning the impact of technology on sense of place. Technology offers a number of bridges between the real and virtual worlds, but in so doing places an increased tension on the sense of place and subsequently the identity of the individual. This, coupled with the increased use of camera phones, has enabled the documentation of all aspects of our lives, the things we do, the objects we encounter and the places we inhabit. The installation taps into these hidden electronic resources by letting people share their sense of place associated with a large scale event. The work explores the changing nature of the sense of place of performers, visitors and residents over the duration of the event. Interaction with the installation will transform the viewer into performer, echoing Relph’s insider-outsider dichotomy

Festival Images: brand image and stakeholders' brand relationship types at the Edinburgh Festival Fringe.

The Edinburgh Festival Fringe (The Fringe) is the largest arts festival in the world and it has inspired the creation of similar festivals world-wide. Since its conception in 1947, the Fringe has demonstrated significant growth in visitor numbers; ticket sales; and its economic contribution. Despite this, the sustainable future of Edinburgh’s festivals is debated as Edinburgh, ‘the Festival City’, faces threats from other festival destinations. Festivals position Edinburgh creatively in contrast to the city’s traditionally perceived image as a cultural-historic centre. Despite this, little research has been undertaken into the creative and cultural significance of Edinburgh’s festivals, including the Fringe. This interdisciplinary research grounded in marketing, tourism, and festival and event management; and underpinned by constructivism, presents an understanding of types of brand relationships that exist between the Fringe and its primary stakeholders. This is achieved through defining both the Fringe brand image and its primary stakeholders; and applying these definitions to the development of a typology of Fringe-stakeholders’ brand relationships. The significance of this study is evident within its topic of inquiry and the research methods applied. In the little-considered arena of arts festivals and their stakeholders, this is the first in-depth study into the Fringe as a festival and festival brand. Within this, the definition of a Fringe brand image contributes to understanding the cultural and creative significance of the Fringe. Furthermore, this research contributes a unique understanding of the types of stakeholders that are engaged with the Fringe. The types of brand relationships that exist between these stakeholders and the Fringe are another significant contribution to knowledge and understanding. While specific to the present context, these findings may prove transferable to further festivals or events, and related areas and industries. The contribution made by this research to the methodological developments in festival and event studies is of additional significance. The application of visual research methods, including semiotic analysis and photo-elicitation within phenomenological interviews, has previously been applied in marketing, consumer, and tourism research, but not to the understanding of festival brands and stakeholders’ brand relationship types. Findings of this research illustrate that existing marketing and consumer brand frameworks and stakeholder theories are applicable to festivals. Further, it is possible to define ‘a’ Fringe brand image which is subjective and contradictory. The unique open-access and organic, operational model of the Fringe facilitates its many contributors, and consumers. Fringe stakeholders may be categorised according to their level of engagement with the Fringe (as primary or secondary) and their particular stakeholder role(s), which are varied and multiple. Fringe-stakeholder brand relationship types are overwhelmingly positive; and are based upon interpersonal relationship dimensions (including friendships, marriages, kinships and partnerships). Fringe-stakeholder brand relationship types can be classified therefore as having similar dimensions to those brand relationship types previously described for consumer products and brands.

The Depiction of Coronal Structure in White-Light Images

Morgan, Huw, Habbal, S.R., Woo, R., (2006) 'The Depiction of Coronal Structure in White-Light Images', Solar Physics 236(2) pp.263-272 RAE2008

Linear structures in mammographic images: detection and classification

R. Zwiggelaar, S.M. Astley, C.J. Taylor and C.R.M. Boggis, 'Linear structures in mammographic images: detection and classification', IEEE Transaction on Medical Imaging 23 (9), 1077-1086 (2004)

Words, Images, Enemies : Securitization and International Politics

Williams, Mike, 'Words, Images, Enemies: Securitization and International Politics', International Studies Quarterly (2003) 47(4) pp.511-531 RAE2008

Electronic dictionary entries with animated pictures: Lookup preferences and word retention

http://ijl.oxfordjournals.org/cgi/reprint/ecp022?ijkey=FWAwWPvILuZDT1S&keytype=ref

Religion and the life attitudes and self-images of American adolescents

The purpose of the project is to research the shape and influence of religion and spirituality in the lives of U.S. adolescents; to identify effective practices in the religious, moral, and social formation of the lives of youth; to describe the extent to which youth participate in and benefit from the programs and opportunities that religious communities are offering to their youth; and to foster an informed national discussion about the influence of religion in youth's lives, in order to encourage sustained reflection about and rethinking of our cultural and institutional practices with regard to youth and religion.