Knowledge assisted data management and retrieval in multimedia database systems

With the proliferation of multimedia data and ever-growing requests for multimedia applications, there is an increasing need for efficient and effective indexing, storage and retrieval of multimedia data, such as graphics, images, animation, video, audio and text. Due to the special characteristics of the multimedia data, the Multimedia Database management Systems (MMDBMSs) have emerged and attracted great research attention in recent years. Though much research effort has been devoted to this area, it is still far from maturity and there exist many open issues. In this dissertation, with the focus of addressing three of the essential challenges in developing the MMDBMS, namely, semantic gap, perception subjectivity and data organization, a systematic and integrated framework is proposed with video database and image database serving as the testbed. In particular, the framework addresses these challenges separately yet coherently from three main aspects of a MMDBMS: multimedia data representation, indexing and retrieval. In terms of multimedia data representation, the key to address the semantic gap issue is to intelligently and automatically model the mid-level representation and/or semi-semantic descriptors besides the extraction of the low-level media features. The data organization challenge is mainly addressed by the aspect of media indexing where various levels of indexing are required to support the diverse query requirements. In particular, the focus of this study is to facilitate the high-level video indexing by proposing a multimodal event mining framework associated with temporal knowledge discovery approaches. With respect to the perception subjectivity issue, advanced techniques are proposed to support users' interaction and to effectively model users' perception from the feedback at both the image-level and object-level.

DIMUSE: An integrated framework for distributed multimedia system with database management and security support

With the recent explosion in the complexity and amount of digital multimedia data, there has been a huge impact on the operations of various organizations in distinct areas, such as government services, education, medical care, business, entertainment, etc. To satisfy the growing demand of multimedia data management systems, an integrated framework called DIMUSE is proposed and deployed for distributed multimedia applications to offer a full scope of multimedia related tools and provide appealing experiences for the users. This research mainly focuses on video database modeling and retrieval by addressing a set of core challenges. First, a comprehensive multimedia database modeling mechanism called Hierarchical Markov Model Mediator (HMMM) is proposed to model high dimensional media data including video objects, low-level visual/audio features, as well as historical access patterns and frequencies. The associated retrieval and ranking algorithms are designed to support not only the general queries, but also the complicated temporal event pattern queries. Second, system training and learning methodologies are incorporated such that user interests are mined efficiently to improve the retrieval performance. Third, video clustering techniques are proposed to continuously increase the searching speed and accuracy by architecting a more efficient multimedia database structure. A distributed video management and retrieval system is designed and implemented to demonstrate the overall performance. The proposed approach is further customized for a mobile-based video retrieval system to solve the perception subjectivity issue by considering individual user's profile. Moreover, to deal with security and privacy issues and concerns in distributed multimedia applications, DIMUSE also incorporates a practical framework called SMARXO, which supports multilevel multimedia security control. SMARXO efficiently combines role-based access control (RBAC), XML and object-relational database management system (ORDBMS) to achieve the target of proficient security control. A distributed multimedia management system named DMMManager (Distributed MultiMedia Manager) is developed with the proposed framework DEMUR; to support multimedia capturing, analysis, retrieval, authoring and presentation in one single framework.

A generalized multidimensional index structure for multimedia data to support content-based similarity searches in a collaborative search environment

Since multimedia data, such as images and videos, are way more expressive and informative than ordinary text-based data, people find it more attractive to communicate and express with them. Additionally, with the rising popularity of social networking tools such as Facebook and Twitter, multimedia information retrieval can no longer be considered a solitary task. Rather, people constantly collaborate with one another while searching and retrieving information. But the very cause of the popularity of multimedia data, the huge and different types of information a single data object can carry, makes their management a challenging task. Multimedia data is commonly represented as multidimensional feature vectors and carry high-level semantic information. These two characteristics make them very different from traditional alpha-numeric data. Thus, to try to manage them with frameworks and rationales designed for primitive alpha-numeric data, will be inefficient. An index structure is the backbone of any database management system. It has been seen that index structures present in existing relational database management frameworks cannot handle multimedia data effectively. Thus, in this dissertation, a generalized multidimensional index structure is proposed which accommodates the atypical multidimensional representation and the semantic information carried by different multimedia data seamlessly from within one single framework. Additionally, the dissertation investigates the evolving relationships among multimedia data in a collaborative environment and how such information can help to customize the design of the proposed index structure, when it is used to manage multimedia data in a shared environment. Extensive experiments were conducted to present the usability and better performance of the proposed framework over current state-of-art approaches.

Essays on international lending and increasing returns to scale

Standard economic theory suggests that capital should flow from rich countries to poor countries. However, capital has predominantly flowed to rich countries. The three essays in this dissertation attempt to explain this phenomenon. The first two essays suggest theoretical explanations for why capital has not flowed to the poor countries. The third essay empirically tests the theoretical explanations.^ The first essay examines the effects of increasing returns to scale on international lending and borrowing with moral hazard. Introducing increasing returns in a two-country general equilibrium model yields possible multiple equilibria and helps explain the possibility of capital flows from a poor to a rich country. I find that a borrowing country may need to borrow sufficient amounts internationally to reach a minimum investment threshold in order to invest domestically.^ The second essay examines how a poor country may invest in sectors with low productivity because of sovereign risk, and how collateral differences across sectors may exacerbate the problem. I model sovereign borrowing with a two-sector economy: one sector with increasing returns to scale (IRS) and one sector with diminishing returns to scale (DRS). Countries with incomes below a threshold will only invest in the DRS sector, and countries with incomes above a threshold will invest mostly in the IRS sector. The results help explain the existence of a bimodal world income distribution.^ The third essay empirically tests the explanations for why capital has not flowed from the rich to the poor countries, with a focus on institutions and initial capital. I find that institutional variables are a very important factor, but in contrast to other studies, I show that institutions do not account for the Lucas Paradox. Evidence of increasing returns still exists, even when controlling for institutions and other variables. In addition, I find that the determinants of capital flows may depend on whether a country is rich or poor.^

Multimedia Training: Why Some use it and Some Do Not

Forms of interactive multimedia, including CD-ROM, DV-I, Laserdisc, and virtual reality, have given a new perspective to training in many industries. As the hospitality industry and other service industries continue to grow, these forms of technology are becoming of increasing interest as organizations strive to deliver more efficient and effective services to customers and employees

A scalable multimedia content processing framework with application to TV shopping

The advent of smart TVs has reshaped the TV-consumer interaction by combining TVs with mobile-like applications and access to the Internet. However, consumers are still unable to seamlessly interact with the contents being streamed. An example of such limitation is TV shopping, in which a consumer makes a purchase of a product or item displayed in the current TV show. Currently, consumers can only stop the current show and attempt to find a similar item in the Web or an actual store. It would be more convenient if the consumer could interact with the TV to purchase interesting items. ^ Towards the realization of TV shopping, this dissertation proposes a scalable multimedia content processing framework. Two main challenges in TV shopping are addressed: the efficient detection of products in the content stream, and the retrieval of similar products given a consumer-selected product. The proposed framework consists of three components. The first component performs computational and temporal aware multimedia abstraction to select a reduced number of frames that summarize the important information in the video stream. By both reducing the number of frames and taking into account the computational cost of the subsequent detection phase, this component component allows the efficient detection of products in the stream. The second component realizes the detection phase. It executes scalable product detection using multi-cue optimization. Additional information cues are formulated into an optimization problem that allows the detection of complex products, i.e., those that do not have a rigid form and can appear in various poses. After the second component identifies products in the video stream, the consumer can select an interesting one for which similar ones must be located in a product database. To this end, the third component of the framework consists of an efficient, multi-dimensional, tree-based indexing method for multimedia databases. The proposed index mechanism serves as the backbone of the search. Moreover, it is able to efficiently bridge the semantic gap and perception subjectivity issues during the retrieval process to provide more relevant results.^

The effect of multimedia instruction on achievement of college history students

The purpose of this study was to investigate the effect of multimedia instruction on achievement of college students in AMH 2010 from exploration and discovery to1865. A non-equivalent control group design was used. The dependent variable was achievement. The independent variables were learning styles method of instruction, and visual clarifiers (notes). The study was conducted using two history sections from Palm Beach Community College, in Boca Raton, Florida, between August and December, 1998. Data were obtained by means of placement scores, posttests, the Productivity Environmental Preference Survey (PEPS), and a researcher-developed student survey. Statistical analysis of the data was done using SPSS statistical software. Demographic variables were compared using Chi square. T tests were run on the posttests to determine the equality of variances. The posttest scores of the groups were compared using the analysis of covariance (ANCOVA) at the .05 level of significance. The first hypothesis there is a significant difference in students' learning of U.S. History when students receive multimedia instruction was supported, F = (1, 52)= 688, p < .0005, and F = (1, 53) = 8.52, p < .005for Tests 2 and 3, respectively. The second hypothesis there is a significant difference on the effectiveness of multimedia instruction based on students' various learning preferences was not supported. The last hypotheses there is a significant difference on students' learning of U.S. History when students whose first language is other than English and students who need remediation receive visual clarifiers were not supported. Analysis of covariance (ANCOVA) indicated no difference between the groups on Test 1, Test 2, or Test 3: F (1, 4 5)= .01, p < .940, F (l, 52) = .77, p < .385, and F (1,53) =.17, p > .678, respectively, for language. Analysis of covariance (ANCOVA) indicated no significant difference on Test 1, Test 2, or Test 3, between the groups on the variable remediation: F (1, 45) = .31, p < .580, F (1, 52) = 1.44, p < .236, and F (1, 53) = .21, p < .645, respectively.

Servicio Documentación Multimedia Universidad Complutense (1993-2016): patrimonio documental científico-informativo multimedia (blogs, canales, portales, listas distribución, proyectos investigación, publicaciones electrónicas, producción videográfica, revistas, web social… formación, congresos, asociaciones, posicionamiento, difusión informativa… [Estudio documental multimedia del Servicio de Documentación Multimedia, Dpto./Sección Dptal. Biblioteconomía y Documentación]

El Servicio de Documentación Multimedia (MULTIDOC 3.0) dependiente de la Sección Departamental/Departamento de Biblioteconomía y Documentación de la Universidad Complutense de Madrid (http://www.multidoc.es) fue creado en junio de 1993. Con patente número M 2202582 registrada con fecha 20.5.1999 en el Boletín Oficial de la Propiedad Industrial (BOPI, 1.7.1999), no ha dejado de desarrollar actividades académico-investigadoras de forma ininterrumpida hasta la actualidad: proyectos de investigación, publicaciones electrónicas, revistas, portales, canales, blogs, presencia en redes sociales generales y especializadas; con actuaciones en todos estos años en el ámbito de la formación, congresos, asociaciones, producción multimedia propia, difusión informativa, gozando de un buen posicionamiento.

Multimedia en la Universidad a propósito de BIBLIORed3.0: ciencias de la información-comunicación, archivos-bibliotecas-centros documentación-servicios especializados… acceso abierto y proyección iberoamericana [Estudio documental multimedia del Servicio de Documentación Multimedia, Dpto./Sección Dptal. Biblioteconomía y Documentación]

BIBLIORed3.0 es una web universitaria administrada y mantenida en la Universidad Complutense (Servicio Documentación Multimedia del Dpto. Biblioteconomía y Documentación) dedicada a proporcionar información y documentación multimedia en y sobre cine, periodismo, publicidad, radio, televisión, internet-web social y gestión de información en medios de comunicación (documentación informativa) en el ámbito fundamentalmente de archivos, bibliotecas, centros-servicios de documentación y servicios especializados universitarios, en acceso abierto y proyección iberoamericana, en la idea de convertirse en una red social propia. BIBLIORed3.0 dispone de dominio propio en Internet e ISSN 2386-8880 (asignado por BNE-Biblioteca Nacional de España, 26.01.2015).

Glosario social multimedia de innovación educomunicativa y TIC (Glosario Social Expandido)

La información sobre conceptos de innovación educomunicativa en la web, sobre todo los relacionados con las TIC, suele ser confusa y presentarse de una forma divulgativa inexacta o de una manera científica compleja en artículos largos. Además, suelen utilizarse términos en inglés o en extrañas hibridaciones. Las y los estudiantes –y cualquier persona- que buscan estos términos suelen recurrir a la divulgación inexacta, lo que hace que no comprendan el término en toda su extensión y, por tanto, que los desarrollos que se realizan, tanto teóricos como prácticos, se alejen de la excelencia ya desde su inicio. Conceptos como Branding, Big Data, Force Touch, Gamificación, Geocaching, InRead video, Inroll Video, Interfaz Social, Mobile First, Mooc, Neurocomunicación, Responsive Web Design, Transmedia, Walking Cinema, Walking Documentary, Wayfinding… o no se comprenden o se comprenden sin los matices imprescindibles para un buen desarrollo académico y profesional. Los investigadores del grupo “Museum I+D+C. Laboratorio de cultura digital y museografía hipermedia” de la Universidad Complutense de Madrid, pertenecientes a distintas universidades de Argentina, Brasil, España, México, Colombia, Chile, Ecuador y Reino Unido, coinciden en la necesidad de intentar clarificar esos términos. Queremos animar a cualquier persona que lea estas líneas a participar en el proyecto, bien proponiendo mejoras o aportando nuevos términos.

Bimodal adaptive hypermedia and interactive multimedia a web-based learning environment based on Kolb's theory of learning style

Mémoire numérisé par la Direction des bibliothèques de l'Université de Montréal.

Bimodal adaptive hypermedia and interactive multimedia a web-based learning environment based on Kolb's theory of learning style

Mémoire numérisé par la Direction des bibliothèques de l'Université de Montréal.

Dithen: A Computation-as-a-Service Cloud Platform For Large-Scale Multimedia Processing

We present Dithen, a novel computation-as-a-service (CaaS) cloud platform specifically tailored to the parallel ex-ecution of large-scale multimedia tasks. Dithen handles the upload/download of both multimedia data and executable items, the assignment of compute units to multimedia workloads, and the reactive control of the available compute units to minimize the cloud infrastructure cost under deadline-abiding execution. Dithen combines three key properties: (i) the reactive assignment of individual multimedia tasks to available computing units according to availability and predetermined time-to-completion constraints; (ii) optimal resource estimation based on Kalman-filter estimates; (iii) the use of additive increase multiplicative decrease (AIMD) algorithms (famous for being the resource management in the transport control protocol) for the control of the number of units servicing workloads. The deployment of Dithen over Amazon EC2 spot instances is shown to be capable of processing more than 80,000 video transcoding, face detection and image processing tasks (equivalent to the processing of more than 116 GB of compressed data) for less than $1 in billing cost from EC2. Moreover, the proposed AIMD-based control mechanism, in conjunction with the Kalman estimates, is shown to provide for more than 27% reduction in EC2 spot instance cost against methods based on reactive resource estimation. Finally, Dithen is shown to offer a 38% to 500% reduction of the billing cost against the current state-of-the-art in CaaS platforms on Amazon EC2 (Amazon Lambda and Amazon Autoscale). A baseline version of Dithen is currently available at dithen.com.

A Multimedia Video Player Based of FFmpeg

With the rapid development of Internet technologies, video and audio processing are among the most important parts due to the constant requirements of high quality media contents. Along with the improvement of network environment and the hardware equipment, this demand is becoming more and more imperious, people prefer high quality videos and audios as well as the net streaming media resources. FFmpeg is a set of open source program about the A/V decoding. Many commercial players use FFmpeg as their displaying cores. This paper designed a simple and easy-to-use video player based on FFmpeg. The first part is about the basic theories and related knowledge of video displaying, including some concepts like data formats, streaming media data, video coding and decoding. In a word, the realization of the video player depend on the a set of video decoding process. The general idea about the process is to get the video packets from the Internet, to read the related protocols and de-encapsulate the protocols, to de-encapsulate the packaging data and to get encoded formats data, to decode them to pixel data that can be displayed directly through graphics cards. During the coding and decoding process, there could be different degrees of data losing, which is called lossy compression, but it usually does not influence the quality of user experiences. The second part is about the principle of the FFmpeg decoding process, that is one of the key point of the paper. In this project, FFmpeg is used for the main decoding task, by call some main functions and structures from FFmpeg class libraries, packaging video formats could be transfer to pixel data, after getting the pixel data, SDL is used for the displaying process. The third part is about the SDL displaying flow. Similarly, it would invoke some important displaying functions from SDL class libraries to realize the function, though SDL is able to do not only displaying task, but also many other game playing process. After that, a independent video displayer is completed, it is provided with all the key function of a player. The fourth part make a simple users interface for the player based on the MFC program, it enable the player could be used by most people. At last, in consideration of the mobile Internet’s blossom, people nowadays can hardly ever drop their mobile phones, there is a brief introduction about how to transplant the video player to Android platform which is one of the most used mobile systems.

La multimedia y sus aplicaciones: elaboración de un video promocional para la carrera de ingeniería de sistemas

¿Por qué la multimedia? Tradicionalmente, la manera de presentar la información en los computadores ha sido la de los reportes y pantallas, en las que aparecen texto, números y ocasionalmente gráficos. A pesar de que estos medios son efectivos para cierto tipo de comunicaciones, su consulta causa normalmente tedio a las personas, y una información valiosa puede perderse por una manera poco efectiva de comunicarla.