Automated gathering of Web information: An in-depth examination of agents interacting with search engines

The Web has become a worldwide repository of information which individuals, companies, and organizations utilize to solve or address various information problems. Many of these Web users utilize automated agents to gather this information for them. Some assume that this approach represents a more sophisticated method of searching. However, there is little research investigating how Web agents search for online information. In this research, we first provide a classification for information agent using stages of information gathering, gathering approaches, and agent architecture. We then examine an implementation of one of the resulting classifications in detail, investigating how agents search for information on Web search engines, including the session, query, term, duration and frequency of interactions. For this temporal study, we analyzed three data sets of queries and page views from agents interacting with the Excite and AltaVista search engines from 1997 to 2002, examining approximately 900,000 queries submitted by over 3,000 agents. Findings include: (1) agent sessions are extremely interactive, with sometimes hundreds of interactions per second (2) agent queries are comparable to human searchers, with little use of query operators, (3) Web agents are searching for a relatively limited variety of information, wherein only 18% of the terms used are unique, and (4) the duration of agent-Web search engine interaction typically spans several hours. We discuss the implications for Web information agents and search engines.

Classifying the user intent of web queries using k-means clustering

Purpose: Web search engines are frequently used by people to locate information on the Internet. However, not all queries have an informational goal. Instead of information, some people may be looking for specific web sites or may wish to conduct transactions with web services. This paper aims to focus on automatically classifying the different user intents behind web queries. Design/methodology/approach: For the research reported in this paper, 130,000 web search engine queries are categorized as informational, navigational, or transactional using a k-means clustering approach based on a variety of query traits. Findings: The research findings show that more than 75 percent of web queries (clustered into eight classifications) are informational in nature, with about 12 percent each for navigational and transactional. Results also show that web queries fall into eight clusters, six primarily informational, and one each of primarily transactional and navigational. Research limitations/implications: This study provides an important contribution to web search literature because it provides information about the goals of searchers and a method for automatically classifying the intents of the user queries. Automatic classification of user intent can lead to improved web search engines by tailoring results to specific user needs. Practical implications: The paper discusses how web search engines can use automatically classified user queries to provide more targeted and relevant results in web searching by implementing a real time classification method as presented in this research. Originality/value: This research investigates a new application of a method for automatically classifying the intent of user queries. There has been limited research to date on automatically classifying the user intent of web queries, even though the pay-off for web search engines can be quite beneficial. © Emerald Group Publishing Limited.

Web searcher interaction with the Dogpile.com metasearch engine

Metasearch engines are an intuitive method for improving the performance of Web search by increasing coverage, returning large numbers of results with a focus on relevance, and presenting alternative views of information needs. However, the use of metasearch engines in an operational environment is not well understood. In this study, we investigate the usage of Dogpile.com, a major Web metasearch engine, with the aim of discovering how Web searchers interact with metasearch engines. We report results examining 2,465,145 interactions from 534,507 users of Dogpile.com on May 6, 2005 and compare these results with findings from other Web searching studies. We collect data on geographical location of searchers, use of system feedback, content selection, sessions, queries, and term usage. Findings show that Dogpile.com searchers are mainly from the USA (84% of searchers), use about 3 terms per query (mean = 2.85), implement system feedback moderately (8.4% of users), and generally (56% of users) spend less than one minute interacting with the Web search engine. Overall, metasearchers seem to have higher degrees of interaction than searchers on non-metasearch engines, but their sessions are for a shorter period of time. These aspects of metasearching may be what define the differences from other forms of Web searching. We discuss the implications of our findings in relation to metasearch for Web searchers, search engines, and content providers.

Defining a session on Web search engines

Detecting query reformulations within a session by a Web searcher is an important area of research for designing more helpful searching systems and targeting content to particular users. Methods explored by other researchers include both qualitative (i.e., the use of human judges to manually analyze query patterns on usually small samples) and nondeterministic algorithms, typically using large amounts of training data to predict query modification during sessions. In this article, we explore three alternative methods for detection of session boundaries. All three methods are computationally straightforward and therefore easily implemented for detection of session changes. We examine 2,465,145 interactions from 534,507 users of Dogpile.com on May 6, 2005. We compare session analysis using (a) Internet Protocol address and cookie; (b) Internet Protocol address, cookie, and a temporal limit on intrasession interactions; and (c) Internet Protocol address, cookie, and query reformulation patterns. Overall, our analysis shows that defining sessions by query reformulation along with Internet Protocol address and cookie provides the best measure, resulting in an 82% increase in the count of sessions. Regardless of the method used, the mean session length was fewer than three queries, and the mean session duration was less than 30 min. Searchers most often modified their query by changing query terms (nearly 23% of all query modifications) rather than adding or deleting terms. Implications are that for measuring searching traffic, unique sessions may be a better indicator than the common metric of unique visitors. This research also sheds light on the more complex aspects of Web searching involving query modifications and may lead to advances in searching tools.

Personalised search – a hybrid approach for web information retrieval and its evaluation

Nowadays, everyone can effortlessly access a range of information on the World Wide Web (WWW). As information resources on the web continue to grow tremendously, it becomes progressively more difficult to meet high expectations of users and find relevant information. Although existing search engine technologies can find valuable information, however, they suffer from the problems of information overload and information mismatch. This paper presents a hybrid Web Information Retrieval approach allowing personalised search using ontology, user profile and collaborative filtering. This approach finds the context of user query with least user’s involvement, using ontology. Simultaneously, this approach uses time-based automatic user profile updating with user’s changing behaviour. Subsequently, this approach uses recommendations from similar users using collaborative filtering technique. The proposed method is evaluated with the FIRE 2010 dataset and manually generated dataset. Empirical analysis reveals that Precision, Recall and F-Score of most of the queries for many users are improved with proposed method.

A radiological method to determine the accuracy of motion capture marker placement on palpable anatomical landmarks through a shoe

The accuracy of marker placement on palpable surface anatomical landmarks is an important consideration in biomechanics. Although marker placement reliability has been studied in some depth, it remains unclear whether or not the markers are accurately positioned over the intended landmark in order to define the static position and orientation of the segment. A novel method using commonly available X-ray imaging was developed to identify the accuracy of markers placed on the shoe surface by palpating landmarks through the shoe. An anterior–posterior and lateral–medial X-ray was taken on 24 participants with a newly developed marker set applied to both the skin and shoe. The vector magnitude of both skin- and shoe-mounted markers from the anatomical landmark was calculated, as well as the mean marker offset between skin- and shoe-mounted markers. The accuracy of placing markers on the shoe relative to the skin-mounted markers, accounting for shoe thickness, was less than 5mm for all markers studied. Further, when using the developed guidelines provided in this study, the method was deemed reliable (Intra-rater ICCs¼0.50–0.92). In conclusion, the method proposed here can reliably assess marker placement accuracy on the shoe surface relative to chosen anatomical landmarks beneath the skin.

Sunscreen application thickness amongst primary school children : the children and sunscreen study

Childhood sun exposure has been associated with increased risk of developing melanoma later in life. Sunscreen, children.s preferred method of sun protection, has been shown to reduce skin cancer risk. However, the effectiveness of sunscreen is largely dependent on user compliance, such as the thickness of application. To reach the sun protection factor (SPF) sunscreen must be applied at a thickness of 2mg/cm2. It has been demonstrated that adults tend to apply less than half of the recommended 2mg/cm2. This was the first study to measure the thickness at which children apply sunscreen. We recruited 87 primary school aged children (n=87, median age 8.7, 5-12 years) from seven state schools within one Brisbane education district (32% consent rate). The children were supplied with sunscreen in three dispenser types (pump, squeeze and roll-on) and were asked to use these for one week each. We measured the weight of the sunscreen before and after use, and calculated the children.s body surface area (based on height and weight) and area to which sunscreen was applied (based on children.s self-reported body coverage of application). Combined these measurements resulted in an average thickness of sunscreen application, which was our main outcome measure. We asked parents to complete a self-administered questionnaire which captured information about potential explanatory variables. Children applied sunscreen at a median thickness of 0.48mg/cm2, significantly less than the recommended 2mg/cm2 (p<0.001). When using the roll-on dispenser (median 0.22mg/cm2), children applied significantly less sunscreen thickness, compared to the pump (median 0.75mg.cm2, p<0.001), and squeeze (median 0.57mg/cm2, p<0.001) dispensers. School grade (1-7) was significantly associated with thickness of application (p=0.032), with children in the youngest grades applying the most. Other variables that were significantly associated with the outcome variable included: number of siblings (p=0.001), household annual income (p<0.001), and the number of lifetime sunburns the child had experienced (p=0.007). This work is the first to measure children.s sunscreen application thickness and demonstrates that regardless of their age or the type of dispenser that they use, children do not apply enough sunscreen to reach the advertised SPF. It is envisaged that this study will assist in the formulation of recommendations for future research, practice and policy aimed at improving childhood sun protection to reduce skin cancer incidence in the future.

Comparing methods to estimate the human lens power

Purpose: To compare accuracies of different methods for calculating human lens power when lens thickness is not available. Methods: Lens power was calculated by four methods. Three methods were used with previously published biometry and refraction data of 184 emmetropic and myopic eyes of 184 subjects (age range [18, 63] years, spherical equivalent range [–12.38, +0.75] D). These three methods consist of the Bennett method, which uses lens thickness, our modification of the Stenström method and the Bennett¬Rabbetts method, both of which do not require knowledge of lens thickness. These methods include c constants, which represent distances from lens surfaces to principal planes. Lens powers calculated with these methods were compared with those calculated using phakometry data available for a subgroup of 66 emmetropic eyes (66 subjects). Results: Lens powers obtained from the Bennett method corresponded well with those obtained by phakometry for emmetropic eyes, although individual differences up to 3.5D occurred. Lens powers obtained from the modified¬Stenström and Bennett¬Rabbetts methods deviated significantly from those obtained with either the Bennett method or phakometry. Customizing the c constants improved this agreement, but applying these constants to the entire group gave mean lens power differences of 0.71 ± 0.56D compared with the Bennett method. By further optimizing the c constants, the agreement with the Bennett method was within ± 1D for 95% of the eyes. Conclusion: With appropriate constants, the modified¬Stenström and Bennett¬Rabbetts methods provide a good approximation of the Bennett lens power in emmetropic and myopic eyes.

Member moment capacities of mono-symmetric LiteSteel beam floor joists with web openings

Recently developed cold-formed LiteSteel beam (LSB) sections have found increasing popularity in residential, industrial and commercial buildings due to their light weight and cost-effectiveness. Another beneficial characteristic is that they allow torsionally rigid rectangular flanges to be combined with economical fabrication processes. Currently, there is significant interest in the use of LSB sections as flexural members in floor joist systems. When used as floor joists, these sections require openings in the web to provide access for inspection and other services. At present, however, there is no design method available that provides accurate predictions of the moment capacities of LSBs with web openings. This paper presents the results of an investigation of the buckling and ultimate strength behaviour of LSB flexural members with web openings. A detailed fine element analysis (FEA)-based parametric study was conducted with the aim of developing appropriate design rules and making recommendations for the safe design of LSB floor joists. The results include the required moment capacity curves for LSB sections with a range of web opening combinations and spans and the development of appropriate design rules for the prediction of the ultimate moment capacities of LSBs with web openings.

A common neighbour based two-way collaborative recommendation method

Traditional recommendation methods offer items, that are inanimate and one way recommendation, to users. Emerging new applications such as online dating or job recruitments require reciprocal people-to-people recommendations that are animate and two-way recommendations. In this paper, we propose a reciprocal collaborative method based on the concepts of users' similarities and common neighbors. The dataset employed for the experiment is gathered from a real life online dating network. The proposed method is compared with baseline methods that use traditional collaborative algorithms. Results show the proposed method can achieve noticeably better performance than the baseline methods.

Phenomenology as a method for exploring management practice

Phenomenology is a term that has been described as a philosophy, a research paradigm, a methodology, and equated with qualitative research. In this paper first we clarify phenomenology by tracing its movement both as a philosophy and as a research method. Next we make a case for the use of phenomenology in empirical investigations of management phenomena. The paper discusses a selection of central concepts pertaining to phenomenology as a scientific research method, which include description, phenomenological reduction and free imaginative variation. In particular, the paper elucidates the efficacy of Giorgi’s descriptive phenomenological research praxis as a qualitative research method and how its utility can be applied in creating a deeper and richer understanding of management practice.

Retinal and choroidal thickness in myopic anisometropia

PURPOSE: To examine the foveal retinal thickness (RT) and subfoveal choroidal thickness (ChT) between the fellow eyes of myopic anisometropes. METHODS: Twenty-two young (mean age 23 ± 5 years), healthy myopic anisometropes (≥ 1 D spherical equivalent [SEq] anisometropia) without amblyopia or strabismus were recruited. Spectral domain optical coherence tomography (SD-OCT) was used to capture images of the retina and choroid. Customised software was used to register, align and average multiple foveal OCT B-Scan images from each subject in order to enhance image quality. Two independent masked observers then manually determined the RT and ChT at the centre of the fovea from each SD-OCT image, which were then averaged. Axial length was measured using optical low coherence biometry during relaxed accommodation. RESULTS: The mean absolute SEq anisometropia was 1.74 ± 0.95 D and the mean interocular difference in axial length was 0.58 ± 0.41 mm. There was a strong correlation between SEq anisometropia and the interocular difference in axial length (r = 0.90, p < 0.001). Measures of RT and ChT were highly correlated between the two observers (r = 0.99 and 0.97 respectively) and in close agreement (mean inter-observer difference: RT 1.3 ± 2.2 µm, ChT 1.5 ± 13.7 µm). There was no significant difference in RT between the more (218 ± 18 µm) and less myopic eyes (215 ± 18 µm) (p > 0.05). However, the mean subfoveal ChT was significantly thinner in the more myopic eye (252 ± 46 µm) compared to the fellow, less myopic eye (286 ± 58 µm) (p < 0.001). There was a moderate correlation between the interocular difference in ChT and the interocular difference in axial length (r = -0.50, p < 0.01). CONCLUSIONS: Foveal RT was similar between the fellow eyes of myopic anisometropes; however, the subfoveal choroid was significantly thinner in the more myopic (longer) eye of our anisometropic cohort. The interocular difference in ChT correlated with the magnitude of axial anisometropia.

Dynamic equivalent state estimation for multi-area power systems with synchronized phasor measurement units

This paper proposes a new approach for state estimation of angles and frequencies of equivalent areas in large power systems with synchronized phasor measurement units. Defining coherent generators and their correspondent areas, generators are aggregated and system reduction is performed in each area of inter-connected power systems. The structure of the reduced system is obtained based on the characteristics of the reduced linear model and measurement data to form the non-linear model of the reduced system. Then a Kalman estimator is designed for the reduced system to provide an equivalent dynamic system state estimation using the synchronized phasor measurement data. The method is simulated on two test systems to evaluate the feasibility of the proposed method.

Enhancing opportunities to feed forward ; developing problem solving skills using web based scenarios

Universities often struggle to satisfy students’ need for feedback. This is an area where student satisfaction with courses of study can be low. Yet it is clear that one of the properties of good teaching is giving the highest quality feedback on student work. The term ‘feedback’ though is most commonly associated with summative assessment given by a teacher after work is completed. The student can often be a passive participant in the process. This paper looks at the implementation of a web based interactive scenario completed by students prior to summative assessment. It requires students to participate actively to develop and improve their legal problem solving skills. Traditional delivery of legal education focuses on print and an instructor who conveys the meaning of the written word to students. Today, mixed modes of teaching are often preferred and they can provide enhanced opportunities for feeding forward with greater emphasis on what students do. Web based activities allow for flexible delivery; they are accessible off campus, at a time that suits the student and may be completed by students at their own pace. This paper reports on an online interactive activity which provides valuable formative feedback necessary to allow for successful completion of a final problem solving assignment. It focuses on how the online activity feeds forward and contributes to the development of legal problem solving skills. Introduction to Law is a unit designed and introduced for completion by undergraduate students from faculties other than law but is focused most particularly on students enrolled in the Bachelor of Entertainment Industries degree, a joint initiative of the faculties of Creative Industries, Business and Law at the Queensland University of Technology in Australia. The final (and major) assessment for the unit is an assignment requiring students to explain the legal consequences of particular scenarios. A number of cost effective web based interactive scenarios have been developed to support the unit’s classroom activities. The tool commences with instruction on problem solving method. Students then view the stimulus which is a narrative produced in the form of a music video clip. A series of questions are posed which guide students through the process and they can compare their responses with sample answers provided. The activity clarifies the problem solving method and expectations for the summative assessment and allows students to practise the skill. The paper reports on the approach to teaching and learning taken in the unit including the design process and implementation of the activity. It includes an evaluation of the activity with respect to its effectiveness as a tool to feed forward and reflects on the implications for the teaching of law in higher education.

Experimental studies of the shear behavior and strength of LiteSteel beams with stiffened web openings

Abstract: LiteSteel beam (LSB) is a new cold-formed steel hollow flange channel section produced using a patented manufacturing process. It is commonly used as flexural members in residential, industrial and commercial buildings. Current practice in flooring systems is to include openings in the web element of floor joists or bearers so that building services can be located within them. Test results have shown that the shear capacity of LSBs can be reduced considerably by the inclusion of web openings. A cost effective method of eliminating the detrimental effects of a large web opening is to attach suitable stiffeners around the web openings of LSBs. A detailed experimental study consisting of 17 shear tests was therefore undertaken to investigate the shear behaviour and strength of LSBs with stiffened circular web openings. Both plate and stud stiffeners with varying sizes and thicknesses were attached to the web elements of LSBs using a number of screw-fastening arrangements in order to develop a suitable stiffening arrangement for LSBs. Simply supported test specimens of LSBs with an aspect ratio of 1.5 were loaded at mid-span until failure. This paper presents the details of this experimental study of LSBs with stiffened web openings, and the results of their shear capacities and associated behavioural characteristics. Suitable screw-fastened plate stiffener arrangements have been recommended in order to restore the original shear capacity of LSBs.