On simple adaptive momentum

Simple Adaptive Momentum [1] was introduced as a simple means of speeding the training of multi-layer perceptrons (MLPs) by changing the momentum term depending on the angle between the current and previous changes in the weights of the MLP. In the original paper. the weight changes of the whole network are used in determining this angle. This paper considers adapting the momentum term using certain subsets of these weights. This idea was inspired by the author's object oriented approach to programming MLPs. successfully used in teaching students: this approach is also described. It is concluded that the angle is best determined using the weight changes in each layer separately.

Simple adaptive momentum: new algorithm for training multilayer perceptrons

The speed of convergence while training is an important consideration in the use of neural nets. The authors outline a new training algorithm which reduces both the number of iterations and training time required for convergence of multilayer perceptrons, compared to standard back-propagation and conjugate gradient descent algorithms.

A theoretical framework for energy and momentum consistency in subgrid-scale parameterization for climate models

A theoretical framework for the joint conservation of energy and momentum in the parameterization of subgrid-scale processes in climate models is presented. The framework couples a hydrostatic resolved (planetary scale) flow to a nonhydrostatic subgrid-scale (mesoscale) flow. The temporal and horizontal spatial scale separation between the planetary scale and mesoscale is imposed using multiple-scale asymptotics. Energy and momentum are exchanged through subgrid-scale flux convergences of heat, pressure, and momentum. The generation and dissipation of subgrid-scale energy and momentum is understood using wave-activity conservation laws that are derived by exploiting the (mesoscale) temporal and horizontal spatial homogeneities in the planetary-scale flow. The relations between these conservation laws and the planetary-scale dynamics represent generalized nonacceleration theorems. A derived relationship between the wave-activity fluxes-which represents a generalization of the second Eliassen-Palm theorem-is key to ensuring consistency between energy and momentum conservation. The framework includes a consistent formulation of heating and entropy production due to kinetic energy dissipation.

On the momentum fluxes associated with mountain waves in directionally sheared flows

The direct impact of mountain waves on the atmospheric circulation is due to the deposition of wave momentum at critical levels, or levels where the waves break. The first process is treated analytically in this study within the framework of linear theory. The variation of the momentum flux with height is investigated for relatively large shears, extending the authors’ previous calculations of the surface gravity wave drag to the whole atmosphere. A Wentzel–Kramers–Brillouin (WKB) approximation is used to treat inviscid, steady, nonrotating, hydrostatic flow with directional shear over a circular mesoscale mountain, for generic wind profiles. This approximation must be extended to third order to obtain momentum flux expressions that are accurate to second order. Since the momentum flux only varies because of wave filtering by critical levels, the application of contour integration techniques enables it to be expressed in terms of simple 1D integrals. On the other hand, the momentum flux divergence (which corresponds to the force on the atmosphere that must be represented in gravity wave drag parameterizations) is given in closed analytical form. The momentum flux expressions are tested for idealized wind profiles, where they become a function of the Richardson number (Ri). These expressions tend, for high Ri, to results by previous authors, where wind profile effects on the surface drag were neglected and critical levels acted as perfect absorbers. The linear results are compared with linear and nonlinear numerical simulations, showing a considerable improvement upon corresponding results derived for higher Ri.

Real estate mutual funds: herding, momentum-trading and performance

This study jointly examines herding, momentum trading and performance in real estate mutual funds (REMFs). We do this using trading and performance data for 159 REMFs across the period 1998–2008. In support of the view that Real Estate Investment Trust (REIT) stocks are relatively more transparent, we find that stock herding by REMFs is lower in REIT stocks than other stock. Herding behavior in our data reveals a tendency for managers to sell winners, reflective of the “disposition effect.” We find low overall levels of REMF momentum trading, but further evidence of the disposition effect when momentum trading is segregated into buy–sell dimensions. We test the robustness of our analysis using style analysis, and by reference to the level of fund dividend distribution. Our results for this are consistent with our conjecture about the role of transparency in herding, but they provide no new insights in relation to the momentum-trading dimensions of our analysis. Summarizing what are complex interrelationships, we find that neither herding nor momentum trading are demonstrably superior investment strategies for REMFs.