On simple adaptive momentum

Simple Adaptive Momentum [1] was introduced as a simple means of speeding the training of multi-layer perceptrons (MLPs) by changing the momentum term depending on the angle between the current and previous changes in the weights of the MLP. In the original paper. the weight changes of the whole network are used in determining this angle. This paper considers adapting the momentum term using certain subsets of these weights. This idea was inspired by the author's object oriented approach to programming MLPs. successfully used in teaching students: this approach is also described. It is concluded that the angle is best determined using the weight changes in each layer separately.

A method for estimating the turbulent kinetic energy dissipation rate from a vertically pointing Doppler lidar, and independent evaluation from balloon-borne in situ measurements

A method of estimating dissipation rates from a vertically pointing Doppler lidar with high temporal and spatial resolution has been evaluated by comparison with independent measurements derived from a balloon-borne sonic anemometer. This method utilizes the variance of the mean Doppler velocity from a number of sequential samples and requires an estimate of the horizontal wind speed. The noise contribution to the variance can be estimated from the observed signal-to-noise ratio and removed where appropriate. The relative size of the noise variance to the observed variance provides a measure of the confidence in the retrieval. Comparison with in situ dissipation rates derived from the balloon-borne sonic anemometer reveal that this particular Doppler lidar is capable of retrieving dissipation rates over a range of at least three orders of magnitude. This method is most suitable for retrieval of dissipation rates within the convective well-mixed boundary layer where the scales of motion that the Doppler lidar probes remain well within the inertial subrange. Caution must be applied when estimating dissipation rates in more quiescent conditions. For the particular Doppler lidar described here, the selection of suitably short integration times will permit this method to be applicable in such situations but at the expense of accuracy in the Doppler velocity estimates. The two case studies presented here suggest that, with profiles every 4 s, reliable estimates of ϵ can be derived to within at least an order of magnitude throughout almost all of the lowest 2 km and, in the convective boundary layer, to within 50%. Increasing the integration time for individual profiles to 30 s can improve the accuracy substantially but potentially confines retrievals to within the convective boundary layer. Therefore, optimization of certain instrument parameters may be required for specific implementations.

Identifying and quantifying nonconservative energy production/destruction terms in hydrostatic Boussinesq primitive equation models

This paper seeks to illustrate the point that physical inconsistencies between thermodynamics and dynamics usually introduce nonconservative production/destruction terms in the local total energy balance equation in numerical ocean general circulation models (OGCMs). Such terms potentially give rise to undesirable forces and/or diabatic terms in the momentum and thermodynamic equations, respectively, which could explain some of the observed errors in simulated ocean currents and water masses. In this paper, a theoretical framework is developed to provide a practical method to determine such nonconservative terms, which is illustrated in the context of a relatively simple form of the hydrostatic Boussinesq primitive equation used in early versions of OGCMs, for which at least four main potential sources of energy nonconservation are identified; they arise from: (1) the “hanging” kinetic energy dissipation term; (2) assuming potential or conservative temperature to be a conservative quantity; (3) the interaction of the Boussinesq approximation with the parameterizations of turbulent mixing of temperature and salinity; (4) some adiabatic compressibility effects due to the Boussinesq approximation. In practice, OGCMs also possess spurious numerical energy sources and sinks, but they are not explicitly addressed here. Apart from (1), the identified nonconservative energy sources/sinks are not sign definite, allowing for possible widespread cancellation when integrated globally. Locally, however, these terms may be of the same order of magnitude as actual energy conversion terms thought to occur in the oceans. Although the actual impact of these nonconservative energy terms on the overall accuracy and physical realism of the oceans is difficult to ascertain, an important issue is whether they could impact on transient simulations, and on the transition toward different circulation regimes associated with a significant reorganization of the different energy reservoirs. Some possible solutions for improvement are examined. It is thus found that the term (2) can be substantially reduced by at least one order of magnitude by using conservative temperature instead of potential temperature. Using the anelastic approximation, however, which was initially thought as a possible way to greatly improve the accuracy of the energy budget, would only marginally reduce the term (4) with no impact on the terms (1), (2) and (3).

Simple adaptive momentum: new algorithm for training multilayer perceptrons

The speed of convergence while training is an important consideration in the use of neural nets. The authors outline a new training algorithm which reduces both the number of iterations and training time required for convergence of multilayer perceptrons, compared to standard back-propagation and conjugate gradient descent algorithms.

The influence of Langmuir turbulence on the scaling for the dissipation rate in the oceanic boundary layer

A model for estimating the turbulent kinetic energy dissipation rate in the oceanic boundary layer, based on insights from rapid-distortion theory, is presented and tested. This model provides a possible explanation for the very high dissipation levels found by numerous authors near the surface. It is conceived that turbulence, injected into the water by breaking waves, is subsequently amplified due to its distortion by the mean shear of the wind-induced current and straining by the Stokes drift of surface waves. The partition of the turbulent shear stress into a shear-induced part and a wave-induced part is taken into account. In this picture, dissipation enhancement results from the same mechanism responsible for Langmuir circulations. Apart from a dimensionless depth and an eddy turn-over time, the dimensionless dissipation rate depends on the wave slope and wave age, which may be encapsulated in the turbulent Langmuir number La_t. For large La_t, or any Lat but large depth, the dissipation rate tends to the usual surface layer scaling, whereas when Lat is small, it is strongly enhanced near the surface, growing asymptotically as ɛ ∝ La_t^{-2} when La_t → 0. Results from this model are compared with observations from the WAVES and SWADE data sets, assuming that this is the dominant dissipation mechanism acting in the ocean surface layer and statistical measures of the corresponding fit indicate a substantial improvement over previous theoretical models. Comparisons are also carried out against more recent measurements, showing good order-of-magnitude agreement, even when shallow-water effects are important.

On the connection between dissipation enhancement in the ocean surface layer and Langmuir circulations

A mechanism for the enhancement of the viscous dissipation rate of turbulent kinetic energy (TKE) in the oceanic boundary layer (OBL) is proposed, based on insights gained from rapid-distortion theory (RDT). In this mechanism, which complements mechanisms purely based on wave breaking, preexisting TKE is amplified and subsequently dissipated by the joint action of a mean Eulerian wind-induced shear current and the Stokes drift of surface waves, the same elements thought to be responsible for the generation of Langmuir circulations. Assuming that the TKE dissipation rate epsilon saturates to its equilibrium value over a time of the order one eddy turnover time of the turbulence, a new scaling expression, dependent on the turbulent Langmuir number, is derived for epsilon. For reasonable values of the input parameters, the new expression predicts an increase of the dissipation rate near the surface by orders of magnitude compared with usual surface-layer scaling estimates, consistent with available OBL data. These results establish on firmer grounds a suspected connection between two central OBL phenomena: dissipation enhancement and Langmuir circulations.

On the momentum fluxes associated with mountain waves in directionally sheared flows

The direct impact of mountain waves on the atmospheric circulation is due to the deposition of wave momentum at critical levels, or levels where the waves break. The first process is treated analytically in this study within the framework of linear theory. The variation of the momentum flux with height is investigated for relatively large shears, extending the authors’ previous calculations of the surface gravity wave drag to the whole atmosphere. A Wentzel–Kramers–Brillouin (WKB) approximation is used to treat inviscid, steady, nonrotating, hydrostatic flow with directional shear over a circular mesoscale mountain, for generic wind profiles. This approximation must be extended to third order to obtain momentum flux expressions that are accurate to second order. Since the momentum flux only varies because of wave filtering by critical levels, the application of contour integration techniques enables it to be expressed in terms of simple 1D integrals. On the other hand, the momentum flux divergence (which corresponds to the force on the atmosphere that must be represented in gravity wave drag parameterizations) is given in closed analytical form. The momentum flux expressions are tested for idealized wind profiles, where they become a function of the Richardson number (Ri). These expressions tend, for high Ri, to results by previous authors, where wind profile effects on the surface drag were neglected and critical levels acted as perfect absorbers. The linear results are compared with linear and nonlinear numerical simulations, showing a considerable improvement upon corresponding results derived for higher Ri.

Dissipation of shear-free turbulence near boundaries

The rapid-distortion model of Hunt & Graham (1978) for the initial distortion of turbulence by a flat boundary is extended to account fully for viscous processes. Two types of boundary are considered: a solid wall and a free surface. The model is shown to be formally valid provided two conditions are satisfied. The first condition is that time is short compared with the decorrelation time of the energy-containing eddies, so that nonlinear processes can be neglected. The second condition is that the viscous layer near the boundary, where tangential motions adjust to the boundary condition, is thin compared with the scales of the smallest eddies. The viscous layer can then be treated using thin-boundary-layer methods. Given these conditions, the distorted turbulence near the boundary is related to the undistorted turbulence, and thence profiles of turbulence dissipation rate near the two types of boundary are calculated and shown to agree extremely well with profiles obtained by Perot & Moin (1993) by direct numerical simulation. The dissipation rates are higher near a solid wall than in the bulk of the flow because the no-slip boundary condition leads to large velocity gradients across the viscous layer. In contrast, the weaker constraint of no stress at a free surface leads to the dissipation rate close to a free surface actually being smaller than in the bulk of the flow. This explains why tangential velocity fluctuations parallel to a free surface are so large. In addition we show that it is the adjustment of the large energy-containing eddies across the viscous layer that controls the dissipation rate, which explains why rapid-distortion theory can give quantitatively accurate values for the dissipation rate. We also find that the dissipation rate obtained from the model evaluated at the time when the model is expected to fail actually yields useful estimates of the dissipation obtained from the direct numerical simulation at times when the nonlinear processes are significant. We conclude that the main role of nonlinear processes is to arrest growth by linear processes of the viscous layer after about one large-eddy turnover time.

Real estate mutual funds: herding, momentum-trading and performance

This study jointly examines herding, momentum trading and performance in real estate mutual funds (REMFs). We do this using trading and performance data for 159 REMFs across the period 1998–2008. In support of the view that Real Estate Investment Trust (REIT) stocks are relatively more transparent, we find that stock herding by REMFs is lower in REIT stocks than other stock. Herding behavior in our data reveals a tendency for managers to sell winners, reflective of the “disposition effect.” We find low overall levels of REMF momentum trading, but further evidence of the disposition effect when momentum trading is segregated into buy–sell dimensions. We test the robustness of our analysis using style analysis, and by reference to the level of fund dividend distribution. Our results for this are consistent with our conjecture about the role of transparency in herding, but they provide no new insights in relation to the momentum-trading dimensions of our analysis. Summarizing what are complex interrelationships, we find that neither herding nor momentum trading are demonstrably superior investment strategies for REMFs.