Reinforcement learning in dendritic structures

The discovery of binary dendritic events such as local NMDA spikes in dendritic subbranches led to the suggestion that dendritic trees could be computationally equivalent to a 2-layer network of point neurons, with a single output unit represented by the soma, and input units represented by the dendritic branches. Although this interpretation endows a neuron with a high computational power, it is functionally not clear why nature would have preferred the dendritic solution with a single but complex neuron, as opposed to the network solution with many but simple units. We show that the dendritic solution has a distinguished advantage over the network solution when considering different learning tasks. Its key property is that the dendritic branches receive an immediate feedback from the somatic output spike, while in the corresponding network architecture the feedback would require additional backpropagating connections to the input units. Assuming a reinforcement learning scenario we formally derive a learning rule for the synaptic contacts on the individual dendritic trees which depends on the presynaptic activity, the local NMDA spikes, the somatic action potential, and a delayed reinforcement signal. We test the model for two scenarios: the learning of binary classifications and of precise spike timings. We show that the immediate feedback represented by the backpropagating action potential supplies the individual dendritic branches with enough information to efficiently adapt their synapses and to speed up the learning process.

Reinforcement learning in dendritic structures

The discovery of binary dendritic events such as local NMDA spikes in dendritic subbranches led to the suggestion that dendritic trees could be computationally equivalent to a 2-layer network of point neurons, with a single output unit represented by the soma, and input units represented by the dendritic branches. Although this interpretation endows a neuron with a high computational power, it is functionally not clear why nature would have preferred the dendritic solution with a single but complex neuron, as opposed to the network solution with many but simple units. We show that the dendritic solution has a distinguished advantage over the network solution when considering different learning tasks. Its key property is that the dendritic branches receive an immediate feedback from the somatic output spike, while in the corresponding network architecture the feedback would require additional backpropagating connections to the input units. Assuming a reinforcement learning scenario we formally derive a learning rule for the synaptic contacts on the individual dendritic trees which depends on the presynaptic activity, the local NMDA spikes, the somatic action potential, and a delayed reinforcement signal. We test the model for two scenarios: the learning of binary classifications and of precise spike timings. We show that the immediate feedback represented by the backpropagating action potential supplies the individual dendritic branches with enough information to efficiently adapt their synapses and to speed up the learning process.

Behaviour of general dental practitioners in Germany regarding posterior restorations with flowable composites

Because the recommendation to use flowables for posterior restorations is still a matter of debate, the objective of this study was to determine in a nationwide survey in Germany how frequently, for what indications, and for what reasons, German dentists use flowable composites in posterior teeth. In addition, the acceptance of a simplified filling technique for posterior restorations using a low stress flowable composite was evaluated. Completed questionnaires from all over Germany were returned by 1,449 dentists resulting in a response rate of 48.5%; 78.6% of whom regularly used flowable composites for posterior restorations. The most frequent indications were cavity lining (80.1%) and small Class I fillings (74.2%). Flowables were less frequently used for small Class II fillings (22.7%) or other indications (13.6%). Most frequent reasons given for the use of flowables in posterior teeth were the prevention of voids (71.7%) and superior adaptation to cavity walls (72.9%), whereas saving time was considered less important (13.8%). Based on the subjective opinion of the dentists the simplified filling technique seemed to deliver advantages compared to the methods used to date particularly with regard to good cavity adaptation and ease of use. In conclusion, resin composites are the standard material type used for posterior restorations by general dental practitioners in Germany and most dentists use flowable composites as liners.

Depth of cure of resin composites: is the ISO 4049 method suitable for bulk fill materials?

To evaluate if depth of cure D(ISO) determined by the ISO 4049 method is accurately reflected with bulk fill materials when compared to depth of cure D(new) determined by Vickers microhardness profiles.

Biomaterials for Intervertebral Disc Regeneration

The intervertebral disc (IVD) is a complex avascular organ of viscoelastic properties. The current research focus is to regenerate and to partially restore a degenerated IVD by ‘smart’ biomaterials in combination of cell therapy and/or growth factors. For the two tissues of the IVD, that is, the nucleus pulposus (NP) and the annulus fibrosus (AF), biomaterials of different mechanical properties are needed. The ideal biomaterial to restore the water-rich NP and the tensile-force resistant AF has not been identified yet. The lack of blood vessels and the relative scarcity of specially adapted cells of the IVD organ demand novel concepts of tissue-engineered biological approaches to regenerate or replace the IVD. Injectable biodegradable hydrogels with swelling properties are in focus for NP replacement, whereas electrospun biphasic composites and silk, among other biodegradable polymers, are discussed for AF reinforcement.

Gradient estimation in dendritic reinforcement learning

We study synaptic plasticity in a complex neuronal cell model where NMDA-spikes can arise in certain dendritic zones. In the context of reinforcement learning, two kinds of plasticity rules are derived, zone reinforcement (ZR) and cell reinforcement (CR), which both optimize the expected reward by stochastic gradient ascent. For ZR, the synaptic plasticity response to the external reward signal is modulated exclusively by quantities which are local to the NMDA-spike initiation zone in which the synapse is situated. CR, in addition, uses nonlocal feedback from the soma of the cell, provided by mechanisms such as the backpropagating action potential. Simulation results show that, compared to ZR, the use of nonlocal feedback in CR can drastically enhance learning performance. We suggest that the availability of nonlocal feedback for learning is a key advantage of complex neurons over networks of simple point neurons, which have previously been found to be largely equivalent with regard to computational capability.

Microhardness and marginal adaptation of pre-warmed composites

Objectives: The aim of this study was to examine the effect of pre-warmed composite on the microhardness and marginal adaptation. Methods: Ninety six identical class II cavities were prepared in extracted human molars and filled/cured in three 2 mm increments using a metal matrix. Two composites (Tetric Evo Ceram (IvoclarVivadent) and ELS(Saremco)) were cured with a LED curing unit (Bluephase (IvoclarVivadent)) using curing cycles of 20 and 40 seconds. The composite was used at room temperature or pre-warmed at 54.5ºC (Calset(AdDent)). Twelve teeth were filled for every composite-curing time-composite temperature combination. The teeth were thermocycled (1000 cycles at 5º and 55ºC) and then stored at 37° C for seven days . Dye penetration (basic fuchsine 5% for 8 hours) was measured using a score scale. Knoop microhardness was determined 100, 200, 500, 1000, 1500, 2500, 3500, 4500 and 5500µm from the occlusal surface at a distance of 150 and 1000µm from the metal matrix. The total degree of polymerization of a composite specimen was determined by calculating the area under the hardness curve. Results: Statistical analyses showed no difference in marginal adaptation (p>0.05). Hardness values at 150µm from the matrix were lower than those at 1000µm. There was an increase of the microhardness at the top of each increment and decrease towards the bottom of each increment. Longer curing times resulted in harder composite samples. Multiple linear regression showed that only the curing time (p<0.001) and composite material (p<0.001) had a significant association with the degree of polymerization. The degree of polymerization was not influenced by pre-warming the composite at a temperature of 54.5ºC (p=4.86). Conclusion: Polymerization time can not be reduced by pre-warming the composite on a temperature of 54.5ºC. The marginal adaptation is not compromised by pre-warming the composite.

Minimum ten year results of total hip arthroplasty with the acetabular reinforcement ring in avascular osteonecrosis

Total hip arthroplasty (THA) still carries a higher failure rate in patients with avascular necrosis of the femoral head (AVN) than in a similar patient population with THA for other reasons. This is particularly true for the acetabular component. One of the major factors accounting for this is the compromised acetabular bone quality with structural defects subsequent to collapsing of the femoral head in high-grade AVN. In this study we implanted an acetabular reinforcement ring with hook (ARRH), which had been used successfully for other indications with acetabular bone stock deficiency, in 32 consecutive THA's in 29 patients with AVN. Five patients died during the observation period of causes unrelated to the surgery, one patient was lost to follow-up and one patient could not be followed up due to chronic illness, leaving 25 hips (23 patients) with a minimum follow-up of ten years (mean: 11.8; range: 10-15). The mean Merle d'Aubigne score increased significantly from 7.7 preoperatively to 16.6 postoperatively (p < 0.001). One revision was performed for aseptic stem loosening. Of the unrevised hips, one acetabular component was classified as definitively loose. The cumulative 12-year survivorship for THA with ARRH in AVN was 95.2% (confidence interval: 86.1-100%) for both components, 100% for the cup and 95.2% for the stem (86.1-100%).