A nonparametric Bayesian approach to adaptive sampling of psychometric functions
BMC Neuroscience volume 10, Article number: P353 (2009)
Psychometric functions express the relation between stimuli parameters and responses of subjects. As these functions have to be estimated from experimental data one encounters several difficulties:
2. It is common in the neurosciences that the number of experimental trials is strongly restricted: Data acquisition might be expensive, tested animals or humans might get tired or might learn too quickly, etc.
3. Usually psychometric functions are modeled by function families having only a small number of parameters [1, 2], thus parametric models might imply too strong assumptions about the psychometric function courses.
As an example for the third point, we refer to an ongoing research debate about the time course for early visual processing. For the detection and discrimination impairment of a stimulus by a closely followed second stimulus, two competing models exist (U-shaped vs. monotonically increasing, see ) that had been related to special types of experiments each. Recent experimental results, however, demonstrate severe violations of these experimental assumptions [4, 5], but the question whether any of these two models is appropriate at all remains open. A suitable nonparametric inference might help to find better descriptions of the experimental data and finally to develop new models with only a few parameters.
To overcome the problems above, we consider some recent ideas:
1. Making use of Bayesian techniques for estimating psychometric functions gives much more reliable estimates together with trustworthy confidences .
2. Adopting the nonparametric approach of multi binning for linking stimuli parameters and their responses for estimating peristimulus time histograms of spike trains .
3. Adaptive sampling with respect to maximize the information gain in each sample step should help to exploit a limited number of experimental trials .
By incorporating those ideas, we propose a universal estimation technique that will help to detect novel features in psychometric functions when there is only little prior knowledge about the underlying mechanisms.
Wichmann FA, Hill NJ: The psychometric function: I. Fitting, sampling, and goodness of fit. Percept Psychophys. 2001, 63: 1293-1313.
Wichmann FA, Hill NJ: The psychometric function: II. Bootstrap-based confidence intervals and sampling. Percept Psychophys. 2001, 63: 1314-1329.
Kolers PA: Intensity and contour effects in visual masking. Vision Res. 1962, 2: 277-294. 10.1016/0042-6989(62)90037-8.
Duangudom V, Francis G, Herzog MA: What is the strength of a mask in visual metacontrast masking?. J Vision. 2007, 7: 1-10. 10.1167/7.1.7.
Francis G, Cho YS: Effects of temporal integration masking on the shape of visual backward functions. J Exp Psychol-Hum Percept Perform. 2008, 34: 1116-1128. 10.1037/0096-15184.108.40.2066.
Kuss M, Jakel F, Wichmann FA: Bayesian inference for psychometric functions. J Vision. 2005, 5: 478-492. 10.1167/5.5.8.
Endres D, Oram M, Schindelin J, Földiák P: Bayesian binning beats approximate alternatives: estimating peri-stimulus time histograms. Advances in Neural Information Processing Systems 20. 2008, Cambridge: MIT Press
Tanner TG, Hill NJ, Rasmussen CE, Wichmann FA: Efficient adaptive sampling of the psychometric function by maximizing information gain. Proceedings of the 8th Tübinger Perception Conference. Edited by: Bülthoff HH, Mallot HA, Ulrich R, Wichmann FA. 2005, Knirsch Verlag: Kirchentellisfurt
About this article
Cite this article
Elze, T., Jost, J. & Poppe, S. A nonparametric Bayesian approach to adaptive sampling of psychometric functions. BMC Neurosci 10 (Suppl 1), P353 (2009). https://doi.org/10.1186/1471-2202-10-S1-P353