postdoc positions at ENSAE
Hi,
interested in doing a postdoc with me on anything related to Bayesian Computation? Please let me know, as there is currently a call for postdoc grants at the ENSAE, see below.
Nicolas Chopin
The Labex ECODEC is a research consortium in Economics and Decision Sciences common to three leading French higher education institutions based in the larger Paris area: École polytechnique, ENSAE and HEC Paris. The Labex Ecodec offers:
 Oneyear postdoctoral fellowships for 20172018

Twoyear postdoctoral fellowships for 20172019
The monthly gross salary of postdoctoral fellowships is 3 000 €.
Candidates are invited to contact as soon as possible members of the research group (see below) with whom they intend to work.
Research groups concerned by the call:
Area 1: Secure Careers in a Global Economy
Area 2: Financial Market Failures and Regulation
Area 3: Product Market Regulation and Consumer DecisionMaking
Area 4: Evaluating the Impact of Public Policies and Firms’ Decisions
Area 5: New Challenges for New Data
Details of axis can be found on the website:
Deadlines for application:
31^{st} December 2016
Screening of applications and decisions can be made earlier for srong candidates who need an early decision.
The application should be sent to application@labexecodec.fr in PDF. Please mention the area number on which you apply in the subject.
The application package includes:
 A cover letter with the name of a potential supervisor among the group;
 A research statement;
 A letter from the potential supervisor in support of the project;
 A Curriculum vita (with the address of the candidate, phone and email contact).
 The Ph.D. dissertation or papers/preprint;
 Reference letters, including one from the PhD advisor. A letter from a member of the research group with whom the candidate is willing to interact will be appreciated.
Please note that HEC, Genes, and X PhD students are not eligible to apply for this call.
Selection will be based on excellence and a research project matching the group’s research agenda.
Area 1 “Secure careers in a Global Economy”: Pierre Cahuc (ENSAE), Dominique Rouziès (HEC), Isabelle Méjean (École polytechnique)
Area 2: “Financial Market Failures and Regulation”: François Derrien (HEC), JeanDavid Fermanian, (ENSAE) Edouard Challe (École polytechnique)
Area 3: “DecisionMaking and Market Regulation”: Nicolas Vieille (HEC), Philippe Choné (ENSAE), MarieLaure Allain (École polytechnique)
Area 4: “Evaluating the Impact of Public Policies and Firm’s Decisions”: Bruno Crépon (ENSAE), Yukio Koriyama (École polytechnique), Daniel Halbheer (HEC)
Area 5: “New Challenges for New Data”: Anna Simoni (ENSAE), Gilles Stoltz (HEC)
MathSciNet reviews on Bayesian papers
I recently started to review papers on Mathematical Reviews / MathSciNet a decided I would post the reviews here from time to time. Here are the first three which deal with (i) objective Bayes priors for discrete parameters, (ii) random probability measures and inference on species variety and (iii) Bayesian nonparametric asymptotic theory and contraction rates.
 An objective approach to prior mass functions for discrete parameter spaces, by Villa, C. and Walker, S. G., J. Amer. Statist. Assoc. 110 (2015), no. 511, 1072–1082.
The paper deals with objective prior derivation in the discrete parameter setting. Previous treatment of this problem includes J. O. Berger, J.M. Bernardo and D. Sun [J. Amer. Statist. Assoc. 107 (2012), no. 498, 636–648; MR2980073] who rely on embedding the discrete parameter into a continuous parameter space and then applying reference methodology (J.M. Bernardo [J. Roy. Statist. Soc. Ser. B 41 (1979), no. 2, 113–147; MR0547240]). The main contribution here is to propose an all purpose objective prior based on the Kullback–Leibler (KL) divergence. More specifically, the prior at any parameter value is obtained as follows: (i) compute the minimum KL divergence over between models indexed by and ; (ii) set proportional to a sound transform of the minimum obtained in (i). A good property of the proposed approach is that it is not problem specific. This objective prior is derived in five models (including binomial and hypergeometric) and is compared to the priors known in the literature. The discussion suggests possible extension to the continuous parameter setting.
 A note on nonparametric inference for species variety with Gibbstype priors, by Favaro, Stefano and James, Lancelot F., Electron. J. Stat. 9 (2015), no. 2, 2884–2902.
A. Lijoi, R. H. Mena and I. Prünster [Biometrika 94 (2007), no. 4, 769–786; MR2416792] recently introduced a Bayesian nonparametric methodology for estimating the species variety featured by an additional unobserved sample of size given an initial observed sample. This methodology was further investigated by S. Favaro, Lijoi and Prünster [Biometrics 68 (2012), no. 4, 1188–1196; MR3040025; Ann. Appl. Probab. 23 (2013), no. 5, 1721–1754; MR3114915]. Although it led to explicit posterior distributions under the general framework of Gibbstype priors [A. V. Gnedin and J. W. Pitman (2005), Teor. Predst. Din. Sist. Komb. i Algoritm. Metody. 12, 83–102, 244–245;MR2160320], there are situations of practical interest where is required to be very large and the computational burden for evaluating these posterior distributions makes impossible their concrete implementation. This paper presents a solution to this problem for a large class of Gibbstype priors which encompasses the two parameter PoissonDirichlet prior and, among others, the normalized generalized Gamma prior. The solution relies on the study of the large asymptotic behaviour of the posterior distribution of the number of new species in the additional sample. In particular a simple characterization of the limiting posterior distribution is introduced in terms of a scale mixture with respect to a suitable latent random variable; this characterization, combined with the adaptive rejection sampling, leads to derive a large approximation of any feature of interest from the exact posterior distribution. The results are implemented through a simulation study and the analysis of a dataset in linguistics.
 Rate exact Bayesian adaptation with modified block priors, by Gao, Chao and Zhou, Harrison H., Ann. Statist. 44 (2016), no. 1, 318–345.
A novel prior distribution is proposed for adaptive Bayesian estimation, meaning that the associated posterior distribution contracts to the truth with the exact optimal rate and at the same time is adaptive regardless of the unknown smoothness. The prior is termed \textit{block prior} and is defined on the Fourier coefficients of a curve by independently assigning 0mean Gaussian distributions on blocks of coefficients indexed by some , with covariance matrix proportional to the identity matrix; the proportional coefficient is itself assigned a prior distribution . Under conditions on , it is shown that (i) the prior puts sufficient prior mass near the true signal and (ii) automatically concentrates on its effective dimension. The main result of the paper is a rateoptimal posterior contraction theorem obtained in a general framework for a modified version of a block prior. Compared to the closely related block spike and slab prior proposed by M. Hoffmann, J. Rousseau and J. SchmidtHieber [Ann. Statist. 43 (2015), no. 5, 2259–2295; MR3396985] which only holds for the white noise model, the present result can be applied in a wide range of models. This is illustrated through applications to five mainstream models: density estimation, white noise model, Gaussian sequence model, Gaussian regression and spectral density estimation. The results hold under Sobolev smoothness and their extension to more flexible Besov smoothness is discussed. The paper also provides a discussion on the absence of an extra log term in the posterior contraction rates (thus achieving the exact minimax rate) with a comparison to other priors commonly used in the literature. These include rescaled Gaussian processes [A. W. van der Vaart and H. van Zanten, Electron. J. Stat. 1 (2007), 433–448; MR2357712; Ann. Statist. 37 (2009), no. 5B, 2655–2675; MR2541442] and sieve priors [V. Rivoirard and J. Rousseau, Bayesian Anal. 7 (2012), no. 2, 311–333; MR2934953; J. Arbel, G. Gayraud and J. Rousseau, Scand. J. Stat. 40 (2013), no. 3, 549–570; MR3091697].
Collegio Carlo Alberto
I have spent three years as a postdoc at the Collegio Carlo Alberto. This was a great time during which I have been able to interact with top colleagues and to prepare my applications in optimal conditions. Now that I have left for Inria Grenoble, here is a brief picture presentation of the Collegio. (more…)
Back to blogging
My last post dates back to May 2015… thanks to JB and Julyan for keeping the place busy! I’m not (quite) dead and intend to go back to posting stuff every now and then. And by the way, congrats to both for their new jobs!
Last July, I’ve also started a new job, as an assistant professor in the Department of Statistics at Harvard University, after having spent two years in Oxford. At some point, I might post something on the cultural difference between the European English and American communities of statisticians.
In the coming weeks, I’ll tell you all about a new paper entitled Coupling of Particle Filters, cowritten with Fredrik Lindsten and Thomas B. Schön from Uppsala University in Sweden. We are excited about this coupling idea because it’s simple and yet brings massive gains in many important aspects of inference for state space models (including both parameter inference and smoothing). I’ll be talking about it at the World Congress in Probability and Statistics in Toronto next week and at JSM in Chicago, early in August.
I’ll also try to write about another exciting project, joint work with Christian Robert, Chris Holmes and Lawrence Murray, on modularization, cutting feedback, the infamous cut function of BUGS and all that funny stuff. I’ve talked about it in ISBA 2016, and intend to put the associated tech report on arXiv over the summer.
Stay tuned!
3D density plot in R with Plotly
In Bayesian nonparametrics, many models address the problem of density regression, including covariate dependent processes. These were settled by the pioneering works by [current ISBA president] MacEachern (1999) who introduced the general class of dependent Dirichlet processes. The literature on dependent processes was developed in numerous models, such as nonparametric regression, time series data, metaanalysis, to cite but a few, and applied to a wealth of fields such as, e.g., epidemiology, bioassay problems, genomics, finance. For references, see for instance the chapter by David Dunson in the Bayesian nonparametrics textbook (edited in 2010 by Nils Lid Hjort, Chris Holmes, Peter Müller and Stephen G. Walker). With Kerrie Mengersen and Judith Rousseau, we have proposed a dependent model in the same vein for modeling the influence of fuel spills on species diversity (arxiv).
Several densities can be plotted on the same 3D plot thanks to the Plotly R library, “an interactive, browserbased charting library built on the open source JavaScript graphing library, plotly.js.”
In our ecological example, the model provides a series of densities on the Y axis (in our case, posterior density of species diversity), indexed by some covariate X (a pollutant). See file density_plot.txt. The following Plotly R code
library(plotly) mydata = read.csv("density_plot.txt") df = as.data.frame(mydata) plot_ly(df, x = Y, y = X, z = Z, group = X, type = "scatter3d", mode = "lines")
provides a graph as below. For the interactive version, see the RPubs page here.
Bayesian demography
“For about two centuries, Bayesian demography remained largely dormant. Only in recent decades has there been a revival of demographers’ interest in Bayesian methods, following the methodological and computational developments of Bayesian statistics. The area is currently growing fast, especially with the United Nations (UN) population projections becoming probabilistic—and Bayesian.” Bijak and Bryant (2016)
It is interesting to see that Bayesian statistics have been infiltrating demography in the recent years. The review paper Bayesian demography 250 years after Bayes by Bijak and Bryant (Population Studies, 2016) stresses that promising areas of application include demographic forecasts, problems with limited data, and highly structured and complex models. As an indication of this growing interest, ISBA meeting to be held next June will showcase a course and a session devoted to the field (given and organized by Adrian Raftery).
With Vianney Costemalle from INSEE, we recently modestly contributed to the field by proposing a Bayesian model (paper in French) which helps reconciling apparently inconsistent population datasets. The aim is to estimate annual migration flows to France (note that the work covers the period 20042011 (long publication process) and as a consequence does not take into account recent migration events). We follow the United Nations (UN) definition of a longterm migrant, who is someone who settles in a foreign country for at least one year. At least two datasets can be used to this aim: 1) the population census , annual since 2004, and 2) data from residence permits . (more…)
Workshop on Bayesian Nonparametrics in Turin
On February 19 took place at Collegio Carlo Alberto the second Statalks, a series of Italian workshops aimed at Master students, PhD students, postdocs and young researchers. This edition was dedicated to Bayesian Nonparametrics. The first two presentations were introductory tutorials while the last four focused on theory and applications. All six were clearly biased according to the scientific interests of our group. Below are the program and the slides.
 A gentle introduction to Bayesian Nonparametrics I (Antonio Canale)
 A gentle introduction to Bayesian Nonparametrics II (Julyan Arbel)
 Dependent processes in Bayesian Nonparametrics (Matteo Ruggiero)
 Asymptotics for discrete random measures (Pierpaolo De Blasi)
 Applications to Ecology and Marketing (Antonio Canale)
 Species sampling models (Julyan Arbel)
Champions League eight of finals’ draw: what are the odds?
[This is a guest post by my friend and colleague Bernardo Nipoti from Collegio Carlo Alberto, Juventus Turin.]
The matches of the group stage of the UEFA Champions league have just finished and next Monday, the 14th of December 2015, in Nyon, there will be a round of draws for deciding the eight matches that will compose the first round of the knockout phase.
As explained on the UEFA website, rules are simple:
 two seeding pots have been formed: one consisting of group winners and the other of runnersup;
 no team can play a club from their group or any side from their own association;
 due to a decision by the UEFA Executive Committee, teams from Russia and Ukraine cannot meet.
The two pots are:
Group winners: Real Madrid (ESP), Wolfsburg (GER), Atlético Madrid (ESP), Manchester City (ENG), Barcelona (ESP, holders), Bayern München (GER), Chelsea (ENG), Zenit (RUS);
Group runnersup: Paris SaintGermain (FRA), PSV Eindhoven (NED), Benfica (POR), Juventus (ITA), Roma (ITA), Arsenal (ENG), Dynamo Kyiv (UKR), Gent (BEL).
Giving these few constraints, are there some matches that are more likely to be drawn than others? For example, supporters of Barcelona might wonder whether the seven possible teams (PSG, PSV, Benfica, Juventus, Arsenal, Dynamo Kyiv and Gent) are all equally likely to be the next opponent of their favorite team. (more…)
List of predatory publishers
I have been recently invited to referee a paper for a journal I had never heard of before: the International Journal of Biological Instrumentation, published by VIBGYOR Online Publishers. This publisher happens to be on the blacklist of predatory publishers by Jeffrey Beall which inventory:
Potential, possible, or probable predatory scholarly openaccess publishers.
I have kindly declined the invitation. Thanks Igor for the link.
Julyan
Some thoughts on the life of a mathematician, by Villani
Some time ago, Cédric Villani came to Turin for delivering two talks. One intended for youngsters (high school level say), another one for a wider audience, as a recipient of the Peano Prize. He commented on live, in Italian per favore:
“Grazie mille! Un grande piacere e un grande onore per me!”
I attended both. The reason why I attended the first being that I am acting as a research advisor for Math en Jeans groups. Villani spoke about his book, Birth of a Theorem, or Théorème Vivant. He also shared a list of se7en thoughts/tips about doing research, with illustrations. I find them quite inspiring, here they are.
 Documentation/literature
Illustrating this by showing Faà di Bruno’s formula Wikipedia page. I like this quote, since the formula enters moment computation for objects I’m using everyday. And also because Faà di Bruno lived in Italian Piedmont, precisely in Turin.  Motivation
“The most important and the most mysterious.”  Favorable environment
Showing pictures of several places where he worked, including Institut Henri Poincaré. Not sure that this one is the most favorable environment for scientific productivity (as a Director I mean).  Exchanges
Meaning between scientists, not trade. Explaining briefly about polymath projects. And displaying a snapshot of Gowers’s Weblog as an illustration of how diverse exchanges he means. I also believe that blogs are a great information medium🙂  Constraints
With snapshots of Musica Ricercata sheet music. And a paragraph of La disparition, a novel without the letter e by Georges Perec. Writing this makes me realize how foolish such an enterprise would look like in mathematics.  Work & Intuition
Interesting to see these two at the same level.  Perseverance & Luck
Same comment as for point 6.
Julyan
1 comment