Description

A common synthetic distribution used to benchmark MCMC methods. For details on this implementation, see Pagani et al. (2022).

Here we use the values:

ParameterValue
Number of "$y$" dimensions, $d$2
Scale factor1.0

Stan implementation

Pair plot

Diagonal entries show estimates of the marginal densities as well as the (0.16, 0.5, 0.84) quantiles (dotted lines). Off-diagonal entries show estimates of the pairwise densities.

Movie linked below (🍿) superimposes 100 iterations of MCMC.

🔍 Full page 🍿 Movie 🔗 Info

Trace plots

🔍 Full page

Moments

parametersmeanstdmcseess_bulkess_tailrhatess_per_sec
x0.1341841.184740.26358417.065920.15361.10053missing
y.11.410821.508320.36749228.529520.06451.0192missing
y.21.42171.505110.36398229.136720.12441.01966missing
💾 CSV

Cumulative traces

For each iteration $i$, shows the running average up to $i$, $\frac{1}{i} \sum_{n = 1}^{i} x_n$.

🔍 Full page

Local communication barrier

When the global communication barrier is large, many chains may be required to obtain tempered restarts.

The local communication barrier can be used to visualize the cause of a high global communication barrier. For example, if there is a sharp peak close to a reference constructed from the prior, it may be useful to switch to a variational approximation.

🔍 Full page 🔗 Info

GCB estimation progress

Estimate of the Global Communication Barrier (GCB) as a function of the adaptation round.

The global communication barrier can be used to set the number of chains. The theoretical framework of Syed et al., 2021 yields that under simplifying assumptions, it is optimal to set the number of chains (the argument n_chains in pigeons()) to roughly 2Λ.

Last round estimate: $1.6962690420739768$

🔍 Full page 🔗 Info

Evidence estimation progress

Estimate of the log normalization (computed using the stepping stone estimator) as a function of the adaptation round.

Last round estimate: $-0.7160471255903893$

🔍 Full page 🔗 Info

Round trips

Number of tempered restarts as a function of the adaptation round.

A tempered restart happens when a sample from the reference percolates to the target. When the reference supports iid sampling, tempered restarts can enable large jumps in the state space.

🔍 Full page 🔗 Info

Swaps plot

🔍 Full page

Pigeons summary

roundn_scansn_tempered_restartsglobal_barrierglobal_barrier_variationallast_round_max_timelast_round_max_allocationstepping_stone
1204.44089e-16missing0.0027288884064.04.44089e-16
2404.44089e-16missing0.00516768131872.01.11022e-16
3806.66134e-16missing0.00996321258752.0-2.22045e-16
41642.22045e-16missing0.0195819511840.02.22045e-16
532124.44089e-16missing0.0398191875536.0-4.44089e-16
66451.64476missing0.1681982.97831e7-0.906407
7128152.03562missing0.2779515.84504e7-0.969437
8256301.91851missing0.5886721.20195e8-0.626089
9512701.81503missing1.144122.36919e8-0.804793
1010241491.69627missing2.254084.69471e8-0.716047
💾 CSV🔗 Info

Pigeons inputs

KeysValues
extended_tracesfalse
checked_round0
extractornothing
recordFunction[Pigeons.traces, Pigeons.round_trip, Pigeons.log_sum_ratio, Pigeons.timing_extrema, Pigeons.allocation_extrema]
multithreadedfalse
show_reporttrue
n_chains10
variationalGaussianReference(Dict{Symbol, Any}(:singleton_variable => [0.13418388775069579, 1.4108210862807629, 1.4217047956360909]), Dict{Symbol, Any}(:singleton_variable => [1.1847353799493323, 1.5083163212247552, 1.5051100895932568]), 5)
explorernothing
n_chains_variational0
targetStanLogPotential(banana_model)
n_rounds10
exec_foldernothing
referencenothing
checkpointfalse
seed1
💾 CSV🔗 Info

Reproducibility

run(`git clone https://github.com/Julia-Tempering/InferenceReport.jl`)
cd("InferenceReport.jl")
run(`git checkout f26f12430f67a2c8c64988c8c8c1d80696a7d7fd`)

using Pkg 
Pkg.activate(".")
Pkg.instantiate()
 

using Pigeons
inputs = Inputs(; target = Pigeons.stan_banana(2), variational = GaussianReference(first_tuning_round = 5), n_rounds = 10, record = [traces; round_trip; record_default()])
 

pt = pigeons(inputs)