<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Hi Christine,
<div class=""><br class="">
</div>
<div class="">I don’t have the answer to your specific question, but I want to raise a few points:</div>
<div class=""><br class="">
</div>
<div class="">Although the permutation framework as implemented in FT outputs 1 p-value per cluster (for a two-sided test, both for the ‘negative’ and for the ‘positive’ clusters), Only the smallest p-value counts for the statistical inference. This is because
your inferential procedure is about making a binary decision, you either reject or accept your null-hypothesis.</div>
<div class=""><br class="">
</div>
<div class="">Also, note that in the permutation framework, without explicit adjustment, the p-values that come out reflect one-sided p-values. For a valid inference, you need to Bonferroni correct these (i.e. multiply them by 2), or adjust the critical alpha
level. </div>
<div class=""><br class="">
</div>
<div class="">This being said, I would say that what you want to achieve (i.e. doing post-hoc tests) does not need to be done within the cluster-based framework. The clusters are just byproducts of your inferential procedure.</div>
<div class=""><br class="">
</div>
<div class="">Some general background on how to deal with the output of the tests can be found on: </div>
<div class=""><br class="">
</div>
<div class=""><a href="http://www.fieldtriptoolbox.org/faq/how_not_to_interpret_results_from_a_cluster-based_permutation_test" class="">http://www.fieldtriptoolbox.org/faq/how_not_to_interpret_results_from_a_cluster-based_permutation_test</a></div>
<div class=""><br class="">
</div>
<div class="">In your specific case, where as a first step you have evaluated the interaction as a difference of differences, I would think it’s fine to use this result to justify a selection of channel + time points, across which you average the condition
specific ERP, and which you subject to your post hoc tests.</div>
<div class=""><br class="">
</div>
<div class="">Best,</div>
<div class="">Jan-Mathijs</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
<div>
<blockquote type="cite" class="">
<div class="">On 30 Nov 2016, at 09:57, Blume Christine <<a href="mailto:christine.blume@sbg.ac.at" class="">christine.blume@sbg.ac.at</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div class="WordSection1" style="page: WordSection1; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;">
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">Maybe an example will stimulate some discussion ;-).<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">I test an interaction among two factors with two levels each with regard to the ERPs elicited by each stimulus.<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">Let’s say we present two stimuli (house vs. face) in colour (black/white vs. colour). The interaction is significant and we want to know which factor levels differ using post hoc tests using the following
cfg.<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg = [];</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.latency = [0 1];</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.method =<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(160, 32, 240);" class="">'montecarlo'</span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.statistic =<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(160, 32, 240);" class="">'ft_statfun_depsamplesT'</span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.correctm =<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(160, 32, 240);" class="">'cluster'</span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.clusteralpha = 0.05;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.clusterstatistic =<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(160, 32, 240);" class="">'maxsum'</span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.minnbchan = 2;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.tail = 0;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.clustertail = 0;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.alpha = 0.025;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.numrandomization = 1000;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg_neighb.method =<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(160, 32, 240);" class="">'distance'</span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.neighbours = ft_prepare_neighbours(cfg_neighb, data_sample);</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.design = design;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.ivar = 2;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.uvar = 1;</span><span style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">What we get is the following.<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_COLOURvsFACE_BW = ft_timelockstatistics(cfg, grandavg_erp.FACE_COLOUR, grandavg_erp.FACE_BW);</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_COLOURvsFACE_BW.posclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%
18 clusters, p > 0.4076</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_COLOURvsFACE_BW.negclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%
12 clusters, p > 0.2957</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_COLOURvsHOUSE_COLOUR = ft_timelockstatistics(cfg, grandavg_erp.FACE_COLOUR, grandavg_erp.HOUSE_COLOUR);</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_COLOURvsHOUSE_COLOUR.posclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%
10 clusters, p > 0.4326</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_COLOURvsHOUSE_COLOUR.negclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%
12 clusters, p = 0.0599; p > 0.8631</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_COLOURvsHOUSE_BW = ft_timelockstatistics(cfg, grandavg_erp.FACE_COLOUR, grandavg_erp.HOUSE_BW);</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_COLOURvsHOUSE_BW.posclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%<span class="Apple-converted-space"> </span><b class="">16
clusters, p = 0.0360</b>, p > 0.7742</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_COLOURvsHOUSE_BW.negclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%<span class="Apple-converted-space"> </span><b class="">13
clusters, p = 0.0300</b>, p > 0.5105</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.HOUSE_COLOURvsFACE_BW = ft_timelockstatistics(cfg, grandavg_erp.HOUSE_COLOUR, grandavg_erp.FACE_BW);</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.HOUSE_COLOURvsFACE_BW.posclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%
16 clusters, p > 0.2697</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.HOUSE_COLOURvsFACE_BW.negclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%<span class="Apple-converted-space"> </span><b class="">11
clusters, p = 0.0090</b>, p > .0.9291</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.HOUSE_COLOURvsHOUSE_BW = ft_timelockstatistics(cfg, grandavg_erp.HOUSE_COLOUR, grandavg_erp.HOUSE_BW);</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.HOUSE_COLOURvsHOUSE_BW.posclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%<span class="Apple-converted-space"> </span><b class="">19
clusters, p = 0.0020</b>, p = 0.0979, p > 0.2468</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.HOUSE_COLOURvsHOUSE_BW.negclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%<span class="Apple-converted-space"> </span><b class="">13
clusters, p = 0.0480</b>, p = 0.0699, p > 0.3606</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_BWvsHOUSE_BW = ft_timelockstatistics(cfg, grandavg_erp.FACE_COLOUR, grandavg_erp.HOUSE_BW);</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_BWvsHOUSE_BW.posclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%<span class="Apple-converted-space"> </span><b class="">16
clusters, p = 0.0410</b>, p > 0.7732</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">stat_erp.FACE_BWvsHOUSE_BW.negclusters.prob<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(34, 139, 34);" class="">%<span class="Apple-converted-space"> </span><b class="">13
clusters, p = 0.0320</b>, p > 0.4725</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">Now the question is: how do we correct for these 6 follow-up tests? If we say we want to use the Bonferroni-Holm correction for example, we have to sort p-values according to size. However, we have
two p-values per test, one for positive and one for negative clusters and Bonferroni-Holm assumes we only have one per test.<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">Any ideas or suggestions how to best handle this?<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">Best,<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">Christine<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div class="">
<div style="border-style: solid none none; border-top-color: rgb(181, 196, 223); border-top-width: 1pt; padding: 3pt 0cm 0cm;" class="">
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<b class=""><span lang="DE" style="font-size: 10pt; font-family: Tahoma, sans-serif;" class="">Von:</span></b><span lang="DE" style="font-size: 10pt; font-family: Tahoma, sans-serif;" class=""><span class="Apple-converted-space"> </span>Blume Christine<span class="Apple-converted-space"> </span><br class="">
<b class="">Gesendet:</b><span class="Apple-converted-space"> </span>Montag, 28. November 2016 17:04<br class="">
<b class="">An:</b><span class="Apple-converted-space"> </span>FieldTrip discussion list (<a href="mailto:fieldtrip@science.ru.nl" style="color: purple; text-decoration: underline;" class="">fieldtrip@science.ru.nl</a>)<br class="">
<b class="">Betreff:</b><span class="Apple-converted-space"> </span>AW: [FieldTrip] Cluster-based permutation: Interactions & Alpha adjustment<o:p class=""></o:p></span></div>
</div>
</div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">Sorry, I forgot to mention that I am using<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">cfg.method =<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New'; color: rgb(160, 32, 240);" class="">'montecarlo'</span><span lang="EN-US" style="font-size: 10pt; font-family: 'Courier New';" class="">;</span><span lang="EN-US" style="font-size: 12pt; font-family: 'Courier New';" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">Best,<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class="">Christine<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div>
<div class="">
<div style="border-style: solid none none; border-top-color: rgb(181, 196, 223); border-top-width: 1pt; padding: 3pt 0cm 0cm;" class="">
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<b class=""><span lang="DE" style="font-size: 10pt; font-family: Tahoma, sans-serif;" class="">Von:</span></b><span lang="DE" style="font-size: 10pt; font-family: Tahoma, sans-serif;" class=""><span class="Apple-converted-space"> </span><a href="mailto:fieldtrip-bounces@science.ru.nl" style="color: purple; text-decoration: underline;" class="">fieldtrip-bounces@science.ru.nl</a><span class="Apple-converted-space"> </span>[<a href="mailto:fieldtrip-bounces@science.ru.nl" style="color: purple; text-decoration: underline;" class="">mailto:fieldtrip-bounces@science.ru.nl</a>]<span class="Apple-converted-space"> </span><b class="">Im
Auftrag von<span class="Apple-converted-space"> </span></b>Blume Christine<br class="">
<b class="">Gesendet:</b><span class="Apple-converted-space"> </span>Montag, 28. November 2016 16:46<br class="">
<b class="">An:</b><span class="Apple-converted-space"> </span>FieldTrip discussion list (<a href="mailto:fieldtrip@science.ru.nl" style="color: purple; text-decoration: underline;" class="">fieldtrip@science.ru.nl</a>)<br class="">
<b class="">Betreff:</b><span class="Apple-converted-space"> </span>[FieldTrip] Cluster-based permutation: Interactions & Alpha adjustment<o:p class=""></o:p></span></div>
</div>
</div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" class="">Dear community,<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" class="">I am using the cluster-based permutation test for statistical evaluation of my data. Besides main effects I also test the interaction between them. When following up on a significant interaction with further permutation tests I feel
I should correct my alpha level for multiple comparisons. Is that correct?<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" class="">Best,<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" class="">Christine<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-GB" style="font-size: 9pt;" class="">---------------------------------------------------------------------------------<br class="">
Dipl.-Psych. Christine Blume</span><span lang="EN-US" style="font-size: 9pt;" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" style="font-size: 9pt;" class="">University of Salzburg<br class="">
Department of Psychology<br class="">
Centre for Cognitive Neuroscience (CCNS)<br class="">
Laboratory for Sleep, Cognition and Consciousness Research<br class="">
Hellbrunner Str. 34<br class="">
A-5020 Salzburg</span><span lang="EN-GB" style="font-size: 9pt;" class=""><br class="">
Email:<span class="Apple-converted-space"> </span></span><span lang="EN-US" style="font-size: 9pt; color: blue;" class=""><a href="mailto:christine.blume@sbg.ac.at" style="color: purple; text-decoration: underline;" class=""><span lang="EN-GB" class="">christine.blume@sbg.ac.at</span></a></span><span lang="EN-US" style="font-size: 9pt;" class=""><br class="">
T: +43 (0) 662 – 8044 5146</span><span lang="EN-US" style="font-size: 10pt;" class=""><br class="">
</span><span lang="EN-US" style="font-size: 9pt; color: blue;" class=""><a href="http://www.sleepscience.at/" style="color: purple; text-decoration: underline;" class="">www.sleepscience.at</a></span><span lang="EN-US" style="font-size: 9pt; font-family: Tahoma, sans-serif;" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span lang="EN-US" class=""><o:p class=""> </o:p></span></div>
</div>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">_______________________________________________</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">fieldtrip
mailing list</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<a href="mailto:fieldtrip@donders.ru.nl" style="color: purple; text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">fieldtrip@donders.ru.nl</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<a href="https://mailman.science.ru.nl/mailman/listinfo/fieldtrip" style="color: purple; text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">https://mailman.science.ru.nl/mailman/listinfo/fieldtrip</a></div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>