<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
Hi David,
<div class=""><br class="">
</div>
<div class="">If you want to be strict about the multiple tests you are performing, you need to Bonferroni correct for the number of tests, not for the number of clusters as such. The clusters are a ‘byproduct’ of the inferential procedure, and are a means
to reduce the number of comparisons per test to 1. Actually, you are right that in 2-sided testing you are performing 2 tests, one for each side (i.e. testing the largest positive and negative cluster in the observed data against their respective randomization
distributions. The interpretation of the p-values associated with the most extreme clusters (i.e. the ones that are associated with the actual inferential decision), depends on the settings of the cfg.correcttail option. See <a href="https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.fieldtriptoolbox.org%2Ffaq%2Fwhy_should_i_use_the_cfg.correcttail_option_when_using_statistics_montecarlo%2F&data=05%7C01%7Cfieldtrip%40science.ru.nl%7Cc44000c71e984799a1bc08dbd39e426b%7C084578d9400d4a5aa7c7e76ca47af400%7C1%7C0%7C638336448940467345%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Tkk%2BWcEZeYNlJ2R3mx5262sL94GJ2CfPEmX2UN8YHG8%3D&reserved=0" originalsrc="https://www.fieldtriptoolbox.org/faq/why_should_i_use_the_cfg.correcttail_option_when_using_statistics_montecarlo/" shash="ezbag4aWIth7vGvndZ9DfKM37DNi4bqgll4akCM7kS2B9XYELeGflTbfhNxcemAtYyfm8QWfTyiXGjye5+jTXzIPRA6uqpQvcpKGEA5hZyzfAsuAM/4zOOdScgIyMgu39NORky6mg6AJdC60nYG5bjbO/i2y8COQsHmXaRJNAgs=" class="">https://www.fieldtriptoolbox.org/faq/why_should_i_use_the_cfg.correcttail_option_when_using_statistics_montecarlo/</a> for
more information.</div>
<div class=""><br class="">
</div>
<div class="">I hope this helps,</div>
<div class="">Jan-Mathijs</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
<div>
<blockquote type="cite" class="">
<div class="">On 17 Oct 2023, at 19:47, David Prete via fieldtrip <<a href="mailto:fieldtrip@science.ru.nl" class="">fieldtrip@science.ru.nl</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div class="">Hello Everyone, <br class="">
<br class="">
I asked this question last week, but it didn't show up in my Fieldtrip<br class="">
emails so I'm trying to send this again to see if it works this time.<br class="">
Sorry if you're seeing this twice.<br class="">
<br class="">
I have run multiple cluster-based permutation analyses and I am<br class="">
wondering if I need to correct for multiple comparisons and how<br class="">
exactly would I do that? I know there was a previous thread that<br class="">
suggested using Bonferroni correction but not how to apply the<br class="">
correction. If I run the cluster analysis 9 times in total based on<br class="">
different time windows and comparing different conditions, would I<br class="">
divide 0.05 by 9 to get a corrected p-value of 0.00556? Or do I need<br class="">
to correct based on the total number of clusters found from the 9<br class="">
times I ran the analysis? So, for example let's say each time I ran<br class="">
the analysis I found a positive and negative cluster leading to 18<br class="">
different p-values, would the correction be 0.05 divided by 18?<br class="">
<br class="">
Thank you,<br class="">
David Prete (he/him)<br class="">
Ph.D. Candidate<br class="">
McMaster University<br class="">
<br class="">
<br class="">
_______________________________________________<br class="">
fieldtrip mailing list<br class="">
<a href="https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailman.science.ru.nl%2Fmailman%2Flistinfo%2Ffieldtrip&data=05%7C01%7Cfieldtrip%40science.ru.nl%7Cc44000c71e984799a1bc08dbd39e426b%7C084578d9400d4a5aa7c7e76ca47af400%7C1%7C0%7C638336448940467345%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5qvQIDcHAiqOH7MiDksSfdJOnZc5yiTSQemrHWeP0z0%3D&reserved=0" originalsrc="https://mailman.science.ru.nl/mailman/listinfo/fieldtrip" shash="TgW7MBl9HJrSdqQgJfSMpyH4uw4rOCM2iw9gPSc6fi8WCN43BC3gYZdiH4T9PLISR+NPrMIsF6lzAdVvWy8OBprHN8QZ4giCcN5YRzPwT5XZVTSwWDDllceoZ0kDd9q6BEcL/eChB6L+DAKYw6nJDM/LtFN0O8GxFivsby3XSHg=" class="">https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailman.science.ru.nl%2Fmailman%2Flistinfo%2Ffieldtrip&data=05%7C01%7Cjanmathijs.schoffelen%40donders.ru.nl%7Cc6ac3241c5e3439f7d7808dbcf3c5540%7C084578d9400d4a5aa7c7e76ca47af400%7C1%7C0%7C638331630260706725%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=THIhFBgc6VtNF%2BxCVK5gPFo4dd1oG%2FF2UvjsFP6Zg1o%3D&reserved=0</a><br class="">
https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdoi.org%2F10.1371%2Fjournal.pcbi.1002202&data=05%7C01%7Cjanmathijs.schoffelen%40donders.ru.nl%7Cc6ac3241c5e3439f7d7808dbcf3c5540%7C084578d9400d4a5aa7c7e76ca47af400%7C1%7C0%7C638331630260706725%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=cZJOHWv%2FQPqbZQoQV0sSlryklBJOZpjggCL24PpGjLs%3D&reserved=0<br class="">
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>