[FieldTrip] Two-way permutation test

[Maris, E.G.G. (Eric)]

Hi Matthias & David,

You can find a brief explanation on the topic of permutation based interaction effect testing here: http://www.fieldtriptoolbox.org/faq/how_can_i_test_an_interaction_effect_using_cluster-based_permutation_tests

It also give pointers to how to implement it in Fieldtrip, which you should be familiar with. (For David: Matthias is a student in our Master CNS program, and I pointed him to the FT discussion list. Btw the list has an archive that contains many discussions of the interaction effect issue.)

best,
Eric Maris



From: David Groppe <david.m.groppe at gmail.com<mailto:david.m.groppe at gmail.com>>
Subject: Re: [FieldTrip] Two-way permutation test
Date: 28 Aug 2015 17:08:55 CEST
To: FieldTrip discussion list <fieldtrip at science.ru.nl<mailto:fieldtrip at science.ru.nl>>
Reply-To: FieldTrip discussion list <fieldtrip at science.ru.nl<mailto:fieldtrip at science.ru.nl>>


Hi Matthias,
   If I understand you correctly, you can use a t-score based permutation test to solve your problem. This procedure can test for an effect of factor A, factor B, and their interaction as described here:

http://openwetware.org/wiki/Mass_Univariate_ERP_Toolbox:_within-subject_t-tests

   cheers,
       -David


On Fri, Aug 28, 2015 at 9:31 AM, Fritsche, M. (Matthias) <m.fritsche at student.ru.nl<mailto:m.fritsche at student.ru.nl>> wrote:
Dear Fieldtrip mailing list,

my name is Matthias Fritsche and I'm a research intern in Floris de Lange's 'Prediction & Attention' group at the Donders Center for Cognitive Neuroimaging. I'm currently working on my Master's project and have got a question I hope you might be able to help me with.

I'm currently at the data analysis stage of a behavioral experiment and wondered whether there is a possibility to conduct a two-way permutation test (ANOVA-style, but without actually using ANOVAs/F-values).

My experiment has two independent variables, let’s call them A and B, and one dependent variable. Every participant was tested in all of the four conditions, A1B1, A2B1, A1B2 and A2B2. The dependent variable is a parameter of a model that is fit to the data. However, due to unstable fitting at the subject level, I can only obtain this parameter from the group-averaged data.

When only interested in effects between two specific conditions, e.g. A1B1 vs A2B1, the test is straightforward. In order to create the null distribution, I randomly swap the condition labels, A1B1 and A2B1, for each participant and compute the resulting group test statistic (difference of the dependent variable between A1B1 and A2B1) for that permutation. One option would be to test the difference between every two conditions in this way.

However, I wondered whether there is also a way to use a permutation test similar to a 2-way ANOVA, i.e. testing the main effects of factor A and factor B, as well as the interaction effect. For that purpose, there seem to be permutation tests that use ANOVAs to generate permutation distributions of F-values. However, I cannot use ANOVAs since I only have the dependent variable for the whole group and not for individual participants. Do you know of any method to solve this?

Thanks for your help.

Best,
Matthias

_______________________________________________
fieldtrip mailing list
fieldtrip at donders.ru.nl<mailto:fieldtrip at donders.ru.nl>
http://mailman.science.ru.nl/mailman/listinfo/fieldtrip



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.science.ru.nl/pipermail/fieldtrip/attachments/20150829/622fa037/attachment.html>