<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link="#0563C1" vlink="#954F72"><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>Hi all,<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>I am not expert in edf data, but it is indeed true that some dataformats allow for reading in single channels, while others do not, and some dataformats allow for reading in only specific time points while others do not. While the FT-end-user may specify these things always, independently of the data format, ‘behind the curtain’ FT may need to read in all data and/or channels and then throw away what the user did NOT ask for. So, while specifying only a second of data for the ft_ high level function, it might be that the specific low-level reading function (mostly written by the manufacturer) does return ALL samples anyways. Same might happen for the channel dimension. <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>Most dataformats allow for at least either the one or the other, few for both and few for none. So, if specifying shorter trial lengths does not work, it might be well worth to specify only a single channel (as Anja suggested). But again, I do not know the specifics of edf. I justed wanted to add that to the discussion for educational purposes.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>Best of luck ;)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>Jörn<o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span style='font-size:9.0pt;font-family:"Verdana",sans-serif;color:#1F497D;mso-fareast-language:NL'>--</span></b><b><span style='font-size:9.0pt;font-family:"Verdana",sans-serif;color:#255A9E;mso-fareast-language:NL'><br>Jörn M. Horschig, PhD</span></b><span style='font-size:9.0pt;font-family:"Verdana",sans-serif;color:#626264;mso-fareast-language:NL'>, Software Engineer<br><a href="http://www.artinis.com/" target="_blank"><span style='color:#626264'>Artinis Medical Systems</span></a> | +31 481 350 980 </span><b><span style='font-size:9.0pt;font-family:"Verdana",sans-serif;color:#255A9E;mso-fareast-language:NL'><o:p></o:p></span></b></p></div><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'> fieldtrip-bounces@science.ru.nl [mailto:fieldtrip-bounces@science.ru.nl] <b>On Behalf Of </b>Anja Pflug<br><b>Sent:</b> Friday, December 18, 2015 14:07<br><b>To:</b> fieldtrip@science.ru.nl<br><b>Subject:</b> [FieldTrip] Importing large edf data<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p>Hello Leila,<o:p></o:p></p><p>have you tried to import only one of your 51 channels?<o:p></o:p></p><p>If this works you could cut the data or downsample it and then combine all channels in a later step.<o:p></o:p></p><p>Best,<o:p></o:p></p><p>Anja<o:p></o:p></p><p><o:p> </o:p></p><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><p><a href="mailto:fieldtrip-request@science.ru.nl"><span lang=DE>fieldtrip-request@science.ru.nl</span></a><span lang=DE> hat am 18. </span>Dezember 2015 um 12:00 geschrieben:<br><br><br>Send fieldtrip mailing list submissions to<br><a href="mailto:fieldtrip@science.ru.nl">fieldtrip@science.ru.nl</a><br><br>To subscribe or unsubscribe via the World Wide Web, visit<br><a href="http://mailman.science.ru.nl/mailman/listinfo/fieldtrip">http://mailman.science.ru.nl/mailman/listinfo/fieldtrip</a><br>or, via email, send a message with subject or body 'help' to<br><a href="mailto:fieldtrip-request@science.ru.nl">fieldtrip-request@science.ru.nl</a><br><br>You can reach the person managing the list at<br><a href="mailto:fieldtrip-owner@science.ru.nl">fieldtrip-owner@science.ru.nl</a><br><br>When replying, please edit your Subject line so it is more specific<br>than "Re: Contents of fieldtrip digest..."<br><br><br>Today's Topics:<br><br>1. importing large edf data (Leila Ayoubian)<br><br><br>----------------------------------------------------------------------<br><br>Message: 1<br>Date: Fri, 18 Dec 2015 09:43:43 +0000 (UTC)<br>From: Leila Ayoubian <<a href="mailto:leilayou_54@yahoo.com">leilayou_54@yahoo.com</a>><br>To: "<a href="mailto:fieldtrip@science.ru.nl">fieldtrip@science.ru.nl</a>" <<a href="mailto:fieldtrip@science.ru.nl">fieldtrip@science.ru.nl</a>><br>Subject: [FieldTrip] importing large edf data<br>Message-ID:<br><<a href="mailto:807603762.476165.1450431823359.JavaMail.yahoo@mail.yahoo.com">807603762.476165.1450431823359.JavaMail.yahoo@mail.yahoo.com</a>><br>Content-Type: text/plain; charset="utf-8"<br><br>Hi:Thanks for providing us with this amazing toolbox.<br>I am new to fieldtrip. I am trying to import EEG data in the format of *.edf for the purpose of seizure detection for epileptic patients. I can't break up the data as you understand the detection has to have continuous data. However I could load section of the data at a time and clear what is already used and reload again.?<br>So trying to load the data like this:<br>cfg.dataset= ('mydata.edf');<br>rawdata=ft_preprocessing(cfg);<br>This is the error message I get :<br>%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%<br>Error using zeros<br>Requested 51x51927040 (19.7GB) array exceeds maximum array size preference. Creation of arrays greater than this limit may take a long time<br>and cause MATLAB to become unresponsive. See array size limit or preference panel for more information.<br><br>Error in read_edf (line 403)<br>? dat = zeros(length(chanindx),nepochs*epochlength);<br><br>Error in ft_read_data (line 622)<br>??? dat = read_edf(filename, hdr, begsample, endsample, chanindx);<br><br>Error in ft_preprocessing (line 566)<br>????? dat = ft_read_data(cfg.datafile, 'header', hdr, 'begsample', begsample, 'endsample', endsample, 'chanindx', rawindx, 'checkboundary',<br>????? strcmp(cfg.continuous, 'no'), 'dataformat', cfg.dataformat);<br><br>Error in ReadFedfiles (line 8)<br>rawdata=ft_preprocessing(cfg);%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%<br>I tried the ft_redefinetrial, but since the input to this file is the output from ft-PREPROCESSING it gives me the same error. <br><br><br>I also tried to use ft_read_data to choose the samples I want to load :?filename???? = 'mydata.edf'<br>?hdr?? = ft_read_header(filename);<br>?sample.start=1<br>?sample.end=100<br>dat = ft_read_data(filename,'sample.start','1','sample.end','100') <br>and here is again the error message:<br>Error using zeros<br>Requested 51x51927040 (19.7GB) array exceeds maximum array size preference. Creation of arrays greater than this limit may take a<br>long time and cause MATLAB to become unresponsive. See array size limit or preference panel for more information.<br><br>Error in read_edf (line 403)<br>? dat = zeros(length(chanindx),nepochs*epochlength);<br><br>Error in ft_read_data (line 622)<br>??? dat = read_edf(filename, hdr, begsample, endsample, chanindx);<br><br>Error in ReadFedfiles (line 31)<br>dat = ft_read_data(filename,'sample.start','1','sample.end','100')<br>?<br>>> <br><br>Could you please direct me as to which functions and in which order I should be using the functions to load data in smaller samples.Some examples would be useful.<br>Thanks again for your support and assistance. <br>We appreciate your effort.<br>Kind regards<br><br>___________________________________________________ Dr. Leila Ayoubian <br>-------------- next part --------------<br>An HTML attachment was scrubbed...<br>URL: <<a href="http://mailman.science.ru.nl/pipermail/fieldtrip/attachments/20151218/6dfa7ce1/attachment-0001.html">http://mailman.science.ru.nl/pipermail/fieldtrip/attachments/20151218/6dfa7ce1/attachment-0001.html</a>><br><br>------------------------------<br><br>_______________________________________________<br>fieldtrip mailing list<br><a href="mailto:fieldtrip@donders.ru.nl">fieldtrip@donders.ru.nl</a><br><a href="http://mailman.science.ru.nl/mailman/listinfo/fieldtrip">http://mailman.science.ru.nl/mailman/listinfo/fieldtrip</a><br><br>End of fieldtrip Digest, Vol 61, Issue 14<br>*****************************************<o:p></o:p></p></blockquote></div></body></html>